[Howto]: set up the llm studio Meta-Llama-3-8B-Instruct-GGUF model in gpt pilot 0.2 in local system

[DeveBj]

Version

Command-line (Python) version

Operating System

Windows 11

Your question

Hello,

am trying to setup the gpt pilot in my local system where am trying to use the model Meta-Llama-3-8B-Instruct-GGUF installed via llm studio also am running the server, having the below config but am getting the error while am running the python main.py command.

Error-

Error parsing config file config.json: 3 validation errors for Config
openai
Extra inputs are not permitted [type=extra_forbidden, input_value={'api_key': 'your_openai_api_key'}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.7/v/extra_forbidden
lm-studio
Extra inputs are not permitted [type=extra_forbidden, input_value={'base_url': 'http://loca...0, 'read_timeout': 10.0}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.7/v/extra_forbidden
models
Extra inputs are not permitted [type=extra_forbidden, input_value={'Meta-Llama-3-8B-Instruc...-Instruct-Q4_K_M.gguf'}}, input_type=dict]

config.json-

{
"openai": {
"api_key": "your_openai_api_key"
},
"agent": {
"default": {
"provider": "lm-studio",
"model": "Meta-Llama-3-8B-Instruct-GGUF"
}
},
"lm-studio": {
"base_url": "http://localhost:1234/v1/",
"api_key": "your_api_key_here",
"connect_timeout": 60.0,
"read_timeout": 10.0
},
"models": {
"Meta-Llama-3-8B-Instruct-GGUF": {
"model_path": "C:/Users/test/.cache/lm-studio/models/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf"
}
}
}

appreciate any one's help, thanks!