4
Configure kobold cpp
Rickard Edén edited this page 2024-11-04 21:16:01 +01:00
- Start kobold cpp with the model you would like to run.
- Open
llm_config.yamland change the following fields:
URL: "http://localhost:5001"or wherever your server runs (this is default kobold cpp)ENDPOINT: "/api/v1/generate"BACKEND: "kobold_cpp"
If you use a password to secure your api, you can define it in the config with:
API_PASSWORD: "your_password"
If you want to change any generation settings, the game will use DEFAULT_BODY (and sometimes, still, GENERATION_BODY)