4 Configure kobold cpp
Rickard Edén edited this page 2024-11-04 21:16:01 +01:00
  1. Start kobold cpp with the model you would like to run.
  2. Open llm_config.yaml and change the following fields:
  • URL: "http://localhost:5001" or wherever your server runs (this is default kobold cpp)
  • ENDPOINT: "/api/v1/generate"
  • BACKEND: "kobold_cpp"

If you use a password to secure your api, you can define it in the config with:

API_PASSWORD: "your_password"

If you want to change any generation settings, the game will use DEFAULT_BODY (and sometimes, still, GENERATION_BODY)