Request: Ollama as an LLM backend #94

New issue

Open

opened 2024-10-08 19:35:03 -04:00 by rdamron · 1 comment

rdamron commented

2024-10-08 19:35:03 -04:00

(Migrated from github.com)

I was wondering if adding Ollama as a backend server would be an option. It's a polished wrapper for llama cpp I believe. https://ollama.com

neph1 commented

2024-10-09 02:32:05 -04:00

(Migrated from github.com)

Does it have an open ai compatible api? In that case it should be possible to set up already.

https://github.com/neph1/LlamaTale/wiki/Configure-OpenAI-as-backend

Does it have an open ai compatible api? In that case it should be possible to set up already. https://github.com/neph1/LlamaTale/wiki/Configure-OpenAI-as-backend

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

neph1/LlamaTale#94

No description provided.

Rows
Columns