marella/ctransformers
1
0
Fork 0
Code Issues 107 Pull requests 5 Projects Releases 30 Packages Wiki Activity Actions

Does ctransformers support ollama models? #204

New issue
Open
opened 2024-02-21 15:50:38 -05:00 by PriyaranjanMarathe · 1 comment
PriyaranjanMarathe commented 2024-02-21 15:50:38 -05:00 (Migrated from github.com)
Copy link

Does ctransformers support ollama models?

How do I specify the model in this code below?

llm = CTransformers(model="***where is the model file for a ollama model?",
model_type="llama",
max_new_tokens=512,
temperature=0.1)

Does ctransformers support ollama models? How do I specify the model in this code below? llm = CTransformers(model="***where is the model file for a ollama model?", model_type="llama", max_new_tokens=512, temperature=0.1)
PriyaranjanMarathe commented 2024-02-21 15:52:24 -05:00 (Migrated from github.com)
Copy link

https://github.com/ollama/ollama/issues/2652

https://github.com/ollama/ollama/issues/2652
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
guidance
debug
v0.2.27
v0.2.26
v0.2.25
v0.2.24
v0.2.23
v0.2.22
v0.2.21
v0.2.20
v0.2.19
v0.2.18
v0.2.17
v0.2.16
v0.2.15
v0.2.14
v0.2.13
v0.2.12
v0.2.11
v0.2.10
v0.2.9
v0.2.8
v0.2.7
v0.2.5
v0.2.4
v0.2.3
v0.2.2
v0.2.1
v0.2.0
v0.1.2
v0.1.1
v0.1.0
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
marella/ctransformers#204
No description provided.