marella/ctransformers
1
0
Fork 0
Code Issues 107 Pull requests 5 Projects Releases 30 Packages Wiki Activity Actions

IBM Granite models support? #214

New issue
Open
opened 2025-01-10 02:08:43 -05:00 by 0wwafa · 0 comments
0wwafa commented 2025-01-10 02:08:43 -05:00 (Migrated from github.com)
Copy link
from ctransformers import AutoModelForCausalLM

llm = AutoModelForCausalLM.from_pretrained("ibm-granite/granite-3.1-2b-instruct", model_type="gpt2")

print(llm("Tell me the difference between thinking in humans and in LLMs."))

the above doesn't work. how can I use it?

``` from ctransformers import AutoModelForCausalLM llm = AutoModelForCausalLM.from_pretrained("ibm-granite/granite-3.1-2b-instruct", model_type="gpt2") print(llm("Tell me the difference between thinking in humans and in LLMs.")) ``` the above doesn't work. how can I use it?
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
guidance
debug
v0.2.27
v0.2.26
v0.2.25
v0.2.24
v0.2.23
v0.2.22
v0.2.21
v0.2.20
v0.2.19
v0.2.18
v0.2.17
v0.2.16
v0.2.15
v0.2.14
v0.2.13
v0.2.12
v0.2.11
v0.2.10
v0.2.9
v0.2.8
v0.2.7
v0.2.5
v0.2.4
v0.2.3
v0.2.2
v0.2.1
v0.2.0
v0.1.2
v0.1.1
v0.1.0
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
marella/ctransformers#214
No description provided.