`AutoModelForCausalLM` is stuck, no error #216

New issue

Open

opened 2025-03-10 10:49:45 -04:00 by victoris93 · 0 comments

victoris93 commented

2025-03-10 10:49:45 -04:00

(Migrated from github.com)

I am trying to run this example code: llm = AutoModelForCausalLM.from_pretrained("marella/gpt-2-ggml")
The model is loaded and then the cell just keeps running without outputting anything. Does anyone know what the problem might be?

Additional info:

Model Name: MacBook Air
Chip: Apple M3
Total Number of Cores: 8 (4 performance and 4 efficiency)
Memory: 24 GB

ctransformers version: 0.2.27

I am trying to run this example code: `llm = AutoModelForCausalLM.from_pretrained("marella/gpt-2-ggml")` The model is loaded and then the cell just keeps running without outputting anything. Does anyone know what the problem might be? Additional info: ``` Model Name: MacBook Air Chip: Apple M3 Total Number of Cores: 8 (4 performance and 4 efficiency) Memory: 24 GB ctransformers version: 0.2.27 ```

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

marella/ctransformers#216

No description provided.

Rows
Columns

AutoModelForCausalLM is stuck, no error #216

`AutoModelForCausalLM` is stuck, no error #216