CUDA error 35 at /home/runner/work/ctransformers/ctransformers/models/ggml/ggml-cuda.cu:5067: CUDA driver version is insufficient for CUDA runtime version #139
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
What cuda drivers are needed?
I'm able to run llama-cpp-pyhon and llama.cpp just fine, but not this tool
Ubuntu 22
Cuda 11.7
driver is 515.43.04
note
works in 12.2
but not 11.7/11.8 :/
too bad soo sad for my 4GB VRAM cards
@thistleknot - Here is a fix that worked for me: https://github.com/marella/ctransformers/issues/90#issuecomment-1734127938
Thank you
I got llama.cpp to work on one card that Max's out on compute 5.2 by
setting the compute capability explicitly in the makelist file. I presume
this is similar. However I have yet to test similar changes on this. Will
try sometime this week hopefully
On Mon, Sep 25, 2023, 9:59 AM Sujeendran Menon @.***>
wrote:
i also got this error but following commands worked for me.
#Install CUDA libraries using:
pip install ctransformers[cuda]
run above command and run your project code.