OSError: .......cannot open shared object file: No such file or directory #209
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
I am using the base code as given in HF
from ctransformers import AutoModelForCausalLM
llm = AutoModelForCausalLM.from_pretrained('marella/gpt-2-ggml')
print(llm('AI is going to'))
While this works fine locally on Mac machine, it fails on any of the linux environment (I tried Debian, Ubuntu, Alpine etc. ) using docker.
Here are the errors for each of them
For Apline (FROM python:3.12.1-alpine3.19)
Error is - OSError: Error relocating /usr/local/lib/python3.12/site-packages/ctransformers/lib/basic/libctransformers.so: unsupported relocation type 7
For both Debian, Ubuntu
Error is - OSError: /usr/local/lib/python3.11/site-packages/ctransformers/lib/basic/libctransformers.so: cannot open shared object file: No such file or directory
Even for direct python3.11 images same error comes.
I am trying the latest version
i am facing the same issue, did you find any solution ?
Yes. The issue is because of CPU architecture type for the pulled image. I was using mac and docker by default pull linux image of arm type which is incompatible with ctransformers unless you compile from source (no clear steps). Workaround is you pull the x86/amd image in docker by defining platform parameter in docker file and it will work. BrSaurabhSent from my iPhoneOn 23 Apr 2024, at 8:12 PM, Jashwanth Raj Gowlikar @.***> wrote:
i am facing the same issue, did you find any solution ?
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>
Try. https://github.com/marella/ctransformers/issues/9