RuntimeError: CUDA error: CUDA-capable device(s) is/are busy or unavailable CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Comp #159

Open
opened 2024-03-26 12:15:29 -04:00 by NyanNat · 0 comments
NyanNat commented 2024-03-26 12:15:29 -04:00 (Migrated from github.com)

When I tried to load starcoder based on tutorial provided, RuntimeError emerges because of CUDA error, but torch.cuda.is_available() returns True. The gpu that I run this on is provided below, Can anyone help me with this ?
image

When I tried to load starcoder based on tutorial provided, RuntimeError emerges because of CUDA error, but torch.cuda.is_available() returns True. The gpu that I run this on is provided below, Can anyone help me with this ? ![image](https://github.com/bigcode-project/starcoder/assets/87901664/740a81dc-fc4a-43b0-96e3-5bd784ff3fea)
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
bigcode-project/starcoder#159
No description provided.