bigcode-project/starcoder
1
0
Fork 0
Code Issues 93 Pull requests 8 Projects Releases Packages Wiki Activity Actions

FileNotFoundError: [Errno 2] No such file or directory: 'checkpoint-100/model-00001-of-00003.safetensors' #155

New issue
Open
opened 2024-03-14 07:45:02 -04:00 by dshwei · 0 comments
dshwei commented 2024-03-14 07:45:02 -04:00 (Migrated from github.com)
Copy link

when mutil gpu run starcoder in full parameter tuning ,

File "starcoder-git/finetune.py", line 44, in on_save
kwargs["model"].save_pretrained(checkpoint_folder)
File "/miniconda3/envs/sqlcode/lib/python3.9/site-packages/transformers/modeling_utils.py", line 2480, in save_pretrained
os.remove(full_filename)
FileNotFoundError: [Errno 2] No such file or directory: 'checkpoint-100/model-00001-of-00003.safetensors'

this error maybe when mutil pIds process checkpoints in saved directory

when mutil gpu run starcoder in full parameter tuning , File "starcoder-git/finetune.py", line 44, in on_save kwargs["model"].save_pretrained(checkpoint_folder) File "/miniconda3/envs/sqlcode/lib/python3.9/site-packages/transformers/modeling_utils.py", line 2480, in save_pretrained os.remove(full_filename) FileNotFoundError: [Errno 2] No such file or directory: 'checkpoint-100/model-00001-of-00003.safetensors' this error maybe when mutil pIds process checkpoints in saved directory
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
loubnabnl-patch-2
lewtun-patch-1
loubnabnl-patch-1
arjunguha-readme
No results found.
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
bigcode-project/starcoder#155
No description provided.