Could somebody guide me how to fine-tune with fill-in-middle task based on StarCoderBase? #146

Open
opened 2023-11-22 21:34:24 -05:00 by FlyingPiggyKing · 1 comment
FlyingPiggyKing commented 2023-11-22 21:34:24 -05:00 (Migrated from github.com)

As titled, I have thoudsands of SQL files, I wish to fine tune the base model with these sqls to achieve FIM task.

As titled, I have thoudsands of SQL files, I wish to fine tune the base model with these sqls to achieve FIM task.
loubnabnl commented 2024-02-10 20:08:30 -05:00 (Migrated from github.com)

You can check this repository which supports fine-tuning with FIM https://github.com/loubnabnl/santacoder-finetuning

You can check this repository which supports fine-tuning with FIM https://github.com/loubnabnl/santacoder-finetuning
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
bigcode-project/starcoder#146
No description provided.