bigcode-project/starcoder
1
0
Fork 0
Code Issues 93 Pull requests 8 Projects Releases Packages Wiki Activity Actions

Question about Improving Code Generation with Promting #153

New issue
Open
opened 2024-03-05 11:05:33 -05:00 by icnahom · 0 comments
icnahom commented 2024-03-05 11:05:33 -05:00 (Migrated from github.com)
Copy link

It shows on the paper (Section E.3) that we can put prompt prefixes with the <filename> token.

My Question is, how do we handle this when the prompt we are making is a Fill-in-middle one?

Should the prompt prefix come before the <fim_prefix> token or after?

Which one is correct, A or B? :

  • A. <filename> data <fim_prefix> content <fim_suffix> content <fim_middle>
  • B. <fim_prefix> <filename> data + content <fim_suffix> content <fim_middle>
It shows on the [paper](https://arxiv.org/html/2305.06161v2) (Section E.3) that we can put prompt prefixes with the `<filename>` token. My Question is, how do we handle this when the prompt we are making is a Fill-in-middle one? Should the prompt prefix come before the `<fim_prefix>` token or after? Which one is correct, A or B? : - A. `<filename>` data `<fim_prefix>` content `<fim_suffix>` content `<fim_middle>` - B. `<fim_prefix>` `<filename>` data + content `<fim_suffix>` content `<fim_middle>`
👍 1
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
loubnabnl-patch-2
lewtun-patch-1
loubnabnl-patch-1
arjunguha-readme
No results found.
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
bigcode-project/starcoder#153
No description provided.