63 releases 78 tags

RSS feed

• v0.31.1 31bb7c3ded

  Compare

  v0.31.1 Llama 3 template Stable

  neph1 released this 2024-06-30 10:43:12 -04:00 | 165 commits to master since this release

  Edit: This is superseeded by v0.35.0

  It's now possible to use Llama 3 and derivatives. There's some extra prompting needed:

  Replace the USER_START and USER_END with this:

  SYSTEM_START: '<|begin_of_text|><|eot_id|><|start_header_id|>system<|end_header_id|>\n\n'
  
  USER_START: '<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n'
  
  USER_END: <|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n'
  
  PROMPT_END: '<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n'
  

  And a few small fixes I noticed

  What's Changed

  • llama3 "template" by @neph1 in https://github.com/neph1/LlamaTale/pull/87

  Full Changelog: https://github.com/neph1/LlamaTale/compare/v0.31.0...v0.31.1