63 releases 78 tags

RSS feed

• v0.21.1 dd7a3bbc66

  Compare

  v0.21.1 Streaming for llama.cpp Stable

  neph1 released this 2024-01-10 14:29:58 -05:00 | 300 commits to master since this release

  What's Changed

  • Update v0.21.1 by @neph1 in https://github.com/neph1/LlamaTale/pull/58

  • Llama.cpp now has streaming for location descriptions, as well.
  • Some io refactoring as part of that.
  • Handling error messages from server (needs some further work, but at least doesn't throw exception now)
  • I'm playing with prompts some, moving much of the context for prompts to 'memory' for kobold. Should it be in 'system' for llama.cpp/openai? I'll try it out.

  Full Changelog: https://github.com/neph1/LlamaTale/compare/v0.21.0...v0.21.1