Generating world content should be done in chunks #104
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Currently during world generation, items, creatures, etc are generated in one go. This produces a long json that might be difficult for the LLM to close correctly, or it might get cut off due to token limits. This produces an error, and the LLM will have to start over, or eventually fail, if it was the last try.
It would be better to generate one per LLM call, instead. And then manually create the array.
Possibly the list of names of previously generated items should be passed, to avoid repetition and induce some randomness in the prompt.
Relevant starting points are
generate_world_creatures
generate_world_items
in https://github.com/neph1/LlamaTale/blob/master/tale/llm/world_building.py
Make sure relevant tests are updated to reflect this change.