• v0.2.0 72ab602381

    0.2.0 Stable

    marella released this 2023-05-20 21:59:18 -04:00 | 121 commits to main since this release

    Changes

    • Add support for LLaMA, MPT models
    • Change repetition_penalty default value from 1.0 to 1.1

    Breaking Changes

    • Update GGML library which has breaking changes to quantization formats. Old models have to be re-quantized.

    Some of the latest quantized models are available here.