marella/ctransformers
1
0
Fork 0
Code Issues 107 Pull requests 5 Projects Releases 30 Packages Wiki Activity Actions
30 releases 30 tags
  • v0.2.7 3c6f84c074

    0.2.7 Stable

    marella released this 2023-06-11 11:28:31 -04:00 | 90 commits to main since this release

    Changes

    • Add support for StarChat special tokens
    • Add context_length parameter support for MPT
    • Add low-level API to get eos_token_id, vocab_size, context_length
  • v0.2.5 d03d196999

    0.2.5 Stable

    marella released this 2023-06-02 09:18:51 -04:00 | 97 commits to main since this release

    Changes

    • Add local_files_only option
    • Fix utf-8 decode error
  • v0.2.4 a44a8c04a6

    0.2.4 Stable

    marella released this 2023-05-31 15:03:38 -04:00 | 100 commits to main since this release

    Changes

    • Use smallest model file in a Hugging Face Hub model repo if model_file is not specified
  • v0.2.3 42de21b95f

    0.2.3 Stable

    marella released this 2023-05-30 19:10:50 -04:00 | 103 commits to main since this release

    Changes

    • Add cuBLAS support for LLaMA models
    • Simplify installing and building from source
  • v0.2.2 23006cadef

    0.2.2 Stable

    marella released this 2023-05-28 07:59:25 -04:00 | 112 commits to main since this release

    Changes

    • Add low-level API for logits
    • Add embeddings API for LLaMA models
    • Add context_length parameter for LLaMA models
  • v0.2.1 2f503239d2

    0.2.1 Stable

    marella released this 2023-05-25 12:30:44 -04:00 | 117 commits to main since this release

    Changes

    • Fix threads parameter
  • v0.2.0 72ab602381

    0.2.0 Stable

    marella released this 2023-05-20 21:59:18 -04:00 | 121 commits to main since this release

    Changes

    • Add support for LLaMA, MPT models
    • Change repetition_penalty default value from 1.0 to 1.1

    Breaking Changes

    • Update GGML library which has breaking changes to quantization formats. Old models have to be re-quantized.

    Some of the latest quantized models are available here.

  • v0.1.2 357d693cc9

    0.1.2 Stable

    marella released this 2023-05-19 17:43:55 -04:00 | 130 commits to main since this release

    Changes

    • Add stream option
  • v0.1.1 d39c0f4caa

    0.1.1 Stable

    marella released this 2023-05-18 16:22:33 -04:00 | 133 commits to main since this release

    Changes

    • Add stop option
  • v0.1.0 e71fdc716d

    0.1.0 Stable

    marella released this 2023-05-14 19:25:17 -04:00 | 138 commits to main since this release