fix: context_length has no effect #200

Open

chosen-ox wants to merge 1 commit from chosen-ox/patch-1 into main

chosen-ox commented

2024-01-28 02:37:47 -05:00

(Migrated from github.com)

When I ran the model, I found context_length has no effect. I try to fix it same as marella/ctransformers@ed02cf4b93/ctransformers/gptq/llm.py (L213)

When I ran the model, I found `context_length` has no effect. I try to fix it same as https://github.com/marella/ctransformers/blob/ed02cf4b9322435972ff3566fd4832806338ca3d/ctransformers/gptq/llm.py#L213

This pull request can be merged automatically.

You are not authorized to merge this pull request.

View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.

git fetch -u origin chosen-ox/patch-1:chosen-ox/patch-1

git switch chosen-ox/patch-1

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch main

git merge --no-ff chosen-ox/patch-1

git switch chosen-ox/patch-1

git rebase main

git switch main

git merge --ff-only chosen-ox/patch-1

git switch chosen-ox/patch-1

git rebase main

git switch main

git merge --no-ff chosen-ox/patch-1

git switch main

git merge --squash chosen-ox/patch-1

git switch main

git merge --ff-only chosen-ox/patch-1

git switch main

git merge chosen-ox/patch-1

git push origin main

No reviewers

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

marella/ctransformers!200

No description provided.

Rows
Columns