marella/ctransformers
1
0
Fork 0
Code Issues 107 Pull requests 5 Projects Releases 30 Packages Wiki Activity Actions

WIP: recover from transformers 4.34 refactored #155

Draft
victorlee0505 wants to merge 2 commits from victorlee0505/vlee/transformers into main
pull from: victorlee0505/vlee/transformers
merge into: marella:main
Conversation 0 Commits 2 Files changed 1 +8 -1
victorlee0505 commented 2023-10-04 16:35:48 -04:00 (Migrated from github.com)
Copy link

this PR is for #154.

I believe PreTrainedTokenizer super().__init__(**kwargs) attempted to use get_vocab from LLM but self._llm = llm is not yet set, hence it can not access to the LLM.

So I move it down and it works now.

*force-pushed to change author

this PR is for #154. I believe PreTrainedTokenizer `super().__init__(**kwargs)` attempted to use `get_vocab` from LLM but `self._llm = llm` is not yet set, hence it can not access to the LLM. So I move it down and it works now. *force-pushed to change author
This pull request is marked as a work in progress.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin victorlee0505/vlee/transformers:victorlee0505/vlee/transformers
git switch victorlee0505/vlee/transformers

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch main
git merge --no-ff victorlee0505/vlee/transformers
git switch victorlee0505/vlee/transformers
git rebase main
git switch main
git merge --ff-only victorlee0505/vlee/transformers
git switch victorlee0505/vlee/transformers
git rebase main
git switch main
git merge --no-ff victorlee0505/vlee/transformers
git switch main
git merge --squash victorlee0505/vlee/transformers
git switch main
git merge --ff-only victorlee0505/vlee/transformers
git switch main
git merge victorlee0505/vlee/transformers
git push origin main
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
marella/ctransformers!155
No description provided.