kuafuai/DevOpsGPT
1
0
Fork 0
Code Issues 16 Pull requests 2 Projects Releases 2 Packages Wiki Activity Actions

Add Bedrock, Ollama, Claude2, Cohere, Replicate [100+ LLMs] - using LiteLLM #114

Open
krrishdholakia wants to merge 1 commit from krrishdholakia/patch-1 into master
pull from: krrishdholakia/patch-1
merge into: kuafuai:master
Conversation 1 Commits 1 Files changed 1 +32
krrishdholakia commented 2023-10-11 18:32:32 -04:00 (Migrated from github.com)
Copy link

Hi @booboosui @charging-kuafuai,

Noticed you're calling the openai completions endpoint. I'm working on litellm (simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and wanted to see how i could be helpful.

My PR shows users how to call their LLM providers (bedrock, togetherai, huggingface tgi, replicate, ai21, cohere, ai21 etc.) by pointing your openai endpoint to a local proxy they can use for experimentation.

This makes no code changes to your app.

Happy to add additional tests/documentation if the initial PR looks good.

Hi @booboosui @charging-kuafuai, Noticed you're calling the openai completions endpoint. I'm working on litellm (simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and wanted to see how i could be helpful. My PR shows users how to call their LLM providers (bedrock, togetherai, huggingface tgi, replicate, ai21, cohere, ai21 etc.) by pointing your openai endpoint to a [local proxy](https://docs.litellm.ai/docs/proxy_server) they can use for experimentation. This makes **no code changes** to your app. Happy to add additional tests/documentation if the initial PR looks good.
cwsqer006 (Migrated from github.com) reviewed 2024-01-05 07:46:26 -05:00
cwsqer006 (Migrated from github.com) left a comment
Copy link

ok

ok
This pull request can be merged automatically.
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin krrishdholakia/patch-1:krrishdholakia/patch-1
git switch krrishdholakia/patch-1

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch master
git merge --no-ff krrishdholakia/patch-1
git switch krrishdholakia/patch-1
git rebase master
git switch master
git merge --ff-only krrishdholakia/patch-1
git switch krrishdholakia/patch-1
git rebase master
git switch master
git merge --no-ff krrishdholakia/patch-1
git switch master
git merge --squash krrishdholakia/patch-1
git switch master
git merge --ff-only krrishdholakia/patch-1
git switch master
git merge krrishdholakia/patch-1
git push origin master
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kuafuai/DevOpsGPT!114
No description provided.