Use with a local model #94

New issue

Open

opened 2023-08-31 14:09:07 -04:00 by jasonmhead · 2 comments

jasonmhead commented

2023-08-31 14:09:07 -04:00

(Migrated from github.com)

What would it take to modify for use with gpt4all or use with another local model method?

What technical modification suggestions would you have?

What would it take to modify for use with gpt4all or use with another local model method? What technical modification suggestions would you have?

👍 2

booboosui commented

2023-08-31 23:18:52 -04:00

(Migrated from github.com)

You can implement this interface, call a different model in the internal logic

And modify the code here to call your method

Usually, different models of Prompt understanding is different, you might also need to adjust the related Prompt

Welcome feedback if you encounter problems : )

You can implement this [interface](https://github.com/kuafuai/DevOpsGPT/blob/master/backend/app/pkgs/tools/llm_interface.py), call a different model in the internal logic And modify the code [here](https://github.com/kuafuai/DevOpsGPT/blob/master/backend/app/pkgs/tools/llm.py#L7C1-L7C1) to call your method Usually, different models of Prompt understanding is different, you might also need to adjust the related [Prompt](https://github.com/kuafuai/DevOpsGPT/tree/master/backend/app/pkgs/prompt) Welcome feedback if you encounter problems : )

👍 2

david101-hunter commented

2025-01-07 04:29:35 -05:00

(Migrated from github.com)

@booboosui can you write a readme for this issue?

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

kuafuai/DevOpsGPT#94

No description provided.

Rows
Columns