-
Notifications
You must be signed in to change notification settings - Fork 8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Provide a new fast and simple way of accessing APIs (As example: Yi-models,Deepseek) #1782
Merged
binary-husky
merged 18 commits into
binary-husky:frontier
from
Menghuan1918:openai_form_in_one
May 13, 2024
Merged
Provide a new fast and simple way of accessing APIs (As example: Yi-models,Deepseek) #1782
binary-husky
merged 18 commits into
binary-husky:frontier
from
Menghuan1918:openai_form_in_one
May 13, 2024
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Hi, 是否考虑参考#1763 在参数中添加 API_KEY 呢 我的想法是在传参的时候直接带上该模型的:
可以最大化的优化现在在添加新模型时的步骤并且尽可能解耦? 当然同时可能会有在使用第三方包的时候需要单独设计部分 |
能否麻烦您解释一下您描述的“热重载”的场景?
不知道您有没有更好的想法 |
或者可以采取和oneapi接入相似的思路,模型名以"cus-"开头,而API则以"CUS_模型名字"以关键词去查找
|
* Fix DOC2X API key refresh issue in PDF translation * remove add --------- Co-authored-by: binary-husky <qingxu.fu@outlook.com>
…gpt_academic into Menghuan1918-openai_form_in_one
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
考虑到新的大语言模型API普遍兼容OpenAI 的API格式(例如: Groq,Yi01,Deepseek,Moonshot等)
这个PR提供了一种更为简单的方式快速添加此类API,仅需要给程序提供:
这是一个使用这种方法添加DeepseekAPI的示范,其仅需修改
config.py
与request_llms/bridge_all.py
两个文件,仅使用33行代码即可添加"deepseek-chat"以及"deepseek-coder"模型。PR包含的其他内容:将零一万物的请求格式也替换为这种格式
同时参考这个issue,留下了对代理的开关参数,或许未来可以自定义?