Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The reranking model has been set up successfully, but it is not taking effect and the original model is still being used. #10351

Closed
5 tasks done
zhukefucn opened this issue Nov 6, 2024 · 3 comments

Comments

@zhukefucn
Copy link

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.10.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

The reranking model has been set up successfully, but it is not taking effect and the original model is still being used.
original model is jina,I changed to cohere model , set in two position , one is default rerank model setting , the other is in knowledge base .

✔️ Expected Behavior

new rerank model setting taking effect correctly

❌ Actual Behavior

The reranking model has been set up successfully, but it is not taking effect and the original model is still being used.

Copy link

dosubot bot commented Nov 6, 2024

I found some similar issues that might help you troubleshoot the problem:

  1. Knowledge Retrieval Node Incorrectly Reverts to RerankModel: This issue was resolved by ensuring the reranking configuration is preserved correctly. You might want to check if your configuration is being overridden or not saved properly [1].

  2. How to use Xinference's rerank models in Dify?: This issue was resolved by validating the model UID. Ensure that the model configuration, including any identifiers, is correctly set up [2].

  3. 用了Cohere的rerank API,对话没有产生回放: This issue highlighted several potential causes for reranking not taking effect, such as an empty document list, score thresholds not being met, invalid API keys, or connection errors. Check these aspects to ensure they are not causing the issue [3].

For your specific case, ensure that the reranking model settings are correctly configured in both the default settings and the knowledge base settings. Verify that the reranking_mode and reranking_model configurations are correct and that there are no authorization errors or misconfigurations in the Docker setup. Additionally, check the logs for any errors or warnings that might indicate why the new model is not being applied.

To continue talking to Dosu, mention @dosu.

@crazywoola
Copy link
Member

This has been fixed in later version, please upgrade to latest one.

@zhukefucn
Copy link
Author

How can I change data setting to slove the problem temporerly ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants