-
Notifications
You must be signed in to change notification settings - Fork 3.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add warning message near chat window about model hallucinations #2794
Conversation
Also, I am currently using this as the warning image, however, if there is an internal one that works better I'm happy to replace it. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks but I want to hold this until #2741 get merged
I'm not against this per se, but do we really have this low hopes for humanity?... |
I think this is really important as some outputs may look good, people are confused and see for example #2751 . We should also state that the assistant has no internet access .. I saw at least 3 different videos which either in the video or later "as correction in the comments" stated that OA would have internet access .. probably mainly because our mission-statement and the docs page say this. Also more ordinary people without ML/NLP experience or children might start using the system who have not heard about the hallucination problem. I am not 100% happy with the current text proposal for the message, maybe could @olliestanley or someone else who is native speaker please make a proposal for the message? |
btw I think we should also add a message to encourage users to give feedback with thumbs up/down for generated messages. |
@andreaskoepf Could we make the message to encourage users to give feedback a new issue since it is not directly related to this issue? |
Yes that would be fine |
❌ pre-commit failed. |
1 similar comment
❌ pre-commit failed. |
I've synced my fork and it seems like changes were pushed to main that don't pass pre-commit. These errors aren't related to the changes I've made @andreaskoepf |
pre-commit is passing on latest
Other messages are just |
I think in a first step we should get this warning in. @notmd you can make a design proposal for something different (later in separate PR), but IMO there are things like inference feedback collection which by far are more important .. we should discuss that via discord. @Quarks-1 could you please address the pre-commit errors:
thx! |
I can do this tomorrow, in the meantime we could merge this PR and I could submit a separate PR, either way is fine |
@olliestanley If there is a specific message you would like to have instead I am happy to replace it! |
@olliestanley I think we could merge it now and you could maybe tweak the message a bit in a separate PR. @notmd if you are ok with the overall approach, e.g. using the |
As Andreas said, many people may not understand what "hallucination" is in this context. It's also not (yet) really true to say that safeguards have been put in place. As a first draft I would consider something like:
We can tweak this further later if needed. |
Sounds good, makes sense to make a separate PR then. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We definitely need a design update, since this will block the majority of the screen for mobile users.
Referencing issue #2756 , this is my current progress
Would love some feedback!