Skip to content

Issues: IINemo/lm-polygraph

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

19 Open 14 Closed
19 Open 14 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Several Estimators not resulting in Uncertainty Estimations but Values outside [0,1]
#284 opened Feb 8, 2025 by muelphil
1
Compute of CCP - using deberta-large-mnli for the semantic comparisons
#283 opened Feb 4, 2025 by muelphil
BlackBox issue, ERROR:lm_polygraph:401 Unauthorized
#282 opened Jan 28, 2025 by MathewShuvarikov
CCP usability for ChatGLM model
#280 opened Jan 22, 2025 by EdwardChang5467
@cant-access-rediska0123
3
lack package.json file
#277 opened Dec 24, 2024 by chivalry1314
3
cannot import name 'normalize_ue' from 'lm_polygraph.utils.normalize'
#276 opened Dec 24, 2024 by chivalry1314
@rvashurin
2
It seems that the estimater_uncertainty method can only handle one str at a time. How to process multiple str in parallel? Can you provide corresponding examples
#275 opened Dec 22, 2024 by eLeventhw
1
Using LM-Polygraph with Custom OpenAI Endpoint / with Pre-Generated Responses enhancement New feature or request
#263 opened Nov 27, 2024 by muelphil
3
ways to compute ROC-AUC and the label
#262 opened Nov 26, 2024 by EdwardChang5467
@rvashurin @cant-access-rediska0123
4
I would like to ask about the output of GPT3.5, how can GPT4 recognize related words when encountering this situation
#260 opened Nov 24, 2024 by wangzhonghai
@IINemo @cant-access-rediska0123
6
Isn't CCP a white box model? How to test GPT-3.5-turbo
#255 opened Nov 14, 2024 by wangzhonghai
@IINemo @ArtemVazh @cant-access-rediska0123
6
Problems with tokenizer for LLMs without instruct-tuning bug Something isn't working
#239 opened Oct 14, 2024 by IINemo
Example for normalizaiton
#226 opened Aug 22, 2024 by YiJohnny
@SpeedOfMagic
1
generate_texts on wbmodel ignores generation parameters and stopping critera. bug Something isn't working
#224 opened Aug 21, 2024 by rvashurin
Semantic entropy is using probabilites greater than 1 bug Something isn't working
#223 opened Aug 20, 2024 by gyampols
1
@rvashurin
2
Dockerfile adjustments enhancement New feature or request
#206 opened Jun 20, 2024 by SuperCoolCucumber
1
@rvashurin
3
using the openai API for a BlackBox model for non OPENAI hosted platforms enhancement New feature or request
#166 opened Feb 22, 2024 by psteinb
@cant-access-rediska0123
4
What is the different between pe_uncertainties and ep_uncertainties? documentation Improvements or additions to documentation
#164 opened Feb 21, 2024 by HuihuiChyan
@rvashurin
2
Possible mismatching max_length and max_new_tokens in example eval script bug Something isn't working
#118 opened Oct 9, 2023 by kirill-fedyanin
@rvashurin
4
ProTip! no:milestone will show everything without a milestone.