Evaluate your LLM's response with Prometheus and GPT4 💯
-
Updated
Nov 29, 2024 - Python
#
llm-as-evaluator
Here are 8 public repositories matching this topic...
Deliver safe & effective language models
nlp artificial-intelligence benchmarks benchmark-framework model-assessment ai-safety mlops responsible-ai ml-safety trustworthy-ai ethics-in-ai ml-testing large-language-models llm ai-testing llm-test llm-evaluation-toolkit llm-as-evaluator llm-testing
-
Updated
Dec 24, 2024 - Python
xFinder: Robust and Pinpoint Answer Extraction for Large Language Models
benchmark regex reliability evaluation dataset gpt phi large-language-models llm open-compass chatglm qwen lm-evaluation llm-as-a-judge llm-as-evaluator xfinder reliable-evaluation key-answer-extraction judge-model
-
Updated
Dec 25, 2024 - Python
This is the repo for the survey of Bias and Fairness in IR with LLMs.
information-retrieval recommender-systems bias ir fairness large-language-models llm chatgpt llm4rec llm4rs llm-as-a-judge llm-as-evaluator llm4ir
-
Updated
Oct 29, 2024
Code and data for "Timo: Towards Better Temporal Reasoning for Language Models" (COLM 2024)
temporal-reasoning sota-model llms rlhf rlaif llm-as-a-judge llm-as-evaluator self-critic-framework colm2024
-
Updated
Oct 23, 2024 - Python
Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"
nlp evaluation bias bias-detection llm llms llm-evaluation llms-benchmarking llm-as-judge llm-as-a-judge llm-as-evaluator
-
Updated
Feb 16, 2024 - Jupyter Notebook
Use groq for evaluations
-
Updated
Jul 11, 2024 - Python
Antibodies for LLMs hallucinations (grouping LLM as a judge, NLI, reward models)
-
Updated
Jun 13, 2024 - Python
Improve this page
Add a description, image, and links to the llm-as-evaluator topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-as-evaluator topic, visit your repo's landing page and select "manage topics."