A benchmark that challenges language models to code solutions for scientific problems
-
Updated
Sep 29, 2025 - Python
#
ai-benchmarks
Here are 4 public repositories matching this topic...
AGI-Elo: How Far Are We From Mastering A Task?
benchmark leaderboard agi imagenet coco artificial-general-intelligence datasets evaluation-metrics elo-rating rating-system evaluation-framework sota ai-benchmarks waymo-open-dataset mmlu vision-language-action ai-evaluation-framework livecodebench navsim
-
Updated
May 21, 2025 - Python
A production-grade benchmarking suite that evaluates vector databases (Qdrant, Milvus, Weaviate, ChromaDB, Pinecone, SQLite, TopK) for music semantic search applications. Features automated performance testing, statistical analysis across 15-20 iterations, real-time web UI for database comparison, and comprehensive reporting with production.
python docker benchmarking machine-learning information-retrieval music-recommendation semantic-search performance-testing similarity-search pinecone weaviate fastapi milvus vector-database ai-benchmarks sentence-transformers qdrant embedding-search chromadb sqlite-vec
-
Updated
Aug 27, 2025 - Python
LlamaEval is a rapid prototype developed during a hackathon to provide a user-friendly dashboard for evaluating and comparing Llama models using the TogetherAI API.
-
Updated
Nov 10, 2024 - Python
Improve this page
Add a description, image, and links to the ai-benchmarks topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-benchmarks topic, visit your repo's landing page and select "manage topics."