Add table driven evals example #29

markuswustenberg · 2025-01-14T10:46:32Z

Just say "Hi!" to Gemini/GPT/Claude.

github-actions · 2025-01-14T10:47:08Z

Evals

github-actions · 2025-01-14T10:53:08Z

github-actions · 2025-01-14T11:52:18Z

Name	Input	Expected	Output	Type	Score	Duration
TestEvalLLMs/gpt-4o-mini	Hi!	Hello! How can I assist you today?	Hello! How can I assist you today?	LevenshteinDistance	1.00 🆕	429.167221ms
TestEvalLLMs/gemini-1.5-flash	Hi!	Hi there! How can I help you today?	Hi there! How can I help you today?	LevenshteinDistance	1.00 🆕	449.116406ms
TestEvalLLMs/claude-3.5-haiku	Hi!	Hello! How are you doing today? Is there anything …	Hello! How are you doing today? Is there anything …	LevenshteinDistance	1.00 🆕	591.892319ms
TestEvalPrompt/answers_with_a_pong	ping	pong	plong	LevenshteinDistance	0.80 ➡️	1.042µs

Total					0.95	1.470176988s

Add table driven evals example

f9e36ac

Just say "Hi!" to Gemini/GPT/Claude.

set temperature 0

7a23323

markuswustenberg added 2 commits January 14, 2025 12:45

Merge branch 'main' into llm-test

6b810ad

add secrets

20ac94b

markuswustenberg merged commit 919ca24 into main Jan 14, 2025
3 checks passed

markuswustenberg deleted the llm-test branch January 14, 2025 11:53