[Feature] Offering help with Unit Tests

[erlapso]

Hi everyone! I noticed a lot of Pull Requests, particularly in relation to new features and tests.

I'd like to help improve the test coverage using CodeBeaver, an AI agent that I built (it's free for open source!). To demonstrate what's possible, I've created a PR:
[Feature] Add HLE (Humanity's Last Exam) dataset - Unit Tests
that adds comprehensive tests to the last Pull Request that was opened here: [Feature] Add HLE (Humanity's Last Exam) dataset.

What the PR demonstrates:

• Increases coverage by +100.00% for tests/test_datasets_info.py, tests/test_OlympiadBench.py, and tests/test_OlympiadBench_categories.py
• Adds comprehensive tests with 3 new test files:
  • tests/test_datasets_info.py
  • tests/test_OlympiadBench.py
  • tests/test_OlympiadBench_categories.py
• All new tests pass successfully, ensuring reliability

On top of that: If you check the PR you will see that CodeBeaver does not only go for coverage - it also adds all the edge cases it can think of (we make it iterate 3 times on that alone).

How it works:

CodeBeaver analyzes your code changes in PRs

• Automatically generates and updates tests
• Opens PRs with new/updated tests
• Helps catch bugs before they reach production

Next steps

If this interests the maintainer team, I'm happy to:

• Walk through how the tests were generated
• Help set up automated test generation for future PRs (takes ~5 minutes)
• Focus on specific areas you'd like to improve coverage for

Let me know what you think! Happy to adapt this approach based on the project's needs.