Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DOC: update adaptive benchmarks #96

Merged
merged 12 commits into from
Feb 27, 2021
Merged

DOC: update adaptive benchmarks #96

merged 12 commits into from
Feb 27, 2021

Conversation

stsievert
Copy link
Owner

@stsievert stsievert commented Feb 17, 2021

What does this PR implement?
It updates the "alien egg" and Zappos benchmarks on adaptive sampling. The offline embedding algorithm has been improved in #95, and this PR shows the results of that.

It also fixes various bugs/maintenance issues:

  • Remove setting random_state (had an issue where it wasn't changing, so repeated queries were being asked).
  • Return unique queries from Adaptive.get_queries (so repeated queries aren't posted to database or chosen in round robin).

Reference issues/PRs
#95.

@stsievert stsievert changed the title DOC: benchmark on adaptive sampling for "alien eggs" dataset DOC: update adaptive benchmarks Feb 24, 2021
@stsievert stsievert merged commit 4db75d8 into master Feb 27, 2021
@stsievert stsievert deleted the adaptive-doc-update branch February 27, 2021 02:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant