Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Finalize solr reindex #8632

Merged
merged 8 commits into from
Aug 30, 2024
Merged

Finalize solr reindex #8632

merged 8 commits into from
Aug 30, 2024

Conversation

cdrini
Copy link
Collaborator

@cdrini cdrini commented Dec 15, 2023

Closes #8234

Puts an end to the stage of our solr stuck on the staging server! These are the settings that were used to run the solr reindex. Some of the features in the issue aren't correctly there because of how bumpy this reindex was, and might require another full reindex :(

Technical

  • Increased some timeout for solr requests; was noticing a few things timing out during solr updater runs
  • Switched lists solr updater to use POST to avoid url too long errors
  • Remove if solr_next wrappers
  • Reduce frequency of solr haproxy health checks to match our other services

Testing

Screenshot

Stakeholders

@cdrini cdrini force-pushed the solr-next branch 3 times, most recently from 6acef02 to d7918a3 Compare August 29, 2024 17:48
@cdrini cdrini marked this pull request as ready for review August 29, 2024 18:04
@cdrini cdrini changed the title Solr next Finalize solr reindex Aug 29, 2024
cdrini added 2 commits August 30, 2024 17:21
500ms is waaay to fast. Our other haproxies check at 5000ms, so matched that.
That way it can handle lists with many keys
@mekarpeles mekarpeles merged commit 7fce118 into internetarchive:master Aug 30, 2024
4 checks passed
@cdrini cdrini deleted the solr-next branch August 30, 2024 16:14
@jimchamp jimchamp assigned mekarpeles and unassigned mekarpeles Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Do a full solr reindex
2 participants