Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cache eviction policy for vector indexes #192

Closed
wants to merge 1 commit into from

Conversation

Thejas-bhat
Copy link
Member

  • Uses the exponentially weighted moving average to get the average hits on a particular field (thereby a particular vector index). The index stays in the cache above a certain threshold of the average hits and below which the index is closed and the memory is freed for reuse on C side of things.
  • This ensures that we are not keeping the index in the cache (and holding up memory) even when there is no query workload on the field in a segment so the memory pressure does get reduced on the C side of operations.
  • Still a work in progress

@Thejas-bhat
Copy link
Member Author

Closing this in favour of #226

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant