Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Core] Enable prefix caching with block manager v2 enabled #4142

Merged
merged 7 commits into from
May 1, 2024

Commits on Apr 27, 2024

  1. [Core] Enable prefix caching with block manager v2 enabled

    This PR is for enabel APC feature over block manager V2.
    
    APC core idea is like maintain a table mapping between content hash and
    physical block. If one block is full, then it would be prompted to be
    immutable. While if several immutable comes in sequence, we kept the
    first physical block, while free the other.
    
    Those freed physical block, aka no reference at scheduler, would be
    housekept inside evictor, when we try to alloc block again under pressue,
    and find no free one as in the initial state, we could resort to
    evictor to pop one unrefered computed block, which is used to store
    new data comes from upper layer.
    
    The evictor policy could be changed, but current only implement LRU one.
    
    Co-authored-by: Sage Moore <sagemoore@utexas.edu>
    2 people authored and root committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    ebc941e View commit details
    Browse the repository at this point in the history
  2. fix ruff

    wenlei03 committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    de4537a View commit details
    Browse the repository at this point in the history
  3. fix yapf

    wenlei03 committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    3053991 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. fix _blocks track issue

    wenlei03 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    8527c30 View commit details
    Browse the repository at this point in the history
  2. fix ruff issue

    wenlei03 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    425b657 View commit details
    Browse the repository at this point in the history
  3. fix yapf

    wenlei03 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    b57bfcb View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. add performance todo note

    wenlei03 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    7a547e1 View commit details
    Browse the repository at this point in the history