Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sharding Prototype I: implementation as translating Store #876

Closed
wants to merge 11 commits into from
Closed

Sharding Prototype I: implementation as translating Store #876

wants to merge 11 commits into from

Commits on Nov 17, 2021

  1. initial sharding prototype

    @jstriebel
    jstriebel committed Nov 17, 2021
    Configuration menu
    Copy the full SHA
    f8cabaa View commit details
    Browse the repository at this point in the history

  2. add small script to test chunking

    @jstriebel
    jstriebel committed Nov 17, 2021
    Configuration menu
    Copy the full SHA
    8290f1e View commit details
    Browse the repository at this point in the history

  3. Update util.py

    @jstriebel
    jstriebel committed Nov 17, 2021
    Configuration menu
    Copy the full SHA
    a44b2e5 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2021

  1. implement feedback

    @jstriebel
    jstriebel committed Nov 18, 2021
    Configuration menu
    Copy the full SHA
    97a9368 View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2021

  1. make shard_format configurable, add bitmask for uncompressed chunks

    @jstriebel
    jstriebel committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    7e2768a View commit details
    Browse the repository at this point in the history

  2. add chunking_test.py output to itself

    @jstriebel
    jstriebel committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    8071268 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2021

  1. implement indexed sharded format

    @jstriebel
    jstriebel committed Dec 7, 2021
    Configuration menu
    Copy the full SHA
    b4fd3e2 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2021

  1. index: use little endian, note empty chunks with pair of max uint64

    @jstriebel
    jstriebel committed Dec 8, 2021
    Configuration menu
    Copy the full SHA
    d0434a6 View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2021

  1. Merge branch 'master' into sharding

    @normanrz
    normanrz committed Dec 21, 2021
    Configuration menu
    Copy the full SHA
    19be805 View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2021

  1. fix linting & typing

    @jstriebel
    jstriebel committed Dec 22, 2021
    Configuration menu
    Copy the full SHA
    4859e31 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into sharding

    @jstriebel
    jstriebel committed Dec 22, 2021
    Configuration menu
    Copy the full SHA
    2d1fea0 View commit details
    Browse the repository at this point in the history