Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Introduce new encoding of BPV 21 for DocIdsWriter used in BKD Tree #13521

Open
wants to merge 62 commits into
base: main
Choose a base branch
from
Open

Introduce new encoding of BPV 21 for DocIdsWriter used in BKD Tree #13521

wants to merge 62 commits into from

Commits on Jun 21, 2024

  1. BPV 21 Encoding in DocIdsWriter and it's micro benchmark

    @expani
    expani committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    11e41b4 View commit details
    Browse the repository at this point in the history

  2. Deleted single loop encoders

    @expani
    expani committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    2376766 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. Using 2 step bpv 21 encoder in docIdsWriter

    @expani
    expani committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    886810b View commit details
    Browse the repository at this point in the history

  2. Minor refactor

    @expani
    expani committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    9e20958 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Initial commit - DocId Benchmark

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    5034e04 View commit details
    Browse the repository at this point in the history

  2. Explicit use of NIOFSDirectory

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    e06bc3b View commit details
    Browse the repository at this point in the history

  3. Increasing iterations to 10

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    d2122cd View commit details
    Browse the repository at this point in the history

  4. Added a new encoder

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    d09e79a View commit details
    Browse the repository at this point in the history

  5. Removed older benchmarks

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    1ddd597 View commit details
    Browse the repository at this point in the history

  6. Added License

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    9f3792b View commit details
    Browse the repository at this point in the history

  7. Refactoring

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    4e8a1f2 View commit details
    Browse the repository at this point in the history

  8. Gradle Tidy

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    04361d3 View commit details
    Browse the repository at this point in the history

  9. Added teardown to properly cleanup files

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    f35605a View commit details
    Browse the repository at this point in the history

  10. Added comments

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    4a02e64 View commit details
    Browse the repository at this point in the history

  11. Reading docId sequences from files

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    c01fb9b View commit details
    Browse the repository at this point in the history

  12. Using charset while reading file

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    d751e60 View commit details
    Browse the repository at this point in the history

  13. Avoid write/read to files per unique sequence

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    b833e73 View commit details
    Browse the repository at this point in the history

  14. Fixing build failure for distro test

    @expani
    expani committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    db1ed1d View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Added output verification code and cleanup

    @expani
    expani committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    42eac06 View commit details
    Browse the repository at this point in the history

  2. Added sequence smaller than 512 elements

    @expani
    expani committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    5fb5b25 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Added Bit32Encoder and moved the unrolled version of Bit21Encoder to … 

    …DocIdsWriter
    @expani
    expani committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    5af1e60 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'apache:main' into bpv21_main

    @expani
    expani authored Aug 29, 2024
    Configuration menu
    Copy the full SHA
    0a07019 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Merge branch 'apache:main' into bpv21_main

    @expani
    expani authored Sep 6, 2024
    Configuration menu
    Copy the full SHA
    1cb896a View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Separated encode and decode benchmarks - initial commit

    @expani
    expani committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    0b59eb3 View commit details
    Browse the repository at this point in the history

  2. Separated encode and decode benchmarks - initial commit

    @expani
    expani committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    bd04aaf View commit details
    Browse the repository at this point in the history

  3. Taking input file as a system property other than default

    @expani
    expani committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    ad7b749 View commit details
    Browse the repository at this point in the history

  4. Added input scale factor as a sys property for input to benchmark

    @expani
    expani committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    5479ac2 View commit details
    Browse the repository at this point in the history

  5. Replaced usage of java.io.File and other cleanup

    @expani
    expani committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    a3a5c58 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Refactor

    @expani
    expani committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    4085679 View commit details
    Browse the repository at this point in the history

  2. Trimming numbers to avoid NFE

    @expani
    expani committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    e309031 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2024

  1. Used reflection for generating singleton instances and addressed PR C… 

    …omments
    @expani
    expani committed Oct 6, 2024
    Configuration menu
    Copy the full SHA
    7dd5d80 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Fixed gradle check errors

    @expani
    expani committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    0289c6b View commit details
    Browse the repository at this point in the history

  2. Fixed gradle check errors

    @expani
    expani committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    e20be32 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Added hybrid bit21 encoder

    @expani
    expani committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    16c6c2b View commit details
    Browse the repository at this point in the history

  2. Added versions.lock for unit testing dependency in lucene-jmh module

    @expani
    expani committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    fa34d4e View commit details
    Browse the repository at this point in the history

  3. Changed decoder for os.arch amd64 ( x86 processor )

    @expani
    expani committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    a090196 View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. Merge branch 'apache:main' into bpv21_main

    @expani
    expani authored Oct 15, 2024
    Configuration menu
    Copy the full SHA
    dad37c1 View commit details
    Browse the repository at this point in the history

  2. Added unit tests to randomly generate docIds for all encoders

    @expani
    expani committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    fd862b7 View commit details
    Browse the repository at this point in the history

  3. Added unit tests to randomly generate docIds for all encoders

    @expani
    expani committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    68d0bbf View commit details
    Browse the repository at this point in the history

  4. Removed resource file with hardcoded docIds

    @expani
    expani committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    33232e5 View commit details
    Browse the repository at this point in the history

  5. Removed resource file with hardcoded docIds

    @expani
    expani committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    5853093 View commit details
    Browse the repository at this point in the history

  6. Refactoring

    @expani
    expani committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    8d6f7ca View commit details
    Browse the repository at this point in the history

  7. Merge branch 'apache:main' into bpv21_main

    @expani
    expani authored Oct 15, 2024
    Configuration menu
    Copy the full SHA
    336308e View commit details
    Browse the repository at this point in the history

  8. Fixed all gradle failures

    @expani
    expani committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    4fb0a87 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Auto inferring docIdProvider

    @expani
    expani committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    33fd619 View commit details
    Browse the repository at this point in the history

  2. Made encoding conditional based on architecture

    @expani
    expani committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    295531c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'apache:main' into bpv21_main

    @expani
    expani authored Oct 16, 2024
    Configuration menu
    Copy the full SHA
    7312d91 View commit details
    Browse the repository at this point in the history

  4. Fixed file cleanup for unit tests

    @expani
    expani committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    359440a View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Benchmarking effects of only using writeLong instead of writeInt

    @expani
    expani committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    4406d75 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. Closing IndexInput after every use

    @expani
    expani committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    dc3d6fc View commit details
    Browse the repository at this point in the history

  2. Temporarily added debug loggers to track for larger inputs

    @expani
    expani committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    0d1d879 View commit details
    Browse the repository at this point in the history

  3. Disabling encode benchmark temporarily

    @expani
    expani committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    5b6b26d View commit details
    Browse the repository at this point in the history

  4. Added extra loggers

    @expani
    expani committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    fdca13f View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2024

  1. Removed print statements for debugging stages

    @expani
    expani committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    b2c45e5 View commit details
    Browse the repository at this point in the history

  2. Made loading docIdSequences parallel to reduce benchmark time

    @expani
    expani committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    ecf53d9 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. Excluding lines with comments

    @expani
    expani committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    7f95cd3 View commit details
    Browse the repository at this point in the history

  2. Changed readLong to readInt for trailing docIds in leaf block

    @expani
    expani committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    af8b914 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. Adding new encoder with only readLong instead of readInt to easily co… 

    …mpare performance
    @expani
    expani committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    4d10d9d View commit details
    Browse the repository at this point in the history

  2. Adding new encoder with only readLong instead of readInt to easily co… 

    …mpare performance
    @expani
    expani committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    da2325c View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Added new hybrid encoder based on readlong vs readint tests

    @expani
    expani committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    06dd48f View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2024

  1. Added a variation of BPV32 using only r/w long

    @expani
    expani committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    775fb38 View commit details
    Browse the repository at this point in the history

  2. Added a variation of BPV32 using only r/w long

    @expani
    expani committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    702580a View commit details
    Browse the repository at this point in the history