Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Kernel] AQ AZP 3/4: Asymmetric quantization kernels #7270

Merged
merged 29 commits into from
Sep 16, 2024
Merged

[Kernel] AQ AZP 3/4: Asymmetric quantization kernels #7270

merged 29 commits into from
Sep 16, 2024

Commits on Aug 6, 2024

  1. DRAFT dynamic azp quant kernel - failing non-deterministically

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    9c5b95b View commit details
    Browse the repository at this point in the history

  2. Fixed blockReduce bug! Also using round-to-even for azp

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    c0916db View commit details
    Browse the repository at this point in the history

  3. Remove scale adjustment

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    69f9493 View commit details
    Browse the repository at this point in the history

  4. Fixed saturation in kernel

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    15e4c72 View commit details
    Browse the repository at this point in the history

  5. Integer allclose comparison

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    6353a8b View commit details
    Browse the repository at this point in the history

  6. utils fix

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    a95790a View commit details
    Browse the repository at this point in the history

  7. Fixed torch ref conversion

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    84db5cd View commit details
    Browse the repository at this point in the history

  8. Format

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    d11340c View commit details
    Browse the repository at this point in the history

  9. Inverted azp sign to be consistent with RFC, unit tests, and compress… 

    …ed-tensors
    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    fe91441 View commit details
    Browse the repository at this point in the history

  10. Fix order of rounding in test (doesn't matter for small numbers, just… 

    … for consistency)
    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    f769c99 View commit details
    Browse the repository at this point in the history

  11. Fewer tests

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    9e49812 View commit details
    Browse the repository at this point in the history

  12. Static per-tensor kernels added

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    c1ad358 View commit details
    Browse the repository at this point in the history

  13. Reduced test size, fixed custom_ops wrapper

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    25d0f58 View commit details
    Browse the repository at this point in the history

  14. format

    @ProExpertProg
    ProExpertProg committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    e05068c View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Merge remote-tracking branch 'refs/remotes/upstream/main' into luka/a… 

    …q-azp-kernels

# Conflicts:
#	csrc/reduction_utils.cuh
#	tests/kernels/test_int8_quant.py
    @ProExpertProg
    ProExpertProg committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    5d249fe View commit details
    Browse the repository at this point in the history

  2. Merge fixes

    @ProExpertProg
    ProExpertProg committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    d02c568 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Fix for AMD build

    @ProExpertProg
    ProExpertProg committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    e4dc101 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. PR comments: Python nits

    @ProExpertProg
    ProExpertProg committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    31b3e44 View commit details
    Browse the repository at this point in the history

  2. PR comments: saturation code

    @ProExpertProg
    ProExpertProg committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    5a9762e View commit details
    Browse the repository at this point in the history

  3. explicit nearest rounding mode

    @ProExpertProg
    ProExpertProg committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    8aed02a View commit details
    Browse the repository at this point in the history

  4. Added rounding mode guard

    @ProExpertProg
    ProExpertProg committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    557db87 View commit details
    Browse the repository at this point in the history

  5. Rounding mode stuff removed, added comment

    @ProExpertProg
    ProExpertProg committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    2b24032 View commit details
    Browse the repository at this point in the history

  6. Fixed test

    @ProExpertProg
    ProExpertProg committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    5e9a0cb View commit details
    Browse the repository at this point in the history

  7. Improved nearbyint rounding comment

    @ProExpertProg
    ProExpertProg committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    65b2f9c View commit details
    Browse the repository at this point in the history

  8. Added saturating cast test

    @ProExpertProg
    ProExpertProg committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    45e1d9e View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Fixed scaled_int8_quant in qqq

    @ProExpertProg
    ProExpertProg committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    2232b6d View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into luka/aq-azp-kernels 

    # Conflicts:
#	tests/kernels/test_int8_quant.py
    @ProExpertProg
    ProExpertProg committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    8df3b2d View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Fixed ops_check & azp test atol

    @ProExpertProg
    ProExpertProg committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    04a539e View commit details
    Browse the repository at this point in the history

  2. Fixed cpu bindings

    @ProExpertProg
    ProExpertProg committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    a3b9f6a View commit details
    Browse the repository at this point in the history