Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Kernel] Adding bias epilogue support for cutlass_scaled_mm #5560

Merged
merged 22 commits into from
Jun 26, 2024
Merged

[Kernel] Adding bias epilogue support for cutlass_scaled_mm #5560

merged 22 commits into from
Jun 26, 2024

Commits on Jun 14, 2024

  1. Initial version of ScaledEpilogueAZP for azp/bias

    @ProExpertProg
    ProExpertProg committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    420de90 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. ScaledEpilogueAZP for cutlass 3.x

    @ProExpertProg
    ProExpertProg committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    4118a2f View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. Formatting

    @ProExpertProg
    ProExpertProg committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    364f2d0 View commit details
    Browse the repository at this point in the history

  2. Renamed azp to bias

    @ProExpertProg
    ProExpertProg committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    32c19e0 View commit details
    Browse the repository at this point in the history

  3. Refactored base class

    @ProExpertProg
    ProExpertProg committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    e20f684 View commit details
    Browse the repository at this point in the history

  4. renamed all azp occurrences to bias

    @ProExpertProg
    ProExpertProg committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    fe4f1e8 View commit details
    Browse the repository at this point in the history

  5. fixed variable conflict

    @ProExpertProg
    ProExpertProg committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    f26e0dc View commit details
    Browse the repository at this point in the history

  6. nullptr opt

    @ProExpertProg
    ProExpertProg committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    fac5553 View commit details
    Browse the repository at this point in the history

  7. bias tensor check on entry

    @ProExpertProg
    ProExpertProg committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    19c60a4 View commit details
    Browse the repository at this point in the history

  8. format

    @ProExpertProg
    ProExpertProg committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    0558f51 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. nullptr opt fix

    @cyang49 @ProExpertProg
    cyang49 authored and ProExpertProg committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    97158de View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. typo

    @ProExpertProg
    ProExpertProg committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    79b432c View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'refs/remotes/upstream/main' into luka/a… 

    …q-azp-epilogues-c2x

# Conflicts:
#	csrc/quantization/cutlass_w8a8/scaled_mm_c3x.cu
    @ProExpertProg
    ProExpertProg committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    6c6b1c0 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'refs/remotes/upstream/main' into luka/a… 

    …q-azp-epilogues-c2x

# Conflicts:
#	csrc/quantization/cutlass_w8a8/scaled_mm_c2x.cu
    @ProExpertProg
    ProExpertProg committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    0246dba View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/main' into luka/aq-azp-epilogu… 

    …es-c2x
    @ProExpertProg
    ProExpertProg committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    a2d2a43 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. format

    @ProExpertProg
    ProExpertProg committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    9e27422 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Fix "RuntimeError: Error Internal"

    @LucasWilkinson
    LucasWilkinson committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    b24644c View commit details
    Browse the repository at this point in the history

  2. convert bias type to output type, add checks

    @LucasWilkinson
    LucasWilkinson committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    dbcb96a View commit details
    Browse the repository at this point in the history

  3. remove duplicate checks

    @LucasWilkinson
    LucasWilkinson committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    a45a471 View commit details
    Browse the repository at this point in the history

  4. rest of bias to ElementD

    @ProExpertProg
    ProExpertProg committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    dbe9da9 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'refs/remotes/upstream/main' into luka/a… 

    …q-azp-epilogues-c2x
    @ProExpertProg
    ProExpertProg committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    0c01dcf View commit details
    Browse the repository at this point in the history

  6. fp8 bias ElementD

    @ProExpertProg
    ProExpertProg committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    e0ba8d9 View commit details
    Browse the repository at this point in the history