Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[torch.compile] avoid Dynamo guard evaluation overhead #7898

Merged
merged 23 commits into from
Aug 28, 2024
Merged

[torch.compile] avoid Dynamo guard evaluation overhead #7898

merged 23 commits into from
Aug 28, 2024

Commits on Aug 27, 2024

  1. custom dispatch

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    248d4db View commit details
    Browse the repository at this point in the history

  2. refine

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    8f4ed39 View commit details
    Browse the repository at this point in the history

  3. add wrapper

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    2d8b20a View commit details
    Browse the repository at this point in the history

  4. update

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    9f752fd View commit details
    Browse the repository at this point in the history

  5. add wrapper test

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    4be616a View commit details
    Browse the repository at this point in the history

  6. fix

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    026a525 View commit details
    Browse the repository at this point in the history

  7. update wrapper

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    7a1dd38 View commit details
    Browse the repository at this point in the history

  8. separate tests

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    1f0f148 View commit details
    Browse the repository at this point in the history

  9. add tests

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    7531186 View commit details
    Browse the repository at this point in the history

  10. update tests

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    31e9e7b View commit details
    Browse the repository at this point in the history

  11. multi wrappers

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    ace38e2 View commit details
    Browse the repository at this point in the history

  12. use wrapper

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    31a9e06 View commit details
    Browse the repository at this point in the history

  13. fix

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    0a349f5 View commit details
    Browse the repository at this point in the history

  14. fix

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    12cb164 View commit details
    Browse the repository at this point in the history

  15. more explanation

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    f483660 View commit details
    Browse the repository at this point in the history

  16. add tests

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    ec52afc View commit details
    Browse the repository at this point in the history

  17. add package

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    fabce9a View commit details
    Browse the repository at this point in the history

  18. update tests

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    b9fff4c View commit details
    Browse the repository at this point in the history

  19. add tests

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    f5019fc View commit details
    Browse the repository at this point in the history

  20. add init

    @youkaichao
    youkaichao committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    e3692ba View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Update vllm/worker/tpu_model_runner.py 

    Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
    @youkaichao @WoosukKwon
    youkaichao and WoosukKwon authored Aug 28, 2024
    Configuration menu
    Copy the full SHA
    746036c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into custom_dispatch

    @youkaichao
    youkaichao committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    80ce2bd View commit details
    Browse the repository at this point in the history

  3. fix args

    @youkaichao
    youkaichao committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a0bac86 View commit details
    Browse the repository at this point in the history