Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both draft and target models. #6485

Merged
merged 45 commits into from
Jul 21, 2024
Merged

[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both draft and target models. #6485

merged 45 commits into from
Jul 21, 2024

Commits on May 29, 2024

  1. Merge pull request #1 from vllm-project/main 

    Pull from head
    @sroy745
    sroy745 authored May 29, 2024
    Configuration menu
    Copy the full SHA
    5650b95 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 3, 2024
    Configuration menu
    Copy the full SHA
    8f36146 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 3, 2024
    Configuration menu
    Copy the full SHA
    9e75057 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 7, 2024
    Configuration menu
    Copy the full SHA
    db2c679 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 10, 2024
    Configuration menu
    Copy the full SHA
    8d7512c View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 12, 2024
    Configuration menu
    Copy the full SHA
    1473f74 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 14, 2024
    Configuration menu
    Copy the full SHA
    4013e1a View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2dbdd78 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 20, 2024
    Configuration menu
    Copy the full SHA
    b3575e9 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 24, 2024
    Configuration menu
    Copy the full SHA
    94b0d43 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 27, 2024
    Configuration menu
    Copy the full SHA
    fa8fedf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 27, 2024
    Configuration menu
    Copy the full SHA
    6ed96b4 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 28, 2024
    Configuration menu
    Copy the full SHA
    b71c533 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 29, 2024
    Configuration menu
    Copy the full SHA
    57babef View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jul 1, 2024
    Configuration menu
    Copy the full SHA
    4b19bac View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jul 6, 2024
    Configuration menu
    Copy the full SHA
    eb7a1c4 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jul 10, 2024
    Configuration menu
    Copy the full SHA
    7e2c87e View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jul 15, 2024
    Configuration menu
    Copy the full SHA
    6212d5f View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. Disable LogProbs generation for spec decoding

    @sroy745
    sroy745 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    1eddc27 View commit details
    Browse the repository at this point in the history

  2. Changes to sampler.py

    @sroy745
    sroy745 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    7a2f99c View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. Merge branch 'main' into sroy-sd-disable-log-prob

    @sroy745
    sroy745 authored Jul 17, 2024
    Configuration menu
    Copy the full SHA
    92a050a View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. Not sync logprobs

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    a46433f View commit details
    Browse the repository at this point in the history

  2. Revert change and add target_model_runner

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    81c1628 View commit details
    Browse the repository at this point in the history

  3. Revert one more file

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    a0cfe9b View commit details
    Browse the repository at this point in the history

  4. Revert changes to sampler.py

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    773ad81 View commit details
    Browse the repository at this point in the history

  5. Fix formatting and other errors

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    3d8e0e8 View commit details
    Browse the repository at this point in the history

  6. Reverting unneeded changes

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    95bc438 View commit details
    Browse the repository at this point in the history

  7. Change to batch_expansion.py

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    d2f0237 View commit details
    Browse the repository at this point in the history

  8. Changes

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    fd1ceea View commit details
    Browse the repository at this point in the history

  9. Revert changes

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    7b194ac View commit details
    Browse the repository at this point in the history

  10. Fixes for e2e logprobs test

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    a31a457 View commit details
    Browse the repository at this point in the history

  11. Fix formatting

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    acfef3c View commit details
    Browse the repository at this point in the history

  12. Reverting a change

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    e631a3e View commit details
    Browse the repository at this point in the history

  13. Fix tests

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    4148de6 View commit details
    Browse the repository at this point in the history

  14. Dummy commit

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    0bf1ae0 View commit details
    Browse the repository at this point in the history

  15. dummy commit

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    d73aba9 View commit details
    Browse the repository at this point in the history

  16. Fix comments

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    40af330 View commit details
    Browse the repository at this point in the history

  17. Merge branch 'main' into sroy-sd-disable-log-prob

    @sroy745
    sroy745 authored Jul 19, 2024
    Configuration menu
    Copy the full SHA
    d3d54c1 View commit details
    Browse the repository at this point in the history

  18. Some documentation fix

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    ec25de7 View commit details
    Browse the repository at this point in the history

  19. Format and comments

    @sroy745
    sroy745 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    c6417a7 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2024

  1. Addressing comments

    @sroy745
    sroy745 committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    25ce4af View commit details
    Browse the repository at this point in the history

  2. Moving logic to 2 new methods

    @sroy745
    sroy745 committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    7bc875b View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2024

  1. Address comments

    @sroy745
    sroy745 committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    596506d View commit details
    Browse the repository at this point in the history

  2. Address comments

    @sroy745
    sroy745 committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    c35f8f0 View commit details
    Browse the repository at this point in the history

  3. Small fix to comment

    @sroy745
    sroy745 committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    2c9d95f View commit details
    Browse the repository at this point in the history