Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Frontend][Feature] Add jamba tool parser #9154

Merged
merged 22 commits into from
Oct 18, 2024
Merged

[Frontend][Feature] Add jamba tool parser #9154

merged 22 commits into from
Oct 18, 2024
+595 −9

Commits on Sep 26, 2024

  1. first working version of jamba tool parsing

    @tomeras91
    tomeras91 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    cbd955a View commit details
    Browse the repository at this point in the history

  2. lint and format

    @tomeras91
    tomeras91 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    1a8c4e1 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. fix: We don't want to add content if it's an empty string

    @tomeras91
    tomeras91 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    0da420d View commit details
    Browse the repository at this point in the history

  2. add initial tests for jamba tool parser

    @tomeras91
    tomeras91 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    310535c View commit details
    Browse the repository at this point in the history

  3. reduce code duplication with use of parametrize

    @tomeras91
    tomeras91 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    f5c9d09 View commit details
    Browse the repository at this point in the history

  4. fix model outputs to match jamba expected output

    @tomeras91
    tomeras91 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    6b04e35 View commit details
    Browse the repository at this point in the history

  5. add tests for jamba tool parsing with streaming

    @tomeras91
    tomeras91 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    c25cd51 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Merge branch 'main' into add-jamba-tool-parser

    @tomeras91
    tomeras91 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    d551be0 View commit details
    Browse the repository at this point in the history

  2. adjust JambaToolParser to changes in upstream

    @tomeras91
    tomeras91 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    d31e688 View commit details
    Browse the repository at this point in the history

  3. Add adjust_request function to JambaToolParser since we need to set s… 

    …kip_special_tokens to False as done in Internlm2ToolParser
    @tomeras91
    tomeras91 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    6a27eb3 View commit details
    Browse the repository at this point in the history

  4. update comments and remove unused code

    @tomeras91
    tomeras91 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    bc16953 View commit details
    Browse the repository at this point in the history

  5. lint & format + adjust tests to new tool parser API

    @tomeras91
    tomeras91 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    25d839d View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. dummy for build

    @tomeras91
    tomeras91 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    16542bc View commit details
    Browse the repository at this point in the history

  2. Revert "dummy for build" 

    This reverts commit 16542bc.
    @tomeras91
    tomeras91 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    2a25f10 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into add-jamba-tool-parser

    @DarkLight1337
    DarkLight1337 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    a935865 View commit details
    Browse the repository at this point in the history

  4. Use vllm-project#9188 and improve validation

    @DarkLight1337
    DarkLight1337 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    3c757c5 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. removed done TODO

    @tomeras91
    tomeras91 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    0db1408 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'add-jamba-tool-parser' of github.com:tomeras91/vllm int… 

    …o add-jamba-tool-parser
    @tomeras91
    tomeras91 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    e5c2878 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. Added Jamba tool calling to docs

    @tomeras91
    tomeras91 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    20aeb6d View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Apply vllm-project#9461

    @DarkLight1337
    DarkLight1337 authored Oct 18, 2024
    Configuration menu
    Copy the full SHA
    54efc40 View commit details
    Browse the repository at this point in the history

  2. Trigger build with fix typo

    @DarkLight1337
    DarkLight1337 authored Oct 18, 2024
    Configuration menu
    Copy the full SHA
    ae9a0b7 View commit details
    Browse the repository at this point in the history

  3. Fix missing option

    @DarkLight1337
    DarkLight1337 authored Oct 18, 2024
    Configuration menu
    Copy the full SHA
    d5fefe9 View commit details
    Browse the repository at this point in the history