Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core][VLM] Add precise multi-modal placeholder tracking #8346

Open
wants to merge 27 commits into
base: main
Choose a base branch
from
Open

[Core][VLM] Add precise multi-modal placeholder tracking #8346

wants to merge 27 commits into from

Commits on Sep 18, 2024

  1. [Core][VLM] Add precise multi-modal placeholder tracking

    @petersalas
    petersalas committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    d5e298f View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    aa756bf View commit details
    Browse the repository at this point in the history

  3. Fix msgpack failures

    @petersalas
    petersalas committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    46ee2d5 View commit details
    Browse the repository at this point in the history

  4. Fix test

    @petersalas
    petersalas committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    6c7830e View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Change DummyData to NamedTuple

    @petersalas
    petersalas committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    bf7d874 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    33e3023 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    8ebd665 View commit details
    Browse the repository at this point in the history

  3. Add online + chunked prefill test for ultravox

    @petersalas
    petersalas committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    5da9450 View commit details
    Browse the repository at this point in the history

  4. Use SequenceData.from_token_counts in Ultravox

    @petersalas
    petersalas committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    c5d0d7f View commit details
    Browse the repository at this point in the history

  5. Update test mock

    @petersalas
    petersalas committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    7a6cbe9 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Fix test failures

    @petersalas
    petersalas committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    1a617f2 View commit details
    Browse the repository at this point in the history

  2. Fix llava-onevision dummy data

    @petersalas
    petersalas committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    509cbac View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Allow None values in AttentionMetadata

    @petersalas
    petersalas committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    cb2dc49 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    b60ec8c View commit details
    Browse the repository at this point in the history

  3. Fix phi3v test

    @petersalas
    petersalas committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    defb59c View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    5a48342 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Replace index tensors with lists

    @petersalas
    petersalas committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    a8025f9 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    c10dff9 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Fix test failures

    @petersalas
    petersalas committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    862c46c View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    f14ab68 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    938b857 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    6611261 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    d0d1ea2 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. Add docstrings

    @petersalas
    petersalas committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    d0bc54d View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    f0b7a3f View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. Update docstrings

    @petersalas
    petersalas committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    5171297 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into psalas/placeholder-… 

    …positions
    @petersalas
    petersalas committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    fc0c190 View commit details
    Browse the repository at this point in the history