Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core] Consolidate prompt arguments to LLM engines #4328

Merged
merged 57 commits into from
May 28, 2024
Merged

[Core] Consolidate prompt arguments to LLM engines #4328

merged 57 commits into from
May 28, 2024

Commits on Apr 24, 2024

  1. Combine prompt inputs

    @DarkLight1337
    DarkLight1337 committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    5d42800 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. Fix a bunch of tests

    @DarkLight1337
    DarkLight1337 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    5db2c5e View commit details
    Browse the repository at this point in the history

  2. Fix LLaVA test

    @DarkLight1337
    DarkLight1337 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    74c5905 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    cd8917b View commit details
    Browse the repository at this point in the history

  4. Fix benchmark_latency test

    @DarkLight1337
    DarkLight1337 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    b49aba7 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    bfd7295 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    45c7f23 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    493e6ed View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    20aeceb View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    0f46653 View commit details
    Browse the repository at this point in the history

  2. Clarify tokenizer usage

    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    c4f3540 View commit details
    Browse the repository at this point in the history

  3. Rename encode_request -> process_model_inputs

    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    ab8182c View commit details
    Browse the repository at this point in the history

  4. Support old API in LLM.generate

    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    eac33e1 View commit details
    Browse the repository at this point in the history

  5. Add tests to ensure old API still works 

    - To facilitate equality tests, `CompletionOutput` is now a dataclass
    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    703d318 View commit details
    Browse the repository at this point in the history

  6. Let all entrypoints tests be run at the same time

    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    19d85f9 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    baebd99 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    dc9816f View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    1c50600 View commit details
    Browse the repository at this point in the history

  2. Add tests for LLM.encode and fix corresponding bugs

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    5759dfa View commit details
    Browse the repository at this point in the history

  3. Apply formatter

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    cc4bfb5 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    6085b08 View commit details
    Browse the repository at this point in the history

  5. Rename _add_requests to _validate_and_add_requests to be more sim… 

    …ilar to the original `_validate_and_prepare_requests`
    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    d5c9731 View commit details
    Browse the repository at this point in the history

  6. Separate entrypoints tests into two groups

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    4f218a5 View commit details
    Browse the repository at this point in the history

  7. Fix memory profiling error

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    a9201d0 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Fix memory usage for embedding server

    @DarkLight1337
    DarkLight1337 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    ceebfa6 View commit details
    Browse the repository at this point in the history

  2. Update embeddings API to use new imputs

    @DarkLight1337
    DarkLight1337 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    7d991cd View commit details
    Browse the repository at this point in the history

  3. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    0e79dfb View commit details
    Browse the repository at this point in the history

  4. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    2c0d58f View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 16, 2024
    Configuration menu
    Copy the full SHA
    48e7a4a View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    b6c0e29 View commit details
    Browse the repository at this point in the history

  2. Merge llm groups back into one by enabling gc

    @DarkLight1337
    DarkLight1337 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    3097582 View commit details
    Browse the repository at this point in the history

  3. Improve documentation for LLM/engine

    @DarkLight1337
    DarkLight1337 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    7bbd123 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Direct readers to the PromptInputs class

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    056eb61 View commit details
    Browse the repository at this point in the history

  2. Separate _run_engine from _validate_and_add_requests

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    b3b990a View commit details
    Browse the repository at this point in the history

  3. Add flag for deprecating legacy API

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    2169def View commit details
    Browse the repository at this point in the history

  4. Add tests for deprecate_kwargs

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    3dbded1 View commit details
    Browse the repository at this point in the history

  5. Apply formatter

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    8e20317 View commit details
    Browse the repository at this point in the history

  6. Rename attribute to be less misleading

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    fdccaa2 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Renable using 'fork' start method and improve speed by using `torch… 

    ….multiprocessing` wrapper instead of stdlib `multiprocessing`
    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    77ee1c8 View commit details
    Browse the repository at this point in the history

  2. Simplify logic of casting request output

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    b1bcdd1 View commit details
    Browse the repository at this point in the history

  3. Improve code readability

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    44b4681 View commit details
    Browse the repository at this point in the history

  4. Fix multi_modal_data being a required key

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    50343cb View commit details
    Browse the repository at this point in the history

  5. Fix index out of range error

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    45aa420 View commit details
    Browse the repository at this point in the history

  6. Use a flag to control whether to check output types

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    d4e2589 View commit details
    Browse the repository at this point in the history

  7. Simplify flags

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    c07b579 View commit details
    Browse the repository at this point in the history

  8. Move output validation to a more appropriate location

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    9d56eb0 View commit details
    Browse the repository at this point in the history

  9. Add message to deprecation notice

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    bc05031 View commit details
    Browse the repository at this point in the history

  10. Apply formatter

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    95d4130 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Remove unused parameter in _validate_and_add_requests and fix test

    @DarkLight1337
    DarkLight1337 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    cc84f65 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. Simplify code

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    6c5d4a6 View commit details
    Browse the repository at this point in the history

  2. Move attribute assignment outside _init_tokenizer

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    fd2da12 View commit details
    Browse the repository at this point in the history

  3. Only emit warning once

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    d78de94 View commit details
    Browse the repository at this point in the history

  4. Simplify assignment expression

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    8a86829 View commit details
    Browse the repository at this point in the history

  5. Place special case at the start

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    731ac0e View commit details
    Browse the repository at this point in the history

  6. move API reference to under developer doc

    @ywang96
    ywang96 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    2d1a0bc View commit details
    Browse the repository at this point in the history

Commits on May 26, 2024

  1. Fix links in docs

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    7b8ce2c View commit details
    Browse the repository at this point in the history

  2. Remove unnecessary code to avoid repeated warning

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    fff21a1 View commit details
    Browse the repository at this point in the history