Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add tensor parallel inference unit tests #2232

Merged
merged 34 commits into from
Sep 9, 2022
Merged

Add tensor parallel inference unit tests #2232

merged 34 commits into from
Sep 9, 2022

Commits on Aug 17, 2022

  1. added mp test

    @mrwyattii
    mrwyattii committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    770c59a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into add-mp-inf-tests

    @mrwyattii
    mrwyattii authored Aug 17, 2022
    Configuration menu
    Copy the full SHA
    706617f View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2022

  1. make text-gen compare DS output to baseline

    @mrwyattii
    mrwyattii authored Aug 18, 2022
    Configuration menu
    Copy the full SHA
    c0925a1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into add-mp-inf-tests

    @mrwyattii
    mrwyattii authored Aug 18, 2022
    Configuration menu
    Copy the full SHA
    36bb2c5 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2022

  1. Merge branch 'master' into add-mp-inf-tests

    @RezaYazdaniAminabadi
    RezaYazdaniAminabadi authored Aug 23, 2022
    Configuration menu
    Copy the full SHA
    f942b5a View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2022

  1. remove non-gpt models from multigpu test

    @mrwyattii
    mrwyattii committed Aug 25, 2022
    Configuration menu
    Copy the full SHA
    adaabe0 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2022

  1. add more models and fixes for OOM

    @mrwyattii
    mrwyattii committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    f9a7eae View commit details
    Browse the repository at this point in the history

  2. added job ID to environment printout

    @mrwyattii
    mrwyattii committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    606a669 View commit details
    Browse the repository at this point in the history

  3. made multi-GPU tests sequential

    @mrwyattii
    mrwyattii committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    aef7603 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into add-mp-inf-tests

    @mrwyattii
    mrwyattii authored Aug 26, 2022
    Configuration menu
    Copy the full SHA
    27a9825 View commit details
    Browse the repository at this point in the history

  5. update inference workflow with sequential tests

    @mrwyattii
    mrwyattii committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    7cb4136 View commit details
    Browse the repository at this point in the history

  6. fix for multi-gpu

    @mrwyattii
    mrwyattii committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    409af10 View commit details
    Browse the repository at this point in the history

  7. fix for selecting inference sequential tests

    @mrwyattii
    mrwyattii committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    28c8102 View commit details
    Browse the repository at this point in the history

  8. change default to not include inference tests

    @mrwyattii
    mrwyattii committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    185d4b9 View commit details
    Browse the repository at this point in the history

  9. restrict gptneox to half precision

    @mrwyattii
    mrwyattii committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    5c84dca View commit details
    Browse the repository at this point in the history

  10. increas world_size to 4 for multigpu

    @mrwyattii
    mrwyattii committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    6edb13b View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2022

  1. Merge branch 'master' into add-mp-inf-tests

    @jeffra
    jeffra authored Aug 29, 2022
    Configuration menu
    Copy the full SHA
    a75d5fe View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2022

  1. Merge branch 'master' into add-mp-inf-tests

    @jeffra
    jeffra authored Sep 1, 2022
    Configuration menu
    Copy the full SHA
    a79bb15 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into add-mp-inf-tests

    @samadejacobs
    samadejacobs authored Sep 1, 2022
    Configuration menu
    Copy the full SHA
    2ab79f0 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2022

  1. use fp16 revision of gpt-j

    @jeffra
    jeffra committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    19839cb View commit details
    Browse the repository at this point in the history

  2. revert non-gptj

    @jeffra
    jeffra committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    776be03 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2022

  1. use gpt-j fp16 revision

    @jeffra
    jeffra committed Sep 3, 2022
    Configuration menu
    Copy the full SHA
    429c88d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into add-mp-inf-tests

    @jeffra
    jeffra authored Sep 3, 2022
    Configuration menu
    Copy the full SHA
    b6d2b3b View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2022

  1. Merge branch 'master' into add-mp-inf-tests

    @jeffra
    jeffra authored Sep 7, 2022
    Configuration menu
    Copy the full SHA
    af8d94d View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2022

  1. fix for broken tests

    @mrwyattii
    mrwyattii committed Sep 8, 2022
    Configuration menu
    Copy the full SHA
    335406a View commit details
    Browse the repository at this point in the history

  2. fix invalid model/task check

    @mrwyattii
    mrwyattii committed Sep 8, 2022
    Configuration menu
    Copy the full SHA
    d0bb608 View commit details
    Browse the repository at this point in the history

  3. correct gpt-neo test that should have been skipped

    @mrwyattii
    mrwyattii committed Sep 8, 2022
    Configuration menu
    Copy the full SHA
    4678f05 View commit details
    Browse the repository at this point in the history

  4. add exception for bloom models failing to match text-gen output

    @mrwyattii
    mrwyattii committed Sep 8, 2022
    Configuration menu
    Copy the full SHA
    5b5e65a View commit details
    Browse the repository at this point in the history

  5. restrict number of tokens generated

    @mrwyattii
    mrwyattii committed Sep 8, 2022
    Configuration menu
    Copy the full SHA
    19f2bf0 View commit details
    Browse the repository at this point in the history

  6. fix for opt models

    @mrwyattii
    mrwyattii committed Sep 8, 2022
    Configuration menu
    Copy the full SHA
    7feac82 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2022

  1. Update test_inference.py

    @mrwyattii
    mrwyattii authored Sep 9, 2022
    Configuration menu
    Copy the full SHA
    cfdf629 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into add-mp-inf-tests

    @mrwyattii
    mrwyattii authored Sep 9, 2022
    Configuration menu
    Copy the full SHA
    3e87d74 View commit details
    Browse the repository at this point in the history

  3. formatting

    @mrwyattii
    mrwyattii committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    42ccea5 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into add-mp-inf-tests

    @mrwyattii
    mrwyattii authored Sep 9, 2022
    Configuration menu
    Copy the full SHA
    db48d24 View commit details
    Browse the repository at this point in the history