Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AutoParallel] Add sequence parallel for llama #59822

Merged
merged 24 commits into from
Dec 9, 2023
Merged

[AutoParallel] Add sequence parallel for llama #59822

merged 24 commits into from
Dec 9, 2023

Commits on Dec 6, 2023

  1. [AutoParallel] Fix problems of sequence parallel in dynamic mode.

    @GhostScreaming
    GhostScreaming committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    c185964 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … fix_backward_reshard
    @GhostScreaming
    GhostScreaming committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    d302229 View commit details
    Browse the repository at this point in the history

  3. Polish code.

    @GhostScreaming
    GhostScreaming committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    f4cb01f View commit details
    Browse the repository at this point in the history

  4. Remove TODO in transpose.cc

    @GhostScreaming
    GhostScreaming committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    81d2199 View commit details
    Browse the repository at this point in the history

  5. Polish code.

    @GhostScreaming
    GhostScreaming committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    74e8033 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … fix_backward_reshard
    @GhostScreaming
    GhostScreaming committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    41cdd55 View commit details
    Browse the repository at this point in the history

  2. Remove useless modification.

    @GhostScreaming
    GhostScreaming committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    4de6ed7 View commit details
    Browse the repository at this point in the history

  3. Polish code.

    @GhostScreaming
    GhostScreaming committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    e79197e View commit details
    Browse the repository at this point in the history

  4. Polish code.

    @GhostScreaming
    GhostScreaming committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    f647ef3 View commit details
    Browse the repository at this point in the history

  5. Remove useless modification.

    @GhostScreaming
    GhostScreaming committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    5a1cf9f View commit details
    Browse the repository at this point in the history

  6. Allow partial status flow

    @GhostScreaming
    GhostScreaming committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    c8caf0c View commit details
    Browse the repository at this point in the history

  7. add 3D auto_parallel test.

    @wuhuachaocoding
    wuhuachaocoding committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    6b90d53 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … fix_backward_reshard
    @GhostScreaming
    GhostScreaming committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    4ae381b View commit details
    Browse the repository at this point in the history

  9. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … fix_backward_reshard
    @GhostScreaming
    GhostScreaming committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    2ccb14e View commit details
    Browse the repository at this point in the history

  10. add 3d test and fix reshard bug.

    @wuhuachaocoding
    wuhuachaocoding committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    06410aa View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2023

  1. Merge commit 'refs/pull/59726/head' of https://github.com/PaddlePaddl… 

    …e/Paddle into test_sp
    @GhostScreaming
    GhostScreaming committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    1180c9d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … test_sp
    @GhostScreaming
    GhostScreaming committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    2893385 View commit details
    Browse the repository at this point in the history

  3. Add sequence parallel for llama.

    @GhostScreaming
    GhostScreaming committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    d6c38d9 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … test_sp
    @GhostScreaming
    GhostScreaming committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    522de43 View commit details
    Browse the repository at this point in the history

  5. Polish code according to review comments.

    @GhostScreaming
    GhostScreaming committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    1e46ace View commit details
    Browse the repository at this point in the history

  6. Fix bug of backward set in_grad dist_attr.

    @GhostScreaming
    GhostScreaming committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    732230b View commit details
    Browse the repository at this point in the history

  7. Polish.

    @GhostScreaming
    GhostScreaming committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    0ce56d8 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … test_sp
    @GhostScreaming
    GhostScreaming committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    ec12fd0 View commit details
    Browse the repository at this point in the history

  9. Change place where sp call reshard

    @GhostScreaming
    GhostScreaming committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    e22be22 View commit details
    Browse the repository at this point in the history