Code

Sharding stage 2 support main grad#57473

Code

Merged

FeixLiu merged 8 commits intoPaddlePaddle:developPaddlePaddle/Paddle:developfrom FeixLiu:sharding_stage2_bf16_main_gradFeixLiu/Paddle:sharding_stage2_bf16_main_gradCopy head branch name to clipboardSep 20, 2023

+424-39

Commits

Commits on Sep 19, 2023

• sharding stage 2 main grad

  FeixLiu

  committed
  e130383

  Copy full SHA for e130383

• resolve confilct

  FeixLiu

  committed
  6763a14

  Copy full SHA for 6763a14

• fit precommit error

  FeixLiu

  committed
  91b472b

  Copy full SHA for 91b472b

• update ut

  FeixLiu

  committed
  22299fb

  Copy full SHA for 22299fb

• add grad acc ut

  FeixLiu

  committed
  a56c3c3

  Copy full SHA for a56c3c3

• for v100

  FeixLiu

  committed
  93f704f

  Copy full SHA for 93f704f

• add ut to the gpups

  FeixLiu

  committed
  8ca777b

  Copy full SHA for 8ca777b

• split ut

  FeixLiu

  committed
  57d943c

  Copy full SHA for 57d943c