Code

[AutoParallel] recompute tuning#48608

Code

Merged

JZ-LIANG merged 27 commits intoPaddlePaddle:developPaddlePaddle/Paddle:developfrom zhaoyinglia:AutoParallel/tuning_recomputezhaoyinglia/Paddle:AutoParallel/tuning_recomputeCopy head branch name to clipboardDec 14, 2022

+495-249

Commits

Commits on Dec 1, 2022

• [AutoParallel] recompute tuning

  

  zhaoyingli

  committed
  3f51a36

  Copy full SHA for 3f51a36

• Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into AutoParallel/tuning_recompute

  

  zhaoyingli

  committed
  3661984

  Copy full SHA for 3661984

• fix conflict

  

  zhaoyingli

  committed
  1de9545

  Copy full SHA for 1de9545

• update comment

  

  zhaoyingli

  committed
  0dacac2

  Copy full SHA for 0dacac2

• bug fix

  

  zhaoyingli

  committed
  5c8d6e1

  Copy full SHA for 5c8d6e1

• update rc algo

  

  zhaoyingli

  committed
  a91fdec

  Copy full SHA for a91fdec

Commits on Dec 2, 2022

• tiny fix

  

  zhaoyingli

  committed
  8c72bc1

  Copy full SHA for 8c72bc1

• fix clear process_group

  

  zhaoyingli

  committed
  5f81773

  Copy full SHA for 5f81773

• remove comment

  

  zhaoyingli

  committed
  0fbb7ff

  Copy full SHA for 0fbb7ff

• update segment print

  

  zhaoyingli

  committed
  fe13bb3

  Copy full SHA for fe13bb3

Commits on Dec 6, 2022

• fix import OpRole

  

  zhaoyingli

  committed
  95717d0

  Copy full SHA for 95717d0

• adapt amp pass and grad_clip pass for opt_tuner

  

  zhaoyingli

  committed
  ce325c2

  Copy full SHA for ce325c2

• update tuning config

  

  zhaoyingli

  committed
  a3e128f

  Copy full SHA for a3e128f

Commits on Dec 7, 2022

• fix import

  

  zhaoyingli

  committed
  fb73b4d

  Copy full SHA for fb73b4d

• Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into AutoParallel/tuning_recompute

  

  zhaoyingli

  committed
  12c15da

  Copy full SHA for 12c15da

Commits on Dec 8, 2022

• annotate recompute info on ops and upgrade recompute pass

  

  zhaoyingli

  committed
  f5f76d2

  Copy full SHA for f5f76d2

• add op_namescope for seed op

  

  zhaoyingli

  committed
  de60fec

  Copy full SHA for de60fec

• record reserved vars

  

  zhaoyingli

  committed
  7b47635

  Copy full SHA for 7b47635

Commits on Dec 9, 2022

• fix recompute var's dist_attr

  

  zhaoyingli

  committed
  159c60f

  Copy full SHA for 159c60f

• Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into AutoParallel/tuning_recompute

  

  zhaoyingli

  committed
  893fcc5

  Copy full SHA for 893fcc5

• fix strategy unittest

  

  zhaoyingli

  committed
  8e019e6

  Copy full SHA for 8e019e6

Commits on Dec 12, 2022

• adapt for fp16

  

  zhaoyingli

  committed
  4d4e1d6

  Copy full SHA for 4d4e1d6

• update unittest

  

  zhaoyingli

  committed
  1071160

  Copy full SHA for 1071160

• revert copy opt

  

  zhaoyingli

  committed
  a9062e7

  Copy full SHA for a9062e7

Commits on Dec 13, 2022

• update unittest

  

  zhaoyingli

  committed
  a498f9b

  Copy full SHA for a498f9b

• rename set_recompute_segments

  

  zhaoyingli

  committed
  036aedf

  Copy full SHA for 036aedf

Commits on Dec 14, 2022

• fix unittest

  

  zhaoyinglia

  committed
  ebe2ffb

  Copy full SHA for ebe2ffb