Code

Introduce float8 training#19488

Code

Merged

fchollet merged 12 commits intokeras-team:masterkeras-team/keras:masterfrom james77777778:add-fp8-v2james77777778/keras:add-fp8-v2Copy head branch name to clipboardApr 15, 2024

+1,605-304

Commits

Commits on Apr 11, 2024

• Add float8 training support

  james77777778

  committed
  3740c63

  Copy full SHA for 3740c63

• Add tests for fp8 training

  james77777778

  committed
  7047b38

  Copy full SHA for 7047b38

• Add quantize_and_dequantize test

  james77777778

  committed
  9739766

  Copy full SHA for 9739766

• Fix bugs and add float8 correctness tests

  james77777778

  committed
  44b4426

  Copy full SHA for 44b4426

• Cleanup

  james77777778

  committed
  0958490

  Copy full SHA for 0958490

Commits on Apr 13, 2024

• Merge branch 'master' into add-fp8-v2

  james77777778

  committed
  fd5d57a

  Copy full SHA for fd5d57a

• Address comments and cleanup

  james77777778

  committed
  0a9653a

  Copy full SHA for 0a9653a

• Add docstrings and some minor refactoring

  james77777778

  committed
  e98c126

  Copy full SHA for e98c126

Commits on Apr 14, 2024

• Add QuantizedFloat8DTypePolicy

  james77777778

  committed
  076bb37

  Copy full SHA for 076bb37

Commits on Apr 15, 2024

• Add dtype policy setter

  james77777778

  committed
  20a2c27

  Copy full SHA for 20a2c27

• Fix torch dynamo issue by using self._dtype_policy

  james77777778

  committed
  db15659

  Copy full SHA for db15659

• Improve test coverage

  james77777778

  committed
  197c6e7

  Copy full SHA for 197c6e7