#

large-batch-optimization

Here are 2 public repositories matching this topic...

KhoiDOO / tvlars

TVLARS - A Fast Convergence Optimizer for Large Batch Training

optimization optimization-algorithms learning-rate warmup learning-rate-scheduling layer-wise-relevance-propagation large-batch-optimization

Updated Nov 20, 2023
Python

vinnik-dmitry07 / full-batch

Super-Convergence on CIFAR10

sophia cifar10 lion second-order-optimization adamw super-convergence weight-decay sharpness-aware-minimization madgrad large-batch-optimization lion-optimizer

Updated Jun 17, 2024
Python

Improve this page

Add a description, image, and links to the large-batch-optimization topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the large-batch-optimization topic, visit your repo's landing page and select "manage topics."