NNTile is a framework for training large neural networks. It relies on a task-based parallel programming paradigm, which distributes computations across all avialable hardware resources dynamically and transmits data asynchronously. For this purpose NNTile utilizes StarPU library.
NNTile
Tiling for efficient training and inferencing large neural networks
Pinned Loading
Repositories
Showing 4 of 4 repositories
- litgpt Public Forked from Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
nntile/litgpt’s past year of commit activity