Skip to content

Commit 489a576

Browse files
authored
Add a link to HG to regional_aot.py (profile links) (#3559)
Include a link to a HG blog that uses this technique in full glory.
1 parent 6e96f1a commit 489a576

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

recipes_source/regional_aot.py

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
Reducing AoT cold start compilation time with regional compilation
44
============================================================================
55
6-
**Author:** `Sayak Paul <https://github.com/sayakpaul>`_, `Charles Bensimon <https://github.com/cbensimon>`_, `Angela Yi <https://github.com/angelayi>`_
6+
**Author:** `Sayak Paul <https://huggingface.co/sayakpaul>`_, `Charles Bensimon <https://huggingface.co/cbensimon>`_, `Angela Yi <https://github.com/angelayi>`_
77
88
In the `regional compilation recipe <https://docs.pytorch.org/tutorials/recipes/regional_compilation.html>`__, we showed
99
how to reduce cold start compilation times while retaining (almost) full compilation benefits. This was demonstrated for
@@ -236,4 +236,6 @@ def aot_compile_load_model(regional=False) -> torch.nn.Module:
236236
#
237237
# This recipe shows how to control the cold start time when compiling your
238238
# model ahead-of-time. This becomes effective when your model has repeated
239-
# blocks, which is typically seen in large generative models.
239+
# blocks, which is typically seen in large generative models. We used this
240+
# recipe on various models to speed up real-time performance. Learn more
241+
# `here <https://huggingface.co/blog/zerogpu-aoti>`__.

0 commit comments

Comments
 (0)