Skip to content

Commit

Permalink
update 2.1.100 example page to remove the out-of-date note for ddp ex…
Browse files Browse the repository at this point in the history
…ample (#2448)
  • Loading branch information
jingxu10 authored Jan 10, 2024
1 parent a4225fb commit 6356c8d
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions cpu/2.1.100+cpu/tutorials/examples.html
Original file line number Diff line number Diff line change
Expand Up @@ -335,7 +335,6 @@ <h5>BFloat16<a class="headerlink" href="#bfloat16" title="Permalink to this head
<section id="distributed-training">
<h4>Distributed Training<a class="headerlink" href="#distributed-training" title="Permalink to this heading"></a></h4>
<p>Distributed training with PyTorch DDP is accelerated by oneAPI Collective Communications Library Bindings for Pytorch* (oneCCL Bindings for Pytorch*). The extension supports FP32 and BF16 data types. More detailed information and examples are available at the <a class="reference external" href="https://github.com/intel/torch-ccl">Github repo</a>.</p>
<p><strong>Note:</strong> When performing distributed training with BF16 data type, use oneCCL Bindings for Pytorch*. Due to a PyTorch limitation, distributed training with BF16 data type with Intel® Extension for PyTorch* is not supported.</p>
<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">os</span>
<span class="kn">import</span> <span class="nn">torch</span>
<span class="kn">import</span> <span class="nn">torch.distributed</span> <span class="k">as</span> <span class="nn">dist</span>
Expand Down Expand Up @@ -1041,4 +1040,4 @@ <h2>Intel® AI Reference Models<a class="headerlink" href="#intel-ai-reference-m
</script>

</body>
</html>
</html>

0 comments on commit 6356c8d

Please sign in to comment.