Skip to content

Commit

Permalink
Updating Opacus' website and tutorial to include Ghost Clipping DP-SGD (
Browse files Browse the repository at this point in the history
#667)

Summary:
Pull Request resolved: #667

We update an existing tutorial on fine-tuning a language model, but now also with GC DP-SGD.

Reviewed By: HuanyuZhang

Differential Revision: D61411180

fbshipit-source-id: 515d1a112e5cb9b0ba562128c0a0a7ec7d2a985d
  • Loading branch information
EnayatUllah authored and facebook-github-bot committed Aug 22, 2024
1 parent 4823344 commit 27e6a1d
Show file tree
Hide file tree
Showing 3 changed files with 131 additions and 39 deletions.
153 changes: 119 additions & 34 deletions tutorials/building_text_classifier.ipynb

Large diffs are not rendered by default.

7 changes: 7 additions & 0 deletions website/pages/tutorials/index.js
Original file line number Diff line number Diff line change
Expand Up @@ -72,6 +72,13 @@ class TutorialHome extends React.Component {
Efficient Per-Sample Gradient Computation for More Layers in Opacus
</a>
</li>
<li>
<a
href="https://pytorch.org/blog/clipping-in-opacus/"
target="_blank">
Enabling Fast Gradient Clipping and Ghost Clipping in Opacus
</a>
</li>
</ol>
<h4>Videos*</h4>
<p>* Note that Opacus API has changed over time and some of the code samples and demos in the videos may not work. The concepts presented in the videos though are concrete and still valid.</p>
Expand Down
10 changes: 5 additions & 5 deletions website/tutorials.json
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
{
"Using Opacus": [
{
"id": "building_image_classifier",
"title": "Building image classifier with Differential Privacy"
"id": "building_text_classifier",
"title": "Building text classifier with Fast Gradient Clipping DP-SGD"
},
{
"id": "building_text_classifier",
"title": "Building text classifier with Differential Privacy"
"id": "building_image_classifier",
"title": "Building image classifier with Differential Privacy"
},
{
"id": "building_lstm_name_classifier",
Expand All @@ -27,6 +27,6 @@
{
"id": "ddp_tutorial",
"title": "Training on multiple GPUs with DistributedDataParallel"
}
}
]
}

0 comments on commit 27e6a1d

Please sign in to comment.