Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Port TorchRL tutorial for DDPG Loss to pytorch.org #2413

Merged
merged 27 commits into from
Jun 13, 2023
Merged

Port TorchRL tutorial for DDPG Loss to pytorch.org #2413

Show file tree
Hide file tree
Changes from 18 commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
1b2f520
Port TorchRL tutorial for DDPG Loss to pytorch.org
nairbv Jun 2, 2023
95d7b1c
some stylistic changes, e.g. UK->US
nairbv Jun 5, 2023
871f50b
capitalize CUDA
nairbv Jun 5, 2023
09840d0
they / They
nairbv Jun 5, 2023
67f25c6
update URL format
nairbv Jun 5, 2023
22f5555
Apply suggestions from code review
nairbv Jun 5, 2023
8bcd15c
Merge branch 'main' into add_coding_ddpg
Jun 6, 2023
ecf0b6e
workaround pyspell errors
nairbv Jun 6, 2023
60ffc17
fix some more pyspell issues
nairbv Jun 6, 2023
f14df96
fix a ci failure
nairbv Jun 6, 2023
41fbe38
adding "next steps" section
nairbv Jun 7, 2023
d48f073
Merge branch 'main' into add_coding_ddpg
Jun 7, 2023
1b1bfc1
cleanup more typos
nairbv Jun 8, 2023
fdc6653
Merge branch 'main' into add_coding_ddpg
nairbv Jun 8, 2023
3a21bca
add early import of torchrl to avoid conflicts on mp.set_start_method
nairbv Jun 8, 2023
b4d74d5
Merge branch 'main' into add_coding_ddpg
nairbv Jun 8, 2023
2e946ea
try again on fixing multiproc spawn issue, couldnt repro locally
nairbv Jun 9, 2023
7ba9abd
Merge branch 'main' into add_coding_ddpg
nairbv Jun 9, 2023
d756188
Apply suggestions from code review
Jun 12, 2023
271e5d3
Update intermediate_source/coding_ddpg.py
Jun 12, 2023
b575982
Merge branch 'main' into add_coding_ddpg
Jun 12, 2023
7c48bff
Update intermediate_source/coding_ddpg.py
Jun 12, 2023
ed57fca
fix
vmoens Jun 13, 2023
b878abd
Merge branch 'main' into add_coding_ddpg
vmoens Jun 13, 2023
425a694
SyncDataCollector
vmoens Jun 13, 2023
1263c60
SyncDataCollector
vmoens Jun 13, 2023
f4a5e4b
Merge branch 'main' into add_coding_ddpg
Jun 13, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added _static/img/half_cheetah.gif
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
9 changes: 9 additions & 0 deletions en-wordlist.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,7 @@ ConvNets
DCGAN
DCGANs
DDP
DDPG
DDQN
DLRM
DNN
Expand Down Expand Up @@ -113,6 +114,8 @@ Numpy's
ONNX
OpenAI
OpenMP
Ornstein
OU
PIL
PPO
Plotly
Expand Down Expand Up @@ -144,6 +147,7 @@ Spacy
TPU
TensorBoard
TensorBoards
TensorDict
TextVQA
Tokenization
TorchDynamo
Expand All @@ -154,6 +158,7 @@ TorchRL's
TorchScript
TorchX
Tunable
Uhlenbeck
UI
Unescape
VGG
Expand Down Expand Up @@ -207,6 +212,7 @@ cpu
csv
cuDNN
datafile
dataflow
dataframe
dataloader
dataloaders
Expand All @@ -231,6 +237,7 @@ elementwise
embeddings
encodings
ensembling
enum
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you also add:
rollouts
rollout
Ornstein
Uhlenbeck
OU

This should be enough to pass the spellcheck after merging other suggestions

eq
et
evaluateInput
Expand Down Expand Up @@ -347,6 +354,7 @@ resnet
restride
rewinded
rollout
rollouts
romanized
runnable
runtime
Expand All @@ -373,6 +381,7 @@ subreddit
subregion
subregion's
summarization
swappable
tanh
th
thresholding
Expand Down
8 changes: 8 additions & 0 deletions index.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -295,6 +295,14 @@ What's new in PyTorch tutorials?
:link: intermediate/mario_rl_tutorial.html
:tags: Reinforcement-Learning

.. customcarditem::
:header: Code a DDPG Loss
:card_description: Use TorchRL to code a DDPG Loss
:image: _static/img/half_cheetah.gif
:link: intermediate/coding_ddpg.html
:tags: Reinforcement-Learning



.. Deploying PyTorch Models in Production
Expand Down
Loading