Skip to content

Commit

Permalink
Missing line in Saving and loading (#369)
Browse files Browse the repository at this point in the history
* Missing line in Saving and loading

* Bugs in Background & C51 docs
  • Loading branch information
Sharad24 authored Sep 30, 2020
1 parent 7d73d75 commit fe3c90e
Show file tree
Hide file tree
Showing 3 changed files with 4 additions and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/usage/tutorials/Deep/Background.rst
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ The State Value Function is defined as the expected return starting from only St
V^{\pi}(s) = E\left[ R_{t} \right]
State Action Value Function
---------------------
---------------------------

The Action Value Function is defined as the expected return starting from a state s and a taking an action a.

Expand Down
1 change: 1 addition & 0 deletions docs/source/usage/tutorials/Deep/Categorical_DQN.rst
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
===========================
Categorical Deep Q-Networks
===========================

Expand Down
2 changes: 2 additions & 0 deletions docs/source/usage/tutorials/Saving and loading.rst
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ We often want to checkpoint our training model in the RL setting, GenRL offers t
Following is a sample code to save checkpoints -

.. code-block:: python
import gym
import shutil
Expand Down Expand Up @@ -33,6 +34,7 @@ Following is a sample code to save checkpoints -
Let's say you have a saved weights and hyperparameters file to load onto the model you can change your trainer as below to load it -

.. code-block:: python
trainer = OnPolicyTrainer(
algo,
env,
Expand Down

0 comments on commit fe3c90e

Please sign in to comment.