Skip to content

Commit

Permalink
Update torchrl/objectives/value/advantages.py
Browse files Browse the repository at this point in the history
Co-authored-by: Vincent Moens <vincentmoens@gmail.com>
  • Loading branch information
albertbou92 and vmoens authored Nov 22, 2023
1 parent c23401a commit 886b4e0
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions torchrl/objectives/value/advantages.py
Original file line number Diff line number Diff line change
Expand Up @@ -1361,6 +1361,7 @@ class VTrace(ValueEstimatorBase):
value_network (TensorDictModule): value operator used to retrieve the value estimates.
actor_network (TensorDictModule): actor operator used to retrieve the log prob.
rho_thresh (Union[float, Tensor]): rho clipping parameter for importance weights.
Defaults to ``1.0``.
c_thresh (Union[float, Tensor]): c clipping parameter for importance weights.
average_adv (bool): if ``True``, the resulting advantage values will be standardized.
Default is ``False``.
Expand Down

0 comments on commit 886b4e0

Please sign in to comment.