[CI] Fix doc upload

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1739

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (9 Unrelated Failures)

As of commit f54bcde with merge base ffc62cc ():

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• Build M1 Wheels / pytorch/rl / wheel-py3_8-cpu (gh)
• Olddeps Tests on Linux / unittests (3.8, 11.6) / linux-job (gh)
• Unit-tests on MacOS CPU / tests (3.11) / macos-job (gh)
• Unit-tests on MacOS CPU / tests (3.8) / macos-job (gh)
• Unit-tests on Windows CPU / unittests / windows-job (gh)
• Unit-tests on Windows GPU / unittests / windows-job (gh)

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Habitat Tests on Linux / tests (3.9, 11.6) / linux-job (gh)
• RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
• Unit-tests on Linux GPU, latest stable release / tests (3.8, 11.8) / linux-job (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}11$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	62.4569ms	62.0688ms	16.1111 Ops/s	14.9760 Ops/s	$\textbf{\color{#35bf28}+7.58\%}$
test_sync	35.0271ms	33.9150ms	29.4855 Ops/s	26.6648 Ops/s	$\textbf{\color{#35bf28}+10.58\%}$
test_async	78.0095ms	33.5222ms	29.8310 Ops/s	29.6853 Ops/s	$\color{#35bf28}+0.49\%$
test_simple	0.4990s	0.4409s	2.2683 Ops/s	2.2841 Ops/s	$\color{#d91a1a}-0.70\%$
test_transformed	0.6844s	0.6217s	1.6084 Ops/s	1.6299 Ops/s	$\color{#d91a1a}-1.32\%$
test_serial	1.4160s	1.3587s	0.7360 Ops/s	0.7405 Ops/s	$\color{#d91a1a}-0.62\%$
test_parallel	1.3478s	1.2987s	0.7700 Ops/s	0.7746 Ops/s	$\color{#d91a1a}-0.60\%$
test_step_mdp_speed[True-True-True-True-True]	0.1736ms	23.2154μs	43.0748 KOps/s	43.6226 KOps/s	$\color{#d91a1a}-1.26\%$
test_step_mdp_speed[True-True-True-True-False]	39.6340μs	13.9943μs	71.4579 KOps/s	72.0543 KOps/s	$\color{#d91a1a}-0.83\%$
test_step_mdp_speed[True-True-True-False-True]	41.9880μs	14.2105μs	70.3706 KOps/s	71.3074 KOps/s	$\color{#d91a1a}-1.31\%$
test_step_mdp_speed[True-True-True-False-False]	31.6290μs	8.5215μs	117.3499 KOps/s	119.9983 KOps/s	$\color{#d91a1a}-2.21\%$
test_step_mdp_speed[True-True-False-True-True]	53.2690μs	24.7075μs	40.4735 KOps/s	40.9871 KOps/s	$\color{#d91a1a}-1.25\%$
test_step_mdp_speed[True-True-False-True-False]	49.5730μs	15.4124μs	64.8829 KOps/s	65.6526 KOps/s	$\color{#d91a1a}-1.17\%$
test_step_mdp_speed[True-True-False-False-True]	37.2690μs	15.6900μs	63.7347 KOps/s	65.2740 KOps/s	$\color{#d91a1a}-2.36\%$
test_step_mdp_speed[True-True-False-False-False]	49.7430μs	9.8766μs	101.2492 KOps/s	101.7291 KOps/s	$\color{#d91a1a}-0.47\%$
test_step_mdp_speed[True-False-True-True-True]	51.6670μs	26.1011μs	38.3126 KOps/s	38.3072 KOps/s	$\color{#35bf28}+0.01\%$
test_step_mdp_speed[True-False-True-True-False]	47.6690μs	16.9205μs	59.1000 KOps/s	59.8251 KOps/s	$\color{#d91a1a}-1.21\%$
test_step_mdp_speed[True-False-True-False-True]	66.3840μs	15.4527μs	64.7137 KOps/s	64.6928 KOps/s	$\color{#35bf28}+0.03\%$
test_step_mdp_speed[True-False-True-False-False]	42.1290μs	9.9821μs	100.1796 KOps/s	102.1780 KOps/s	$\color{#d91a1a}-1.96\%$
test_step_mdp_speed[True-False-False-True-True]	64.6400μs	27.4374μs	36.4465 KOps/s	37.0650 KOps/s	$\color{#d91a1a}-1.67\%$
test_step_mdp_speed[True-False-False-True-False]	48.5600μs	17.9396μs	55.7425 KOps/s	56.1032 KOps/s	$\color{#d91a1a}-0.64\%$
test_step_mdp_speed[True-False-False-False-True]	45.6660μs	16.6999μs	59.8807 KOps/s	60.3579 KOps/s	$\color{#d91a1a}-0.79\%$
test_step_mdp_speed[True-False-False-False-False]	30.1660μs	11.1206μs	89.9232 KOps/s	91.3188 KOps/s	$\color{#d91a1a}-1.53\%$
test_step_mdp_speed[False-True-True-True-True]	4.1720ms	26.2553μs	38.0875 KOps/s	38.6812 KOps/s	$\color{#d91a1a}-1.53\%$
test_step_mdp_speed[False-True-True-True-False]	71.1530μs	17.2500μs	57.9709 KOps/s	59.9210 KOps/s	$\color{#d91a1a}-3.25\%$
test_step_mdp_speed[False-True-True-False-True]	67.7160μs	18.4536μs	54.1900 KOps/s	55.8628 KOps/s	$\color{#d91a1a}-2.99\%$
test_step_mdp_speed[False-True-True-False-False]	34.0330μs	11.2836μs	88.6242 KOps/s	90.4378 KOps/s	$\color{#d91a1a}-2.01\%$
test_step_mdp_speed[False-True-False-True-True]	80.4500μs	27.2038μs	36.7596 KOps/s	37.0213 KOps/s	$\color{#d91a1a}-0.71\%$
test_step_mdp_speed[False-True-False-True-False]	50.9350μs	17.8999μs	55.8661 KOps/s	55.3598 KOps/s	$\color{#35bf28}+0.91\%$
test_step_mdp_speed[False-True-False-False-True]	62.0260μs	19.3536μs	51.6700 KOps/s	52.7390 KOps/s	$\color{#d91a1a}-2.03\%$
test_step_mdp_speed[False-True-False-False-False]	34.0640μs	12.3619μs	80.8939 KOps/s	82.0153 KOps/s	$\color{#d91a1a}-1.37\%$
test_step_mdp_speed[False-False-True-True-True]	74.5990μs	28.4584μs	35.1390 KOps/s	35.2811 KOps/s	$\color{#d91a1a}-0.40\%$
test_step_mdp_speed[False-False-True-True-False]	53.2290μs	19.1870μs	52.1186 KOps/s	51.8710 KOps/s	$\color{#35bf28}+0.48\%$
test_step_mdp_speed[False-False-True-False-True]	41.0370μs	19.0835μs	52.4013 KOps/s	52.2036 KOps/s	$\color{#35bf28}+0.38\%$
test_step_mdp_speed[False-False-True-False-False]	45.8460μs	12.2843μs	81.4048 KOps/s	81.5846 KOps/s	$\color{#d91a1a}-0.22\%$
test_step_mdp_speed[False-False-False-True-True]	57.7880μs	29.8753μs	33.4724 KOps/s	33.6816 KOps/s	$\color{#d91a1a}-0.62\%$
test_step_mdp_speed[False-False-False-True-False]	50.6850μs	20.4206μs	48.9702 KOps/s	48.6543 KOps/s	$\color{#35bf28}+0.65\%$
test_step_mdp_speed[False-False-False-False-True]	52.7190μs	20.3497μs	49.1409 KOps/s	50.0936 KOps/s	$\color{#d91a1a}-1.90\%$
test_step_mdp_speed[False-False-False-False-False]	33.6830μs	13.4472μs	74.3651 KOps/s	75.5564 KOps/s	$\color{#d91a1a}-1.58\%$
test_values[generalized_advantage_estimate-True-True]	13.4537ms	12.0748ms	82.8171 Ops/s	82.1206 Ops/s	$\color{#35bf28}+0.85\%$
test_values[vec_generalized_advantage_estimate-True-True]	35.6928ms	27.6780ms	36.1297 Ops/s	36.5960 Ops/s	$\color{#d91a1a}-1.27\%$
test_values[td0_return_estimate-False-False]	0.2612ms	0.1780ms	5.6195 KOps/s	5.5321 KOps/s	$\color{#35bf28}+1.58\%$
test_values[td1_return_estimate-False-False]	26.3520ms	25.7203ms	38.8798 Ops/s	37.9851 Ops/s	$\color{#35bf28}+2.36\%$
test_values[vec_td1_return_estimate-False-False]	35.8102ms	27.6261ms	36.1977 Ops/s	36.7266 Ops/s	$\color{#d91a1a}-1.44\%$
test_values[td_lambda_return_estimate-True-False]	45.0686ms	36.6596ms	27.2780 Ops/s	27.2769 Ops/s	$+0.00\%$
test_values[vec_td_lambda_return_estimate-True-False]	34.9541ms	27.5164ms	36.3420 Ops/s	36.3462 Ops/s	$\color{#d91a1a}-0.01\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	11.3114ms	8.1443ms	122.7858 Ops/s	121.2623 Ops/s	$\color{#35bf28}+1.26\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	10.5588ms	1.9861ms	503.4979 Ops/s	463.2277 Ops/s	$\textbf{\color{#35bf28}+8.69\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	1.3065ms	0.4480ms	2.2319 KOps/s	2.2385 KOps/s	$\color{#d91a1a}-0.30\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	46.4763ms	40.5739ms	24.6464 Ops/s	25.0370 Ops/s	$\color{#d91a1a}-1.56\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	15.7177ms	2.9033ms	344.4393 Ops/s	390.0654 Ops/s	$\textbf{\color{#d91a1a}-11.70\%}$
test_dqn_speed	11.2259ms	1.6619ms	601.7100 Ops/s	594.7424 Ops/s	$\color{#35bf28}+1.17\%$
test_ddpg_speed	12.9135ms	3.6984ms	270.3875 Ops/s	265.5667 Ops/s	$\color{#35bf28}+1.82\%$
test_sac_speed	20.0443ms	10.4417ms	95.7700 Ops/s	94.3970 Ops/s	$\color{#35bf28}+1.45\%$
test_redq_speed	29.3826ms	20.0721ms	49.8203 Ops/s	50.4186 Ops/s	$\color{#d91a1a}-1.19\%$
test_redq_deprec_speed	93.2201ms	16.7588ms	59.6703 Ops/s	65.4454 Ops/s	$\textbf{\color{#d91a1a}-8.82\%}$
test_td3_speed	19.2709ms	10.7486ms	93.0352 Ops/s	91.9589 Ops/s	$\color{#35bf28}+1.17\%$
test_cql_speed	47.5770ms	38.8862ms	25.7161 Ops/s	25.1514 Ops/s	$\color{#35bf28}+2.24\%$
test_a2c_speed	17.1446ms	8.2953ms	120.5498 Ops/s	115.1173 Ops/s	$\color{#35bf28}+4.72\%$
test_ppo_speed	24.7220ms	9.1318ms	109.5076 Ops/s	110.8651 Ops/s	$\color{#d91a1a}-1.22\%$
test_reinforce_speed	15.8988ms	7.9052ms	126.4994 Ops/s	129.2874 Ops/s	$\color{#d91a1a}-2.16\%$
test_iql_speed	44.3881ms	35.5821ms	28.1040 Ops/s	28.0735 Ops/s	$\color{#35bf28}+0.11\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.9265ms	1.9076ms	524.2232 Ops/s	526.1666 Ops/s	$\color{#d91a1a}-0.37\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.1123s	2.3849ms	419.3085 Ops/s	491.4276 Ops/s	$\textbf{\color{#d91a1a}-14.68\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.7888ms	2.1586ms	463.2717 Ops/s	492.6048 Ops/s	$\textbf{\color{#d91a1a}-5.95\%}$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.0877ms	2.0212ms	494.7673 Ops/s	523.4436 Ops/s	$\textbf{\color{#d91a1a}-5.48\%}$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.1082s	2.3173ms	431.5322 Ops/s	499.7295 Ops/s	$\textbf{\color{#d91a1a}-13.65\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.3420ms	2.0863ms	479.3097 Ops/s	492.0028 Ops/s	$\color{#d91a1a}-2.58\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.5493ms	1.8997ms	526.4099 Ops/s	522.9126 Ops/s	$\color{#35bf28}+0.67\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.1153s	2.3099ms	432.9205 Ops/s	495.4940 Ops/s	$\textbf{\color{#d91a1a}-12.63\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	3.2936ms	2.0381ms	490.6580 Ops/s	485.2756 Ops/s	$\color{#35bf28}+1.11\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.2316ms	1.9679ms	508.1530 Ops/s	523.9757 Ops/s	$\color{#d91a1a}-3.02\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.1224s	2.3609ms	423.5704 Ops/s	493.5614 Ops/s	$\textbf{\color{#d91a1a}-14.18\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.2726ms	2.1454ms	466.1085 Ops/s	490.4542 Ops/s	$\color{#d91a1a}-4.96\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.0417ms	2.0700ms	483.0903 Ops/s	523.4609 Ops/s	$\textbf{\color{#d91a1a}-7.71\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.1388s	2.4057ms	415.6814 Ops/s	489.9113 Ops/s	$\textbf{\color{#d91a1a}-15.15\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.1455ms	2.0983ms	476.5670 Ops/s	488.9789 Ops/s	$\color{#d91a1a}-2.54\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.2752ms	1.9245ms	519.6278 Ops/s	522.3811 Ops/s	$\color{#d91a1a}-0.53\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.1557s	2.4297ms	411.5791 Ops/s	489.5738 Ops/s	$\textbf{\color{#d91a1a}-15.93\%}$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	3.7283ms	2.1335ms	468.7065 Ops/s	485.4379 Ops/s	$\color{#d91a1a}-3.45\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1884s	18.9116ms	52.8777 Ops/s	54.1238 Ops/s	$\color{#d91a1a}-2.30\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1218s	16.9415ms	59.0266 Ops/s	60.3820 Ops/s	$\color{#d91a1a}-2.24\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	0.1216s	17.0102ms	58.7881 Ops/s	60.0694 Ops/s	$\color{#d91a1a}-2.13\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1253s	17.2531ms	57.9607 Ops/s	54.2675 Ops/s	$\textbf{\color{#35bf28}+6.81\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1221s	16.9346ms	59.0507 Ops/s	60.2373 Ops/s	$\color{#d91a1a}-1.97\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.1193s	17.0129ms	58.7790 Ops/s	59.9137 Ops/s	$\color{#d91a1a}-1.89\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1290s	17.3608ms	57.6011 Ops/s	60.0091 Ops/s	$\color{#d91a1a}-4.01\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1196s	17.1924ms	58.1652 Ops/s	59.0153 Ops/s	$\color{#d91a1a}-1.44\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	0.1215s	16.8418ms	59.3760 Ops/s	59.2450 Ops/s	$\color{#35bf28}+0.22\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}7$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1230s	0.1211s	8.2568 Ops/s	8.3363 Ops/s	$\color{#d91a1a}-0.95\%$
test_sync	0.1125s	0.1039s	9.6274 Ops/s	9.6974 Ops/s	$\color{#d91a1a}-0.72\%$
test_async	0.2816s	0.1007s	9.9314 Ops/s	9.9401 Ops/s	$\color{#d91a1a}-0.09\%$
test_single_pixels	0.1319s	0.1313s	7.6169 Ops/s	7.6866 Ops/s	$\color{#d91a1a}-0.91\%$
test_sync_pixels	96.9462ms	94.9839ms	10.5281 Ops/s	10.4034 Ops/s	$\color{#35bf28}+1.20\%$
test_async_pixels	0.1850s	91.8215ms	10.8907 Ops/s	10.8636 Ops/s	$\color{#35bf28}+0.25\%$
test_simple	0.9531s	0.8767s	1.1407 Ops/s	1.1516 Ops/s	$\color{#d91a1a}-0.95\%$
test_transformed	1.1815s	1.1198s	0.8930 Ops/s	0.9141 Ops/s	$\color{#d91a1a}-2.31\%$
test_serial	2.5247s	2.4683s	0.4051 Ops/s	0.4132 Ops/s	$\color{#d91a1a}-1.96\%$
test_parallel	2.5642s	2.4800s	0.4032 Ops/s	0.4046 Ops/s	$\color{#d91a1a}-0.33\%$
test_step_mdp_speed[True-True-True-True-True]	0.1156ms	34.2554μs	29.1925 KOps/s	28.2348 KOps/s	$\color{#35bf28}+3.39\%$
test_step_mdp_speed[True-True-True-True-False]	45.8120μs	20.7429μs	48.2092 KOps/s	47.9376 KOps/s	$\color{#35bf28}+0.57\%$
test_step_mdp_speed[True-True-True-False-True]	36.9420μs	20.6316μs	48.4695 KOps/s	47.4229 KOps/s	$\color{#35bf28}+2.21\%$
test_step_mdp_speed[True-True-True-False-False]	28.3120μs	12.2435μs	81.6759 KOps/s	79.9276 KOps/s	$\color{#35bf28}+2.19\%$
test_step_mdp_speed[True-True-False-True-True]	62.4530μs	36.2162μs	27.6120 KOps/s	27.0986 KOps/s	$\color{#35bf28}+1.89\%$
test_step_mdp_speed[True-True-False-True-False]	37.9120μs	22.3886μs	44.6656 KOps/s	44.4035 KOps/s	$\color{#35bf28}+0.59\%$
test_step_mdp_speed[True-True-False-False-True]	46.2920μs	22.3619μs	44.7188 KOps/s	44.0247 KOps/s	$\color{#35bf28}+1.58\%$
test_step_mdp_speed[True-True-False-False-False]	31.4220μs	13.9939μs	71.4596 KOps/s	69.8674 KOps/s	$\color{#35bf28}+2.28\%$
test_step_mdp_speed[True-False-True-True-True]	57.7830μs	38.7236μs	25.8240 KOps/s	25.5162 KOps/s	$\color{#35bf28}+1.21\%$
test_step_mdp_speed[True-False-True-True-False]	49.8830μs	24.4085μs	40.9693 KOps/s	40.8175 KOps/s	$\color{#35bf28}+0.37\%$
test_step_mdp_speed[True-False-True-False-True]	56.6430μs	22.2675μs	44.9085 KOps/s	44.4331 KOps/s	$\color{#35bf28}+1.07\%$
test_step_mdp_speed[True-False-True-False-False]	33.1120μs	14.0712μs	71.0672 KOps/s	69.7485 KOps/s	$\color{#35bf28}+1.89\%$
test_step_mdp_speed[True-False-False-True-True]	71.7430μs	40.5382μs	24.6681 KOps/s	24.5448 KOps/s	$\color{#35bf28}+0.50\%$
test_step_mdp_speed[True-False-False-True-False]	44.9120μs	25.9002μs	38.6098 KOps/s	37.6899 KOps/s	$\color{#35bf28}+2.44\%$
test_step_mdp_speed[True-False-False-False-True]	41.7920μs	24.1921μs	41.3358 KOps/s	41.1322 KOps/s	$\color{#35bf28}+0.49\%$
test_step_mdp_speed[True-False-False-False-False]	39.9520μs	15.6990μs	63.6983 KOps/s	63.1641 KOps/s	$\color{#35bf28}+0.85\%$
test_step_mdp_speed[False-True-True-True-True]	59.3420μs	38.9463μs	25.6763 KOps/s	25.6511 KOps/s	$\color{#35bf28}+0.10\%$
test_step_mdp_speed[False-True-True-True-False]	44.0520μs	24.5824μs	40.6795 KOps/s	40.5570 KOps/s	$\color{#35bf28}+0.30\%$
test_step_mdp_speed[False-True-True-False-True]	46.4620μs	26.6202μs	37.5655 KOps/s	37.4901 KOps/s	$\color{#35bf28}+0.20\%$
test_step_mdp_speed[False-True-True-False-False]	31.4710μs	16.0421μs	62.3359 KOps/s	60.9153 KOps/s	$\color{#35bf28}+2.33\%$
test_step_mdp_speed[False-True-False-True-True]	73.7140μs	40.3072μs	24.8095 KOps/s	24.3214 KOps/s	$\color{#35bf28}+2.01\%$
test_step_mdp_speed[False-True-False-True-False]	50.5530μs	25.9494μs	38.5366 KOps/s	37.7896 KOps/s	$\color{#35bf28}+1.98\%$
test_step_mdp_speed[False-True-False-False-True]	44.6120μs	28.4411μs	35.1604 KOps/s	35.3542 KOps/s	$\color{#d91a1a}-0.55\%$
test_step_mdp_speed[False-True-False-False-False]	35.3320μs	17.9586μs	55.6836 KOps/s	55.6841 KOps/s	$-0.00\%$
test_step_mdp_speed[False-False-True-True-True]	62.3420μs	42.1970μs	23.6984 KOps/s	23.5496 KOps/s	$\color{#35bf28}+0.63\%$
test_step_mdp_speed[False-False-True-True-False]	43.8920μs	27.9757μs	35.7453 KOps/s	35.5092 KOps/s	$\color{#35bf28}+0.67\%$
test_step_mdp_speed[False-False-True-False-True]	54.7730μs	28.4454μs	35.1550 KOps/s	35.5394 KOps/s	$\color{#d91a1a}-1.08\%$
test_step_mdp_speed[False-False-True-False-False]	55.2220μs	18.2659μs	54.7467 KOps/s	55.5909 KOps/s	$\color{#d91a1a}-1.52\%$
test_step_mdp_speed[False-False-False-True-True]	63.4230μs	44.3900μs	22.5276 KOps/s	22.9663 KOps/s	$\color{#d91a1a}-1.91\%$
test_step_mdp_speed[False-False-False-True-False]	63.0230μs	30.3488μs	32.9503 KOps/s	33.6037 KOps/s	$\color{#d91a1a}-1.94\%$
test_step_mdp_speed[False-False-False-False-True]	51.0020μs	30.0756μs	33.2495 KOps/s	33.9035 KOps/s	$\color{#d91a1a}-1.93\%$
test_step_mdp_speed[False-False-False-False-False]	42.8320μs	19.6812μs	50.8098 KOps/s	50.1935 KOps/s	$\color{#35bf28}+1.23\%$
test_values[generalized_advantage_estimate-True-True]	25.3680ms	24.8107ms	40.3052 Ops/s	41.5119 Ops/s	$\color{#d91a1a}-2.91\%$
test_values[vec_generalized_advantage_estimate-True-True]	86.7802ms	3.2867ms	304.2605 Ops/s	302.1244 Ops/s	$\color{#35bf28}+0.71\%$
test_values[td0_return_estimate-False-False]	0.1003ms	63.6093μs	15.7210 KOps/s	16.0844 KOps/s	$\color{#d91a1a}-2.26\%$
test_values[td1_return_estimate-False-False]	56.6762ms	56.1913ms	17.7964 Ops/s	19.0145 Ops/s	$\textbf{\color{#d91a1a}-6.41\%}$
test_values[vec_td1_return_estimate-False-False]	2.0406ms	1.7241ms	580.0232 Ops/s	578.0962 Ops/s	$\color{#35bf28}+0.33\%$
test_values[td_lambda_return_estimate-True-False]	87.8953ms	86.2301ms	11.5969 Ops/s	11.1285 Ops/s	$\color{#35bf28}+4.21\%$
test_values[vec_td_lambda_return_estimate-True-False]	2.0222ms	1.7342ms	576.6448 Ops/s	580.4118 Ops/s	$\color{#d91a1a}-0.65\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	23.7392ms	23.6215ms	42.3343 Ops/s	43.2882 Ops/s	$\color{#d91a1a}-2.20\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.8849ms	0.7127ms	1.4031 KOps/s	1.4228 KOps/s	$\color{#d91a1a}-1.38\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7473ms	0.6720ms	1.4880 KOps/s	1.4958 KOps/s	$\color{#d91a1a}-0.52\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.4930ms	1.4662ms	682.0524 Ops/s	686.9158 Ops/s	$\color{#d91a1a}-0.71\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.9505ms	0.7014ms	1.4258 KOps/s	1.4330 KOps/s	$\color{#d91a1a}-0.50\%$
test_dqn_speed	7.6118ms	1.4714ms	679.6303 Ops/s	691.1134 Ops/s	$\color{#d91a1a}-1.66\%$
test_ddpg_speed	4.6609ms	3.2965ms	303.3478 Ops/s	303.7901 Ops/s	$\color{#d91a1a}-0.15\%$
test_sac_speed	10.3358ms	9.2124ms	108.5495 Ops/s	107.5920 Ops/s	$\color{#35bf28}+0.89\%$
test_redq_speed	19.5815ms	16.8070ms	59.4989 Ops/s	59.2169 Ops/s	$\color{#35bf28}+0.48\%$
test_redq_deprec_speed	0.1025s	14.1001ms	70.9216 Ops/s	75.4990 Ops/s	$\textbf{\color{#d91a1a}-6.06\%}$
test_td3_speed	9.5202ms	9.3353ms	107.1202 Ops/s	105.9796 Ops/s	$\color{#35bf28}+1.08\%$
test_cql_speed	0.1337s	34.4027ms	29.0675 Ops/s	31.9448 Ops/s	$\textbf{\color{#d91a1a}-9.01\%}$
test_a2c_speed	8.4601ms	7.0169ms	142.5134 Ops/s	138.8935 Ops/s	$\color{#35bf28}+2.61\%$
test_ppo_speed	8.7850ms	7.3110ms	136.7807 Ops/s	133.5456 Ops/s	$\color{#35bf28}+2.42\%$
test_reinforce_speed	7.5083ms	6.0518ms	165.2397 Ops/s	162.3136 Ops/s	$\color{#35bf28}+1.80\%$
test_iql_speed	28.8060ms	27.0311ms	36.9944 Ops/s	36.5882 Ops/s	$\color{#35bf28}+1.11\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.1670ms	2.5354ms	394.4113 Ops/s	398.3367 Ops/s	$\color{#d91a1a}-0.99\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	3.8125ms	2.6971ms	370.7733 Ops/s	331.5528 Ops/s	$\textbf{\color{#35bf28}+11.83\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.3650ms	2.6973ms	370.7410 Ops/s	372.2709 Ops/s	$\color{#d91a1a}-0.41\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.1246ms	2.5236ms	396.2629 Ops/s	397.9673 Ops/s	$\color{#d91a1a}-0.43\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	3.9176ms	2.6893ms	371.8476 Ops/s	328.8600 Ops/s	$\textbf{\color{#35bf28}+13.07\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.6779ms	2.7043ms	369.7860 Ops/s	369.9539 Ops/s	$\color{#d91a1a}-0.05\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.1684ms	2.5100ms	398.3997 Ops/s	396.2704 Ops/s	$\color{#35bf28}+0.54\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.7490ms	2.6984ms	370.5878 Ops/s	329.8786 Ops/s	$\textbf{\color{#35bf28}+12.34\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	3.6226ms	2.6941ms	371.1875 Ops/s	369.4063 Ops/s	$\color{#35bf28}+0.48\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.1984ms	2.5054ms	399.1390 Ops/s	396.2270 Ops/s	$\color{#35bf28}+0.73\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	3.7498ms	2.7082ms	369.2495 Ops/s	330.0929 Ops/s	$\textbf{\color{#35bf28}+11.86\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.9601ms	2.7033ms	369.9134 Ops/s	367.0803 Ops/s	$\color{#35bf28}+0.77\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.2452ms	2.5109ms	398.2694 Ops/s	394.6903 Ops/s	$\color{#35bf28}+0.91\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	4.2788ms	2.7179ms	367.9245 Ops/s	327.6362 Ops/s	$\textbf{\color{#35bf28}+12.30\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	4.0708ms	2.7076ms	369.3354 Ops/s	368.4827 Ops/s	$\color{#35bf28}+0.23\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.7364ms	2.5110ms	398.2479 Ops/s	395.0193 Ops/s	$\color{#35bf28}+0.82\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.8019ms	2.7078ms	369.2993 Ops/s	328.0052 Ops/s	$\textbf{\color{#35bf28}+12.59\%}$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.0583ms	2.7121ms	368.7232 Ops/s	367.2563 Ops/s	$\color{#35bf28}+0.40\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.2282s	19.9029ms	50.2438 Ops/s	51.4196 Ops/s	$\color{#d91a1a}-2.29\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1281s	17.8001ms	56.1794 Ops/s	56.2106 Ops/s	$\color{#d91a1a}-0.06\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	0.1314s	17.7812ms	56.2391 Ops/s	55.8524 Ops/s	$\color{#35bf28}+0.69\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1301s	15.5977ms	64.1119 Ops/s	55.8790 Ops/s	$\textbf{\color{#35bf28}+14.73\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1286s	17.9081ms	55.8407 Ops/s	55.6356 Ops/s	$\color{#35bf28}+0.37\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.1296s	17.8896ms	55.8983 Ops/s	64.4824 Ops/s	$\textbf{\color{#d91a1a}-13.31\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1296s	17.9403ms	55.7403 Ops/s	56.5178 Ops/s	$\color{#d91a1a}-1.38\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1311s	17.7625ms	56.2983 Ops/s	56.0888 Ops/s	$\color{#35bf28}+0.37\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	0.1288s	17.8787ms	55.9323 Ops/s	55.7210 Ops/s	$\color{#35bf28}+0.38\%$

[pytorch-bot]

No ciflow labels are configured for this repo.
For information on how to enable CIFlow bot see this wiki