[CI] Fix wheels

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2274

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures

As of commit eeb6dd8 with merge base 55f0a52 ():

NEW FAILURES - The following jobs have failed:

• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t c0b6fa13ca3b1c8f74f1f116a23b49de8e7314100c9eac54236fadfb6a0197b1 /exec failed with exit code 139
• RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
  RuntimeError: vmap: It looks like you're attempting to use a Tensor in some data-dependent control flow. We don't support that yet, please shout over at https://github.com/pytorch/functorch/issues/257 .
• Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 17d4946fd6f6379c4e62ebe57abb5b7d0484e604931c4c023f125c2be967f27a /exec failed with exit code 1
• Unit-tests on Windows / unittests-cpu / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}9$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1133s	60.6913ms	16.4768 Ops/s	17.8317 Ops/s	$\textbf{\color{#d91a1a}-7.60\%}$
test_sync	32.8280ms	30.4139ms	32.8798 Ops/s	31.5328 Ops/s	$\color{#35bf28}+4.27\%$
test_async	55.2094ms	29.8463ms	33.5050 Ops/s	35.9358 Ops/s	$\textbf{\color{#d91a1a}-6.76\%}$
test_simple	0.3883s	0.3831s	2.6101 Ops/s	2.6292 Ops/s	$\color{#d91a1a}-0.72\%$
test_transformed	0.5467s	0.5421s	1.8448 Ops/s	1.8192 Ops/s	$\color{#35bf28}+1.41\%$
test_serial	1.3481s	1.2876s	0.7767 Ops/s	0.7707 Ops/s	$\color{#35bf28}+0.77\%$
test_parallel	1.1494s	1.0963s	0.9121 Ops/s	0.9192 Ops/s	$\color{#d91a1a}-0.77\%$
test_step_mdp_speed[True-True-True-True-True]	0.1178ms	22.3991μs	44.6447 KOps/s	44.4367 KOps/s	$\color{#35bf28}+0.47\%$
test_step_mdp_speed[True-True-True-True-False]	58.8500μs	13.0768μs	76.4711 KOps/s	75.1277 KOps/s	$\color{#35bf28}+1.79\%$
test_step_mdp_speed[True-True-True-False-True]	36.9690μs	12.9558μs	77.1856 KOps/s	75.9130 KOps/s	$\color{#35bf28}+1.68\%$
test_step_mdp_speed[True-True-True-False-False]	37.8900μs	7.5913μs	131.7295 KOps/s	130.4944 KOps/s	$\color{#35bf28}+0.95\%$
test_step_mdp_speed[True-True-False-True-True]	55.0930μs	23.8283μs	41.9670 KOps/s	42.2074 KOps/s	$\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-True-False-True-False]	55.1630μs	14.4923μs	69.0023 KOps/s	68.6509 KOps/s	$\color{#35bf28}+0.51\%$
test_step_mdp_speed[True-True-False-False-True]	42.2680μs	14.1209μs	70.8172 KOps/s	69.6949 KOps/s	$\color{#35bf28}+1.61\%$
test_step_mdp_speed[True-True-False-False-False]	44.2710μs	8.8606μs	112.8591 KOps/s	111.9566 KOps/s	$\color{#35bf28}+0.81\%$
test_step_mdp_speed[True-False-True-True-True]	82.5840μs	25.0485μs	39.9225 KOps/s	39.3415 KOps/s	$\color{#35bf28}+1.48\%$
test_step_mdp_speed[True-False-True-True-False]	65.3520μs	15.8258μs	63.1879 KOps/s	62.9884 KOps/s	$\color{#35bf28}+0.32\%$
test_step_mdp_speed[True-False-True-False-True]	49.0810μs	14.1639μs	70.6022 KOps/s	70.4605 KOps/s	$\color{#35bf28}+0.20\%$
test_step_mdp_speed[True-False-True-False-False]	50.2030μs	8.9405μs	111.8502 KOps/s	112.7780 KOps/s	$\color{#d91a1a}-0.82\%$
test_step_mdp_speed[True-False-False-True-True]	58.6390μs	26.4363μs	37.8268 KOps/s	38.0422 KOps/s	$\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-False-False-True-False]	61.4750μs	17.1840μs	58.1937 KOps/s	58.6982 KOps/s	$\color{#d91a1a}-0.86\%$
test_step_mdp_speed[True-False-False-False-True]	36.5970μs	15.3575μs	65.1149 KOps/s	64.9990 KOps/s	$\color{#35bf28}+0.18\%$
test_step_mdp_speed[True-False-False-False-False]	57.6070μs	10.1063μs	98.9486 KOps/s	99.1345 KOps/s	$\color{#d91a1a}-0.19\%$
test_step_mdp_speed[False-True-True-True-True]	57.4070μs	24.9791μs	40.0335 KOps/s	39.2078 KOps/s	$\color{#35bf28}+2.11\%$
test_step_mdp_speed[False-True-True-True-False]	62.1450μs	15.8447μs	63.1126 KOps/s	63.1600 KOps/s	$\color{#d91a1a}-0.07\%$
test_step_mdp_speed[False-True-True-False-True]	55.4530μs	16.3175μs	61.2840 KOps/s	60.2442 KOps/s	$\color{#35bf28}+1.73\%$
test_step_mdp_speed[False-True-True-False-False]	34.2840μs	10.0873μs	99.1348 KOps/s	98.2056 KOps/s	$\color{#35bf28}+0.95\%$
test_step_mdp_speed[False-True-False-True-True]	85.3990μs	26.2286μs	38.1263 KOps/s	37.5689 KOps/s	$\color{#35bf28}+1.48\%$
test_step_mdp_speed[False-True-False-True-False]	48.5800μs	17.0984μs	58.4849 KOps/s	58.2159 KOps/s	$\color{#35bf28}+0.46\%$
test_step_mdp_speed[False-True-False-False-True]	67.4250μs	17.6229μs	56.7443 KOps/s	56.7441 KOps/s	$+0.00\%$
test_step_mdp_speed[False-True-False-False-False]	39.3030μs	11.2652μs	88.7692 KOps/s	88.2717 KOps/s	$\color{#35bf28}+0.56\%$
test_step_mdp_speed[False-False-True-True-True]	78.2050μs	27.5510μs	36.2964 KOps/s	35.9105 KOps/s	$\color{#35bf28}+1.07\%$
test_step_mdp_speed[False-False-True-True-False]	67.6360μs	18.3891μs	54.3801 KOps/s	54.6510 KOps/s	$\color{#d91a1a}-0.50\%$
test_step_mdp_speed[False-False-True-False-True]	54.1900μs	17.5263μs	57.0570 KOps/s	56.1994 KOps/s	$\color{#35bf28}+1.53\%$
test_step_mdp_speed[False-False-True-False-False]	63.4880μs	11.3449μs	88.1456 KOps/s	87.7756 KOps/s	$\color{#35bf28}+0.42\%$
test_step_mdp_speed[False-False-False-True-True]	54.9020μs	29.3276μs	34.0976 KOps/s	34.1634 KOps/s	$\color{#d91a1a}-0.19\%$
test_step_mdp_speed[False-False-False-True-False]	43.7920μs	19.6199μs	50.9687 KOps/s	51.4367 KOps/s	$\color{#d91a1a}-0.91\%$
test_step_mdp_speed[False-False-False-False-True]	80.2490μs	18.7090μs	53.4502 KOps/s	53.0990 KOps/s	$\color{#35bf28}+0.66\%$
test_step_mdp_speed[False-False-False-False-False]	60.0010μs	12.5060μs	79.9619 KOps/s	79.7121 KOps/s	$\color{#35bf28}+0.31\%$
test_values[generalized_advantage_estimate-True-True]	12.4051ms	9.8002ms	102.0386 Ops/s	105.6001 Ops/s	$\color{#d91a1a}-3.37\%$
test_values[vec_generalized_advantage_estimate-True-True]	37.5759ms	35.7682ms	27.9578 Ops/s	29.5193 Ops/s	$\textbf{\color{#d91a1a}-5.29\%}$
test_values[td0_return_estimate-False-False]	0.2294ms	0.1678ms	5.9611 KOps/s	6.0805 KOps/s	$\color{#d91a1a}-1.96\%$
test_values[td1_return_estimate-False-False]	24.3173ms	23.9959ms	41.6738 Ops/s	42.6145 Ops/s	$\color{#d91a1a}-2.21\%$
test_values[vec_td1_return_estimate-False-False]	36.7047ms	35.4929ms	28.1747 Ops/s	29.8035 Ops/s	$\textbf{\color{#d91a1a}-5.47\%}$
test_values[td_lambda_return_estimate-True-False]	52.6156ms	35.1163ms	28.4768 Ops/s	29.7428 Ops/s	$\color{#d91a1a}-4.26\%$
test_values[vec_td_lambda_return_estimate-True-False]	36.8078ms	35.5183ms	28.1545 Ops/s	29.8423 Ops/s	$\textbf{\color{#d91a1a}-5.66\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	8.7156ms	8.4573ms	118.2411 Ops/s	119.8598 Ops/s	$\color{#d91a1a}-1.35\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.2939ms	1.9541ms	511.7375 Ops/s	554.7994 Ops/s	$\textbf{\color{#d91a1a}-7.76\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.4383ms	0.3602ms	2.7759 KOps/s	2.7949 KOps/s	$\color{#d91a1a}-0.68\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	57.2394ms	45.1786ms	22.1344 Ops/s	24.7756 Ops/s	$\textbf{\color{#d91a1a}-10.66\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	3.5514ms	3.0301ms	330.0272 Ops/s	330.7233 Ops/s	$\color{#d91a1a}-0.21\%$
test_dqn_speed	1.5453ms	1.3464ms	742.7354 Ops/s	734.0288 Ops/s	$\color{#35bf28}+1.19\%$
test_ddpg_speed	3.6237ms	2.8570ms	350.0154 Ops/s	346.7526 Ops/s	$\color{#35bf28}+0.94\%$
test_sac_speed	8.9748ms	8.5315ms	117.2130 Ops/s	116.6505 Ops/s	$\color{#35bf28}+0.48\%$
test_redq_speed	15.0449ms	13.5719ms	73.6817 Ops/s	68.2602 Ops/s	$\textbf{\color{#35bf28}+7.94\%}$
test_redq_deprec_speed	15.8565ms	13.3493ms	74.9105 Ops/s	74.3279 Ops/s	$\color{#35bf28}+0.78\%$
test_td3_speed	17.2640ms	8.5920ms	116.3868 Ops/s	118.6156 Ops/s	$\color{#d91a1a}-1.88\%$
test_cql_speed	38.5518ms	36.9767ms	27.0440 Ops/s	27.1993 Ops/s	$\color{#d91a1a}-0.57\%$
test_a2c_speed	8.6091ms	7.5172ms	133.0281 Ops/s	134.4937 Ops/s	$\color{#d91a1a}-1.09\%$
test_ppo_speed	8.8463ms	7.7879ms	128.4045 Ops/s	129.1783 Ops/s	$\color{#d91a1a}-0.60\%$
test_reinforce_speed	7.8658ms	6.7357ms	148.4632 Ops/s	150.0001 Ops/s	$\color{#d91a1a}-1.02\%$
test_iql_speed	33.6251ms	32.8297ms	30.4602 Ops/s	30.6471 Ops/s	$\color{#d91a1a}-0.61\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	5.1533ms	3.5345ms	282.9256 Ops/s	283.1028 Ops/s	$\color{#d91a1a}-0.06\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	95.4931ms	0.5557ms	1.7995 KOps/s	2.0396 KOps/s	$\textbf{\color{#d91a1a}-11.77\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7865ms	0.4711ms	2.1228 KOps/s	2.1211 KOps/s	$\color{#35bf28}+0.08\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.8623ms	3.5125ms	284.6990 Ops/s	286.9477 Ops/s	$\color{#d91a1a}-0.78\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.9925ms	0.4838ms	2.0670 KOps/s	2.0393 KOps/s	$\color{#35bf28}+1.36\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.7806ms	0.4661ms	2.1453 KOps/s	2.1578 KOps/s	$\color{#d91a1a}-0.58\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	2.6017ms	1.7430ms	573.7100 Ops/s	578.5677 Ops/s	$\color{#d91a1a}-0.84\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.7980ms	1.6403ms	609.6526 Ops/s	608.0533 Ops/s	$\color{#35bf28}+0.26\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.9939ms	3.6561ms	273.5123 Ops/s	271.5910 Ops/s	$\color{#35bf28}+0.71\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.1458ms	0.6297ms	1.5880 KOps/s	1.5898 KOps/s	$\color{#d91a1a}-0.11\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8845ms	0.6076ms	1.6460 KOps/s	1.6476 KOps/s	$\color{#d91a1a}-0.10\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	5.1813ms	3.5463ms	281.9804 Ops/s	285.4440 Ops/s	$\color{#d91a1a}-1.21\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.1033ms	0.4955ms	2.0182 KOps/s	2.0316 KOps/s	$\color{#d91a1a}-0.66\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6458ms	0.4725ms	2.1163 KOps/s	2.1091 KOps/s	$\color{#35bf28}+0.34\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.7199ms	3.5030ms	285.4705 Ops/s	286.4747 Ops/s	$\color{#d91a1a}-0.35\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.8866ms	0.4964ms	2.0145 KOps/s	2.0419 KOps/s	$\color{#d91a1a}-1.34\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.9072ms	0.4813ms	2.0777 KOps/s	2.1448 KOps/s	$\color{#d91a1a}-3.13\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.7646ms	3.6196ms	276.2707 Ops/s	270.5523 Ops/s	$\color{#35bf28}+2.11\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.8305ms	0.6292ms	1.5893 KOps/s	1.5695 KOps/s	$\color{#35bf28}+1.26\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.9446ms	0.6115ms	1.6352 KOps/s	1.6532 KOps/s	$\color{#d91a1a}-1.09\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1129s	7.9958ms	125.0655 Ops/s	163.2303 Ops/s	$\textbf{\color{#d91a1a}-23.38\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	15.0805ms	12.5195ms	79.8755 Ops/s	80.2779 Ops/s	$\color{#d91a1a}-0.50\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	1.0835ms	1.0365ms	964.8019 Ops/s	966.8589 Ops/s	$\color{#d91a1a}-0.21\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1068s	5.7493ms	173.9335 Ops/s	127.3057 Ops/s	$\textbf{\color{#35bf28}+36.63\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	15.1361ms	12.5066ms	79.9576 Ops/s	80.8227 Ops/s	$\color{#d91a1a}-1.07\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	1.1497ms	1.0338ms	967.3420 Ops/s	899.4478 Ops/s	$\textbf{\color{#35bf28}+7.55\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1082s	5.9249ms	168.7787 Ops/s	165.0446 Ops/s	$\color{#35bf28}+2.26\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	15.1327ms	12.6564ms	79.0113 Ops/s	79.8674 Ops/s	$\color{#d91a1a}-1.07\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	1.8865ms	1.2249ms	816.3823 Ops/s	805.2296 Ops/s	$\color{#35bf28}+1.39\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1593s	0.1078s	9.2729 Ops/s	9.7617 Ops/s	$\textbf{\color{#d91a1a}-5.01\%}$
test_sync	94.0399ms	89.6388ms	11.1559 Ops/s	11.2243 Ops/s	$\color{#d91a1a}-0.61\%$
test_async	0.1767s	88.0854ms	11.3526 Ops/s	11.7288 Ops/s	$\color{#d91a1a}-3.21\%$
test_single_pixels	0.1137s	0.1136s	8.8061 Ops/s	8.8372 Ops/s	$\color{#d91a1a}-0.35\%$
test_sync_pixels	77.5263ms	73.4225ms	13.6198 Ops/s	14.8636 Ops/s	$\textbf{\color{#d91a1a}-8.37\%}$
test_async_pixels	0.1197s	56.4286ms	17.7215 Ops/s	17.5905 Ops/s	$\color{#35bf28}+0.74\%$
test_simple	0.7284s	0.7279s	1.3738 Ops/s	1.3420 Ops/s	$\color{#35bf28}+2.37\%$
test_transformed	1.0253s	0.9662s	1.0350 Ops/s	1.0322 Ops/s	$\color{#35bf28}+0.27\%$
test_serial	2.2163s	2.1575s	0.4635 Ops/s	0.4638 Ops/s	$\color{#d91a1a}-0.06\%$
test_parallel	1.9143s	1.8533s	0.5396 Ops/s	0.5455 Ops/s	$\color{#d91a1a}-1.08\%$
test_step_mdp_speed[True-True-True-True-True]	94.0110μs	33.4885μs	29.8610 KOps/s	29.9388 KOps/s	$\color{#d91a1a}-0.26\%$
test_step_mdp_speed[True-True-True-True-False]	34.2410μs	19.4606μs	51.3860 KOps/s	50.5168 KOps/s	$\color{#35bf28}+1.72\%$
test_step_mdp_speed[True-True-True-False-True]	38.2410μs	19.4432μs	51.4318 KOps/s	53.3128 KOps/s	$\color{#d91a1a}-3.53\%$
test_step_mdp_speed[True-True-True-False-False]	43.8410μs	11.1023μs	90.0716 KOps/s	90.6479 KOps/s	$\color{#d91a1a}-0.64\%$
test_step_mdp_speed[True-True-False-True-True]	63.1320μs	35.3589μs	28.2815 KOps/s	28.1465 KOps/s	$\color{#35bf28}+0.48\%$
test_step_mdp_speed[True-True-False-True-False]	38.4600μs	21.3475μs	46.8438 KOps/s	46.1648 KOps/s	$\color{#35bf28}+1.47\%$
test_step_mdp_speed[True-True-False-False-True]	40.1910μs	21.0728μs	47.4545 KOps/s	48.1404 KOps/s	$\color{#d91a1a}-1.42\%$
test_step_mdp_speed[True-True-False-False-False]	27.6810μs	13.0077μs	76.8774 KOps/s	76.9248 KOps/s	$\color{#d91a1a}-0.06\%$
test_step_mdp_speed[True-False-True-True-True]	68.7710μs	37.1844μs	26.8930 KOps/s	26.7731 KOps/s	$\color{#35bf28}+0.45\%$
test_step_mdp_speed[True-False-True-True-False]	61.4210μs	23.4159μs	42.7061 KOps/s	42.3617 KOps/s	$\color{#35bf28}+0.81\%$
test_step_mdp_speed[True-False-True-False-True]	56.5120μs	21.1465μs	47.2890 KOps/s	47.9640 KOps/s	$\color{#d91a1a}-1.41\%$
test_step_mdp_speed[True-False-True-False-False]	31.8010μs	13.0983μs	76.3458 KOps/s	76.2890 KOps/s	$\color{#35bf28}+0.07\%$
test_step_mdp_speed[True-False-False-True-True]	58.1420μs	40.0419μs	24.9739 KOps/s	25.6845 KOps/s	$\color{#d91a1a}-2.77\%$
test_step_mdp_speed[True-False-False-True-False]	45.9110μs	25.2680μs	39.5757 KOps/s	39.8031 KOps/s	$\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-False-False-False-True]	45.2610μs	22.8134μs	43.8338 KOps/s	44.6125 KOps/s	$\color{#d91a1a}-1.75\%$
test_step_mdp_speed[True-False-False-False-False]	39.2610μs	14.8138μs	67.5047 KOps/s	67.5878 KOps/s	$\color{#d91a1a}-0.12\%$
test_step_mdp_speed[False-True-True-True-True]	55.6210μs	37.7737μs	26.4734 KOps/s	26.7086 KOps/s	$\color{#d91a1a}-0.88\%$
test_step_mdp_speed[False-True-True-True-False]	42.8510μs	23.3204μs	42.8809 KOps/s	42.8320 KOps/s	$\color{#35bf28}+0.11\%$
test_step_mdp_speed[False-True-True-False-True]	42.9410μs	25.1433μs	39.7720 KOps/s	40.8428 KOps/s	$\color{#d91a1a}-2.62\%$
test_step_mdp_speed[False-True-True-False-False]	31.3910μs	14.8219μs	67.4677 KOps/s	68.0054 KOps/s	$\color{#d91a1a}-0.79\%$
test_step_mdp_speed[False-True-False-True-True]	68.9620μs	39.6498μs	25.2208 KOps/s	25.4109 KOps/s	$\color{#d91a1a}-0.75\%$
test_step_mdp_speed[False-True-False-True-False]	51.0010μs	25.1011μs	39.8389 KOps/s	39.6838 KOps/s	$\color{#35bf28}+0.39\%$
test_step_mdp_speed[False-True-False-False-True]	58.1910μs	27.0702μs	36.9410 KOps/s	37.7056 KOps/s	$\color{#d91a1a}-2.03\%$
test_step_mdp_speed[False-True-False-False-False]	33.9310μs	16.8052μs	59.5053 KOps/s	60.4605 KOps/s	$\color{#d91a1a}-1.58\%$
test_step_mdp_speed[False-False-True-True-True]	62.4820μs	41.1494μs	24.3017 KOps/s	24.2172 KOps/s	$\color{#35bf28}+0.35\%$
test_step_mdp_speed[False-False-True-True-False]	62.2110μs	27.1674μs	36.8088 KOps/s	36.9999 KOps/s	$\color{#d91a1a}-0.52\%$
test_step_mdp_speed[False-False-True-False-True]	45.0910μs	27.2924μs	36.6402 KOps/s	37.6108 KOps/s	$\color{#d91a1a}-2.58\%$
test_step_mdp_speed[False-False-True-False-False]	33.9810μs	16.7734μs	59.6183 KOps/s	60.3857 KOps/s	$\color{#d91a1a}-1.27\%$
test_step_mdp_speed[False-False-False-True-True]	60.4510μs	43.3336μs	23.0768 KOps/s	23.1053 KOps/s	$\color{#d91a1a}-0.12\%$
test_step_mdp_speed[False-False-False-True-False]	48.8410μs	28.8712μs	34.6366 KOps/s	34.5541 KOps/s	$\color{#35bf28}+0.24\%$
test_step_mdp_speed[False-False-False-False-True]	51.7120μs	28.5036μs	35.0833 KOps/s	35.4546 KOps/s	$\color{#d91a1a}-1.05\%$
test_step_mdp_speed[False-False-False-False-False]	32.3410μs	18.3883μs	54.3825 KOps/s	54.8329 KOps/s	$\color{#d91a1a}-0.82\%$
test_values[generalized_advantage_estimate-True-True]	25.5054ms	25.1373ms	39.7815 Ops/s	41.7152 Ops/s	$\color{#d91a1a}-4.64\%$
test_values[vec_generalized_advantage_estimate-True-True]	88.6059ms	2.6696ms	374.5861 Ops/s	375.3119 Ops/s	$\color{#d91a1a}-0.19\%$
test_values[td0_return_estimate-False-False]	89.2110μs	66.8998μs	14.9477 KOps/s	15.2577 KOps/s	$\color{#d91a1a}-2.03\%$
test_values[td1_return_estimate-False-False]	59.8487ms	56.7115ms	17.6331 Ops/s	18.5941 Ops/s	$\textbf{\color{#d91a1a}-5.17\%}$
test_values[vec_td1_return_estimate-False-False]	1.4196ms	1.0867ms	920.2372 Ops/s	929.0121 Ops/s	$\color{#d91a1a}-0.94\%$
test_values[td_lambda_return_estimate-True-False]	94.6585ms	90.5078ms	11.0488 Ops/s	11.6054 Ops/s	$\color{#d91a1a}-4.80\%$
test_values[vec_td_lambda_return_estimate-True-False]	1.3765ms	1.0833ms	923.1342 Ops/s	930.6330 Ops/s	$\color{#d91a1a}-0.81\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	25.1524ms	24.8781ms	40.1960 Ops/s	41.7266 Ops/s	$\color{#d91a1a}-3.67\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.9432ms	0.7262ms	1.3770 KOps/s	1.4040 KOps/s	$\color{#d91a1a}-1.92\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7575ms	0.6725ms	1.4869 KOps/s	1.5119 KOps/s	$\color{#d91a1a}-1.65\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.5029ms	1.4743ms	678.2697 Ops/s	683.6668 Ops/s	$\color{#d91a1a}-0.79\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.7186ms	0.6874ms	1.4548 KOps/s	1.4805 KOps/s	$\color{#d91a1a}-1.74\%$
test_dqn_speed	7.5964ms	1.4618ms	684.0739 Ops/s	687.8013 Ops/s	$\color{#d91a1a}-0.54\%$
test_ddpg_speed	3.1726ms	2.9208ms	342.3688 Ops/s	340.6200 Ops/s	$\color{#35bf28}+0.51\%$
test_sac_speed	10.2306ms	8.4199ms	118.7669 Ops/s	117.9897 Ops/s	$\color{#35bf28}+0.66\%$
test_redq_speed	0.1021s	11.6594ms	85.7679 Ops/s	93.5426 Ops/s	$\textbf{\color{#d91a1a}-8.31\%}$
test_redq_deprec_speed	12.3232ms	11.6631ms	85.7407 Ops/s	80.7719 Ops/s	$\textbf{\color{#35bf28}+6.15\%}$
test_td3_speed	8.5112ms	8.3459ms	119.8190 Ops/s	119.8441 Ops/s	$\color{#d91a1a}-0.02\%$
test_cql_speed	26.0181ms	25.6010ms	39.0610 Ops/s	39.2509 Ops/s	$\color{#d91a1a}-0.48\%$
test_a2c_speed	7.2819ms	5.8053ms	172.2552 Ops/s	178.3708 Ops/s	$\color{#d91a1a}-3.43\%$
test_ppo_speed	6.4730ms	6.1143ms	163.5499 Ops/s	169.2842 Ops/s	$\color{#d91a1a}-3.39\%$
test_reinforce_speed	4.9549ms	4.6856ms	213.4215 Ops/s	217.5964 Ops/s	$\color{#d91a1a}-1.92\%$
test_iql_speed	20.5337ms	19.6179ms	50.9738 Ops/s	51.3936 Ops/s	$\color{#d91a1a}-0.82\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	4.7898ms	4.6913ms	213.1586 Ops/s	219.0961 Ops/s	$\color{#d91a1a}-2.71\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.6762ms	0.5419ms	1.8453 KOps/s	1.8466 KOps/s	$\color{#d91a1a}-0.07\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.2209ms	0.5225ms	1.9138 KOps/s	1.9115 KOps/s	$\color{#35bf28}+0.12\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	4.9586ms	4.6287ms	216.0442 Ops/s	220.7545 Ops/s	$\color{#d91a1a}-2.13\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.6330ms	0.5354ms	1.8679 KOps/s	1.8650 KOps/s	$\color{#35bf28}+0.16\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	4.3004ms	0.5168ms	1.9349 KOps/s	1.9176 KOps/s	$\color{#35bf28}+0.91\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	2.2196ms	2.0045ms	498.8747 Ops/s	504.8624 Ops/s	$\color{#d91a1a}-1.19\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	5.4647ms	1.9139ms	522.4952 Ops/s	526.7727 Ops/s	$\color{#d91a1a}-0.81\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	4.9407ms	4.7891ms	208.8057 Ops/s	210.2693 Ops/s	$\color{#d91a1a}-0.70\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.8016ms	0.6896ms	1.4502 KOps/s	1.4486 KOps/s	$\color{#35bf28}+0.11\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.1345s	0.7793ms	1.2832 KOps/s	1.4923 KOps/s	$\textbf{\color{#d91a1a}-14.02\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	4.7581ms	4.6704ms	214.1122 Ops/s	218.4090 Ops/s	$\color{#d91a1a}-1.97\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.7131ms	0.5421ms	1.8448 KOps/s	1.8430 KOps/s	$\color{#35bf28}+0.10\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6396ms	0.5183ms	1.9294 KOps/s	1.9178 KOps/s	$\color{#35bf28}+0.60\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	4.8087ms	4.6499ms	215.0567 Ops/s	219.6580 Ops/s	$\color{#d91a1a}-2.09\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.1187s	0.6986ms	1.4315 KOps/s	1.8559 KOps/s	$\textbf{\color{#d91a1a}-22.87\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.6648ms	0.5136ms	1.9469 KOps/s	1.9338 KOps/s	$\color{#35bf28}+0.68\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.2318ms	4.8618ms	205.6846 Ops/s	209.6301 Ops/s	$\color{#d91a1a}-1.88\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.8034ms	0.6927ms	1.4437 KOps/s	1.4558 KOps/s	$\color{#d91a1a}-0.83\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.5459ms	0.6748ms	1.4819 KOps/s	1.4949 KOps/s	$\color{#d91a1a}-0.87\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1270s	7.3099ms	136.8017 Ops/s	136.9798 Ops/s	$\color{#d91a1a}-0.13\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	17.8907ms	15.7522ms	63.4834 Ops/s	65.4134 Ops/s	$\color{#d91a1a}-2.95\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	2.1779ms	1.1390ms	877.9481 Ops/s	882.2613 Ops/s	$\color{#d91a1a}-0.49\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1253s	9.7029ms	103.0619 Ops/s	138.8292 Ops/s	$\textbf{\color{#d91a1a}-25.76\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	18.0116ms	15.7269ms	63.5853 Ops/s	56.6069 Ops/s	$\textbf{\color{#35bf28}+12.33\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	2.1848ms	1.1340ms	881.8620 Ops/s	893.8872 Ops/s	$\color{#d91a1a}-1.35\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1246s	7.4675ms	133.9129 Ops/s	136.5386 Ops/s	$\color{#d91a1a}-1.92\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	18.5137ms	15.9209ms	62.8107 Ops/s	64.5264 Ops/s	$\color{#d91a1a}-2.66\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	2.3274ms	1.2991ms	769.7785 Ops/s	708.9201 Ops/s	$\textbf{\color{#35bf28}+8.58\%}$