[BugFix] Fix broken gym tests (#1980) #18

Job	Run time
unittests-pettingzoo / linux-job	1s
unittests-atari-dqn (3.9, 12.1) / linux-job	1s
unittests-brax (3.9, 12.1) / linux-job	1s
unittests-envpool (3.9, 12.1) / linux-job	1s
unittests-d4rl (3.9, 12.1) / linux-job	1s
unittests-gendgrl (3.9, 12.1) / linux-job	1s
unittests-gym (3.9, 12.1) / linux-job	1s
unittests-jumanji (3.9, 12.1) / linux-job	1s
unittests-minari (3.9, 12.1) / linux-job	1s
unittests-openx (3.9, 12.1) / linux-job	1s
unittests-robohive (3.9, 12.1) / linux-job	1s
unittests-sklearn (3.9, 12.1) / linux-job	1s
unittests-roboset (3.9, 12.1) / linux-job	1s
unittests-smacv2 (3.9, 12.1) / linux-job	1s
unittests-vd4rl (3.9, 12.1) / linux-job	1s
unittests-vmas (3.9, 12.1) / linux-job	1s
	16s

Provide feedback