fix flaky tests #3054

Job	Run time
Run Tests (test_controllers)	27m 40s
Run Tests (test_controllers)	27m 40s
Run Tests (test_curobo)	30m 51s
Run Tests (test_curobo)	30m 51s
Run Tests (test_data_collection)	41m 43s
Run Tests (test_data_collection)	41m 43s
Run Tests (test_dump_load_states)	45m 16s
Run Tests (test_dump_load_states)	45m 16s
Run Tests (test_envs)	44m 20s
Run Tests (test_envs)	44m 20s
Run Tests (test_multiple_envs)	22m 14s
Run Tests (test_multiple_envs)	22m 14s
Run Tests (test_object_removal)	28m 9s
Run Tests (test_object_removal)	28m 9s
Run Tests (test_object_states)	43m 47s
Run Tests (test_object_states)	42m 51s
Run Tests (test_primitives)	41m 40s
Run Tests (test_primitives)	41m 40s
Run Tests (test_robot_states_flatcache)	39m 55s
Run Tests (test_robot_states_flatcache)	39m 55s
Run Tests (test_robot_states_no_flatcache)	18m 58s
Run Tests (test_robot_states_no_flatcache)	18m 58s
Run Tests (test_robot_teleoperation)	11m 5s
Run Tests (test_robot_teleoperation)	11m 5s
Run Tests (test_scene_graph)	21m 32s
Run Tests (test_scene_graph)	21m 32s
Run Tests (test_sensors)	41m 28s
Run Tests (test_sensors)	41m 28s
Run Tests (test_symbolic_primitives)	56m 1s
Run Tests (test_symbolic_primitives)	56m 1s
Run Tests (test_systems)	36m 28s
Run Tests (test_systems)	36m 28s
Run Tests (test_transform_utils)	15m 34s
Run Tests (test_transform_utils)	15m 34s
Run Tests (test_transition_rules)	39m 57s
Run Tests (test_transition_rules)	39m 57s
Compile Report	9s
Compile Report	9s
	20h 12m 38s

Provide feedback