Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix flaky tests #1042

Merged
merged 11 commits into from
Dec 10, 2024

remove debugging text in test_data_collection.py

6e0f9f1
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

fix flaky tests #1042

remove debugging text in test_data_collection.py
6e0f9f1
Select commit
Loading
Failed to load commit list.
GitHub Actions / Test Results succeeded Dec 10, 2024 in 0s

153 passed, 0 failed and 9 skipped

Tests passed successfully

Report Passed Failed Skipped Time
12264922833-tests-test_controllers/test_controllers.xml 1✅ 948s
12264922833-tests-test_curobo/test_curobo.xml 1✅ 1166s
12264922833-tests-test_data_collection/test_data_collection.xml 1✅ 1835s
12264922833-tests-test_dump_load_states/test_dump_load_states.xml 4✅ 2057s
12264922833-tests-test_envs/test_envs.xml 5✅ 2004s
12264922833-tests-test_multiple_envs/test_multiple_envs.xml 8✅ 2⚪ 630s
12264922833-tests-test_object_removal/test_object_removal.xml 2✅ 1024s
12264922833-tests-test_object_states/test_object_states.xml 33✅ 1847s
12264922833-tests-test_primitives/test_primitives.xml 6✅ 4⚪ 1811s
12264922833-tests-test_robot_states_flatcache/test_robot_states_flatcache.xml 3✅ 1717s
12264922833-tests-test_robot_states_no_flatcache/test_robot_states_no_flatcache.xml 3✅ 457s
12264922833-tests-test_robot_teleoperation/test_robot_teleoperation.xml 1⚪ 31ms
12264922833-tests-test_scene_graph/test_scene_graph.xml 1✅ 605s
12264922833-tests-test_sensors/test_sensors.xml 2✅ 1818s
12264922833-tests-test_symbolic_primitives/test_symbolic_primitives.xml 18✅ 2⚪ 2698s
12264922833-tests-test_systems/test_systems.xml 1✅ 1529s
12264922833-tests-test_transform_utils/test_transform_utils.xml 34✅ 151s
12264922833-tests-test_transition_rules/test_transition_rules.xml 30✅ 1644s

✅ 12264922833-tests-test_controllers/test_controllers.xml

1 tests were completed in 948s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 1✅ 948s

✅ pytest

tests.test_controllers
  ✅ test_arm_control

✅ 12264922833-tests-test_curobo/test_curobo.xml

1 tests were completed in 1166s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 1✅ 1166s

✅ pytest

tests.test_curobo
  ✅ test_curobo

✅ 12264922833-tests-test_data_collection/test_data_collection.xml

1 tests were completed in 1835s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 1✅ 1835s

✅ pytest

tests.test_data_collection
  ✅ test_data_collect_and_playback

✅ 12264922833-tests-test_dump_load_states/test_dump_load_states.xml

4 tests were completed in 2057s with 4 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 4✅ 2057s

✅ pytest

tests.test_dump_load_states
  ✅ test_dump_load
  ✅ test_dump_load_serialized
  ✅ test_save_restore_partial
  ✅ test_save_restore_full

✅ 12264922833-tests-test_envs/test_envs.xml

5 tests were completed in 2004s with 5 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 5✅ 2004s

✅ pytest

tests.test_envs
  ✅ test_dummy_task
  ✅ test_point_reaching_task
  ✅ test_point_navigation_task
  ✅ test_behavior_task
  ✅ test_rs_int_full_load

✅ 12264922833-tests-test_multiple_envs/test_multiple_envs.xml

10 tests were completed in 630s with 8 passed, 0 failed and 2 skipped.

Test suite Passed Failed Skipped Time
pytest 8✅ 2⚪ 630s

✅ pytest

tests.test_multiple_envs
  ✅ test_multi_scene_dump_load_states
  ✅ test_multi_scene_get_local_position
  ✅ test_multi_scene_set_local_position
  ✅ test_multi_scene_scene_prim
  ✅ test_multi_scene_particle_source
  ✅ test_multi_scene_position_orientation_relative_to_scene
  ✅ test_tiago_getter
  ✅ test_tiago_setter
  ⚪ test_behavior_getter
  ⚪ test_behavior_setter

✅ 12264922833-tests-test_object_removal/test_object_removal.xml

2 tests were completed in 1024s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 2✅ 1024s

✅ pytest

tests.test_object_removal
  ✅ test_removal_and_readdition
  ✅ test_readdition

✅ 12264922833-tests-test_object_states/test_object_states.xml

33 tests were completed in 1847s with 33 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 33✅ 1847s

✅ pytest

tests.test_object_states
  ✅ test_on_top
  ✅ test_inside
  ✅ test_under
  ✅ test_touching
  ✅ test_contact_bodies
  ✅ test_next_to
  ✅ test_overlaid
  ✅ test_pose
  ✅ test_joint
  ✅ test_aabb
  ✅ test_adjacency
  ✅ test_temperature
  ✅ test_max_temperature
  ✅ test_heat_source_or_sink
  ✅ test_cooked
  ✅ test_burnt
  ✅ test_frozen
  ✅ test_heated
  ✅ test_on_fire
  ✅ test_toggled_on
  ✅ test_attached_to
  ✅ test_particle_source
  ✅ test_particle_sink
  ✅ test_particle_applier
  ✅ test_particle_remover
  ✅ test_saturated
  ✅ test_open
  ✅ test_folded_unfolded
  ✅ test_draped
  ✅ test_filled
  ✅ test_contains
  ✅ test_covered
  ✅ test_clear_sim

✅ 12264922833-tests-test_primitives/test_primitives.xml

10 tests were completed in 1811s with 6 passed, 0 failed and 4 skipped.

Test suite Passed Failed Skipped Time
pytest 6✅ 4⚪ 1811s

✅ pytest

tests.test_primitives.TestPrimitives
  ✅ test_navigate[Tiago]
  ✅ test_navigate[Fetch]
  ✅ test_grasp[Tiago]
  ✅ test_grasp[Fetch]
  ✅ test_place[Tiago]
  ✅ test_place[Fetch]
  ⚪ test_open_prismatic[Tiago]
  ⚪ test_open_prismatic[Fetch]
  ⚪ test_open_revolute[Tiago]
  ⚪ test_open_revolute[Fetch]

✅ 12264922833-tests-test_robot_states_flatcache/test_robot_states_flatcache.xml

3 tests were completed in 1717s with 3 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 3✅ 1717s

✅ pytest

tests.test_robot_states_flatcache
  ✅ test_camera_pose_flatcache_on
  ✅ test_robot_load_drive
  ✅ test_grasping_mode

✅ 12264922833-tests-test_robot_states_no_flatcache/test_robot_states_no_flatcache.xml

3 tests were completed in 457s with 3 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 3✅ 457s

✅ pytest

tests.test_robot_states_no_flatcache
  ✅ test_camera_pose_flatcache_off
  ✅ test_camera_semantic_segmentation
  ✅ test_object_in_FOV_of_robot

✅ 12264922833-tests-test_robot_teleoperation/test_robot_teleoperation.xml

1 tests were completed in 31ms with 0 passed, 0 failed and 1 skipped.

Test suite Passed Failed Skipped Time
pytest 1⚪ 31ms

✅ pytest

tests.test_robot_teleoperation
  ⚪ test_teleop

✅ 12264922833-tests-test_scene_graph/test_scene_graph.xml

1 tests were completed in 605s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 1✅ 605s

✅ pytest

tests.test_scene_graph
  ✅ test_scene_graph

✅ 12264922833-tests-test_sensors/test_sensors.xml

2 tests were completed in 1818s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 2✅ 1818s

✅ pytest

tests.test_sensors
  ✅ test_segmentation_modalities
  ✅ test_bbox_modalities

✅ 12264922833-tests-test_symbolic_primitives/test_symbolic_primitives.xml

20 tests were completed in 2698s with 18 passed, 0 failed and 2 skipped.

Test suite Passed Failed Skipped Time
pytest 18✅ 2⚪ 2698s

✅ pytest

tests.test_symbolic_primitives.TestSymbolicPrimitives
  ✅ test_in_hand_state[Fetch]
  ✅ test_open[Fetch]
  ✅ test_close[Fetch]
  ✅ test_place_inside[Fetch]
  ✅ test_place_ontop[Fetch]
  ✅ test_toggle_on[Fetch]
  ✅ test_soak_under[Fetch]
  ✅ test_wipe[Fetch]
  ⚪ test_cut[Fetch]
  ✅ test_persistent_sticky_grasping[Fetch]
  ✅ test_in_hand_state[Tiago]
  ✅ test_open[Tiago]
  ✅ test_close[Tiago]
  ✅ test_place_inside[Tiago]
  ✅ test_place_ontop[Tiago]
  ✅ test_toggle_on[Tiago]
  ✅ test_soak_under[Tiago]
  ✅ test_wipe[Tiago]
  ⚪ test_cut[Tiago]
  ✅ test_persistent_sticky_grasping[Tiago]

✅ 12264922833-tests-test_systems/test_systems.xml

1 tests were completed in 1529s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 1✅ 1529s

✅ pytest

tests.test_systems
  ✅ test_system_clear

✅ 12264922833-tests-test_transform_utils/test_transform_utils.xml

34 tests were completed in 151s with 34 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 34✅ 151s

✅ pytest

tests.test_transform_utils.TestQuaternionOperations
  ✅ test_quat2mat_special_cases
  ✅ test_quat_multiply
  ✅ test_quat_conjugate
  ✅ test_quat_inverse
  ✅ test_quat_distance
tests.test_transform_utils.TestVectorOperations
  ✅ test_normalize
  ✅ test_dot_product
  ✅ test_l2_distance
tests.test_transform_utils.TestMatrixOperations
  ✅ test_rotation_matrix_properties
  ✅ test_rotation_matrix
  ✅ test_transformation_matrix
  ✅ test_transformation_matrix_no_point
  ✅ test_matrix_inverse
tests.test_transform_utils.TestCoordinateTransformations
  ✅ test_cartesian_to_polar
tests.test_transform_utils.TestPoseTransformations
  ✅ test_pose2mat_and_mat2pose
  ✅ test_pose_inv
tests.test_transform_utils.TestAxisAngleConversions
  ✅ test_axisangle2quat_and_quat2axisangle
  ✅ test_vecs2axisangle
  ✅ test_vecs2quat
tests.test_transform_utils.TestEulerAngleConversions
  ✅ test_euler2quat_and_quat2euler
  ✅ test_euler2mat_and_mat2euler
tests.test_transform_utils.TestQuaternionApplications
  ✅ test_quat_apply
  ✅ test_quat_slerp
tests.test_transform_utils.TestTransformPoints
  ✅ test_transform_points_2d
  ✅ test_transform_points_3d
tests.test_transform_utils.TestMiscellaneousFunctions
  ✅ test_convert_quat
  ✅ test_random_quaternion
  ✅ test_random_axis_angle
  ✅ test_align_vector_sets
  ✅ test_copysign
  ✅ test_anorm
  ✅ test_check_quat_right_angle
  ✅ test_z_angle_from_quat
  ✅ test_integer_spiral_coordinates

✅ 12264922833-tests-test_transition_rules/test_transition_rules.xml

30 tests were completed in 1644s with 30 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 30✅ 1644s

✅ pytest

tests.test_transition_rules
  ✅ test_dryer_rule
  ✅ test_washer_rule
  ✅ test_slicing_rule
  ✅ test_dicing_rule_cooked
  ✅ test_dicing_rule_uncooked
  ✅ test_melting_rule
  ✅ test_cooking_physical_particle_rule_failure_recipe_systems
  ✅ test_cooking_physical_particle_rule_success
  ✅ test_mixing_rule_failure_recipe_systems
  ✅ test_mixing_rule_failure_nonrecipe_systems
  ✅ test_mixing_rule_success
  ✅ test_cooking_system_rule_failure_recipe_systems
  ✅ test_cooking_system_rule_failure_nonrecipe_systems
  ✅ test_cooking_system_rule_failure_nonrecipe_objects
  ✅ test_cooking_system_rule_success
  ✅ test_cooking_object_rule_failure_wrong_container
  ✅ test_cooking_object_rule_failure_recipe_objects
  ✅ test_cooking_object_rule_failure_unary_states
  ✅ test_cooking_object_rule_failure_binary_system_states
  ✅ test_cooking_object_rule_failure_binary_object_states
  ✅ test_cooking_object_rule_failure_wrong_heat_source
  ✅ test_cooking_object_rule_success
  ✅ test_single_toggleable_machine_rule_output_system_failure_wrong_container
  ✅ test_single_toggleable_machine_rule_output_system_failure_recipe_systems
  ✅ test_single_toggleable_machine_rule_output_system_failure_recipe_objects
  ✅ test_single_toggleable_machine_rule_output_system_failure_nonrecipe_systems
  ✅ test_single_toggleable_machine_rule_output_system_failure_nonrecipe_objects
  ✅ test_single_toggleable_machine_rule_output_system_success
  ✅ test_single_toggleable_machine_rule_output_object_failure_unary_states
  ✅ test_single_toggleable_machine_rule_output_object_success