Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Buildfarmer log 2024/07/08 - 2024/07/15 #66

Closed
github-actions bot opened this issue Jul 8, 2024 · 13 comments
Closed

Buildfarmer log 2024/07/08 - 2024/07/15 #66

github-actions bot opened this issue Jul 8, 2024 · 13 comments
Labels
buildfarmer-log Log of issues in the buildfarm

Comments

@github-actions
Copy link
Contributor

github-actions bot commented Jul 8, 2024

Previous log #63

@github-actions github-actions bot added the buildfarmer-log Log of issues in the buildfarm label Jul 8, 2024
Copy link
Contributor Author

github-actions bot commented Jul 8, 2024

Jul 08

Build regressions

Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_win_deb
- Failing 66.67% in 8 out of 12 builds
	  (also in: "nightly_win_rep" job)
	projectroot.test_tutorial_use_logger_service__rmw_connextdds

Issue #2 in nightly_linux_repeated
- Failing 50.0% in 7 out of 14 builds
	projectroot.test_tf2_sensor_msgs_cpp

Issue #3 in nightly_win_rep
- Failing 58.33% in 7 out of 12 builds
	projectroot.gtest_multiple_service_calls__rmw_connextdds
	test_rclcpp.gtest_multiple_service_calls__rmw_connextdds.gtest.missing_result

Issue #4 in nightly_win_deb
- Failing 50.0% in 6 out of 12 builds
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	projectroot.test.rclcpp.test_executor (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #5 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	projectroot.test_generic_subscription
	test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all

Issue #6 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset

Issue #7 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_subscription_topic_statistics

Issue #8 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	projectroot.test.rclcpp.test_client_common
	rclcpp.TestAllClientTypesWithServer/Client.client_qos
	rclcpp.TestAllClientTypesWithServer/GenericClient.client_qos

Issue #9 in Rci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #10 in nightly_win_deb
- Failing 41.67% in 5 out of 12 builds
	  (also in: "nightly_win_rep" job)
	rclcpp.test_executor.gtest.missing_result

Issue #11 in nightly_win_rep
- Failing 41.67% in 5 out of 12 builds
	projectroot.test.rclcpp.test_time (known issue in: https://github.com/ros2/rclcpp/issues/2436 - CLOSED)

Issue #12 in gz_rendering-8-win
- Failing 100.0% in 4 out of 4 builds
	  (also in: "gz_rendering-7-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-main-win" job)
	2 msbuild warnings
	MeshTest.NormalMapWithoutTexCoord

Issue #13 in nightly_linux-rhel_repeated
- Failing 28.57% in 4 out of 14 builds
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]

Issue #14 in nightly_linux_repeated
- Failing 28.57% in 4 out of 14 builds
	projectroot.test_two_links_fixed_joint_prefix_launch.py

Issue #15 in nightly_win_rep
- Failing 33.33% in 4 out of 12 builds
	test_rclcpp.test_timeout_subscriber.timeout_subscriber

Issue #16 in nightly_win_rep
- Failing 33.33% in 4 out of 12 builds
	projectroot.test_node
	rclpy.test_node.xunit.missing_result

Issue #17 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
	test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all

Issue #18 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux_release" job)
	  (also in: "nightly_linux_repeated" job)
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all

Issue #19 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_subscription

Issue #20 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #21 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	projectroot.test_pub_sub

Issue #22 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestService.server_qos

Issue #23 in nightly_linux-aarch64_repeated
- Failing 25.0% in 3 out of 12 builds
	  (also in: "nightly_win_rep" job)
	rclcpp.TestBusyWaiting/EventsExecutor.test_spin

Issue #24 in nightly_linux-aarch64_repeated
- Failing 33.33% in 3 out of 9 builds
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_executors_busy_waiting

Issue #25 in nightly_linux_repeated
- Failing 21.43% in 3 out of 14 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	projectroot.test_security_nodes_c__rmw_connextdds

Issue #26 in nightly_win_rep
- Failing 25.0% in 3 out of 12 builds
	rclcpp.TestClockSleep.sleep_for_steady_past_returns_immediately

Issue #27 in nightly_win_rep
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #28 in nightly_win_rep
- Failing 25.0% in 3 out of 12 builds
	projectroot.gtest_timeout_subscriber__rmw_fastrtps_cpp

Issue #29 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 66.67% in 2 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_service_introspection
	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Issue #30 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 40.0% in 2 out of 5 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #31 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 40.0% in 2 out of 5 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	projectroot.test_generic_pub_sub (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #32 in Jci__nightly-release_ubuntu_noble_amd64
- Failing 14.29% in 2 out of 14 builds
	  (also in: "nightly_linux-aarch64_release" job)
	  (also in: "nightly_linux_release" job)
	1 clang-tidy warnings
	1 gcc warnings

Issue #33 in gz_math-main-win
- Failing 40.0% in 2 out of 5 builds
	Stopwatch.StartStopReset

Issue #34 in nightly_linux_release
- Failing 14.29% in 2 out of 14 builds
	  (also in: "nightly_linux-aarch64_debug" job)
	  (also in: "nightly_win_rep" job)
	test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully

Issue #35 in nightly_linux_release
- Failing 14.29% in 2 out of 14 builds
	  (also in: "nightly_linux-aarch64_debug" job)
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_0
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_1
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_2
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_0
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_1
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_0
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_1
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_2
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_0
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_1
	test_security.TestSecurePublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time

Issue #36 in nightly_linux_repeated
- Failing 14.29% in 2 out of 14 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	projectroot.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp
	test_rclcpp.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp.xunit.missing_result

Issue #37 in nightly_win_rep
- Failing 16.67% in 2 out of 12 builds
	projectroot.test_qos_event
	rclpy.test_qos_event.xunit.missing_result

Issue #38 in nightly_win_rep
- Failing 16.67% in 2 out of 12 builds
	projectroot.gtest_spin__rmw_connextdds
	test_rclcpp.test_spin.spin_until_future_complete_interrupted

Issue #39 in nightly_win_rep
- Failing 16.67% in 2 out of 12 builds
	demo_nodes_cpp.TestExecutablesTutorialAfterShutdown.test_last_process_exit_code
	projectroot.test_tutorial_add_two_ints_server_add_two_ints_client_async__rmw_fastrtps_cpp
	projectroot.test_tutorial_talker_listener__rmw_fastrtps_cpp

Issue #40 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 33.33% in 1 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	rclpy.rclpy.test.test_client.TestClient.test_service_timestamps

Issue #41 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 33.33% in 1 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content

Issue #42 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 33.33% in 1 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_client

Issue #43 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 20.0% in 1 out of 5 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	tf2_ros.tf2_ros_test_message_filter.gtest.missing_result

Issue #44 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 20.0% in 1 out of 5 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_deb" job)
	projectroot.tf2_ros_test_message_filter

Issue #45 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_service

Issue #46 in gz_transport-ign-transport8-win
- Failing 33.33% in 1 out of 3 builds
	playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)

Issue #47 in nightly_linux-aarch64_repeated
- Failing 7.14% in 1 out of 14 builds
	ros2multicast.ros2multicast.test.test_api.test_api[1-3]
	ros2multicast.ros2multicast.test.test_api.test_api[2-3]
	ros2multicast.ros2multicast.test.test_api.test_api[3-3]

Issue #48 in nightly_linux_repeated
- Failing 7.14% in 1 out of 14 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	projectroot.test_client_scope_consistency_cpp__rmw_cyclonedds_cpp
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_consistency_cpp

Issue #49 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_rep" job)
	test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result

Issue #50 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rel" job)
	test_rclcpp.TestNNodes.test_10_nodes

Issue #51 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_debug" job)
	rclcpp.TestExecutors/EventsExecutor.notifyTwiceWhileSpinning

Issue #52 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rel" job)
	projectroot.test_n_nodes__rmw_fastrtps_cpp
	test_rclcpp.TestNNodesAfterShutdown.test_10_nodes

Issue #53 in nightly_win_rep
- Failing 8.33% in 1 out of 12 builds
	projectroot.gtest_timeout_subscriber__rmw_connextdds
	projectroot.test_record_regex__rmw_cyclonedds_cpp

Issue #54 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_rep" job)
	projectroot.gtest_multithreaded__rmw_connextdds

@Crola1702
Copy link
Contributor

Crola1702 commented Jul 8, 2024

Nightly Linux Packaging | Build regression | Keeping track 👀

Reference builds:

Failed because agent linux-0357aeec is out of space.

Copy link
Contributor Author

github-actions bot commented Jul 9, 2024

Jul 09

Build regressions

Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 73.33% in 11 out of 15 builds
	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)

Issue #2 in nightly_win_rep
- Failing 69.23% in 9 out of 13 builds
	projectroot.gtest_multiple_service_calls__rmw_connextdds
	test_rclcpp.gtest_multiple_service_calls__rmw_connextdds.gtest.missing_result

Issue #3 in nightly_linux-rhel_repeated
- Failing 33.33% in 5 out of 15 builds
	projectroot.gtest_publisher__rmw_connextdds

Issue #4 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	projectroot.test_generic_subscription
	test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all

Issue #5 in Rci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #6 in gz_rendering-main-win
- Failing 100.0% in 4 out of 4 builds
	  (also in: "gz_rendering-7-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-main-win" job)
	2 msbuild warnings
	MeshTest.NormalMapWithoutTexCoord

Issue #7 in gz_sim-ign-gazebo6-win
- Failing 100.0% in 4 out of 4 builds
	13 msbuild warnings

Issue #8 in nightly_win_rep
- Failing 30.77% in 4 out of 13 builds
	test_rclcpp.test_timeout_subscriber.timeout_subscriber

Issue #9 in nightly_win_rep
- Failing 30.77% in 4 out of 13 builds
	projectroot.test.rclcpp.test_entities_collector

Issue #10 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
	test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all

Issue #11 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux_release" job)
	  (also in: "nightly_linux_repeated" job)
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all

Issue #12 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_subscription

Issue #13 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #14 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	projectroot.test_pub_sub

Issue #15 in Rci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)
	  (also in: "Rci__benchmark_ubuntu_noble_amd64" job)
	projectroot.benchmark_string_conversions

Issue #16 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	2 cmake warnings

Issue #17 in nightly_linux_repeated
- Failing 20.0% in 3 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_showimage_cam2image__rmw_cyclonedds_cpp

Issue #18 in nightly_win_rep
- Failing 23.08% in 3 out of 13 builds
	projectroot.gtest_timeout_subscriber__rmw_fastrtps_cpp

Issue #19 in nightly_win_rep
- Failing 23.08% in 3 out of 13 builds
	demo_nodes_cpp.TestExecutablesTutorialAfterShutdown.test_last_process_exit_code

Issue #20 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 50.0% in 2 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #21 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 50.0% in 2 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	projectroot.test_generic_pub_sub (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #22 in gz_math-main-win
- Failing 40.0% in 2 out of 5 builds
	Stopwatch.StartStopReset

Issue #23 in gz_sim-ign-gazebo6-win
- Failing 50.0% in 2 out of 4 builds
	INTEGRATION_multiple_servers.test_ran

Issue #24 in nightly_linux_repeated
- Failing 13.33% in 2 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	projectroot.test_security_nodes_c__rmw_connextdds

Issue #25 in nightly_linux_repeated
- Failing 13.33% in 2 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	projectroot.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp
	test_rclcpp.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp.xunit.missing_result

Issue #26 in nightly_win_rep
- Failing 15.38% in 2 out of 13 builds
	projectroot.test_record_all_ignore_leaf_topics__rmw_connextdds
	rclcpp.TestExecutorEntitiesCollector.add_callback_group_twice

Issue #27 in nightly_win_rep
- Failing 13.33% in 2 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	projectroot.test_record_all__rmw_cyclonedds_cpp

Issue #28 in nightly_win_rep
- Failing 15.38% in 2 out of 13 builds
	projectroot.gtest_timeout_subscriber__rmw_connextdds

Issue #29 in Jci__nightly-performance_ubuntu_noble_amd64
- Failing 33.33% in 1 out of 3 builds
	buildfarm_perf_tests.PerformanceTestResults.test_results_rmw_connextdds
	projectroot.test.test_performance_rmw_connextdds_sync_PointCloud8m

Issue #30 in Jci__nightly-release_ubuntu_noble_amd64
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_release" job)
	1 clang-tidy warnings
	1 gcc warnings

Issue #31 in Rci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_executors_busy_waiting

Issue #32 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Issue #33 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
	projectroot.test.test_performance_CycloneDDS_sync_Array8m

Issue #34 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	30 gcc warnings
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
	projectroot.cpplint (known issue in: https://github.com/ros2/rosidl/issues/790 - CLOSED)
	projectroot.uncrustify

Issue #35 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	2 clang-tidy warnings

Issue #36 in nightly_linux-aarch64_repeated
- Failing 6.67% in 1 out of 15 builds
	test_ros2trace.test_ros2trace.test.test_ros2trace.test_trace.TestROS2TraceCLI.test_default

Issue #37 in nightly_linux-rhel_repeated
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[2-3]

Issue #38 in nightly_win_deb
- Failing 8.33% in 1 out of 12 builds
	projectroot.test_component_manager
	projectroot.test_component_manager_api
	rclcpp_components.TestComponentManager.components_api
	rclcpp_components.TestComponentManager.create_component_factory_invalid
	rclcpp_components.TestComponentManager.create_component_factory_valid
	rclcpp_components.TestComponentManager.get_component_resources_invalid
	rclcpp_components.TestComponentManager.get_component_resources_valid

Issue #39 in nightly_win_rel
- Failing 7.69% in 1 out of 13 builds
	  (also in: "nightly_win_rep" job)
	test_cli_remapping.TestCLIRemapping.test_service_replacement[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe]
	test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe]

Issue #40 in nightly_win_rel
- Failing 6.67% in 1 out of 15 builds
	test_cli_remapping.TestCLIRemapping.test_node_name_replacement[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py]
	test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py]

Issue #41 in nightly_win_rel
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_cli_remapping

Issue #42 in nightly_win_rep
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rel" job)
	test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result

Issue #43 in nightly_win_rep
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[3-3]

Issue #44 in nightly_win_rep
- Failing 7.69% in 1 out of 13 builds
	projectroot.test_tutorial_use_logger_service__rmw_fastrtps_cpp

Issue #45 in nightly_win_rep
- Failing 8.33% in 1 out of 12 builds
	  (also in: "nightly_win_deb" job)
	projectroot.test_buffer_server
	tf2_ros.TestBufferServer.lookup_transform_available
	tf2_ros.TestBufferServer.lookup_transform_delayed
	tf2_ros.TestBufferServer.lookup_transform_timeout

Issue #46 in nightly_win_rep
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rel" job)
	projectroot.gtest_multithreaded__rmw_connextdds

@Crola1702
Copy link
Contributor

Gz-sensors_main-win | Warnings | Investigating 🕵️

Reference build: https://build.osrfoundation.org/job/gz_sensors-ci-main-homebrew-amd64/59/

Warnings:

All of them are -Wdeprecated-declarations in 'OpticalFrameId' is deprecated

@Crola1702
Copy link
Contributor

Crola1702 commented Jul 9, 2024

Nightly windows debug | Build regressions | Keeping track 👀

Reference build: https://ci.ros2.org/view/nightly/job/nightly_win_deb/3149/

ros2cli tests phase failed.

Log output:
--- output: ros2cli^M
============================= test session starts =============================^M^M
platform win32 -- Python 3.8.3, pytest-6.2.5, py-1.11.0, pluggy-1.5.0^M^M
cachedir: C:\ci\ws\build\ros2cli\.pytest_cache^M^M
rootdir: C:\ci\ws\src\ros2\ros2cli, configfile: pytest.ini^M^M
plugins: ament-copyright-0.18.1, ament-flake8-0.18.1, ament-lint-0.18.1, ament-mypy-0.18.1, ament-pep257-0.18.1, ament-xmllint-0.18.1, launch-pytest-3.6.0, launch-testing-3.6.0, launch-testi
timeout: 900.0s^M^M
timeout method: thread^M^M
timeout func_only: False^M^M
collected 31 items^M^M
^M^M
test\test_copyright.py .                                                 [  3%]^M^M
Fatal Python error: Aborted^M
^M
Thread 0x00000308 (most recent call first):^M
  File "C:\Python38\lib\threading.py", line 306 in wait^M
  File "C:\Python38\lib\threading.py", line 558 in wait^M
  File "C:\Python38\lib\threading.py", line 1252 in run^M
  File "C:\Python38\lib\threading.py", line 932 in _bootstrap_inner^M
  File "C:\Python38\lib\threading.py", line 890 in _bootstrap^M
^M
Current thread 0x00000a60 (most recent call first):^M
  File "C:\ci\ws\install\Lib\site-packages\rclpy\node.py", line 190 in __init__^M
  File "C:\ci\ws\install\Lib\site-packages\rclpy\__init__.py", line 241 in create_node^M
  File "C:\ci\ws\src\ros2\ros2cli\ros2cli\test\test_daemon.py", line 56 in local_node^M
  File "C:\Python38\lib\site-packages\_pytest\fixtures.py", line 925 in call_fixture_func^M
  File "C:\Python38\lib\site-packages\_pytest\fixtures.py", line 1126 in pytest_fixture_setup^M
  File "C:\Python38\lib\site-packages\pluggy\_callers.py", line 103 in _multicall^M
  File "C:\Python38\lib\site-packages\pluggy\_manager.py", line 120 in _hookexec^M
  File "C:\Python38\lib\site-packages\pluggy\_hooks.py", line 513 in __call__^M
  File "C:\Python38\lib\site-packages\_pytest\fixtures.py", line 1072 in execute^M
  File "C:\Python38\lib\site-packages\_pytest\fixtures.py", line 687 in _compute_fixture_value^M
  File "C:\Python38\lib\site-packages\_pytest\fixtures.py", line 601 in _get_active_fixturedef^M
  File "C:\Python38\lib\site-packages\_pytest\fixtures.py", line 581 in getfixturevalue^M
  File "C:\Python38\lib\site-packages\_pytest\fixtures.py", line 568 in _fillfixtures^M
  File "C:\Python38\lib\site-packages\_pytest\python.py", line 1647 in setup^M
  File "C:\Python38\lib\site-packages\_pytest\runner.py", line 449 in prepare^M
  File "C:\Python38\lib\site-packages\_pytest\runner.py", line 150 in pytest_runtest_setup^M
  File "C:\Python38\lib\site-packages\pluggy\_callers.py", line 103 in _multicall^M
  File "C:\Python38\lib\site-packages\pluggy\_manager.py", line 120 in _hookexec^M
  File "C:\Python38\lib\site-packages\pluggy\_hooks.py", line 513 in __call__^M
  File "C:\Python38\lib\site-packages\_pytest\runner.py", line 255 in <lambda>^M
  File "C:\Python38\lib\site-packages\_pytest\runner.py", line 311 in from_call^M
  File "C:\Python38\lib\site-packages\_pytest\runner.py", line 254 in call_runtest_hook^M
  File "C:\Python38\lib\site-packages\_pytest\runner.py", line 215 in call_and_report^M
  File "C:\Python38\lib\site-packages\_pytest\runner.py", line 120 in runtestprotocol^M
  File "C:\Python38\lib\site-packages\pytest_rerunfailures.py", line 608 in pytest_runtest_protocol^M
  File "C:\Python38\lib\site-packages\pluggy\_callers.py", line 103 in _multicall^M
  File "C:\Python38\lib\site-packages\pluggy\_manager.py", line 120 in _hookexec^M
  File "C:\Python38\lib\site-packages\pluggy\_manager.py", line 120 in _hookexec^M                                                                                                            
  File "C:\Python38\lib\site-packages\pluggy\_hooks.py", line 513 in __call__^M
  File "C:\Python38\lib\site-packages\_pytest\main.py", line 348 in pytest_runtestloop^M
  File "C:\Python38\lib\site-packages\pluggy\_callers.py", line 103 in _multicall^M
  File "C:\Python38\lib\site-packages\pluggy\_manager.py", line 120 in _hookexec^M
  File "C:\Python38\lib\site-packages\pluggy\_hooks.py", line 513 in __call__^M
  File "C:\Python38\lib\site-packages\_pytest\main.py", line 323 in _main^M
  File "C:\Python38\lib\site-packages\_pytest\main.py", line 269 in wrap_session^M
  File "C:\Python38\lib\site-packages\_pytest\main.py", line 316 in pytest_cmdline_main^M
  File "C:\Python38\lib\site-packages\pluggy\_callers.py", line 103 in _multicall^M
  File "C:\Python38\lib\site-packages\pluggy\_manager.py", line 120 in _hookexec^M
  File "C:\Python38\lib\site-packages\pluggy\_hooks.py", line 513 in __call__^M
  File "C:\Python38\lib\site-packages\_pytest\config\__init__.py", line 162 in main^M
  File "C:\Python38\lib\site-packages\_pytest\config\__init__.py", line 185 in console_main^M
  File "C:\Python38\lib\site-packages\pytest\__main__.py", line 5 in <module>^M
  File "C:\Python38\lib\runpy.py", line 87 in _run_code^M
  File "C:\Python38\lib\runpy.py", line 194 in _run_module_as_main^M
test\test_daemon.py ---^M

@Crola1702
Copy link
Contributor

Crola1702 commented Jul 9, 2024

Humble jobs not running

See: https://build.ros2.org/view/Hci/ and sort by last success. None of them have run in the last 11 days.

Humble has the lower priority of build.ros2 CI jobs, so I think they might be getting down the queue because long buildtimes and a high job lists.

09/07:

Today there were multiple Rolling jobs in queue and running, and some Iron jobs in queue. At the end there were the Humble jobs waiting for three days

10/07:

Today Iron triggered all its jobs, there are also Rolling jobs running, Humble jobs are still on the queue. Iron was supposed to run yesterday, but it seems it didn't and it's still on queue

Checking last Rolling runs, the duration running all Rolling jobs is more than 24 hours. This could mean that Rolling is triggered again when it hasn't finished to run all the jobs!

Job Rci__nightly-cyclonedds_ubuntu_noble_amd64 Rci__nightly-connext_ubuntu_noble_amd64 Rci__nightly-cross-vendor-cyclonedds-fastrtps_ubuntu_noble_amd64 Rci__nightly-cross-vendor-connext-fastrtps_ubuntu_noble_amd64 Rci__nightly-cross-vendor-connext-cyclonedds_ubuntu_noble_amd64 Rci__nightly-release_ubuntu_noble_amd64 Rci__nightly-fastrtps_ubuntu_noble_amd64 Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 Rci__nightly-debug_ubuntu_noble_amd64 TOTAL TIME
Last duration 3 hr 28 min 4 hr 11 min 10 min 10 min 10 min 4 hr 38 min 4 hr 4 min 3 hr 51 min 4 hr 11 min 24 hr 53 min

From #52 (comment) we know that build.ros2.org jobs take more time to run in noble, so the increase in buildtime might be causing the Rolling infinite trigger.

Although we have 2 CI Agents, the two of them get occupied by daily distro run and Rolling new runs, leaving more items in the queue.

Copy link
Contributor Author

Jul 10

Build regressions
job_name|build_number|build_datetime|failure_reason|last_section
nightly_linux_debug|3114|2024-07-10 06:37:27.831000|Jenkins channel closing down (Agent disconnected)|build
nightly_linux-aarch64_repeated|2814|2024-07-10 04:00:01.233000|Jenkins channel closing down (Agent disconnected)|build
packaging_linux-rhel|1997|2024-07-10 08:25:37.188000|Jenkins channel closing down (Agent disconnected)|build underlay packages
gz_sensors-main-win|61|2024-07-09 23:17:10.489000|Jenkins channel closing down (Agent disconnected)|configure the MSVC compiler
gz_fuel_tools-ign-fuel-tools4-win|59|2024-07-09 15:06:27.767000|Early fail|No last section
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 81.25% in 13 out of 16 builds
	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)

Issue #2 in nightly_linux_repeated
- Failing 62.5% in 10 out of 16 builds
	projectroot.test_tf2_sensor_msgs_cpp

Issue #3 in nightly_win_rep
- Failing 71.43% in 10 out of 14 builds
	projectroot.gtest_multiple_service_calls__rmw_connextdds
	test_rclcpp.gtest_multiple_service_calls__rmw_connextdds.gtest.missing_result

Issue #4 in nightly_win_rep
- Failing 58.33% in 7 out of 12 builds
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_executors_busy_waiting

Issue #5 in nightly_linux-rhel_repeated
- Failing 50.0% in 6 out of 12 builds
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	projectroot.test_generic_pub_sub__rmw_connextdds (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #6 in nightly_linux_repeated
- Failing 37.5% in 6 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	projectroot.gtest_publisher__rmw_connextdds

Issue #7 in gz_rendering-main-win
- Failing 100.0% in 5 out of 5 builds
	  (also in: "gz_rendering-7-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-main-win" job)
	2 msbuild warnings
	MeshTest.NormalMapWithoutTexCoord

Issue #8 in nightly_linux_repeated
- Failing 31.25% in 5 out of 16 builds
	projectroot.fps_view_controller_test

Issue #9 in nightly_win_rep
- Failing 33.33% in 5 out of 15 builds
	  (also in: "nightly_linux_iron_coverage" job)
	projectroot.test_timer

Issue #10 in nightly_win_rep
- Failing 35.71% in 5 out of 14 builds
	projectroot.test_node
	rclpy.test_node.xunit.missing_result

Issue #11 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 4 out of 4 builds
	rclcpp.TestClient.client_qos

Issue #12 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
	test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all

Issue #13 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux_repeated" job)
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all

Issue #14 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	projectroot.test_pub_sub

Issue #15 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset

Issue #16 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestService.server_qos

Issue #17 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_subscription_topic_statistics

Issue #18 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	projectroot.test.rclcpp.test_client_common
	rclcpp.TestAllClientTypesWithServer/Client.client_qos
	rclcpp.TestAllClientTypesWithServer/GenericClient.client_qos

Issue #19 in Rci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #20 in gz_sim-ign-gazebo6-win
- Failing 100.0% in 4 out of 4 builds
	13 msbuild warnings

Issue #21 in nightly_linux_debug
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #22 in nightly_win_rep
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_subscription

Issue #23 in nightly_win_rep
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #24 in nightly_win_rep
- Failing 28.57% in 4 out of 14 builds
	projectroot.test_parameter_client
	rclpy.test_parameter_client.xunit.missing_result

Issue #25 in Rci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)
	  (also in: "Rci__benchmark_ubuntu_noble_amd64" job)
	projectroot.benchmark_string_conversions

Issue #26 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	2 cmake warnings

Issue #27 in nightly_linux-aarch64_repeated
- Failing 18.75% in 3 out of 16 builds
	projectroot.test_transport_py
	rosbag2_py.test_transport_py.xunit.missing_result

Issue #28 in nightly_linux-aarch64_repeated
- Failing 18.75% in 3 out of 16 builds
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_client_scope_consistency_cpp__rmw_cyclonedds_cpp
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_consistency_cpp

Issue #29 in nightly_linux_repeated
- Failing 18.75% in 3 out of 16 builds
	projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp

Issue #30 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	projectroot.test_parameter_event_handler
	projectroot.test_parameter_service
	projectroot.test_qos_event
	projectroot.test_time_source
	rclpy.test_parameter_event_handler.xunit.missing_result
	rclpy.test_parameter_service.xunit.missing_result
	rclpy.test_qos_event.xunit.missing_result
	rclpy.test_subscription.xunit.missing_result
	rclpy.test_time_source.xunit.missing_result

Issue #31 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 50.0% in 2 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_service_introspection
	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Issue #32 in gz_sensors-ci-main-homebrew-amd64
- Failing 33.33% in 2 out of 6 builds
	4 clang warnings

Issue #33 in gz_sim-ign-gazebo6-win
- Failing 50.0% in 2 out of 4 builds
	INTEGRATION_multiple_servers.test_ran

Issue #34 in nightly_linux_repeated
- Failing 12.5% in 2 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	projectroot.test_node_name__rmw_fastrtps_cpp
	test_rclcpp.test_node_name__rmw_fastrtps_cpp.xunit.missing_result

Issue #35 in nightly_win_rep
- Failing 12.5% in 2 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rep" job)
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]

Issue #36 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.test_logging_service
	projectroot.test_messages
	projectroot.test_qos_overriding_options
	projectroot.test_rate
	projectroot.test_rosout_subscription
	projectroot.test_service_introspection
	projectroot.test_wait_for_message
	projectroot.test_waitable
	rclpy.test_logging_service.xunit.missing_result
	rclpy.test_messages.xunit.missing_result
	rclpy.test_publisher.xunit.missing_result
	rclpy.test_qos_overriding_options.xunit.missing_result
	rclpy.test_rate.xunit.missing_result
	rclpy.test_rosout_subscription.xunit.missing_result
	rclpy.test_service.xunit.missing_result
	rclpy.test_service_introspection.xunit.missing_result
	rclpy.test_timer.xunit.missing_result
	rclpy.test_wait_for_message.xunit.missing_result
	rclpy.test_waitable.xunit.missing_result

Issue #37 in nightly_win_rep
- Failing 12.5% in 2 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	projectroot.test.rclcpp.test_clock
	rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock

Issue #38 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	test_tf2.BufferClientTestAfterShutdown.test_exit_code

Issue #39 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 7.14% in 1 out of 14 builds
	  (also in: "nightly_win_rep" job)
	rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger

Issue #40 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 25.0% in 1 out of 4 builds
	projectroot.test_buffer_client_tester.launch.py

Issue #41 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_subscription
	rclcpp.TestService.on_new_request_callback
	rclcpp.TestSubscription.on_new_message_callback

Issue #42 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	projectroot.test.rclcpp.test_client
	rclcpp.TestClient.on_new_response_callback

Issue #43 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	4 cmake warnings
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
	projectroot.lint_cmake

Issue #44 in Jci__nightly-performance_ubuntu_noble_amd64
- Failing 33.33% in 1 out of 3 builds
	buildfarm_perf_tests.PerformanceTestResults.test_results_rmw_connextdds
	projectroot.test.test_performance_rmw_connextdds_sync_PointCloud8m

Issue #45 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 25.0% in 1 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	tf2_ros.tf2_ros_test_message_filter.gtest.missing_result

Issue #46 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 25.0% in 1 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_deb" job)
	projectroot.tf2_ros_test_message_filter

Issue #47 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_service

Issue #48 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Issue #49 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_Array8m

Issue #50 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Issue #51 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	30 gcc warnings
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
	projectroot.cpplint (known issue in: https://github.com/ros2/rosidl/issues/790 - CLOSED)
	projectroot.uncrustify

Issue #52 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	2 clang-tidy warnings

Issue #53 in nightly_linux-aarch64_debug
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux_release" job)
	  (also in: "nightly_win_rep" job)
	test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully

Issue #54 in nightly_linux-aarch64_debug
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux_release" job)
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_0
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_1
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_2
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_0
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_1
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_0
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_1
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_2
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_0
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_1
	test_security.TestSecurePublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time

Issue #55 in nightly_linux-aarch64_repeated
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_debug" job)
	  (also in: "nightly_linux_repeated" job)
	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Issue #56 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	test_tracetools.test_generic_pub_sub__rmw_connextdds.xunit.missing_result

Issue #57 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[3-3]

Issue #58 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]

Issue #59 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_showimage_cam2image__rmw_cyclonedds_cpp

Issue #60 in nightly_linux_debug
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestExecutors/EventsExecutor.notifyTwiceWhileSpinning

Issue #61 in nightly_linux_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job) (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED)
	ros2topic.ros2topic.test.test_cli.test_cli (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED)

Issue #62 in nightly_linux_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	ros2node.ros2node.test.test_cli.test_cli
	ros2node.ros2node.test.test_cli_duplicate_node_names.test_cli_duplicate_node_names

Issue #63 in nightly_linux_repeated
- Failing 6.25% in 1 out of 16 builds
	projectroot.test_generic_subscription__rmw_connextdds
	projectroot.test_subscription__rmw_connextdds
	test_tracetools.test_generic_subscription__rmw_connextdds.xunit.missing_result
	test_tracetools.test_subscription__rmw_connextdds.xunit.missing_result

Issue #64 in nightly_win_deb
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_rep" job)
	sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy

Issue #65 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_win_deb" job)
	test_rclcpp.test_multithreaded.multi_access_publisher

Issue #66 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	ros2cli.ros2cli.test.test_strategy.test_enforce_no_daemon[1-3]
	ros2cli.ros2cli.test.test_strategy.test_enforce_no_daemon[2-3]
	ros2cli.ros2cli.test.test_strategy.test_enforce_no_daemon[3-3]

Issue #67 in nightly_win_rep
- Failing 8.33% in 1 out of 12 builds
	  (also in: "nightly_win_deb" job)
	rclcpp_action.TestServer.deferred_execution
	rclcpp_action.TestServer.get_result
	rclcpp_action.TestServer.get_result_deferred
	rclcpp_action.TestServer.publish_feedback
	rclcpp_action.TestServer.publish_status_aborted
	rclcpp_action.TestServer.publish_status_succeeded

Issue #68 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	rclcpp.TestBusyWaiting/EventsExecutor.test_spin

Issue #69 in nightly_win_rep
- Failing 8.33% in 1 out of 12 builds
	  (also in: "nightly_win_deb" job)
	projectroot.test_service

Issue #70 in nightly_win_rep
- Failing 8.33% in 1 out of 12 builds
	  (also in: "nightly_win_deb" job)
	projectroot.test_server

Issue #71 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rel" job)
	projectroot.test_n_nodes__rmw_fastrtps_cpp
	test_rclcpp.TestNNodesAfterShutdown.test_10_nodes

Issue #72 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rel" job)
	projectroot.gtest_multithreaded__rmw_connextdds

Issue #73 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	launch_testing_ros.test.examples.talker_listener_launch_test.talker_listener_launch_test
	ros2cli.ros2cli.test.test_strategy.test_with_no_daemon_running[3-3]

Issue #74 in nightly_win_rep
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test

Copy link
Contributor Author

Jul 11

Build regressions

Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 80.0% in 12 out of 15 builds
	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)

Issue #2 in nightly_linux_repeated
- Failing 66.67% in 10 out of 15 builds
	projectroot.test_tf2_sensor_msgs_cpp

Issue #3 in nightly_win_rep
- Failing 71.43% in 10 out of 14 builds
	projectroot.gtest_multiple_service_calls__rmw_connextdds
	test_rclcpp.gtest_multiple_service_calls__rmw_connextdds.gtest.missing_result

Issue #4 in nightly_win_rep
- Failing 63.64% in 7 out of 11 builds
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_executors_busy_waiting

Issue #5 in nightly_linux_repeated
- Failing 40.0% in 6 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	projectroot.gtest_publisher__rmw_connextdds

Issue #6 in gz_rendering-main-win
- Failing 100.0% in 5 out of 5 builds
	  (also in: "gz_rendering-7-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-main-win" job)
	2 msbuild warnings
	MeshTest.NormalMapWithoutTexCoord

Issue #7 in nightly_linux-rhel_repeated
- Failing 45.45% in 5 out of 11 builds
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	projectroot.test_generic_pub_sub__rmw_connextdds (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #8 in nightly_linux_repeated
- Failing 33.33% in 5 out of 15 builds
	projectroot.fps_view_controller_test

Issue #9 in nightly_win_rep
- Failing 35.71% in 5 out of 14 builds
	  (also in: "nightly_linux_iron_coverage" job)
	projectroot.test_timer

Issue #10 in nightly_win_rep
- Failing 35.71% in 5 out of 14 builds
	projectroot.test_node
	rclpy.test_node.xunit.missing_result

Issue #11 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset

Issue #12 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_subscription_topic_statistics

Issue #13 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	projectroot.test.rclcpp.test_client_common
	rclcpp.TestAllClientTypesWithServer/Client.client_qos
	rclcpp.TestAllClientTypesWithServer/GenericClient.client_qos

Issue #14 in Rci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #15 in gz_sim-ign-gazebo6-win
- Failing 100.0% in 4 out of 4 builds
	13 msbuild warnings

Issue #16 in nightly_win_rep
- Failing 28.57% in 4 out of 14 builds
	projectroot.test_parameter_client
	rclpy.test_parameter_client.xunit.missing_result

Issue #17 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	rclcpp.TestClient.client_qos

Issue #18 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
	test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all

Issue #19 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux_repeated" job)
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all

Issue #20 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	projectroot.test_pub_sub

Issue #21 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestService.server_qos

Issue #22 in nightly_linux-aarch64_repeated
- Failing 20.0% in 3 out of 15 builds
	projectroot.test_transport_py
	rosbag2_py.test_transport_py.xunit.missing_result

Issue #23 in nightly_linux-aarch64_repeated
- Failing 20.0% in 3 out of 15 builds
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_client_scope_consistency_cpp__rmw_cyclonedds_cpp
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_consistency_cpp

Issue #24 in nightly_linux_debug
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #25 in nightly_win_rep
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_subscription

Issue #26 in nightly_win_rep
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #27 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	projectroot.test_parameter_event_handler
	projectroot.test_parameter_service
	projectroot.test_qos_event
	projectroot.test_time_source
	rclpy.test_parameter_event_handler.xunit.missing_result
	rclpy.test_parameter_service.xunit.missing_result
	rclpy.test_qos_event.xunit.missing_result
	rclpy.test_subscription.xunit.missing_result
	rclpy.test_time_source.xunit.missing_result

Issue #28 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 50.0% in 2 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_service_introspection
	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Issue #29 in gz_sensors-ci-main-homebrew-amd64
- Failing 40.0% in 2 out of 5 builds
	4 clang warnings

Issue #30 in gz_sim-ign-gazebo6-win
- Failing 50.0% in 2 out of 4 builds
	INTEGRATION_multiple_servers.test_ran

Issue #31 in nightly_linux_repeated
- Failing 13.33% in 2 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	projectroot.test_node_name__rmw_fastrtps_cpp
	test_rclcpp.test_node_name__rmw_fastrtps_cpp.xunit.missing_result

Issue #32 in nightly_linux_repeated
- Failing 13.33% in 2 out of 15 builds
	projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp

Issue #33 in nightly_win_rep
- Failing 13.33% in 2 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rep" job)
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]

Issue #34 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.test_logging_service
	projectroot.test_messages
	projectroot.test_qos_overriding_options
	projectroot.test_rate
	projectroot.test_rosout_subscription
	projectroot.test_service_introspection
	projectroot.test_wait_for_message
	projectroot.test_waitable
	rclpy.test_logging_service.xunit.missing_result
	rclpy.test_messages.xunit.missing_result
	rclpy.test_publisher.xunit.missing_result
	rclpy.test_qos_overriding_options.xunit.missing_result
	rclpy.test_rate.xunit.missing_result
	rclpy.test_rosout_subscription.xunit.missing_result
	rclpy.test_service.xunit.missing_result
	rclpy.test_service_introspection.xunit.missing_result
	rclpy.test_timer.xunit.missing_result
	rclpy.test_wait_for_message.xunit.missing_result
	rclpy.test_waitable.xunit.missing_result

Issue #35 in nightly_win_rep
- Failing 13.33% in 2 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	projectroot.test.rclcpp.test_clock
	rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock

Issue #36 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	test_tf2.BufferClientTestAfterShutdown.test_exit_code

Issue #37 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 7.14% in 1 out of 14 builds
	  (also in: "nightly_win_rep" job)
	rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger

Issue #38 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 33.33% in 1 out of 3 builds
	projectroot.test_buffer_client_tester.launch.py

Issue #39 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_subscription
	rclcpp.TestService.on_new_request_callback
	rclcpp.TestSubscription.on_new_message_callback

Issue #40 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	projectroot.test.rclcpp.test_client
	rclcpp.TestClient.on_new_response_callback

Issue #41 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Issue #42 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Issue #43 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	4 cmake warnings
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
	projectroot.lint_cmake

Issue #44 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	30 gcc warnings
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
	projectroot.cpplint (known issue in: https://github.com/ros2/rosidl/issues/790 - CLOSED)
	projectroot.uncrustify

Issue #45 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	2 clang-tidy warnings

Issue #46 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 25.0% in 1 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	tf2_ros.tf2_ros_test_message_filter.gtest.missing_result

Issue #47 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 25.0% in 1 out of 4 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_deb" job)
	projectroot.tf2_ros_test_message_filter

Issue #48 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_service

Issue #49 in nightly_linux-aarch64_debug
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux_release" job)
	  (also in: "nightly_win_rep" job)
	test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully

Issue #50 in nightly_linux-aarch64_debug
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux_release" job)
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_0
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_1
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_2
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_0
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_1
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_0
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_1
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_2
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_0
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_1
	test_security.TestSecurePublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time

Issue #51 in nightly_linux-aarch64_repeated
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_debug" job)
	  (also in: "nightly_linux_repeated" job)
	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Issue #52 in nightly_linux-rhel_repeated
- Failing 6.67% in 1 out of 15 builds
	test_tracetools.test_generic_pub_sub__rmw_connextdds.xunit.missing_result

Issue #53 in nightly_linux-rhel_repeated
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[3-3]

Issue #54 in nightly_linux-rhel_repeated
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]

Issue #55 in nightly_linux-rhel_repeated
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_showimage_cam2image__rmw_cyclonedds_cpp

Issue #56 in nightly_linux_debug
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestExecutors/EventsExecutor.notifyTwiceWhileSpinning

Issue #57 in nightly_linux_repeated
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job) (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED)
	ros2topic.ros2topic.test.test_cli.test_cli (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED)

Issue #58 in nightly_linux_repeated
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	ros2node.ros2node.test.test_cli.test_cli
	ros2node.ros2node.test.test_cli_duplicate_node_names.test_cli_duplicate_node_names

Issue #59 in nightly_linux_repeated
- Failing 6.67% in 1 out of 15 builds
	projectroot.test_generic_subscription__rmw_connextdds
	projectroot.test_subscription__rmw_connextdds
	test_tracetools.test_generic_subscription__rmw_connextdds.xunit.missing_result
	test_tracetools.test_subscription__rmw_connextdds.xunit.missing_result

Issue #60 in nightly_win_deb
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_rep" job)
	sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy

Issue #61 in nightly_win_rep
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_win_deb" job)
	test_rclcpp.test_multithreaded.multi_access_publisher

Issue #62 in nightly_win_rep
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	ros2cli.ros2cli.test.test_strategy.test_enforce_no_daemon[1-3]
	ros2cli.ros2cli.test.test_strategy.test_enforce_no_daemon[2-3]
	ros2cli.ros2cli.test.test_strategy.test_enforce_no_daemon[3-3]

Issue #63 in nightly_win_rep
- Failing 9.09% in 1 out of 11 builds
	  (also in: "nightly_win_deb" job)
	rclcpp_action.TestServer.deferred_execution
	rclcpp_action.TestServer.get_result
	rclcpp_action.TestServer.get_result_deferred
	rclcpp_action.TestServer.publish_feedback
	rclcpp_action.TestServer.publish_status_aborted
	rclcpp_action.TestServer.publish_status_succeeded

Issue #64 in nightly_win_rep
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	rclcpp.TestBusyWaiting/EventsExecutor.test_spin

Issue #65 in nightly_win_rep
- Failing 9.09% in 1 out of 11 builds
	  (also in: "nightly_win_deb" job)
	projectroot.test_service

Issue #66 in nightly_win_rep
- Failing 9.09% in 1 out of 11 builds
	  (also in: "nightly_win_deb" job)
	projectroot.test_server

Issue #67 in nightly_win_rep
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rel" job)
	projectroot.test_n_nodes__rmw_fastrtps_cpp
	test_rclcpp.TestNNodesAfterShutdown.test_10_nodes

Issue #68 in nightly_win_rep
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rel" job)
	projectroot.gtest_multithreaded__rmw_connextdds

Issue #69 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	launch_testing_ros.test.examples.talker_listener_launch_test.talker_listener_launch_test
	ros2cli.ros2cli.test.test_strategy.test_with_no_daemon_running[3-3]

Issue #70 in nightly_win_rep
- Failing 100.0% in 1 out of 1 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test

@Crola1702
Copy link
Contributor

Crola1702 commented Jul 11, 2024

Ros2 Connext | Test regressions | Investigating 🕵️

Reference builds:

Test regressions:

Most of errors show an output similar to:

unknown file: Failure
C++ exception with description "failed to set the on new response callback for client: rmw_client_set_on_new_response_callback not implemented, at /tmp/ws/src/ros2/rmw_connextdds/rmw_connextdds_common/src/common/rmw_listener.cpp:58" thrown in the test body.

unknown file: Failure
C++ exception with description "could not create client: error not set, at /tmp/ws/src/ros2/rcl/rcl/src/rcl/client.c:146" thrown in the test body.
Full log output
[ RUN      ] TestClient.on_new_response_callback
[ERROR] [1720517303.715179852] [rmw_connextdds]: rmw_client_set_on_new_response_callback not implemented
RTI Connext DDS Non-commercial license is for academic, research, evaluation and personal use only. USE FOR COMMERCIAL PURPOSES IS PROHIBITED. See RTI_LICENSE.TXT for terms. Download free tools at rti.com/ncl. License issued to Non-Commercial User [email protected] For non-production use only.
Expires on 00-jan-00 See www.rti.com for more information.
unknown file: Failure
C++ exception with description "failed to set the on new response callback for client: rmw_client_set_on_new_response_callback not implemented, at /tmp/ws/src/ros2/rmw_connextdds/rmw_connextdds_common/src/common/rmw_listener.cpp:58" thrown in the test body.
[  FAILED  ] TestClient.on_new_response_callback (306 ms)

...

[ RUN      ] TestClient.client_qos
[ERROR] [1720517304.608630352] [rmw_connextdds]: failed to create DDS writer
[ERROR] [1720517304.608717614] [rmw_connextdds]: failed to create client requester
[ERROR] [1720517304.608727494] [rmw_connextdds]: failed to create RMW client implementation
RTI Connext DDS Non-commercial license is for academic, research, evaluation and personal use only. USE FOR COMMERCIAL PURPOSES IS PROHIBITED. See RTI_LICENSE.TXT for terms. Download free tools at rti.com/ncl. License issued to Non-Commercial User [email protected] For non-production use only.
Expires on 00-jan-00 See www.rti.com for more information.
[D0000|Pub(80000008)|T=rq/ns/clientRequest|CREATE Writer] DDS_LivelinessQosPolicy_is_consistentI:inconsistent QoS policy: assertions_per_lease_duration is set to more than 1000000 assertions per second
[D0000|Pub(80000008)|T=rq/ns/clientRequest|CREATE Writer] DDS_DataWriterQos_is_consistentI:inconsistent QoS policy: liveliness
[D0000|Pub(80000008)|T=rq/ns/clientRequest|CREATE Writer] DDS_Publisher_create_datawriter_disabledI:ERROR: Inconsistent QoS
unknown file: Failure
C++ exception with description "could not create client: error not set, at /tmp/ws/src/ros2/rcl/rcl/src/rcl/client.c:146" thrown in the test body.
[  FAILED  ] TestClient.client_qos (306 ms)

...

[ RUN      ] TestService.on_new_request_callback
[ERROR] [1720517309.583558190] [rmw_connextdds]: rmw_service_set_on_new_request_callback not implemented
RTI Connext DDS Non-commercial license is for academic, research, evaluation and personal use only. USE FOR COMMERCIAL PURPOSES IS PROHIBITED. See RTI_LICENSE.TXT for terms. Download free tools at rti.com/ncl. License issued to Non-Commercial User [email protected] For non-production use only.
Expires on 00-jan-00 See www.rti.com for more information.
unknown file: Failure
C++ exception with description "failed to set the on new request callback for service: rmw_service_set_on_new_request_callback not implemented, at /tmp/ws/src/ros2/rmw_connextdds/rmw_connextdds_common/src/common/rmw_listener.cpp:45" thrown in the test body.
[  FAILED  ] TestService.on_new_request_callback (306 ms)

...

[ RUN      ] TestService.server_qos
[ERROR] [1720517310.400830337] [rmw_connextdds]: failed to create DDS writer
[ERROR] [1720517310.400910519] [rmw_connextdds]: failed to create service replier
[ERROR] [1720517310.400918009] [rmw_connextdds]: failed to create RMW service implementation
RTI Connext DDS Non-commercial license is for academic, research, evaluation and personal use only. USE FOR COMMERCIAL PURPOSES IS PROHIBITED. See RTI_LICENSE.TXT for terms. Download free tools at rti.com/ncl. License issued to Non-Commercial User [email protected] For non-production use only.
Expires on 00-jan-00 See www.rti.com for more information.
[D0000|Pub(80000008)|T=rr/ns/serviceReply|CREATE Writer] DDS_LivelinessQosPolicy_is_consistentI:inconsistent QoS policy: assertions_per_lease_duration is set to more than 1000000 assertions per second
[D0000|Pub(80000008)|T=rr/ns/serviceReply|CREATE Writer] DDS_DataWriterQos_is_consistentI:inconsistent QoS policy: liveliness
[D0000|Pub(80000008)|T=rr/ns/serviceReply|CREATE Writer] DDS_Publisher_create_datawriter_disabledI:ERROR: Inconsistent QoS
unknown file: Failure
C++ exception with description "could not create service: error not set, at /tmp/ws/src/ros2/rcl/rcl/src/rcl/service.c:159" thrown in the test body.
[  FAILED  ] TestService.server_qos (305 ms)

...

[ RUN      ] TestSubscription.on_new_message_callback
[ERROR] [1720517318.520322791] [rmw_connextdds]: rmw_subscription_set_on_new_message_callback not implemented
RTI Connext DDS Non-commercial license is for academic, research, evaluation and personal use only. USE FOR COMMERCIAL PURPOSES IS PROHIBITED. See RTI_LICENSE.TXT for terms. Download free tools at rti.com/ncl. License issued to Non-Commercial User [email protected] For non-production use only.
Expires on 00-jan-00 See www.rti.com for more information.
unknown file: Failure
C++ exception with description "failed to set the on new message callback for subscription: rmw_subscription_set_on_new_message_callback not implemented, at /tmp/ws/src/ros2/rmw_connextdds/rmw_connextdds_common/src/common/rmw_listener.cpp:74" thrown in the test body.
[  FAILED  ] TestSubscription.on_new_message_callback (306 ms)

...

[ RUN      ] TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger
[ERROR] [1720517343.448656055] [rmw_connextdds]: rmw_subscription_set_on_new_message_callback not implemented
RTI Connext DDS Non-commercial license is for academic, research, evaluation and personal use only. USE FOR COMMERCIAL PURPOSES IS PROHIBITED. See RTI_LICENSE.TXT for terms. Download free tools at rti.com/ncl. License issued to Non-Commercial User [email protected] For non-production use only.
Expires on 00-jan-00 See www.rti.com for more information.
unknown file: Failure
C++ exception with description "failed to set the on new message callback for subscription: rmw_subscription_set_on_new_message_callback not implemented, at /tmp/ws/src/ros2/rmw_connextdds/rmw_connextdds_common/src/common/rmw_listener.cpp:74" thrown in the test body.
[  FAILED  ] TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger, where TypeParam = rclcpp::experimental::executors::EventsExecutor (305 ms)

Reported in: ros2/rclcpp#2582

Copy link
Contributor Author

Jul 12

Build regressions

Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 81.25% in 13 out of 16 builds
	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)

Issue #2 in nightly_linux_repeated
- Failing 68.75% in 11 out of 16 builds
	projectroot.test_tf2_sensor_msgs_cpp

Issue #3 in nightly_win_rep
- Failing 70.0% in 7 out of 10 builds
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_executors_busy_waiting

Issue #4 in nightly_linux_repeated
- Failing 37.5% in 6 out of 16 builds
	projectroot.fps_view_controller_test

Issue #5 in nightly_linux_repeated
- Failing 31.25% in 5 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	projectroot.test_showimage_cam2image__rmw_cyclonedds_cpp

Issue #6 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
	test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all

Issue #7 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux_repeated" job)
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all

Issue #8 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_subscription

Issue #9 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #10 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	projectroot.test_pub_sub

Issue #11 in Rci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - OPEN)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - OPEN)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - OPEN)
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - CLOSED | https://github.com/ros2/rclcpp/issues/2582 - OPEN)

Issue #12 in gz_rendering-main-win
- Failing 100.0% in 4 out of 4 builds
	  (also in: "gz_rendering-7-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-main-win" job)
	2 msbuild warnings
	MeshTest.NormalMapWithoutTexCoord

Issue #13 in nightly_linux-rhel_repeated
- Failing 40.0% in 4 out of 10 builds
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	projectroot.test_generic_pub_sub__rmw_connextdds (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #14 in nightly_win_rep
- Failing 25.0% in 4 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rep" job)
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]

Issue #15 in Hci__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	projectroot.test.rclcpp.test_qos_event

Issue #16 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test

Issue #17 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_debug" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Issue #18 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset

Issue #19 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_subscription_topic_statistics

Issue #20 in Rci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	rclcpp.TestExecutors/StaticSingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)

Issue #21 in Rci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some_max_duration (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)

Issue #22 in Rci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)

Issue #23 in Rci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_all (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)
	rclcpp.TestBusyWaiting/StaticSingleThreadedExecutor.test_spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - CLOSED)

Issue #24 in nightly_linux-aarch64_repeated
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test

Issue #25 in nightly_linux_iron_coverage
- Failing 20.0% in 3 out of 15 builds
	  (also in: "nightly_linux_humble_coverage" job) (known issue in: https://github.com/ros2/launch_ros/issues/304 - CLOSED)
	  (also in: "nightly_linux_iron_coverage" job) (known issue in: https://github.com/ros2/launch_ros/issues/304 - CLOSED)
	launch_testing_ros.test.examples.wait_for_topic_launch_test.wait_for_topic_launch_test (known issue in: https://github.com/ros2/launch_ros/issues/304 - CLOSED)

Issue #26 in nightly_linux_repeated
- Failing 18.75% in 3 out of 16 builds
	projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp

Issue #27 in nightly_linux_repeated
- Failing 18.75% in 3 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	projectroot.test_client_scope_consistency_cpp__rmw_cyclonedds_cpp
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_consistency_cpp

Issue #28 in nightly_linux_repeated
- Failing 18.75% in 3 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_clock
	rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock

Issue #29 in nightly_win_rep
- Failing 18.75% in 3 out of 16 builds
	  (also in: "nightly_linux-aarch64_debug" job)
	  (also in: "nightly_linux_release" job)
	test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully

Issue #30 in Hci__nightly-performance_ubuntu_jammy_amd64
- Failing 66.67% in 2 out of 3 builds
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Issue #31 in Hci__nightly-performance_ubuntu_jammy_amd64
- Failing 66.67% in 2 out of 3 builds
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Issue #32 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 50.0% in 2 out of 4 builds
	projectroot.test_buffer_client_tester.launch.py

Issue #33 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	4 cmake warnings
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
	projectroot.lint_cmake

Issue #34 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	30 gcc warnings
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
	projectroot.cpplint (known issue in: https://github.com/ros2/rosidl/issues/790 - CLOSED)
	projectroot.uncrustify

Issue #35 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	2 clang-tidy warnings

Issue #36 in gz_transport-ci-gz-transport12-homebrew-amd64
- Failing 40.0% in 2 out of 5 builds
	UNIT_gz_TEST.xml.[failed-to-read]

Issue #37 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	test_tracetools.test_generic_pub_sub__rmw_connextdds.xunit.missing_result

Issue #38 in Hci__nightly-connext_ubuntu_jammy_amd64
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_win_rep" job)
	rclcpp.TestQosEvent.test_invalid_on_new_event_callback
	rclcpp.TestQosEvent.test_on_new_event_callback

Issue #39 in Hci__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 33.33% in 1 out of 3 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	rosbag2_transport.PlayerTestFixture.playing_respects_delay

Issue #40 in Hci__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 50.0% in 1 out of 2 builds
	projectroot.test_play_timing__rmw_fastrtps_dynamic_cpp

Issue #41 in Hci__nightly-performance_ubuntu_jammy_amd64
- Failing 33.33% in 1 out of 3 builds
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_Array8m

Issue #42 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	test_tf2.BufferClientTestAfterShutdown.test_exit_code

Issue #43 in gz_sim-ign-gazebo6-win
- Failing 20.0% in 1 out of 5 builds
	3 msbuild warnings

Issue #44 in gz_sim-main-win
- Failing 20.0% in 1 out of 5 builds
	INTEGRATION_mesh_inertia_calculation.test_ran

Issue #45 in gz_transport-ci-ign-transport11-homebrew-amd64
- Failing 25.0% in 1 out of 4 builds
	ignTest.TopicInfo

Issue #46 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	projectroot.test_record__rmw_fastrtps_cpp
	projectroot.test_record_all__rmw_connextdds
	rosbag2_transport.RecordIntegrationTestFixture.can_record_again_after_stop

Issue #47 in nightly_linux_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	projectroot.test_security_nodes_c__rmw_connextdds

Issue #48 in nightly_win_deb
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_rep" job)
	test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result

Issue #49 in nightly_win_deb
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_rep" job)
	sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy

Issue #50 in nightly_win_deb
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_rep" job)
	projectroot.gtest_multithreaded__rmw_connextdds

Issue #51 in nightly_win_deb
- Failing 8.33% in 1 out of 12 builds
	projectroot.copyright
	rviz_default_plugins.copyright.xunit.missing_result

Issue #52 in nightly_win_rel
- Failing 6.25% in 1 out of 16 builds
	rclcpp.TestAddCallbackGroupsToExecutorStable/SingleThreadedExecutor.subscriber_triggered_to_receive_message

Issue #53 in nightly_win_rel
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux_repeated" job)
	projectroot.test.rclcpp.test_add_callback_groups_to_executor__rmw_connextdds
	rclcpp.TestAddCallbackGroupsToExecutorStable/MultiThreadedExecutor.subscriber_triggered_to_receive_message

Issue #54 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[2-3]

Issue #55 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	rclcpp.TestBusyWaiting/EventsExecutor.test_spin

Issue #56 in nightly_win_rep
- Failing 6.67% in 1 out of 15 builds
	projectroot.test.test_get_node_names__rmw_connextdds
	projectroot.test.test_graph__rmw_connextdds
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_fastrtps_cpp__secure_not_connecting_0
	projectroot.test_services_cpp__rmw_connextdds
	rcl.TestGetNodeNames.test_rcl_get_node_names
	rcl.TestGraphFixture.test_graph_guard_condition_trigger_check
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_services_cpp

@Crola1702
Copy link
Contributor

Crola1702 commented Jul 12, 2024

Gz-transport12-homebrew | Test regression | Investigating 🕵️

Reference build: https://build.osrfoundation.org/job/gz_transport-ci-gz-transport12-homebrew-amd64/59/

Test regression:

Log output:

33: [ RUN      ] gzTest.TopicInfo
33: /Users/jenkins/jenkins-agent/workspace/gz_transport-ci-gz-transport12-homebrew-amd64/gz-transport/src/cmd/gz_TEST.cc:124: Failure
33: Value of: output
33:   Actual: false
33: Expected: true
33: OUTPUT[���\0`\0\0Д��\0`\0\0z�����\0\0�\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0�Ս���\0\0\0p����\0\0@����\0\0\0�\0\0\0\0\0\0\0�@����\0\0�] Size[80]. Expected Size=50
33: 
33: [  FAILED  ] gzTest.TopicInfo (26576 ms)

And then:

Failed to read test report file /Users/jenkins/jenkins-agent/workspace/gz_transport-ci-gz-transport12-homebrew-amd64/build/test_results/UNIT_gz_TEST.xml
org.dom4j.DocumentException: Invalid byte 1 of 1-byte UTF-8 sequence.

Repository doesn't have any new changes.

Reported in gazebosim/gz-transport#509


The same test is failing (but for a different reason) in gz-transport11:

33: [ RUN      ] ignTest.TopicInfo
33: /Users/jenkins/jenkins-agent/workspace/gz_transport-ci-ign-transport11-homebrew-amd64/gz-transport/src/cmd/gz_TEST.cc:135: Failure
33: Value of: infoFound
33:   Actual: false
33: Expected: true
33: OUTPUT[No publishers on topic [/foo]
33: ] Size[30]. Expected Size=50
33: 
33: /Users/jenkins/jenkins-agent/workspace/gz_transport-ci-ign-transport11-homebrew-amd64/gz-transport/src/cmd/gz_TEST.cc:138: Failure
33: Value of: output.find("ignition.msgs.Vector3d") != std::string::npos
33:   Actual: false
33: Expected: true
33: [  FAILED  ] ignTest.TopicInfo (26651 ms)

Also reported in: gazebosim/gz-transport#510

Copy link
Contributor Author

Jul 13

Build regressions
job_name|build_number|build_datetime|failure_reason|last_section
nightly_linux_repeated|3517|2024-07-13 07:14:51.565000|Packages cyclonedds  Failed|build
packaging_linux|3502|2024-07-13 07:36:23.978000|Packages rviz_ogre_vendor  Failed|build underlay packages
packaging_windows_debug|2265|2024-07-13 00:21:40.731000|Early fail|No last section
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_debug
- Failing 75.0% in 12 out of 16 builds
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)
	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)

Issue #2 in nightly_win_rep
- Failing 100.0% in 12 out of 12 builds
	  (also in: "nightly_win_deb" job) (known issue in: https://github.com/ros2/rcl/issues/1162 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rcl/issues/1162 - OPEN)
	projectroot.test_action_interaction__rmw_connextdds (known issue in: https://github.com/ros2/rcl/issues/1162 - OPEN)

Issue #3 in nightly_win_rep
- Failing 73.33% in 11 out of 15 builds
	projectroot.gtest_multiple_service_calls__rmw_connextdds
	test_rclcpp.gtest_multiple_service_calls__rmw_connextdds.gtest.missing_result

Issue #4 in nightly_win_rep
- Failing 75.0% in 9 out of 12 builds
	  (also in: "nightly_win_deb" job) (known issue in: https://github.com/ros2/rcl/issues/1162 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rcl/issues/1162 - OPEN)
	rcl_action.TestActionClientServerInteraction.test_interaction (known issue in: https://github.com/ros2/rcl/issues/1162 - OPEN)

Issue #5 in nightly_win_rep
- Failing 46.67% in 7 out of 15 builds
	projectroot.test_n_nodes__rmw_fastrtps_cpp
	test_rclcpp.TestNNodesAfterShutdown.test_10_nodes

Issue #6 in nightly_linux_iron_coverage
- Failing 40.0% in 6 out of 15 builds
	test_tracetools.test_tracetools.test.test_timer.TestTimer.test_all

Issue #7 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
	test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all

Issue #8 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux_repeated" job)
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all

Issue #9 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_subscription

Issue #10 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #11 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	projectroot.test_pub_sub

Issue #12 in nightly_linux-rhel_repeated
- Failing 33.33% in 5 out of 15 builds
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_clock
	rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock

Issue #13 in nightly_win_rep
- Failing 31.25% in 5 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rep" job)
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]

Issue #14 in nightly_win_rep
- Failing 26.67% in 4 out of 15 builds
	projectroot.test.rclcpp.test_time (known issue in: https://github.com/ros2/rclcpp/issues/2436 - CLOSED)

Issue #15 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 30.0% in 3 out of 10 builds
	tf2_ros.tf2_ros_test_message_filter.gtest.missing_result

Issue #16 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset

Issue #17 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_subscription_topic_statistics

Issue #18 in gz_transport-ci-gz-transport12-homebrew-amd64
- Failing 50.0% in 3 out of 6 builds
	UNIT_gz_TEST.xml.[failed-to-read]

Issue #19 in nightly_win_rep
- Failing 20.0% in 3 out of 15 builds
	rclcpp.TestClockSleep.sleep_until_ros_time_enable_interrupt

Issue #20 in Hci__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	projectroot.test.rclcpp.test_qos_event
	rclcpp.TestQosEvent.test_invalid_on_new_event_callback
	rclcpp.TestQosEvent.test_on_new_event_callback

Issue #21 in Hci__nightly-performance_ubuntu_jammy_amd64
- Failing 66.67% in 2 out of 3 builds
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Issue #22 in Hci__nightly-performance_ubuntu_jammy_amd64
- Failing 66.67% in 2 out of 3 builds
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Issue #23 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test

Issue #24 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test

Issue #25 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_debug" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Issue #26 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	4 cmake warnings
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
	projectroot.lint_cmake

Issue #27 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	2 clang-tidy warnings
	30 gcc warnings
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
	projectroot.cpplint (known issue in: https://github.com/ros2/rosidl/issues/790 - CLOSED)
	projectroot.uncrustify

Issue #28 in gz_transport-ci-ign-transport11-homebrew-amd64
- Failing 40.0% in 2 out of 5 builds
	ignTest.TopicInfo

Issue #29 in nightly_linux-rhel_repeated
- Failing 13.33% in 2 out of 15 builds
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp

Issue #30 in nightly_linux_humble_coverage
- Failing 13.33% in 2 out of 15 builds
	  (also in: "nightly_linux_iron_coverage" job) (known issue in: https://github.com/ros2/launch_ros/issues/304 - CLOSED)
	launch_testing_ros.test.examples.wait_for_topic_launch_test.wait_for_topic_launch_test (known issue in: https://github.com/ros2/launch_ros/issues/304 - CLOSED)

Issue #31 in nightly_linux_iron_coverage
- Failing 13.33% in 2 out of 15 builds
	  (also in: "nightly_win_rep" job)
	projectroot.test_timer

Issue #32 in nightly_win_deb
- Failing 16.67% in 2 out of 12 builds
	projectroot.copyright
	rviz_default_plugins.copyright.xunit.missing_result

Issue #33 in nightly_win_rep
- Failing 13.33% in 2 out of 15 builds
	projectroot.test_requester_replier__rclpy__rmw_connextdds

Issue #34 in Hci__nightly-performance_ubuntu_jammy_amd64
- Failing 33.33% in 1 out of 3 builds
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_Array8m

Issue #35 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 8.33% in 1 out of 12 builds
	  (also in: "nightly_win_deb" job)
	projectroot.tf2_ros_test_message_filter

Issue #36 in gz_sim-ign-gazebo6-win
- Failing 20.0% in 1 out of 5 builds
	3 msbuild warnings

Issue #37 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]

Issue #38 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rel" job)
	test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result

Issue #39 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_win_rel" job)
	test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py]

Issue #40 in nightly_win_rep
- Failing 6.67% in 1 out of 15 builds
	test_cli_remapping.TestCLIRemapping.test_service_replacement[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py]
	test_communication.TestRequesterReplier.test_requester_finishes_in_a_finite_amount_of_time[Empty]
	test_communication.TestRequesterReplierAfterShutdown.test_processes_finished_gracefully[Empty]

Issue #41 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_win_rel" job)
	projectroot.test_cli_remapping

Issue #42 in nightly_win_rep
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rel" job)
	projectroot.gtest_multithreaded__rmw_connextdds

Issue #43 in sdformat-ci-main-homebrew-amd64
- Failing 16.67% in 1 out of 6 builds
	7 clang warnings

Copy link
Contributor Author

Jul 14

Build regressions
job_name|build_number|build_datetime|failure_reason|last_section
nightly_linux_humble_coverage|861|2024-07-14 05:34:38.590000|Packages test_rclcpp  Failed|build
nightly_linux_release|3138|2024-07-14 06:27:52.839000|Early fail|No last section
nightly_linux_repeated|3518|2024-07-14 06:28:15.581000|Early fail|No last section
packaging_linux|3503|2024-07-14 06:29:02.106000|Early fail|No last section
nightly_linux-rhel_debug|1978|2024-07-14 04:00:01.216000|Packages rviz_default_plugins  Failed|build
packaging_linux-rhel|2004|2024-07-14 06:29:20.361000|Early fail|No last section
nightly_win_rep|3415|2024-07-14 04:00:01.743000|Number of failed test exceeds the threshold|test
gz-rendering9-debbuilder|430|2024-07-14 09:53:39.757000|Jenkins channel closing down (Agent disconnected)|create deb packages
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 10 out of 10 builds
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset

Issue #2 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 10 out of 10 builds
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_subscription_topic_statistics

Issue #3 in nightly_linux-rhel_repeated
- Failing 71.43% in 10 out of 14 builds
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_tf2_sensor_msgs_cpp

Issue #4 in nightly_linux-rhel_repeated
- Failing 37.5% in 6 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rep" job)
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]

Issue #5 in nightly_linux-rhel_repeated
- Failing 42.86% in 6 out of 14 builds
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_two_links_fixed_joint_prefix_launch.py

Issue #6 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
	test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all

Issue #7 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all

Issue #8 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_subscription

Issue #9 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #10 in Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	projectroot.test_pub_sub

Issue #11 in Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 21.43% in 3 out of 14 builds
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED)
	ros2topic.ros2topic.test.test_cli.test_cli (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED)

Issue #12 in gz_transport-ci-gz-transport12-homebrew-amd64
- Failing 50.0% in 3 out of 6 builds
	UNIT_gz_TEST.xml.[failed-to-read]

Issue #13 in Hci__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	projectroot.test.rclcpp.test_qos_event
	rclcpp.TestQosEvent.test_invalid_on_new_event_callback
	rclcpp.TestQosEvent.test_on_new_event_callback

Issue #14 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test

Issue #15 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test

Issue #16 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Issue #17 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_Array8m

Issue #18 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Issue #19 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	4 cmake warnings
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
	projectroot.lint_cmake

Issue #20 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	2 clang-tidy warnings
	30 gcc warnings
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
	projectroot.cpplint (known issue in: https://github.com/ros2/rosidl/issues/790 - CLOSED)
	projectroot.uncrustify

Issue #21 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 40.0% in 2 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	projectroot.test.rclcpp.test_service_introspection
	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Issue #22 in gz_transport-ci-ign-transport11-homebrew-amd64
- Failing 40.0% in 2 out of 5 builds
	ignTest.TopicInfo

Issue #23 in nightly_linux-aarch64_repeated
- Failing 13.33% in 2 out of 15 builds
	  (also in: "nightly_linux-rhel_debug" job)
	launch_testing_examples.launch_testing_examples.hello_world_launch_test.launch_testing_examples.hello_world_launch_test

Issue #24 in nightly_linux-aarch64_repeated
- Failing 14.29% in 2 out of 14 builds
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/examples/issues/340 - CLOSED)
	launch_testing_examples.launch_testing_examples.check_multiple_nodes_launch_test.launch_testing_examples.check_multiple_nodes_launch_test (known issue in: https://github.com/ros2/examples/issues/340 - CLOSED)

Issue #25 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_node_name__rmw_fastrtps_cpp
	test_rclcpp.test_node_name__rmw_fastrtps_cpp.xunit.missing_result

Issue #26 in nightly_linux-rhel_repeated
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_debug" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Issue #27 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	rclcpp.TestAddCallbackGroupsToExecutorStable/SingleThreadedExecutor.subscriber_triggered_to_receive_message

Issue #28 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 20.0% in 1 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	rclpy.rclpy.test.test_client.TestClient.test_service_timestamps

Issue #29 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 20.0% in 1 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_client

Issue #30 in Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 7.14% in 1 out of 14 builds
	  (also in: "nightly_linux_repeated" job)
	ros2node.ros2node.test.test_cli.test_cli

Issue #31 in Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 6.67% in 1 out of 15 builds
	  (also in: "nightly_win_rep" job)
	rcl.TestGetNodeNames.test_rcl_get_node_names

Issue #32 in Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 10.0% in 1 out of 10 builds
	projectroot.test.test_get_node_names__rmw_fastrtps_dynamic_cpp
	rcl.TestGetNodeNames.test_rcl_get_node_names_with_enclave
	ros2doctor.ros2doctor.test.test_api.test_api
	ros2service.ros2service.test.test_cli.test_cli (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED)

Issue #33 in gz_gui-ci-ign-gui6-focal-amd64
- Failing 25.0% in 1 out of 4 builds
	UNIT_Publisher_TEST.test_ran
	UNIT_Screenshot_TEST.test_ran
	UNIT_ShutdownButton_TEST.test_ran

Issue #34 in gz_sim-ign-gazebo6-win
- Failing 20.0% in 1 out of 5 builds
	3 msbuild warnings

Issue #35 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]

Issue #36 in nightly_win_rel
- Failing 6.25% in 1 out of 16 builds
	rclcpp.TestAddCallbackGroupsToExecutorStable/EventsExecutor.subscriber_triggered_to_receive_message

Issue #37 in nightly_win_rel
- Failing 7.14% in 1 out of 14 builds
	  (also in: "nightly_linux_repeated" job)
	projectroot.test.rclcpp.test_add_callback_groups_to_executor__rmw_connextdds
	rclcpp.TestAddCallbackGroupsToExecutorStable/MultiThreadedExecutor.subscriber_triggered_to_receive_message

Issue #38 in sdformat-ci-main-homebrew-amd64
- Failing 16.67% in 1 out of 6 builds
	7 clang warnings

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
buildfarmer-log Log of issues in the buildfarm
Projects
None yet
Development

No branches or pull requests

1 participant