Bamboo CI Link
Execution details at https://ci1.netdef.org/browse/FRR-PULLREQ3-TOPO5U18ARM8-771

Execution Summary

Failures
❌ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_add_routes(45.793 s)

E AssertionError: 14 tests failed

❓ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_adjacencies(0.002 s)

/root/share/topotests/lib/ltemplate.py:185: Have 14 errors

❓ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_check_routes(0.002 s)

/root/share/topotests/lib/ltemplate.py:185: Have 14 errors

❓ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_check_close(0.002 s)

/root/share/topotests/lib/ltemplate.py:185: Have 14 errors

❓ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_check_timeout(0.002 s)

/root/share/topotests/lib/ltemplate.py:185: Have 14 errors

❓ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_cleanup_all(0.969 s)

/root/share/topotests/lib/ltemplate.py:185: Have 14 errors

❌ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_add_routes(45.726 s)

E AssertionError: 14 tests failed

❓ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_adjacencies(0.004 s)

/root/share/topotests/lib/ltemplate.py:185: Have 14 errors

❓ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_check_routes(0.004 s)

/root/share/topotests/lib/ltemplate.py:185: Have 14 errors

❓ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_check_close(0.005 s)

/root/share/topotests/lib/ltemplate.py:185: Have 14 errors

❓ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_check_timeout(0.004 s)

/root/share/topotests/lib/ltemplate.py:185: Have 14 errors

❓ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_cleanup_all(0.893 s)

/root/share/topotests/lib/ltemplate.py:185: Have 14 errors

Success and Not classified
✔️ bgp_max_med_on_startup.test_bgp_max_med_on_startup test_bgp_max_med_on_startup (9.669 s)
✔️ bgp_maximum_prefix_invalid_update.test_bgp_maximum_prefix_invalid_update test_bgp_maximum_prefix_invalid (6.249 s)
✔️ bgp_maximum_prefix_out.test_bgp_maximum_prefix_out test_bgp_maximum_prefix_out (23.443 s)
✔️ bgp_minimum_holdtime.test_bgp_minimum_holdtime test_bgp_minimum_holdtime (5.352 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_address_unambiguous_within_each_vrf_p0 (27.828 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_ambiguous_overlapping_addresses_in_different_vrfs_p0 (2.062 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_static_routes_associated_to_specific_vrfs_p0 (2.419 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_vrf_with_unique_physical_interface_p0 (4.390 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_prefixes_leaking_p0 (4.719 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_static_routes_advertised_within_specific_vrf_p0 (3.904 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_end_to_end_traffic_isolation_p0 (29.201 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_static_routes_for_inter_vrf_route_leaking_p0 (1.633 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_inter_vrf_and_intra_vrf_communication_iBGP_p0 (1.714 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_inter_vrf_and_intra_vrf_communication_eBGP_p0 (1.698 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_route_map_within_vrf_to_alter_bgp_attribute_nexthop_p0 (5.424 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_route_map_within_vrf_to_alter_bgp_attribute_p0[locPrf] (12.167 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_route_map_within_vrf_to_alter_bgp_attribute_p0[weight] (12.211 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_route_map_within_vrf_to_alter_bgp_attribute_p0[metric] (12.208 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_route_map_within_vrf_to_alter_bgp_attribute_aspath_p0 (12.302 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_route_map_within_vrf_to_alter_bgp_attribute_lcomm_p0 (4.692 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_route_map_match_traffic_based_on_vrf_p0 (5.787 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_vrf_lite_with_static_bgp_originated_routes_p0 (11.043 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_prefix_list_to_permit_deny_prefixes_p0 (6.053 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_route_map_set_and_match_tag_p0 (2.070 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_route_map_set_and_match_metric_p0 (1.855 s)
✔️ bgp_multi_vrf_topo1.test_bgp_multi_vrf_topo1 test_route_map_set_and_match_community_p0 (10.323 s)
✔️ bgp_multi_vrf_topo2.test_bgp_multi_vrf_topo2 test_vrf_with_multiple_links_p1 (104.362 s)
✔️ bgp_multi_vrf_topo2.test_bgp_multi_vrf_topo2 test_shut_noshut_p1 (27.580 s)
✔️ bgp_multi_vrf_topo2.test_bgp_multi_vrf_topo2 test_vrf_vlan_routing_table_p1 (23.781 s)
✔️ bgp_multi_vrf_topo2.test_bgp_multi_vrf_topo2 test_vrf_route_leaking_next_hop_interface_flapping_p1 (3.051 s)
✔️ bgp_multi_vrf_topo2.test_bgp_multi_vrf_topo2 test_restart_bgpd_daemon_p1 (11.992 s)
✔️ bgp_multi_vrf_topo2.test_bgp_multi_vrf_topo2 test_delete_and_re_add_vrf_p1 (37.722 s)
✔️ bgp_multi_vrf_topo2.test_bgp_multi_vrf_topo2 test_vrf_name_significance_p1 (61.536 s)
✔️ bgp_multi_vrf_topo2.test_bgp_multi_vrf_topo2 test_restart_frr_services_p1 (16.089 s)
✔️ bgp_multiview_topo1.test_bgp_multiview_topo1 test_router_running (10.632 s)
✔️ bgp_multiview_topo1.test_bgp_multiview_topo1 test_bgp_converge (10.441 s)
✔️ bgp_multiview_topo1.test_bgp_multiview_topo1 test_bgp_routingTable (0.349 s)
✔️ bgp_multiview_topo1.test_bgp_multiview_topo1 test_shutdown_check_memleak (2.018 s)
✔️ bgp_path_attribute_discard.test_bgp_path_attribute_discard test_bgp_path_attribute_discard (5.984 s)
✔️ bgp_path_attribute_discard.test_bgp_path_attribute_discard test_memory_leak (0.688 s)
✔️ bgp_path_attributes_topo1.test_bgp_path_attributes test_next_hop_attribute (21.051 s)
✔️ bgp_path_attributes_topo1.test_bgp_path_attributes test_aspath_attribute (11.048 s)
✔️ bgp_path_attributes_topo1.test_bgp_path_attributes test_localpref_attribute (11.143 s)
✔️ bgp_path_attributes_topo1.test_bgp_path_attributes test_weight_attribute (11.146 s)
✔️ bgp_path_attributes_topo1.test_bgp_path_attributes test_origin_attribute (5.994 s)
✔️ bgp_path_attributes_topo1.test_bgp_path_attributes test_med_attribute (12.951 s)
✔️ bgp_path_attributes_topo1.test_bgp_path_attributes test_admin_distance (16.163 s)
✔️ bgp_path_selection.test_bgp_path_selection test_bgp_path_selection_ecmp (6.771 s)
✔️ bgp_path_selection.test_bgp_path_selection test_bgp_path_selection_vpn_ecmp (1.952 s)
✔️ bgp_path_selection.test_bgp_path_selection test_bgp_path_selection_metric (0.268 s)
✔️ bgp_path_selection.test_bgp_path_selection test_bgp_path_selection_vpn_metric (1.881 s)
✔️ bgp_peer_graceful_shutdown.test_bgp_peer_graceful_shutdown test_bgp_orf (8.818 s)
✔️ bgp_peer_group.test_bgp_peer-group test_bgp_peer_group (7.033 s)
✔️ bgp_peer_type_multipath_relax.test_bgp_peer-type_multipath-relax test_bgp_peer_type_multipath_relax (20.896 s)
✔️ bgp_peer_type_multipath_relax.test_bgp_peer-type_multipath-relax test_memory_leak (1.749 s)
✔️ bgp_prefix_list_any.test_bgp_prefix_list_any test_bgp_route_map_prefix_list (20.728 s)
✔️ bgp_prefix_list_topo1.test_prefix_lists test_ip_prefix_lists_in_permit (12.570 s)
✔️ bgp_prefix_list_topo1.test_prefix_lists test_ip_prefix_lists_out_permit (3.048 s)
✔️ bgp_prefix_list_topo1.test_prefix_lists test_ip_prefix_lists_in_deny_and_permit_any (0.701 s)
✔️ bgp_prefix_list_topo1.test_prefix_lists test_delete_prefix_lists (0.741 s)
✔️ bgp_prefix_list_topo1.test_prefix_lists test_ip_prefix_lists_out_deny_and_permit_any (3.026 s)
✔️ bgp_prefix_list_topo1.test_prefix_lists test_modify_prefix_lists_in_permit_to_deny (9.320 s)
✔️ bgp_prefix_list_topo1.test_prefix_lists test_modify_prefix_lists_in_deny_to_permit (9.356 s)
✔️ bgp_prefix_list_topo1.test_prefix_lists test_modify_prefix_lists_out_permit_to_deny (9.307 s)
✔️ bgp_prefix_list_topo1.test_prefix_lists test_modify_prefix_lists_out_deny_to_permit (9.320 s)
✔️ bgp_prefix_list_topo1.test_prefix_lists test_ip_prefix_lists_implicit_deny (5.064 s)
✔️ bgp_prefix_sid.test_bgp_prefix_sid test_r1_receive_and_advertise_prefix_sid_type1 (7.439 s)
✔️ bgp_prefix_sid.test_bgp_prefix_sid test_peer2_receive_prefix_sid_type1 (1.102 s)
✔️ bgp_prefix_sid2.test_bgp_prefix_sid2 test_r1_rib (6.965 s)
✔️ bgp_recursive_route_ebgp_multi_hop.test_bgp_recursive_route_ebgp_multi_hop test_recursive_routes_iBGP_peer_p1 (33.114 s)
✔️ bgp_recursive_route_ebgp_multi_hop.test_bgp_recursive_route_ebgp_multi_hop test_next_hop_as_self_ip_p1 (18.535 s)
✔️ bgp_recursive_route_ebgp_multi_hop.test_bgp_recursive_route_ebgp_multi_hop test_next_hop_with_recursive_lookup_p1 (42.557 s)
✔️ bgp_recursive_route_ebgp_multi_hop.test_bgp_recursive_route_ebgp_multi_hop test_BGP_path_attributes_default_values_p1 (10.964 s)
✔️ bgp_recursive_route_ebgp_multi_hop.test_bgp_recursive_route_ebgp_multi_hop test_BGP_peering_bw_loopback_and_physical_p1 (20.088 s)
✔️ bgp_recursive_route_ebgp_multi_hop.test_bgp_recursive_route_ebgp_multi_hop test_BGP_active_standby_preemption_and_ecmp_p1 (18.184 s)
✔️ bgp_recursive_route_ebgp_multi_hop.test_bgp_recursive_route_ebgp_multi_hop test_password_authentication_for_eBGP_and_iBGP_peers_p1 (19.039 s)
✔️ bgp_reject_as_sets.test_bgp_reject_as_sets test_bgp_reject_as_sets (8.047 s)
✔️ bgp_remove_private_as.test_bgp_remove_private_as test_bgp_remove_private_as (19.323 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_memory_leak (9.060 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_add_routes (45.793 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_adjacencies (0.002 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_adjacencies (0.002 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_check_routes (0.002 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_check_routes (0.002 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_check_close (0.002 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_check_close (0.002 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_check_timeout (0.002 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_check_timeout (0.002 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_cleanup_all (0.969 s)
✔️ bgp_rfapi_basic_sanity.test_bgp_rfapi_basic_sanity test_cleanup_all (0.969 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_memory_leak (9.680 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_add_routes (45.726 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_adjacencies (0.004 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_adjacencies (0.004 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_check_routes (0.004 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_check_routes (0.004 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_check_close (0.005 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_check_close (0.005 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_check_timeout (0.004 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_check_timeout (0.004 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_cleanup_all (0.893 s)
✔️ bgp_rfapi_basic_sanity_config2.test_bgp_rfapi_basic_sanity_config2 test_cleanup_all (0.893 s)
✔️ bgp_route_aggregation.test_bgp_aggregation test_route_summarisation_with_summary_only_p1 (26.091 s)
✔️ bgp_route_aggregation.test_bgp_aggregation test_route_summarisation_with_as_set_p1 (15.816 s)