Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Limited number of VRFs in VPNv4 #16744

Open
2 tasks done
mnaiem81 opened this issue Sep 4, 2024 · 12 comments
Open
2 tasks done

Limited number of VRFs in VPNv4 #16744

mnaiem81 opened this issue Sep 4, 2024 · 12 comments
Labels
triage Needs further investigation

Comments

@mnaiem81
Copy link

mnaiem81 commented Sep 4, 2024

Description

I see an issue with v9.1 where I deploy +255 VRFs per server with dynamically assigned VPN label using 'label vpn export auto'

Two below scenarios happen here:

  1. If it's just booted with BGP config with at least one VRF, it assigns 128 labels pool. usually [16-143] or [80-207]
FRR1# show debugging label-table
Proto ldp: [16/79]
Proto bgp: [80/207]

FRR2# show debugging label-table
Proto bgp: [16/143]
  1. If its booted with BGP config with +255 VRFs, it assigns 255 labels pool
FRR1# show debugging label-table
Proto ldp: [16/79]
Proto ldp: [80/143]
Proto ldp: [144/207]
Proto ldp: [208/271]
Proto ldp: [272/335]
Proto ldp: [336/399]
Proto ldp: [400/463]
Proto bgp: [464/719]

What is the problem?

  • Any new configured VRF above the assigned pool, will never assigned a label which breaks VPNv4. For example, VRF#256 is broken.
  • If any VRF is deleted, its assigned label is freed up but never used for new VRFs until a reboot to re-order assigned labels.

Output of show mpls table below from one FRR with 260 VRFs, the last configured 15 VRFs not working because no labels for them although from table label#466,469,471,472, etc are free from previously deleted VRFs.

464            BGP   013f10d46      -
465            BGP   0144d3d78      -
467            BGP   85405a33d      -
468            BGP   04480589a      -
470            BGP   088c7620d      -
473            BGP   0cd47cb93      -
476            BGP   137929dcf      -
477            BGP   13d51117f      -
478            BGP   1682af3f8      -
479            BGP   17cf5b54b      -
482            BGP   1d311c183      -
485            BGP   221dd6776      -
486            BGP   2276e52f7      -
487            BGP   234790c7a      -
488            BGP   24637169a      -
489            BGP   24d50840a      -
490            BGP   25fcc4268      -
491            BGP   264e04eb4      -
492            BGP   270339265      -
494            BGP   2b01c4086      -
496            BGP   2dbadccb9      -
497            BGP   2dd12c61f      -
499            BGP   2fd1ea814      -
500            BGP   304010694      -
501            BGP   31a9a8394      -
502            BGP   325003920      -
503            BGP   36aecdc61      -
504            BGP   38480e887      -
506            BGP   395f6d4ef      -
508            BGP   3be3063f0      -
510            BGP   3f423b026      -
515            BGP   468f463d0      -
517            BGP   4a0f75177      -
518            BGP   4d5938d5c      -
520            BGP   4de8b43f8      -
522            BGP   4eb560bb1      -
523            BGP   4f5d2dc82      -
524            BGP   4f7f5845b      -
526            BGP   52876563c      -
527            BGP   53af66025      -
529            BGP   56c567d50      -
531            BGP   5b7fe590c      -
533            BGP   60bec47fd      -
534            BGP   62a844ac2      -
538            BGP   6849d06c0      -
539            BGP   68bc70d71      -
540            BGP   68f31bb39      -
541            BGP   6a2cbaf78      -
542            BGP   6bd6806ad      -
543            BGP   6c197e6a1      -
544            BGP   70194d54c      -
547            BGP   730a9c284      -
549            BGP   7376d07d6      -
550            BGP   74b8906f7      -
551            BGP   794feaf76      -
553            BGP   7c177a060      -
554            BGP   7d332668a      -
555            BGP   7e1f0d776      -
557            BGP   7fc1a3acb      -
558            BGP   8091152e8      -
559            BGP   87c4c6969      -
563            BGP   89bd5c304      -
564            BGP   8a0b5b6eb      -
565            BGP   8a73b4ac1      -
566            BGP   8abb59e9b      -
567            BGP   8b4dee69b      -
568            BGP   8ba361a06      -
569            BGP   8bb3bd80d      -
570            BGP   8bb61157f      -
571            BGP   8cf2520f7      -
572            BGP   90755d43d      -
573            BGP   90cf89179      -
574            BGP   921accf27      -
575            BGP   925743e39      -
581            BGP   9b6e3bbc9      -
583            BGP   9dbb83dba      -
584            BGP   9fc94b62f      -
586            BGP   a0f0db387      -
587            BGP   a2e7ddf3f      -
588            BGP   a8dc7065b      -
589            BGP   aa1a61a66      -
590            BGP   aaf51722f      -
591            BGP   ab7a3b36b      -
592            BGP   ab9e59768      -
593            BGP   acfff2092      -
596            BGP   b4eb05d0f      -
597            BGP   b4fdfcb24      -
598            BGP   bb2671448      -
599            BGP   bcb4d8515      -
602            BGP   c01409859      -
603            BGP   c0828ef85      -
607            BGP   c7fecf00d      -
608            BGP   ca2b1c849      -
609            BGP   caa319c8f      -
610            BGP   cb1b2a13a      -
611            BGP   d56284b7a      -
613            BGP   d79f758af      -
614            BGP   dba992c58      -
615            BGP   dccb5e998      -
616            BGP   de1f18d11      -
617            BGP   de5e82878      -
620            BGP   e76d836c0      -
621            BGP   ebb90d64d      -
624            BGP   f0193db13      -
627            BGP   f86e9f55b      -
629            BGP   fc7d503bc      -
630            BGP   fd558b91d      -
631            BGP   fff044d15      -
632            BGP   484d8660a      -
633            BGP   12a2acde5      -
634            BGP   49a0b1757      -
636            BGP   34a640b4a      -
637            BGP   fa186ad90      -
638            BGP   42df6832c      -
640            BGP   c80539e3c      -
643            BGP   cecda5258      -
645            BGP   261e40e7e      -
647            BGP   6c759f0e5      -
650            BGP   fba9691ac      -
653            BGP   596961922      -
655            BGP   f179584d9      -
656            BGP   566072ab3      -
657            BGP   c1a140bd1      -
661            BGP   d3b10c25e      -
664            BGP   7c3645892      -
665            BGP   171671901      -
668            BGP   ea6dabba2      -
669            BGP   e57d4fe6c      -
670            BGP   d1d2236b0      -
671            BGP   5d3f8986f      -
672            BGP   2550d01a3      -
675            BGP   1b01c73c4      -
676            BGP   7d4f521f6      -
678            BGP   696591593      -
684            BGP   828bb533c      -
685            BGP   28bb20ad3      -
688            BGP   92d9fb9d7      -
692            BGP   041cb7e24      -
698            BGP   9d967434c      -
702            BGP   4d60f1282      -
703            BGP   11a12983f      -
710            BGP   a896470ec      -
711            BGP   410b4b96d      -
713            BGP   d906abfdc      -
715            BGP   2af87759f      -
717            BGP   fc4db85bd      -
719            BGP   060b0a466      -

VRF config (nothing special)

 router bgp 65444 vrf 088c7620d
 no bgp ebgp-requires-policy
 no bgp suppress-duplicates
 no bgp hard-administrative-reset
 no bgp graceful-restart notification
 no bgp network import-check
 !
 address-family ipv4 unicast
  redistribute connected
  label vpn export auto
  rd vpn export 5655:7036
  rt vpn both 65000:7036
  export vpn
  import vpn
 exit-address-family
exit

Version

FRR1# show version
FRRouting 9.1_git (sevrer) on Linux(4.15.0-172-generic).
Copyright 1996-2005 Kunihiro Ishiguro, et al.
configured with:
    '--prefix=/usr' '--sbindir=/usr/lib/frr' '--sysconfdir=/etc/frr' '--libdir=/usr/lib' '--localstatedir=/var/run/frr' '--enable-rpki' '--enable-vtysh' '--enable-multipath=64' '--enable-vty-group=frrvty' '--enable-user=frr' '--enable-group=frr' '--enable-pcre2posix' '--enable-scripting' 'CC=gcc' 'CXX=g++'

How to reproduce

  • To reproduce, run 'show debugg label-table' to check assigned pool chunk.
    If it is 128, you need to create more than 128 VRFs and verify from show mpls table.
    if it is 256, you need to create more than 256 VRFs and verify from show mpls table.

  • Delete any VRF to free-up its assigned label and try to get it dynamically assigned again.

Expected behavior

Expected behaviors here:

  • Dynamic label pool could be anything between 16 - 1048575 and makes no sense to be limited to 128 or 256 BGP labels.
  • Pool should be dynamic and can assign new labels pool when needed without need to reboot or be limited to specific number.
  • Released labels should be available for re-assignment without need to reboot.

Actual behavior

Limitation of supported VRFs per server limits its usage

Additional context

No response

Checklist

  • I have searched the open issues for this bug.
  • I have not included sensitive information in this report.
@mnaiem81 mnaiem81 added the triage Needs further investigation label Sep 4, 2024
@pguibert6WIND
Copy link
Member

Hi @mnaiem81 , this looks like a label manager issue in BGP, where BGP does not know:

  • how to reuse freed labels
  • how to enlarge the label pool
    more information should be given:
show bgp labelpool chunks
show bgp labelpool inuse
show bgp labelpool ledger
show bgp labelpool requests
show bgp labelpool summary

@mnaiem81
Copy link
Author

mnaiem81 commented Sep 5, 2024

Hi @pguibert6WIND,
Please find output below from FRR that currently has 227 VRFs configured some of them has no labels assigned because of old VRFs were deleted and new ones added after a point where more than 256 were configured.

FRR1# show bgp labelpool chunks
     First       Last       Size      nfree
-------------------------------------------
       464        719        256          0
       
FRR1# show bgp labelpool inuse
Prefix                Label
---------------------------
VRF                        464
VRF                        465
VRF                        466
VRF                        467
VRF                        468
VRF                        469
VRF                        470
VRF                        471
VRF                        472
VRF                        473
VRF                        474
VRF                        475
VRF                        476
VRF                        477
VRF                        478
VRF                        479
VRF                        480
VRF                        481
VRF                        482
VRF                        483
VRF                        484
VRF                        485
VRF                        486
VRF                        487
VRF                        488
VRF                        489
VRF                        490
VRF                        491
VRF                        492
VRF                        493
VRF                        494
VRF                        495
VRF                        496
VRF                        497
VRF                        498
VRF                        499
VRF                        500
VRF                        501
VRF                        502
VRF                        503
VRF                        504
VRF                        505
VRF                        506
VRF                        507
VRF                        508
VRF                        509
VRF                        510
VRF                        511
VRF                        512
VRF                        513
VRF                        514
VRF                        515
VRF                        516
VRF                        517
VRF                        518
VRF                        519
VRF                        520
VRF                        521
VRF                        522
VRF                        523
VRF                        524
VRF                        525
VRF                        526
VRF                        527
VRF                        528
VRF                        529
VRF                        530
VRF                        531
VRF                        532
VRF                        533
VRF                        534
VRF                        535
VRF                        536
VRF                        537
VRF                        538
VRF                        539
VRF                        540
VRF                        541
VRF                        542
VRF                        543
VRF                        544
VRF                        545
VRF                        546
VRF                        547
VRF                        548
VRF                        549
VRF                        550
VRF                        551
VRF                        552
VRF                        553
VRF                        554
VRF                        555
VRF                        556
VRF                        557
VRF                        558
VRF                        559
VRF                        560
VRF                        561
VRF                        562
VRF                        563
VRF                        564
VRF                        565
VRF                        566
VRF                        567
VRF                        568
VRF                        569
VRF                        570
VRF                        571
VRF                        572
VRF                        573
VRF                        574
VRF                        575
VRF                        576
VRF                        577
VRF                        578
VRF                        579
VRF                        580
VRF                        581
VRF                        582
VRF                        583
VRF                        584
VRF                        585
VRF                        586
VRF                        587
VRF                        588
VRF                        589
VRF                        590
VRF                        591
VRF                        592
VRF                        593
VRF                        594
VRF                        595
VRF                        596
VRF                        597
VRF                        598
VRF                        599
VRF                        600
VRF                        601
VRF                        602
VRF                        603
VRF                        604
VRF                        605
VRF                        606
VRF                        607
VRF                        608
VRF                        609
VRF                        610
VRF                        611
VRF                        612
VRF                        613
VRF                        614
VRF                        615
VRF                        616
VRF                        617
VRF                        618
VRF                        619
VRF                        620
VRF                        621
VRF                        622
VRF                        623
VRF                        624
VRF                        625
VRF                        626
VRF                        627
VRF                        628
VRF                        629
VRF                        630
VRF                        631
VRF                        632
VRF                        633
VRF                        634
VRF                        635
VRF                        636
VRF                        637
VRF                        638
VRF                        639
VRF                        640
VRF                        641
VRF                        642
VRF                        643
VRF                        644
VRF                        645
VRF                        646
VRF                        647
VRF                        648
VRF                        649
VRF                        650
VRF                        651
VRF                        652
VRF                        653
VRF                        654
VRF                        655
VRF                        656
VRF                        657
VRF                        658
VRF                        659
VRF                        660
VRF                        661
VRF                        662
VRF                        663
VRF                        664
VRF                        665
VRF                        666
VRF                        667
VRF                        668
VRF                        669
VRF                        670
VRF                        671
VRF                        672
VRF                        673
VRF                        674
VRF                        675
VRF                        676
VRF                        677
VRF                        678
VRF                        679
VRF                        680
VRF                        681
VRF                        682
VRF                        683
VRF                        684
VRF                        685
VRF                        686
VRF                        687
VRF                        688
VRF                        689
VRF                        690
VRF                        691
VRF                        692
VRF                        693
VRF                        694
VRF                        695
VRF                        696
VRF                        697
VRF                        698
VRF                        699
VRF                        700
VRF                        701
VRF                        702
VRF                        703
VRF                        704
VRF                        705
VRF                        706
VRF                        707
VRF                        708
VRF                        709
VRF                        710
VRF                        711
VRF                        712
VRF                        713
VRF                        714
VRF                        715
VRF                        716
VRF                        717
VRF                        718
VRF                        719
FRR1# show bgp labelpool ledger
Prefix                Label
---------------------------
VRF                        675
VRF                        676
VRF                        677
VRF                        678
VRF                        679
VRF                        681
VRF                        684
VRF                        686
VRF                        687
VRF                        697
VRF                        703
VRF                        689
VRF                        4294967295
VRF                        709
VRF                        4294967295
VRF                        710
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        654
VRF                        690
VRF                        717
VRF                        655
VRF                        656
VRF                        657
VRF                        658
VRF                        683
VRF                        706
VRF                        707
VRF                        708
VRF                        718
VRF                        4294967295
VRF                        4294967295
VRF                        659
VRF                        660
VRF                        699
VRF                        704
VRF                        719
VRF                        661
VRF                        662
VRF                        700
VRF                        705
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        663
VRF                        664
VRF                        665
VRF                        666
VRF                        701
VRF                        4294967295
VRF                        4294967295
VRF                        667
VRF                        691
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        668
VRF                        669
VRF                        670
VRF                        671
VRF                        672
VRF                        673
VRF                        692
VRF                        674
VRF                        630
VRF                        631
VRF                        632
VRF                        633
VRF                        634
VRF                        635
VRF                        636
VRF                        637
VRF                        638
VRF                        639
VRF                        712
VRF                        4294967295
VRF                        640
VRF                        641
VRF                        642
VRF                        680
VRF                        713
VRF                        643
VRF                        644
VRF                        645
VRF                        646
VRF                        647
VRF                        648
VRF                        695
VRF                        714
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        649
VRF                        696
VRF                        715
VRF                        650
VRF                        651
VRF                        682
VRF                        685
VRF                        652
VRF                        716
VRF                        4294967295
VRF                        653
VRF                        606
VRF                        607
VRF                        608
VRF                        609
VRF                        610
VRF                        611
VRF                        612
VRF                        4294967295
VRF                        613
VRF                        614
VRF                        615
VRF                        616
VRF                        617
VRF                        618
VRF                        619
VRF                        688
VRF                        620
VRF                        621
VRF                        622
VRF                        623
VRF                        624
VRF                        625
VRF                        694
VRF                        4294967295
VRF                        626
VRF                        627
VRF                        628
VRF                        4294967295
VRF                        629
VRF                        582
VRF                        693
VRF                        4294967295
VRF                        583
VRF                        584
VRF                        585
VRF                        586
VRF                        587
VRF                        588
VRF                        589
VRF                        590
VRF                        591
VRF                        592
VRF                        593
VRF                        594
VRF                        595
VRF                        596
VRF                        597
VRF                        598
VRF                        599
VRF                        600
VRF                        601
VRF                        602
VRF                        603
VRF                        604
VRF                        605
VRF                        4294967295
VRF                        4294967295
VRF                        4294967295
VRF                        558
VRF                        559
VRF                        560
VRF                        561
VRF                        562
VRF                        563
VRF                        564
VRF                        565
VRF                        566
VRF                        567
VRF                        568
VRF                        569
VRF                        570
VRF                        571
VRF                        572
VRF                        573
VRF                        574
VRF                        575
VRF                        576
VRF                        4294967295
VRF                        577
VRF                        578
VRF                        579
VRF                        580
VRF                        581
VRF                        546
VRF                        4294967295
VRF                        547
VRF                        548
VRF                        549
VRF                        550
VRF                        551
VRF                        552
VRF                        553
VRF                        554
VRF                        555
VRF                        556
VRF                        557
VRF                        534
VRF                        535
VRF                        536
VRF                        702
VRF                        537
VRF                        4294967295
VRF                        538
VRF                        539
VRF                        540
VRF                        541
VRF                        542
VRF                        543
VRF                        544
VRF                        545
VRF                        522
VRF                        523
VRF                        524
VRF                        525
VRF                        526
VRF                        527
VRF                        528
VRF                        529
VRF                        530
VRF                        4294967295
VRF                        531
VRF                        532
VRF                        533
VRF                        510
VRF                        511
VRF                        512
VRF                        513
VRF                        514
VRF                        515
VRF                        516
VRF                        517
VRF                        518
VRF                        519
VRF                        711
VRF                        520
VRF                        521
VRF                        504
VRF                        505
VRF                        506
VRF                        507
VRF                        508
VRF                        509
VRF                        498
VRF                        499
VRF                        500
VRF                        501
VRF                        502
VRF                        503
VRF                        492
VRF                        493
VRF                        494
VRF                        495
VRF                        496
VRF                        497
VRF                        486
VRF                        487
VRF                        488
VRF                        489
VRF                        490
VRF                        491
VRF                        483
VRF                        484
VRF                        485
VRF                        480
VRF                        481
VRF                        4294967295
VRF                        482
VRF                        477
VRF                        478
VRF                        479
VRF                        474
VRF                        4294967295
VRF                        475
VRF                        4294967295
VRF                        4294967295
VRF                        476
VRF                        471
VRF                        472
VRF                        473
VRF                        468
VRF                        469
VRF                        4294967295
VRF                        470
VRF                        465
VRF                        466
VRF                        4294967295
VRF                        467
VRF                        698
VRF                        464
FRR1#  show bgp labelpool requests
Prefix
----------------
FRR1# show bgp labelpool summary
Labelpool Summary
-----------------
Ledger:       302
InUse:        256
Requests:     0
LabelChunks:  1
Pending:      256
Reconnects:   1

@mnaiem81
Copy link
Author

Is this the same for FRR v10 ? or a plan to fix?

@pguibert6WIND
Copy link
Member

pguibert6WIND commented Sep 26, 2024

Is this the same for FRR v10 ? or a plan to fix?

I think the issue still remains, and a fix needs to be done.
BGP label manager issue.

No plan to fix as of today.
you should contact your support team:)

@varuntumbe
Copy link
Contributor

Hi @mnaiem81 ,

Would it be possible to share "show running-config" of problematic node and its one of the peer ? ( peer which has vpnv4 session with problematic node. )

Thanks

@mnaiem81
Copy link
Author

mnaiem81 commented Nov 7, 2024

here is config, I just removed one PL named 'PL.NET4.SPECIFIC' which permits some public IPs but nothing fancy there just PL.

'''Current configuration:
!
frr version 9.1_git
frr defaults traditional
hostname net-prod-011
no ipv6 forwarding
service integrated-vtysh-config
!
ip route 100.79.254.104/32 Null0
ip route 100.79.254.126/32 Null0
ip route 100.79.254.141/32 Null0
ip route 100.79.254.150/32 Null0
!
vrf 1ecee3627
ip route 0.0.0.0/0 172.27.0.2
exit-vrf
!
vrf cecda5258
ip route 0.0.0.0/0 172.27.2.2
exit-vrf
!
vrf 596961922
ip route 0.0.0.0/0 172.27.0.2
exit-vrf
!
vrf 85405a33d
ip route 0.0.0.0/0 172.27.1.2
exit-vrf
!
vrf 43a3dcf89
ip route 0.0.0.0/0 172.27.1.2
exit-vrf
!
vrf e067b6238
ip route 0.0.0.0/0 172.27.0.2
exit-vrf
!
vrf 59877e10e
ip route 0.0.0.0/0 172.27.0.2
exit-vrf
!
vrf 14bba0212
ip route 0.0.0.0/0 172.27.0.2
exit-vrf
!
vrf 24933e019
ip route 0.0.0.0/0 172.27.0.2
exit-vrf
!
interface lo
ip router isis BACKBONE
isis circuit-type level-2-only
isis passive
exit
!
interface bond0.3058
ip router isis BACKBONE
isis bfd
isis circuit-type level-2-only
exit
!
interface bond0.3056
ip router isis BACKBONE
isis bfd
isis circuit-type level-2-only
exit
!
router bgp 11111
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp default ipv4-unicast
no bgp graceful-restart notification
no bgp network import-check
neighbor 10.10.255.238 remote-as 11111
neighbor 10.10.255.238 description CR02
neighbor 10.10.255.238 update-source lo
neighbor 10.10.255.238 advertisement-interval 1
neighbor 10.10.255.238 timers 3 12
neighbor 10.10.255.239 remote-as 11111
neighbor 10.10.255.239 description CR01
neighbor 10.10.255.239 update-source lo
neighbor 10.10.255.239 advertisement-interval 1
neighbor 10.10.255.239 timers 3 12
!
address-family ipv4 unicast
network 10.10.243.3/32
network 10.10.243.4/32
network 100.79.254.104/32
network 100.79.254.126/32
network 100.79.254.141/32
network 100.79.254.150/32
neighbor 10.10.255.238 activate
neighbor 10.10.255.238 route-map RM.NET4.SERVER.TO.CORE out
neighbor 10.10.255.239 activate
neighbor 10.10.255.239 route-map RM.NET4.SERVER.TO.CORE out
exit-address-family
!
address-family ipv4 vpn
neighbor 10.10.255.238 activate
neighbor 10.10.255.238 next-hop-self force
neighbor 10.10.255.239 activate
neighbor 10.10.255.239 next-hop-self force
exit-address-family
exit
!
router bgp 11111 vrf 08cbf80bd
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7254
rt vpn both 65000:7254
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 0afb24aa2
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7118
rt vpn both 65000:7118
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 186c59d5c
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7311
rt vpn both 65000:7311
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 1ec8cca2a
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7309
rt vpn both 65000:7309
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 2054f26ba
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7297
rt vpn both 65000:7297
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 270339265
bgp router-id 172.27.3.1
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export 80069
rd vpn export 5655:7423
rt vpn both 65000:7423
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 290e9d29c
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7305
rt vpn both 65000:7305
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 2c8472cc2
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7132
rt vpn both 65000:7132
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 2fbb1f6dd
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7259
rt vpn both 65000:7259
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 3885ab1b8
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7028
rt vpn both 65000:7028
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 3abaeeeb4
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7291
rt vpn both 65000:7291
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 3e327bcd4
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7312
rt vpn both 65000:7312
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 40dd739c4
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7024
rt vpn both 65000:7024
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 414b880d5
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7291
rt vpn both 65000:7291
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 43cbaf757
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7041
rt vpn both 65000:7041
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 45d7a2810
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7239
rt vpn both 65000:7239
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 49118966d
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7296
rt vpn both 65000:7296
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 4e3ac47f9
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7214
rt vpn both 65000:7214
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 52362fc22
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7301
rt vpn both 65000:7301
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 609e5e250
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7240
rt vpn both 65000:7240
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 6443ba47d
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7236
rt vpn both 65000:7236
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 6c197e6a1
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7184
rt vpn both 65000:7184
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 70cfd238b
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7290
rt vpn both 65000:7290
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 731fb072d
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7301
rt vpn both 65000:7301
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 7a105972d
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7299
rt vpn both 65000:7299
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 7c177a060
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7139
rt vpn both 65000:7139
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 7e2b34e13
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7006
rt vpn both 65000:7006
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 88fd4b53e
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7275
rt vpn both 65000:7275
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 896db5dfe
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7176
rt vpn both 65000:7176
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 8982671db
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7293
rt vpn both 65000:7293
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 8a73b4ac1
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7083
rt vpn both 65000:7083
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 933a51cbf
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7202
rt vpn both 65000:7202
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 939c7cf77
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7305
rt vpn both 65000:7305
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 94e7942f7
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7287
rt vpn both 65000:7287
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 9638d892e
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7228
rt vpn both 65000:7228
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf a0d9c5342
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7093
rt vpn both 65000:7093
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf b3b17b23d
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7425
rt vpn both 65000:7425
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf b40a3c86e
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7008
rt vpn both 65000:7008
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf bb2671448
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7173
rt vpn both 65000:7173
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf bd0ef53ac
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7310
rt vpn both 65000:7310
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf bfc6fd996
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7288
rt vpn both 65000:7288
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf c0f5d38c1
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7020
rt vpn both 65000:7020
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf c78e3d3d2
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7040
rt vpn both 65000:7040
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf dec7927f1
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7172
rt vpn both 65000:7172
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf ec57b3b83
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7146
rt vpn both 65000:7146
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf efdcd37cd
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7121
rt vpn both 65000:7121
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf f3f8c577c
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7327
rt vpn both 65000:7327
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf fff044d15
no bgp ebgp-requires-policy
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
no bgp network import-check
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7120
rt vpn both 65000:7120
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 135e15bcb
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7451
rt vpn both 65000:7451
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf eb7200633
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7471
rt vpn both 65000:7471
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf cecda5258
bgp router-id 172.27.2.1
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
redistribute static
label vpn export 80046
rd vpn export 5655:7181
rt vpn both 65000:7181
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 26a698071
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7481
rt vpn both 65000:7481
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 596961922
bgp router-id 172.27.0.1
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
redistribute static
label vpn export auto
rd vpn export 5655:7168
rt vpn both 65000:7168
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 1ecee3627
bgp router-id 172.27.0.1
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
redistribute static
label vpn export 80041
rd vpn export 5655:7105
rt vpn both 65000:7105
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf TEST_VRF
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
network 172.27.27.27/32
redistribute connected
label vpn export auto
rd vpn export 5655:9999
rt vpn both 65000:9999
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf TEST_VRF1
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export 654
rd vpn export 5655:8777
rt vpn both 65000:8777
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf TEST_VRF2
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export 655
rd vpn export 5655:9777
rt vpn both 65000:9777
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf TEST_VRF3
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export 653
rd vpn export 5655:9666
rt vpn both 65000:9666
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf TEST_VRF4
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:8555
rt vpn both 65000:8555
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 696591593
no bgp suppress-duplicates
no bgp hard-administrative-reset
no bgp graceful-restart notification
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7410
rt vpn both 65000:7410
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 410b4b96d
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7519
rt vpn both 65000:7519
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf d906abfdc
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7059
rt vpn both 65000:7059
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf bf0f96c09
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7440
rt vpn both 65000:7440
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf ef04357c5
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7261
rt vpn both 65000:7261
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 85405a33d
bgp router-id 172.27.1.1
!
address-family ipv4 unicast
redistribute connected
redistribute static
label vpn export 472
rd vpn export 5655:7546
rt vpn both 65000:7546
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 6814c54b5
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7562
rt vpn both 65000:7562
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf a92aaa145
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7570
rt vpn both 65000:7570
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf a8dc7065b
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
label vpn export 80030
rd vpn export 5655:7191
rt vpn both 65000:7191
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 43a3dcf89
bgp router-id 172.27.1.1
!
address-family ipv4 unicast
redistribute connected
redistribute static
label vpn export auto
rd vpn export 5655:7061
rt vpn both 65000:7061
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf a871be4ac
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
label vpn export auto
rd vpn export 5655:7098
rt vpn both 65000:7098
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 14bba0212
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
redistribute static
label vpn export 480
rd vpn export 5655:7103
rt vpn both 65000:7103
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 8091152e8
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
label vpn export 80039
rd vpn export 5655:7022
rt vpn both 65000:7022
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 24933e019
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
redistribute static
label vpn export 80019
rd vpn export 5655:7001
rt vpn both 65000:7001
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 20e1dd936
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
label vpn export 80003
rd vpn export 5655:7020
rt vpn both 65000:7020
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf e067b6238
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
redistribute static
label vpn export 475
rd vpn export 5655:7027
rt vpn both 65000:7027
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 59877e10e
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
redistribute static
label vpn export 80001
rd vpn export 5655:7023
rt vpn both 65000:7023
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 15099f360
bgp router-id 172.27.1.1
!
address-family ipv4 unicast
redistribute connected
label vpn export 80005
rd vpn export 5655:7545
rt vpn both 65000:7545
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 9f541228e
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
label vpn export 80002
rd vpn export 5655:7012
rt vpn both 65000:7012
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 631461e60
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
label vpn export 80004
rd vpn export 5655:7013
rt vpn both 65000:7013
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 2ad5f00f2
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
label vpn export 80006
rd vpn export 5655:7015
rt vpn both 65000:7015
export vpn
import vpn
exit-address-family
exit
!
router bgp 11111 vrf 11607d775
bgp router-id 172.27.0.1
!
address-family ipv4 unicast
redistribute connected
label vpn export 80007
rd vpn export 5655:7024
rt vpn both 65000:7024
export vpn
import vpn
exit-address-family
exit
!
mpls ldp
router-id 10.10.243.4
!
address-family ipv4
discovery transport-address 10.10.243.4
!
interface bond0.3056
exit
!
interface bond0.3058
exit
!
exit-address-family
!
exit
!
router isis BACKBONE
is-type level-2-only
net 49.0000.0001.0002.0111.00
lsp-timers gen-interval 5 refresh-interval 900 max-lifetime 1200
spf-interval 5
log-adjacency-changes
exit
!
ip prefix-list 192-168-0-0 seq 5 permit 192.168.0.0/16 le 32
ip prefix-list ALLOW-VPN seq 5 permit 172.20.1.56/30
ip prefix-list ALLOW-VPN seq 6 permit 172.20.1.60/30
ip prefix-list ALLOW-VPN seq 10 deny any
ip prefix-list EXPORT-PRIVATE seq 5 permit 10.14.0.10/32 le 32
ip prefix-list EXPORT-PRIVATE seq 10 permit 192.168.20.0/24 le 32
ip prefix-list EXPORT-PRIVATE seq 1000 deny any
ip prefix-list PL.NET4.DENY.ALL seq 5 deny 0.0.0.0/0 le 32
!
route-map ALLOW-VPN permit 10
match ip address prefix-list ALLOW-VPN
exit
!
route-map EXPORT-PRIVATE permit 10
match ip address prefix-list EXPORT-PRIVATE
exit
!
route-map RM.NET4.192-168 permit 10
match ip address prefix-list 192-168-0-0
exit
!
route-map RM.NET4.DENY.ALL permit 10
match ip address prefix-list PL.NET4.DENY.ALL
exit
!
route-map RM.NET4.SERVER.TO.CORE permit 10
match ip address prefix-list PL.NET4.SPECIFIC
exit
!
bfd
peer 100.65.73.1 interface bond0.3056
transmit-interval 750
receive-interval 750
exit
!
peer 100.65.73.129 interface bond0.3058
transmit-interval 750
receive-interval 750
exit
!
exit
!
end'''

connected VPN config

'''
router bgp 11111
neighbor 10.10.243.3
remote-as 11111
timers 3 12
advertisement-interval 1
description net-prod-011
update-source Loopback0
graceful-restart disable
address-family ipv4 unicast
route-policy RP.NET4.PERMIT.ALL in
route-reflector-client
route-policy RP.NET4.DEFAULT.ONLY out
default-originate
!
address-family vpnv4 unicast
route-policy RP.NET4.PERMIT.ALL in
route-reflector-client
route-policy RP.NET4.PERMIT.ALL out
'''

@varuntumbe
Copy link
Contributor

r1# show version
FRRouting 10.3-dev-MyOwnFRRVersion-g7c1034087 (r1) on Linux(5.15.0-76-generic).
Copyright 1996-2005 Kunihiro Ishiguro, et al.
This is a git build of frr-10.3-dev-85-g7c1034087
Associated branch(es):
local:master
github/FRRouting/frr.git/master

configured with:
'--prefix=/usr' '--includedir=${prefix}/include' '--bindir=${prefix}/bin' '--sbindir=${prefix}/lib/frr' '--libdir=${prefix}/lib/frr' '--libexecdir=${prefix}/lib/frr' '--sysconfdir=/etc' '--localstatedir=/var' '--with-moduledir=${prefix}/lib/frr/modules' '--enable-configfile-mask=0640' '--enable-logfile-mask=0640' '--enable-snmp=agentx' '--enable-multipath=64' '--enable-user=frr' '--enable-group=frr' '--enable-vty-group=frrvty' '--enable-config-rollbacks' '--with-pkg-git-version' '--with-pkg-extra-version=-MyOwnFRRVersion'
r1#
r1#
r1# show bgp labelpool chunks
First Last Size nfree

   400        911        512        196
   144        399        256          0
    16        143        128          0

r1#
r1#

I have around 800 BGP vpnv4 sessions but seeing 2 things.

  1. For me label pool is getting expanded as and when more session gets created
  2. but as mentioned released label value is not getting reused ( when delete some vrfs and add new ones ).

May be to hit the first problem ( breaking vpnv4 session, may I need to have some LDP labels as well as the submitter has ? ), Currently I dont have LDP running. I just have vpnv4 EBGP sessions.

I will try extending the current topo to include LDP as well and check the behavior.

Please suggest if there are better ideas @donaldsharp @pguibert6WIND.

Thanks

@louberger
Copy link
Member

if you come up with a stripped down topotest showing the issue, we take a look at if this.

@paulzlabn
Copy link
Contributor

Could someone please describe a minimal topology + config to show this problem? I don't normally work with mpls but I do have a vanilla linux VM with FRR. Can it be done with a single instance of FRR?

I tried just loading the FRR config file containing the running config that mnaiem81 posted above but "show mpls table" was empty. Surely I'm missing some other important pieces.

@mnaiem81
Copy link
Author

mnaiem81 commented Dec 2, 2024

Hi @paulzlabn
Topology is two routers running

  • IGP (IS-IS or OSPF)
router isis BACKBONE
 is-type level-2-only
 net 49.0000.0001.0002.0111.00
 lsp-timers gen-interval 5 refresh-interval 900 max-lifetime 1200
 spf-interval 5
 log-adjacency-changes
exit
interface bond0.3056
 ip router isis BACKBONE
 isis circuit-type level-2-only
exit
  • MPLS LDP
mpls ldp
 router-id 10.10.243.4
 !
 address-family ipv4
  discovery transport-address 10.10.243.4
  !
  interface bond0.3056
  exit
  !
 exit-address-family
 !
exit
  • BGP VPNv4 + IPv4 AFIs
router bgp 65444
 neighbor 10.10.255.238 remote-as 65444
 neighbor 10.10.255.238 description BACKBONE
 neighbor 10.10.255.238 update-source lo
 neighbor 10.10.255.238 advertisement-interval 1
 neighbor 10.10.255.238 timers 3 12
 !
 address-family ipv4 unicast
  neighbor 10.10.255.238 activate
exit-address-family
   !
 address-family ipv4 vpn
  neighbor 10.10.255.238 activate
  neighbor 10.10.255.238 next-hop-self force
   exit-address-family
exit

@paulzlabn
Copy link
Contributor

Hi @paulzlabn Topology is two routers running [...]

Lou indicated you were working on a topotest - any luck? It might take me a while otherwise to get a working setup.

@varuntumbe
Copy link
Contributor

Hey,

We were able to write the topotest and find the solution. Will commit shortly

Thanks
Varun

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
triage Needs further investigation
Projects
None yet
Development

No branches or pull requests

5 participants