VxLAN factory. Kashi na 1

Hello habr. A halin yanzu ni ne jagoran kwas na "Network Engineer" a OTUS.
A cikin tsammanin fara sabon rajista don kwas "Injiniya Network", Na shirya jerin labarai akan fasahar VxLAN EVPN.

Akwai adadi mai yawa akan yadda VxLAN EVPN ke aiki, don haka ina so in tattara ayyuka da ayyuka daban-daban don magance matsaloli a cibiyar bayanan zamani.

VxLAN factory. Kashi na 1

A cikin ɓangaren farko na jerin akan fasahar VxLAN EVPN, Ina so in duba hanyar da za a tsara haɗin L2 tsakanin runduna a saman masana'anta na cibiyar sadarwa.

Duk misalan za a yi su akan Cisco Nexus 9000v, wanda aka taru a cikin Topology na Spine-Leaf. Ba za mu tsaya kan kafa cibiyar sadarwar Underlay ba a cikin wannan labarin.

  1. cibiyar sadarwa karkashin kasa
  2. BGP peering don adireshin-iyali l2vpn evpn
  3. Saitin NVE
  4. Suppress-arp

cibiyar sadarwa karkashin kasa

Ana amfani da topology kamar haka:

VxLAN factory. Kashi na 1

Bari mu saita adireshin akan duk na'urori:

Spine-1 - 10.255.1.101
Spine-2 - 10.255.1.102

Leaf-11 - 10.255.1.11
Leaf-12 - 10.255.1.12
Leaf-21 - 10.255.1.21

Host-1 - 192.168.10.10
Host-2 - 192.168.10.20

Bari mu duba cewa akwai haɗin IP tsakanin duk na'urori:

Leaf21# sh ip route
<........>
10.255.1.11/32, ubest/mbest: 2/0                      ! Leaf-11 доступен чеерз два Spine
    *via 10.255.1.101, Eth1/4, [110/81], 00:00:03, ospf-UNDERLAY, intra
    *via 10.255.1.102, Eth1/3, [110/81], 00:00:03, ospf-UNDERLAY, intra
10.255.1.12/32, ubest/mbest: 2/0                      ! Leaf-12 доступен чеерз два Spine
    *via 10.255.1.101, Eth1/4, [110/81], 00:00:03, ospf-UNDERLAY, intra
    *via 10.255.1.102, Eth1/3, [110/81], 00:00:03, ospf-UNDERLAY, intra
10.255.1.21/32, ubest/mbest: 2/0, attached
    *via 10.255.1.22, Lo0, [0/0], 00:02:20, local
    *via 10.255.1.22, Lo0, [0/0], 00:02:20, direct
10.255.1.101/32, ubest/mbest: 1/0
    *via 10.255.1.101, Eth1/4, [110/41], 00:00:06, ospf-UNDERLAY, intra
10.255.1.102/32, ubest/mbest: 1/0
    *via 10.255.1.102, Eth1/3, [110/41], 00:00:03, ospf-UNDERLAY, intra

Bari mu bincika cewa an ƙirƙiri yankin VPC kuma duka masu sauyawa biyu sun wuce rajistan daidaito kuma saitunan a kan nodes biyu iri ɗaya ne:

Leaf11# show vpc 

vPC domain id                     : 1
Peer status                       : peer adjacency formed ok
vPC keep-alive status             : peer is alive
Configuration consistency status  : success
Per-vlan consistency status       : success
Type-2 consistency status         : success
vPC role                          : primary
Number of vPCs configured         : 0
Peer Gateway                      : Disabled
Dual-active excluded VLANs        : -
Graceful Consistency Check        : Enabled
Auto-recovery status              : Disabled
Delay-restore status              : Timer is off.(timeout = 30s)
Delay-restore SVI status          : Timer is off.(timeout = 10s)
Operational Layer3 Peer-router    : Disabled

vPC status
----------------------------------------------------------------------------
Id    Port          Status Consistency Reason                Active vlans
--    ------------  ------ ----------- ------                ---------------
5     Po5           up     success     success               1

Farashin BGP

A ƙarshe, za mu iya ci gaba zuwa daidaita hanyar sadarwar Overlay.

A matsayin wani ɓangare na labarin, wajibi ne a tsara hanyar sadarwa tsakanin runduna, kamar yadda aka nuna a cikin zanen da ke ƙasa:

VxLAN factory. Kashi na 1

Don saita hanyar sadarwa mai rufewa, kuna buƙatar kunna BGP akan Canjin Spine da Leaf tare da goyan bayan dangin l2vpn evpn:

feature bgp
nv overlay evpn

Na gaba, kuna buƙatar saita peering BGP tsakanin Leaf da Spine. Don sauƙaƙe saitin da haɓaka rarraba bayanan kwatance, muna saita Spine azaman uwar garken Route-Reflector. Za mu rubuta duk Leaf a cikin saitin ta hanyar samfuri don inganta saitin.

Don haka saitin kan Spine yayi kama da haka:

router bgp 65001
  template peer LEAF 
    remote-as 65001
    update-source loopback0
    address-family l2vpn evpn
      send-community
      send-community extended
      route-reflector-client
  neighbor 10.255.1.11
    inherit peer LEAF
  neighbor 10.255.1.12
    inherit peer LEAF
  neighbor 10.255.1.21
    inherit peer LEAF

Saitin akan Canjin Leaf yayi kama da haka:

router bgp 65001
  template peer SPINE
    remote-as 65001
    update-source loopback0
    address-family l2vpn evpn
      send-community
      send-community extended
  neighbor 10.255.1.101
    inherit peer SPINE
  neighbor 10.255.1.102
    inherit peer SPINE

A kan Spine, bari mu bincika peering tare da duk Canjin Leaf:

Spine1# sh bgp l2vpn evpn summary
<.....>
Neighbor        V    AS MsgRcvd MsgSent   TblVer  InQ OutQ Up/Down  State/PfxRcd
10.255.1.11     4 65001       7       8        6    0    0 00:01:45 0
10.255.1.12     4 65001       7       7        6    0    0 00:01:16 0
10.255.1.21     4 65001       7       7        6    0    0 00:01:01 0

Kamar yadda kuke gani, babu matsaloli tare da BGP. Bari mu ci gaba don saita VxLAN. Za a yi ƙarin daidaitawa ne kawai a gefen maɓallan Leaf. Spine yana aiki ne kawai azaman tushen cibiyar sadarwa kuma yana shiga cikin watsa zirga-zirga kawai. Duk aiki akan encapsulation da ma'anar hanya yana faruwa ne kawai akan maɓallan leaf.

Saitin NVE

NVE - cibiyar sadarwa kama-da-wane

Kafin fara saitin, bari mu gabatar da wasu kalmomi:

VTEP - Vitual Tunnel End Point, na'urar da ramin VxLAN ke farawa ko ƙare. VTEP ba dole ba ne kowace na'ura ta hanyar sadarwa ba. Sabar da ke goyan bayan fasahar VxLAN kuma na iya aiki. A cikin ilimin kimiyyar mu, duk masu canza Leaf sune VTEPs.

VNI - Virtual Network Index - mai gano hanyar sadarwa tsakanin VxLAN. Kuna iya zana kwatance tare da VLAN. Duk da haka, akwai wasu bambance-bambance. Lokacin amfani da masana'anta, VLANs sun zama na musamman kawai a cikin canjin ganye guda ɗaya kuma ba a yaɗa su a cikin hanyar sadarwa. Amma kowane VLAN yana iya samun lambar VNI mai alaƙa da ita, wanda aka rigaya yaɗa shi ta hanyar sadarwar. Abin da yake kama da kuma yadda za a iya amfani da shi za a tattauna a kasa.

Bari mu ba da damar fasalin don fasahar VxLAN ta yi aiki da ikon haɗa lambobin VLAN tare da lambar VNI:

feature nv overlay
feature vn-segment-vlan-based

Bari mu saita ƙirar NVE, wanda ke da alhakin aikin VxLAN. Wannan keɓancewa yana da alhakin ɗaukar hotuna a cikin masu kai VxLAN. Kuna iya zana misalin tare da Tunnel interface don GRE:

interface nve1
  no shutdown
  host-reachability protocol bgp ! используем BGP для передачи маршрутной информации
  source-interface loopback0    ! интерфейс  с которого отправляем пакеты loopback0

A kan Leaf-21 canzawa, an halicce duk abin da ba tare da matsala ba. Koyaya, idan muka duba fitar da umarnin show nve peers, to zai zama fanko. Anan kuna buƙatar komawa zuwa saitin VPC. Mun ga cewa Leaf-11 da Leaf-12 an haɗa su kuma an haɗa su ta hanyar yankin VPC. Wannan yana haifar da yanayi mai zuwa:

Mai watsa shiri-2 yana aika firam ɗaya zuwa Leaf-21 don ya watsa shi akan hanyar sadarwa zuwa Mai watsa shiri-1. Koyaya, Leaf-21 yana ganin cewa adireshin MAC na Mai watsa shiri-1 yana samun damar ta hanyar VTEP guda biyu a lokaci ɗaya. Menene Leaf-21 ya kamata yayi a wannan yanayin? Bayan haka, wannan yana nufin cewa madauki zai iya bayyana a cikin hanyar sadarwa.

Don magance wannan yanayin, muna buƙatar Leaf-11 da Leaf-12 don yin aiki azaman na'ura ɗaya a cikin masana'anta. Ana warware shi a sauƙaƙe. A kan Maɓallin Loopback wanda muke gina rami, ƙara adireshin na biyu. Adireshin sakandare dole ne ya zama iri ɗaya akan duka VTEPs.

interface loopback0
 ip add 10.255.1.10/32 secondary

Don haka, daga ra'ayi na sauran VTEPs, muna samun topology mai zuwa:

VxLAN factory. Kashi na 1

Wato, yanzu za a gina rami tsakanin adireshin IP na Leaf-21 da IP mai kama da juna tsakanin Leaf-11 guda biyu da Leaf-12. Yanzu ba za a sami matsala koyan adireshin MAC daga na'urori biyu ba kuma zirga-zirga na iya motsawa daga wannan VTEP zuwa wani. Wanne daga cikin VTEPs guda biyu zai aiwatar da zirga-zirgar zirga-zirgar an yanke shawarar ta amfani da tebur mai tuƙi akan Spine:

Spine1# sh ip route
<.....>
10.255.1.10/32, ubest/mbest: 2/0
    *via 10.255.1.11, Eth1/1, [110/41], 1d01h, ospf-UNDERLAY, intra
    *via 10.255.1.12, Eth1/2, [110/41], 1d01h, ospf-UNDERLAY, intra
10.255.1.11/32, ubest/mbest: 1/0
    *via 10.255.1.11, Eth1/1, [110/41], 1d22h, ospf-UNDERLAY, intra
10.255.1.12/32, ubest/mbest: 1/0
    *via 10.255.1.12, Eth1/2, [110/41], 1d01h, ospf-UNDERLAY, intra

Kamar yadda kake gani a sama, adireshin 10.255.1.10 yana samuwa nan da nan ta hanyar biyu Next-hops.

A wannan mataki, mun magance ainihin haɗin kai. Bari mu ci gaba don saita ƙirar NVE:
Nan da nan za mu kunna Vlan 10 kuma mu haɗa shi da VNI 10000 akan kowane Leaf don runduna. Saita rami L2 tsakanin runduna

vlan 10                 ! Включаем VLAN на всех VTEP подключенных к необходимым хостам
  vn-segment 10000      ! Ассоциируем VLAN с номер VNI 

interface nve1
  member vni 10000      ! Добавляем VNI 10000 для работы через интерфейс NVE. для инкапсуляции в VxLAN
    ingress-replication protocol bgp    ! указываем, что для распространения информации о хосте используем BGP

Yanzu bari mu bincika nve takwarorina da tebur don BGP EVPN:

Leaf21# sh nve peers
Interface Peer-IP          State LearnType Uptime   Router-Mac
--------- ---------------  ----- --------- -------- -----------------
nve1      10.255.1.10      Up    CP        00:00:41 n/a                 ! Видим что peer доступен с secondary адреса

Leaf11# sh bgp l2vpn evpn

   Network            Next Hop            Metric     LocPrf     Weight Path
Route Distinguisher: 10.255.1.11:32777    (L2VNI 10000)        ! От кого именно пришел этот l2VNI
*>l[3]:[0]:[32]:[10.255.1.10]/88                                   ! EVPN route-type 3 - показывает нашего соседа, который так же знает об l2VNI10000
                      10.255.1.10                       100      32768 i
*>i[3]:[0]:[32]:[10.255.1.20]/88
                      10.255.1.20                       100          0 i
* i                   10.255.1.20                       100          0 i

Route Distinguisher: 10.255.1.21:32777
* i[3]:[0]:[32]:[10.255.1.20]/88
                      10.255.1.20                       100          0 i
*>i                   10.255.1.20                       100          0 i

A sama muna ganin hanyoyin EVPN kawai-nau'in 3. Wannan nau'in hanyar yana magana game da peer (Leaf), amma ina masu masaukin mu suke?
Abun shine cewa ana watsa bayanai game da rundunonin MAC ta hanyar hanyar EVPN-nau'in 2

Domin ganin rundunoninmu, kuna buƙatar saita hanyar EVPN-nau'in 2:

evpn
  vni 10000 l2
    route-target import auto   ! в рамках данной статьи используем автоматический номер для route-target
    route-target export auto

Bari mu yi amfani da Mai watsa shiri-2 zuwa Mai watsa shiri-1:

Firewall2# ping 192.168.10.1
PING 192.168.10.1 (192.168.10.1): 56 data bytes
36 bytes from 192.168.10.2: Destination Host Unreachable
Request 0 timed out
64 bytes from 192.168.10.1: icmp_seq=1 ttl=254 time=215.555 ms
64 bytes from 192.168.10.1: icmp_seq=2 ttl=254 time=38.756 ms
64 bytes from 192.168.10.1: icmp_seq=3 ttl=254 time=42.484 ms
64 bytes from 192.168.10.1: icmp_seq=4 ttl=254 time=40.983 ms

Kuma a ƙasa za mu iya ganin cewa nau'in hanya-2 tare da adireshin MAC mai watsa shiri ya bayyana a cikin tebur BGP - 5001.0007.0007 da 5001.0008.0007

Leaf11# sh bgp l2vpn evpn
<......>

   Network            Next Hop            Metric     LocPrf     Weight Path
Route Distinguisher: 10.255.1.11:32777    (L2VNI 10000)
*>l[2]:[0]:[0]:[48]:[5001.0007.0007]:[0]:[0.0.0.0]/216                      !  evpn route-type 2 и mac адрес хоста 1
                      10.255.1.10                       100      32768 i
*>i[2]:[0]:[0]:[48]:[5001.0008.0007]:[0]:[0.0.0.0]/216                      ! evpn route-type 2 и mac адрес хоста 2
* i                   10.255.1.20                       100          0 i
*>l[3]:[0]:[32]:[10.255.1.10]/88
                      10.255.1.10                       100      32768 i
Route Distinguisher: 10.255.1.21:32777
* i[2]:[0]:[0]:[48]:[5001.0008.0007]:[0]:[0.0.0.0]/216
                      10.255.1.20                       100          0 i
*>i                   10.255.1.20                       100          0 i

Na gaba, zaku iya ganin cikakken bayani akan Sabuntawa, wanda kuka karɓi bayanai game da Mai watsa shiri na MAC. A ƙasa ba duk fitarwar umarni bane.

Leaf21# sh bgp l2vpn evpn 5001.0007.0007

BGP routing table information for VRF default, address family L2VPN EVPN
Route Distinguisher: 10.255.1.11:32777        !  отправил Update с MAC Host. Не виртуальный адрес VPC, а адрес Leaf
BGP routing table entry for [2]:[0]:[0]:[48]:[5001.0007.0007]:[0]:[0.0.0.0]/216,
 version 1507
Paths: (2 available, best #2)
Flags: (0x000202) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not i
n HW

  Path type: internal, path is valid, not best reason: Neighbor Address, no labe
led nexthop
  AS-Path: NONE, path sourced internal to AS
    10.255.1.10 (metric 81) from 10.255.1.102 (10.255.1.102)    ! с кем именно строим VxLAN тоннель
      Origin IGP, MED not set, localpref 100, weight 0
      Received label 10000         ! Номер VNI, который ассоциирован с VLAN, в котором находится Host
      Extcommunity: RT:65001:10000 SOO:10.255.1.10:0 ENCAP:8        ! Тут видно, что RT сформировался автоматически на основе номеров AS и VNI
      Originator: 10.255.1.11 Cluster list: 10.255.1.102
<........>

Bari mu ga yadda firam ɗin ke kama da lokacin da aka ratsa su cikin masana'anta:

VxLAN factory. Kashi na 1

Ƙaddamarwa-ARP

Mai girma, yanzu muna da sadarwar L2 tsakanin runduna kuma zamu iya gamawa a can. Duk da haka, ba duka ba ne mai sauƙi. Muddin muna da 'yan kaɗan ba za a sami matsala ba. Amma bari mu yi tunanin yanayin da muke da ɗaruruwa da dubban runduna. Wace matsala za mu iya fuskanta?

Wannan matsalar ita ce zirga-zirgar BUM(Broadcast, Unknown Unicast, Multicast). A cikin tsarin wannan labarin, za mu yi la'akari da zaɓi na magance zirga-zirgar watsa shirye-shirye.
Babban janareta na Watsa shirye-shiryen a cikin hanyoyin sadarwar Ethernet shine runduna da kansu ta hanyar ka'idar ARP.

Nexus yana aiwatar da tsarin da ke gaba don magance buƙatun ARP - suppress-arp.
Wannan fasalin yana aiki kamar haka:

  1. Mai watsa shiri-1 yana aika buƙatar APR zuwa adireshin Watsa shirye-shiryen cibiyar sadarwar sa.
  2. Buƙatar ta kai ga Canjin Leaf kuma maimakon wuce wannan buƙatar ta gaba zuwa masana'anta zuwa Mai watsa shiri-2, Leaf yana amsa kanta kuma yana nuna IP da MAC da ake buƙata.

Don haka, buƙatar Watsa shirye-shiryen ba ta je masana'anta ba. Amma ta yaya wannan zai iya aiki idan Leaf kawai ya san adireshin MAC?

Komai abu ne mai sauƙi, nau'in hanyar EVPN-nau'in 2, ban da adireshin MAC, na iya watsa haɗin MAC/IP. Don yin wannan, kuna buƙatar saita adireshin IP a cikin VLAN akan Leaf. Tambayar ta taso, menene IP zan saita? A kan nexus yana yiwuwa a ƙirƙiri adireshi da aka rarraba (daya) akan duk masu sauyawa:

feature interface-vlan

fabric forwarding anycast-gateway-mac 0001.0001.0001    ! задаем virtual mac для создания распределенного шлюза между всеми коммутаторами

interface Vlan10
  no shutdown
  ip address 192.168.10.254/24          ! на всех Leaf задаем одинаковый IP
  fabric forwarding mode anycast-gateway    ! говорим использовать Virtual mac

Don haka, daga mahangar runduna, hanyar sadarwar za ta kasance kamar haka:

VxLAN factory. Kashi na 1

Duba BGP l2routeevpn

Leaf11# sh bgp l2vpn evpn
<......>

   Network            Next Hop            Metric     LocPrf     Weight Path
Route Distinguisher: 10.255.1.11:32777    (L2VNI 10000)
*>l[2]:[0]:[0]:[48]:[5001.0007.0007]:[0]:[0.0.0.0]/216
                      10.255.1.21                       100      32768 i
*>i[2]:[0]:[0]:[48]:[5001.0008.0007]:[0]:[0.0.0.0]/216
                      10.255.1.10                       100          0 i
* i                   10.255.1.10                       100          0 i
* i[2]:[0]:[0]:[48]:[5001.0008.0007]:[32]:[192.168.10.20]/248
                      10.255.1.10                       100          0 i
*>i                   10.255.1.10                       100          0 i

<......>

Route Distinguisher: 10.255.1.21:32777
* i[2]:[0]:[0]:[48]:[5001.0008.0007]:[0]:[0.0.0.0]/216
                      10.255.1.20                       100          0 i
*>i                   10.255.1.20                       100          0 i
* i[2]:[0]:[0]:[48]:[5001.0008.0007]:[32]:[192.168.10.20]/248
*>i                   10.255.1.20                       100          0 i

<......>

Daga fitowar umarni zaku iya ganin cewa a cikin nau'in hanyar EVPN-nau'in 2, ban da MAC, yanzu muna kuma ga adireshin IP ɗin mai watsa shiri.

Bari mu koma zuwa saitin suppress-arp. An kunna wannan saitin don kowane VNI daban:

interface nve1
  member vni 10000   
    suppress-arp

Sa'an nan wasu rikitarwa sun taso:

  • Don wannan fasalin yayi aiki, ana buƙatar sarari a cikin ƙwaƙwalwar TCAM. Ga misalin saituna don suppress-arp:

hardware access-list tcam region arp-ether 256

Wannan saitin zai buƙaci fa'ida biyu. Wato idan kun saita 256, to kuna buƙatar 'yantar da 512 a cikin TCAM. Kafa TCAM ya wuce iyakar wannan labarin, tunda kafa TCAM ya dogara ne kawai akan aikin da aka ba ku kuma yana iya bambanta daga wannan hanyar sadarwa zuwa waccan.

  • Dole ne a aiwatar da aiwatar da suppress-arp akan duk maɓallan Leaf. Koyaya, rikitarwa na iya tasowa lokacin daidaitawa akan nau'ikan Leaf waɗanda ke zaune a cikin yankin VPC. Idan an canza TCAM, daidaito tsakanin nau'i-nau'i zai karye kuma za'a iya cire kumburi ɗaya daga aiki. Bugu da ƙari, ana iya buƙatar sake kunna na'urar don amfani da saitin canjin TCAM.

A sakamakon haka, kuna buƙatar yin la'akari da hankali ko, a cikin halin ku, yana da daraja aiwatar da wannan saitin a cikin masana'anta mai gudana.

Wannan ya ƙare ɓangaren farko na jerin. A kashi na gaba za mu kalli yadda za a bi ta hanyar masana'anta ta VxLAN tare da rabuwar hanyoyin sadarwa zuwa VRF daban-daban.

Kuma yanzu ina gayyatar kowa da kowa zuwa webinar kyauta, a cikin abin da zan gaya muku dalla-dalla game da kwas. Mahalarta 20 na farko don yin rajista don wannan gidan yanar gizon za su sami Takaddun Rangwame ta imel a cikin kwanaki 1-2 bayan watsa shirye-shiryen.

source: www.habr.com

Add a comment