Te hangahanga o nga hanganga IT e kore e he. Wāhanga 1 - Te Whakareri ki te Whakatakoto i tetahi Rōpū oVirt 4.3

Ka tonohia nga kaipanui kia waia ki nga maataapono mo te hanga i te hanga he-whakaaro mo te hinonga iti i roto i te pokapū raraunga kotahi, ka korerohia i roto i nga waahanga poto o nga tuhinga.

Kupu whakataki

Na pokapū raraunga (Pokapū Tukatuka Raraunga) ka taea te mohio ko:

  • ake whatanga i roto i tona ake "ruma tūmau" i runga i te rohe o te hinonga, e tutuki nga whakaritenga iti mo te whakarato hiko me te taputapu whakamahana, me te whai waahi Ipurangi ma nga kaiwhakarato motuhake e rua;
  • he whatanga reti me ona ake taputapu, kei roto i te pokapū raraunga tuuturu - te mea e kiia ana. he kohinga Tier III, IV ranei e whakamana ana i te mana pono, te whakamatao me te kore e uru ki te Ipurangi;
  • tino riihi taputapu i roto i te Tier III ranei IV pokapū raraunga.

Ko tehea waahanga noho hei whiriwhiri - i ia keehi, he mea takitahi nga mea katoa, me te nuinga o te waa ka whakawhirinaki ki etahi take matua:

  • he aha te take e hiahia ai te hinonga ki tana ake hanganga IT;
  • he aha te hiahia o te hinonga mai i te hanganga IT (te pono, te tauine, te whakahaere, me etahi atu);
  • te nui o te haumi tuatahi i roto i nga hanganga IT, me te ahua o nga utu mo taua mea - te whakapaipai (ko te tikanga ko te hoko i a koe ake taputapu), te whakahaere ranei (he mea reti nga taputapu);
  • te pae whakamahere o te hinonga ake.

Ka taea e koe te tuhi maha mo nga take e awe ana i te whakatau a tetahi hinonga ki te hanga me te whakamahi i ona hanganga IT, engari ko ta matou whainga ko te whakaatu i roto i nga mahi me pehea te hanga i tenei tino hanganga kia pai ai te he ka taea tonu e koe te penapena - whakaitihia te utu mo te hoko rorohiko arumoni, me karo rawa ranei.

Ka rite ki nga mahi roa e whakaatu ana, kaore e pai ki te penapena i runga i te rino, na te mea ka rua nga utu a te tangata kino, me te nui noa atu. Engari ano - he taputapu pai, he taunakitanga noa tenei, a, i te mutunga he aha te mea hei hoko me te nui o te whakawhirinaki ki nga kaha o te hinonga, me te "apo" o tana whakahaere. I tua atu, ko te kupu "aroha" me maarama i roto i te tikanga pai o te kupu, na te mea he pai ake te haumi ki nga taputapu i te waahi tuatahi, kia kore ai koe e raru nui me tana tautoko me te taapiri, na te mea i te tuatahi he he. Ko te whakamahere me te nui o te penapena moni ka nui ake nga utu i te wa e timata ana tetahi kaupapa.

Na, ko nga raraunga tuatahi mo te kaupapa:

  • he hinonga kua whakatau ki te hanga i tana ake tomokanga tukutuku me te kawe i ana mahi ki te Ipurangi;
  • i whakatau te kamupene ki te riihi i tetahi whatanga ki te whakauru i ana taputapu ki roto i te pokapū raraunga pai kua whakamanahia i runga i te paerewa Tier III;
  • I whakatau te kamupene kia kaua e penapena nui i runga i nga taputapu, na reira i hokona nga taputapu e whai ake nei me nga whakamanatanga roa me te tautoko:

Rarangi taputapu

  • e rua nga tūmau Dell PowerEdge R640 tinana e whai ake nei:
  • e rua nga tukatuka Intel Xeon Gold 5120
  • 512GB RAM
  • e rua nga kōpae SAS i RAID1, mo te whakaurunga OS
  • he kaari whatunga 4-tauranga 1G i hangaia
  • e rua nga kaari whatunga 2-tauranga 10G
  • kotahi 2-tauranga FC HBA 16G.
  • Dell MD2f 3820 rokiroki pūmana hono mā FC 16G tika ki te ope Dell;
  • e rua nga huringa o te taumata tuarua - Cisco WS-C2960RX-48FPS-L kua tapae;
  • e rua nga huringa o te taumata tuatoru - Cisco WS-C3850-24T-E, kua whakauruhia ki roto i te puranga;
  • Rack, UPS, PDU, tūmau papatohu - i whakaratohia e te pokapū raraunga.

Ka taea e tatou te kite, he pai nga tumanakohanga o nga taputapu o naianei mo te whakahekenga whakapae me te poutū, mena ka taea e te hinonga te whakataetae me etahi atu kamupene o te ahua o te ahua i runga i te Ipurangi, ka tiimata ki te whai hua ka taea te haumi ki te whakarahi i nga rauemi mo etahi atu whakataetae. tipu hua.

He aha nga taputapu ka taea e taatau te taapiri mena ka whakatau te hinonga ki te whakanui ake i nga mahi o a maatau roopu rorohiko:

  • he nui to matou rahui i runga i te maha o nga tauranga i runga i nga huringa 2960X, ko te tikanga ka taea e matou te taapiri atu i etahi atu taputapu taputapu;
  • hoko e rua nga whakawhiti FC hei hono i nga punaha rokiroki me etahi atu kaitoro ki a raatau;
  • ka taea te whakahou ake i nga tūmau o naianei - taapirihia te mahara, whakakapihia nga kaitahuri ki nga mea pai ake, hono atu ki te whatunga 10G me nga urutau whatunga o naianei;
  • ka taea e koe te taapiri atu i nga papaa kōpae ki te punaha rokiroki me nga momo kōpae e hiahiatia ana - SAS, SATA, SSD ranei, i runga i te kawenga kua whakaritea;
  • i muri i te taapiri i nga huringa FC, ka taea e koe te hoko i tetahi atu punaha rokiroki hei taapiri atu i te kaha o te kopae, a ki te hoko koe i tetahi whiringa Tukurua Mamao motuhake ki a ia, ka taea e koe te whirihora i te tukurua raraunga i waenga i nga punaha rokiroki i roto i nga rohe o tetahi pokapū raraunga me waenga i nga pokapū raraunga. (engari kei tua atu i te waahi o te tuhinga);
  • kei reira ano nga huringa taumata-tuatoru - Cisco 3850, ka taea te whakamahi hei matua o te whatunga he-whakaaro mo te ararere tere-tere i waenga i nga whatunga o roto. Ka awhina nui tenei i nga wa kei te heke mai, i te mea ka tipu haere nga hanganga o roto. Kei te 3850 hoki nga tauranga 10G ka taea te whakamahi i muri mai ka whakahou ake i nga taputapu whatunga ki te tere 10G.

I tenei wa kaore he waahi kaore he mariko, ka tino pai taatau, ina koa he huarahi pai tenei ki te whakaiti i te utu mo te hoko i nga kaitoro utu nui mo nga waahanga hangahanga takitahi (tumau tukutuku, papaa raraunga, me etahi atu), kaore i te tino pai. whakamahia i roto i te take o te kawenga iti, a ko tenei te mea ka puta i te timatanga o te whakarewanga kaupapa.

I tua atu, he maha atu nga painga o te mariko ka tino whai hua ki a tatou: Ko te VM he he mai i te ngoikoretanga o te tūmau taputapu, Te heke ora i waenga i nga kohinga taputapu tautau mo te tiaki, te tohatoha a-ringa, te tohatoha aunoa ranei i waenga i nga kohinga kapoi, aha atu.

Mo nga taputapu i hokona e te hinonga, ko te tukunga o te roopu VMware vSphere e tino watea ana e kii ana, engari na te mea e mohiotia ana tetahi raupaparorohiko mai i VMware mo ona tohu utu "hoiho", ka whakamahia e matou he punaha whakahaere mariko kore utu - Tuhinga o mua, i runga i te kaupapa i hangaia he hua rongonui, engari kua hangaia - rhev.

Pūmanawa Tuhinga o mua he mea tika ki te whakakotahi i nga waahanga katoa o te hanganga ki te kotahi kia pai ai te mahi me nga miihini mariko e tino waatea ana - ko nga papaaarangi, tono paetukutuku, tūmau takawaenga, taurite, tūmau mo te kohi rangitaki me te tātari, me era atu, ara. , he aha te tomokanga tukutuku o to tatou hinonga.

Hei whakarapopototanga i tenei kupu whakataki, kei te tatari mai nga tuhinga e whai ake nei, e whakaatu ana me pehea te whakatakoto i te katoa o nga taputapu me nga hanganga rorohiko o te hinonga:

Rarangi tuhinga

  • Tuhinga o 1. Kei te whakareri ki te tuku i tetahi roopu oVirt 4.3.
  • Tuhinga o 2. Te whakauru me te whirihora i te roopu oVirt 4.3.
  • Tuhinga o 3. Te whakatu i te kahui VyOS, te whakarite i te ara-a-waho he-kore.
  • Tuhinga o 4. Te whakatu i te puranga Cisco 3850, te whakarite ararere ipurangiroto.

Wāhanga 1. Te Whakareri ki te Hoatu i te OVirt 4.3 Cluster

Tatūnga kaihautū taketake

Ko te whakauru me te whirihora i te OS te taahiraa ngawari. He maha nga tuhinga mo te whakauru tika me te whirihora i te OS, na reira kaore he tikanga ki te ngana ki te whakaputa i tetahi mea motuhake mo tenei.

Na, e rua a matou nga kaihautu Dell PowerEdge R640 e hiahia ana matou ki te whakauru i te OS me te mahi i nga tautuhinga tuatahi kia taea ai te whakamahi hei hypervisors ki te whakahaere miihini mariko i roto i te roopu oVirt 4.3.

I te mea e whakamahere ana matou ki te whakamahi i te rorohiko kore-arumoni kore utu oVirt, i kowhiria e matou te OS mo te tuku ope. CentOS 7.7, ahakoa ka taea te whakauru i etahi atu punaha whakahaere ki nga kaihautu mo oVirt:

  • he hanga motuhake i runga i te RHEL, ko te mea e kiia ana. oVirt Node;
  • OS Oracle Linux Raumati 2019 i panuitia mo te pupuri i te oVirt ki runga.

I mua i te whakauru i te OS, ka tūtohuhia:

  • whirihora i te atanga whatunga iDRAC i runga i nga ope e rua;
  • whakahōu mārō mō BIOS me iDRAC ki ngā putanga hou;
  • whirihora i te Kōtaha Pūnaha o te tūmau, he pai ki te aratau Mahi;
  • whirihorahia te RAID mai i nga kopae a-rohe (e taunaki ana a RAID1) hei whakauru i te OS ki runga i te tūmau.

Na ka whakauruhia e matou te OS ki runga i te kōpae i hangaia i mua ma te iDRAC - he mea noa te tukanga whakauru, kaore he waa motuhake i roto. Ka taea hoki e koe te uru atu ki te papatohu tūmau ki te tiimata i te whakaurunga OS ma te iDRAC, ahakoa kaore he mea e arai i a koe ki te hono tika i te kaitirotiro, papapātuhi me te kiore ki te tūmau me te whakauru i te OS mai i te puku kohiko.

I muri i te whakauru i te OS, ka mahia e matou ona tautuhinga tuatahi:

systemctl enable network.service
systemctl start network.service
systemctl status network.service

systemctl stop NetworkManager
systemctl disable NetworkManager
systemctl status NetworkManager

yum install -y ntp
systemctl enable ntpd.service
systemctl start ntpd.service

cat /etc/sysconfig/selinux
SELINUX=disabled
SELINUXTYPE=targeted

cat /etc/security/limits.conf
 *               soft    nofile         65536
 *               hard   nofile         65536

cat /etc/sysctl.conf
vm.max_map_count = 262144
vm.swappiness = 1

Te tāuta i te huinga pūmanawa taketake

Mo te tatūnga OS tuatahi, me whirihora e koe tetahi atanga whatunga i runga i te tūmau kia uru koe ki te Ipurangi ki te whakahou i te OS me te whakauru i nga kohinga rorohiko e tika ana. Ka taea tenei i te wa o te whakaurunga OS me muri.

yum -y install epel-release
yum update
yum -y install bind-utils yum-utils net-tools git htop iotop nmon pciutils sysfsutils sysstat mc nc rsync wget traceroute gzip unzip telnet 

Ko nga tautuhinga katoa o runga ake nei me te huinga o nga raupaparorohiko he take o te hiahia whaiaro, a ko tenei huinga he taunakitanga anake.

I te mea ka mahi to tatou kaihautu i te mahi a te hypervisor, ka taea e tatou te tohu mahi e hiahiatia ana:

systemctl enable tuned 
systemctl start tuned 
systemctl status tuned 

tuned-adm profile 
tuned-adm profile virtual-host 

Ka taea e koe te panui atu mo te whakaaturanga whakaaturanga i konei:Upoko 4".

Whai muri i te whakaurunga o te OS, ka neke atu ki te waahanga e whai ake nei - te whirihora i nga hononga whatunga ki runga i nga kaihautu, me te puranga o nga huringa Cisco 2960X.

Te whirihora i te Cisco 2960X Whakawhiti Stack

I roto i ta maatau kaupapa, ka whakamahia nga nama VLAN e whai ake nei - ka whakapaohohia nga rohe wehe mai i a raatau, hei wehe i nga momo hokohoko rereke:

VLAN 10 - Ipurangi
VLAN 17 - Whakahaere (iDRAC, rokiroki, whakahaere whakawhiti)
VLAN 32 – Whatunga hanga VM
VLAN 33 – whatunga hononga (ki nga kaikirimana o waho)
VLAN 34 - whatunga whakamatautau VM
VLAN 35 – Whatunga kaiwhakawhanake VM
VLAN 40 – Whatunga aroturuki

I mua i te tiimata o te mahi, me hoatu he hoahoa ki te taumata L2, me tae ki te mutunga:

Te hangahanga o nga hanganga IT e kore e he. Wāhanga 1 - Te Whakareri ki te Whakatakoto i tetahi Rōpū oVirt 4.3

Mo te taunekeneke whatunga o nga kaihautu oVirt me nga miihini mariko ki a raatau ano, me te whakahaere i a maatau punaha rokiroki, he mea tika kia whirihorahia he puranga o nga huringa Cisco 2960X.

Kua hangaia e nga kaihautu Dell nga kaari whatunga 4-tauranga, na reira, he mea tika kia whakarite i to raatau hononga ki te Cisco 2960X ma te whakamahi i te hononga whatunga he-kore, ma te whakamahi i te whakarōpūtanga o nga tauranga whatunga tinana ki roto i te atanga arorau, me te LACP (802.3 ad) kawa:

  • ko nga tauranga tuatahi e rua i runga i te kaihautu kua whirihorahia i roto i te aratau hono me te hono ki te whakawhiti 2960X - ka whirihorahia tenei atanga arorau piriti me tetahi wahitau mo te whakahaere manaaki, te aro turuki, te whakawhitiwhiti korero me etahi atu kaihautu i roto i te roopu oVirt, ka whakamahia ano mo te Migration Live o nga miihini mariko;
  • ko nga tauranga tuarua e rua i runga i te kaihautu kei te whirihora ano i te aratau hononga me te hono ki te 2960X - i runga i tenei atanga arorau ma te whakamahi i te oVirt, ka hangaia nga piriti i muri mai (i nga VLAN e rite ana) ka hono atu nga miihini mariko.
  • ka hohe nga tauranga whatunga e rua i roto i te atanga arorau kotahi, ara. Ka taea te tuku waka ki runga i a raatau i te wa kotahi, i roto i te aratau taurite.
  • Ko nga tautuhinga whatunga i runga i nga kohinga kohinga me tino rite, haunga nga wahitau IP.

Tatūnga tāpae whakakā taketake 2960X me ona tauranga

I mua, ko o maatau huringa:

  • whatanga whakairihia;
  • honohia e nga taura motuhake e rua o te roa e hiahiatia ana, hei tauira, CAB-STK-E-1M;
  • hono ki te hiko;
  • hono ki te teihana mahi a te kaiwhakahaere ma te tauranga papatohu mo tana whirihoranga tuatahi.

Kei te waatea nga aratohu e tika ana mo tenei whārangi whaimana kaihanga.

I muri i te whakaoti i nga mahi i runga ake nei, ka whirihorahia e matou nga huringa.
Ko te tikanga o ia whakahau kaore e tika kia whakamaarama i roto i te anga o tenei tuhinga; mena e tika ana, ka kitea takitahi nga korero katoa.
Ko ta matou whainga ko te whakarite tere i te taapu whakawhiti me te hono i nga kaihautu me nga atanga whakahaere rokiroki ki reira.

1) Ka hono atu matou ki te whakawhiti matua, haere ki te aratau whaimana, ka haere ki te aratau whirihoranga me te hanga i nga tautuhinga taketake.

Whirihoranga whakawhiti taketake:

 enable
 configure terminal

 hostname 2960X

 no service pad
 service timestamps debug datetime msec
 service timestamps log datetime localtime show-timezone msec
 no service password-encryption
 service sequence-numbers

 switch 1 priority 15
 switch 2 priority 14
 stack-mac persistent timer 0

 clock timezone MSK 3
  vtp mode transparent
  ip subnet-zero

 vlan 17
  name Management

 vlan 32
  name PROD 

 vlan 33
  name Interconnect

 vlan 34
  name Test

 vlan 35
  name Dev

 vlan 40
  name Monitoring

 spanning-tree mode rapid-pvst
 spanning-tree etherchannel guard misconfig
 spanning-tree portfast bpduguard default
 spanning-tree extend system-id
 spanning-tree vlan 1-40 root primary
 spanning-tree loopguard default
 vlan internal allocation policy ascending
 port-channel load-balance src-dst-ip

 errdisable recovery cause loopback
 errdisable recovery cause bpduguard
 errdisable recovery interval 60

line con 0
 session-timeout 60
 exec-timeout 60 0
 logging synchronous
line vty 5 15
 session-timeout 60
 exec-timeout 60 0
 logging synchronous

 ip http server
 ip http secure-server
 no vstack

interface Vlan1
 no ip address
 shutdown

 exit 

Tiakina te whirihora me te whakahau "wr mem" ka whakaara ano i te taapu whakawhiti me te whakahau "reload»i runga i te pana matua 1.

2) Ka whirihorahia e matou nga tauranga whatunga o te whakawhiti i roto i te aratau uru (whakauru) i roto i te VLAN 17, hei hono i nga atanga mana o nga punaha rokiroki me nga tūmau iDRAC.

Whirihora Tauranga Whakahaere:

interface GigabitEthernet1/0/5
 description iDRAC - host1
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet1/0/6
 description Storage1 - Cntr0/Eth0
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet2/0/5
 description iDRAC - host2
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet2/0/6
 description Storage1 – Cntr1/Eth0
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge
 exit

3) Whai muri i te utaina ano o te puranga, tirohia kei te tika te mahi:

Te tirotiro i te mahi o te puranga:

2960X#show switch stack-ring speed

Stack Ring Speed        : 20G
Stack Ring Configuration: Full
Stack Ring Protocol     : FlexStack

2960X#show switch stack-ports
  Switch #    Port 1       Port 2
  --------    ------       ------
    1           Ok           Ok
    2           Ok           Ok

2960X#show switch neighbors
  Switch #    Port 1       Port 2
  --------    ------       ------
      1         2             2
      2         1             1

2960X#show switch detail
Switch/Stack Mac Address : 0cd0.f8e4.ХХХХ
Mac persistency wait time: Indefinite
                                           H/W   Current
Switch#  Role   Mac Address     Priority Version  State
----------------------------------------------------------
*1       Master 0cd0.f8e4.ХХХХ    15     4       Ready
 2       Member 0029.c251.ХХХХ     14     4       Ready

         Stack Port Status             Neighbors
Switch#  Port 1     Port 2           Port 1   Port 2
--------------------------------------------------------
  1        Ok         Ok                2        2
  2        Ok         Ok                1        1

4) Whakaritea te uru SSH ki te 2960X tāpae

Hei whakahaere mamao i te puranga ma te SSH, ka whakamahia e matou te IP 172.20.1.10 kua whirihorahia i runga i te SVI (whakawhiti atanga mariko) VLAN17.

Ahakoa he pai ki te whakamahi i tetahi tauranga whakatapua i runga i te whakawhiti mo nga kaupapa whakahaere, he mea tenei mo te hiahia me te whai waahi.

Te whakarite i te uru SSH ki te puranga whakawhiti:

ip default-gateway 172.20.1.2

interface vlan 17
 ip address 172.20.1.10 255.255.255.0

hostname 2960X
 ip domain-name hw.home-lab.ru
 no ip domain-lookup

clock set 12:47:04 06 Dec 2019

crypto key generate rsa

ip ssh version 2
ip ssh time-out 90

line vty 0 4
 session-timeout 60
 exec-timeout 60 0
 privilege level 15
 logging synchronous
 transport input ssh

line vty 5 15
 session-timeout 60
 exec-timeout 60 0
 privilege level 15
 logging synchronous
 transport input ssh

aaa new-model
aaa authentication login default local 
username cisco privilege 15 secret my_ssh_password

Whakaritea he kupuhipa kia uru ki te aratau whaimana:

enable secret *myenablepassword*
service password-encryption

Whakaritea NTP:

ntp server 85.21.78.8 prefer
ntp server 89.221.207.113
ntp server 185.22.60.71
ntp server 192.36.143.130
ntp server 185.209.85.222

show ntp status
show ntp associations
show clock detail

5) Whakaritea nga atanga Etherchannel arorau me nga tauranga tinana e hono ana ki nga kaihautu. Mo te ngawari o te whirihoranga, ka whakaaetia nga VLAN katoa e waatea ana i runga i nga atanga arorau katoa, engari ko te tikanga me whirihora i nga mea e hiahiatia ana:

Whirihorahia nga atanga Etherchannel:

interface Port-channel1
 description EtherChannel with Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel2
 description EtherChannel with Host2-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel3
 description EtherChannel with Host1-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel4
 description EtherChannel with Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface GigabitEthernet1/0/1
 description Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 1 mode active

interface GigabitEthernet1/0/2
 description Host2-management
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 2 mode active

interface GigabitEthernet1/0/3
 description Host1-VM
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 3 mode active

interface GigabitEthernet1/0/4
 description Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 4 mode active

interface GigabitEthernet2/0/1
 description Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 1 mode active

interface GigabitEthernet2/0/2
 description Host2-management
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 2 mode active

interface GigabitEthernet2/0/3
 description Host1-VM
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 3 mode active

interface GigabitEthernet2/0/4
 description Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 4 mode active

Te whirihoranga tuatahi o nga hononga whatunga mo nga miihini mariko, i runga i nga kaihautu Kaihautu1 и Kaihautu2

Ka tirohia e matou te waahi o nga waahanga e tika ana mo te mahi honohono i roto i te punaha, whakauruhia te waahanga mo te whakahaere piriti:

modinfo bonding
modinfo 8021q
yum install bridge-utils

Te whirihora i te atanga arorau BOND1 mo nga miihini mariko me ona atanga tinana ki nga kaihautu:

cat /etc/sysconfig/network-scripts/ifcfg-bond1
#DESCRIPTION - management
DEVICE=bond1
NAME=bond1
TYPE=Bond
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'

cat /etc/sysconfig/network-scripts/ifcfg-em2
#DESCRIPTION - management
DEVICE=em2
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

cat /etc/sysconfig/network-scripts/ifcfg-em3
#DESCRIPTION - management
DEVICE=em3
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

I muri i te whakaoti i nga tautuhinga i runga i te puranga 2960X me nga kaihautu, whakaara ano i te whatunga i runga i nga kaihautu, me te tirotiro i te mahi o te atanga arorau.

  • i runga i te kaihautu:

systemctl restart network

cat /proc/net/bonding/bond1
Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)

Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2+3 (2)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
...
802.3ad info
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable
System priority: 65535
...
Slave Interface: em2
MII Status: up
Speed: 1000 Mbps
Duplex: full
...
Slave Interface: em3
MII Status: up
Speed: 1000 Mbps
Duplex: full

  • i runga i te puranga whakawhiti 2960X:

2960X#show lacp internal
Flags:  S - Device is requesting Slow LACPDUs
        F - Device is requesting Fast LACPDUs
        A - Device is in Active mode       P - Device is in Passive mode

Channel group 1
                            LACP port     Admin     Oper    Port        Port
Port      Flags   State     Priority      Key       Key     Number      State
Gi1/0/1   SA      bndl      32768         0x1       0x1     0x102       0x3D
Gi2/0/1   SA      bndl      32768         0x1       0x1     0x202       0x3D

2960X#sh etherchannel summary
Flags:  D - down        P - bundled in port-channel
        I - stand-alone s - suspended
        H - Hot-standby (LACP only)
        R - Layer3      S - Layer2
        U - in use      N - not in use, no aggregation
        f - failed to allocate aggregator

        M - not in use, minimum links not met
        m - not in use, port not aggregated due to minimum links not met
        u - unsuitable for bundling
        w - waiting to be aggregated
        d - default port

        A - formed by Auto LAG

Number of channel-groups in use: 11
Number of aggregators:           11

Group  Port-channel  Protocol    Ports
------+-------------+-----------+-----------------------------------------------
1      Po1(SU)         LACP      Gi1/0/1(P)  Gi2/0/1(P)

Te whirihoranga tuatahi o nga hononga whatunga mo te whakahaere i nga rauemi tautau, i runga i nga kaihautu Kaihautu1 и Kaihautu2

Te whirihora i te atanga arorau BOND1 mo te whakahaere i runga i nga kaihautu, me ona atanga tinana:

cat /etc/sysconfig/network-scripts/ifcfg-bond0
#DESCRIPTION - management
DEVICE=bond0
NAME=bond0
TYPE=Bond
BONDING_MASTER=yes
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'

cat /etc/sysconfig/network-scripts/ifcfg-em0
#DESCRIPTION - management
DEVICE=em0
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

cat /etc/sysconfig/network-scripts/ifcfg-em1
#DESCRIPTION - management
DEVICE=em1
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

I muri i te whakaoti i nga tautuhinga i runga i te puranga 2960X me nga kaihautu, whakaara ano i te whatunga i runga i nga kaihautu, me te tirotiro i te mahi o te atanga arorau.

systemctl restart network
cat /proc/net/bonding/bond1

2960X#show lacp internal
2960X#sh etherchannel summary

Whakaritea he atanga whatunga whakahaere ki ia kaihautu i roto VLAN 17, ka herea ki te atanga arorau BOND1:

Te whirihora i te VLAN17 ki te Kaihautū1:

cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes 
USERCTL=no 
NM_CONTROLLED=no 
VLAN=yes
MTU=1500  
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.163
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=public

Te whirihora i te VLAN17 ki te Kaihautū2:

cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes 
USERCTL=no 
NM_CONTROLLED=no 
VLAN=yes
MTU=1500  
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.164
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=public

Ka timata ano tatou i te whatunga i runga i nga kaihautu me te tirotiro i o raatau tirohanga ki a ratau.

Ma tenei ka oti te whirihoranga o te puranga whakawhiti Cisco 2960X, a ki te tika nga mahi katoa, inaianei kei a maatau te hononga whatunga o nga huānga hanganga katoa ki a raatau i te taumata L2.

Dell MD3820f tatūnga rokiroki

I mua i te tiimata ki te whirihora i te punaha rokiroki, me hono atu ki te puranga whakawhiti Cisco 2960X atanga whakahaere, tae atu ki nga kaihautu Kaihautu1 и Kaihautu2 mā FC.

Ko te kaupapa whaanui mo te hono o te punaha rokiroki ki te puranga whakawhiti i tukuna i te upoko o mua.

Ko te kaupapa mo te hono rokiroki ma te FC ki nga kaihautu me penei te ahua:

Te hangahanga o nga hanganga IT e kore e he. Wāhanga 1 - Te Whakareri ki te Whakatakoto i tetahi Rōpū oVirt 4.3

I te wa o te hononga, he mea tika ki te tuhi i nga wahitau WWPN mo nga kaihautu FC HBA e hono ana ki nga tauranga FC i runga i te punaha rokiroki - ka tika tenei mo te whirihoranga o muri mai o te kaihautu e herea ana ki nga LUN i runga i te punaha rokiroki.

I runga i te teihana mahi a te kaiwhakahaere, tango me te whakauru i te taputapu whakahaere rokiroki Dell MD3820f - Kaiwhakahaere Rokiroki Kōpae Kōpae PowerVault (MDSM).
Ka hono atu matou ki a ia ma ona wahitau IP taunoa, ka whirihora i o matou wahitau mai i VLAN17, hei whakahaere i nga kaiwhakahaere ma te TCP/IP:

Rokiroki1:

ControllerA IP - 172.20.1.13, MASK - 255.255.255.0, Gateway - 172.20.1.2
ControllerB IP - 172.20.1.14, MASK - 255.255.255.0, Gateway - 172.20.1.2

I muri i te whakarite i nga wahitau, ka haere matou ki te atanga whakahaere rokiroki me te tautuhi i te kupuhipa, te whakarite i te wa, te whakahou i te firmware mo nga kaiwhakahaere me nga kōpae, mehemea e tika ana, etc.
Me pehea te mahi i tenei ka whakaahuahia i roto i aratohu whakahaere rokiroki.

I muri i te hanga i nga tautuhinga i runga ake nei, me mahi noa etahi mea:

  1. Whirihorahia nga ID tauranga FC kaihautu - Tautuhi Tauranga Kaihautū.
  2. Waihangahia he roopu manaaki − roopu manaaki me te taapiri i a maatau ope Dell e rua ki a ia.
  3. Waihangahia he roopu kōpae me nga kōpae mariko (LUN ranei) kei roto, ka tukuna ki nga kaihautu.
  4. Whirihorahia te whakaaturanga o nga kopae mariko (LUN ranei) mo nga kaihautu.

Ko te taapiri i nga kaihautu hou me nga tohu tohu o nga tauranga kaihautu FC ki a raatau ka mahia ma te tahua - Nga Mahere Kaihautu -> Tautuhia -> Kaihautū…
Ka kitea nga wahitau WWPN o nga kaihautu FC HBA, hei tauira, i te iDRAC o te tūmau.

Ko te mutunga, me whiwhi tatou i tetahi mea penei i tenei pikitia:

Te hangahanga o nga hanganga IT e kore e he. Wāhanga 1 - Te Whakareri ki te Whakatakoto i tetahi Rōpū oVirt 4.3

Ko te taapiri i tetahi roopu kaihautu hou me te hono i nga kaihautu ki tera ka mahia ma te tahua - Nga Mahere Kaihautu -> Tautuhia -> Rōpū Kaihautū…
Mo nga kaihautu, tohua te momo OS - Linux (DM-MP).

I muri i te hanga i tetahi roopu manaaki, ma te ripa Ratonga Rokiroki & Tārua, hanga he roopu kōpae - Rōpū Kōpae, me te momo e pa ana ki nga whakaritenga mo te whakararu i te he, hei tauira, RAID10, kei roto ko nga kōpae mariko o te rahi e hiahiatia ana:

Te hangahanga o nga hanganga IT e kore e he. Wāhanga 1 - Te Whakareri ki te Whakatakoto i tetahi Rōpū oVirt 4.3

Ka mutu, ko te waahi whakamutunga ko te whakaaturanga o nga kopae mariko (LUN ranei) mo nga kaihautu.
Ki te mahi i tenei, ma te tahua - Nga Mahere Kaihautu -> Mahere Lun -> Tāpiri ... ka herea e matou nga kopae mariko ki nga kaihautu ma te tuku tau ki a ratou.

Me penei te ahua o nga mea katoa ki tenei whakaahua:

Te hangahanga o nga hanganga IT e kore e he. Wāhanga 1 - Te Whakareri ki te Whakatakoto i tetahi Rōpū oVirt 4.3

Koinei te waahi ka mutu taatau me te whakatakotoranga rokiroki, a ki te tika nga mahi katoa, katahi ka kite nga kaihautu i nga LUN i tukuna ki a ratou ma o ratou FC HBA.
Me akiaki te punaha ki te whakahou i nga korero mo nga puku hono:

ls -la /sys/class/scsi_host/
echo "- - -" > /sys/class/scsi_host/host[0-9]/scan

Kia kite tatou he aha nga taputapu e kitea ana i runga i o maatau tūmau:

cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 02 Id: 00 Lun: 00
  Vendor: DELL     Model: PERC H330 Mini   Rev: 4.29
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 00
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 01
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 04
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 11
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 31
  Vendor: DELL     Model: Universal Xport  Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 00
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 01
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 04
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 11
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 31
  Vendor: DELL     Model: Universal Xport  Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05

lsscsi
[0:2:0:0]    disk    DELL     PERC H330 Mini   4.29  /dev/sda
[15:0:0:0]   disk    DELL     MD38xxf          0825  -
[15:0:0:1]   disk    DELL     MD38xxf          0825  /dev/sdb
[15:0:0:4]   disk    DELL     MD38xxf          0825  /dev/sdc
[15:0:0:11]  disk    DELL     MD38xxf          0825  /dev/sdd
[15:0:0:31]  disk    DELL     Universal Xport  0825  -
 [18:0:0:0]   disk    DELL     MD38xxf          0825  -
[18:0:0:1]   disk    DELL     MD38xxf          0825  /dev/sdi
[18:0:0:4]   disk    DELL     MD38xxf          0825  /dev/sdj
[18:0:0:11]  disk    DELL     MD38xxf          0825  /dev/sdk
[18:0:0:31]  disk    DELL     Universal Xport  0825  -

I runga i nga kaihautu, ka taea hoki e koe te whirihora tini, ahakoa ka taea e ia te mahi i a ia ano i te wa e whakauru ana i te oVirt, he pai ake te tirotiro i te tika o te MP i mua.

Te whakauru me te whirihora DM Multipath

yum install device-mapper-multipath
mpathconf --enable --user_friendly_names y

cat /etc/multipath.conf | egrep -v "^s*(#|$)"
defaults {
    user_friendly_names yes
            find_multipaths yes
}

blacklist {
  wwid 26353900f02796769
  devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"     
  devnode "^hd[a-z]"
 }

Tautuhia te ratonga MP ki te tiimata aunoa ka timata:

systemctl enable multipathd && systemctl restart multipathd

Te tirotiro i nga korero mo nga waahanga kua utaina mo te mahi MP:

lsmod | grep dm_multipath
dm_multipath           27792  6 dm_service_time
dm_mod                124407  139 dm_multipath,dm_log,dm_mirror

modinfo dm_multipath
filename:       /lib/modules/3.10.0-957.12.2.el7.x86_64/kernel/drivers/md/dm-multipath.ko.xz
license:        GPL
author:         Sistina Software <[email protected]>
description:    device-mapper multipath target
retpoline:      Y
rhelversion:    7.6
srcversion:     985A03DCAF053D4910E53EE
depends:        dm-mod
intree:         Y
vermagic:       3.10.0-957.12.2.el7.x86_64 SMP mod_unload modversions
signer:         CentOS Linux kernel signing key
sig_key:        A3:2D:39:46:F2:D3:58:EA:52:30:1F:63:37:8A:37:A5:54:03:00:45
sig_hashalgo:   sha256

Tiro ana i te whakarāpopototanga o te whirihoranga ara-maha o naianei:

mpathconf
multipath is enabled
find_multipaths is disabled
user_friendly_names is disabled
dm_multipath module is loaded
multipathd is running

I muri i te taapiri i te LUN hou ki te punaha rokiroki me te whakaatu ki te kaihautu, me tirotiro koe i nga HBA e hono ana ki te kaihautu kei runga.

systemctl reload multipathd
multipath -v2

Ka mutu, ka tirohia mena kua whakaatuhia nga LUN katoa ki runga i te punaha rokiroki mo nga kaihautu, me te mea e rua nga huarahi ki te katoa.

Tirohanga mahi MP:

multipath -ll
3600a098000e4b4b3000003175cec1840 dm-2 DELL    ,MD38xxf
size=2.0T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:1  sdb 8:16  active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 18:0:0:1  sdi 8:128 active ready running
3600a098000e4b48f000002ab5cec1921 dm-6 DELL    ,MD38xxf
size=10T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 18:0:0:11 sdk 8:160 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 15:0:0:11 sdd 8:48  active ready running
3600a098000e4b4b3000003c95d171065 dm-3 DELL    ,MD38xxf
size=150G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:4  sdc 8:32  active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 18:0:0:4  sdj 8:144 active ready running

Ka taea e koe te kite, ko nga kopae mariko e toru i runga i te punaha rokiroki ka kitea i roto i nga huarahi e rua. Na, kua oti katoa nga mahi whakarite, ko te tikanga ka taea e koe te haere ki te waahanga matua - te whakarite i te roopu oVirt, ka korerohia i roto i te tuhinga e whai ake nei.

Source: will.com

Tāpiri i te kōrero