ProHoster > Blog > Utongi > Kusikwa kweiyo inokanganisa-inoshivirira IT zvivakwa. Chikamu 1 - kugadzirira kuendesa oVirt 4.3 sumbu

Kusikwa kweiyo inokanganisa-inoshivirira IT zvivakwa. Chikamu 1 - kugadzirira kuendesa oVirt 4.3 sumbu

Vaverengi vanokokwa kuti vajairane nemisimboti yekuvaka chivakwa chinoshivirira chinokanganisa chebhizinesi diki mukati meimwe data data, iyo ichakurukurwa zvakadzama mune pfupi pfupi yezvinyorwa.

Chikamu chekutanga

Under Data center (Data Processing Center) inogona kunzwisiswa se:

  • yako wega rack mune yako wega "server room" pane zvivakwa zvebhizinesi, iyo inosangana nezvinodiwa zvishoma zvekupa magetsi uye kutonhora kwemidziyo, uye zvakare ine mukana weInternet kuburikidza nevaviri vakazvimiririra vanopa;
  • rack yekurenda ine midziyo yayo, iri munzvimbo chaiyo yedata - iyo inonzi. collocation, iyo inoenderana neTier III kana IV chiyero, uye inovimbisa yakavimbika magetsi ekupa, kutonhora uye kukanganisa-kushivirira kuwana Internet;
  • midziyo yekurenda zvizere muTier III kana IV data center.

Ndeipi sarudzo yekugara yekusarudza ndeyemunhu mune yega yega, uye kazhinji zvinoenderana neakati wandei zvinhu zvakakosha:

  • Nei bhizinesi richida iro rayo IT masisitimu?
  • chii chaizvo chinodiwa nebhizinesi kubva kune IT zvivakwa (kuvimbika, scalability, manejimendi, nezvimwewo);
  • huwandu hwekudyara kwekutanga muInfrastructure yeIT, pamwe nemhando ipi yemitengo yayo - capital (zvinoreva kuti unotenga yako midziyo), kana inoshanda (midziyo inowanzorendwa);
  • kuronga horizon yebhizinesi pachayo.

Zvakawanda zvinogona kunyorwa pamusoro pezvinhu zvinopesvedzera danho rebhizinesi kugadzira nekushandisa zvivakwa zvaro zveIT, asi chinangwa chedu kuratidza mukuita magadzirirwo ekugadzira iyi hurongwa kuitira kuti ive inoshivirira kukanganisa uye kuchengetedza mari. - kuderedza mutengo. yekutenga software yekutengesa, kana kuvadzivisa zvachose.

Sezviratidziro zvenguva refu, hazvina kukodzera kuchengetedza pane Hardware, sezvo stingy ichibhadhara kaviri, uye zvimwe zvakawanda. Asi zvakare, yakanaka hardware ingori kurudziro, uye pakupedzisira chii chaizvo chekutenga uye kuti yakawanda sei zvinoenderana nekugona kwebhizinesi uye "makaro" ekutungamira kwayo. Uyezve, izwi rekuti "makaro" rinofanirwa kunzwisiswa nenzira yakanaka yeshoko, nekuti zviri nani kuisa mari muhardware padanho rekutanga, kuti urege kuve nezvinetso zvakakomba nerutsigiro rwayo uye kuyera, kubva pakutanga kurongeka kwakashata. kuchengetedza zvakanyanya kunogona kutungamira kumitengo yakakwira pane yekutanga chirongwa.

Saka, iyo yekutanga data yeprojekiti:

  • kune bhizinesi rakasarudza kugadzira rayo rewebhu portal uye kuunza zviitiko zvaro kuInternet;
  • kambani yakasarudza kuhaya rack kuti iise midziyo yayo munzvimbo yakanaka yedata yakasimbiswa maererano neTier III standard;
  • kambani yakasarudza kusachengetedza zvakawanda pane Hardware, uye nekudaro yakatenga midziyo inotevera ine waranti yakawedzerwa uye rutsigiro:

Equipment list

  • maviri emuviri Dell PowerEdge R640 maseva sezvinotevera:
  • maviri Intel Xeon Goridhe 5120 processors
  • 512 GB RAM
  • maviri SAS disks muRAID1, yekuisa OS
  • yakavakirwa-mukati 4-chiteshi 1G network kadhi
  • maviri 2-port 10G network makadhi
  • imwe 2-chiteshi FC HBA 16G.
  • 2-controller kuchengetedza system Dell MD3820f, yakabatana neFC 16G yakananga kuDell mauto;
  • maviri wechipiri-level switch - Cisco WS-C2960RX-48FPS-L akaturikidzana;
  • maviri echitatu-level switch - Cisco WS-C3850-24T-E, akaturikidzana;
  • Rack, UPS, PDU, console maseva anopihwa neiyo data data.

Sezvatinoona, michina iripo ine tarisiro yakanaka yekuyera uye yakatwasuka kuyera, kana bhizinesi richikwanisa kukwikwidza nemamwe makambani echimiro chakafanana paInternet, uye chotanga kuwana purofiti, iyo inogona kuiswa mukuwedzera zviwanikwa zvekuwedzera makwikwi. uye kuwedzera purofiti.

Ndeipi michina yatinogona kuwedzera kana bhizinesi rafunga kuwedzera kuita kwecomputing cluster yedu:

  • isu tine hombe yekuchengetedza muhuwandu hwezviteshi pane 2960X switch, zvinoreva kuti tinogona kuwedzera mamwe maseva ehardware;
  • tenga maviri ekuwedzera FC switch yekubatanidza masisitimu ekuchengetedza uye mamwe maseva kwavari;
  • maseva aripo anogona kukwidziridzwa - kuwedzera chiyeuchidzo, kutsiva ma processor ane mamwe ane simba, batanidza kune network 10G uchishandisa iripo network adapter;
  • Iwe unogona kuwedzera mamwe masherufu edhisiki kune yekuchengetedza system nemhando inodiwa yediski - SAS, SATA kana SSD, zvichienderana nemutoro wakarongwa;
  • mushure mekuwedzera FC switch, unogona kutenga imwe yekuchengetedza sisitimu kuti uwedzere dhisiki yakawanda, uye kana iwe ukatenga yakakosha Remote Replication sarudzo kwairi, unogona kuseta kudzokororwa kwedata pakati pezvigadziriso zvekuchengetedza mukati meiyo data data uye pakati penzvimbo dzedata ( asi izvi zvatopfuura mukati mechikamu chechinyorwa);
  • Kune zvakare yechitatu-nhanho switch - Cisco 3850, iyo inogona kushandiswa seyakanganisa-inoshivirira network musimboti weiyo-kumhanya-mhanya pakati pemukati metiweki. Izvi zvichabatsira zvikuru mune ramangwana sezvo zvivako zvemukati zvinokura. Iyo 3850 zvakare ine 10G ports, iyo inogona kushandiswa gare gare kana uchikwidziridza network yako michina kuenda ku10G kumhanya.

Sezvo pari zvino pasina pese pasina virtualization, isu tichave tiri muchimiro, kunyanya sezvo iyi iri nzira yakanaka yekudzikisa mutengo wekutenga anodhura maseva kune ega ega zvivakwa zvinhu (webhu maseva, dhatabhesi, nezvimwewo), izvo zvisiri nguva dzose. optimal inoshandiswa kana yakaderera mutoro, uye izvi ndizvo chaizvo zvichaitika pakutanga kwekutanga kweprojekiti.

Uye zvakare, virtualization ine mamwe akawanda mabhenefiti anogona kutibatsira zvakanyanya: VM kukanganisa kushivirira kunopesana nehardware server kutadza, Kurarama kutama pakati pehardware cluster node dzekugadzirisa kwavo, manyorerwo kana otomatiki kugovera pakati pemasumbu masumbu, nezvimwe.

Kune Hardware yakatengwa nebhizinesi, kutumirwa kweiyo inowanikwa VMware vSphere cluster inozviratidza, asi sezvo chero software kubva kuVMware ichizivikanwa ne "bhiza" mutengo tags, isu tichashandisa yemahara software yekugadzirisa virtualization - oVirt, pahwaro hwekuti chigadzirwa chinozivikanwa asi chatove chekutengesa chinogadzirwa - rhev.

Software oVirt zvinodikanwa kusanganisa zvese zvezvivakwa kuita chinhu chimwe chete kuti ugone kushanda zviri nyore nemachina anowanikwa zvakanyanya - aya madhatabhesi, mawebhusaiti ekushandisa, proxy maseva, zviremera, maseva ekuunganidza matanda uye analytics, nezvimwewo, izvo webhu portal yebhizinesi redu ine.

Kupfupisa iyi sumo, tinogona kutarisira kune zvinotevera zvinyorwa, izvo zvicharatidza mukuita chaizvo maitiro ekuendesa iyo yese hardware uye software zvivakwa zvebhizinesi:

Rondedzero yezvinyorwa

  • Chikamu 1. Kugadzirira kuendesa oVirt 4.3 cluster.
  • Chikamu 2. Kuisa uye kugadzirisa oVirt 4.3 cluster.
  • Chikamu 3. Kumisikidza VyOS cluster, kuronga kukanganisa-kushivirira nzira yekunze.
  • Chikamu 4. Kumisikidza Cisco 3850 stack, kuronga intranet routing.

Chikamu 1. Kugadzirira kuendesa oVirt 4.3 cluster

Basic host setup

Kuisa uye kugadzirisa iyo OS ndiyo nhanho iri nyore. Kune akawanda akawanda zvinyorwa pamusoro pekuisa nemazvo uye kugadzirisa iyo OS, saka hapana chikonzero mukuyedza kupa chimwe chinhu chakasarudzika pamusoro peizvi.

Saka, isu tine maviri eDell PowerEdge R640 mauto atinoda kuisa OS uye kuita zvigadziriso zvekutanga kuitira kuti tizvishandise se hypervisors yekumhanyisa mashini chaiwo muoVirt 4.3 cluster.

Sezvo isu tichironga kushandisa iyo yemahara isiri-yekutengesa oVirt software, iyo OS yakasarudzwa kuendesa mauto. CentOS 7.7, kunyangwe mamwe maOS anogona kuisirwa pane anotambira oVirt:

  • yakakosha kuvaka yakavakirwa paRHEL, iyo inonzi. oVirt Node;
  • OS Oracle Linux, zhizha 2019 zvakaziviswa nezve kutsigira basa reoVirt pairi.

Usati waisa OS inokurudzirwa:

  • gadzirisa iyo iDRAC network interface pane ese ari maviri mauto;
  • gadziridza BIOS uye iDRAC firmware kune ichangoburwa shanduro;
  • gadzirisa iyo server's System Profile, zviri nani muPerformance mode;
  • gadzirisa RAID kubva kumadhisiki emunharaunda (RAID1 inokurudzirwa) kuisa OS pane server.

Ipapo isu tinoisa iyo OS pane dhisiki yakagadzirwa kare kuburikidza neDRAC - iyo yekuisa maitiro ndeye yakajairika, hapana yakakosha nguva mairi. Kuwana kune server console kutanga OS kuisirwa kunogona zvakare kuwanikwa kuburikidza neDRAC, kunyangwe pasina chinokutadzisa kubatanidza cheki, keyboard uye mbeva zvakananga kune server uye nekuisa iyo OS kubva kune flash drive.

Mushure mekuisa iyo OS, tinoita marongero ayo ekutanga:

systemctl enable network.service
systemctl start network.service
systemctl status network.service

systemctl stop NetworkManager
systemctl disable NetworkManager
systemctl status NetworkManager

yum install -y ntp
systemctl enable ntpd.service
systemctl start ntpd.service

cat /etc/sysconfig/selinux
SELINUX=disabled
SELINUXTYPE=targeted

cat /etc/security/limits.conf
 *               soft    nofile         65536
 *               hard   nofile         65536

cat /etc/sysctl.conf
vm.max_map_count = 262144
vm.swappiness = 1

Kuisa yakakosha seti yesoftware

Kuti utange kugadzirisa OS, unofanirwa kugadzirisa chero network network pane sevha kuitira kuti iwe ugone kuwana iyo Internet kugadzirisa OS uye kuisa inodiwa software mapakeji. Izvi zvinogona kuitwa zvese panguva yekuiswa kweOS uye shure kwayo.

yum -y install epel-release
yum update
yum -y install bind-utils yum-utils net-tools git htop iotop nmon pciutils sysfsutils sysstat mc nc rsync wget traceroute gzip unzip telnet

Zvese zviri pamusoro apa marongero uye software set inyaya yekuda kwako, uye iyi seti ingori kurudziro.

Sezvo mugamuchiri wedu achizoita basa re hypervisor, isu tichagonesa inodiwa maitiro ekuita:

systemctl enable tuned 
systemctl start tuned 
systemctl status tuned 

tuned-adm profile 
tuned-adm profile virtual-host

Unogona kuverenga zvakawanda nezve profil performance pano: "Chapter 4. tuned and tuned-adm".

Mushure mekuisa iyo OS, tinoenda kune inotevera chikamu - kumisikidza network interfaces pane mauto uye stack yeCisco 2960X switch.

Kugadzirisa Cisco 2960X Switch Stack

Chirongwa chedu chichashandisa nhamba dzinotevera dzeVLAN - kana nhepfenyuro, dzakaparadzaniswa kubva kune mumwe, kuitira kuparadzanisa marudzi akasiyana emotokari:

VLAN 10 - Internet
VLAN 17 -Kutungamira (iDRAC, masisitimu ekuchengetedza, switch switch)
VLAN 32 -VM kugadzira network
VLAN 33 - yekubatanidza network (kune ekunze makondirakiti)
VLAN 34 -VM bvunzo network
VLAN 35 -VM yekuvandudza network
VLAN 40 - Monitoring network

Tisati tatanga basa, heino dhayagiramu padanho reL2, yatinofanira kusvika pairi:

Kusikwa kweiyo inokanganisa-inoshivirira IT zvivakwa. Chikamu 1 - kugadzirira kuendesa oVirt 4.3 sumbu

Nekubatana kwetiweki yeOVirt mauto uye chaiwo machina kune mumwe nemumwe, pamwe nekugadzirisa yedu yekuchengetedza sisitimu, zvinodikanwa kugadzirisa stack yeCisco 2960X switch.

Dell mauto akavakira-mune 4-port network makadhi, saka, zvinokurudzirwa kuronga kubatana kwavo kuCisco 2960X vachishandisa kukanganisa-kushivirira network yekubatanidza, vachishandisa boka remagetsi network network kuita inonzwisisika interface, uye LACP protocol ( 802.3ad):

  • madoko maviri ekutanga pane anotambira anogadziridzwa mu bonding mode uye akabatana neiyo 2960X switch - iyi inonzwisisika interface ichagadziriswa. zambuko iine kero yekutarisira manejimendi, kutarisa, kutaurirana nemamwe mauto muoVirt cluster, ichashandiswawo Kurarama kutama kwemachina chaiwo;
  • madoko maviri echipiri pane anotambira anogadziridzwawo mukubatanidza modhi uye akabatana ne2960X - pane ino inonzwisisika interface uchishandisa oVirt, mabhiriji anozogadzirwa mune ramangwana (mune maVLAN anoenderana) ayo chaiwo michina ichabatanidzwa.
  • ese maviri network ports, mukati meiyo yakafanana inonzwisisika interface, ichave inoshanda, i.e. traffic pamusoro pavo inogona kufambiswa panguva imwe chete, mukuenzanisa mode.
  • zvigadziriso zvenetiweki pamasumbu emapoka anofanirwa kunge ari ZVIMWE ZVIMWE, kunze kwemakero eIP.

Basic switch stack setup 2960X nezviteshi zvayo

Kuchinja kwedu kunofanira kutanga kuve:

  • rack yakaiswa;
  • yakabatanidzwa kuburikidza netambo mbiri dzakakosha dzehurefu hunodiwa, semuenzaniso, CAB-STK-E-1M;
  • yakabatanidzwa kune magetsi;
  • yakabatana kune nzvimbo yebasa yemutungamiriri kuburikidza neiyo console port kune yavo yekutanga kumisikidzwa.

Nhungamiro inodiwa yeizvi inowanikwa pa zviri pamutemo peji mugadziri.

Mushure mekupedza matanho ari pamusoro, isu tinogadzirisa switch.
Zvinorehwa nemurairo wega wega hazvina kuitirwa kuti zvitsanangurwe mukati mechimiro chechinyorwa ichi; kana zvichidikanwa, ruzivo rwese runogona kuwanikwa rwakazvimiririra.
Chinangwa chedu ndechekugadzirisa iyo switch stack nekukurumidza sezvinobvira uye kubatanidza mauto uye ekuchengetedza manejimendi ekuchengetedza kwairi.

1) Batanidza kune tenzi switch, enda kune yakasarudzika modhi, wozoenda kune yekumisikidza modhi uye gadzira zvakakosha zvigadziriso.

Basic switch config:

 enable
 configure terminal

 hostname 2960X

 no service pad
 service timestamps debug datetime msec
 service timestamps log datetime localtime show-timezone msec
 no service password-encryption
 service sequence-numbers

 switch 1 priority 15
 switch 2 priority 14
 stack-mac persistent timer 0

 clock timezone MSK 3
  vtp mode transparent
  ip subnet-zero

 vlan 17
  name Management

 vlan 32
  name PROD 

 vlan 33
  name Interconnect

 vlan 34
  name Test

 vlan 35
  name Dev

 vlan 40
  name Monitoring

 spanning-tree mode rapid-pvst
 spanning-tree etherchannel guard misconfig
 spanning-tree portfast bpduguard default
 spanning-tree extend system-id
 spanning-tree vlan 1-40 root primary
 spanning-tree loopguard default
 vlan internal allocation policy ascending
 port-channel load-balance src-dst-ip

 errdisable recovery cause loopback
 errdisable recovery cause bpduguard
 errdisable recovery interval 60

line con 0
 session-timeout 60
 exec-timeout 60 0
 logging synchronous
line vty 5 15
 session-timeout 60
 exec-timeout 60 0
 logging synchronous

 ip http server
 ip http secure-server
 no vstack

interface Vlan1
 no ip address
 shutdown

 exit

Isu tinochengetedza config nemurairo "wr mem" uye reboot the switch stack nemurairo"reloadΒ»pa master switch 1.

2) Isu tinogadzirisa network ports ye switch in access mode muVLAN 17, kubatanidza manejimendi ekutungamira ekuchengetedza masisitimu uye iDRAC maseva.

Kugadzira manejimendi ports:

interface GigabitEthernet1/0/5
 description iDRAC - host1
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet1/0/6
 description Storage1 - Cntr0/Eth0
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet2/0/5
 description iDRAC - host2
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet2/0/6
 description Storage1 – Cntr1/Eth0
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge
 exit

3) Mushure mekurodha zvakare stack, tarisa kuti inoshanda nemazvo:

Kuongorora kushanda kwe stack:

2960X#show switch stack-ring speed

Stack Ring Speed        : 20G
Stack Ring Configuration: Full
Stack Ring Protocol     : FlexStack

2960X#show switch stack-ports
  Switch #    Port 1       Port 2
  --------    ------       ------
    1           Ok           Ok
    2           Ok           Ok

2960X#show switch neighbors
  Switch #    Port 1       Port 2
  --------    ------       ------
      1         2             2
      2         1             1

2960X#show switch detail
Switch/Stack Mac Address : 0cd0.f8e4.Π₯Π₯Π₯Π₯
Mac persistency wait time: Indefinite
                                           H/W   Current
Switch#  Role   Mac Address     Priority Version  State
----------------------------------------------------------
*1       Master 0cd0.f8e4.Π₯Π₯Π₯Π₯    15     4       Ready
 2       Member 0029.c251.Π₯Π₯Π₯Π₯     14     4       Ready

         Stack Port Status             Neighbors
Switch#  Port 1     Port 2           Port 1   Port 2
--------------------------------------------------------
  1        Ok         Ok                2        2
  2        Ok         Ok                1        1

4) Kumisikidza SSH kuwana kune iyo 2960X stack

Kuti titarise kure kure neSSH, tichashandisa IP 172.20.1.10 yakagadzirirwa SVI (switch virtual interface) VLAN17.

Kunyangwe zvichikurudzirwa kushandisa yakazvitsaurira chiteshi pane switch kune manejimendi zvinangwa, iyi inyaya yezvido zvemunhu uye kugona.

Kugadzirisa SSH kuwana kune stack ye switch:

ip default-gateway 172.20.1.2

interface vlan 17
 ip address 172.20.1.10 255.255.255.0

hostname 2960X
 ip domain-name hw.home-lab.ru
 no ip domain-lookup

clock set 12:47:04 06 Dec 2019

crypto key generate rsa

ip ssh version 2
ip ssh time-out 90

line vty 0 4
 session-timeout 60
 exec-timeout 60 0
 privilege level 15
 logging synchronous
 transport input ssh

line vty 5 15
 session-timeout 60
 exec-timeout 60 0
 privilege level 15
 logging synchronous
 transport input ssh

aaa new-model
aaa authentication login default local 
username cisco privilege 15 secret my_ssh_password

Gadzirisa password kuti uise yakasarudzika mode:

enable secret *myenablepassword*
service password-encryption

Kugadzira NTP:

ntp server 85.21.78.8 prefer
ntp server 89.221.207.113
ntp server 185.22.60.71
ntp server 192.36.143.130
ntp server 185.209.85.222

show ntp status
show ntp associations
show clock detail

5) Gadzirisa inonzwisisika Etherchannel interfaces uye zviteshi zvemuviri zvakabatana nevanotambira. Kuti zvive nyore kugadzirisa, ese aripo maVLAN anogoneswa pane ese ane musoro maficha, asi zvinowanzokurudzirwa kugadzirisa chete izvo zvinodiwa:

Kugadzirisa Etherchannel interfaces:

interface Port-channel1
 description EtherChannel with Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel2
 description EtherChannel with Host2-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel3
 description EtherChannel with Host1-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel4
 description EtherChannel with Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface GigabitEthernet1/0/1
 description Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 1 mode active

interface GigabitEthernet1/0/2
 description Host2-management
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 2 mode active

interface GigabitEthernet1/0/3
 description Host1-VM
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 3 mode active

interface GigabitEthernet1/0/4
 description Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 4 mode active

interface GigabitEthernet2/0/1
 description Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 1 mode active

interface GigabitEthernet2/0/2
 description Host2-management
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 2 mode active

interface GigabitEthernet2/0/3
 description Host1-VM
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 3 mode active

interface GigabitEthernet2/0/4
 description Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 4 mode active

Kwekutanga kumisikidzwa kwetiweki interfaces yemashini chaiwo pane vanogamuchira Muenzi1 ΠΈ Muenzi2

Isu tinotarisa kuvepo kwemamodule anodiwa ekubatanidza kushanda muhurongwa, isa module yekudzora mabhiriji:

modinfo bonding
modinfo 8021q
yum install bridge-utils

Kugadzirisa iyo BOND1 inonzwisisika interface yemakina chaiwo uye maratidziro ayo emuviri pane anotambira:

cat /etc/sysconfig/network-scripts/ifcfg-bond1
#DESCRIPTION - management
DEVICE=bond1
NAME=bond1
TYPE=Bond
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'

cat /etc/sysconfig/network-scripts/ifcfg-em2
#DESCRIPTION - management
DEVICE=em2
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

cat /etc/sysconfig/network-scripts/ifcfg-em3
#DESCRIPTION - management
DEVICE=em3
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no

Mushure mekupedza zvigadziriso pane stack 2960H uye mauto, isu tinotangazve network pane mauto uye tarisa kushanda kweiyo inonzwisisika interface.

  • pamugamuchiri:

systemctl restart network

cat /proc/net/bonding/bond1
Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)

Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2+3 (2)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
...
802.3ad info
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable
System priority: 65535
...
Slave Interface: em2
MII Status: up
Speed: 1000 Mbps
Duplex: full
...
Slave Interface: em3
MII Status: up
Speed: 1000 Mbps
Duplex: full

  • pane switch stack 2960H:

2960X#show lacp internal
Flags:  S - Device is requesting Slow LACPDUs
        F - Device is requesting Fast LACPDUs
        A - Device is in Active mode       P - Device is in Passive mode

Channel group 1
                            LACP port     Admin     Oper    Port        Port
Port      Flags   State     Priority      Key       Key     Number      State
Gi1/0/1   SA      bndl      32768         0x1       0x1     0x102       0x3D
Gi2/0/1   SA      bndl      32768         0x1       0x1     0x202       0x3D

2960X#sh etherchannel summary
Flags:  D - down        P - bundled in port-channel
        I - stand-alone s - suspended
        H - Hot-standby (LACP only)
        R - Layer3      S - Layer2
        U - in use      N - not in use, no aggregation
        f - failed to allocate aggregator

        M - not in use, minimum links not met
        m - not in use, port not aggregated due to minimum links not met
        u - unsuitable for bundling
        w - waiting to be aggregated
        d - default port

        A - formed by Auto LAG

Number of channel-groups in use: 11
Number of aggregators:           11

Group  Port-channel  Protocol    Ports
------+-------------+-----------+-----------------------------------------------
1      Po1(SU)         LACP      Gi1/0/1(P)  Gi2/0/1(P)

Yekutanga gadziriso yetiweki interfaces yekutarisira zviwanikwa zvecluster pane vanogamuchira Muenzi1 ΠΈ Muenzi2

Kugadzirisa iyo BOND1 inonzwisisika interface kune manejimendi uye yayo yemuviri maratidziro pane anotambira:

cat /etc/sysconfig/network-scripts/ifcfg-bond0
#DESCRIPTION - management
DEVICE=bond0
NAME=bond0
TYPE=Bond
BONDING_MASTER=yes
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'

cat /etc/sysconfig/network-scripts/ifcfg-em0
#DESCRIPTION - management
DEVICE=em0
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

cat /etc/sysconfig/network-scripts/ifcfg-em1
#DESCRIPTION - management
DEVICE=em1
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no

Mushure mekupedza zvigadziriso pane stack 2960H uye mauto, isu tinotangazve network pane mauto uye tarisa kushanda kweiyo inonzwisisika interface.

systemctl restart network
cat /proc/net/bonding/bond1

2960X#show lacp internal
2960X#sh etherchannel summary

Isu tinogadzirisa iyo control network interface pane yega yega host mukati VLAN 17, woisungira kune inonzwisisika interface BOND1:

Kugadzirisa VLAN17 paHost1:

cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes 
USERCTL=no 
NM_CONTROLLED=no 
VLAN=yes
MTU=1500  
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.163
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=public

Kugadzirisa VLAN17 paHost2:

cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes 
USERCTL=no 
NM_CONTROLLED=no 
VLAN=yes
MTU=1500  
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.164
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=public

Isu tinotangazve network pane mauto uye tarisa kuoneka kwavo kune mumwe nemumwe.

Izvi zvinopedzisa kumisikidzwa kweiyo stack yeCisco 2960X switch, uye kana zvese zvakaitwa nemazvo, saka ikozvino tine network yekubatanidza yezvinhu zvese zvezvivakwa kune mumwe nemumwe padanho reL2.

Kumisikidza Dell MD3820f yekuchengetedza system

Usati watanga basa rekumisikidza sisitimu yekuchengetedza, inofanirwa kunge yatove yakabatana kune stack yeCisco switch 2960H control interfaces, pamwe nevanotambira Muenzi1 ΠΈ Muenzi2 kuburikidza neFC.

Dhiagiramu yakajairika yekuti masisitimu ekuchengetedza anofanirwa kubatana sei kune stack ye switch yakapihwa muchitsauko chapfuura.

Dhiagiramu yekubatanidza iyo yekuchengetedza sisitimu kuburikidza neFC kune vanogamuchira inofanira kutaridzika seizvi:

Kusikwa kweiyo inokanganisa-inoshivirira IT zvivakwa. Chikamu 1 - kugadzirira kuendesa oVirt 4.3 sumbu

Panguva yekubatanidza, iwe unofanirwa kunyora pasi kero dzeWWPN dzeFC HBA mauto akabatana neFC ports pane yekuchengetedza system - izvi zvichave zvakakosha kuti gare gare kumisikidza kusungirirwa kwemauto kuLUNs pane yekuchengetedza system.

Panzvimbo yebasa yemutungamiriri, dhawunirodha uye isa chishandiso chekutonga iyo Dell MD3820f yekuchengetedza system - PowerVault Modular Disk Storage Manager (MDSM).
Isu tinobatana kwairi kuburikidza neayo default IP kero, uye tobva tagadzirisa kero dzedu kubva VLAN17, kubata vatongi kuburikidza neTCP/IP:

Kuchengetedza1:

ControllerA IP - 172.20.1.13, MASK - 255.255.255.0, Gateway - 172.20.1.2
ControllerB IP - 172.20.1.14, MASK - 255.255.255.0, Gateway - 172.20.1.2

Mushure mekugadzirisa kero, enda kunzvimbo yekuchengetedza yekuchengetedza uye isa password, isa nguva, gadzirisa firmware yevatongi uye disks, kana zvichidiwa, nezvimwe.
Kuti izvi zvinoitwa sei zvinotsanangurwa mukati gwara rekutonga Storage system

Mushure mekupedza marongero ari pamusoro, isu tichangoda kuita mashoma matanho:

  1. Gadzirisa host FC port IDs - Host Port Identifiers.
  2. Gadzira boka rekugamuchira - Boka rekugamuchira uye wedzera mauto edu maviri eDell kwairi.
  3. Gadzira boka redhisiki uye madhisiki chaiwo (kana maLUNs) mairi ayo acharatidzwa kune vanogamuchira.
  4. Gadzirisa kuratidzwa kwemadhisiki (kana maLUNs) evagamuchiri.

Kuwedzera mauto matsva uye anosunga anotambira FC port identifiers kwavari kunoitwa kuburikidza nemenyu - Host Mappings -> Tsanangura -> Vagamuchiri…
WWPN kero dzeFC HBA mauto anogona kuwanikwa, semuenzaniso, mumaseva eDRAC.

Somugumisiro, tinofanira kuwana chimwe chinhu chakadai:

Kusikwa kweiyo inokanganisa-inoshivirira IT zvivakwa. Chikamu 1 - kugadzirira kuendesa oVirt 4.3 sumbu

Kuwedzera boka idzva revatenzi uye kusunga mauto kwairi kunoitwa kuburikidza nemenyu - Host Mappings -> Tsanangura -> Boka rinotambira…
Kune vanogamuchira, sarudza iyo OS mhando - Linux (DM-MP).

Mushure mekugadzira boka rekugamuchira, kuburikidza ne tab Kuchengeta & Copy Services, gadzira boka re disk - Disk Group, ine mhando zvichienderana nezvinodiwa zvekushivirira kukanganisa, semuenzaniso, RAID10, uye mairi chaiwo madhisiki ehukuru hunodiwa:

Kusikwa kweiyo inokanganisa-inoshivirira IT zvivakwa. Chikamu 1 - kugadzirira kuendesa oVirt 4.3 sumbu

Uye pakupedzisira, nhanho yekupedzisira ndeyekuratidzwa kwemadhisiki (kana maLUNs) kune vanogamuchira.
Kuti uite izvi, kuburikidza nemenyu - Host Mappings -> Moon mapping -> Wedzera… Isu tinosanganisa madhisiki echokwadi neanotambira nekupa nhamba kwavari.

Zvese zvinofanirwa kutaridzika senge iyi skrini:

Kusikwa kweiyo inokanganisa-inoshivirira IT zvivakwa. Chikamu 1 - kugadzirira kuendesa oVirt 4.3 sumbu

Apa ndipo patinopedzisa kumisikidza sisitimu yekuchengetera, uye kana zvese zvakaitwa nemazvo, saka vanogamuchira vanofanirwa kuona maLUN achiunzwa kwavari kuburikidza neFC HBA yavo.
Ngatimanikidze sisitimu kuti igadzirise ruzivo nezve akabatana disks:

ls -la /sys/class/scsi_host/
echo "- - -" > /sys/class/scsi_host/host[0-9]/scan

Ngationei kuti ndezvipi zvishandiso zvinoonekwa pamaseva edu:

cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 02 Id: 00 Lun: 00
  Vendor: DELL     Model: PERC H330 Mini   Rev: 4.29
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 00
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 01
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 04
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 11
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 31
  Vendor: DELL     Model: Universal Xport  Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 00
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 01
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 04
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 11
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 31
  Vendor: DELL     Model: Universal Xport  Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05

lsscsi
[0:2:0:0]    disk    DELL     PERC H330 Mini   4.29  /dev/sda
[15:0:0:0]   disk    DELL     MD38xxf          0825  -
[15:0:0:1]   disk    DELL     MD38xxf          0825  /dev/sdb
[15:0:0:4]   disk    DELL     MD38xxf          0825  /dev/sdc
[15:0:0:11]  disk    DELL     MD38xxf          0825  /dev/sdd
[15:0:0:31]  disk    DELL     Universal Xport  0825  -
 [18:0:0:0]   disk    DELL     MD38xxf          0825  -
[18:0:0:1]   disk    DELL     MD38xxf          0825  /dev/sdi
[18:0:0:4]   disk    DELL     MD38xxf          0825  /dev/sdj
[18:0:0:11]  disk    DELL     MD38xxf          0825  /dev/sdk
[18:0:0:31]  disk    DELL     Universal Xport  0825  -

Pamahosts iwe unogona zvakare kugadzirisa kuwanda, uye kunyangwe kana uchiisa oVirt inogona kuita izvi pachayo, zviri nani kuti utarise mashandiro eMP pamberi iwe pachako.

Kuiswa uye kumisikidzwa kweDM Multipath

yum install device-mapper-multipath
mpathconf --enable --user_friendly_names y

cat /etc/multipath.conf | egrep -v "^s*(#|$)"
defaults {
    user_friendly_names yes
            find_multipaths yes
}

blacklist {
  wwid 26353900f02796769
  devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"     
  devnode "^hd[a-z]"
 }

Seta iyo MP sevhisi kuti iite otomatiki uye itange iyo:

systemctl enable multipathd && systemctl restart multipathd

Kutarisa ruzivo nezve akaremerwa mamodule ekushanda kweMP:

lsmod | grep dm_multipath
dm_multipath           27792  6 dm_service_time
dm_mod                124407  139 dm_multipath,dm_log,dm_mirror

modinfo dm_multipath
filename:       /lib/modules/3.10.0-957.12.2.el7.x86_64/kernel/drivers/md/dm-multipath.ko.xz
license:        GPL
author:         Sistina Software <[email protected]>
description:    device-mapper multipath target
retpoline:      Y
rhelversion:    7.6
srcversion:     985A03DCAF053D4910E53EE
depends:        dm-mod
intree:         Y
vermagic:       3.10.0-957.12.2.el7.x86_64 SMP mod_unload modversions
signer:         CentOS Linux kernel signing key
sig_key:        A3:2D:39:46:F2:D3:58:EA:52:30:1F:63:37:8A:37:A5:54:03:00:45
sig_hashalgo:   sha256

Ngatitarisei ruzivo rwepfupiso pamusoro peiyo iripo multipath kumisikidza:

mpathconf
multipath is enabled
find_multipaths is disabled
user_friendly_names is disabled
dm_multipath module is loaded
multipathd is running

Mushure mekuwedzera LUN nyowani kune yekuchengetera sisitimu uye nekuiratidza kune iyo saiti, iwe unofanirwa kuongorora iyo HBAs yakabatana kune iyo host pairi. 

systemctl reload multipathd
multipath -v2

Uye chekupedzisira, isu tinotarisa kana ese maLUN akaunzwa pane yekuchengetedza sisitimu yevanotambira, uye kana paine nzira mbiri kune dzese.

Kuongorora kushanda kweMP:

multipath -ll
3600a098000e4b4b3000003175cec1840 dm-2 DELL    ,MD38xxf
size=2.0T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:1  sdb 8:16  active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 18:0:0:1  sdi 8:128 active ready running
3600a098000e4b48f000002ab5cec1921 dm-6 DELL    ,MD38xxf
size=10T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 18:0:0:11 sdk 8:160 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 15:0:0:11 sdd 8:48  active ready running
3600a098000e4b4b3000003c95d171065 dm-3 DELL    ,MD38xxf
size=150G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:4  sdc 8:32  active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 18:0:0:4  sdj 8:144 active ready running

Sezvauri kuona, ese matatu madhisiki edhisiki pane yekuchengetedza system anoonekwa munzira mbiri. Nokudaro, basa rose rekugadzirira rakapedzwa, izvo zvinoreva kuti iwe unogona kuenderera kune chikamu chikuru - kugadzira boka reOVirt, iro richakurukurwa munyaya inotevera.

Source: www.habr.com

Voeg