Kupanga maziko a IT osalolera zolakwika. Gawo 1 - kukonzekera kutumiza gulu la oVirt 4.3

Owerenga akuitanidwa kuti adziŵe bwino ndi mfundo zomanga zowonongeka zowonongeka kwa bizinesi yaying'ono mkati mwa malo amodzi a deta, zomwe zidzakambidwe mwatsatanetsatane mndandanda waufupi wa nkhani.

Kuyamba

Ndi Data center (Data Processing Center) ikhoza kumveka ngati:

• choyikira chanu mu "chipinda chanu cha seva" pamalo abizinesi, chomwe chimakwaniritsa zofunikira zochepa zoperekera magetsi ndi kuziziritsa kwa zida, komanso mutha kugwiritsa ntchito intaneti kudzera mwa othandizira awiri odziyimira pawokha;
• rack yobwereka yokhala ndi zida zake, yomwe ili pamalo enieni a data - otchedwa. collocation, yomwe imagwirizana ndi Gawo la III kapena IV, komanso lomwe limatsimikizira magetsi odalirika, kuziziritsa komanso kugwiritsa ntchito intaneti kosalekeza;
• zida zobwereketsa kwathunthu mu Tier III kapena IV data center.

Malo ogona omwe mungasankhire ndi munthu payekhapayekha, ndipo nthawi zambiri zimatengera zinthu zingapo zazikulu:

• Chifukwa chiyani bizinesi ikufuna maziko ake a IT?
• Kodi bizinesiyo ikufuna chiyani kwenikweni kuchokera kuzinthu za IT (kudalirika, scalability, management, etc.);
• kuchuluka kwa ndalama zoyambira muzinthu za IT, komanso mtundu wanji wamtengo wake - capital (zomwe zikutanthauza kuti mumagula zida zanu), kapena zogwirira ntchito (zida nthawi zambiri zimabwereka);
• kukonzekera m'mphepete mwa bizinesi yokha.

Zambiri zitha kulembedwa pazifukwa zomwe zimalimbikitsa lingaliro la bizinesi kuti lipange ndikugwiritsa ntchito zida zake za IT, koma cholinga chathu ndikuwonetsa momwe tingapangire zida izi kuti zikhale zololera zolakwika ndikusunga ndalama. - kuchepetsa mtengo kugula mapulogalamu amalonda, kapena kuwapewa konse.

Monga momwe machitidwe a nthawi yayitali amasonyezera, sikoyenera kupulumutsa pa hardware, popeza stingy amalipira kawiri, ndipo ngakhale zambiri. Koma kachiwiri, hardware yabwino ndi malingaliro chabe, ndipo pamapeto pake zomwe mungagule ndi ndalama zingati zimatengera luso la bizinesi ndi "dyera" la kayendetsedwe kake. Komanso, mawu akuti "umbombo" ayenera kumveka m'lingaliro labwino la liwu, popeza ndi bwino kuyika ndalama mu hardware pa siteji koyamba, kuti musakhale ndi mavuto aakulu ndi thandizo lake ndi makulitsidwe, popeza poyamba zolakwa kukonzekera ndi. kusungirako ndalama zambiri kungapangitse kuti pakhale ndalama zambiri kuposa pamene mukuyamba ntchitoyo.

Kotero, deta yoyambirira ya polojekitiyi:

• pali bizinesi yomwe yasankha kupanga tsamba lake lawebusayiti ndikubweretsa zochitika zake pa intaneti;
• kampaniyo inaganiza zobwereka choyikapo kuti iziyika zida zake pamalo abwino ovomerezeka ovomerezeka malinga ndi muyezo wa Tier III;
• kampaniyo idaganiza kuti isasunge zambiri pa Hardware, motero idagula zida zotsatirazi ndi chitsimikizo chowonjezereka ndi chithandizo:

Zida mndandanda

• ma seva awiri akuthupi a Dell PowerEdge R640 motere:
• mapurosesa awiri a Intel Xeon Gold 5120
• 512 GB RAM
• ma disks awiri a SAS mu RAID1, kuti akhazikitse OS
• 4-port 1G network khadi
• makhadi awiri a 2-port 10G network
• imodzi 2-doko FC HBA 16G.
• 2-controller storage system Dell MD3820f, yolumikizidwa kudzera pa FC 16G mwachindunji kwa makamu a Dell;
• masiwichi awiri agawo lachiwiri - Cisco WS-C2960RX-48FPS-L zodzaza;
• masiwichi awiri amtundu wachitatu - Cisco WS-C3850-24T-E, odzaza;
• Rack, UPS, PDU, maseva a console amaperekedwa ndi data center.

Monga tikuwonera, zida zomwe zilipo zili ndi chiyembekezo chabwino chakukula kopingasa komanso kowongoka, ngati bizinesiyo imatha kupikisana ndi makampani ena omwe ali ndi mbiri yofananira pa intaneti, ndikuyamba kupeza phindu, lomwe lingathe kuyikidwamo pakukulitsa chuma chambiri mpikisano. ndi kukula kwa phindu.

Ndi zida ziti zomwe tingawonjezere ngati bizinesi ikufuna kuwonjezera magwiridwe antchito a gulu lathu lamakompyuta:

• tili ndi malo ambiri osungiramo ma doko pa masinthidwe a 2960X, zomwe zikutanthauza kuti titha kuwonjezera ma seva ambiri;
• gulani ma switch awiri owonjezera a FC kuti mulumikizane ndi machitidwe osungira ndi ma seva owonjezera kwa iwo;
• ma seva omwe alipo akhoza kukwezedwa - onjezani kukumbukira, m'malo mwa mapurosesa ndi amphamvu kwambiri, gwirizanitsani ndi intaneti ya 10G pogwiritsa ntchito ma adapter omwe alipo;
• Mutha kuwonjezera mashelufu owonjezera a disk kumalo osungira ndi mtundu wofunikira wa disk - SAS, SATA kapena SSD, kutengera katundu wokonzedwa;
• mutatha kuwonjezera ma switch a FC, mutha kugula njira ina yosungiramo kuti muwonjezere mphamvu zambiri za disk, ndipo ngati mutagula njira yapadera ya Remote Replication kwa izo, mukhoza kukhazikitsa kubwereza kwa deta pakati pa machitidwe osungiramo mkati mwa malo omwewo a data komanso pakati pa malo a deta ( koma izi zadutsa kale mkati mwa nkhaniyo);
• Palinso masiwichi amtundu wachitatu - Cisco 3850, yomwe ingagwiritsidwe ntchito ngati phata lololera zolakwika pamayendedwe othamanga kwambiri pakati pa maukonde amkati. Izi zidzathandiza kwambiri m'tsogolomu pamene zomangamanga zamkati zikukula. 3850 ilinso ndi ma doko a 10G, omwe angagwiritsidwe ntchito pambuyo pake pokweza zida zanu zapaintaneti ku liwiro la 10G.

Popeza tsopano palibe paliponse popanda virtualization, ndithudi tidzakhala muzochitika, makamaka popeza iyi ndi njira yabwino kwambiri yochepetsera mtengo wogula ma seva okwera mtengo pazinthu zamagulu amtundu uliwonse (ma seva a pa intaneti, ma database, ndi zina zotero), zomwe sizikhala nthawi zonse. zabwino kwambiri zimagwiritsidwa ntchito ngati katundu wochepa, ndipo izi ndi zomwe zidzachitike kumayambiriro kwa polojekitiyi.

Kuphatikiza apo, virtualization ili ndi zabwino zina zambiri zomwe zingakhale zothandiza kwambiri kwa ife: Kulekerera kwa VM motsutsana ndi kulephera kwa seva ya hardware, Kusuntha kwamoyo pakati pa ma hardware cluster node pakukonza kwawo, kugawa kwamanja kapena kugawa pakati pamagulu amagulu, ndi zina zotero.

Kwa zida zogulidwa ndi bizinesi, kutumizidwa kwa gulu la VMware vSphere lomwe likupezeka kwambiri limadziwonetsa, koma popeza pulogalamu iliyonse yochokera ku VMware imadziwika ndi ma tag ake amtengo wa "kavalo", tidzagwiritsa ntchito pulogalamu yaulere yowongolera - oVirt, pamaziko omwe chinthu chodziwika bwino koma chogulitsa kale chimapangidwa - rhev.

Software oVirt Zofunikira kuphatikiza zinthu zonse zamapangidwe kukhala chinthu chimodzi kuti athe kugwira ntchito mosavuta ndi makina omwe amapezeka kwambiri - awa ndi nkhokwe, kugwiritsa ntchito intaneti, ma seva oyimira, owerengera, ma seva osonkhanitsira mitengo ndi ma analytics, ndi zina zambiri, ndiko kuti, zomwe tsamba lawebusayiti la bizinesi yathu lili ndi.

Kuti tifotokoze mwachidule mawu oyambirawa, titha kuyembekezera zolemba zotsatirazi, zomwe zikuwonetsa momwe tingagwiritsire ntchito zida zonse zamapulogalamu ndi mapulogalamu abizinesi:

Mndandanda wa zolemba

• Gawo 1 Kukonzekera kutumiza gulu la oVirt 4.3.
• Gawo 2 Kukhazikitsa ndi kukonza gulu la oVirt 4.3.
• Gawo 3 Kukhazikitsa gulu la VyOS, kukonza njira zakunja zololera zolakwika.
• Gawo 4 Kukhazikitsa stack ya Cisco 3850, kukonza ma intranet routing.

Gawo 1. Kukonzekera kutumiza gulu la oVirt 4.3

Kukonzekera koyambira koyambira

Kukhazikitsa ndi kukonza OS ndiye gawo losavuta kwambiri. Pali zolemba zambiri zamomwe mungayikitsire bwino ndikusintha OS, ndiye palibe chifukwa choyesera kupereka china chake chokhudza izi.

Chifukwa chake, tili ndi makamu awiri a Dell PowerEdge R640 omwe tiyenera kukhazikitsa Os ndikuchita zoikamo zoyambira kuti tigwiritse ntchito ngati ma hypervisors oyendetsa makina pafupifupi mu gulu la oVirt 4.3.

Popeza tikukonzekera kugwiritsa ntchito pulogalamu yaulere ya oVirt yopanda malonda, OS idasankhidwa kuti itumize makamu. CentOS 7.7, ngakhale ma OS ena akhoza kukhazikitsidwa pa makamu a oVirt:

• zomangamanga zapadera zochokera ku RHEL, zomwe zimatchedwa. oVirt Node;
• OS Oracle Linux, chilimwe 2019 zidalengezedwa zakuthandizira ntchito ya oVirt pa izo.

Musanayike OS ndikulimbikitsidwa:

• sinthani mawonekedwe a netiweki a iDRAC pa makamu onse awiri;
• sinthani BIOS ndi iDRAC firmware kumitundu yaposachedwa;
• sinthani System Profile ya seva, makamaka mumayendedwe a Performance;
• sinthani RAID kuchokera ku ma disks am'deralo (RAID1 ikulimbikitsidwa) kuti muyike OS pa seva.

Kenako timayika OS pa diski yomwe idapangidwa kale kudzera pa iDRAC - kukhazikitsa ndikwabwinobwino, palibe mphindi zapadera mmenemo. Kufikira ku seva ya seva kuti muyambe kuyika OS kutha kupezekanso kudzera pa iDRAC, ngakhale palibe chomwe chimakulepheretsani kulumikiza chowunikira, kiyibodi ndi mbewa molunjika ku seva ndikuyika OS kuchokera pa drive drive.

Pambuyo kukhazikitsa OS, timapanga zoikamo zake zoyambirira:

systemctl enable network.service
systemctl start network.service
systemctl status network.service

systemctl stop NetworkManager
systemctl disable NetworkManager
systemctl status NetworkManager

yum install -y ntp
systemctl enable ntpd.service
systemctl start ntpd.service

cat /etc/sysconfig/selinux
SELINUX=disabled
SELINUXTYPE=targeted

cat /etc/security/limits.conf
 *               soft    nofile         65536
 *               hard   nofile         65536

cat /etc/sysctl.conf
vm.max_map_count = 262144
vm.swappiness = 1

Kuyika pulogalamu yoyambira

Kuti muyambe kukhazikitsa OS, muyenera kukonza mawonekedwe aliwonse amtundu pa seva kuti mutha kugwiritsa ntchito intaneti kuti musinthe OS ndikuyika mapulogalamu ofunikira. Izi zitha kuchitika pa nthawi ya kukhazikitsa Os ndi pambuyo pake.

yum -y install epel-release
yum update
yum -y install bind-utils yum-utils net-tools git htop iotop nmon pciutils sysfsutils sysstat mc nc rsync wget traceroute gzip unzip telnet 

Zonse zomwe zili pamwambazi ndi mapulogalamu a mapulogalamu ndi nkhani yaumwini, ndipo setiyi ndi malingaliro chabe.

Popeza wotilandirayo atenga gawo la hypervisor, tithandizira mawonekedwe ofunikira:

systemctl enable tuned 
systemctl start tuned 
systemctl status tuned 

tuned-adm profile 
tuned-adm profile virtual-host 

Mutha kuwerenga zambiri za mawonekedwe apa: "Mutu 4. kusinthidwa ndi kusinthidwa-adm".

Pambuyo kukhazikitsa OS, timapita ku gawo lotsatira - kukhazikitsa maukonde pa makamu ndi mulu wa Cisco 2960X masiwichi.

Kukonza Cisco 2960X Switch Stack

Ntchito yathu idzagwiritsa ntchito manambala otsatirawa a VLAN - kapena madera owulutsa, otalikirana, kuti alekanitse mitundu yosiyanasiyana yamagalimoto:

Chithunzi cha 10 - Intaneti
Chithunzi cha 17 - Management (iDRAC, makina osungira, kasamalidwe ka ma switch)
Chithunzi cha 32 - Network yopanga VM
Chithunzi cha 33 - maukonde olumikizana (kwa makontrakitala akunja)
Chithunzi cha 34 - VM test network
Chithunzi cha 35 - VM developer network
Chithunzi cha 40 - Monitoring network

Tisanayambe ntchito, nachi chithunzi pamlingo wa L2 chomwe tiyenera kufikapo:

Pakuyanjana kwa maukonde a oVirt makamu ndi makina enieni wina ndi mnzake, komanso kuyang'anira makina athu osungira, ndikofunikira kukonza masiwichi a Cisco 2960X.

Magulu a Dell apanga makhadi a netiweki a 4-port, chifukwa chake, ndikofunikira kukonza kulumikizana kwawo ndi Cisco 2960X pogwiritsa ntchito kulumikizana kosalekeza kwa netiweki, pogwiritsa ntchito gulu la madoko amtaneti kukhala mawonekedwe omveka, ndi protocol ya LACP ( 802.3ad):

• madoko awiri oyambilira omwe ali pagulu amakonzedwa munjira yolumikizirana ndikulumikizidwa ndi switch ya 2960X - mawonekedwe omveka awa adzakonzedwa. mlatho ndi adilesi yoyang'anira olandila, kuyang'anira, kulumikizana ndi makamu ena mugulu la oVirt, idzagwiritsidwanso ntchito pakusamuka kwa Live kwa makina enieni;
• madoko awiri achiwiri pa khamu nawonso kukhazikitsidwa mumalowedwe omangika ndi olumikizidwa kwa 2960X - pa mawonekedwe zomveka ntchito oVirt, milatho adzalengedwa m'tsogolo (mu VLANs lolingana) kumene makina pafupifupi adzakhala chikugwirizana.
• madoko onse a netiweki, mkati mwa mawonekedwe omwewo omveka, adzakhala achangu, i.e. magalimoto pamwamba pawo akhoza kupatsirana nthawi imodzi, munjira yokhazikika.
• zokonda pa netiweki pamagulumagulu ziyenera kukhala ZOMWEZO, kupatula ma adilesi a IP.

Kukonzekera koyambira koyambira 2960X ndi madoko ake

Zosintha zathu ziyenera kukhala:

• rack wokwera;
• olumikizidwa kudzera pazingwe ziwiri zapadera zautali wofunikira, mwachitsanzo, CAB-STK-E-1M;
• olumikizidwa ndi magetsi;
• olumikizidwa ku malo ogwirira ntchito a woyang'anira kudzera pa doko la console pakukonza kwawo koyamba.

Malangizo ofunikira pa izi akupezeka pa tsamba lovomerezeka wopanga.

Mukamaliza masitepe omwe ali pamwambapa, timakonza zosintha.
Tanthauzo la lamulo lililonse silinapangidwe kuti limvetsetsedwe mkati mwa nkhaniyi; ngati kuli kofunikira, chidziwitso chonse chikhoza kupezeka paokha.
Cholinga chathu ndikukonza masinthidwe osinthira mwachangu momwe tingathere ndikulumikiza makamu ndi njira zosungirako zosungirako.

1) Lumikizani ku master switch, pitani kumayendedwe amwayi, kenako pitani kumayendedwe osinthira ndikupanga zoyambira.

Kusintha koyambira:

 enable
 configure terminal

 hostname 2960X

 no service pad
 service timestamps debug datetime msec
 service timestamps log datetime localtime show-timezone msec
 no service password-encryption
 service sequence-numbers

 switch 1 priority 15
 switch 2 priority 14
 stack-mac persistent timer 0

 clock timezone MSK 3
  vtp mode transparent
  ip subnet-zero

 vlan 17
  name Management

 vlan 32
  name PROD 

 vlan 33
  name Interconnect

 vlan 34
  name Test

 vlan 35
  name Dev

 vlan 40
  name Monitoring

 spanning-tree mode rapid-pvst
 spanning-tree etherchannel guard misconfig
 spanning-tree portfast bpduguard default
 spanning-tree extend system-id
 spanning-tree vlan 1-40 root primary
 spanning-tree loopguard default
 vlan internal allocation policy ascending
 port-channel load-balance src-dst-ip

 errdisable recovery cause loopback
 errdisable recovery cause bpduguard
 errdisable recovery interval 60

line con 0
 session-timeout 60
 exec-timeout 60 0
 logging synchronous
line vty 5 15
 session-timeout 60
 exec-timeout 60 0
 logging synchronous

 ip http server
 ip http secure-server
 no vstack

interface Vlan1
 no ip address
 shutdown

 exit 

Timasunga config ndi lamulo "wr me" ndikuyambitsanso chosinthira chosinthira ndi lamulo "patsaninso»pa master switch 1.

2) Timakonza ma doko a netiweki akusintha munjira yolowera mu VLAN 17, kuti tilumikizane ndi njira zoyang'anira zosungirako ndi ma seva a iDRAC.

Kupanga madoko owongolera:

interface GigabitEthernet1/0/5
 description iDRAC - host1
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet1/0/6
 description Storage1 - Cntr0/Eth0
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet2/0/5
 description iDRAC - host2
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet2/0/6
 description Storage1 – Cntr1/Eth0
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge
 exit

3) Mukatsitsanso stack, onetsetsani kuti ikugwira ntchito bwino:

Kuwona magwiridwe antchito a stack:

2960X#show switch stack-ring speed

Stack Ring Speed        : 20G
Stack Ring Configuration: Full
Stack Ring Protocol     : FlexStack

2960X#show switch stack-ports
  Switch #    Port 1       Port 2
  --------    ------       ------
    1           Ok           Ok
    2           Ok           Ok

2960X#show switch neighbors
  Switch #    Port 1       Port 2
  --------    ------       ------
      1         2             2
      2         1             1

2960X#show switch detail
Switch/Stack Mac Address : 0cd0.f8e4.ХХХХ
Mac persistency wait time: Indefinite
                                           H/W   Current
Switch#  Role   Mac Address     Priority Version  State
----------------------------------------------------------
*1       Master 0cd0.f8e4.ХХХХ    15     4       Ready
 2       Member 0029.c251.ХХХХ     14     4       Ready

         Stack Port Status             Neighbors
Switch#  Port 1     Port 2           Port 1   Port 2
--------------------------------------------------------
  1        Ok         Ok                2        2
  2        Ok         Ok                1        1

4) Kukhazikitsa mwayi wa SSH ku stack 2960X

Kuti tisamalire stack kudzera pa SSH, tidzagwiritsa ntchito IP 172.20.1.10 yokonzedwera SVI (kusintha mawonekedwe enieni) Chithunzi cha VLAN17.

Ngakhale kuli koyenera kugwiritsa ntchito doko lodzipatulira pa switch pazifukwa zowongolera, iyi ndi nkhani ya zomwe amakonda komanso kuthekera kwake.

Kukonza mwayi wa SSH pagulu la masiwichi:

ip default-gateway 172.20.1.2

interface vlan 17
 ip address 172.20.1.10 255.255.255.0

hostname 2960X
 ip domain-name hw.home-lab.ru
 no ip domain-lookup

clock set 12:47:04 06 Dec 2019

crypto key generate rsa

ip ssh version 2
ip ssh time-out 90

line vty 0 4
 session-timeout 60
 exec-timeout 60 0
 privilege level 15
 logging synchronous
 transport input ssh

line vty 5 15
 session-timeout 60
 exec-timeout 60 0
 privilege level 15
 logging synchronous
 transport input ssh

aaa new-model
aaa authentication login default local 
username cisco privilege 15 secret my_ssh_password

Konzani mawu achinsinsi kuti mulowe mwamwayi:

enable secret *myenablepassword*
service password-encryption

Kupanga NTP:

ntp server 85.21.78.8 prefer
ntp server 89.221.207.113
ntp server 185.22.60.71
ntp server 192.36.143.130
ntp server 185.209.85.222

show ntp status
show ntp associations
show clock detail

5) Konzani zolumikizira zomveka za Etherchannel ndi madoko akuthupi olumikizidwa ndi makamu. Kuti musamavutike, ma VLAN onse omwe akupezeka adzayatsidwa pazolumikizana zonse zomveka, koma nthawi zambiri zimalimbikitsidwa kuti zisinthe zomwe zikufunika:

Kukonza zolumikizirana ndi Etherchannel:

interface Port-channel1
 description EtherChannel with Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel2
 description EtherChannel with Host2-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel3
 description EtherChannel with Host1-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel4
 description EtherChannel with Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface GigabitEthernet1/0/1
 description Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 1 mode active

interface GigabitEthernet1/0/2
 description Host2-management
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 2 mode active

interface GigabitEthernet1/0/3
 description Host1-VM
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 3 mode active

interface GigabitEthernet1/0/4
 description Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 4 mode active

interface GigabitEthernet2/0/1
 description Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 1 mode active

interface GigabitEthernet2/0/2
 description Host2-management
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 2 mode active

interface GigabitEthernet2/0/3
 description Host1-VM
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 3 mode active

interface GigabitEthernet2/0/4
 description Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 4 mode active

Kukonzekera koyambirira kwa ma netiweki olumikizirana pamakina enieni pa makamu alendo1 и alendo2

Timayang'ana kukhalapo kwa ma module ofunikira kuti agwirizane kuti agwire ntchito mudongosolo, kukhazikitsa gawo lowongolera milatho:

modinfo bonding
modinfo 8021q
yum install bridge-utils

Kukonza mawonekedwe omveka a BOND1 pamakina enieni ndi mawonekedwe ake akuthupi pa makamu:

cat /etc/sysconfig/network-scripts/ifcfg-bond1
#DESCRIPTION - management
DEVICE=bond1
NAME=bond1
TYPE=Bond
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'

cat /etc/sysconfig/network-scripts/ifcfg-em2
#DESCRIPTION - management
DEVICE=em2
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

cat /etc/sysconfig/network-scripts/ifcfg-em3
#DESCRIPTION - management
DEVICE=em3
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

Mukamaliza zoikamo pa okwana 2960 Х ndi makamu, timayambitsanso maukonde pa makamu ndikuyang'ana magwiridwe antchito a mawonekedwe omveka.

• pa wolandila:

systemctl restart network

cat /proc/net/bonding/bond1
Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)

Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2+3 (2)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
...
802.3ad info
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable
System priority: 65535
...
Slave Interface: em2
MII Status: up
Speed: 1000 Mbps
Duplex: full
...
Slave Interface: em3
MII Status: up
Speed: 1000 Mbps
Duplex: full

• pamtengo wosinthira 2960 Х:

2960X#show lacp internal
Flags:  S - Device is requesting Slow LACPDUs
        F - Device is requesting Fast LACPDUs
        A - Device is in Active mode       P - Device is in Passive mode

Channel group 1
                            LACP port     Admin     Oper    Port        Port
Port      Flags   State     Priority      Key       Key     Number      State
Gi1/0/1   SA      bndl      32768         0x1       0x1     0x102       0x3D
Gi2/0/1   SA      bndl      32768         0x1       0x1     0x202       0x3D

2960X#sh etherchannel summary
Flags:  D - down        P - bundled in port-channel
        I - stand-alone s - suspended
        H - Hot-standby (LACP only)
        R - Layer3      S - Layer2
        U - in use      N - not in use, no aggregation
        f - failed to allocate aggregator

        M - not in use, minimum links not met
        m - not in use, port not aggregated due to minimum links not met
        u - unsuitable for bundling
        w - waiting to be aggregated
        d - default port

        A - formed by Auto LAG

Number of channel-groups in use: 11
Number of aggregators:           11

Group  Port-channel  Protocol    Ports
------+-------------+-----------+-----------------------------------------------
1      Po1(SU)         LACP      Gi1/0/1(P)  Gi2/0/1(P)

Kukonzekera koyambirira kwa ma netiweki olumikizirana kuti muzitha kuyang'anira zinthu zamagulu pa makamu alendo1 и alendo2

Kukonza mawonekedwe omveka a BOND1 a kasamalidwe ndi mawonekedwe ake pa olandila:

cat /etc/sysconfig/network-scripts/ifcfg-bond0
#DESCRIPTION - management
DEVICE=bond0
NAME=bond0
TYPE=Bond
BONDING_MASTER=yes
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'

cat /etc/sysconfig/network-scripts/ifcfg-em0
#DESCRIPTION - management
DEVICE=em0
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

cat /etc/sysconfig/network-scripts/ifcfg-em1
#DESCRIPTION - management
DEVICE=em1
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

Mukamaliza zoikamo pa okwana 2960 Х ndi makamu, timayambitsanso maukonde pa makamu ndikuyang'ana magwiridwe antchito a mawonekedwe omveka.

systemctl restart network
cat /proc/net/bonding/bond1

2960X#show lacp internal
2960X#sh etherchannel summary

Timakonza mawonekedwe a network network pa host host aliyense Chithunzi cha 17, ndikumanga ku mawonekedwe omveka bwino a BOND1:

Kukonza VLAN17 pa Host1:

cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes 
USERCTL=no 
NM_CONTROLLED=no 
VLAN=yes
MTU=1500  
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.163
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=public

Kukonza VLAN17 pa Host2:

cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes 
USERCTL=no 
NM_CONTROLLED=no 
VLAN=yes
MTU=1500  
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.164
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=public

Timayambanso maukonde pa makamu ndikuyang'ana maonekedwe awo kwa wina ndi mzake.

Izi zimamaliza kasinthidwe ka masinthidwe a Cisco 2960X, ndipo ngati zonse zidachitika molondola, ndiye kuti tsopano tili ndi kulumikizana kwa maukonde azinthu zonse zachitukuko wina ndi mnzake pamlingo wa L2.

Kukhazikitsa Dell MD3820f yosungirako

Musanayambe ntchito yokonza zosungirako, ziyenera kulumikizidwa kale ndi ma switch a Cisco 2960 Х control interfaces, komanso makamu alendo1 и alendo2 kudzera pa FC.

Chithunzi chodziwika bwino cha momwe makina osungira ayenera kulumikizidwa ndi ma switch ambiri adaperekedwa m'mutu wapitawu.

Chithunzi cholumikizira makina osungira kudzera ku FC kwa omwe akukhala nawo ayenera kuwoneka motere:

Panthawi yolumikizana, muyenera kulemba ma adilesi a WWPN a makamu a FC HBA olumikizidwa ndi madoko a FC pamakina osungira - izi zidzakhala zofunikira kuti mtsogolo mukhazikitse kumangirira kwa makamu ku LUNs pamakina osungira.

Pamalo ogwirira ntchito a woyang'anira, tsitsani ndikuyika zofunikira pakuwongolera makina osungira a Dell MD3820f - PowerVault Modular Disk Storage Manager (Zithunzi za MDSM).
Timalumikizana nawo kudzera mu ma adilesi ake a IP, kenako timakonza ma adilesi athu kuchokera Chithunzi cha VLAN17, kuyang'anira olamulira kudzera pa TCP/IP:

Kusunga1:

ControllerA IP - 172.20.1.13, MASK - 255.255.255.0, Gateway - 172.20.1.2
ControllerB IP - 172.20.1.14, MASK - 255.255.255.0, Gateway - 172.20.1.2

Pambuyo kukhazikitsa maadiresi, pitani ku mawonekedwe osungirako zosungirako ndikuyika mawu achinsinsi, ikani nthawi, sinthani firmware kwa olamulira ndi ma disks, ngati kuli kofunikira, ndi zina zotero.
Momwe izi zimachitikira zikufotokozedwa mu kalozera woyang'anira Njira yosungirako

Mukamaliza zoikamo pamwambapa, tidzangofunika kuchita zinthu zingapo:

1. Konzani ma ID a doko a FC - Host Port Identifiers.
2. Pangani gulu lothandizira - Gulu la alendo ndikuwonjezera makamu athu awiri a Dell kwa izo.
3. Pangani gulu la disk ndi ma disks (kapena LUNs) mmenemo omwe adzasonyezedwe kwa makamu.
4. Konzani kuwonetsera kwa ma disks (kapena LUNs) a makamu.

Kuwonjeza olandila atsopano ndikumangirira zizindikiritso za doko la FC kwa iwo kumachitika kudzera pa menyu - Host Mappings -> Fotokozani -> Olandira…
Maadiresi a WWPN a makamu a FC HBA atha kupezeka, mwachitsanzo, mu maseva a iDRAC.

Chifukwa chake, tiyenera kupeza zinthu monga izi:

Kuwonjezera gulu latsopano la makamu ndi kumanga makamu kwa izo kumachitika kudzera menyu - Host Mappings -> Fotokozani -> Gulu la Host…
Kwa makamu, sankhani mtundu wa OS - Linux (DM-MP).

Pambuyo popanga gulu la alendo, kudzera pa tabu Ntchito Zosungira & Makope, pangani gulu la disk - Gulu la Disk, yokhala ndi mtundu kutengera zofunikira pakulekerera zolakwika, mwachitsanzo, RAID10, ndi momwemo ma disks enieni a kukula kofunikira:

Ndipo pomaliza, gawo lomaliza ndikuwonetsa ma disks (kapena LUNs) kwa omwe ali nawo.
Kuti muchite izi, dinani pa menyu - Host Mappings -> Mapu a mwezi -> Onjezerani ... Timagwirizanitsa ma disks enieni ndi makamu powapatsa manambala.

Chilichonse chiyenera kuwoneka ngati chithunzi ichi:

Apa ndipamene timamaliza kukhazikitsa njira yosungiramo zinthu, ndipo ngati zonse zidachitika molondola, ndiye kuti omvera ayenera kuwona ma LUN omwe amaperekedwa kwa iwo kudzera mu FC HBA yawo.
Tiyeni tiumirize dongosolo kuti lisinthire zambiri zama disks olumikizidwa:

ls -la /sys/class/scsi_host/
echo "- - -" > /sys/class/scsi_host/host[0-9]/scan

Tiyeni tiwone zida zomwe zimawoneka pa maseva athu:

cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 02 Id: 00 Lun: 00
  Vendor: DELL     Model: PERC H330 Mini   Rev: 4.29
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 00
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 01
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 04
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 11
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 31
  Vendor: DELL     Model: Universal Xport  Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 00
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 01
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 04
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 11
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 31
  Vendor: DELL     Model: Universal Xport  Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05

lsscsi
[0:2:0:0]    disk    DELL     PERC H330 Mini   4.29  /dev/sda
[15:0:0:0]   disk    DELL     MD38xxf          0825  -
[15:0:0:1]   disk    DELL     MD38xxf          0825  /dev/sdb
[15:0:0:4]   disk    DELL     MD38xxf          0825  /dev/sdc
[15:0:0:11]  disk    DELL     MD38xxf          0825  /dev/sdd
[15:0:0:31]  disk    DELL     Universal Xport  0825  -
 [18:0:0:0]   disk    DELL     MD38xxf          0825  -
[18:0:0:1]   disk    DELL     MD38xxf          0825  /dev/sdi
[18:0:0:4]   disk    DELL     MD38xxf          0825  /dev/sdj
[18:0:0:11]  disk    DELL     MD38xxf          0825  /dev/sdk
[18:0:0:31]  disk    DELL     Universal Xport  0825  -

Pa makamu mungathenso kuwonjezera sintha kuchuluka, ndipo ngakhale mukakhazikitsa oVirt imatha kuchita izi palokha, ndikwabwino kuyang'ana momwe MP ikuyendera pasadakhale nokha.

Kukhazikitsa ndikusintha kwa DM Multipath

yum install device-mapper-multipath
mpathconf --enable --user_friendly_names y

cat /etc/multipath.conf | egrep -v "^s*(#|$)"
defaults {
    user_friendly_names yes
            find_multipaths yes
}

blacklist {
  wwid 26353900f02796769
  devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"     
  devnode "^hd[a-z]"
 }

Khazikitsani ntchito ya MP kuti iyambitse ndikuyiyambitsa:

systemctl enable multipathd && systemctl restart multipathd

Kuyang'ana zambiri zama module odzaza a MP:

lsmod | grep dm_multipath
dm_multipath           27792  6 dm_service_time
dm_mod                124407  139 dm_multipath,dm_log,dm_mirror

modinfo dm_multipath
filename:       /lib/modules/3.10.0-957.12.2.el7.x86_64/kernel/drivers/md/dm-multipath.ko.xz
license:        GPL
author:         Sistina Software <[email protected]>
description:    device-mapper multipath target
retpoline:      Y
rhelversion:    7.6
srcversion:     985A03DCAF053D4910E53EE
depends:        dm-mod
intree:         Y
vermagic:       3.10.0-957.12.2.el7.x86_64 SMP mod_unload modversions
signer:         CentOS Linux kernel signing key
sig_key:        A3:2D:39:46:F2:D3:58:EA:52:30:1F:63:37:8A:37:A5:54:03:00:45
sig_hashalgo:   sha256

Tiyeni tiwone zambiri zachidule za kasinthidwe kachulukidwe komwe kadalipo:

mpathconf
multipath is enabled
find_multipaths is disabled
user_friendly_names is disabled
dm_multipath module is loaded
multipathd is running

Pambuyo powonjezera LUN yatsopano kumalo osungirako ndikuyipereka kwa wolandirayo, muyenera kuyang'ana ma HBA olumikizidwa ndi wolandirayo.

systemctl reload multipathd
multipath -v2

Ndipo pomaliza, timayang'ana ngati ma LUN onse adawonetsedwa pazosungirako zosungirako, komanso ngati pali njira ziwiri kwa onsewo.

Kuwona ntchito kwa MP:

multipath -ll
3600a098000e4b4b3000003175cec1840 dm-2 DELL    ,MD38xxf
size=2.0T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:1  sdb 8:16  active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 18:0:0:1  sdi 8:128 active ready running
3600a098000e4b48f000002ab5cec1921 dm-6 DELL    ,MD38xxf
size=10T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 18:0:0:11 sdk 8:160 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 15:0:0:11 sdd 8:48  active ready running
3600a098000e4b4b3000003c95d171065 dm-3 DELL    ,MD38xxf
size=150G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:4  sdc 8:32  active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 18:0:0:4  sdj 8:144 active ready running

Monga mukuwonera, ma disks onse atatu omwe ali pamakina osungira amawoneka m'njira ziwiri. Choncho, ntchito yonse yokonzekera yatha, zomwe zikutanthauza kuti mukhoza kupita ku gawo lalikulu - kukhazikitsa gulu la oVirt, lomwe lidzakambidwe m'nkhani yotsatira.

Source: www.habr.com