Fausiaina o atinaʻe IT faʻafefeteina. Vaega 1 - Sauniuniga e Fa'ata'atia se OVirt 4.3 Cluster

Ua vala'aulia le aufaitau e fa'amasani i latou i mataupu faavae o le fausiaina o se fa'aletonu-fa'apalepale atina'e mo se atina'e la'ititi i totonu o se tasi nofoaga autu o fa'amaumauga, lea o le a talanoaina auiliili i se fa'asologa puupuu o tala.

Vaega tomua

Lalo Nofoaga fa'amaumauga (Center Processing Center) e mafai ona malamalama e faapea:

  • lau lava fata i totonu o lau lava "potu tautua" i luga o le fale o le atinaʻe, lea e fetaui ma manaoga maualalo mo le tuʻuina atu o le eletise ma le faʻamafanafanaina o meafaigaluega, ma e iai foʻi le Initaneti e ala i kamupani tutoʻatasi e lua;
  • se fata mautotogi ma ana lava meafaigaluega, o loʻo i totonu o se nofoaga autu faʻamatalaga moni - o le mea e taʻua. tu'ufa'atasiga, lea e ogatasi ma le Tier III po'o le IV fa'ata'ita'iga, ma e fa'amautinoa ai le fa'atuatuaina o le paoa, fa'amalieina ma le fa'apalepale o le initaneti;
  • totogi atoa meafaigaluega i totonu o le Tier III poʻo le IV nofoaga autu o faʻamaumauga.

O le fea fale e filifili ai e ta'ito'atasi i tulaga ta'itasi, ma e masani lava ona fa'alagolago i le tele o mea taua:

  • Aisea e manaʻomia ai e se atinaʻe ana lava atinaʻe IT?
  • o le a tonu le mea o loʻo manaʻomia e le atinaʻe mai atinaʻe IT (faʻalagolago, faʻalauteleina, faʻatautaia, ma isi);
  • le tele o uluai tupe teufaafaigaluega i totonu o atinaʻe IT, faʻapea foʻi ma le ituaiga o tau mo ia - tupe faavae (o lona uiga e te faʻatau au lava meafaigaluega), poʻo le faʻaogaina (mea faigaluega e masani ona lisiina);
  • fuafuaga mamao o le atina'e lava ia.

E tele mea e mafai ona tusia e uiga i mea e aʻafia ai le filifiliga a se atinaʻe e fausia ma faʻaogaina ana atinaʻe IT, ae o la matou sini o le faʻaalia i le faʻataʻitaʻiga pe faʻapefea ona fausia lenei lava atinaʻe ina ia faʻapalepale faʻaletonu ma mafai foi ona faʻasaoina tupe. le tau o le fa'atauina o polokalame fa'apisinisi, pe 'aloese atoa.

E pei ona faʻaalia e faʻataʻitaʻiga umi, e le aoga le faʻapolopoloina o meafaigaluega, talu ai e faalua ona totogi e le stingy, ma sili atu. Ae le gata i lea, o meafaigaluega lelei ua na o se fautuaga, ma i le faaiuga o le a tonu le mea e faʻatau ma pe o le a le tele e faʻalagolago i le gafatia o le atinaʻe ma le "matapeʻapeʻa" o lana pulega. E le gata i lea, o le upu "matapeʻapeʻa" e tatau ona malamalama i le uiga lelei o le upu, talu ai e sili atu le teu faʻafaigaluega i meafaigaluega i le taimi muamua, ina ia aua neʻi i ai ni faʻafitauli matuia ma lona lagolago atili ma le faʻalauteleina, talu ai le le saʻo o le fuafuaga muamua ma tele fa'aagaga e mafai ona o'o atu ai i tau maualuga atu nai lo le taimi e amata ai le poloketi.

O lea la, o faʻamatalaga muamua mo le poloketi:

  • o loʻo i ai se atinaʻe ua filifili e fausia lana lava upega tafaʻilagi ma aumai ana gaioiga i luga ole Initaneti;
  • na filifili le kamupani e totogi se fata e tuʻu ai ana meafaigaluega i se nofoaga faʻamaumauga lelei faʻamaonia e tusa ai ma le Tier III tulaga;
  • na filifili le kamupani e aua neʻi faʻapolopolo tele i meafaigaluega, ma o lea na faʻatau ai meafaigaluega nei faʻatasi ai ma faʻaopoopoga faʻamaonia ma lagolago:

Lisi o meafaigaluega

  • lua fa'aumau Dell PowerEdge R640 fa'aletino e fa'apea:
  • lua Intel Xeon Gold 5120 processors
  • 512 GB RAM
  • lua SAS tisiki i le RAID1, mo OS faʻapipiʻi
  • fausia-i 4-taulaga 1G network card
  • lua 2-port 10G network cards
  • tasi 2-taulaga FC HBA 16G.
  • 2-pule faʻapipiʻi faʻapipiʻi Dell MD3820f, faʻafesoʻotaʻi e ala i le FC 16G saʻo i le au a Dell;
  • lua sui tulaga lua - Cisco WS-C2960RX-48FPS-L faaputu;
  • lua sui tulaga tolu - Cisco WS-C3850-24T-E, faaputu;
  • Faʻamau, UPS, PDU, faʻamafanafanaga sapalai e tuʻuina atu e le nofoaga autu o faʻamatalaga.

E pei ona tatou vaʻaia, o meafaigaluega o loʻo i ai nei o loʻo i ai ni faʻamoemoega lelei mo le faʻalauteleina ma le faʻasalalau, pe afai e mafai e le atinaʻe ona tauva ma isi kamupani o se faʻamatalaga tutusa i luga o le Initaneti, ma amata ona maua tupe mama, lea e mafai ona faʻafaigaluegaina i le faʻalauteleina o punaoa mo le tauvaga atili. ma le faatupulaia o tupe maua.

O a meafaigaluega e mafai ona matou faʻaopopo pe a filifili le atinaʻe e faʻateleina le faʻatinoga o la matou faʻapipiʻi komepiuta:

  • o loʻo i ai se matou faʻaagaga tele i le numera o ports i luga o le 2960X switches, o lona uiga e mafai ona matou faʻaopoopoina nisi masini masini;
  • fa'atau ni sui fa'aopoopo FC se lua e fa'afeso'ota'i ai masini fa'apipi'i ma isi 'au'aunaga ia i latou;
  • e mafai ona faʻaleleia 'auʻaunaga o loʻo i ai nei - faʻaopoopo le manatua, sui processors ma sili atu le mamana, faʻafesoʻotaʻi i le 10G fesoʻotaʻiga e faʻaaoga ai fesoʻotaʻiga fesoʻotaʻiga o loʻo iai;
  • E mafai ona e faʻaopoopoina fata faʻapipiʻi faʻapipiʻi i le mea e teu ai ma le ituaiga manaʻomia o le tisiki - SAS, SATA poʻo SSD, faʻalagolago i le uta fuafuaina;
  • a maeʻa ona faʻaopoopo le FC ki, e mafai ona e faʻatau se isi mea e teu ai e faʻaopoopo atili ai le malosi o le tisiki, ma afai e te faʻatauina se filifiliga faʻapitoa Remote Replication i ai, e mafai ona e setiina faʻamaumauga faʻamaumauga i le va o le teuina o masini i totonu o le nofoaga autu o faʻamaumauga ma le va o nofoaga autu ( ae o lea ua i tua atu i totonu o le lautele o le tusiga);
  • O lo'o iai fo'i suiga lona tolu - Cisco 3850, lea e mafai ona fa'aaogaina e avea o se fa'aletonu o feso'otaiga fa'apalepale mo le ta'avale maualuga i le va o feso'otaiga i totonu. Ole a fesoasoani tele lea ile lumana'i a'o fa'atupula'ia atina'e totonu. O le 3850 e iai fo'i ports 10G, lea e mafai ona fa'aaoga mulimuli ane pe a fa'aleleia lau masini feso'ota'iga i le 10G saoasaoa.

Talu ai o le taimi nei e leai se mea e aunoa ma le virtualization, o le a tatou i ai i le tulaga masani, aemaise lava talu ai o se auala sili lea e faʻaitiitia ai le tau o le faʻatauina o faʻatauga taugata mo elemene atinaʻe taʻitasi (web servers, databases, etc.), e le o taimi uma. sili ona lelei e faʻaaogaina pe a maualalo le uta, ma o le mea tonu lea o le a tupu i le amataga o le faʻalauiloaina o le poloketi.

E le gata i lea, o le virtualization e tele isi faʻamanuiaga e mafai ona aoga tele ia i tatou: VM faʻaletonu le faʻapalepale i le faʻaogaina o masini komepiuta, Femalagaaʻi ola i le va o nodes fuifui meafaigaluega mo lo latou tausiga, tusi lesona poʻo le tufatufaina otometi i le va o nodes fuifui, ma isi.

Mo meafaigaluega na faʻatauina e le atinaʻe, o le faʻapipiʻiina o se VMware vSphere cluster e sili ona avanoa e faʻaalia ai ia lava, ae talu ai o soʻo se polokalama mai le VMware e lauiloa mo ana "solofanua" tau tau, o le a matou faʻaogaina le polokalama e leai se totogi mo le puleaina o virtualization - oVirt, i luga o le faʻavae o loʻo faia ai se oloa lauiloa ae ua uma ona faʻatau - rhev.

Polokalame oVirt e manaʻomia le tuʻufaʻatasia o elemene uma i totonu o le tasi atoa ina ia mafai ai ona faʻaoga lelei ma masini komepiuta e maua tele - o faʻamaumauga nei, 'upega tafaʻilagi, sui sui, paleni, 'auʻaunaga mo le aoina o ogalaau ma auiliiliga, ma isi, o lona uiga, o le a le 'upega tafaʻilagi o la matou atinaʻe e aofia ai.

Ina ia aoteleina lenei folasaga, e mafai ona tatou tulimatai atu i tala o loʻo mulimuli mai, lea o le a faʻaalia i le faʻataʻitaʻiga tonu pe faʻapefea ona faʻapipiʻi uma meafaigaluega ma masini komepiuta o se atinaʻe:

Lisi o tala

  • Vaega 1. Sauni e fa'apipi'i se fuifui oVirt 4.3.
  • Vaega 2. Fa'apipi'i ma fa'atulagaina oVirt 4.3 fuifui.
  • Vaega 3. Fa'atuina se VyOS fuifui, fa'atulagaina fa'aletonu auala i fafo.
  • Vaega 4. Fa'atūina se fa'aputuga Cisco 3850, fa'atulagaina le ta'avale intranet.

Vaega 1. Saunia e fa'apipi'i se fuifui oVirt 4.3

Fa'atonu talimalo autu

O le faʻapipiʻiina ma le faʻatulagaina o le OS o le laasaga pito sili lea ona faigofie. E tele naua tala ile auala e faʻapipiʻi lelei ai ma faʻapipiʻi le OS, o lea e leai se mea e taumafai ai e tuʻuina atu se mea faʻapitoa e uiga i lenei mea.

O lea la, e lua a matou 'au a le Dell PowerEdge R640 lea matou te manaʻomia e faʻapipiʻi ai le OS ma faʻatino tulaga muamua ina ia mafai ai ona faʻaaogaina e avea ma hypervisors mo le faʻaogaina o masini komepiuta i le oVirt 4.3 cluster.

Talu ai matou te fuafua e faʻaoga le polokalama oVirt e le faʻatau pisinisi, na filifilia le OS mo le faʻapipiʻiina o 'au CentOS 7.7, e ui lava e mafai ona faʻapipiʻi isi OS i luga o 'au mo oVirt:

  • se fale faʻapitoa e faʻavae i luga o le RHEL, le mea e taʻua. oVirt Node;
  • OS Oracle Linux, taumafanafana 2019 na fofogaina mai e uiga i le lagolagoina o le galuega a oVirt i luga.

Aʻo leʻi faʻapipiʻi le OS e fautuaina:

  • fetuutuunai le iDRAC feso'otaiga feso'ota'iga i luga o 'au uma e lua;
  • faʻafouina le BIOS ma le iDRAC firmware i faʻamatalaga lata mai;
  • fetuutuuna'i le Fa'ailoga Fa'atonu a le 'au'aunaga, e sili i le Fa'atinoga;
  • configure RAID mai tisiki i le lotoifale (RAID1 fautuaina) e faʻapipiʻi le OS i luga o le server.

Ona matou faʻapipiʻi lea o le OS i luga o le disk na faia muamua e ala i le iDRAC - o le faʻapipiʻiina e masani lava, e leai ni taimi faʻapitoa i totonu. Avanoa i le faʻamafanafanaga o le server e amata ai le faʻapipiʻiina o le OS e mafai foi ona maua e ala i le iDRAC, e ui lava e leai se mea e taofia ai oe mai le faʻafesoʻotaʻi saʻo o se mataʻituina, keyboard ma le isumu i le server ma faʻapipiʻi le OS mai se kiliva.

A maeʻa ona faʻapipiʻi le OS, matou te faia ona tulaga muamua:

systemctl enable network.service
systemctl start network.service
systemctl status network.service

systemctl stop NetworkManager
systemctl disable NetworkManager
systemctl status NetworkManager

yum install -y ntp
systemctl enable ntpd.service
systemctl start ntpd.service

cat /etc/sysconfig/selinux
SELINUX=disabled
SELINUXTYPE=targeted

cat /etc/security/limits.conf
 *               soft    nofile         65536
 *               hard   nofile         65536

cat /etc/sysctl.conf
vm.max_map_count = 262144
vm.swappiness = 1

Fa'apipi'i se seti fa'avae o polokalame

Ina ia faʻapipiʻi muamua le OS, e tatau ona e faʻapipiʻi soʻo se fesoʻotaʻiga fesoʻotaʻiga i luga o le 'auʻaunaga ina ia mafai ai ona e faʻaogaina le Initaneti e faʻafouina le OS ma faʻapipiʻi pusa polokalama talafeagai. E mafai ona faia lenei mea i le taimi o le faʻapipiʻiina o le OS ma pe a uma.

yum -y install epel-release
yum update
yum -y install bind-utils yum-utils net-tools git htop iotop nmon pciutils sysfsutils sysstat mc nc rsync wget traceroute gzip unzip telnet 

O faʻatulagaga uma o loʻo i luga ma seti polokalama o se mea e fiafia i ai le tagata lava ia, ma o lenei seti ua na o se fautuaga.

Talu ai o le matou talimalo o le a faia le matafaioi o se hypervisor, matou te faʻatagaina le faʻataʻitaʻiga manaʻomia:

systemctl enable tuned 
systemctl start tuned 
systemctl status tuned 

tuned-adm profile 
tuned-adm profile virtual-host 

E mafai ona e faitau atili e uiga i faʻamatalaga faʻatinoga iinei: "Mataupu 4. fa'alogoina ma fa'alogo-adm".

A maeʻa ona faʻapipiʻi le OS, matou te agai i luma i le isi vaega - faʻatulagaina fesoʻotaʻiga fesoʻotaʻiga i luga o 'au ma se faʻaputuga o Cisco 2960X sui.

Fa'atulaga se Cisco 2960X Suiga Fa'aputuga

O la matou poloketi o le a faʻaaogaina numera nei o VLANs - poʻo faʻasalalauga faʻasalalauga, vavae ese mai le tasi ma le isi, ina ia mafai ai ona vavae ese ituaiga o feoaiga:

VLAN 10 – Initaneti
VLAN 17 - Puleaina (iDRAC, faiga teu oloa, pulega sui)
VLAN 32 - VM gaosiga fesoʻotaʻiga
VLAN 33 – feso'ota'iga feso'ota'iga (i konekarate mai fafo)
VLAN 34 - Su'ega su'ega VM
VLAN 35 - VM atinaʻe fesoʻotaʻiga
VLAN 40 – Mataitu feso'otaiga

A'o le'i amataina le galuega, o se ata lenei i le tulaga L2 e tatau ona tatou taunuu i ai:

Fausiaina o atinaʻe IT faʻafefeteina. Vaega 1 - Sauniuniga e Fa'ata'atia se OVirt 4.3 Cluster

Mo fesoʻotaʻiga fesoʻotaʻiga o 'au oVirt ma masini faʻapitoa i le tasi ma le isi, faʻapea foʻi ma le faʻatonutonuina o la tatou polokalama faʻapipiʻi, e tatau ona faʻapipiʻi se faʻaputuga o Cisco 2960X ki.

Dell 'au na fausia i totonu 4-port network cards, o le mea lea, e fautuaina e faʻapipiʻi la latou fesoʻotaʻiga i le Cisco 2960X e faʻaaoga ai se fesoʻotaʻiga fesoʻotaʻiga faʻaletonu, e faʻaaoga ai le faʻapipiʻiina o pusa fesoʻotaʻiga faaletino i totonu o se fesoʻotaʻiga talafeagai, ma le LACP protocol ( 802.3ad):

  • o ports muamua e lua i luga o le talimalo o loʻo faʻapipiʻiina i le faiga faʻapipiʻi ma faʻafesoʻotaʻi i le 2960X ki - o lenei faʻaoga talafeagai o le a faʻapipiʻiina ala laupapa faʻatasi ai ma se tuatusi mo le pulega talimalo, mataʻituina, fesoʻotaʻiga ma isi 'au i le oVirt cluster, o le a faʻaaogaina foi mo le Live migration of virtual machines;
  • o ports lona lua i luga o le talimalo o loʻo faʻapipiʻiina foi i le faʻaogaina o le faʻaogaina ma fesoʻotaʻi atu i le 2960X - i luga o lenei faʻaoga talafeagai e faʻaaoga ai le oVirt, o le a fausia alalaupapa i le lumanaʻi (i le VLANs tutusa) lea o le a fesoʻotaʻi ai masini komepiuta.
  • e lua uafu feso'ota'iga, i totonu o le fa'aoga talafeagai, o le a fa'agaoioia, i.e. fe'avea'i i luga o latou e mafai ona tu'uina atu i le taimi e tasi, i le fa'apaleni faiga.
  • fa'aogaina feso'ota'iga i nodes fuifui e tatau ona matua TOTONU, se'i vagana ai tuatusi IP.

Fa'atonu fa'aputuga o sui 2960X ma ona uafu

O a tatou ki e tatau ona muamua:

  • fa'amauina;
  • feso'ota'i e ala i uaea fa'apitoa e lua o le umi mana'omia, mo se fa'ata'ita'iga, CAB-STK-E-1M;
  • feso'ota'i i le eletise;
  • feso'ota'i atu i le fale faigaluega a le pule e ala i le pusa fa'amafanafana mo la latou fa'atulagaga muamua.

O lo'o maua le ta'iala mo'omia mo lenei mea ile itulau aloaia tagata gaosi.

A maeʻa laasaga o loʻo i luga, matou te faʻatulagaina ia ki.
O le uiga o poloaiga taʻitasi e le o faʻamoemoeina e faʻamalamalamaina i totonu o le faʻavae o lenei tusiga; pe a manaʻomia, o faʻamatalaga uma e mafai ona maua tutoʻatasi.
O la matou sini o le faʻapipiʻi vave o le faʻaputuga ki ma faʻafesoʻotaʻi 'au ma fesoʻotaʻiga faʻapipiʻi i ai.

1) Faʻafesoʻotaʻi i le faʻaoga matai, alu i le tulaga faʻapitoa, ona alu lea i le faʻatulagaga faʻatulagaina ma fai tulaga faʻavae.

Fa'atonu suiga autu:

 enable
 configure terminal

 hostname 2960X

 no service pad
 service timestamps debug datetime msec
 service timestamps log datetime localtime show-timezone msec
 no service password-encryption
 service sequence-numbers

 switch 1 priority 15
 switch 2 priority 14
 stack-mac persistent timer 0

 clock timezone MSK 3
  vtp mode transparent
  ip subnet-zero

 vlan 17
  name Management

 vlan 32
  name PROD 

 vlan 33
  name Interconnect

 vlan 34
  name Test

 vlan 35
  name Dev

 vlan 40
  name Monitoring

 spanning-tree mode rapid-pvst
 spanning-tree etherchannel guard misconfig
 spanning-tree portfast bpduguard default
 spanning-tree extend system-id
 spanning-tree vlan 1-40 root primary
 spanning-tree loopguard default
 vlan internal allocation policy ascending
 port-channel load-balance src-dst-ip

 errdisable recovery cause loopback
 errdisable recovery cause bpduguard
 errdisable recovery interval 60

line con 0
 session-timeout 60
 exec-timeout 60 0
 logging synchronous
line vty 5 15
 session-timeout 60
 exec-timeout 60 0
 logging synchronous

 ip http server
 ip http secure-server
 no vstack

interface Vlan1
 no ip address
 shutdown

 exit 

Matou te faʻasaoina le config ma le poloaiga "wr mem"ma toe faʻafou le faʻaputuga ki ma le faʻatonuga"toe uta»i luga o le ki matua 1.

2) Matou te faʻapipiʻiina ports o fesoʻotaʻiga o le ki i le auala avanoa i le VLAN 17, e faʻafesoʻotaʻi ai fesoʻotaʻiga pulega o faiga faʻapipiʻi ma iDRAC servers.

Fa'atonu ports pulega:

interface GigabitEthernet1/0/5
 description iDRAC - host1
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet1/0/6
 description Storage1 - Cntr0/Eth0
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet2/0/5
 description iDRAC - host2
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet2/0/6
 description Storage1 – Cntr1/Eth0
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge
 exit

3) A maeʻa ona toe faʻapipiʻi le faaputuga, siaki pe saʻo lelei:

Siaki le fa'atinoga o le fa'aputuga:

2960X#show switch stack-ring speed

Stack Ring Speed        : 20G
Stack Ring Configuration: Full
Stack Ring Protocol     : FlexStack

2960X#show switch stack-ports
  Switch #    Port 1       Port 2
  --------    ------       ------
    1           Ok           Ok
    2           Ok           Ok

2960X#show switch neighbors
  Switch #    Port 1       Port 2
  --------    ------       ------
      1         2             2
      2         1             1

2960X#show switch detail
Switch/Stack Mac Address : 0cd0.f8e4.ХХХХ
Mac persistency wait time: Indefinite
                                           H/W   Current
Switch#  Role   Mac Address     Priority Version  State
----------------------------------------------------------
*1       Master 0cd0.f8e4.ХХХХ    15     4       Ready
 2       Member 0029.c251.ХХХХ     14     4       Ready

         Stack Port Status             Neighbors
Switch#  Port 1     Port 2           Port 1   Port 2
--------------------------------------------------------
  1        Ok         Ok                2        2
  2        Ok         Ok                1        1

4) Fa'atulaga SSH avanoa i le 2960X fa'aputu

Ina ia pulea mamao le faaputuga e ala i le SSH, matou te faʻaogaina le IP 172.20.1.10 faʻatulagaina mo SVI (switch virtual interface) VLAN17.

E ui lava e fautuaina le faʻaogaina o se taulaga tuʻufaʻatasia tuʻufaʻatasia i luga o le ki mo faʻamoemoega pulega, o se mataupu o le manaʻoga patino ma gafatia.

Fa'atulagaina le SSH avanoa i se faaputuga o ki:

ip default-gateway 172.20.1.2

interface vlan 17
 ip address 172.20.1.10 255.255.255.0

hostname 2960X
 ip domain-name hw.home-lab.ru
 no ip domain-lookup

clock set 12:47:04 06 Dec 2019

crypto key generate rsa

ip ssh version 2
ip ssh time-out 90

line vty 0 4
 session-timeout 60
 exec-timeout 60 0
 privilege level 15
 logging synchronous
 transport input ssh

line vty 5 15
 session-timeout 60
 exec-timeout 60 0
 privilege level 15
 logging synchronous
 transport input ssh

aaa new-model
aaa authentication login default local 
username cisco privilege 15 secret my_ssh_password

Seti se upu faataga e ulufale ai i le tulaga fa'apitoa:

enable secret *myenablepassword*
service password-encryption

Fa'atulaga NTP:

ntp server 85.21.78.8 prefer
ntp server 89.221.207.113
ntp server 185.22.60.71
ntp server 192.36.143.130
ntp server 185.209.85.222

show ntp status
show ntp associations
show clock detail

5) Fa'atulaga feso'ota'iga Etherchannel talafeagai ma ports fa'aletino e feso'ota'i i 'au. Mo le faigofie o le faʻatulagaina, o VLAN avanoa uma o le a mafai i luga o fesoʻotaʻiga talafeagai uma, ae e masani ona fautuaina e faʻapipiʻi naʻo mea e manaʻomia:

Fa'atulagaina o feso'ota'iga Etherchannel:

interface Port-channel1
 description EtherChannel with Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel2
 description EtherChannel with Host2-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel3
 description EtherChannel with Host1-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel4
 description EtherChannel with Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface GigabitEthernet1/0/1
 description Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 1 mode active

interface GigabitEthernet1/0/2
 description Host2-management
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 2 mode active

interface GigabitEthernet1/0/3
 description Host1-VM
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 3 mode active

interface GigabitEthernet1/0/4
 description Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 4 mode active

interface GigabitEthernet2/0/1
 description Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 1 mode active

interface GigabitEthernet2/0/2
 description Host2-management
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 2 mode active

interface GigabitEthernet2/0/3
 description Host1-VM
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 3 mode active

interface GigabitEthernet2/0/4
 description Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 4 mode active

Fa'asologa muamua o feso'ota'iga feso'ota'iga mo masini va'aia i luga o 'au Talimalo1 и Talimalo2

Matou te siakiina le i ai o modules e manaʻomia mo le faʻapipiʻiina e galue i totonu o le polokalama, faʻapipiʻi se module mo le puleaina o alalaupapa:

modinfo bonding
modinfo 8021q
yum install bridge-utils

Fa'atulagaina o le BOND1 feso'ota'iga talafeagai mo masini masini ma ona feso'ota'iga fa'aletino i 'au:

cat /etc/sysconfig/network-scripts/ifcfg-bond1
#DESCRIPTION - management
DEVICE=bond1
NAME=bond1
TYPE=Bond
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'

cat /etc/sysconfig/network-scripts/ifcfg-em2
#DESCRIPTION - management
DEVICE=em2
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

cat /etc/sysconfig/network-scripts/ifcfg-em3
#DESCRIPTION - management
DEVICE=em3
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

A maeʻa le faʻatulagaina i luga o le faaputuga 2960H ma 'au, matou te toe amata le fesoʻotaʻiga i luga o 'au ma siaki le faʻatinoga o le faʻaoga talafeagai.

  • i luga o le talimalo:

systemctl restart network

cat /proc/net/bonding/bond1
Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)

Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2+3 (2)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
...
802.3ad info
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable
System priority: 65535
...
Slave Interface: em2
MII Status: up
Speed: 1000 Mbps
Duplex: full
...
Slave Interface: em3
MII Status: up
Speed: 1000 Mbps
Duplex: full

  • i luga o se faaputuga ki 2960H:

2960X#show lacp internal
Flags:  S - Device is requesting Slow LACPDUs
        F - Device is requesting Fast LACPDUs
        A - Device is in Active mode       P - Device is in Passive mode

Channel group 1
                            LACP port     Admin     Oper    Port        Port
Port      Flags   State     Priority      Key       Key     Number      State
Gi1/0/1   SA      bndl      32768         0x1       0x1     0x102       0x3D
Gi2/0/1   SA      bndl      32768         0x1       0x1     0x202       0x3D

2960X#sh etherchannel summary
Flags:  D - down        P - bundled in port-channel
        I - stand-alone s - suspended
        H - Hot-standby (LACP only)
        R - Layer3      S - Layer2
        U - in use      N - not in use, no aggregation
        f - failed to allocate aggregator

        M - not in use, minimum links not met
        m - not in use, port not aggregated due to minimum links not met
        u - unsuitable for bundling
        w - waiting to be aggregated
        d - default port

        A - formed by Auto LAG

Number of channel-groups in use: 11
Number of aggregators:           11

Group  Port-channel  Protocol    Ports
------+-------------+-----------+-----------------------------------------------
1      Po1(SU)         LACP      Gi1/0/1(P)  Gi2/0/1(P)

Fa'atonuga muamua o feso'ota'iga feso'ota'iga mo le fa'afoeina o puna'oa fa'apipi'i i 'au Talimalo1 и Talimalo2

Fa'atulagaina o le BOND1 feso'ota'iga talafeagai mo le pulega ma ona feso'ota'iga fa'aletino i 'au:

cat /etc/sysconfig/network-scripts/ifcfg-bond0
#DESCRIPTION - management
DEVICE=bond0
NAME=bond0
TYPE=Bond
BONDING_MASTER=yes
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'

cat /etc/sysconfig/network-scripts/ifcfg-em0
#DESCRIPTION - management
DEVICE=em0
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

cat /etc/sysconfig/network-scripts/ifcfg-em1
#DESCRIPTION - management
DEVICE=em1
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

A maeʻa le faʻatulagaina i luga o le faaputuga 2960H ma 'au, matou te toe amata le fesoʻotaʻiga i luga o 'au ma siaki le faʻatinoga o le faʻaoga talafeagai.

systemctl restart network
cat /proc/net/bonding/bond1

2960X#show lacp internal
2960X#sh etherchannel summary

Matou te faʻatulagaina le faʻaogaina o fesoʻotaʻiga fesoʻotaʻiga i luga o talimalo taʻitasi i totonu VLAN 17, ma fusifusia i le fesoʻotaʻiga talafeagai BOND1:

Fa'atonu VLAN17 ile Host1:

cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes 
USERCTL=no 
NM_CONTROLLED=no 
VLAN=yes
MTU=1500  
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.163
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=public

Fa'atonu VLAN17 ile Host2:

cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes 
USERCTL=no 
NM_CONTROLLED=no 
VLAN=yes
MTU=1500  
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.164
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=public

Matou te toe amataina le fesoʻotaʻiga i luga o 'au ma siaki lo latou vaʻaia o le tasi i le isi.

O le mea lea e faʻamaeʻa ai le faʻatulagaina o le faʻaputuga o Cisco 2960X sui, ma afai na faia saʻo mea uma, o lea ua tatou maua le fesoʻotaʻiga fesoʻotaʻiga o elemene elemene uma o le tasi i le isi i le tulaga L2.

Faʻatulagaina le Dell MD3820f faʻapipiʻi masini

Aʻo leʻi amataina le galuega ile faʻatulagaina o le teuina o mea, e tatau ona faʻafesoʻotaʻi i se faaputuga o sui Cisco 2960H fa'atonu feso'ota'iga, fa'apea fo'i ma 'au Talimalo1 и Talimalo2 auala FC.

O le ata lautele o le auala e tatau ona fa'afeso'ota'i ai faiga e teu ai i se fa'aputuga o ki na tu'uina atu i le mataupu muamua.

O le ata mo le faʻafesoʻotaʻi o le teuina o mea e ala i le FC i 'au e tatau ona foliga faʻapea:

Fausiaina o atinaʻe IT faʻafefeteina. Vaega 1 - Sauniuniga e Fa'ata'atia se OVirt 4.3 Cluster

I le taimi o le fesoʻotaʻiga, e tatau ona e tusia i lalo tuatusi WWPN mo le FC HBA 'au e fesoʻotaʻi atu i le FC ports i luga o le mea e teu ai - o le a manaʻomia lea mo le faʻatulagaina mulimuli ane o le fusifusia o 'au i LUNs i luga o le teuina.

I luga o le fale faigaluega a le pule, sii mai ma faʻapipiʻi le aoga mo le puleaina o le Dell MD3820f system storage - PuleVault Modular Disk Storage Manager (MDSM).
Matou te faʻafesoʻotaʻi i ai e ala i ona tuatusi IP le aoga, ona faʻapipiʻi lea o matou tuatusi mai VLAN17, e fa'afoeina pule e ala i le TCP/IP:

Teuina 1:

ControllerA IP - 172.20.1.13, MASK - 255.255.255.0, Gateway - 172.20.1.2
ControllerB IP - 172.20.1.14, MASK - 255.255.255.0, Gateway - 172.20.1.2

A maeʻa ona faʻatulagaina tuatusi, alu i le faʻaogaina o le faʻaogaina o mea e teu ai ma seti se faʻaupuga, seti le taimi, faʻafouina le firmware mo taʻavale ma disks, pe a manaʻomia, ma isi.
O le auala e faia ai lenei mea o loʻo faʻamatalaina i taiala tau pulega teuina.

A maeʻa le faʻatulagaina o loʻo i luga, e naʻo ni nai laʻasaga tatou te manaʻomia:

  1. Fa'atulaga ID uafu FC talimalo - Fa'ailoga Taulaga talimalo.
  2. Fausia se vaega talimalo - vaega talimalo ma faaopoopo i ai a matou au Dell e lua.
  3. Fausia se vaega tisiki ma tisiki virtual (poʻo LUNs) i totonu o le a tuʻuina atu i tagata talimalo.
  4. Fa'atulaga le tu'uina atu o tisiki mata'utia (po'o LUNs) mo 'au.

O le fa'aopoopoina o 'au fou ma fa'amauina fa'ailoga uafu FC ia i latou e faia i le lisi - Host Mappings -> Faamatala -> Talimalo…
O tuatusi WWPN o 'au a le FC HBA e mafai ona maua, mo se fa'ata'ita'iga, ile 'au'aunaga iDRAC.

O se taunuuga, e tatau ona tatou maua se mea e pei o lenei:

Fausiaina o atinaʻe IT faʻafefeteina. Vaega 1 - Sauniuniga e Fa'ata'atia se OVirt 4.3 Cluster

Fa'aopoopoina se vaega fou o 'au ma fusifusia 'au i ai e faia i le lisi - Host Mappings -> Faamatala -> Vaega Talia…
Mo 'au, filifili le ituaiga OS - Linux (DM-MP).

A maeʻa ona fatuina se vaega talimalo, e ala i le faʻamau Auaunaga Teuina & Kopi, fai se vaega tisiki - Vaega Disk, faʻatasi ai ma se ituaiga e faʻatatau i manaʻoga mo le faʻapalepale sese, mo se faʻataʻitaʻiga, RAID10, ma i totonu o tisiketi mataʻutia o le tele manaʻomia:

Fausiaina o atinaʻe IT faʻafefeteina. Vaega 1 - Sauniuniga e Fa'ata'atia se OVirt 4.3 Cluster

Ma le mea mulimuli, o le vaega mulimuli o le tuʻuina atu lea o tisiki mataʻutia (poʻo LUNs) i 'au.
Ina ia faia lenei mea, e ala i le lisi - Host Mappings -> Fa'afanua masina -> Faʻaopopo… Matou te fa'afeso'ota'ia tisiketi fa'apitoa ma 'au e ala i le tu'uina atu o numera ia i latou.

E tatau ona foliga mea uma e pei o lenei faʻamalama:

Fausiaina o atinaʻe IT faʻafefeteina. Vaega 1 - Sauniuniga e Fa'ata'atia se OVirt 4.3 Cluster

O le mea lea e maeʻa ai le faʻatulagaina o le teuina, ma afai e saʻo mea uma, ona tatau lea ona vaʻaia e le au talimalo ia LUN o loʻo tuʻuina atu ia i latou e ala ia latou FC HBA.
Tatou fa'amalosia le faiga e fa'afou fa'amatalaga e uiga i tisiki feso'ota'i:

ls -la /sys/class/scsi_host/
echo "- - -" > /sys/class/scsi_host/host[0-9]/scan

Sei o tatou va'ai po'o a masini o lo'o va'aia i luga oa tatou 'au'aunaga:

cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 02 Id: 00 Lun: 00
  Vendor: DELL     Model: PERC H330 Mini   Rev: 4.29
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 00
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 01
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 04
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 11
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 31
  Vendor: DELL     Model: Universal Xport  Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 00
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 01
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 04
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 11
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 31
  Vendor: DELL     Model: Universal Xport  Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05

lsscsi
[0:2:0:0]    disk    DELL     PERC H330 Mini   4.29  /dev/sda
[15:0:0:0]   disk    DELL     MD38xxf          0825  -
[15:0:0:1]   disk    DELL     MD38xxf          0825  /dev/sdb
[15:0:0:4]   disk    DELL     MD38xxf          0825  /dev/sdc
[15:0:0:11]  disk    DELL     MD38xxf          0825  /dev/sdd
[15:0:0:31]  disk    DELL     Universal Xport  0825  -
 [18:0:0:0]   disk    DELL     MD38xxf          0825  -
[18:0:0:1]   disk    DELL     MD38xxf          0825  /dev/sdi
[18:0:0:4]   disk    DELL     MD38xxf          0825  /dev/sdj
[18:0:0:11]  disk    DELL     MD38xxf          0825  /dev/sdk
[18:0:0:31]  disk    DELL     Universal Xport  0825  -

I luga o 'au e mafai foi ona e faʻaopoopoina faʻaopoopo faʻatele, ma e ui lava pe a faʻapipiʻi le oVirt e mafai ona faia lenei mea lava ia, e sili atu le siakiina o le faʻagaioiga saʻo a le MP muamua oe lava.

Faʻatulagaina ma le faʻatulagaina o le DM Multipath

yum install device-mapper-multipath
mpathconf --enable --user_friendly_names y

cat /etc/multipath.conf | egrep -v "^s*(#|$)"
defaults {
    user_friendly_names yes
            find_multipaths yes
}

blacklist {
  wwid 26353900f02796769
  devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"     
  devnode "^hd[a-z]"
 }

Seti le auaunaga MP e autostart ma fa'alauiloa:

systemctl enable multipathd && systemctl restart multipathd

Siaki faʻamatalaga e uiga i modules utaina mo le faʻaogaina MP:

lsmod | grep dm_multipath
dm_multipath           27792  6 dm_service_time
dm_mod                124407  139 dm_multipath,dm_log,dm_mirror

modinfo dm_multipath
filename:       /lib/modules/3.10.0-957.12.2.el7.x86_64/kernel/drivers/md/dm-multipath.ko.xz
license:        GPL
author:         Sistina Software <[email protected]>
description:    device-mapper multipath target
retpoline:      Y
rhelversion:    7.6
srcversion:     985A03DCAF053D4910E53EE
depends:        dm-mod
intree:         Y
vermagic:       3.10.0-957.12.2.el7.x86_64 SMP mod_unload modversions
signer:         CentOS Linux kernel signing key
sig_key:        A3:2D:39:46:F2:D3:58:EA:52:30:1F:63:37:8A:37:A5:54:03:00:45
sig_hashalgo:   sha256

Se'i o tatou va'ava'ai i le aotelega o fa'amatalaga e uiga i le fa'atulagaina o multipath o iai nei:

mpathconf
multipath is enabled
find_multipaths is disabled
user_friendly_names is disabled
dm_multipath module is loaded
multipathd is running

A maeʻa ona faʻapipiʻi se LUN fou i le mea e teu ai ma tuʻuina atu i le talimalo, e tatau ona e suʻeina le HBA e fesoʻotaʻi ma le talimalo i luga.

systemctl reload multipathd
multipath -v2

Ma le mea mulimuli, matou te siakiina pe na tuʻuina atu LUN uma i luga o le faʻapipiʻiina o le polokalama mo 'au, ma pe lua auala i latou uma.

Siaki le galuega a le MP:

multipath -ll
3600a098000e4b4b3000003175cec1840 dm-2 DELL    ,MD38xxf
size=2.0T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:1  sdb 8:16  active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 18:0:0:1  sdi 8:128 active ready running
3600a098000e4b48f000002ab5cec1921 dm-6 DELL    ,MD38xxf
size=10T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 18:0:0:11 sdk 8:160 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 15:0:0:11 sdd 8:48  active ready running
3600a098000e4b4b3000003c95d171065 dm-3 DELL    ,MD38xxf
size=150G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:4  sdc 8:32  active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 18:0:0:4  sdj 8:144 active ready running

E pei ona e vaʻaia, o tisiketi uma e tolu i luga o le faʻapipiʻiina o loʻo faʻaalia i luga o auala e lua. O le mea lea, ua maeʻa uma galuega sauniuni, o lona uiga e mafai ona e alu i le vaega autu - faʻatulagaina le oVirt cluster, lea o le a talanoaina i le isi mataupu.

puna: www.habr.com

Faaopoopo i ai se faamatalaga