Babali ba memeloa ho tloaelana le melao-motheo ea ho haha mohaho oa motheo oa ho mamella liphoso bakeng sa khoebo e nyenyane ka har'a setsi se le seng sa data, se tla tšohloa ka ho qaqileng letotong le lekhutšoanyane la lihlooho.
Karolo ea selelekela
Tlas'a setsi sa data (Setsi sa Ts'ebetso ea Lintlha) se ka utloisisoa joalo ka:
- rack ea eona ka "kamoreng ea seva" sebakeng sa khoebo, e fihlelang litlhoko tse tlase tsa ho fana ka lisebelisoa tsa motlakase le tse futhumatsang, hape e na le phihlello ea inthanete ka bafani ba babeli ba ikemetseng;
- rack e hiriloeng e nang le lisebelisoa tsa eona, e fumanehang setsing sa nnete sa data - seo ho thoeng ke. Phaello ea Tier III kapa IV e tiisang matla a tšepahalang, pholiso le phihlello ea phihlello ea Marang-rang;
- thepa e hiriloeng ka botlalo setsing sa data sa Tier III kapa IV.
Ke khetho efe ea bolulo eo u ka e khethang - boemong bo bong le bo bong, ntho e 'ngoe le e' ngoe ke ea motho ka mong, 'me hangata e itšetlehile ka lintlha tse' maloa tsa sehlooho:
- hobaneng ha khoebo e hloka lisebelisoa tsa eona tsa IT ho hang;
- hantle-ntle khoebo e batla eng ho tsoa litsing tsa motheo tsa IT (ts'epehi, scalability, taolo, joalo-joalo);
- palo ea matsete a pele ho lisebelisoa tsa IT, hammoho le hore na ke litšenyehelo tsa mofuta ofe bakeng sa eona - chelete e ngata (e bolelang ho reka thepa ea hau), kapa ho sebetsa (hangata lisebelisoa li hiroa);
- sebaka sa ho rera sa khoebo ka boyona.
O ka ngola ho hongata ka lintlha tse susumetsang qeto ea khoebo ea ho theha le ho sebelisa lisebelisoa tsa eona tsa IT, empa sepheo sa rona ke ho bonts'a ka ts'ebetso mokhoa oa ho theha meaho ena e le hore e se ke ea mamella liphoso le hore o ntse o ka boloka - fokotsa litšenyehelo tsa ho fumana software ea khoebo, kapa u li qobe ka ho feletseng.
Ha nako e telele e bontša, ha hoa lokela ho boloka ka tšepe, kaha mohatelli o lefa habeli, esita le ho feta. Empa hape - hardware e ntle, ena ke khothatso feela, 'me qetellong ke eng eo u ka e rekang hantle le hore na ke bokae ho itšetlehile ka bokhoni ba khoebo, le "meharo" ea tsamaiso ea eona. Ho feta moo, lentsoe "meharo" le lokela ho utloisisoa ka kutloisiso e ntle ea lentsoe, kaha ho molemo ho kenya chelete ho hardware qalong, e le hore hamorao u se ke ua ba le mathata a tebileng ka tšehetso ea eona e eketsehileng le ho fokotseha, kaha qalong e fosahetse. ho rera le ho boloka chelete e ngata haholo ho ka lebisa litšenyehelong tse phahameng ho feta ha u qala morero.
Kahoo, lintlha tsa pele tsa projeke:
- ho na le khoebo e entseng qeto ea ho iketsetsa portal ea eona le ho tlisa mesebetsi ea eona ho Marang-rang;
- khamphani e ile ea etsa qeto ea ho hira rack ho kenya thepa ea eona setsing se setle sa data se tiisitsoeng ho latela maemo a Tier III;
- k'hamphani e nkile qeto ea ho se boloke lintho tse ngata ho Hardware, ka hona e rekile lisebelisoa tse latelang ka liwaranti le tšehetso e atolositsoeng:
Lethathamo la lisebelisoa
- li-server tse peli tsa Dell PowerEdge R640 ka tsela e latelang:
- li-processor tse peli tsa Intel Xeon Gold 5120
- Pheleu ea 512 Gb
- li-disk tse peli tsa SAS ho RAID1, bakeng sa ho kenya OS
- karete ea marang-rang e hahiloeng ka har'a 4-port 1G
- likarete tse peli tsa marang-rang tsa 2-port 10G
- 2-port FC HBA 16G e le 'ngoe.
- Sebaka sa polokelo ea taolo ea Dell MD2f 3820 se hokahaneng ka FC 16G ka kotloloho ho mabotho a Dell;
- li-switches tse peli tsa boemo ba bobeli - Cisco WS-C2960RX-48FPS-L stacked;
- li-switches tse peli tsa boemo ba boraro - Cisco WS-C3850-24T-E, li kopantsoe ka har'a stack;
- Rack, UPS, PDU, li-server tsa console - tse fanoeng ke setsi sa data.
Joalokaha re bona, lisebelisoa tse teng li na le litebello tse ntle tsa ho hola ka mokhoa o otlolohileng le o otlolohileng, haeba khoebo e ka qothisana lehlokoa le lik'hamphani tse ling tsa profil e tšoanang ho Marang-rang, 'me ea qala ho etsa phaello e ka tseteletsoang ho holisa lisebelisoa bakeng sa tlholisano e tsoelang pele. le kholo ea phaello.
Ke lisebelisoa life tseo re ka li kenyelletsang haeba khoebo e nka qeto ea ho eketsa ts'ebetso ea sehlopha sa rona sa komporo:
- re na le polokelo e kholo ho latela palo ea likou ho li-switch tsa 2960X, ho bolelang hore re ka eketsa li-server tse ling tsa hardware;
- reka li-switch tse peli tsa FC ho hokahanya litsamaiso tsa polokelo le li-server tse eketsehileng ho tsona;
- li-server tse teng li ka ntlafatsoa - eketsa mohopolo, fetola li-processor ka tse sebetsang hantle, hokela marang-rang a 10G ka li-adapter tsa marang-rang tse teng;
- o ka eketsa lishelefo tsa disk tse eketsehileng tsamaisong ea polokelo ka mofuta o hlokahalang oa li-disk - SAS, SATA kapa SSD, ho itšetlehile ka mojaro o reriloeng;
- Ka mor'a ho eketsa li-switches tsa FC, u ka reka mokhoa o mong oa polokelo ho eketsa matla a disk le ho feta, 'me haeba u reka khetho e khethehileng ea Remote Replication ho eona, u ka lokisetsa phetisetso ea data pakeng tsa litsamaiso tsa polokelo ka hare ho meeli ea setsi se le seng sa data le pakeng tsa litsi tsa data. (empa sena se se se feta tekanyo ea sehlooho);
- ho boetse ho na le li-switches tsa boemo ba boraro - Cisco 3850, e ka sebelisoang e le setsi sa marang-rang se mamellang liphoso bakeng sa ho tsamaea ka lebelo le phahameng pakeng tsa marang-rang a ka hare. Sena se tla thusa haholo nakong e tlang, ha lisebelisoa tsa ka hare li ntse li hōla. 3850 e boetse e na le likou tsa 10G tse ka sebelisoang hamorao ha ho ntlafatsa lisebelisoa tsa marang-rang ho lebelo la 10G.
Kaha joale ha ho na moo ho se nang virtualization, ka sebele re tla be re le teng, haholo-holo kaha ena ke tsela e ntle ea ho fokotsa litšenyehelo tsa ho fumana li-server tse theko e boima bakeng sa likarolo tsa motheo tsa motheo (li-server, li-database, joalo-joalo), tseo e seng tse nepahetseng kamehla. e sebelisoang ha ho e-na le mojaro o tlaase, 'me sena ke sona se tla ba hantle qalong ea tlhahiso ea morero.
Ntle le moo, virtualization e na le melemo e meng e mengata e ka re thusang haholo: ho mamella liphoso tsa VM ho tsoa ho ho hloleha ha seva sa hardware, Ho falla ha Live lipakeng tsa li-cluster hardware node bakeng sa tlhokomelo ea tsona, kabo ea matsoho kapa ea othomathike lipakeng tsa li-cluster node, jj.
Bakeng sa lisebelisoa tse rekiloeng ke khoebo, ho romelloa ha sehlopha se fumanehang haholo sa VMware vSphere hoa itlhahisa, empa kaha software leha e le efe e tsoang VMware e tsejoa ka li-tag tsa eona tsa "pere", re tla sebelisa software ea mahala ea tsamaiso ea virtualization - , motheong oa hore sehlahisoa se tsebahalang, empa se seng se ntse se rekisoa - .
Software OVirt ho hlokahala ho kopanya likarolo tsohle tsa meralo ea motheo hore e be ntho e le 'ngoe e le hore u tsebe ho sebetsa ka mokhoa o bonolo le mechini e fumanehang haholo - tsena ke li-database, lits'ebetso tsa webo, li-server tsa proxy, li-balancers, li-server tsa ho bokella lintlha le li-analytics, joalo-joalo. , hore na sebaka sa marang-rang sa khoebo ea rona se na le eng.
Ha re akaretsa selelekela sena, lingoloa tse latelang li re emetse, tse tla bonts'a ka ts'ebetso mokhoa oa ho tsamaisa lisebelisoa tsohle tsa software le software ea khoebo:
Lethathamo la lingoliloeng
- Karolo ea 1. Ho itokisa ho tsamaisa sehlopha sa oVirt 4.3.
- Karolo ea 2. Ho kenya le ho hlophisa sehlopha sa oVirt 4.3.
- Karolo ea 3. Ho theha sehlopha sa VyOS, ho hlophisa litsela tse ka ntle tse mamellang liphoso.
- Karolo ea 4. Ho theha stack ea Cisco 3850, ho hlophisa tsela ea intranet.
Karolo ea 1. Ho itokisa ho tsamaisa sehlopha sa oVirt 4.3
Tlhophiso ea mantlha ea moamoheli
Ho kenya le ho hlophisa OS ke mohato o bonolo ka ho fetisisa. Ho na le lingoloa tse ngata mabapi le mokhoa oa ho kenya le ho hlophisa OS hantle, ka hona ha ho utloahale ho leka ho fana ka ho hong ho ikhethileng ka sena.
Kahoo, re na le li-host tse peli tsa Dell PowerEdge R640 tseo ho tsona re hlokang ho kenya OS le ho etsa litlhophiso tsa pele e le hore re li sebelise e le li-hypervisors ho tsamaisa mechini e fumanehang ka har'a sehlopha sa oVirt 4.3.
Kaha re rera ho sebelisa software ea mahala e seng ea khoebo ea oVirt, re khethile OS bakeng sa ho tsamaisa mabotho. CentOS 7.7, leha ho ka khoneha ho kenya lits'ebetso tse ling ho mabotho a oVirt:
- mohaho o khethehileng o thehiloeng ho RHEL, seo ho thoeng ke. ;
- OS Oracle Linux Lehlabula la 2019 mabapi le ho boloka oVirt e sebetsa ho eona.
Pele o kenya OS, ho kgothaletswa:
- lokisa sebopeho sa marang-rang sa iDRAC ho mabotho ka bobeli;
- ntlafatsa firmware bakeng sa BIOS le iDRAC ho liphetolelo tsa morao-rao;
- lokisa Boemo ba Ts'ebetso ea seva, haholo-holo ka mokhoa oa Ts'ebetso;
- lokisa RAID ho tsoa ho li-disk tsa lehae (RAID1 e khothaletsoa) ho kenya OS ho seva.
Ebe re kenya OS ho disk e entsoeng pejana ka iDRAC - ts'ebetso ea ho kenya e tloaelehile, ha ho na linako tse khethehileng ho eona. U ka boela ua kena ho seva sa console ho qala ho kenya OS ka iDRAC, leha ho se letho le u thibelang ho hokahanya mochine, keyboard le mouse ka ho toba ho seva le ho kenya OS ho tloha ho flash drive.
Ka mor'a ho kenya OS, re etsa litlhophiso tsa eona tsa pele:
systemctl enable network.service
systemctl start network.service
systemctl status network.servicesystemctl stop NetworkManager
systemctl disable NetworkManager
systemctl status NetworkManageryum install -y ntp
systemctl enable ntpd.service
systemctl start ntpd.servicecat /etc/sysconfig/selinux
SELINUX=disabled
SELINUXTYPE=targetedcat /etc/security/limits.conf
* soft nofile 65536
* hard nofile 65536cat /etc/sysctl.conf
vm.max_map_count = 262144
vm.swappiness = 1Ho kenya software ea motheo
Bakeng sa tlhophiso ea pele ea OS, o hloka ho lokisa sebopeho leha e le sefe sa marang-rang ho seva e le hore o ka kena Inthaneteng ho ntlafatsa OS le ho kenya liphutheloana tsa software tse hlokahalang. Sena se ka etsoa ka bobeli nakong ea ts'ebetso ea ho kenya OS le ka mor'a eona.
yum -y install epel-release
yum update
yum -y install bind-utils yum-utils net-tools git htop iotop nmon pciutils sysfsutils sysstat mc nc rsync wget traceroute gzip unzip telnet Litlhophiso tsohle tse kaholimo le sete ea software ke taba ea khetho ea motho, mme sete ena ke khothaletso feela.
Kaha moamoheli oa rona o tla bapala karolo ea hypervisor, re tla nolofalletsa boemo ba ts'ebetso bo lakatsehang:
systemctl enable tuned
systemctl start tuned
systemctl status tuned tuned-adm profile
tuned-adm profile virtual-host U ka bala haholoanyane ka profil ea ts'ebetso mona:".
Ka mor'a ho kenya OS, re fetela karolong e latelang - ho lokisa marang-rang a marang-rang ho mabotho, le li-switches tsa Cisco 2960X.
Ho lokisa Cisco 2960X Switch Stack
Morerong oa rona, ho tla sebelisoa linomoro tse latelang tsa VLAN - kapa libaka tsa phatlalatso tse arohaneng le tse ling, molemong oa ho arola mefuta e fapaneng ea sephethephethe:
Tlhaloso: VLAN 10 - Inthanete
Tlhaloso: VLAN 17 - Tsamaiso (iDRAC, polokelo, taolo ea li-switches)
Tlhaloso: VLAN 32 - marang-rang a tlhahiso ea VM
Tlhaloso: VLAN 33 - marang-rang a khokahanyo (ho likonteraka tsa kantle)
Tlhaloso: VLAN 34 - Marang-rang a tlhahlobo ea VM
Tlhaloso: VLAN 35 - Marang-rang a nts'etsopele ea VM
Tlhaloso: VLAN 40 – ho beha leihlo marang-rang
Pele re qala mosebetsi, a re faneng ka setšoantšo sa boemo ba L2, seo qetellong re lokelang ho tla ho sona:
Bakeng sa tšebelisano ea marang-rang ea mabotho a oVirt le mechini e ts'oanang e mong le e mong, hammoho le ho laola sistimi ea rona ea polokelo, hoa hlokahala ho hlophisa li-switches tsa Cisco 2960X.
Mabotho a Dell a na le likarete tsa marang-rang a 4-port, ka hona, ho bohlokoa ho hlophisa khokahano ea bona ho Cisco 2960X ho sebelisa khokahano ea marang-rang e mamellang liphoso, ho sebelisa sehlopha sa likou tsa marang-rang hore e be sebopeho se utloahalang, le LACP (802.3) ad) protocol:
- likou tse peli tsa pele ho moamoheli li hlophisitsoe ka mokhoa oa bonding mme li hokahantsoe le switch ea 2960X - sebopeho sena se hlakileng se tla hlophisoa. borokho e nang le aterese bakeng sa tsamaiso ea moamoheli, tlhokomelo, puisano le batho ba bang sehlopheng sa oVirt, e tla boela e sebelisoe bakeng sa Phallo ea Live ea mechine e sebetsang;
- likou tse peli tsa bobeli ho moamoheli le tsona li hlophisitsoe ka mokhoa oa bonding mme li hokahane le 2960X - ho sehokelo sena se utloahalang se sebelisa oVirt, marokho a tla bōptjoa hamorao (ka VLANs e lumellanang) eo ho eona ho tla kopana mechine ea sebele.
- likou tse peli tsa marang-rang ka har'a sebopeho se ts'oanang se utloahalang li tla sebetsa, ke hore. sephethephethe ho tsona se ka fetisoa ka nako e le 'ngoe, ka mokhoa oa ho leka-lekanya.
- litlhophiso tsa marang-rang ho li-cluster node li tlameha ho tšoana hantle, ntle le liaterese tsa IP.
Tlhophiso ea motheo ea li-switch stack 2960X le likou tsa eona
Pele, li-switches tsa rona e lokela ho ba:
- rack e kentsoeng;
- e kopantsoeng le lithapo tse peli tse khethehileng tsa bolelele bo hlokahalang, mohlala, CAB-STK-E-1M;
- e hokahaneng le phepelo ea motlakase;
- e hokahane le setsi sa mosebetsi sa motsamaisi ka koung ea console bakeng sa tlhophiso ea bona ea pele.
Tataiso e hlokahalang bakeng sa sena e fumaneha ho moetsi.
Ka mor'a ho qeta mehato e ka holimo, re lokisa li-switches.
Se boleloang ke taelo e 'ngoe le e' ngoe ha ea lokela ho hlalosoa ka har'a moralo oa sengoloa sena; ha ho hlokahala, tlhaiso-leseling eohle e ka fumanoa ka boikemelo.
Sepheo sa rona ke ho potlakela ho theha "switch stack" le ho hokahanya li-hosts le li-interfaces tsa tsamaiso ea polokelo ho eona.
1) Re hokela ho master switch, re ee mokhoeng oa tokelo, ebe re ea mokhoeng oa tlhophiso ebe re etsa litlhophiso tsa mantlha.
Basic switch config:
enable
configure terminal
hostname 2960X
no service pad
service timestamps debug datetime msec
service timestamps log datetime localtime show-timezone msec
no service password-encryption
service sequence-numbers
switch 1 priority 15
switch 2 priority 14
stack-mac persistent timer 0
clock timezone MSK 3
vtp mode transparent
ip subnet-zero
vlan 17
name Management
vlan 32
name PROD
vlan 33
name Interconnect
vlan 34
name Test
vlan 35
name Dev
vlan 40
name Monitoring
spanning-tree mode rapid-pvst
spanning-tree etherchannel guard misconfig
spanning-tree portfast bpduguard default
spanning-tree extend system-id
spanning-tree vlan 1-40 root primary
spanning-tree loopguard default
vlan internal allocation policy ascending
port-channel load-balance src-dst-ip
errdisable recovery cause loopback
errdisable recovery cause bpduguard
errdisable recovery interval 60
line con 0
session-timeout 60
exec-timeout 60 0
logging synchronous
line vty 5 15
session-timeout 60
exec-timeout 60 0
logging synchronous
ip http server
ip http secure-server
no vstack
interface Vlan1
no ip address
shutdown
exit
Boloka config ka taelo "wr mm" 'me u qale hape "switch stack" ka taelo "kenya hape»ho master switch 1.
2) Re lokisa marang-rang a marang-rang a ho fetola mokhoa oa ho fumana (ho fihlella) ho VLAN 17, ho hokahanya li-interfaces tsa taolo ea litsamaiso tsa polokelo le li-server tsa iDRAC.
Ho lokisa Maemakepe a Tsamaiso:
interface GigabitEthernet1/0/5
description iDRAC - host1
switchport access vlan 17
switchport mode access
spanning-tree portfast edge
interface GigabitEthernet1/0/6
description Storage1 - Cntr0/Eth0
switchport access vlan 17
switchport mode access
spanning-tree portfast edge
interface GigabitEthernet2/0/5
description iDRAC - host2
switchport access vlan 17
switchport mode access
spanning-tree portfast edge
interface GigabitEthernet2/0/6
description Storage1 – Cntr1/Eth0
switchport access vlan 17
switchport mode access
spanning-tree portfast edge
exit3) Kamora ho kenya stack hape, etsa bonnete ba hore e sebetsa ka nepo:
Ho hlahloba ts'ebetso ea stack:
2960X#show switch stack-ring speed
Stack Ring Speed : 20G
Stack Ring Configuration: Full
Stack Ring Protocol : FlexStack
2960X#show switch stack-ports
Switch # Port 1 Port 2
-------- ------ ------
1 Ok Ok
2 Ok Ok
2960X#show switch neighbors
Switch # Port 1 Port 2
-------- ------ ------
1 2 2
2 1 1
2960X#show switch detail
Switch/Stack Mac Address : 0cd0.f8e4.ХХХХ
Mac persistency wait time: Indefinite
H/W Current
Switch# Role Mac Address Priority Version State
----------------------------------------------------------
*1 Master 0cd0.f8e4.ХХХХ 15 4 Ready
2 Member 0029.c251.ХХХХ 14 4 Ready
Stack Port Status Neighbors
Switch# Port 1 Port 2 Port 1 Port 2
--------------------------------------------------------
1 Ok Ok 2 2
2 Ok Ok 1 14) Ho theha phihlello ea SSH ho stack ea 2960X
Ho laola stack u le hole ka SSH, re tla sebelisa IP 172.20.1.10 e hlophisitsoeng ho SVI (switch virtual interface) VLAN17.
Leha e le ntho e lakatsehang ho sebelisa boema-kepe bo inehetseng ho switjha bakeng sa merero ea tsamaiso, sena ke taba ea khetho ea motho le monyetla.
Ho theha phihlello ea SSH ho stack ea switch:
ip default-gateway 172.20.1.2
interface vlan 17
ip address 172.20.1.10 255.255.255.0
hostname 2960X
ip domain-name hw.home-lab.ru
no ip domain-lookup
clock set 12:47:04 06 Dec 2019
crypto key generate rsa
ip ssh version 2
ip ssh time-out 90
line vty 0 4
session-timeout 60
exec-timeout 60 0
privilege level 15
logging synchronous
transport input ssh
line vty 5 15
session-timeout 60
exec-timeout 60 0
privilege level 15
logging synchronous
transport input ssh
aaa new-model
aaa authentication login default local
username cisco privilege 15 secret my_ssh_passwordKenya phasewete ho kenya mokhoa o khethehileng:
enable secret *myenablepassword*
service password-encryptionHo theha NTP:
ntp server 85.21.78.8 prefer
ntp server 89.221.207.113
ntp server 185.22.60.71
ntp server 192.36.143.130
ntp server 185.209.85.222
show ntp status
show ntp associations
show clock detail5) Beha li-interfaces tse utloahalang tsa Etherchannel le likou tsa 'mele tse amanang le mabotho. Bakeng sa tlhophiso e bonolo, li-VLAN tsohle tse fumanehang li tla lumelloa ho li-interfaces tsohle tse utloahalang, empa hangata ho kgothaletswa ho hlophisa feela se hlokahalang:
Ho lokisa lihokelo tsa Etherchannel:
interface Port-channel1
description EtherChannel with Host1-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
spanning-tree portfast edge trunk
interface Port-channel2
description EtherChannel with Host2-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
spanning-tree portfast edge trunk
interface Port-channel3
description EtherChannel with Host1-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
spanning-tree portfast edge trunk
interface Port-channel4
description EtherChannel with Host2-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
spanning-tree portfast edge trunk
interface GigabitEthernet1/0/1
description Host1-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 1 mode active
interface GigabitEthernet1/0/2
description Host2-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 2 mode active
interface GigabitEthernet1/0/3
description Host1-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 3 mode active
interface GigabitEthernet1/0/4
description Host2-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 4 mode active
interface GigabitEthernet2/0/1
description Host1-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 1 mode active
interface GigabitEthernet2/0/2
description Host2-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 2 mode active
interface GigabitEthernet2/0/3
description Host1-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 3 mode active
interface GigabitEthernet2/0/4
description Host2-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 4 mode activeTlhophiso ea pele ea li-interface tsa marang-rang bakeng sa mechini ea sebele, ho mabotho Moamoheli1 и Moamoheli2
Re lekola boteng ba li-module tse hlokahalang bakeng sa ts'ebetso ea bonding tsamaisong, kenya module bakeng sa ho laola marokho:
modinfo bonding
modinfo 8021q
yum install bridge-utilsHo lokisa sebopeho se utloahalang sa BOND1 bakeng sa mechini ea sebele le lihokelo tsa eona tsa 'mele ho mabotho:
cat /etc/sysconfig/network-scripts/ifcfg-bond1
#DESCRIPTION - management
DEVICE=bond1
NAME=bond1
TYPE=Bond
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'
cat /etc/sysconfig/network-scripts/ifcfg-em2
#DESCRIPTION - management
DEVICE=em2
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no
NM_CONTROLLED=no
cat /etc/sysconfig/network-scripts/ifcfg-em3
#DESCRIPTION - management
DEVICE=em3
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no
NM_CONTROLLED=no Ka mor'a ho qeta li-setting ho stack 2960H le mabotho, qala marang-rang ho mabotho, 'me u hlahlobe ho sebetsa ha sebopeho se utloahalang.
- ho moamoheli:
systemctl restart network
cat /proc/net/bonding/bond1
Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)
Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2+3 (2)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
...
802.3ad info
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable
System priority: 65535
...
Slave Interface: em2
MII Status: up
Speed: 1000 Mbps
Duplex: full
...
Slave Interface: em3
MII Status: up
Speed: 1000 Mbps
Duplex: full- ka har'a stack ea switjha 2960H:
2960X#show lacp internal
Flags: S - Device is requesting Slow LACPDUs
F - Device is requesting Fast LACPDUs
A - Device is in Active mode P - Device is in Passive mode
Channel group 1
LACP port Admin Oper Port Port
Port Flags State Priority Key Key Number State
Gi1/0/1 SA bndl 32768 0x1 0x1 0x102 0x3D
Gi2/0/1 SA bndl 32768 0x1 0x1 0x202 0x3D
2960X#sh etherchannel summary
Flags: D - down P - bundled in port-channel
I - stand-alone s - suspended
H - Hot-standby (LACP only)
R - Layer3 S - Layer2
U - in use N - not in use, no aggregation
f - failed to allocate aggregator
M - not in use, minimum links not met
m - not in use, port not aggregated due to minimum links not met
u - unsuitable for bundling
w - waiting to be aggregated
d - default port
A - formed by Auto LAG
Number of channel-groups in use: 11
Number of aggregators: 11
Group Port-channel Protocol Ports
------+-------------+-----------+-----------------------------------------------
1 Po1(SU) LACP Gi1/0/1(P) Gi2/0/1(P)Tlhophiso ea pele ea li-interface tsa marang-rang bakeng sa ho laola mehloli ea lihlopha, ho ba amohelang Moamoheli1 и Moamoheli2
Ho lokisa sebopeho se utloahalang sa BOND1 bakeng sa tsamaiso ho baamoheli, le lihokelo tsa eona tsa 'mele:
cat /etc/sysconfig/network-scripts/ifcfg-bond0
#DESCRIPTION - management
DEVICE=bond0
NAME=bond0
TYPE=Bond
BONDING_MASTER=yes
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'
cat /etc/sysconfig/network-scripts/ifcfg-em0
#DESCRIPTION - management
DEVICE=em0
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no
NM_CONTROLLED=no
cat /etc/sysconfig/network-scripts/ifcfg-em1
#DESCRIPTION - management
DEVICE=em1
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no
NM_CONTROLLED=no Ka mor'a ho qeta li-setting ho stack 2960H le mabotho, qala marang-rang ho mabotho, 'me u hlahlobe ho sebetsa ha sebopeho se utloahalang.
systemctl restart network
cat /proc/net/bonding/bond1
2960X#show lacp internal
2960X#sh etherchannel summaryTheha sebopeho sa marang-rang sa taolo ho moamoheli e mong le e mong ho Tlhaloso: VLAN 17, 'me u e tlamelle ho sebopeho se utloahalang BOND1:
Ho lokisa VLAN17 ho Host1:
cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
VLAN=yes
MTU=1500
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.163
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=publicHo lokisa VLAN17 ho Host2:
cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
VLAN=yes
MTU=1500
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.164
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=publicRe qala marang-rang ho mabotho 'me re hlahloba ponahalo ea bona ho e mong.
Sena se phethela ho hlophisoa ha "switch switch" ea Cisco 2960X, 'me haeba ntho e' ngoe le e 'ngoe e entsoe ka nepo, joale re na le khokahano ea marang-rang ea likarolo tsohle tsa meralo ho e mong boemong ba L2.
Setulo sa polokelo ea Dell MD3820f
Pele o qala mosebetsi oa ho lokisa sistimi ea polokelo, e tlameha e se e hokahantsoe le "Switch" ea Cisco 2960H lihokelo tsa tsamaiso, hammoho le ho baamoheli Moamoheli1 и Moamoheli2 ka FC.
Morero o akaretsang oa hore na sistimi ea polokelo e lokela ho hokahanngoa joang le stack ea switch e fanoe khaolong e fetileng.
Morero oa ho hokahanya polokelo ka FC ho mabotho o lokela ho shebahala tjena:
Nakong ea ho hokahanya, hoa hlokahala ho ngola liaterese tsa WWPN bakeng sa mabotho a FC HBA a hokahaneng le likoung tsa FC tsamaisong ea polokelo - sena se tla hlokahala bakeng sa tlhophiso e latelang ea ho tlama moamoheli ho LUNs tsamaisong ea polokelo.
Khoasolla le ho kenya sesebelisoa sa taolo ea polokelo ea Dell MD3820f setsing sa mosebetsi sa motsamaisi - PowerVault Modular Disk Storage Manager (MDSM).
Re hokela ho eena ka liaterese tsa hae tsa kamehla tsa IP, ebe re lokisa liaterese tsa rona ho tloha VLAN17, ho laola balaoli ka TCP/IP:
Polokelo1:
ControllerA IP - 172.20.1.13, MASK - 255.255.255.0, Gateway - 172.20.1.2
ControllerB IP - 172.20.1.14, MASK - 255.255.255.0, Gateway - 172.20.1.2Ka mor'a ho theha liaterese, re ea ho sebopeho sa tsamaiso ea polokelo mme re beha phasewete, re behe nako, re ntlafatse firmware bakeng sa balaoli le li-disk, haeba ho hlokahala, joalo-joalo.
Tsela eo sena se etsoang ka eona e hlalositsoe ho polokelo.
Ka mor'a ho etsa litlhophiso tse ka holimo, re hloka feela ho etsa lintho tse 'maloa:
- Lokisa li-ID tsa boema-kepe ba FC - Li-Identifiers tsa Port Port.
- Theha sehlopha sa moamoheli − sehlopha sa baeti 'me u kenye mabotho a rona a mabeli a Dell ho eona.
- Theha sehlopha sa li-disk le li-disk tsa sebele (kapa LUNs) ho eona, tse tla hlahisoa ho mabotho.
- Lokisa tlhahiso ea li-virtual disks (kapa LUNs) bakeng sa baamoheli.
Ho kenyelletsa mabotho a macha le li-identifiers tse tlamang tsa likou tsa FC tse amohelang ho tsona ho etsoa ka menyu - Host Mappings -> Hlalosa -> Baamoheli…
Liaterese tsa WWPN tsa mabotho a FC HBA li ka fumanoa, mohlala, ho iDRAC ea seva.
Ka lebaka leo, re lokela ho fumana ntho e kang ena setšoantšo:
Ho kenyelletsa sehlopha se secha sa moamoheli le ho tlama baamoheli ho sona ho etsoa ka menyu - Host Mappings -> Hlalosa -> Sehlopha sa Baamoheli…
Bakeng sa mabotho, khetha mofuta oa OS - Linux (DM-MP).
Kamora ho theha sehlopha sa moamoheli, ka tab Litšebeletso tsa polokelo le likopi, theha sehlopha sa disk - sehlopha sa disk, ka mofuta ho latela litlhoko tsa mamello ea liphoso, mohlala, RAID10, 'me ho eona ho na le li-disk tsa boholo bo hlokahalang:
'Me qetellong, mohato oa ho qetela ke tlhahiso ea li-disk tsa sebele (kapa LUNs) bakeng sa mabotho.
Ho etsa sena, ka menu ya -. Host Mappings -> 'Mapa oa Lun -> Kenya ... re tlama li-disk tsa sebele ho li-hosts ka ho li abela linomoro.
Ntho e 'ngoe le e' ngoe e lokela ho shebahala joaloka skrini sena:
Mona ke moo re qetellang ka ho hlophisa polokelo, 'me haeba ntho e' ngoe le e 'ngoe e entsoe ka nepo, joale ba amohelang ba lokela ho bona LUNs e hlahisoa ho bona ka FC HBA ea bona.
Ha re qobelleng sistimi ho nchafatsa tlhahisoleseling mabapi le li-drive tse hokahaneng:
ls -la /sys/class/scsi_host/
echo "- - -" > /sys/class/scsi_host/host[0-9]/scanHa re boneng hore na ke lisebelisoa life tse hlahang ho li-server tsa rona:
cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 02 Id: 00 Lun: 00
Vendor: DELL Model: PERC H330 Mini Rev: 4.29
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 00
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 01
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 04
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 11
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 31
Vendor: DELL Model: Universal Xport Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 00
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 01
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 04
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 11
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 31
Vendor: DELL Model: Universal Xport Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
lsscsi
[0:2:0:0] disk DELL PERC H330 Mini 4.29 /dev/sda
[15:0:0:0] disk DELL MD38xxf 0825 -
[15:0:0:1] disk DELL MD38xxf 0825 /dev/sdb
[15:0:0:4] disk DELL MD38xxf 0825 /dev/sdc
[15:0:0:11] disk DELL MD38xxf 0825 /dev/sdd
[15:0:0:31] disk DELL Universal Xport 0825 -
[18:0:0:0] disk DELL MD38xxf 0825 -
[18:0:0:1] disk DELL MD38xxf 0825 /dev/sdi
[18:0:0:4] disk DELL MD38xxf 0825 /dev/sdj
[18:0:0:11] disk DELL MD38xxf 0825 /dev/sdk
[18:0:0:31] disk DELL Universal Xport 0825 -Ho li-hosts, u ka boela ua hlophisa ngatafatso, 'me le hoja e ka iketsetsa eona ha u kenya oVirt, ho molemo ho hlahloba ho nepahala ha MP pele ho nako.
Ho kenya le ho lokisa DM Multipath
yum install device-mapper-multipath
mpathconf --enable --user_friendly_names y
cat /etc/multipath.conf | egrep -v "^s*(#|$)"
defaults {
user_friendly_names yes
find_multipaths yes
}
blacklist {
wwid 26353900f02796769
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
devnode "^hd[a-z]"
}Beha tšebeletso ea MP hore e iketsetse 'me u e qale:
systemctl enable multipathd && systemctl restart multipathdHo hlahloba tlhahisoleseling mabapi le li-module tse kentsoeng bakeng sa ts'ebetso ea MP:
lsmod | grep dm_multipath
dm_multipath 27792 6 dm_service_time
dm_mod 124407 139 dm_multipath,dm_log,dm_mirror
modinfo dm_multipath
filename: /lib/modules/3.10.0-957.12.2.el7.x86_64/kernel/drivers/md/dm-multipath.ko.xz
license: GPL
author: Sistina Software <[email protected]>
description: device-mapper multipath target
retpoline: Y
rhelversion: 7.6
srcversion: 985A03DCAF053D4910E53EE
depends: dm-mod
intree: Y
vermagic: 3.10.0-957.12.2.el7.x86_64 SMP mod_unload modversions
signer: CentOS Linux kernel signing key
sig_key: A3:2D:39:46:F2:D3:58:EA:52:30:1F:63:37:8A:37:A5:54:03:00:45
sig_hashalgo: sha256Ho sheba kakaretso ea tlhophiso e teng ea litsela tse ngata:
mpathconf
multipath is enabled
find_multipaths is disabled
user_friendly_names is disabled
dm_multipath module is loaded
multipathd is runningKamora ho kenya LUN e ncha tsamaisong ea polokelo le ho e hlahisa ho moamoheli, o hloka ho skena li-HBA tse hokahaneng le moamoheli ho eona.
systemctl reload multipathd
multipath -v2'Me qetellong, re hlahloba hore na li-LUN tsohle li hlahisitsoe tsamaisong ea polokelo bakeng sa mabotho, le hore na ho na le litsela tse peli ho bohle.
Tlhahlobo ea ts'ebetso ea MP:
multipath -ll
3600a098000e4b4b3000003175cec1840 dm-2 DELL ,MD38xxf
size=2.0T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:1 sdb 8:16 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
`- 18:0:0:1 sdi 8:128 active ready running
3600a098000e4b48f000002ab5cec1921 dm-6 DELL ,MD38xxf
size=10T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 18:0:0:11 sdk 8:160 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
`- 15:0:0:11 sdd 8:48 active ready running
3600a098000e4b4b3000003c95d171065 dm-3 DELL ,MD38xxf
size=150G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:4 sdc 8:32 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
`- 18:0:0:4 sdj 8:144 active ready runningJoalokaha u ka bona, li-disk tsohle tse tharo tsa sistimi ea polokelo li bonahala ka mekhoa e 'meli. Kahoo, mosebetsi oohle oa litokisetso o phethiloe, ho bolelang hore u ka tsoela pele ho ea karolong e ka sehloohong - ho theha sehlopha sa oVirt, se tla tšohloa sehloohong se latelang.
Source: www.habr.com