Ua kono ʻia ka poʻe heluhelu e hoʻomaʻamaʻa iā lākou iho me nā loina o ke kūkulu ʻana i kahi ʻoihana hoʻomanawanui hewa no kahi ʻoihana liʻiliʻi i loko o kahi kikowaena data hoʻokahi, e kūkākūkā ʻia me nā kikoʻī ma kahi pōkole o nā ʻatikala.
Hoʻomau
I lalo kikowaena ʻikepili (Data Processing Center) hiki ke hoʻomaopopo ʻia penei:
- ponoʻī i loko o kāna "lumi kikowaena" ma ka ʻāina o ka ʻoihana, e kū ana i nā koi liʻiliʻi no ka hāʻawi ʻana i ka mana a me nā mea hoʻoluʻu, a loaʻa pū kekahi i ka pūnaewele ma o ʻelua mau mea hoʻolako kūʻokoʻa;
- kahi pahu hoʻolimalima me kāna mau lako ponoʻī, aia ma kahi kikowaena data maoli - ka mea i kapa ʻia. kahi hui ʻana o Tier III a i ʻole IV e hōʻoiaʻiʻo ana i ka mana hilinaʻi, ka hoʻoluʻu a me ka loaʻa ʻole o ka Internet;
- nā lako hoʻolimalima piha ma kahi kikowaena ʻikepili Tier III a i ʻole IV.
ʻO kahi koho hale e koho ai - i kēlā me kēia hihia, he kanaka hoʻokahi nā mea a pau, a maʻamau e hilinaʻi ʻia i nā kumu nui:
- no ke aha e pono ai i kahi ʻoihana i kāna ʻoihana IT ponoʻī;
- he aha ka makemake o ka ʻoihana mai ka ʻenehana IT (kūpono, scalability, manageability, etc.);
- ka nui o ka hoʻokomo mua ʻana i ka ʻenehana IT, a me ke ʻano o nā kumukūʻai no ia - kapikala (ʻo ia hoʻi ke kūʻai ʻana i kāu mau lako ponoʻī), a i ʻole ka hana ʻana (ua hoʻolimalima ʻia nā mea hana);
- ka pae hoʻolālā o ka ʻoihana ponoʻī.
Hiki iā ʻoe ke kākau i nā mea he nui e pili ana i ka hoʻoholo ʻana o kahi ʻoihana e hana a hoʻohana i kāna ʻenehana IT, akā ʻo kā mākou pahuhopu e hōʻike i ka hoʻomaʻamaʻa ʻana i ka hana ʻana i kēia ʻōnaehana ponoʻī i hiki ke hoʻomanawanui, a i ka manawa like e hiki ai ke mālama i ke kālā - hoʻemi i ke kumukūʻai o ke kūʻai ʻana i nā polokalamu ʻoihana, a i ʻole e pale aku iā lākou.
E like me ka hoʻomaʻamaʻa lōʻihi e hōʻike nei, ʻaʻole pono ke mālama ʻia ma ka hao, no ka mea, ʻelua uku ka mea ʻino, a ʻoi aku ka nui. Akā hou - ʻo ka lako lako maikaʻi, ʻo ia wale nō ka ʻōlelo aʻoaʻo, a i ka hopena i ka mea e kūʻai ai a no ka nui o ka hilinaʻi ʻana i ka hiki o ka ʻoihana, a me ka "makemake" o kāna hoʻokele. Eia kekahi, pono e hoʻomaopopo ʻia ka huaʻōlelo "makemake" ma ke ʻano maikaʻi o ka huaʻōlelo, no ka mea, ʻoi aku ka maikaʻi o ka hoʻokomo ʻana i ka ʻenehana i ka wā mua, i ʻole e loaʻa iā ʻoe nā pilikia koʻikoʻi me kāna kākoʻo a me ka hoʻonui ʻana, no ka mea, ʻo ka hoʻolālā hewa ʻole a me ka mālama kālā nui hiki ke alakaʻi i nā kumukūʻai kiʻekiʻe ma mua o ka wā e hoʻomaka ai i kahi papahana.
No laila, ʻo ka ʻikepili mua no ka papahana:
- aia kahi ʻoihana i hoʻoholo e hana i kāna puka pūnaewele ponoʻī a lawe i kāna mau hana i ka Pūnaewele;
- ua hoʻoholo ka hui e hoʻolimalima i kahi pahu e hoʻokomo i kāna mau mea hana ma kahi kikowaena data maikaʻi i hōʻoia ʻia e like me ke kūlana Tier III;
- Ua hoʻoholo ka hui ʻaʻole e mālama nui i ka lako, a no laila kūʻai aku i kēia mau mea hana me nā palapala hoʻopaʻa lōʻihi a me ke kākoʻo:
Papa inoa lako
- ʻelua mau kikowaena Dell PowerEdge R640 e like me kēia:
- ʻelua mau mea hana Intel Xeon Gold 5120
- 512 Gb hipa kāne
- ʻelua disks SAS ma RAID1, no ka hoʻokomo OS
- i kūkulu ʻia i loko o 4-port 1G network card
- ʻelua kāleka pūnaewele 2-port 10G
- hookahi 2-puka FC HBA 16G.
- ʻO Dell MD2f 3820 mea mālama mālama i hoʻopili ʻia ma o FC 16G pololei i nā pūʻali Dell;
- ʻelua hoʻololi o ka pae ʻelua - Cisco WS-C2960RX-48FPS-L i hoʻopaʻa ʻia;
- ʻelua hoʻololi o ke kolu o ka pae - Cisco WS-C3850-24T-E, i hui pū ʻia i loko o kahi waihona;
- Rack, UPS, PDU, console servers - hāʻawi ʻia e ke kikowaena data.
E like me kā mākou e ʻike ai, loaʻa i nā mea hana i kēia manawa nā manaʻo maikaʻi no ka scaling ākea a me ke kūpaʻa, inā hiki i ka ʻoihana ke hoʻokūkū me nā ʻoihana ʻē aʻe o kahi ʻano like ma ka Pūnaewele, a hoʻomaka i ka loaʻa kālā e hiki ke hoʻolilo ʻia i ka hoʻonui ʻana i nā kumuwaiwai no ka hoʻokūkū hou a me ka ulu kālā.
He aha nā mea hana e hiki ai iā mākou ke hoʻohui inā hoʻoholo ka ʻoihana e hoʻonui i ka hana o kā mākou puʻupuʻu computing:
- loaʻa iā mākou kahi mālama nui e pili ana i ka helu o nā awa ma nā hoʻololi 2960X, ʻo ia ka mea hiki iā mākou ke hoʻohui i nā kikowaena lako lako;
- kūʻai i ʻelua mau hoʻololi FC e hoʻopili i nā ʻōnaehana mālama a me nā kikowaena hou iā lākou;
- hiki ke hoʻonui i nā kikowaena i kēia manawa - hoʻohui i ka hoʻomanaʻo, hoʻololi i nā mea hana me nā mea ʻoi aku ka maikaʻi, e hoʻopili i kahi pūnaewele 10G me nā mea hoʻopili pūnaewele i loaʻa;
- Hiki iā ʻoe ke hoʻohui i nā papa diski hou i ka ʻōnaehana mālama me ke ʻano o ka disk i makemake ʻia - SAS, SATA a i ʻole SSD, e pili ana i ka ukana i hoʻolālā ʻia;
- ma hope o ka hoʻohui ʻana i nā hoʻololi FC, hiki iā ʻoe ke kūʻai i kahi ʻōnaehana mālama e hoʻohui i ka nui o ka disk, a inā ʻoe e kūʻai i kahi koho Replication Remote kūikawā iā ia, hiki iā ʻoe ke hoʻonohonoho i ka replication ʻikepili ma waena o nā ʻōnaehana mālama i loko o ka kikowaena data like a ma waena o nā kikowaena data ( akā, aia kēia ma waho o ke ʻano o ka ʻatikala);
- aia nō hoʻi nā hoʻololi ʻekolu-level - Cisco 3850, hiki ke hoʻohana ʻia ma ke ʻano he kikowaena hoʻomanawanui hewa no ka holo wikiwiki ʻana ma waena o nā pūnaewele kūloko. E kōkua nui kēia i ka wā e hiki mai ana, i ka ulu ʻana o ka ʻōnaehana kūloko. Loaʻa i ka 3850 nā awa 10G hiki ke hoʻohana ʻia ma hope i ka wā e hoʻonui ai i nā lako pūnaewele i ka wikiwiki 10G.
No ka mea ʻaʻohe wahi me ka virtualization, ʻoiaʻiʻo nō mākou i ke ʻano, ʻoi aku ka maikaʻi o kēia ala e hōʻemi ai i ke kumukūʻai o ka loaʻa ʻana o nā kikowaena kumukūʻai no nā mea hoʻomohala pilikino (nā kikowaena pūnaewele, nā waihona, a me nā mea ʻē aʻe), ʻaʻole i hoʻohana maikaʻi ʻia i ka wā haʻahaʻa haʻahaʻa, a ʻo ia ka mea e hiki mai i ka hoʻomaka ʻana o ka hoʻomaka ʻana o ka papahana.
Eia kekahi, he nui nā pono ʻē aʻe o ka virtualization i hiki ke hoʻohana nui iā mākou: ʻO ka hoʻomanawanui hewa ʻana o VM mai kahi hemahema o ka server hardware, Live migration ma waena o nā node hardware cluster no kā lākou mālama ʻana, manual a i ʻole ka hoʻoili ukana ma waena o nā nodes cluster, etc.
No ka lakohana i kūʻai ʻia e ka ʻoihana, ʻo ka hoʻolaha ʻana o kahi pūʻulu VMware vSphere i loaʻa loa e hōʻike iā ia iho, akā no ka mea ua ʻike ʻia kekahi polokalamu mai VMware no kāna mau kumukūʻai "lio", e hoʻohana mākou i nā polokalamu hoʻokele virtualization manuahi - , ma ke kumu i hana ʻia ai kahi huahana kaulana, akā ua hana ʻia - .
Pūnaewele oVirt Pono e hoʻohui i nā mea āpau o ka ʻōnaehana i hoʻokahi holoʻokoʻa i hiki ke hana maʻalahi me nā mīkini virtual i loaʻa loa - ʻo ia nā ʻikepili, nā noi pūnaewele, nā kikowaena proxy, nā mea kaulike, nā kikowaena no ka hōʻiliʻili ʻana i nā lāʻau a me nā analytics, etc.
I ka hōʻuluʻulu ʻana i kēia hoʻolauna, ke kali nei nā ʻatikala aʻe iā mākou, e hōʻike ana i ka hoʻomaʻamaʻa ʻana i ke ʻano o ka hoʻonohonoho ʻana i ka ʻenehana holoʻokoʻa a me nā lako polokalamu o kahi ʻoihana:
Ka papa inoa o nā ʻatikala
- Mahele 1. E hoʻomākaukau ana e kau i kahi oVirt Cluster 4.3.
- Mahele 2. Ke kau ʻana a me ka hoʻonohonoho ʻana i kahi hui oVirt 4.3.
- Mahele 3. Hoʻonohonoho ʻana i kahi pūʻulu VyOS, hoʻonohonoho i ka hoʻokuʻu ʻana i waho.
- Mahele 4. Hoʻonohonoho i ka Cisco 3850 stack, hoʻonohonoho intranet routing.
Mahele 1. Hoʻomākaukau e hoʻolaha i kahi hui oVirt 4.3
Hoʻonohonoho hoʻonohonoho kumu
ʻO ka hoʻonohonoho ʻana a me ka hoʻonohonoho ʻana i ka OS ka hana maʻalahi. Nui nā ʻatikala e pili ana i ka hoʻonohonoho pono ʻana a me ka hoʻonohonoho pono ʻana i ka OS, no laila ʻaʻole kūpono ke hoʻāʻo e hāʻawi i kahi mea kūʻokoʻa e pili ana i kēia.
No laila, loaʻa iā mākou ʻelua mau pūʻali Dell PowerEdge R640 kahi e pono ai mākou e hoʻokomo i ka OS a hana i nā hoʻonohonoho mua i mea e hoʻohana ai iā lākou ma ke ʻano he hypervisors e holo i nā mīkini virtual i kahi hui oVirt 4.3.
No ka mea ke hoʻolālā nei mākou e hoʻohana i ka lako polokalamu manuahi ʻole oVirt, ua koho mākou i ka OS no ka lawe ʻana i nā pūʻali koa. CentOS 7.7, ʻoiai hiki ke hoʻokomo i nā ʻōnaehana hana ʻē aʻe ma luna o nā pūʻali no oVirt:
- kahi kūkulu kūikawā e pili ana i ka RHEL, ka mea i kapa ʻia. ;
- ʻO OS Oracle Linux kauwela 2019 e pili ana i ka mālama ʻana i ka oVirt.
Ma mua o ka hoʻokomo ʻana i ka OS, ʻōlelo ʻia:
- hoʻonohonoho i ke kikowaena pūnaewele iDRAC ma nā pūʻali ʻelua;
- hōʻano hou i ka firmware no BIOS a me iDRAC i nā mana hou loa;
- hoʻonohonoho i ka Pūnaewele Pūnaewele o ke kikowaena, ʻoi aku ka maikaʻi ma ke ʻano hana;
- e hoʻonohonoho i ka RAID mai nā diski kūloko (ua ʻōlelo ʻia ʻo RAID1) e hoʻokomo i ka OS ma ke kikowaena.
A laila hoʻokomo mākou i ka OS ma ka disk i hana mua ʻia ma o iDRAC - maʻamau ke kaʻina hana, ʻaʻohe manawa kūikawā i loko. Hiki iā ʻoe ke komo i ka console server e hoʻomaka i ka hoʻonohonoho OS ma o iDRAC, ʻoiai ʻaʻohe mea e pale iā ʻoe mai ka hoʻopili pololei ʻana i kahi monitor, keyboard a me ka ʻiole i ke kikowaena a hoʻokomo i ka OS mai kahi flash drive.
Ma hope o ka hoʻokomo ʻana i ka OS, hana mākou i kāna mau hoʻonohonoho mua:
systemctl enable network.service
systemctl start network.service
systemctl status network.servicesystemctl stop NetworkManager
systemctl disable NetworkManager
systemctl status NetworkManageryum install -y ntp
systemctl enable ntpd.service
systemctl start ntpd.servicecat /etc/sysconfig/selinux
SELINUX=disabled
SELINUXTYPE=targetedcat /etc/security/limits.conf
* soft nofile 65536
* hard nofile 65536cat /etc/sysctl.conf
vm.max_map_count = 262144
vm.swappiness = 1Ke hoʻokomo ʻana i kahi hoʻonohonoho kumu o ka lako polokalamu
No ka hoʻonohonoho hoʻonohonoho OS mua, pono ʻoe e hoʻonohonoho i kahi kikowaena pūnaewele ma ke kikowaena i hiki iā ʻoe ke komo i ka Pūnaewele e hoʻonui i ka OS a hoʻokomo i nā pūʻulu polokalamu pono. Hiki ke hana i kēia i ka wā o ke kaʻina hoʻonohonoho OS a ma hope.
yum -y install epel-release
yum update
yum -y install bind-utils yum-utils net-tools git htop iotop nmon pciutils sysfsutils sysstat mc nc rsync wget traceroute gzip unzip telnet ʻO nā hoʻonohonoho a pau o luna a me ka hoʻonohonoho polokalamu he mea ia o ka makemake pilikino, a ʻo kēia hoʻonohonoho he ʻōlelo paipai wale nō.
No ka mea e hoʻokani ana kā mākou mea hoʻokipa i ke kuleana o kahi hypervisor, hiki iā mākou ke hoʻohana i ka ʻike hana i makemake ʻia:
systemctl enable tuned
systemctl start tuned
systemctl status tuned tuned-adm profile
tuned-adm profile virtual-host Hiki iā ʻoe ke heluhelu hou aʻe e pili ana i ka ʻike hana ma aneʻi:".
Ma hope o ka hoʻokomo ʻana i ka OS, neʻe mākou i ka ʻāpana aʻe - ka hoʻonohonoho ʻana i nā kikowaena pūnaewele ma luna o nā pūʻali, a me kahi pūʻulu o nā hoʻololi Cisco 2960X.
Ke hoʻonohonoho nei i kahi Cisco 2960X Switch Stack
Ma kā mākou papahana, e hoʻohana ʻia nā helu VLAN ma lalo nei - a i ʻole hoʻolaha i nā kikowaena i hoʻokaʻawale ʻia mai kekahi i kekahi, i mea e hoʻokaʻawale ai i nā ʻano kaʻa like ʻole:
VLAN 10 - Pūnaewele
VLAN 17 - Hoʻokele (iDRAC, mālama, hoʻokele hoʻololi)
VLAN 32 - Pūnaewele hana VM
VLAN 33 - pūnaewele pili (i nā mea hana ʻaelike o waho)
VLAN 34 – Uena hoao VM
VLAN 35 - Pūnaewele hoʻomohala VM
VLAN 40 – ka ʻike pūnaewele
Ma mua o ka hoʻomaka ʻana i ka hana, e hāʻawi mākou i kahi kiʻi ma ka pae L2, pono mākou e hele i:
No ka launa pū ʻana o nā pūʻali oVirt a me nā mīkini virtual me kekahi, a me ka hoʻokele ʻana i kā mākou ʻōnaehana mālama, pono e hoʻonohonoho i kahi pūʻulu o nā hoʻololi Cisco 2960X.
Ua kūkulu ʻo Dell hosts i nā kāleka pūnaewele 4-port, no laila, pono e hoʻonohonoho i kā lākou pili i ka Cisco 2960X me ka hoʻohana ʻana i kahi pilina hoʻopalekana hewa, me ka hoʻohana ʻana i ka hui ʻana o nā awa pūnaewele kino i loko o kahi logical interface, a me ka protocol LACP (802.3ad):
- ua hoʻonohonoho ʻia nā awa mua ʻelua ma ka mea hoʻokipa ma ke ʻano hoʻopaʻa ʻana a pili i ka hoʻololi 2960X - e hoʻonohonoho ʻia kēia ʻano loiloi. alahaka me kahi ʻōlelo no ka hoʻokele host, ka nānā ʻana, ke kamaʻilio ʻana me nā pūʻali ʻē aʻe i ka hui oVirt, e hoʻohana pū ʻia no ka neʻe ʻana o nā mīkini virtual;
- ʻO ka lua o nā awa ʻelua ma ka mea hoʻokipa ua hoʻonohonoho pū ʻia i ke ʻano hoʻopaʻa ʻana a pili i ka 2960X - ma kēia interface logical me ka hoʻohana ʻana i oVirt, e hana ʻia nā alahaka ma hope (ma nā VLAN e pili ana) kahi e hoʻopili ai nā mīkini virtual.
- ʻo nā awa pūnaewele ʻelua i loko o ka ʻaoʻao loiloi like e hana, ʻo ia. Hiki ke hoʻouna ʻia nā kaʻa ma luna o lākou i ka manawa like, ma ke ʻano kaulike.
- ʻO nā hoʻonohonoho pūnaewele ma nā pūnana puʻupuʻu pono e like loa me ka SAME, koe wale nā IP address.
Hoʻonohonoho hoʻonohonoho hoʻololi kumu 2960X a me kona mau awa
Ma mua, pono kā mākou hoʻololi:
- kau ʻia ʻo rack;
- i hoʻohuiʻia e nā kaula kūikawāʻelua o ka lōʻihi i makemakeʻia, no ka laʻana, CAB-STK-E-1M;
- pili i ka lako mana;
- pili i ke kahua hana o ka luna hoʻomalu ma o ke awa console no kā lākou hoʻonohonoho mua.
Loaʻa ka alakaʻi kūpono no kēia ma mea hana.
Ma hope o ka pau ʻana o nā ʻanuʻu i luna, hoʻonohonoho mākou i nā hoʻololi.
ʻO ke ʻano o kēlā me kēia kauoha ʻaʻole ia e wehewehe ʻia i loko o ke kāʻei o kēia ʻatikala; inā pono, hiki ke ʻike kūʻokoʻa nā ʻike āpau.
ʻO kā mākou pahuhopu ʻo ka hoʻonohonoho koke ʻana i kahi pahu hoʻololi a hoʻohui i nā pūʻali koa a me nā mea hoʻokele mālama mālama iā ia.
1) Hoʻopili mākou i ka hoʻololi master, hele i ke ʻano hiʻona, a laila hele i ke ʻano hoʻonohonoho a hana i nā hoʻonohonoho kumu.
Hoʻololi hoʻololi kumu:
enable
configure terminal
hostname 2960X
no service pad
service timestamps debug datetime msec
service timestamps log datetime localtime show-timezone msec
no service password-encryption
service sequence-numbers
switch 1 priority 15
switch 2 priority 14
stack-mac persistent timer 0
clock timezone MSK 3
vtp mode transparent
ip subnet-zero
vlan 17
name Management
vlan 32
name PROD
vlan 33
name Interconnect
vlan 34
name Test
vlan 35
name Dev
vlan 40
name Monitoring
spanning-tree mode rapid-pvst
spanning-tree etherchannel guard misconfig
spanning-tree portfast bpduguard default
spanning-tree extend system-id
spanning-tree vlan 1-40 root primary
spanning-tree loopguard default
vlan internal allocation policy ascending
port-channel load-balance src-dst-ip
errdisable recovery cause loopback
errdisable recovery cause bpduguard
errdisable recovery interval 60
line con 0
session-timeout 60
exec-timeout 60 0
logging synchronous
line vty 5 15
session-timeout 60
exec-timeout 60 0
logging synchronous
ip http server
ip http secure-server
no vstack
interface Vlan1
no ip address
shutdown
exit
E mālama i ka config me ke kauoha "wr mem" a hoʻomaka hou i ka hoʻopaʻa hoʻololi me ke kauoha "hoʻouka hou» ma ke kuapo kumu 1.
2) Hoʻonohonoho mākou i nā awa pūnaewele o ka hoʻololi i ka mode access (access) ma VLAN 17, e hoʻohui i nā mana mana o nā ʻōnaehana mālama a me nā kikowaena iDRAC.
Ke hoʻonohonoho nei i nā awa hoʻokele:
interface GigabitEthernet1/0/5
description iDRAC - host1
switchport access vlan 17
switchport mode access
spanning-tree portfast edge
interface GigabitEthernet1/0/6
description Storage1 - Cntr0/Eth0
switchport access vlan 17
switchport mode access
spanning-tree portfast edge
interface GigabitEthernet2/0/5
description iDRAC - host2
switchport access vlan 17
switchport mode access
spanning-tree portfast edge
interface GigabitEthernet2/0/6
description Storage1 – Cntr1/Eth0
switchport access vlan 17
switchport mode access
spanning-tree portfast edge
exit3) Ma hope o ka hoʻouka hou ʻana i ka waihona, e nānā i ka hana pololei:
Ke nānā nei i ka hana o ka waihona:
2960X#show switch stack-ring speed
Stack Ring Speed : 20G
Stack Ring Configuration: Full
Stack Ring Protocol : FlexStack
2960X#show switch stack-ports
Switch # Port 1 Port 2
-------- ------ ------
1 Ok Ok
2 Ok Ok
2960X#show switch neighbors
Switch # Port 1 Port 2
-------- ------ ------
1 2 2
2 1 1
2960X#show switch detail
Switch/Stack Mac Address : 0cd0.f8e4.ХХХХ
Mac persistency wait time: Indefinite
H/W Current
Switch# Role Mac Address Priority Version State
----------------------------------------------------------
*1 Master 0cd0.f8e4.ХХХХ 15 4 Ready
2 Member 0029.c251.ХХХХ 14 4 Ready
Stack Port Status Neighbors
Switch# Port 1 Port 2 Port 1 Port 2
--------------------------------------------------------
1 Ok Ok 2 2
2 Ok Ok 1 14) Hoʻonohonoho i ke komo SSH i ka waihona 2960X
No ka mālama ʻana i ka waihona ma o SSH, e hoʻohana mākou i ka IP 172.20.1.10 i hoʻonohonoho ʻia ma SVI (switch virtual interface) VLAN17.
ʻOiai makemake ʻia e hoʻohana i kahi awa i hoʻolaʻa ʻia ma ka hoʻololi no nā kumu hoʻokele, he mea kēia o ka makemake pilikino a me ka manawa kūpono.
Ke hoʻonohonoho nei i ke komo SSH i ka waihona hoʻololi:
ip default-gateway 172.20.1.2
interface vlan 17
ip address 172.20.1.10 255.255.255.0
hostname 2960X
ip domain-name hw.home-lab.ru
no ip domain-lookup
clock set 12:47:04 06 Dec 2019
crypto key generate rsa
ip ssh version 2
ip ssh time-out 90
line vty 0 4
session-timeout 60
exec-timeout 60 0
privilege level 15
logging synchronous
transport input ssh
line vty 5 15
session-timeout 60
exec-timeout 60 0
privilege level 15
logging synchronous
transport input ssh
aaa new-model
aaa authentication login default local
username cisco privilege 15 secret my_ssh_passwordE hoʻonohonoho i ka ʻōlelo huna no ke komo ʻana i ke ʻano hiʻona:
enable secret *myenablepassword*
service password-encryptionHoʻonohonoho i ka NTP:
ntp server 85.21.78.8 prefer
ntp server 89.221.207.113
ntp server 185.22.60.71
ntp server 192.36.143.130
ntp server 185.209.85.222
show ntp status
show ntp associations
show clock detail5) E hoʻonohonoho i nā kikowaena Etherchannel kūpono a me nā awa kino i pili i nā pūʻali. No ka maʻalahi o ka hoʻonohonoho ʻana, e ʻae ʻia nā VLAN āpau i loaʻa ma nā pilina pili pono āpau, akā makemake ʻia e hoʻonohonoho wale i nā mea e pono ai:
Ke hoʻonohonoho nei i nā pilina Etherchannel:
interface Port-channel1
description EtherChannel with Host1-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
spanning-tree portfast edge trunk
interface Port-channel2
description EtherChannel with Host2-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
spanning-tree portfast edge trunk
interface Port-channel3
description EtherChannel with Host1-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
spanning-tree portfast edge trunk
interface Port-channel4
description EtherChannel with Host2-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
spanning-tree portfast edge trunk
interface GigabitEthernet1/0/1
description Host1-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 1 mode active
interface GigabitEthernet1/0/2
description Host2-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 2 mode active
interface GigabitEthernet1/0/3
description Host1-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 3 mode active
interface GigabitEthernet1/0/4
description Host2-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 4 mode active
interface GigabitEthernet2/0/1
description Host1-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 1 mode active
interface GigabitEthernet2/0/2
description Host2-management
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 2 mode active
interface GigabitEthernet2/0/3
description Host1-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 3 mode active
interface GigabitEthernet2/0/4
description Host2-VM
switchport trunk allowed vlan 10,17,30-40
switchport mode trunk
channel-protocol lacp
channel-group 4 mode activeʻO ka hoʻonohonoho mua ʻana o nā kikowaena pūnaewele no nā mīkini virtual, ma nā pūʻali Hookipa1 и Hookipa2
Nānā mākou i ka hiki ʻana o nā modula e pono ai no ka hoʻopaʻa ʻana e hana i ka ʻōnaehana, e hoʻokomo i kahi module no ka hoʻokele ʻana i nā alahaka:
modinfo bonding
modinfo 8021q
yum install bridge-utilsKe hoʻonohonoho ʻana i ka pilina pili pono BOND1 no nā mīkini virtual a me kāna mau pilina kino ma nā pūʻali:
cat /etc/sysconfig/network-scripts/ifcfg-bond1
#DESCRIPTION - management
DEVICE=bond1
NAME=bond1
TYPE=Bond
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'
cat /etc/sysconfig/network-scripts/ifcfg-em2
#DESCRIPTION - management
DEVICE=em2
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no
NM_CONTROLLED=no
cat /etc/sysconfig/network-scripts/ifcfg-em3
#DESCRIPTION - management
DEVICE=em3
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no
NM_CONTROLLED=no Ma hope o ka hoʻopau ʻana i nā hoʻonohonoho ma ka waihona 2960H a me nā pūʻali, e hoʻomaka hou i ka pūnaewele ma nā pūʻali, a nānā i ka operability o ka logical interface.
- ma ka mea hoʻokipa:
systemctl restart network
cat /proc/net/bonding/bond1
Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)
Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2+3 (2)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
...
802.3ad info
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable
System priority: 65535
...
Slave Interface: em2
MII Status: up
Speed: 1000 Mbps
Duplex: full
...
Slave Interface: em3
MII Status: up
Speed: 1000 Mbps
Duplex: full- ma ka pahu hoʻololi 2960H:
2960X#show lacp internal
Flags: S - Device is requesting Slow LACPDUs
F - Device is requesting Fast LACPDUs
A - Device is in Active mode P - Device is in Passive mode
Channel group 1
LACP port Admin Oper Port Port
Port Flags State Priority Key Key Number State
Gi1/0/1 SA bndl 32768 0x1 0x1 0x102 0x3D
Gi2/0/1 SA bndl 32768 0x1 0x1 0x202 0x3D
2960X#sh etherchannel summary
Flags: D - down P - bundled in port-channel
I - stand-alone s - suspended
H - Hot-standby (LACP only)
R - Layer3 S - Layer2
U - in use N - not in use, no aggregation
f - failed to allocate aggregator
M - not in use, minimum links not met
m - not in use, port not aggregated due to minimum links not met
u - unsuitable for bundling
w - waiting to be aggregated
d - default port
A - formed by Auto LAG
Number of channel-groups in use: 11
Number of aggregators: 11
Group Port-channel Protocol Ports
------+-------------+-----------+-----------------------------------------------
1 Po1(SU) LACP Gi1/0/1(P) Gi2/0/1(P)ʻO ka hoʻonohonoho mua ʻana o nā kikowaena pūnaewele no ka mālama ʻana i nā kumuwaiwai cluster, ma nā pūʻali Hookipa1 и Hookipa2
Ka hoʻonohonoho ʻana i ka pilina pili pono BOND1 no ka hoʻokele ʻana i nā pūʻali, a me kāna mau pilina kino:
cat /etc/sysconfig/network-scripts/ifcfg-bond0
#DESCRIPTION - management
DEVICE=bond0
NAME=bond0
TYPE=Bond
BONDING_MASTER=yes
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'
cat /etc/sysconfig/network-scripts/ifcfg-em0
#DESCRIPTION - management
DEVICE=em0
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no
NM_CONTROLLED=no
cat /etc/sysconfig/network-scripts/ifcfg-em1
#DESCRIPTION - management
DEVICE=em1
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no
NM_CONTROLLED=no Ma hope o ka hoʻopau ʻana i nā hoʻonohonoho ma ka waihona 2960H a me nā pūʻali, e hoʻomaka hou i ka pūnaewele ma nā pūʻali, a nānā i ka operability o ka logical interface.
systemctl restart network
cat /proc/net/bonding/bond1
2960X#show lacp internal
2960X#sh etherchannel summaryE hoʻonohonoho i kahi kikowaena pūnaewele hoʻokele ma kēlā me kēia host i VLAN 17, a hoʻopaʻa iā ia i ka interface logical BOND1:
Ka hoʻonohonoho ʻana iā VLAN17 ma Host1:
cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
VLAN=yes
MTU=1500
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.163
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=publicKa hoʻonohonoho ʻana iā VLAN17 ma Host2:
cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
VLAN=yes
MTU=1500
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.164
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=publicHoʻomaka hou mākou i ka pūnaewele ma nā pūʻali a nānā i ko lākou ʻike ʻana i kekahi i kekahi.
Hoʻopau kēia i ka hoʻonohonoho ʻana o ka hoʻonohonoho ʻana o nā hoʻololi Cisco 2960X, a inā i hana pololei ʻia nā mea a pau, a laila i kēia manawa ua loaʻa iā mākou ka hoʻohui pūnaewele o nā mea ʻenehana āpau i kekahi i kekahi ma ka pae L2.
Dell MD3820f hoʻonohonoho mālama
Ma mua o ka hoʻomaka ʻana i ka hana ma ka hoʻonohonoho ʻana i ka ʻōnaehana mālama, pono e hoʻopili ʻia i ka hoʻopaʻa hoʻololi Cisco 2960H nā interface hoʻokele, a me nā pūʻali koa Hookipa1 и Hookipa2 ma o FC.
Ua hāʻawi ʻia ka ʻōnaehana maʻamau o ka hoʻopili ʻana o ka ʻōnaehana mālama i ka waihona hoʻololi ma ka mokuna mua.
ʻO ka hoʻolālā no ka hoʻopili ʻana i ka waihona ma o FC i nā pūʻali e like me kēia:
I ka wā o ka pilina, pono e kākau i nā helu WWPN no nā pūʻali FC HBA e pili ana i nā awa FC ma ka ʻōnaehana mālama - pono kēia no ka hoʻonohonoho hou ʻana o ka mea hoʻokipa e hoʻopaʻa ana i nā LUN ma ka ʻōnaehana mālama.
Hoʻoiho a hoʻokomo i ka pono mālama mālama mālama Dell MD3820f ma ke kahua hana luna - PowerVault Modular Disk Storage Manager (MDSM).
Hoʻopili mākou iā ia ma o kāna mau helu IP paʻamau, a laila hoʻonohonoho i kā mākou mau helu mai VLAN17, e hoʻokele i nā mea hoʻoponopono ma o TCP/IP:
Laki:
ControllerA IP - 172.20.1.13, MASK - 255.255.255.0, Gateway - 172.20.1.2
ControllerB IP - 172.20.1.14, MASK - 255.255.255.0, Gateway - 172.20.1.2Ma hope o ka hoʻonohonoho ʻana i nā ʻōlelo, hele mākou i ke kikowaena mālama mālama a hoʻonohonoho i kahi ʻōlelo huna, hoʻonohonoho i ka manawa, hoʻonui i ka firmware no nā mea hoʻokele a me nā disks, inā pono, etc.
Pehea e hana ʻia ai kēia i wehewehe ʻia ma waihona.
Ma hope o ka hana ʻana i nā hoʻonohonoho i luna, pono mākou e hana i kekahi mau mea:
- E hoʻonohonoho i nā ID awa FC hoʻokipa - Nā mea hōʻikeʻike awa hoʻokipa.
- E hana i kahi hui hoʻokipa − Pūʻulu hoʻokipa a hoʻohui i kā mākou mau pūʻali Dell ʻelua iā ia.
- E hana i kahi pūʻulu disk a me nā disks virtual (a i ʻole LUN) i loko, e hōʻike ʻia i nā pūʻali.
- E hoʻonohonoho i ka hōʻike ʻana i nā disks virtual (a i ʻole LUN) no nā pūʻali.
ʻO ka hoʻohui ʻana i nā pūʻali hou a me nā mea hōʻike paʻa o nā awa FC hoʻokipa iā lākou e hana ʻia ma o ka papa kuhikuhi - Nā Palapala Hoʻokipa -> E hoʻoholo -> Nā mea hoʻokipa…
Hiki ke loaʻa nā helu WWPN o nā pūʻali FC HBA, no ka laʻana, ma ka iDRAC o ke kikowaena.
ʻO ka hopena, pono mākou e kiʻi i kahi mea e like me kēia kiʻi:
ʻO ka hoʻohui ʻana i kahi hui hou o nā pūʻali koa a hoʻopaʻa i nā pūʻali iā ia e hana ʻia ma o ka papa kuhikuhi - Nā Palapala Hoʻokipa -> E hoʻoholo -> Pūʻulu hoʻokipa…
No nā mea hoʻokipa, koho i ke ʻano o ka OS - Linux (DM-MP).
Ma hope o ka hana ʻana i kahi hui hoʻokipa, ma o ka pā Nā lawelawe mālama a kope, hana i kahi hui disk - Pūʻulu Disk, me kahi ʻano e pili ana i nā koi no ka hoʻomanawanui hewa, no ka laʻana, RAID10, a i loko o ia mau disks virtual o ka nui e pono ai:
A ʻo ka hope, ʻo ka pae hope ka hōʻike ʻana i nā disks virtual (a i ʻole LUN) no nā mea hoʻokipa.
No ka hana ʻana i kēia, ma o ka papa kuhikuhi - Nā Palapala Hoʻokipa -> Ka palapala ʻāina ʻo Lun -> Pākuʻi… hoʻopaʻa mākou i nā disks virtual i nā pūʻali ma ka hāʻawi ʻana i nā helu iā lākou.
Pono nā mea a pau e like me kēia screenshot:
ʻO kēia kahi a mākou e hoʻopau ai me ka hoʻonohonoho mālama, a inā i hana pololei ʻia nā mea āpau, a laila e ʻike nā mea hoʻokipa i nā LUN i hōʻike ʻia iā lākou ma o kā lākou FC HBA.
E koi mākou i ka ʻōnaehana e hōʻano hou i ka ʻike e pili ana i nā drive pili:
ls -la /sys/class/scsi_host/
echo "- - -" > /sys/class/scsi_host/host[0-9]/scanE ʻike kākou i nā mea hana i ʻike ʻia ma kā mākou mau kikowaena:
cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 02 Id: 00 Lun: 00
Vendor: DELL Model: PERC H330 Mini Rev: 4.29
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 00
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 01
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 04
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 11
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 31
Vendor: DELL Model: Universal Xport Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 00
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 01
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 04
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 11
Vendor: DELL Model: MD38xxf Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 31
Vendor: DELL Model: Universal Xport Rev: 0825
Type: Direct-Access ANSI SCSI revision: 05
lsscsi
[0:2:0:0] disk DELL PERC H330 Mini 4.29 /dev/sda
[15:0:0:0] disk DELL MD38xxf 0825 -
[15:0:0:1] disk DELL MD38xxf 0825 /dev/sdb
[15:0:0:4] disk DELL MD38xxf 0825 /dev/sdc
[15:0:0:11] disk DELL MD38xxf 0825 /dev/sdd
[15:0:0:31] disk DELL Universal Xport 0825 -
[18:0:0:0] disk DELL MD38xxf 0825 -
[18:0:0:1] disk DELL MD38xxf 0825 /dev/sdi
[18:0:0:4] disk DELL MD38xxf 0825 /dev/sdj
[18:0:0:11] disk DELL MD38xxf 0825 /dev/sdk
[18:0:0:31] disk DELL Universal Xport 0825 -Ma nā hosts, hiki iā ʻoe ke hoʻonohonoho hou hoʻomāhuahua, a ʻoiai hiki iā ia ke hana iā ia iho i ka wā e hoʻokomo ai i ka oVirt, ʻoi aku ka maikaʻi o ka nānā ʻana i ka pololei o ka MP ma mua.
Ke hoʻouka a hoʻonohonoho ʻana i ka DM Multipath
yum install device-mapper-multipath
mpathconf --enable --user_friendly_names y
cat /etc/multipath.conf | egrep -v "^s*(#|$)"
defaults {
user_friendly_names yes
find_multipaths yes
}
blacklist {
wwid 26353900f02796769
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
devnode "^hd[a-z]"
}E hoʻonoho i ka lawelawe MP e hoʻomaka auto a hoʻomaka:
systemctl enable multipathd && systemctl restart multipathdKe nānā nei i ka ʻike e pili ana i nā modula i hoʻouka ʻia no ka hana MP:
lsmod | grep dm_multipath
dm_multipath 27792 6 dm_service_time
dm_mod 124407 139 dm_multipath,dm_log,dm_mirror
modinfo dm_multipath
filename: /lib/modules/3.10.0-957.12.2.el7.x86_64/kernel/drivers/md/dm-multipath.ko.xz
license: GPL
author: Sistina Software <[email protected]>
description: device-mapper multipath target
retpoline: Y
rhelversion: 7.6
srcversion: 985A03DCAF053D4910E53EE
depends: dm-mod
intree: Y
vermagic: 3.10.0-957.12.2.el7.x86_64 SMP mod_unload modversions
signer: CentOS Linux kernel signing key
sig_key: A3:2D:39:46:F2:D3:58:EA:52:30:1F:63:37:8A:37:A5:54:03:00:45
sig_hashalgo: sha256Ke nānā nei i kahi hōʻuluʻulu o ka hoʻonohonoho multipath e kū nei:
mpathconf
multipath is enabled
find_multipaths is disabled
user_friendly_names is disabled
dm_multipath module is loaded
multipathd is runningMa hope o ka hoʻohui ʻana i kahi LUN hou i ka ʻōnaehana mālama a hōʻike i ka mea hoʻokipa, pono ʻoe e nānā i nā HBA i pili i ka mea hoʻokipa ma luna.
systemctl reload multipathd
multipath -v2A ʻo ka hope, nānā mākou inā ua hōʻike ʻia nā LUN āpau ma ka ʻōnaehana mālama no nā pūʻali, a inā he ʻelua ala i nā mea āpau.
Nānā hana MP:
multipath -ll
3600a098000e4b4b3000003175cec1840 dm-2 DELL ,MD38xxf
size=2.0T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:1 sdb 8:16 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
`- 18:0:0:1 sdi 8:128 active ready running
3600a098000e4b48f000002ab5cec1921 dm-6 DELL ,MD38xxf
size=10T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 18:0:0:11 sdk 8:160 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
`- 15:0:0:11 sdd 8:48 active ready running
3600a098000e4b4b3000003c95d171065 dm-3 DELL ,MD38xxf
size=150G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:4 sdc 8:32 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
`- 18:0:0:4 sdj 8:144 active ready runningE like me kāu e ʻike ai, ʻike ʻia nā disk virtual ʻekolu ma ka ʻōnaehana mālama i nā ala ʻelua. No laila, ua pau nā hana hoʻomākaukau a pau, ʻo ia ka mea hiki iā ʻoe ke hele i ka ʻāpana nui - hoʻonohonoho i ka hui oVirt, e kūkākūkā ʻia ma ka ʻatikala aʻe.
Source: www.habr.com