🥇 Tsim kev ua txhaum IT kev tsim kho. Part 1 - npaj siv oVirt 4.3 pawg

Cov neeg nyeem tau raug caw kom paub lawv tus kheej nrog cov hauv paus ntsiab lus ntawm kev tsim kev ua txhaum cai rau kev lag luam me hauv ib lub chaw khaws ntaub ntawv, uas yuav tau tham txog kom meej hauv cov lus luv luv.

Taw qhia

Hauv qab Data center (Data Processing Center) tej zaum yuav to taub li:

koj tus kheej khib hauv koj tus kheej "server room" ntawm qhov chaw ntawm lub tuam txhab, uas ua tau raws li qhov tsawg kawg nkaus uas yuav tsum tau muaj rau kev muab cov khoom siv hluav taws xob thiab cua txias, thiab tseem muaj kev nkag tau hauv Is Taws Nem los ntawm ob lub chaw muab kev ywj pheej;
ib tug xauj khib nrog nws tus kheej cov cuab yeej, nyob rau hauv ib tug tiag tiag cov ntaub ntawv chaw - lub thiaj li hu ua. collocation, uas ua raws li Tier III los yog IV tus qauv, thiab uas guarantees txhim khu kev qha fais fab mov, cua txias thiab txhaum-tolerant Internet siv;
tag nrho cov khoom siv xauj hauv Tier III lossis IV data center.

Qhov kev xaiv chaw nyob twg xaiv yog tus kheej hauv txhua kis, thiab feem ntau yog nyob ntawm ntau yam tseem ceeb:

Vim li cas lub tuam txhab xav tau nws tus kheej IT infrastructure?
dab tsi raws nraim qhov kev lag luam xav tau los ntawm IT infrastructure (kev ntseeg siab, scalability, kev tswj hwm, thiab lwm yam);
qhov ntim ntawm kev nqis peev thawj zaug hauv IT infrastructure, nrog rau hom nqi twg rau nws - peev (uas txhais tau tias koj yuav koj tus kheej cov cuab yeej), lossis kev ua haujlwm (cov khoom siv feem ntau yog xauj);
npaj qab ntug ntawm lub enterprise nws tus kheej.

Muaj ntau yam tuaj yeem sau txog qhov cuam tshuam rau kev lag luam kev txiav txim siab los tsim thiab siv nws cov khoom siv IT, tab sis peb lub hom phiaj yog los qhia hauv kev xyaum yuav ua li cas los tsim cov txheej txheem no kom nws ua txhaum ob qho tib si thiab tuaj yeem txuag nyiaj. - txo tus nqi ntawm kev yuav khoom lag luam software, lossis zam lawv tag nrho.

Raws li kev xyaum ua mus ntev, nws tsis tsim nyog txuag ntawm cov khoom siv, txij li qhov stingy them ob zaug, thiab ntau ntxiv. Tab sis dua, kho vajtse zoo tsuas yog ib qho kev pom zoo, thiab thaum kawg yuav ua li cas raws nraim yuav thiab ntau npaum li cas nyob ntawm lub peev xwm ntawm kev lag luam thiab "kev ntshaw" ntawm nws txoj kev tswj hwm. Ntxiv mus, lo lus "kev ntshaw" yuav tsum tau to taub nyob rau hauv lub siab zoo ntawm lo lus, vim hais tias nws yog zoo dua mus nqis peev rau hauv kho vajtse nyob rau hauv thawj theem, thiaj li tsis muaj teeb meem loj nrog nws ntxiv kev txhawb nqa thiab scaling, txij li thaum pib tsis raug kev npaj thiab Kev txuag nyiaj ntau dhau tuaj yeem ua rau cov nqi siab dua thaum pib qhov project.

Yog li, thawj cov ntaub ntawv rau qhov project:

muaj ib lub lag luam uas tau txiav txim siab los tsim nws tus kheej lub vev xaib portal thiab coj nws cov dej num mus rau Is Taws Nem;
lub tuam txhab txiav txim siab mus xauj ib lub khib los tso nws cov khoom siv rau hauv cov ntaub ntawv zoo uas tau lees paub raws li Tier III tus qauv;
lub tuam txhab txiav txim siab tsis txuag ntau ntawm cov khoom siv kho vajtse, thiab yog li yuav cov khoom siv hauv qab no nrog kev tiv thaiv ntev thiab kev txhawb nqa:

Cov npe khoom siv

ob lub cev Dell PowerEdge R640 servers raws li hauv qab no:

ob Intel Xeon Kub 5120 processors

512GB ntawm RAM

ob SAS disks hauv RAID1, rau kev teeb tsa OS

built-in 4-chaw nres nkoj 1G network card

ob 2-chaw nres nkoj 10G network phaib

ib 2-port FC HBA 16G.

2-controller storage system Dell MD3820f, txuas ntawm FC 16G ncaj qha rau Dell hosts;

ob theem thib ob hloov pauv - Cisco WS-C2960RX-48FPS-L stacked;

ob theem thib peb hloov - Cisco WS-C3850-24T-E, stacked;

Khib, UPS, PDU, console servers yog muab los ntawm cov ntaub ntawv chaw.

Raws li peb pom, cov khoom siv uas twb muaj lawm muaj kev cia siab zoo rau kab rov tav thiab ntsug scaling, yog tias lub tuam txhab muaj peev xwm sib tw nrog lwm cov tuam txhab ntawm cov ntaub ntawv zoo sib xws hauv Is Taws Nem, thiab pib tau txais txiaj ntsig, uas tuaj yeem nqis peev hauv kev nthuav dav rau kev sib tw ntxiv. thiab nyiaj txiag loj hlob.

Cov cuab yeej siv dab tsi peb tuaj yeem ntxiv yog tias lub tuam txhab txiav txim siab nce kev ua haujlwm ntawm peb pawg suav:

peb muaj ib tug loj cia nyob rau hauv tus naj npawb ntawm cov chaw nres nkoj ntawm 2960X keyboards, uas txhais tau tias peb muaj peev xwm ntxiv hardware servers;
yuav ob lub FC hloov pauv ntxiv los txuas cov tshuab khaws cia thiab cov servers ntxiv rau lawv;
Cov servers uas twb muaj lawm tuaj yeem hloov kho dua tshiab - ntxiv lub cim xeeb, hloov cov txheej txheem nrog cov muaj zog dua, txuas mus rau 10G network siv cov khoom siv network uas twb muaj lawm;
Koj tuaj yeem ntxiv cov rhawv disk ntxiv rau lub kaw lus nrog rau hom disk uas xav tau - SAS, SATA lossis SSD, nyob ntawm qhov kev npaj thauj khoom;
Tom qab ntxiv FC keyboards, koj tuaj yeem yuav lwm qhov chaw khaws cia kom ntxiv ntau lub peev xwm disk, thiab yog tias koj yuav qhov kev xaiv tshwj xeeb Remote Replication, koj tuaj yeem teeb tsa cov ntaub ntawv rov ua dua ntawm cov tshuab khaws cia ob qho tib si hauv tib cov ntaub ntawv chaw thiab nruab nrab ntawm cov chaw khaws ntaub ntawv (tab sis qhov no yog twb dhau lawm nyob rau hauv lub Scope ntawm tsab xov xwm);
Kuj tseem muaj cov kev hloov pauv thib peb - Cisco 3850, uas tuaj yeem siv los ua qhov tsis ncaj ncees rau lub network tseem ceeb rau kev kub ceev ntawm kev sib txuas sab hauv. Qhov no yuav muaj txiaj ntsig zoo yav tom ntej vim tias kev txhim kho sab hauv loj hlob tuaj. Lub 3850 kuj muaj 10G chaw nres nkoj, uas tuaj yeem siv tom qab thaum txhim kho koj cov khoom siv network rau 10G nrawm.

Txij li tam sim no tsis muaj qhov chaw uas tsis muaj virtualization, peb yuav tsum yog qhov sib txawv, tshwj xeeb tshaj yog vim qhov no yog txoj hauv kev zoo los txo tus nqi ntawm kev yuav cov servers kim rau tus kheej cov ntsiab lus (web servers, databases, thiab lwm yam), uas tsis yog ib txwm muaj. optimal yog siv nyob rau hauv cov ntaub ntawv ntawm load tsawg, thiab qhov no yog raws nraim li cas yuav tshwm sim thaum pib ntawm lub project launch.

Tsis tas li ntawd, virtualization muaj ntau yam zoo uas tuaj yeem pab tau zoo rau peb: VM ua txhaum cai tiv thaiv cov khoom siv tsis ua haujlwm, Kev tsiv teb tsaws chaw ntawm cov cuab yeej kho vajtse rau lawv cov kev saib xyuas, phau ntawv lossis tsis siv neeg thauj khoom faib ntawm pawg nodes, thiab lwm yam.

Rau cov khoom siv uas yuav los ntawm lub tuam txhab, kev xa tawm ntawm VMware vSphere pawg uas muaj ntau heev qhia nws tus kheej, tab sis txij li ib qho software los ntawm VMware paub txog nws tus nqi "nees" cov cim npe, peb yuav siv software dawb kiag li rau kev tswj hwm virtualization - OVirt, nyob rau hauv lub hauv paus ntawm uas ib tug zoo-paub tab sis twb coj mus muag khoom yog tsim - rhev.

Software OVirt tsim nyog los ua ke tag nrho cov txheej txheem hauv ib qho tag nrho txhawm rau kom muaj peev xwm ua haujlwm tau yooj yim nrog cov tshuab virtual - cov no yog databases, web applications, proxy servers, balancers, servers rau sau cov cav thiab analytics, thiab lwm yam. web portal ntawm peb lub lag luam muaj.

Txhawm rau sau cov lus qhia no, peb tuaj yeem tos ntsoov rau cov lus hauv qab no, uas yuav qhia hauv kev xyaum raws nraim li cas yuav siv tag nrho cov khoom siv kho vajtse thiab software infrastructure ntawm lub tuam txhab:

Daim ntawv teev cov kab lus

Ntu 1. Npaj kom xa tawm oVirt 4.3 pawg.
Ntu 2. Txhim kho thiab teeb tsa oVirt 4.3 pawg.
Ntu 3. Teeb tsa VyOS pawg, teeb tsa kev ua txhaum kev cai sab nraud.
Ntu 4. Teeb tsa Cisco 3850 pawg, teeb tsa intranet routing.

Ntu 1. Npaj siv oVirt 4.3 pawg

Basic host teeb

Txhim kho thiab teeb tsa OS yog kauj ruam yooj yim. Muaj ntau ntau cov lus hais txog yuav ua li cas rau nruab thiab teeb tsa OS kom zoo, yog li tsis muaj qhov taw tes rau kev sim muab qee yam tshwj xeeb txog qhov no.

Yog li, peb muaj ob lub Dell PowerEdge R640 tus tswv uas peb yuav tsum tau nruab OS thiab ua qhov kev teeb tsa ua ntej txhawm rau siv lawv ua tus neeg saib xyuas rau kev khiav cov tshuab virtual hauv oVirt 4.3 pawg.

Txij li thaum peb npaj yuav siv cov software dawb uas tsis yog lag luam oVirt, OS tau xaiv rau kev xa tawm cov tswv. CentOS 7.7, txawm tias lwm OSes tuaj yeem ntsia tau rau ntawm cov tswv rau oVirt:

kev tsim tshwj xeeb raws li RHEL, lub npe hu ua. oVirt Node;
OS Oracle Linux, lub caij ntuj sov 2019 tau tshaj tawm txog kev txhawb nqa kev ua haujlwm ntawm oVirt ntawm nws.

Ua ntej txhim kho OS nws raug pom zoo:

configure iDRAC network interface ntawm ob tus tswv;
hloov kho BIOS thiab iDRAC firmware mus rau qhov tseeb versions;
configure tus neeg rau zaub mov qhov System Profile, nyiam dua nyob rau hauv Performance hom;
configure RAID los ntawm lub zos disks (RAID1 yog pom zoo) rau nruab OS ntawm lub server.

Tom qab ntawd peb nruab OS ntawm lub disk tsim ua ntej ntawm iDRAC - txheej txheem kev teeb tsa yog ib txwm, tsis muaj lub sijhawm tshwj xeeb hauv nws. Kev nkag mus rau lub server console kom pib OS installation kuj tuaj yeem tau txais los ntawm iDRAC, txawm hais tias tsis muaj dab tsi tiv thaiv koj los ntawm kev sib txuas ntawm lub monitor, keyboard thiab nas ncaj qha rau lub server thiab txhim kho OS los ntawm flash drive.

Tom qab txhim kho OS, peb ua nws qhov kev teeb tsa thawj zaug:

systemctl enable network.service
systemctl start network.service
systemctl status network.service

systemctl stop NetworkManager
systemctl disable NetworkManager
systemctl status NetworkManager

yum install -y ntp
systemctl enable ntpd.service
systemctl start ntpd.service

cat /etc/sysconfig/selinux
SELINUX=disabled
SELINUXTYPE=targeted

cat /etc/security/limits.conf
 *               soft    nofile         65536
 *               hard   nofile         65536

cat /etc/sysctl.conf
vm.max_map_count = 262144
vm.swappiness = 1

Txhim kho cov txheej txheem yooj yim ntawm software

Txhawm rau pib teeb tsa OS, koj yuav tsum teeb tsa ib qho kev sib txuas hauv network ntawm tus neeg rau zaub mov kom koj tuaj yeem nkag mus hauv Is Taws Nem los hloov kho OS thiab nruab cov pob khoom tsim nyog. Qhov no tuaj yeem ua tiav ob qho tib si thaum lub sijhawm OS installation thiab tom qab nws.

yum -y install epel-release
yum update
yum -y install bind-utils yum-utils net-tools git htop iotop nmon pciutils sysfsutils sysstat mc nc rsync wget traceroute gzip unzip telnet

Tag nrho cov teeb tsa saum toj no thiab software teeb tsa yog qhov teeb meem ntawm tus kheej nyiam, thiab cov teeb no tsuas yog kev pom zoo.

Txij li thaum peb tus tswv tsev yuav ua lub luag haujlwm ntawm tus neeg saib xyuas hypervisor, peb yuav ua kom qhov kev ua tau zoo uas yuav tsum tau ua:

systemctl enable tuned 
systemctl start tuned 
systemctl status tuned

tuned-adm profile 
tuned-adm profile virtual-host

Koj tuaj yeem nyeem ntxiv txog kev ua haujlwm profile ntawm no: "Tshooj 4. tuned thiab tuned-adm".

Tom qab txhim kho OS, peb mus rau ntu tom ntej - teeb tsa kev sib txuas hauv network ntawm cov tswv thiab pawg ntawm Cisco 2960X keyboards.

Configuring Cisco 2960X Switch Stack

Peb qhov project yuav siv cov lej hauv qab no ntawm VLANs - lossis tshaj tawm cov npe, cais tawm ntawm ib leeg, txhawm rau cais cov tsheb sib txawv:

VLAN 10 - internet
VLAN 17 - Kev tswj hwm (iDRAC, qhov system cia, tswj kev hloov pauv)
VLAN 32 - VM ntau lawm network
VLAN 33 - kev sib txuas network (rau cov neeg ua haujlwm sab nraud)
VLAN 34 - VM test network
VLAN 35 - VM tus tsim tawm network
VLAN 40 - Saib xyuas lub network

Ua ntej pib ua haujlwm, ntawm no yog daim duab ntawm qib L2 uas peb yuav tsum tuaj txog thaum kawg:

Rau kev sib cuam tshuam hauv network ntawm oVirt hosts thiab cov tshuab virtual nrog ib leeg, nrog rau kev tswj hwm peb lub kaw lus cia, nws yog qhov tsim nyog los teeb tsa ib pawg ntawm Cisco 2960X keyboards.

Dell hosts muaj built-in 4-chaw nres nkoj network phaib, yog li ntawd, nws raug nquahu kom npaj lawv cov kev sib txuas rau Cisco 2960X siv qhov kev sib txuas tsis raug cai, siv kev sib koom ua ke ntawm lub cev network chaw nres nkoj rau hauv qhov kev sib txuas lus, thiab LACP raws tu qauv ( 802.3 ib.):

thawj ob qhov chaw nres nkoj ntawm tus tswv tsev tau teeb tsa hauv hom kev sib txuas thiab txuas nrog 2960X hloov - qhov kev sib txuas lus zoo no yuav raug teeb tsa choj nrog rau qhov chaw nyob rau kev tswj hwm tus tswv, saib xyuas, kev sib txuas lus nrog lwm tus tswv hauv pawg oVirt, nws tseem yuav raug siv rau kev tsiv teb tsaws chaw ntawm cov tshuab virtual;
qhov thib ob ob qhov chaw nres nkoj ntawm tus tswv tsev kuj tau teeb tsa hauv kev sib koom ua ke thiab txuas nrog 2960X - ntawm qhov kev sib txuas lus no siv oVirt, txuas hniav yuav raug tsim yav tom ntej (hauv VLANs sib txuas) uas cov tshuab virtual yuav txuas nrog.
ob lub network ports, nyob rau hauv tib lub ntsiab lus interface, yuav ua haujlwm, i.e. tsheb hla lawv tuaj yeem kis tau ib txhij, hauv kev sib npaug.
network teeb tsa ntawm pawg nodes yuav tsum yog tib yam nkaus, tshwj tsis yog IP chaw nyob.

Basic switch stack setup 2960X thiab nws cov chaw nres nkoj

Peb cov keyboards yuav tsum ua ntej:

khib mounted;
txuas ntawm ob lub xov tooj tshwj xeeb ntawm qhov ntev yuav tsum tau, piv txwv li, CAB-STK-E-1M;
txuas nrog fais fab mov;
txuas nrog tus thawj tswj hwm lub chaw ua haujlwm ntawm qhov chaw nres nkoj console rau lawv qhov kev teeb tsa thawj zaug.

Cov lus qhia tsim nyog rau qhov no muaj nyob ntawm hauj lwm nplooj tsim tawm.

Tom qab ua tiav cov kauj ruam saum toj no, peb teeb tsa cov keyboards.
Dab tsi txhua qhov lus txib txhais tau tias tsis yog los txiav txim siab nyob rau hauv lub moj khaum ntawm tsab xov xwm no; yog tias tsim nyog, tag nrho cov ntaub ntawv tuaj yeem pom ntawm nws tus kheej.
Peb lub hom phiaj yog los teeb tsa cov hloov pawg kom sai li sai tau thiab txuas cov tswv thiab kev tswj hwm kev sib txuas rau nws.

1) Txuas mus rau tus tswv hloov pauv, mus rau hom muaj cai, tom qab ntawd mus rau hom kev teeb tsa thiab ua qhov yooj yim teeb tsa.

Basic hloov config:

 enable
 configure terminal

 hostname 2960X

 no service pad
 service timestamps debug datetime msec
 service timestamps log datetime localtime show-timezone msec
 no service password-encryption
 service sequence-numbers

 switch 1 priority 15
 switch 2 priority 14
 stack-mac persistent timer 0

 clock timezone MSK 3
  vtp mode transparent
  ip subnet-zero

 vlan 17
  name Management

 vlan 32
  name PROD 

 vlan 33
  name Interconnect

 vlan 34
  name Test

 vlan 35
  name Dev

 vlan 40
  name Monitoring

 spanning-tree mode rapid-pvst
 spanning-tree etherchannel guard misconfig
 spanning-tree portfast bpduguard default
 spanning-tree extend system-id
 spanning-tree vlan 1-40 root primary
 spanning-tree loopguard default
 vlan internal allocation policy ascending
 port-channel load-balance src-dst-ip

 errdisable recovery cause loopback
 errdisable recovery cause bpduguard
 errdisable recovery interval 60

line con 0
 session-timeout 60
 exec-timeout 60 0
 logging synchronous
line vty 5 15
 session-timeout 60
 exec-timeout 60 0
 logging synchronous

 ip http server
 ip http secure-server
 no vstack

interface Vlan1
 no ip address
 shutdown

 exit

Peb khaws cov config nrog cov lus txib "wr meme"thiab reboot lub hloov pawg nrog cov lus txib"reload» ntawm tus tswv hloov 1.

2) Peb teeb tsa cov chaw nres nkoj hauv lub network ntawm qhov hloov pauv hauv hom nkag hauv VLAN 17, txhawm rau txuas cov kev tswj hwm kev sib txuas ntawm cov tshuab khaws cia thiab iDRAC servers.

Teeb tsa cov chaw tswj xyuas:

interface GigabitEthernet1/0/5
 description iDRAC - host1
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet1/0/6
 description Storage1 - Cntr0/Eth0
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet2/0/5
 description iDRAC - host2
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge

interface GigabitEthernet2/0/6
 description Storage1 – Cntr1/Eth0
 switchport access vlan 17
 switchport mode access
 spanning-tree portfast edge
 exit

3) Tom qab reloading pawg, xyuas tias nws ua haujlwm raug:

Txheeb xyuas qhov ua haujlwm ntawm pawg:

2960X#show switch stack-ring speed

Stack Ring Speed        : 20G
Stack Ring Configuration: Full
Stack Ring Protocol     : FlexStack

2960X#show switch stack-ports
  Switch #    Port 1       Port 2
  --------    ------       ------
    1           Ok           Ok
    2           Ok           Ok

2960X#show switch neighbors
  Switch #    Port 1       Port 2
  --------    ------       ------
      1         2             2
      2         1             1

2960X#show switch detail
Switch/Stack Mac Address : 0cd0.f8e4.ХХХХ
Mac persistency wait time: Indefinite
                                           H/W   Current
Switch#  Role   Mac Address     Priority Version  State
----------------------------------------------------------
*1       Master 0cd0.f8e4.ХХХХ    15     4       Ready
 2       Member 0029.c251.ХХХХ     14     4       Ready

         Stack Port Status             Neighbors
Switch#  Port 1     Port 2           Port 1   Port 2
--------------------------------------------------------
  1        Ok         Ok                2        2
  2        Ok         Ok                1        1

4) Teeb tsa SSH nkag mus rau 2960X pawg

Txhawm rau tswj hwm cov pawg ntawm SSH, peb yuav siv IP 172.20.1.10 teeb tsa rau SVI (hloov virtual interface) VLAN17.

Txawm hais tias nws raug nquahu kom siv qhov chaw tshwj xeeb rau kev hloov pauv rau kev tswj hwm lub hom phiaj, qhov no yog qhov teeb meem ntawm tus kheej nyiam thiab muaj peev xwm.

Configuring SSH nkag mus rau ib pawg ntawm cov keyboards:

ip default-gateway 172.20.1.2

interface vlan 17
 ip address 172.20.1.10 255.255.255.0

hostname 2960X
 ip domain-name hw.home-lab.ru
 no ip domain-lookup

clock set 12:47:04 06 Dec 2019

crypto key generate rsa

ip ssh version 2
ip ssh time-out 90

line vty 0 4
 session-timeout 60
 exec-timeout 60 0
 privilege level 15
 logging synchronous
 transport input ssh

line vty 5 15
 session-timeout 60
 exec-timeout 60 0
 privilege level 15
 logging synchronous
 transport input ssh

aaa new-model
aaa authentication login default local 
username cisco privilege 15 secret my_ssh_password

Teeb tus password kom nkag mus rau hom kev cai lij choj:

enable secret *myenablepassword*
service password-encryption

Kev teeb tsa NTP:

ntp server 85.21.78.8 prefer
ntp server 89.221.207.113
ntp server 185.22.60.71
ntp server 192.36.143.130
ntp server 185.209.85.222

show ntp status
show ntp associations
show clock detail

5) Configure logical Etherchannel interfaces thiab lub cev ports txuas nrog hosts. Txhawm rau kom yooj yim ntawm kev teeb tsa, txhua qhov muaj VLANs yuav qhib rau ntawm txhua qhov kev sib txuas lus, tab sis nws feem ntau pom zoo kom teeb tsa tsuas yog qhov xav tau:

Configuring Etherchannel interfaces:

interface Port-channel1
 description EtherChannel with Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel2
 description EtherChannel with Host2-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel3
 description EtherChannel with Host1-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface Port-channel4
 description EtherChannel with Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 spanning-tree portfast edge trunk

interface GigabitEthernet1/0/1
 description Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 1 mode active

interface GigabitEthernet1/0/2
 description Host2-management
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 2 mode active

interface GigabitEthernet1/0/3
 description Host1-VM
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 3 mode active

interface GigabitEthernet1/0/4
 description Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 4 mode active

interface GigabitEthernet2/0/1
 description Host1-management
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 1 mode active

interface GigabitEthernet2/0/2
 description Host2-management
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 2 mode active

interface GigabitEthernet2/0/3
 description Host1-VM
  switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 3 mode active

interface GigabitEthernet2/0/4
 description Host2-VM
 switchport trunk allowed vlan 10,17,30-40
 switchport mode trunk
 channel-protocol lacp
 channel-group 4 mode active

Thawj qhov kev teeb tsa ntawm lub network interfaces rau cov tshuab virtual ntawm cov tswv Hwm 1 и Hwm 2

Peb txheeb xyuas qhov muaj cov modules tsim nyog rau kev sib txuas ua haujlwm hauv qhov system, nruab ib lub module rau kev tswj cov choj:

modinfo bonding
modinfo 8021q
yum install bridge-utils

Configuring BOND1 logical interface rau virtual machines thiab nws lub cev interfaces ntawm hosts:

cat /etc/sysconfig/network-scripts/ifcfg-bond1
#DESCRIPTION - management
DEVICE=bond1
NAME=bond1
TYPE=Bond
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'

cat /etc/sysconfig/network-scripts/ifcfg-em2
#DESCRIPTION - management
DEVICE=em2
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

cat /etc/sysconfig/network-scripts/ifcfg-em3
#DESCRIPTION - management
DEVICE=em3
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond1
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no

Tom qab ua tiav cov kev teeb tsa ntawm pawg 2960 ib thiab hosts, peb rov pib dua lub network ntawm cov tswv thiab tshawb xyuas qhov kev ua haujlwm ntawm qhov kev sib tham sib cav.

ntawm tus tswv tsev:

systemctl restart network

cat /proc/net/bonding/bond1
Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)

Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2+3 (2)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
...
802.3ad info
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable
System priority: 65535
...
Slave Interface: em2
MII Status: up
Speed: 1000 Mbps
Duplex: full
...
Slave Interface: em3
MII Status: up
Speed: 1000 Mbps
Duplex: full

nyob rau hauv ib tug hloov pawg 2960 ib:

2960X#show lacp internal
Flags:  S - Device is requesting Slow LACPDUs
        F - Device is requesting Fast LACPDUs
        A - Device is in Active mode       P - Device is in Passive mode

Channel group 1
                            LACP port     Admin     Oper    Port        Port
Port      Flags   State     Priority      Key       Key     Number      State
Gi1/0/1   SA      bndl      32768         0x1       0x1     0x102       0x3D
Gi2/0/1   SA      bndl      32768         0x1       0x1     0x202       0x3D

2960X#sh etherchannel summary
Flags:  D - down        P - bundled in port-channel
        I - stand-alone s - suspended
        H - Hot-standby (LACP only)
        R - Layer3      S - Layer2
        U - in use      N - not in use, no aggregation
        f - failed to allocate aggregator

        M - not in use, minimum links not met
        m - not in use, port not aggregated due to minimum links not met
        u - unsuitable for bundling
        w - waiting to be aggregated
        d - default port

        A - formed by Auto LAG

Number of channel-groups in use: 11
Number of aggregators:           11

Group  Port-channel  Protocol    Ports
------+-------------+-----------+-----------------------------------------------
1      Po1(SU)         LACP      Gi1/0/1(P)  Gi2/0/1(P)

Thawj qhov kev teeb tsa ntawm lub network interfaces rau kev tswj hwm cov peev txheej ntawm cov tswv Hwm 1 и Hwm 2

Configuring BOND1 logical interface rau kev tswj thiab nws lub cev interfaces ntawm hosts:

cat /etc/sysconfig/network-scripts/ifcfg-bond0
#DESCRIPTION - management
DEVICE=bond0
NAME=bond0
TYPE=Bond
BONDING_MASTER=yes
IPV6INIT=no
ONBOOT=yes
USERCTL=no
NM_CONTROLLED=no
BOOTPROTO=none
BONDING_OPTS='mode=4 lacp_rate=1 xmit_hash_policy=2'

cat /etc/sysconfig/network-scripts/ifcfg-em0
#DESCRIPTION - management
DEVICE=em0
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no 

cat /etc/sysconfig/network-scripts/ifcfg-em1
#DESCRIPTION - management
DEVICE=em1
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no 
NM_CONTROLLED=no

Tom qab ua tiav cov kev teeb tsa ntawm pawg 2960 ib thiab hosts, peb rov pib dua lub network ntawm cov tswv thiab tshawb xyuas qhov kev ua haujlwm ntawm qhov kev sib tham sib cav.

systemctl restart network
cat /proc/net/bonding/bond1

2960X#show lacp internal
2960X#sh etherchannel summary

Peb configure tswj network interface ntawm txhua tus tswv tsev hauv VLAN 17, thiab khi nws mus rau lub logical interface BOND1:

Configuring VLAN17 ntawm Host1:

cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes 
USERCTL=no 
NM_CONTROLLED=no 
VLAN=yes
MTU=1500  
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.163
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=public

Configuring VLAN17 ntawm Host2:

cat /etc/sysconfig/network-scripts/ifcfg-bond1.17
DEVICE=bond1.17
NAME=bond1-vlan17
BOOTPROTO=none
ONBOOT=yes 
USERCTL=no 
NM_CONTROLLED=no 
VLAN=yes
MTU=1500  
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
IPADDR=172.20.17.164
NETMASK=255.255.255.0
GATEWAY=172.20.17.2
DEFROUTE=yes
DNS1=172.20.17.8
DNS2=172.20.17.9
ZONE=public

Peb rov pib lub network ntawm cov tswv thiab xyuas lawv qhov pom kev rau ib leeg.

Qhov no ua kom tiav cov teeb tsa ntawm pawg ntawm Cisco 2960X keyboards, thiab yog tias txhua yam ua tiav, ces tam sim no peb muaj kev sib txuas hauv network ntawm tag nrho cov txheej txheem rau ib leeg ntawm qib L2.

Teeb tsa Dell MD3820f cia qhov system

Ua ntej pib ua haujlwm ntawm kev teeb tsa lub kaw lus cia, nws yuav tsum tau txuas nrog ib pawg ntawm Cisco keyboards 2960 ib tswj interfaces, nrog rau cov tswv Hwm 1 и Hwm 2 via FC.

Daim duab dav dav ntawm yuav ua li cas khaws cov tshuab yuav tsum txuas nrog ib pawg ntawm cov keyboards tau muab rau hauv tshooj dhau los.

Daim duab rau kev sib txuas ntawm qhov system cia ntawm FC rau cov tswv yuav tsum zoo li no:

Thaum lub sij hawm kev sib txuas, koj yuav tsum tau sau cov WWPN chaw nyob rau FC HBA hosts txuas nrog FC cov chaw nres nkoj ntawm lub kaw lus cia - qhov no yuav tsim nyog rau tom qab teeb tsa kev sib txuas ntawm cov tswv rau LUNs ntawm lub kaw lus cia.

Ntawm tus thawj tswj hwm lub chaw ua haujlwm, rub tawm thiab nruab qhov hluav taws xob rau kev tswj hwm Dell MD3820f qhov system cia - PowerVault Modular Disk Storage Manager (MDSM).
Peb txuas rau nws los ntawm nws qhov chaw nyob IP chaw nyob, thiab tom qab ntawd teeb tsa peb qhov chaw nyob los ntawm VLAN17, tswj cov tswj ntawm TCP / IP:

Cia1:

ControllerA IP - 172.20.1.13, MASK - 255.255.255.0, Gateway - 172.20.1.2
ControllerB IP - 172.20.1.14, MASK - 255.255.255.0, Gateway - 172.20.1.2

Tom qab teeb tsa qhov chaw nyob, mus rau qhov chaw tswj hwm kev tswj hwm thiab teeb tsa tus password, teem sijhawm, hloov kho lub firmware rau cov tswj hwm thiab disks, yog tias tsim nyog, thiab lwm yam.
Yuav ua li cas qhov no ua tau yog piav nyob rau hauv phau ntawv qhia kev tswj hwm Cia qhov system

Tom qab ua tiav cov kev teeb tsa saum toj no, peb tsuas yog yuav tsum ua ob peb kauj ruam:

Configure host FC chaw nres nkoj IDs - Host Port Identifiers.
Tsim ib pab pawg tswv tsev – Host pawg thiab ntxiv ob peb Dell hosts rau nws.
Tsim ib pawg disk thiab virtual disks (lossis LUNs) hauv nws uas yuav nthuav tawm rau cov tswv.
Kho qhov kev nthuav qhia ntawm virtual disks (lossis LUNs) rau cov tswv.

Ntxiv cov tswv tshiab thiab khi tus tswv tsev FC chaw nres nkoj rau lawv yog ua tiav los ntawm cov ntawv qhia zaub mov - Host Mappings -> Txhais -> Tus tswv…
WWPN chaw nyob ntawm FC HBA hosts tuaj yeem pom, piv txwv li, hauv iDRAC servers.

Yog li ntawd, peb yuav tsum tau ib yam dab tsi zoo li no:

Ntxiv ib pab pawg tshiab ntawm cov tswv thiab khi cov tswv rau nws yog ua tiav los ntawm cov ntawv qhia zaub mov - Host Mappings -> Txhais -> Host Group…
Rau cov tswv, xaiv hom OS - Linux (DM-MP).

Tom qab tsim ib pawg tswv tsev, dhau ntawm tab Kev Pabcuam Cia & Luam, tsim ib pawg disk - Disk Group, nrog ib hom nyob ntawm qhov yuav tsum tau ua txhaum cai, piv txwv li, RAID10, thiab hauv nws virtual disks ntawm qhov xav tau loj:

Thiab thaum kawg, theem kawg yog qhov kev nthuav qhia ntawm virtual disks (lossis LUNs) rau cov tswv.
Txhawm rau ua qhov no, los ntawm cov ntawv qhia zaub mov - Host Mappings -> Lub hli map -> Ntxiv… Peb koom nrog virtual disks nrog cov tswv los ntawm kev muab cov lej rau lawv.

Txhua yam yuav tsum zoo li no screenshot:

Qhov no yog qhov uas peb ua tiav kev teeb tsa lub kaw lus cia, thiab yog tias txhua yam ua tiav, ces cov tswv tsev yuav tsum pom LUNs qhia rau lawv los ntawm lawv FC HBA.
Cia peb yuam kom lub kaw lus hloov kho cov ntaub ntawv hais txog kev txuas nrog disks:

ls -la /sys/class/scsi_host/
echo "- - -" > /sys/class/scsi_host/host[0-9]/scan

Cia peb pom cov khoom siv twg pom ntawm peb cov servers:

cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 02 Id: 00 Lun: 00
  Vendor: DELL     Model: PERC H330 Mini   Rev: 4.29
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 00
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 01
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 04
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 11
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi15 Channel: 00 Id: 00 Lun: 31
  Vendor: DELL     Model: Universal Xport  Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 00
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 01
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 04
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 11
  Vendor: DELL     Model: MD38xxf          Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05
Host: scsi18 Channel: 00 Id: 00 Lun: 31
  Vendor: DELL     Model: Universal Xport  Rev: 0825
  Type:   Direct-Access                    ANSI  SCSI revision: 05

lsscsi
[0:2:0:0]    disk    DELL     PERC H330 Mini   4.29  /dev/sda
[15:0:0:0]   disk    DELL     MD38xxf          0825  -
[15:0:0:1]   disk    DELL     MD38xxf          0825  /dev/sdb
[15:0:0:4]   disk    DELL     MD38xxf          0825  /dev/sdc
[15:0:0:11]  disk    DELL     MD38xxf          0825  /dev/sdd
[15:0:0:31]  disk    DELL     Universal Xport  0825  -
 [18:0:0:0]   disk    DELL     MD38xxf          0825  -
[18:0:0:1]   disk    DELL     MD38xxf          0825  /dev/sdi
[18:0:0:4]   disk    DELL     MD38xxf          0825  /dev/sdj
[18:0:0:11]  disk    DELL     MD38xxf          0825  /dev/sdk
[18:0:0:31]  disk    DELL     Universal Xport  0825  -

Ntawm hosts koj tuaj yeem ntxiv teeb tsa multipath, thiab txawm hais tias thaum txhim kho oVirt nws tuaj yeem ua qhov no nws tus kheej, nws yog qhov zoo dua los xyuas qhov tseeb ntawm MP ua ntej koj tus kheej.

Installation thiab configuration ntawm DM Multipath

yum install device-mapper-multipath
mpathconf --enable --user_friendly_names y

cat /etc/multipath.conf | egrep -v "^s*(#|$)"
defaults {
    user_friendly_names yes
            find_multipaths yes
}

blacklist {
  wwid 26353900f02796769
  devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"     
  devnode "^hd[a-z]"
 }

Teem MP cov kev pabcuam rau autostart thiab tso nws:

systemctl enable multipathd && systemctl restart multipathd

Xyuas cov ntaub ntawv hais txog loaded modules rau MP ua haujlwm:

lsmod | grep dm_multipath
dm_multipath           27792  6 dm_service_time
dm_mod                124407  139 dm_multipath,dm_log,dm_mirror

modinfo dm_multipath
filename:       /lib/modules/3.10.0-957.12.2.el7.x86_64/kernel/drivers/md/dm-multipath.ko.xz
license:        GPL
author:         Sistina Software <[email protected]>
description:    device-mapper multipath target
retpoline:      Y
rhelversion:    7.6
srcversion:     985A03DCAF053D4910E53EE
depends:        dm-mod
intree:         Y
vermagic:       3.10.0-957.12.2.el7.x86_64 SMP mod_unload modversions
signer:         CentOS Linux kernel signing key
sig_key:        A3:2D:39:46:F2:D3:58:EA:52:30:1F:63:37:8A:37:A5:54:03:00:45
sig_hashalgo:   sha256

Cia peb saib cov ntsiab lus ntawm cov txheej txheem multipath uas twb muaj lawm:

mpathconf
multipath is enabled
find_multipaths is disabled
user_friendly_names is disabled
dm_multipath module is loaded
multipathd is running

Tom qab ntxiv LUN tshiab rau lub kaw lus cia thiab nthuav tawm rau tus tswv tsev, koj yuav tsum luam theej duab HBAs txuas nrog tus tswv ntawm nws.

systemctl reload multipathd
multipath -v2

Thiab thaum kawg, peb xyuas seb tag nrho cov LUNs tau nthuav tawm ntawm qhov chaw cia rau cov tswv, thiab seb puas muaj ob txoj hauv kev rau tag nrho lawv.

Txheeb xyuas MP kev ua haujlwm:

multipath -ll
3600a098000e4b4b3000003175cec1840 dm-2 DELL    ,MD38xxf
size=2.0T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:1  sdb 8:16  active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 18:0:0:1  sdi 8:128 active ready running
3600a098000e4b48f000002ab5cec1921 dm-6 DELL    ,MD38xxf
size=10T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 18:0:0:11 sdk 8:160 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 15:0:0:11 sdd 8:48  active ready running
3600a098000e4b4b3000003c95d171065 dm-3 DELL    ,MD38xxf
size=150G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:4  sdc 8:32  active ready running
`-+- policy='service-time 0' prio=9 status=enabled
  `- 18:0:0:4  sdj 8:144 active ready running

Raws li koj tuaj yeem pom, tag nrho peb lub virtual disks ntawm lub kaw lus cia pom nyob ntawm ob txoj hauv kev. Yog li, tag nrho cov kev npaj ua haujlwm tau ua tiav, uas txhais tau tias koj tuaj yeem mus rau qhov tseem ceeb - teeb tsa oVirt pawg, uas yuav tau tham hauv tsab xov xwm tom ntej.

Tau qhov twg los: www.hab.com

Tsim ib qho txhaum-tolerant IT infrastructure. Ntu 1 - npaj siv oVirt 4.3 pawg

Taw qhia

Ntu 1. Npaj siv oVirt 4.3 pawg

Basic host teeb

Configuring Cisco 2960X Switch Stack

Teeb tsa Dell MD3820f cia qhov system

Ntxiv ib saib Отменить ответ