Qhov no yog ib qho lus dab neeg uas muaj ntau heev hauv thaj chaw ntawm server hardware. Hauv kev xyaum, cov kev daws teeb meem hyperconverged (thaum txhua yam nyob hauv ib qho) xav tau rau ntau yam. Keeb kwm, thawj architectures tau tsim los ntawm Amazon thiab Google rau lawv cov kev pabcuam. Tom qab ntawd lub tswv yim yog los ua ib qho kev ua liaj ua teb los ntawm cov nodes tib yam, txhua tus muaj nws tus kheej disks. Tag nrho cov no tau koom ua ke los ntawm qee qhov system-forming software (hypervisor) thiab tau muab faib ua cov tshuab virtual. Lub hom phiaj tseem ceeb yog qhov tsawg kawg ntawm kev siv zog rau kev pabcuam ib qho thiab qhov tsawg kawg ntawm cov teeb meem thaum ntsuas qhov ntsuas: tsuas yog yuav lwm txhiab lossis ob ntawm tib lub servers thiab txuas lawv nyob ze. Hauv kev xyaum, cov no yog cov xwm txheej sib cais, thiab ntau zaus peb tab tom tham txog ib qho me me ntawm cov nodes thiab ib qho kev sib txawv me ntsis.
Nws hloov tawm tias koj them 10-15% ntau dua rau kev teeb tsa yooj yim. Qhov no yog dab tsi sparked myths xwb nyob rau hauv lub npe. Peb tau siv sijhawm ntev los nrhiav qhov twg thev naus laus zis yuav siv tau zoo, thiab peb pom nws. Qhov tseeb yog tias Cisco tsis muaj nws tus kheej khaws cia, tab sis lawv xav tau kev ua lag luam ua tiav. Thiab lawv tau ua Cisco Hyperflex - ib qho kev daws teeb meem nrog kev cia hauv zos ntawm cov nodes.
Thiab qhov no mam li nco dheev dhau los ua ib qho kev daws teeb meem zoo heev rau cov chaw khaws ntaub ntawv thaub qab (Kev puas tsuaj rov qab). Kuv yuav qhia koj vim li cas thiab tam sim no. Thiab kuv mam li qhia koj cov kev xeem pawg.
Qhov twg xav tau
Hyperconvergence yog:
Hloov cov disks rau suav cov nodes.
Tag nrho kev koom ua ke ntawm lub chaw cia khoom nrog lub virtualization subsystem.
Hloov / kev koom ua ke nrog lub network subsystem.
Qhov kev sib xyaw ua ke no tso cai rau koj los siv ntau lub kaw lus khaws cia ntawm qib virtualization thiab tag nrho los ntawm ib lub qhov rais tswj.
Nyob rau hauv peb lub tuam txhab, tej yaam num los tsim redundant cov ntaub ntawv chaw zov me nyuam yog xav tau heev, thiab ib tug hyperconverged tov yog feem ntau xaiv vim ib pawg ntawm replication xaiv (mus txog ib tug metrocluster) tawm ntawm lub thawv.
Nyob rau hauv cov ntaub ntawv ntawm backup cov ntaub ntawv chaw, peb feem ntau yog tham txog ib tug tej thaj chaw deb chaw nyob rau hauv ib qhov chaw nyob rau sab nraud ntawm lub nroog los yog nyob rau hauv lwm lub nroog tag nrho. Nws tso cai rau koj los kho cov txheej txheem tseem ceeb hauv qhov xwm txheej ntawm ib feem lossis ua tiav qhov tsis ua tiav ntawm cov ntaub ntawv tseem ceeb. Cov ntaub ntawv muag khoom tau rov ua dua tas li, thiab qhov kev rov ua dua no tuaj yeem nyob rau ntawm daim ntawv thov lossis ntawm cov cuab yeej thaiv (kho) qib.
Yog li ntawd, tam sim no kuv yuav tham txog cov qauv tsim thiab kev sim, thiab tom qab ntawd hais txog ob peb lub neej tiag tiag daim ntawv thov scenarios nrog cov ntaub ntawv txuag.
Kev sim
Peb qhov piv txwv muaj plaub lub servers, txhua tus muaj 10 SSD drives ntawm 960 GB. Nws muaj ib tug tshwj xeeb disk rau caching sau ua hauj lwm thiab khaws cia cov kev pab cuam virtual tshuab. Kev daws nws tus kheej yog plaub version. Thawj yog qhov tsis ncaj ncees lawm (kev txiav txim los ntawm kev tshuaj xyuas), qhov thib ob yog damp, qhov thib peb yog qhov ruaj khov heev, thiab qhov no tuaj yeem raug hu ua kev tso tawm tom qab kawg ntawm kev sim beta rau cov pej xeem. Thaum kuaj kuv tsis pom muaj teeb meem, txhua yam ua haujlwm zoo li lub moos.
Hloov hauv v4Ib pawg kab mob tau kho.
Thaum pib, lub platform tsuas tuaj yeem ua haujlwm nrog VMware ESXi hypervisor thiab txhawb nqa qee qhov ntawm cov nodes. Tsis tas li ntawd, cov txheej txheem xa tawm tsis tas yuav ua tiav tiav, qee cov kauj ruam yuav tsum tau rov pib dua, muaj teeb meem nrog kev hloov kho tshiab los ntawm cov ntawv qub, cov ntaub ntawv hauv GUI tsis yog ib txwm tso tawm kom raug (txawm hais tias kuv tseem tsis txaus siab rau cov duab ua haujlwm. ), qee zaum teeb meem tshwm sim ntawm lub interface nrog virtualization .
Tam sim no tag nrho cov teeb meem me nyuam yaus tau raug kho, HyperFlex tuaj yeem daws ob qho tib si ESXi thiab Hyper-V, ntxiv rau nws muaj peev xwm:
Tsim ib pawg stretched.
Tsim ib pawg rau cov chaw ua haujlwm yam tsis siv Fabric Interconnect, los ntawm ob mus rau plaub ntawm (peb yuav tsuas yog servers).
Muaj peev xwm ua haujlwm nrog cov khoom siv sab nraud.
Kev them nyiaj yug rau ntim thiab Kubernetes.
Tsim cov cheeb tsam muaj.
Kev koom ua ke nrog VMware SRM yog qhov ua haujlwm ua haujlwm tsis txaus siab.
Lub architecture tsis txawv ntau ntawm cov kev daws teeb meem ntawm nws cov neeg sib tw tseem ceeb; lawv tsis tau tsim lub tsheb kauj vab. Nws txhua tus khiav ntawm VMware lossis Hyper-V virtualization platform. Lub hardware yog hosted ntawm tus tswv Cisco UCS servers. Muaj cov neeg uas ntxub lub platform rau cov txheeb ze tsis yooj yim ntawm kev teeb tsa thawj zaug, ntau cov nyees khawm, cov txheej txheem tsis tseem ceeb ntawm cov qauv thiab kev vam khom, tab sis kuj tseem muaj cov neeg uas tau kawm Zen, tau txais kev tshoov siab los ntawm lub tswv yim thiab tsis xav tau. ua haujlwm nrog lwm cov servers.
Peb yuav txiav txim siab txog kev daws teeb meem rau VMware, txij li cov kev daws teeb meem yog tsim los rau nws thiab muaj kev ua haujlwm ntau dua; Hyper-V tau ntxiv rau txoj hauv kev txhawm rau txhawm rau khaws cov neeg sib tw thiab ua tau raws li kev xav tau ntawm kev ua lag luam.
Muaj ib pawg ntawm servers puv ntawm disks. Muaj cov disks rau cov ntaub ntawv khaws cia (SSD lossis HDD - raws li koj nyiam thiab xav tau), muaj ib qho SSD disk rau caching. Thaum sau cov ntaub ntawv mus rau lub chaw khaws ntaub ntawv, cov ntaub ntawv tau txais kev cawmdim ntawm cov txheej txheem caching (dawb SSD disk thiab RAM ntawm qhov kev pabcuam VM). Nyob rau hauv parallel, ib qho thaiv ntawm cov ntaub ntawv raug xa mus rau cov nodes hauv pawg (tus naj npawb ntawm cov nodes nyob ntawm qhov sib txuas ntawm pawg). Tom qab kev pom zoo los ntawm tag nrho cov nodes txog kev ua tiav cov ntaub ntawv, kev lees paub ntawm cov ntaub ntawv raug xa mus rau lub hypervisor thiab tom qab ntawd mus rau VM. Cov ntaub ntawv kaw tseg yog deduplicated, compressed thiab sau rau cia disks hauv keeb kwm yav dhau. Nyob rau tib lub sij hawm, ib tug loj thaiv yog ib txwm sau rau lub cia disks thiab sequentially, uas txo cov load ntawm lub cia disks.
Deduplication thiab compression yeej ib txwm qhib thiab tsis tuaj yeem ua tsis taus. Cov ntaub ntawv yog nyeem ncaj qha los ntawm kev cia disks lossis los ntawm RAM cache. Yog tias siv hybrid configuration, cov ntawv nyeem kuj tseem cached ntawm SSD.
Cov ntaub ntawv tsis khi rau qhov chaw tam sim no ntawm lub tshuab virtual thiab muab faib sib npaug ntawm cov nodes. Txoj hauv kev no tso cai rau koj los thauj tag nrho cov disks thiab network interfaces sib npaug. Nws muaj qhov tsis zoo: peb tsis tuaj yeem txo qhov nyeem latency ntau li ntau tau, vim tias tsis muaj kev lees paub ntawm cov ntaub ntawv muaj nyob hauv zos. Tab sis kuv ntseeg tias qhov no yog kev txi me me piv rau cov txiaj ntsig tau txais. Ntxiv mus, network qeeb tau mus txog qhov tseem ceeb uas lawv xyaum tsis cuam tshuam rau tag nrho cov txiaj ntsig.
Ib qho kev pabcuam tshwj xeeb VM Cisco HyperFlex Data Platform controller, uas yog tsim los ntawm txhua qhov chaw khaws cia, yog lub luag haujlwm rau tag nrho cov haujlwm logic ntawm disk subsystem. Hauv peb qhov kev pabcuam VM teeb tsa, yim vCPUs thiab 72 GB ntawm RAM tau faib, uas tsis yog tsawg. Cia kuv ceeb toom koj tias tus tswv tsev nws tus kheej muaj 28 lub cev cores thiab 512 GB ntawm RAM.
Cov kev pabcuam VM tau nkag mus rau lub cev disks ncaj qha los ntawm kev xa mus rau SAS maub los rau VM. Kev sib txuas lus nrog tus hypervisor tshwm sim los ntawm ib qho tshwj xeeb module IOVisor, uas cuam tshuam cov haujlwm I / O, thiab siv tus neeg sawv cev uas tso cai rau koj xa cov lus txib mus rau hypervisor API. Tus neeg sawv cev yog lub luag haujlwm rau kev ua haujlwm nrog HyperFlex snapshots thiab clones.
Disk cov kev pab cuam yog mounted nyob rau hauv lub hypervisor li NFS los yog SMB shares (nyob ntawm seb hom hypervisor, twv seb qhov twg yog qhov twg). Thiab nyob rau hauv lub hood, qhov no yog ib tug faib cov ntaub ntawv system uas tso cai rau koj mus ntxiv nta ntawm cov neeg laus tag nrho-fledged cia systems: nyias ntim faib, compression thiab deduplication, snapshots siv Redirect-on-Sau tshuab, synchronous / asynchronous replication.
Cov kev pabcuam VM muab kev nkag mus rau WEB kev tswj hwm interface ntawm HyperFlex subsystem. Muaj kev koom ua ke nrog vCenter, thiab feem ntau cov haujlwm niaj hnub tuaj yeem ua tau los ntawm nws, tab sis cov chaw khaws ntaub ntawv, piv txwv li, yooj yim dua los txiav los ntawm ib lub webcam cais yog tias koj twb tau hloov mus rau qhov nrawm HTML5 interface, lossis siv tus neeg siv khoom Flash puv. nrog kev koom ua ke tag nrho. Hauv kev pabcuam webcam koj tuaj yeem saib cov kev ua tau zoo thiab cov ncauj lus kom ntxaws ntawm qhov system.
Muaj lwm hom ntawm node nyob rau hauv ib pawg - xam cov nodes. Cov no tuaj yeem yog khib lossis blade servers yam tsis muaj cov disks built-in. Cov servers no tuaj yeem khiav VMs uas nws cov ntaub ntawv khaws cia ntawm cov servers nrog disks. Los ntawm qhov pom ntawm kev nkag mus rau cov ntaub ntawv, tsis muaj qhov sib txawv ntawm cov hom ntawm cov nodes, vim hais tias cov architecture cuam tshuam nrog abstraction los ntawm lub cev qhov chaw ntawm cov ntaub ntawv. Qhov siab tshaj plaws piv ntawm cov nodes rau khaws cia nodes yog 2: 1.
Siv cov lej suav ua kom yooj yim dua thaum ntsuas cov peev txheej pawg: peb tsis tas yuav yuav cov nodes ntxiv nrog cov disks yog tias peb tsuas xav tau CPU / RAM. Tsis tas li ntawd, peb tuaj yeem ntxiv cov hniav tawb thiab txuag ntawm kev tso chaw khib ntawm cov servers.
Yog li ntawd, peb muaj lub platform hyperconverged nrog cov yam ntxwv hauv qab no:
HX-SD400G12TX-EP 400GB 2.5 nti Ent. Perf. 12G SAS SSD (10X endurance) SAS 400 GB.
HX-SD800GBENK9* * 800GB 2.5 nti Ent. Perf. 12G SAS SED SSD (10X endurance) SAS 800 GB.
HX-SD16T123X-EP 1.6TB 2.5 nti Enterprise kev ua tau zoo 12G SAS SSD (3X endurance).
System/Log Drives
HX-SD240GM1X-EV 240GB 2.5 nti Enterprise Tus nqi 6G SATA SSD (Yuav tsum tau hloov kho).
Boot Drives
HX-M2-240GB 240GB SATA M.2 SSD SATA 240 GB.
Txuas mus rau lub network ntawm 40G, 25G lossis 10G Ethernet ports.
FI tuaj yeem yog HX-FI-6332 (40G), HX-FI-6332-16UP (40G), HX-FI-6454 (40G/100G).
Kev kuaj nws tus kheej
Txhawm rau kuaj lub disk subsystem, kuv siv HCIBench 2.2.1. Qhov no yog ib qho khoom siv pub dawb uas tso cai rau koj los tsim cov khoom siv los ntawm ntau lub tshuab virtual. Lub load nws tus kheej yog generated los ntawm ib txwm fio.
Peb pawg muaj plaub qhov, qhov rov ua dua 3, tag nrho cov disks yog Flash.
Rau kev sim, kuv tsim plaub lub khw muag khoom thiab yim lub tshuab virtual. Rau kev sau ntawv, nws xav tias lub caching disk tsis puv.
Cov txiaj ntsig kev xeem yog raws li nram no:
100% Nyeem 100% Random
0% Nyeem 100% Random
Thaiv / kab qhov tob
128
256
512
1024
2048
128
256
512
1024
2048
4K
0,59 ms 213804 IAB
0,84 ms 303540 IAB
1,36ms 374348 IAB
2.47 ms 414116 IAB
4,86ms 420180 IAB
2,22 ms 57408 IAB
3,09 ms 82744 IAB
5,02 ms 101824 IPOS
8,75 ms 116912 IAB
17,2 ms 118592 IAB
8K
0,67 ms 188416 IAB
0,93 ms 273280 IAB
1,7 ms 299932 IAB
2,72 ms 376,484 IAB
5,47 ms 373,176 IAB
3,1 ms 41148 IAB
4,7 ms 54396 IAB
7,09 ms 72192 IAB
12,77 ms 80132 IAB
16K
0,77 ms 164116 IAB
1,12 ms 228328 IAB
1,9 ms 268140 IAB
3,96 ms 258480 IAB
3,8 ms 33640 IAB
6,97 ms 36696 IAB
11,35 ms 45060 IAB
32K
1,07 ms 119292 IAB
1,79 ms 142888 IAB
3,56 ms 143760 IAB
7,17 ms 17810 IAB
11,96 ms 21396 IAB
64K
1,84 ms 69440 IAB
3,6 ms 71008 IAB
7,26 ms 70404 IAB
11,37 ms 11248 IAB
Bold qhia qhov tseem ceeb tom qab uas tsis muaj qhov nce hauv kev tsim khoom, qee zaum txawm tias degradation pom. Qhov no yog vim qhov tseeb tias peb raug txwv los ntawm kev ua haujlwm ntawm lub network / controllers / disks.
Sequential nyeem 4432 MB/s.
Sequential sau 804 MB/s.
Yog tias ib tus maub los ua tsis tiav (tsis ua haujlwm ntawm lub tshuab virtual lossis tus tswv), qhov kev ua haujlwm poob yog ob npaug.
Yog tias qhov chaw khaws cia tsis ua haujlwm, qhov kev poob qis yog 1/3. Disk rebuild siv 5% ntawm cov peev txheej ntawm txhua tus tswj hwm.
Ntawm qhov thaiv me me, peb raug txwv los ntawm kev ua haujlwm ntawm tus maub los (lub tshuab virtual), nws cov CPU tau thauj khoom ntawm 100%, thiab thaum lub block nce, peb raug txwv los ntawm qhov chaw nres nkoj bandwidth. 10 Gbps tsis txaus los qhib lub peev xwm ntawm AllFlash system. Hmoov tsis zoo, cov kev txwv ntawm qhov muab tso rau demo tsis tso cai rau peb sim ua haujlwm ntawm 40 Gbit / s.
Hauv kuv qhov kev xav los ntawm kev ntsuam xyuas thiab kawm txog kev tsim vaj tsev, vim yog lub algorithm uas tso cov ntaub ntawv ntawm txhua tus tswv, peb tau txais qhov ntsuas tau, kev ua haujlwm tau zoo, tab sis qhov no kuj yog qhov kev txwv thaum nyeem ntawv, vim tias nws yuav muaj peev xwm nyem tawm ntau ntawm cov disks hauv zos, ntawm no nws yuav txuag tau lub network tsim tau ntau dua, piv txwv li, FI ntawm 40 Gbit / s muaj.
Tsis tas li ntawd, ib qho disk rau caching thiab deduplication tej zaum yuav muaj kev txwv; qhov tseeb, hauv qhov kev sim no peb tuaj yeem sau rau plaub SSD disks. Nws yuav zoo heev kom muaj peev xwm nce tus naj npawb ntawm caching drives thiab pom qhov txawv.
Kev siv tiag
Txhawm rau teeb tsa lub chaw khaws ntaub ntawv thaub qab, koj tuaj yeem siv ob txoj hauv kev (peb tsis xav muab qhov thaub qab ntawm qhov chaw nyob deb):
Active-Passive. Txhua daim ntawv thov raug tuav hauv qhov chaw tseem ceeb ntawm cov ntaub ntawv. Replication yog synchronous lossis asynchronous. Yog tias qhov chaw tseem ceeb ntawm cov ntaub ntawv tsis ua haujlwm, peb yuav tsum qhib lub thaub qab. Qhov no tuaj yeem ua tiav manually / scripts / orchestration applications. Ntawm no peb yuav tau txais ib qho RPO commensurate nrog lub replication zaus, thiab RTO nyob ntawm cov tshuaj tiv thaiv thiab kev txawj ntse ntawm tus thawj tswj hwm thiab qhov zoo ntawm kev txhim kho / debugging ntawm kev hloov txoj kev npaj.
Thaum siv Cisco HyperFlex, cov qauv hauv qab no tau txais:
Rau HyperFlex, Kuv siv servers nrog cov peev txheej CPU / RAM loj, vim tias ... Qee qhov kev pabcuam yuav mus rau HyperFlex maub los VM; hais txog CPU thiab lub cim xeeb, Kuv txawm rov teeb tsa HyperFlex kev teeb tsa me ntsis kom tsis txhob ua si nrog Cisco thiab lav cov peev txheej rau VMs ntxiv. Tab sis peb tuaj yeem tso tseg FibreChannel keyboards, thiab peb yuav tsis xav tau Ethernet chaw nres nkoj rau txhua tus neeg rau zaub mov; kev khiav tsheb hauv zos tau hloov pauv hauv FI.
Qhov tshwm sim yog qhov teeb tsa hauv qab no rau txhua qhov chaw khaws ntaub ntawv:
Cov servers
8 x 1U Server (384 GB RAM, 2 x Intel Kub 6132, FC HBA)
8 x HX240C-M5L (512 GB RAM, 2 x Intel Kub 6150, 3,2 GB SSD, 10 x 6 TB NL-SAS)
SHD
Hybrid cia system nrog FC Front-End (20TB SSD, 130 TB NL-SAS)
-
LAN
2 x Ethernet hloov 10G 12 chaw nres nkoj
-
SAN
2 x FC hloov 32/16Gb 24 chaw nres nkoj
2 x Cisco UCS FI 6332
Daim ntawv tso cai
VMware Ent Plus
Replication thiab/los yog orchestration ntawm VM switching
VMware Ent Plus
Kuv tsis tau muab daim ntawv tso cai rov ua dua software rau Hyperflex, vim qhov no muaj tawm ntawm lub thawv rau peb.
Rau classical architecture, kuv xaiv tus neeg muag khoom uas tau tsim nws tus kheej ua cov chaw tsim khoom zoo thiab pheej yig. Rau ob qho kev xaiv, kuv siv tus qauv luv nqi rau ib qho kev daws teeb meem, thiab vim li ntawd kuv tau txais tus nqi tiag.
Cisco HyperFlex daws tau los ua 13% pheej yig dua.
Scenario 2: tsim ntawm ob lub chaw ua haujlwm cov ntaub ntawv. Hauv qhov xwm txheej no, peb tab tom tsim cov pawg txuas ntxiv ntawm VMware.
Cov qauv qub muaj xws li virtualization servers, SAN (FC raws tu qauv) thiab ob lub tshuab cia uas tuaj yeem nyeem thiab sau rau qhov ntim ntawm lawv. Ntawm txhua qhov system cia peb muab lub peev xwm muaj txiaj ntsig rau kev khaws cia.