Kab lus no tau sau los pab koj xaiv txoj kev daws teeb meem rau koj tus kheej thiab nkag siab qhov sib txawv ntawm SDS xws li Gluster, Ceph thiab Vstorage (Virtuozzo).
Cov ntawv nyeem siv cov ntawv txuas mus rau cov ntawv nrog cov ncauj lus kom ntxaws txog qee qhov teeb meem, yog li cov lus piav qhia yuav luv li sai tau, siv cov ntsiab lus tseem ceeb yam tsis muaj qhov tsis tsim nyog fluff thiab cov ntaub ntawv qhia uas koj tuaj yeem ua tau, yog tias koj xav tau, ntawm nws tus kheej tau txais hauv Is Taws Nem.
Qhov tseeb, tau kawg, cov ntsiab lus tau tsa yuav tsum muaj lub suab ntawm cov ntawv nyeem, tab sis nyob rau hauv lub ntiaj teb niaj hnub no ntau thiab ntau tus neeg tsis nyiam nyeem ntau heev))), yog li koj tuaj yeem nyeem sai thiab xaiv, thiab yog tias muaj qee yam. tsis meej, ua raws li cov kev txuas lossis google cov lus tsis meej))), thiab tsab xov xwm no zoo li pob tshab qhwv rau cov ncauj lus sib sib zog nqus, uas qhia txog kev sau - cov ntsiab lus tseem ceeb ntawm txhua qhov kev txiav txim siab.
Dab ntsej
Cia peb pib nrog Gluster, uas nquag siv los ntawm cov chaw tsim khoom ntawm hyperconverged platforms nrog SDS raws li qhib qhov chaw rau virtual ib puag ncig thiab tuaj yeem pom ntawm RedHat lub vev xaib hauv seem cia, qhov chaw koj tuaj yeem xaiv los ntawm ob txoj kev xaiv SDS: Gluster lossis Ceph.
Gluster muaj ib pawg ntawm cov neeg txhais lus - cov kev pabcuam uas ua txhua yam haujlwm ntawm kev faib cov ntaub ntawv, thiab lwm yam. Cib yog ib qho kev pabcuam uas pabcuam ib lub disk, Volume yog ib lub ntim (pool) uas sib sau cov cib no. Tom ntej no los txog kev pabcuam rau kev faib cov ntaub ntawv rau hauv pab pawg siv DHT (distributed hash table) muaj nuj nqi. Peb yuav tsis suav nrog Sharding kev pabcuam hauv cov lus piav qhia vim tias cov kev sib txuas hauv qab no yuav piav qhia txog cov teeb meem cuam tshuam nrog nws.
Thaum sau ntawv, tag nrho cov ntaub ntawv khaws cia hauv cib thiab nws daim ntawv luam ib txhij sau rau cib ntawm ob lub server. Tom ntej no, cov ntaub ntawv thib ob yuav raug sau rau pawg thib ob ntawm ob lub cib (lossis ntau dua) ntawm cov servers sib txawv.
Yog tias cov ntaub ntawv muaj kwv yees li qhov loj me thiab qhov ntim tsuas yog muaj ib pawg, ces txhua yam zoo, tab sis nyob rau hauv lwm yam teeb meem hauv qab no yuav tshwm sim los ntawm cov lus piav qhia:
- qhov chaw nyob rau hauv pab pawg yog siv tsis sib npaug, nws nyob ntawm qhov loj ntawm cov ntaub ntawv thiab yog tias tsis muaj qhov chaw txaus hauv pab pawg los sau cov ntaub ntawv, koj yuav tau txais qhov yuam kev, cov ntaub ntawv yuav tsis raug sau thiab yuav tsis muab faib rau lwm pab pawg. ;
- thaum sau ib cov ntaub ntawv, IO tsuas yog mus rau ib pawg, tus so tsis ua haujlwm;
- koj tsis tuaj yeem tau txais IO ntawm tag nrho ntim thaum sau ib cov ntaub ntawv;
- thiab lub tswv yim dav dav zoo li tsis tshua muaj txiaj ntsig vim tsis muaj cov ntaub ntawv faib rau hauv cov blocks, qhov twg nws yooj yim dua los sib npaug thiab daws qhov teeb meem ntawm kev faib tawm tsis sib xws, thiab tsis yog li tam sim no tag nrho cov ntaub ntawv nkag mus rau hauv ib qho thaiv.
Los ntawm cov lus piav qhia peb kuj tsis tuaj yeem nkag siab tias gluster ua haujlwm raws li cov ntaub ntawv khaws cia rau saum cov khoom siv kho vajtse RAID. Muaj kev txhim kho kev sim txiav (Sharding) cov ntaub ntawv rau hauv cov blocks, tab sis tag nrho qhov no yog ib qho ntxiv uas ua rau muaj kev poob qis ntawm cov kev tsim vaj tsev uas twb muaj lawm, ntxiv rau kev siv cov khoom sib faib dawb dawb nrog kev txwv kev ua haujlwm raws li Fuse. Tsis muaj cov kev pabcuam metadata, uas txwv qhov kev ua tau zoo thiab kev ua txhaum lub peev xwm ntawm kev khaws cia thaum faib cov ntaub ntawv rau hauv cov blocks. Cov ntsuas kev ua tau zoo tuaj yeem pom tau nrog qhov "Distributed Replicated" configuration thiab tus naj npawb ntawm cov nodes yuav tsum yog tsawg kawg yog 6 los npaj ib tug txhim khu kev qha replica 3 nrog kev pom zoo load faib.
Cov kev tshawb pom no kuj muaj feem xyuam nrog kev piav qhia ntawm cov neeg siv kev paub thiab thaum piv nrog , thiab tseem muaj cov lus piav qhia ntawm cov kev paub dhau los ua rau kev nkag siab txog qhov tsim tau zoo dua thiab txhim khu kev qha
Daim duab qhia txog kev xa khoom xa tawm thaum sau ob cov ntaub ntawv, qhov twg cov ntawv luam ntawm thawj cov ntaub ntawv raug faib thoob plaws thawj peb lub servers, uas tau muab tso ua ke rau hauv pawg 0, thiab peb daim ntawv luam ntawm cov ntaub ntawv thib ob tau muab tso rau hauv pawg thib ob ntim 1 ntawm peb. servers. Txhua lub server muaj ib lub disk.
Qhov kev txiav txim dav dav yog tias koj tuaj yeem siv Gluster, tab sis nrog kev nkag siab tias yuav muaj kev txwv hauv kev ua tau zoo thiab kev ua txhaum cai uas tsim teeb meem nyob rau hauv qee qhov xwm txheej ntawm kev daws teeb meem hyperconverged, qhov twg cov peev txheej tseem xav tau rau kev suav cov khoom ntawm virtual ib puag ncig.
Kuj tseem muaj qee qhov Gluster kev ua tau zoo uas tuaj yeem ua tiav raws li qee yam xwm txheej, txwv rau
ceph
Tam sim no cia saib Ceph los ntawm cov lus piav qhia architecture uas kuv muaj peev xwm ua tau Kuj tseem muaj qhov sib piv ntawm , qhov twg koj tuaj yeem nkag siab tam sim ntawd nws raug nquahu kom xa Ceph ntawm cov servers cais, vim nws cov kev pabcuam xav tau tag nrho cov khoom siv kho vajtse hauv qab thauj khoom.
architecture complex tshaj Gluster thiab muaj cov kev pab cuam xws li metadata cov kev pab cuam, tab sis tag nrho pawg ntawm cov khoom yog heev complex thiab tsis heev saj zawg zog rau siv nyob rau hauv ib tug virtualization tov. Cov ntaub ntawv khaws cia hauv cov blocks, uas zoo li ua tau zoo dua, tab sis nyob rau hauv hierarchy ntawm tag nrho cov kev pab cuam (cov khoom), muaj kev poob thiab latency nyob rau hauv tej yam loads thiab xwm txheej ceev, piv txwv li hauv qab no
Los ntawm cov lus piav qhia ntawm architecture, lub plawv yog CRUSH, ua tsaug rau qhov chaw khaws cia cov ntaub ntawv raug xaiv. Tom ntej no los PG - qhov no yog qhov nyuaj tshaj plaws abstraction (cov pab pawg neeg xav paub) kom nkag siab. PGs yuav tsum tau ua kom CRUSH zoo dua. Lub hom phiaj tseem ceeb ntawm PG yog pab pawg khoom kom txo tau cov peev txheej, nce kev ua tau zoo thiab ua kom muaj peev xwm. Hais txog cov khoom ncaj qha, ib tus zuj zus, yam tsis tau muab tso rau hauv PG yuav kim heev. OSD yog ib qho kev pabcuam rau txhua tus disk.
Ib pawg tuaj yeem muaj ib lossis ntau cov ntaub ntawv sib txawv rau cov hom phiaj sib txawv thiab nrog cov chaw sib txawv. Cov pas dej tau muab faib ua pab pawg. Cov pab pawg tso chaw khaws cov khoom uas cov neeg siv khoom nkag. Qhov no yog qhov uas cov txheej txheem xaus, thiab lub cev theem pib, vim hais tias txhua pab pawg muab tso rau ib lub ntsiab disk thiab ob peb replica disks (yuav muaj pes tsawg raws nraim nyob ntawm lub pas dej ua ke replication). Nyob rau hauv lwm yam lus, nyob rau hauv cov nqe lus nug ntawm yuav ua li cas muab cov khoom nyob rau hauv ib tug tshwj xeeb kev tso kawm pab pawg neeg, thiab nyob rau hauv lub cev theem - nyob rau hauv lub disks uas muab rau nws. Hauv qhov no, cov disks tuaj yeem nyob ntawm lub cev ntawm cov nodes sib txawv lossis txawm nyob hauv cov chaw sib txawv.
Nyob rau hauv cov tswv yim no, kev tso kawm pab pawg zoo li ib theem tsim nyog rau qhov yooj ntawm tag nrho cov kev daws teeb meem, tab sis tib lub sij hawm, raws li ib tug ntxiv txuas nyob rau hauv cov saw no, uas involuntarily qhia ib tug poob ntawm productivity. Piv txwv li, thaum sau cov ntaub ntawv, lub kaw lus yuav tsum tau faib nws mus rau hauv cov pab pawg no thiab tom qab ntawd ntawm lub cev theem mus rau hauv lub ntsiab disk thiab disks rau replicas. Ntawd yog, Hash muaj nuj nqi ua haujlwm thaum tshawb nrhiav thiab ntxig ib qho khoom, tab sis muaj kev phiv - nws yog tus nqi siab heev thiab kev txwv ntawm kev rov tsim kho lub hash (thaum ntxiv lossis tshem tawm lub disk). Lwm qhov teeb meem hash yog qhov tseeb nailed qhov chaw ntawm cov ntaub ntawv uas hloov tsis tau. Ntawd yog, yog tias qee qhov disk nyob rau hauv kev nce load, ces lub kaw lus tsis muaj lub sijhawm tsis txhob sau rau nws (los ntawm xaiv lwm disk), lub hash muaj nuj nqi yuav tsum muab cov ntaub ntawv nyob rau hauv txoj cai, txawm li cas los xij. lub disk yog, yog li Ceph noj ntau lub cim xeeb thaum rov tsim kho PG thaum kho tus kheej lossis nce kev cia. Qhov xaus yog tias Ceph ua haujlwm tau zoo (txawm tias maj mam), tab sis tsuas yog thaum tsis muaj qhov ntsuas, xwm txheej ceev, lossis hloov tshiab.
Muaj, tau kawg, cov kev xaiv rau kev nce kev ua tau zoo los ntawm caching thiab cache sib koom, tab sis qhov no yuav tsum tau kho vajtse zoo thiab tseem yuav poob. Tab sis tag nrho, Ceph zoo li ntxias ntau dua li Gluster rau kev tsim khoom. Tsis tas li ntawd, thaum siv cov khoom no, nws yog ib qho tsim nyog yuav tsum tau coj mus rau hauv tus account qhov tseem ceeb - qhov no yog qib siab ntawm kev txawj ntse, kev paub dhau los thiab kev tshaj lij nrog rau qhov tseem ceeb ntawm Linux, vim nws tseem ceeb heev rau kev xa tawm, teeb tsa thiab tswj txhua yam kom raug, uas imposes ntau lub luag hauj lwm thiab lub nra rau tus thawj coj.
Kev khaws cia
Lub architecture zoo li nthuav ntau dua , uas tuaj yeem siv ua ke nrog hypervisor ntawm tib lub nodes, ntawm tib yam , tab sis nws yog ib qho tseem ceeb heev rau configure txhua yam kom raug kom ua tau zoo. Ntawd yog, kev siv cov khoom zoo li no los ntawm lub thawv ntawm txhua qhov kev teeb tsa yam tsis tau suav nrog cov lus pom zoo raws li cov qauv tsim yuav yooj yim heev, tab sis tsis tsim nyog.
Dab tsi tuaj yeem sib koom ua ke rau kev khaws cia ntawm ib sab ntawm cov kev pabcuam ntawm kvm-qemu hypervisor, thiab cov no tsuas yog ob peb qhov kev pabcuam uas pom muaj kev pom zoo ntawm cov khoom siv tau pom: cov neeg siv khoom tau teeb tsa ntawm FUSE (hloov kho, tsis qhib qhov chaw), MDS metadata kev pabcuam (Metadata kev pabcuam), kev pabcuam Chunk pabcuam cov ntaub ntawv thaiv, uas nyob rau theem ntawm lub cev sib npaug rau ib qho disk thiab qhov ntawd yog tag nrho. Nyob rau hauv cov nqe lus ntawm kev ceev, tau kawg, nws yog qhov zoo tshaj plaws los siv lub tswv yim tsis raug cai nrog ob lub replicas, tab sis yog tias koj siv caching thiab cav ntawm SSD drives, ces yuam kev-hloov coding (luag coding los yog raid6) tuaj yeem ua tau zoo overclocked ntawm ib qho. hybrid tswvyim los yog txawm zoo dua ntawm tag nrho cov flash. Muaj qee qhov tsis zoo nrog EC (txhim kho coding): thaum hloov ib qho thaiv cov ntaub ntawv, nws yog ib qho tsim nyog los suav cov nqi sib npaug. Txhawm rau hla qhov poob cuam tshuam nrog kev ua haujlwm no, Ceph sau rau EC ncua sijhawm thiab teeb meem kev ua haujlwm tuaj yeem tshwm sim thaum muaj qee qhov kev thov, thaum, piv txwv li, tag nrho cov blocks yuav tsum tau nyeem, thiab nyob rau hauv cov ntaub ntawv ntawm Virtuozzo Cia, sau ntawv hloov blocks yog nqa tawm. siv qhov "log-structured file system" mus kom ze, uas txo cov nqi xam cov nqi sib npaug. Txhawm rau kwv yees kwv yees li cov kev xaiv nrog kev ua haujlwm nrawm nrog thiab tsis muaj EC, muaj - Cov duab tuaj yeem kwv yees nyob ntawm qhov tseeb coefficient ntawm cov khoom tsim khoom, tab sis cov txiaj ntsig ntawm kev suav yog ib qho kev pab zoo hauv kev npaj kev teeb tsa.
Ib daim duab yooj yim ntawm cov khoom khaws cia tsis txhais tau tias cov khoom no tsis nqus tab sis yog tias koj xam tag nrho cov nqi ua ntej, koj tuaj yeem suav nrog kev sib koom tes ntawm tus neeg saib xyuas.
Muaj ib lub tswv yim rau kev sib piv kev siv cov khoom siv kho vajtse los ntawm Ceph thiab Virtuozzo cov kev pabcuam cia.
Yog tias yav dhau los nws tuaj yeem sib piv Gluster thiab Ceph siv cov ntawv qub, siv cov kab tseem ceeb tshaj plaws los ntawm lawv, ces nrog Virtuozzo nws nyuaj dua. Tsis muaj ntau cov khoom ntawm cov khoom no thiab cov ntaub ntawv tsuas tuaj yeem khaws tau los ntawm cov ntaub ntawv ntawm los yog nyob rau hauv Lavxias teb sab yog peb xav txog Vstorage li cia siv nyob rau hauv ib co hyperconverged kev daws teeb meem nyob rau hauv cov tuam txhab xws li thiab Acronis.
Kuv mam li sim pab nrog cov lus piav qhia ntawm cov qauv no, yog li yuav muaj cov ntawv nyeem ntxiv me ntsis, tab sis nws yuav siv sijhawm ntau los nkag siab cov ntaub ntawv koj tus kheej, thiab cov ntaub ntawv uas twb muaj lawm tsuas yog siv los ua ib qho kev siv los ntawm kev kho lub rooj. ntawm cov ntsiab lus lossis tshawb nrhiav los ntawm lo lus tseem ceeb.
Cia peb xav txog cov txheej txheem kaw cia hauv kev teeb tsa kho vajtse hybrid nrog cov khoom siv tau piav qhia saum toj no: cov ntaub ntawv kaw cia pib mus rau ntawm qhov uas tus neeg siv tau pib nws (FUSE mount point kev pabcuam), tab sis Metadata Service (MDS) tus tswv tivthaiv yuav tau kawg. coj tus neeg siv khoom ncaj qha mus rau qhov kev pabcuam chunk uas xav tau (kev pabcuam khaws cia CS blocks), uas yog, MDS tsis koom nrog cov txheej txheem kaw, tab sis tsuas yog coj cov kev pabcuam mus rau qhov yuav tsum tau ua. Feem ntau, peb tuaj yeem muab qhov piv txwv rau kev kaw nrog cov dej ntws rau hauv cov thoob. Txhua chim yog 256MB cov ntaub ntawv thaiv.
Ntawd yog, ib qho disk yog qee tus naj npawb ntawm cov chim, uas yog, qhov ntim disk faib los ntawm 256MB. Txhua daim ntawv luam tawm mus rau ib qho, qhov thib ob yuav luag sib luag rau lwm qhov, thiab lwm yam ... Yog tias peb muaj peb qhov rov ua dua thiab muaj SSD disks rau cache (rau kev nyeem ntawv thiab sau ntawv), ces kev pom zoo ntawm kev sau yuav tshwm sim tom qab sau ntawv. lub log rau SSD, thiab rov pib dua los ntawm SSD yuav txuas ntxiv mus rau HDD, zoo li hauv keeb kwm yav dhau. Nyob rau hauv cov ntaub ntawv ntawm peb replicas, cov ntaub ntawv yuav raug cog lus tom qab kev pom zoo los ntawm SSD ntawm lub thib peb node. Nws yuav zoo li tias qhov sib npaug ntawm kev sau nrawm ntawm peb SSD tuaj yeem muab faib los ntawm peb thiab peb yuav tau txais kev sau nrawm ntawm ib qho kev hloov pauv, tab sis cov ntawv luam tau sau ua ke thiab lub network Latency ceev feem ntau siab dua li ntawm SSD, thiab qhov tseeb qhov kev sau ntawv yuav nyob ntawm lub network. Hauv qhov no, txhawm rau pom IOPS tiag tiag, koj yuav tsum raug thauj tag nrho Vstorage los ntawm , uas yog, kuaj lub load tiag tiag, thiab tsis nco thiab cache, qhov twg nws yog ib qho tsim nyog yuav tsum coj mus rau hauv tus account qhov tseeb cov ntaub ntawv thaiv qhov loj me, cov xov tooj, thiab lwm yam.
Cov ntaub ntawv sau tseg saum toj no ntawm SSD ua haujlwm zoo li sai li sai tau cov ntaub ntawv nkag mus rau hauv nws, nws tau nyeem tam sim ntawd los ntawm kev pabcuam thiab sau rau HDD. Muaj ntau qhov kev pabcuam metadata (MDS) ib pawg thiab lawv tus lej raug txiav txim los ntawm pawg pawg, uas ua haujlwm raws li Paxos algorithm. Los ntawm tus neeg siv khoom pom, FUSE mount point yog pawg khaws cia khaws cia ib txhij pom rau txhua qhov ntawm cov pawg, txhua qhov node muaj cov neeg siv khoom txuas raws li lub hauv paus ntsiab lus no, yog li qhov chaw khaws cia no muaj nyob rau txhua qhov.
Rau kev ua tau zoo ntawm ib qho ntawm cov kev piav qhia saum toj no, nws yog ib qho tseem ceeb heev, nyob rau theem kev npaj thiab xa mus, kom raug teeb tsa lub network, qhov twg yuav muaj kev sib npaug vim kev sib sau ua ke thiab raug xaiv network channel bandwidth. Hauv kev sib sau ua ke, nws yog ib qho tseem ceeb uas yuav tsum xaiv txoj cai hashing hom thiab thav duab loj. Kuj tseem muaj qhov sib txawv muaj zog heev los ntawm SDS tau piav qhia saum toj no, qhov no yog fuse nrog txoj kev ceev ceev hauv Virtuozzo Storage. Uas, ntxiv rau cov fuse niaj hnub, tsis zoo li lwm cov kev daws teeb meem qhib, nce IOPS thiab tso cai rau koj kom tsis txhob raug txwv los ntawm kab rov tav lossis ntsug. Feem ntau, piv rau cov architectures uas tau piav saum toj no, qhov no zoo li muaj zog dua, tab sis rau qhov zoo siab, tau kawg, koj yuav tsum tau yuav daim ntawv tso cai, tsis zoo li Ceph thiab Gluster.
Txhawm rau kom ua tiav, peb tuaj yeem hais qhia rau sab saum toj ntawm peb: Virtuozzo Cia yog thawj qhov chaw ntawm kev ua tau zoo thiab kev ntseeg siab ntawm architecture, Ceph yuav siv qhov thib ob, thiab Gluster yog qhov thib peb.
Cov txheej txheem los ntawm Virtuozzo Storage tau raug xaiv: nws yog ib qho kev pom zoo ntawm cov khoom vaj tse, kho tshiab rau qhov Fuse mus kom ze nrog txoj kev ceev, cov txheej txheem kho vajtse hloov tau yooj yim, kev siv nyiaj tsawg thiab muaj peev xwm sib koom nrog suav (xws li / virtualization), uas yog, nws yog kiag li haum rau ib tug hyperconverged tov, uas nws yog ib feem ntawm. Qhov thib ob yog Ceph vim tias nws yog ib qho khoom tsim tau zoo dua piv rau Gluster, vim nws txoj haujlwm hauv cov blocks, nrog rau cov xwm txheej hloov tau yooj yim dua thiab muaj peev xwm ua haujlwm hauv pawg loj.
Muaj cov phiaj xwm los sau qhov sib piv ntawm vSAN, Chaw Direct Storage, Vstorage thiab Nutanix Storage, sim Vstorage ntawm HPE thiab Huawei cov cuab yeej, nrog rau cov xwm txheej rau kev sib koom ua ke Vstorage nrog cov khoom siv sab nraud, yog li yog tias koj nyiam cov kab lus, nws yuav yog. zoo siab tau txais kev tawm tswv yim los ntawm koj, uas tuaj yeem ua rau muaj kev txhawb siab rau cov ntawv tshiab, suav nrog koj cov lus pom thiab xav tau.
Tau qhov twg los: www.hab.com