Lesi sihloko sibhalelwe ukukusiza ukuthi uzikhethele isisombululo esifanele futhi uqonde umehluko phakathi kwe-SDS efana ne-Gluster, Ceph ne-Vstorage (Virtuozzo).
Umbhalo usebenzisa izixhumanisi ezihlokweni ngokudalulwa okuningiliziwe kwezinkinga ezithile, ngakho-ke izincazelo zizoba mfushane ngangokunokwenzeka, zisebenzisa amaphuzu abalulekile ngaphandle kwe-fluff engadingekile nolwazi lwesingeniso ongaluthola ngokuzimela ku-inthanethi, uma uthanda.
Eqinisweni, izihloko eziphakanyisiwe zidinga amathoni ombhalo, kodwa emhlabeni wanamuhla abantu abaningi abathandi ukufunda okuningi))), ngakho-ke ungafunda ngokushesha futhi wenze ukukhetha, futhi uma kukhona okuthile. akucaci, landela izixhumanisi noma amagama angacacile we-google))), futhi lesi sihloko sifana ne-wrapper esobala yalezi zihloko ezijulile, ebonisa ukugcwaliswa - amaphuzu ayinhloko ayinhloko esinqumo ngasinye.
I-Gluster
Ake siqale nge-Gluster, esetshenziswa ngenkuthalo abakhiqizi bamapulatifomu e-hyperconverged ane-SDS esekelwe kumthombo ovulekile wezindawo ezibonakalayo futhi ingatholakala kuwebhusayithi ye-RedHat engxenyeni yokugcina, lapho ungakhetha kuzo ezimbili izinketho ze-SDS: Gluster noma Ceph.
I-Gluster iqukethe inqwaba yabahumushi - amasevisi enza wonke umsebenzi wokusabalalisa amafayela, njll. I-Brick iyisevisi ehlinzeka ngediski eyodwa, Ivolumu iyivolumu (ichibi) ehlanganisa lezi zitini. Okulandelayo kuza isevisi yokusabalalisa amafayela ngamaqembu kusetshenziswa umsebenzi we-DHT (ithebula le-hash elisabalalisiwe). Ngeke sifake isevisi yokwabelana encazelweni njengoba izixhumanisi ezingezansi zizochaza izinkinga ezihambisana nayo.
Lapho ubhala, lonke ifayela ligcinwa esitini futhi ikhophi yalo ibhalwe ngesikhathi esisodwa isitini kuseva yesibili. Okulandelayo, ifayela lesibili lizobhalwa eqenjini lesibili lezitini ezimbili (noma ngaphezulu) kumaseva ahlukene.
Uma amafayela elingana nosayizi ofanayo futhi ivolumu iqukethe iqembu elilodwa kuphela, khona-ke konke kuhamba kahle, kodwa ngaphansi kwezinye izimo izinkinga ezilandelayo zizovela ezincazelweni:
- isikhala emaqenjini sisetshenziswa ngokungalingani, kuya ngobukhulu bamafayela futhi uma singekho isikhala esanele eqenjini sokubhala ifayela, uzothola iphutha, ifayela ngeke libhalwe futhi ngeke liphinde lihanjiswe kwelinye iqembu. ;
- lapho ubhala ifayela elilodwa, i-IO iya eqenjini elilodwa kuphela, abanye abangenzi lutho;
- awukwazi ukuthola i-IO yevolumu yonke lapho ubhala ifayela elilodwa;
- futhi umqondo ojwayelekile ubukeka ukhiqiza kancane ngenxa yokuntuleka kokusatshalaliswa kwedatha kumabhulokhi, lapho kulula khona ukulinganisa nokuxazulula inkinga yokusabalalisa okufanayo, hhayi njengoba manje lonke ifayela lingena vimba.
Kusukela encazelweni esemthethweni futhi ngokuzenzakalelayo sifinyelela ekuqondeni ukuthi i-gluster isebenza njengokugcinwa kwamafayela ngaphezulu kwe-hardware RAID yakudala. Kube nemizamo yokuthuthukisa yokusika (Sharding) amafayela abe amabhulokhi, kodwa konke lokhu kuyisengezo esibeka ukulahlekelwa kokusebenza endleleni evele ikhona yezakhiwo, kanye nokusetshenziswa kwezingxenye ezinjalo ezisatshalaliswa ngokukhululekile ezinemikhawulo yokusebenza njengeFuse. Awekho amasevisi emethadatha, akhawulela ukusebenza kanye namandla okubekezelela amaphutha esitoreji lapho kusakazwa amafayela kumabhulokhi. Izinkomba zokusebenza ezingcono zingabonwa ngokulungiselelwa kokuthi "Kusatshalaliswe Okuphindaphindiwe" futhi inani lamanodi kufanele okungenani libe ngu-6 ukuze kuhlelwe i-replica ethembekile engu-3 enokusabalalisa komthwalo okulungile.
Lokhu okutholakele kuphinde kuhlobane nencazelo yomuzwa womsebenzisi futhi uma kuqhathaniswa , futhi kukhona nencazelo yokuhlangenwe nakho okuholela ekuqondeni lokhu kulungiselelwa okukhiqiza kakhulu nokuthembeke kakhudlwana
Isithombe sibonisa ukusatshalaliswa komthwalo lapho kubhalwa amafayela amabili, lapho amakhophi efayela lokuqala asatshalaliswa kuwo wonke amaseva amathathu okuqala, ahlanganiswa abe yiqembu levolumu engu-0, futhi amakhophi amathathu efayela lesibili abekwe eqenjini lesibili ivolumu1 kwamathathu. amaseva. Iseva ngayinye inediski eyodwa.
Isiphetho esijwayelekile ukuthi ungasebenzisa i-Gluster, kodwa ngokuqonda ukuthi kuzoba nemikhawulo ekusebenzeni nasekubekezeleleni amaphutha okudala ubunzima ngaphansi kwezimo ezithile zesisombululo se-hyperconverged, lapho izinsiza zidingeka futhi emithwalweni yekhompyutha yezindawo ezibonakalayo.
Kukhona nezinye izinkomba zokusebenza kwe-Gluster ezingafinyelelwa ngaphansi kwezimo ezithile, kunqunyelwe
ceph
Manje ake sibheke uCeph ezincazelweni zezakhiwo engikwazile ukuzenza Kukhona futhi ukuqhathanisa phakathi , lapho ungaqonda khona ngokushesha ukuthi kuhle ukuthi usebenzise i-Ceph kumaseva ahlukene, njengoba izinsizakalo zayo zidinga zonke izinsiza ze-hardware ngaphansi komthwalo.
bokwakha iyinkimbinkimbi kakhulu kune-Gluster futhi kunezinsizakalo ezifana nezinsizakalo zemethadatha, kodwa sonke isitaki sezingxenye siyinkimbinkimbi futhi asiguquguquki kakhulu ukusisebenzisa kusixazululo se-virtualization. Idatha igcinwa kumabhulokhi, abukeka ekhiqiza kakhulu, kodwa kusigaba sazo zonke izinsizakalo (izingxenye), kukhona ukulahlekelwa nokubambezeleka ngaphansi kwemithwalo ethile nezimo eziphuthumayo, isibonelo okulandelayo
Kusukela encazelweni yezakhiwo, inhliziyo ithi CRUSH, ngenxa yokuthi indawo yokugcina idatha ikhethwa. Okulandelayo kuza i-PG - lena i-abstraction enzima kakhulu (iqembu elinengqondo) ukuyiqonda. Ama-PG ayadingeka ukwenza i-CRUSH isebenze kakhulu. Inhloso enkulu ye-PG ukuhlanganisa izinto ukuze kuncishiswe ukusetshenziswa kwensiza, kukhuphule ukusebenza kanye nokulinganisa. Ukukhuluma ngezinto ngokuqondile, ngazinye, ngaphandle kokuzihlanganisa zibe i-PG kuzobiza kakhulu. I-OSD iyisevisi yediski ngayinye ngayinye.
Iqoqo lingaba nedatha yedatha eyodwa noma eziningi ngezinjongo ezihlukile kanye nezilungiselelo ezihlukile. Amachibi ahlukaniswe ngamaqembu okubekwa. Amaqembu okubeka agcina izinto amakhasimende afinyelela kuzo. Yilapho izinga elinengqondo ligcina khona, futhi izinga lomzimba liqala, ngoba iqembu ngalinye lokubeka linikezwa idiski eyodwa eyinhloko kanye namadiski okuphindaphinda amaningana (bangaki ngokunembile ancike entweni yokuphindaphinda kwechibi). Ngamanye amazwi, ezingeni elinengqondo into igcinwa eqenjini elithile lokubeka, futhi ezingeni elingokwenyama - kumadiski abelwe wona. Kulokhu, ama-disks angatholakala ngokomzimba kuma-node ahlukene noma ngisho nasezikhungweni zedatha ezahlukene.
Kulolu hlelo, amaqembu okubeka abukeka njengezinga elidingekayo lokuguquguquka kwesisombululo sonke, kodwa ngesikhathi esifanayo, njengesixhumanisi esengeziwe kulolu chungechunge, okuphakamisa ngokuzenzakalelayo ukulahlekelwa kokukhiqiza. Isibonelo, lapho ubhala idatha, isistimu idinga ukuyihlukanisa ibe yilawa maqembu bese iba sezingeni elibonakalayo ibe yidiski eyinhloko namadiski okukopisha. Okusho ukuthi, umsebenzi we-Hash usebenza lapho usesha futhi ufaka into, kodwa kukhona umphumela ohlangothini - yizindleko eziphakeme kakhulu kanye nemingcele yokwakha kabusha i-hashi (lapho ungeza noma ususa idiski). Enye inkinga ye-hashi indawo ebethelwe ngokucacile yedatha engakwazi ukushintshwa. Okusho ukuthi, uma ngandlela thile idiski ingaphansi komthwalo owandayo, uhlelo alunalo ithuba lokungayibhali (ngokukhetha enye idiski), umsebenzi we-hashi ubophezela idatha ukuthi itholakale ngokulandela umthetho, kungakhathaliseki ukuthi kubi kangakanani. idiski, ngakho-ke u-Ceph udla inkumbulo eningi lapho akha kabusha i-PG uma kwenzeka ukuzelapha noma ukwandisa isitoreji. Isiphetho siwukuthi i-Ceph isebenza kahle (yize ihamba kancane), kodwa kuphela lapho kungekho ukukala, izimo eziphuthumayo, noma izibuyekezo.
Kukhona, vele, izinketho zokwandisa ukusebenza ngokusebenzisa ukugcinwa kwesikhashana kanye nokwabelana ngenqolobane, kodwa lokhu kudinga ihadiwe elihle futhi kusazoba nokulahlekelwa. Kepha sekukonke, i-Ceph ibukeka ilinga kakhulu kune-Gluster ngokukhiqiza. Futhi, lapho usebenzisa le mikhiqizo, kubalulekile ukucabangela isici esibalulekile - lokhu izinga eliphezulu lekhono, isipiliyoni kanye nobuchwepheshe ngokugcizelela kakhulu ku-Linux, ngoba kubaluleke kakhulu ukuhambisa, ukulungisa nokugcina yonke into ngendlela efanele, okubeka umthwalo owengeziwe kanye nomthwalo kumlawuli.
Vstorage
Izakhiwo zibukeka zithakazelisa nakakhulu , engasetshenziswa ngokuhambisana ne-hypervisor kumanodi afanayo, ngokufanayo , kodwa kubaluleke kakhulu ukulungisa yonke into ngendlela efanele ukuze kuzuzwe ukusebenza okuhle. Okungukuthi, ukuthumela umkhiqizo onjalo kusuka ebhokisini kunoma yikuphi ukucushwa ngaphandle kokucabangela izincomo ngokuhambisana nezakhiwo kuzoba lula kakhulu, kodwa kungakhiqizi.
Yini engahlala ndawonye ukuze igcinwe eduze kwezinsiza ze-kvm-qemu hypervisor, futhi lezi yizinsizakalo ezimbalwa lapho kutholwe khona isigaba esiphezulu sezingxenye: isevisi yeklayenti ifakwe nge-FUSE (eguquliwe, hhayi umthombo ovulekile), isevisi yemethadatha ye-MDS (Isevisi yemethadatha), isevisi ye-Chunk service data blocks, ezingeni elibonakalayo elilingana nediski eyodwa futhi yilokho kuphela. Ngokuya ngesivinini, vele, kuhle kakhulu ukusebenzisa isikimu esibekezelela amaphutha esinezifaniso ezimbili, kepha uma usebenzisa i-caching kanye namalogi kumadrayivu e-SSD, khona-ke ukufaka amakhodi okubekezelela iphutha (ukusula amakhodi noma i-raid6) kungahle kubekwe ngaphezulu kwe-overclocked i-hybrid scheme noma okungcono kakhulu kuwo wonke ama-flash. Kunobubi obuthile nge-EC (susa ukubhala ikhodi): lapho ushintsha ibhulokhi yedatha eyodwa, kuyadingeka ukubala kabusha amanani okulingana. Ukudlula ukulahlekelwa okuhlobene nalokhu kusebenza, u-Ceph ubhalela i-EC ngokuhlehlisa futhi izinkinga zokusebenza zingenzeka ngesikhathi sesicelo esithile, lapho, ngokwesibonelo, wonke amabhlogo adinga ukufundwa, futhi esimweni se-Virtuozzo Storage, ukubhala amabhlogo ashintshiwe kwenziwa. kusetshenziswa indlela βyesistimu yefayela elakhiwe ngelogiβ, enciphisa izindleko zokubala ngokulinganayo. Ukulinganisa cishe izinketho ngokusheshisa komsebenzi nge-EC nangaphandle kwayo, zikhona - izibalo zingaba cishe kuye ngokuthi i-coefficient yokunemba yomkhiqizi wemishini, kodwa umphumela wezibalo uwusizo oluhle ekuhleleni ukucushwa.
Umdwebo olula wezingxenye zokugcina akusho ukuthi lezi zingxenye azimunyi kodwa uma ubala zonke izindleko kusengaphambili, ungathembela ekusebenzisaneni eduze kwe-hypervisor.
Kunohlelo lokuqhathanisa ukusetshenziswa kwezinsiza zehadiwe yi-Ceph kanye nezinsizakalo zokugcina ze-Virtuozzo.
Uma ngaphambili kwakungenzeka ukuqhathanisa i-Gluster ne-Ceph usebenzisa izihloko ezindala, usebenzisa imigqa ebaluleke kakhulu evela kubo, khona-ke nge-Virtuozzo kunzima kakhulu. Awekho ama-athikili amaningi kulo mkhiqizo futhi ulwazi lungatholwa kuphela kumadokhumenti kuqhubeke noma ngesiRashiya uma sibheka i-Vstorage njengesitoreji esisetshenziswa kwezinye izixazululo ze-hyperconverged ezinkampanini ezifana kanye ne-Acronis.
Ngizozama ukusiza ngencazelo yalesi sakhiwo, ngakho-ke kuzoba nombhalo omncane, kodwa kuthatha isikhathi esiningi ukuqonda imibhalo ngokwakho, futhi imibhalo ekhona ingasetshenziswa kuphela njengereferensi ngokubuyekeza ithebula. kokuqukethwe noma ukusesha ngegama elingukhiye.
Ake sicabangele inqubo yokurekhoda ekucushweni kwezingxenyekazi zekhompuyutha ezixubile nezingxenye ezichazwe ngenhla: ukurekhoda kuqala ukuya endaweni lapho ikhasimende liyiqale khona (isevisi yephoyinti lokukhweza le-FUSE), kodwa ingxenye enkulu ye-Metadata Service (MDS) qondisa iklayenti ngqo kusevisi ye-chunk oyifunayo (amabhulokhi we-CS yesevisi yesitoreji), okungukuthi, i-MDS ayihlanganyeli enqubweni yokurekhoda, kodwa imane iqondise isevisi engxenyeni edingekayo. Ngokuvamile, singanikeza isifaniso sokurekhoda ngokuthela amanzi emiphongolweni. Umphongolo ngamunye uwuvimba wedatha ongu-256MB.
Okusho ukuthi, idiski eyodwa inombolo ethile yemiphongolo enjalo, okungukuthi, ivolumu yediski ehlukaniswe ngu-256MB. Ikhophi ngayinye isakazwa ku-node eyodwa, eyesibili icishe ifane nenye i-node, njll ... Uma sine-replicas emithathu futhi kukhona ama-SSD disks we-cache (yokufunda nokubhala izingodo), khona-ke ukuqinisekiswa kokubhala kuzokwenzeka ngemva kokubhala. ilogi ku-SSD, nokusetha kabusha okufanayo kusuka ku-SSD kuzoqhubeka ku-HDD, njengokungathi kungemuva. Endabeni yama-replicas amathathu, irekhodi lizokwenziwa ngemva kokuqinisekiswa kwe-SSD yenodi yesithathu. Kungase kubonakale sengathi isamba sesivinini sokubhala sama-SSD amathathu singahlukaniswa ngamathathu futhi sizothola isivinini sokubhala se-replica eyodwa, kodwa amakhophi abhalwe ngokuhambisana futhi isivinini se-Latency yenethiwekhi ngokuvamile siphezulu kune-SSD, futhi empeleni ukusebenza kokubhala kuzoncika kunethiwekhi. Mayelana nalokhu, ukuze ubone i-IOPS yangempela, udinga ukulayisha kahle yonke i-Vstorage nge , okungukuthi, ukuhlola umthwalo wangempela, hhayi inkumbulo kanye nenqolobane, lapho kudingekile ukucabangela usayizi olungile we-block data, inombolo yezintambo, njll.
Ilogi yokurekhoda eshiwo ngenhla ku-SSD isebenza ngendlela yokuthi ngokushesha nje lapho idatha ingena kuyo, ifundwa ngokushesha yisevisi futhi ibhalwe ku-HDD. Kunamasevisi amaningi emethadatha (MDS) ngeqoqo ngalinye futhi inombolo yawo inqunywa ikhoramu, esebenza ngokuvumelana ne-algorithm ye-Paxos. Kusukela ekubukeni kweklayenti, i-FUSE mount point ifolda yokugcina iqoqo elibonakala ngesikhathi esifanayo kuwo wonke ama-node ku-cluster, i-node ngayinye ineklayenti eliphakanyisiwe ngokwalesi simiso, ngakho-ke lesi sitoreji sitholakala ku-node ngayinye.
Ngokusebenza kwanoma iyiphi yalezi zindlela ezichazwe ngenhla, kubaluleke kakhulu, esigabeni sokuhlela nokuthunyelwa, ukulungisa kahle inethiwekhi, lapho kuzoba khona ukulinganisa ngenxa yokuhlanganiswa kanye nomkhawulokudonsa wesiteshi senethiwekhi esikhethwe kahle. Ekuhlanganiseni, kubalulekile ukukhetha imodi ye-hashing efanele namasayizi ozimele. Kuphinde kube nomehluko oqine kakhulu kusukela ku-SDS echazwe ngenhla, lena i-fuse enobuchwepheshe bendlela esheshayo ku-Virtuozzo Storage. Okuthi, ngaphezu kwe-fuse eyenziwe yesimanjemanje, ngokungafani nezinye izixazululo zomthombo ovulekile, ikhulisa kakhulu i-IOPS futhi ikuvumela ukuthi unganqunyelwe ukukala okuvundlile noma okuqondile. Ngokuvamile, uma kuqhathaniswa nezakhiwo ezichazwe ngenhla, lokhu kubonakala kunamandla kakhulu, kodwa ngenxa yenjabulo enjalo, yiqiniso, udinga ukuthenga amalayisensi, ngokungafani ne-Ceph ne-Gluster.
Ukufingqa, singagqamisa phezulu kokuthathu: I-Virtuozzo Storage ithatha indawo yokuqala ngokusebenza nokuthembeka kwezakhiwo, uCeph uthatha indawo yesibili, kanti uGluster uthatha indawo yesithathu.
Indlela eyakhethwa ngayo i-Virtuozzo Storage: iyisethi ephelele yezingxenye zezakhiwo, eyenzelwe le ndlela ye-Fuse ibe yesimanjemanje ngendlela esheshayo, isethi eguquguqukayo yokucushwa kwehadiwe, ukusetshenziswa okuncane kwezinsiza kanye nekhono lokwabelana ngekhompyutha (i-computing/virtualization), okungukuthi, ifaneleka ngokuphelele isixazululo se-hyperconverged , ayingxenye yayo. Indawo yesibili i-Ceph ngoba iyisakhiwo esikhiqiza kakhulu uma siqhathaniswa ne-Gluster, ngenxa yokusebenza kwayo kumabhulokhi, kanye nezimo eziguquguqukayo kanye nekhono lokusebenza kumaqoqo amakhulu.
Kunezinhlelo zokubhala ukuqhathanisa phakathi kwe-vSAN, i-Space Direct Storage, i-Vstorage ne-Nutanix Storage, ukuhlola i-Vstorage ku-HPE kanye nemishini ye-Huawei, kanye nezimo zokuhlanganisa i-Vstorage nezinhlelo zokugcina ze-hardware zangaphandle, ngakho-ke uma uthanda lesi sihloko, bekungaba. kuhle ukuthola impendulo evela kuwe, engakhuphula ugqozi lwezihloko ezintsha, kucatshangelwa ukuphawula kwakho nezifiso zakho.
Source: www.habr.com