Ichi chinyorwa chakanyorwa kuti ikubatsire kusarudza mhinduro yakakodzera iwe uye kunzwisisa mutsauko pakati peSDS seGluster, Ceph uye Vstorage (Virtuozzo).
Chinyorwa chinoshandisa zvinongedzo kuzvinyorwa zvine kuburitswa kwakadzama kwemamwe matambudziko, saka tsananguro dzichava pfupi sezvinobvira, uchishandisa akakosha mapoinzi pasina husina kufanira fluff uye ruzivo rwekutanga rwaunogona, kana uchida, wakazvimirira kuwana paInternet.
Muchokwadi, hongu, misoro yakasimudzwa inoda toni dzechinyorwa, asi munyika yanhasi vanhu vakawanda havafariri kuverenga zvakawanda))), saka unogona kukurumidza kuverenga uye kuita sarudzo, uye kana chimwe chinhu chiripo. zvisina kujeka, tevera zvinongedzo kana google mazwi asina kujeka))), uye chinyorwa ichi chakafanana neyakajeka wrapper yeiyi misoro yakadzama, inoratidza kuzadza - iwo makuru mapoinzi echisarudzo chega chega.
gluster
Ngatitangei neGluster, iyo inoshandiswa zvakanyanya nevagadziri ve hyperconverged mapuratifomu ane SDS yakavakirwa payakavhurika sosi yezvakatipoteredza nharaunda uye inogona kuwanikwa paRedHat webhusaiti muchikamu chekuchengetedza, kwaunogona kusarudza kubva maviri SDS sarudzo: Gluster kana Ceph.
Gluster ine murwi wevashanduri - masevhisi anoita basa rese rekugovera mafaera, nezvimwe. Brick ibasa rinoita dhisiki rimwe chete, Vhoriyamu ivhoriyamu (dziva) inobatanidza zvidhinha izvi. Inotevera inouya sevhisi yekugovera mafaera mumapoka vachishandisa iyo DHT (yakagoverwa hash tafura) basa. Isu hatizosanganisire iyo Sharding sevhisi mune tsananguro sezvo zvinongedzo pazasi zvinotsanangura matambudziko ane chekuita nazvo.
Paunenge uchinyora, iyo yose faira inochengetwa muzvidhinha uye kopi yayo panguva imwechete yakanyorerwa zvidhina pane yechipiri server. Zvadaro, faira yechipiri ichanyorwa kune boka rechipiri rezvidhinha zviviri (kana kupfuura) pamaseva akasiyana.
Kana mafaera ari akaenzana saizi uye vhoriyamu ine boka rimwe chete, saka zvese zvakanaka, asi mune mamwe mamiriro matambudziko anotevera achamuka kubva pane tsananguro:
- nzvimbo mumapoka inoshandiswa zvisina kuenzana, zvinoenderana nekukura kwemafaira uye kana pasina nzvimbo yakakwana muboka yekunyora faira, uchagamuchira chikanganiso, faira harinyorwi uye harizogovaniswe kune rimwe boka. ;
- pakunyora faira rimwe chete, IO inongoenda kuboka rimwe chete, mamwe ese haana basa;
- haugone kuwana IO yevhoriyamu yese paunenge uchinyora faira imwe;
- uye pfungwa yakajairika inotaridzika isingabatsiri nekuda kwekushayikwa kwekugovera data mumabhuroka, uko zviri nyore kuenzanisa uye kugadzirisa dambudziko rekugovera yunifomu, uye kwete sezvino faira rese rinopinda mubhuroka.
Kubva pane rondedzero yepamutemo isuwo tinosvika pakunzwisisa kuti gluster inoshanda sekuchengetedza faira pamusoro peiyo classic hardware RAID. Pakave nebudiriro yekuyedza kucheka (Sharding) mafaera kuita mabhuroko, asi zvese izvi ndezvekuwedzera izvo zvinoisa kurasikirwa kwekuita pane yatovepo yekuvaka maitiro, pamwe nekushandiswa kwezvinhu zvakadaro zvakagovaniswa zvakasununguka zvine zvisingakwanisi kuita seFuse. Iko hakuna metadata masevhisi, ayo anodzikamisa mashandiro uye kukanganisa kushivirira kugona kwekuchengetedza kana uchigovera mafaera mumabhururu. Zvirinani kuita zviratidzo zvinogona kucherechedzwa neiyo "Distributed Replicated" gadziriso uye nhamba yemanodhi inofanira kunge iri 6 kuronga yakavimbika replica 3 ine yakakwana yekugovera mitoro.
Izvi zvakawanikwa zvakare zvine chekuita nerondedzero yeruzivo rwemushandisi uye kana zvichienzaniswa na , uye kunewo tsananguro yechiitiko chinotungamira kunzwisiso yeiyi inobereka uye yakavimbika kugadzirisa
Mufananidzo unoratidza kugoverwa kwemutoro paunenge uchinyora mafaera maviri, uko makopi efaira rekutanga anogovaniswa pamasevha matatu ekutanga, ayo anosanganiswa muboka revhoriyamu 0, uye makopi matatu echipiri faira anoiswa paboka rechipiri vhoriyamu1 yevatatu. servers. Sevha imwe neimwe ine dhisiki imwe.
Mhedziso yakajairika ndeyokuti iwe unogona kushandisa Gluster, asi nekunzwisisa kuti kuchave nekupikiswa mukuita uye kukanganisa kushivirira izvo zvinogadzira matambudziko pasi pemamwe mamiriro eiyo hyperconverged mhinduro, uko zviwanikwa zvinodiwawo kune komputa mizhinji yenzvimbo dzakaita.
Kune zvakare mamwe maGluster performance zviratidzo ayo anogona kuwanikwa pasi pemamwe mamiriro, anogumira
ceph
Zvino ngatitarisei kuCeph kubva kune tsananguro yezvivakwa yandakakwanisa Panewo kuenzanisa pakati , kwaunogona kunzwisisa pakarepo kuti zvinokurudzirwa kuendesa Ceph pamaseva akasiyana, sezvo masevhisi ayo anoda zvese zviwanikwa zvehardware pasi pemutoro.
akitekicha yakanyanya kuomarara kupfuura Gluster uye kune masevhisi akadai semetadata masevhisi, asi iyo yese stack yezvikamu yakaoma uye haina kuchinjika zvakanyanya pakuishandisa mune virtualization mhinduro. Iyo data inochengetwa mumabhuraki, ayo anotaridzika zvakanyanya kugadzira, asi mune hierarchy yeese masevhisi (zvikamu), pane kurasikirwa uye latency pasi pemimwe mitoro uye mamiriro ekukurumidzira, semuenzaniso zvinotevera.
Kubva pane tsananguro yezvivakwa, mwoyo uri CRUSH, nekuda kwekuti nzvimbo yekuchengetedza data inosarudzwa. Inotevera inouya PG - iyi ndiyo yakanyanya kuoma kubvisa (inonzwisisika boka) kunzwisisa. MaPG anodiwa kuti CRUSH ishande zvakanyanya. Chinangwa chikuru chePG kuunganidza zvinhu kuderedza kushandiswa kwezviwanikwa, kuwedzera mashandiro uye scalability. Kugadzirisa zvinhu zvakananga, zvega, pasina kuzvisanganisa muPG zvingave zvinodhura. OSD ibasa remunhu wega dhisiki.
Cluster inogona kuva nedhamu rimwe chete kana akawanda ezvinangwa zvakasiyana uye ane marongero akasiyana. Madziva akakamurwa kuita mapoka ekuisa. Mapoka ekuisa zvinhu anochengeta zvinhu zvinosvika nevatengi. Apa ndipo panoperera mwero unonzwisisika, uye nhanho yemuviri inotanga, nekuti boka rega rega rekuisa rinopihwa imwe huru dhisiki uye akati wandei replica disks (angangani chaizvo zvinoenderana nedziva replication factor). Mune mamwe mazwi, pamwero unonzwisisika chinhu chinochengetwa mune rimwe boka rekuisa, uye pamwero wenyama - pane dhisiki dzakapihwa kwairi. Muchiitiko ichi, ma disks anogona kunge ari mumuviri panzvimbo dzakasiyana-siyana kana kunyange munzvimbo dzakasiyana dze data.
Muchirongwa ichi, mapoka ekuisa anotaridzika seyero inodiwa yekuchinjika kwemhinduro yese, asi panguva imwe chete, sekuwedzera chinongedzo mumaketani aya, ayo anoratidza nekusaziva kurasikirwa kwechigadzirwa. Semuenzaniso, kana uchinyora data, sisitimu inoda kuipatsanura mumapoka aya uye ipapo padanho remuviri mudhisiki huru uye dhisiki replicas. Ndiko kuti, basa reHash rinoshanda pakutsvaga nekuisa chinhu, asi pane mhedzisiro - inodhura zvakanyanya uye zvinorambidzwa pakuvakazve hashi (kana uchiwedzera kana kubvisa dhisiki). Rimwe dambudziko rehashi inzvimbo yakanyatsoroverwa yedata isingagone kuchinjwa. Ndokunge, kana neimwe nzira dhisiki iri pasi pemutoro wakawedzera, saka sisitimu haina mukana wekusanyorera kwairi (nekusarudza imwe dhisiki), iyo hashi basa inosungira iyo data kuti iwanikwe maererano nemutemo, zvisinei kuti zvakaipa sei. iyo dhisiki iri, saka Ceph inodya ndangariro zhinji pakuvakazve iyo PG kana yekuzviporesa kana kuwedzera kuchengetedza. Mhedziso ndeyokuti Ceph inoshanda nemazvo (zvisinei zvishoma nezvishoma), asi chete kana pasina kuyera, mamiriro ekukurumidzira, kana kugadzirisa.
Kune, hongu, sarudzo dzekuwedzera mashandiro kuburikidza necaching uye cache kugovera, asi izvi zvinoda yakanaka hardware uye pachave nekurasikirwa. Asi zvakazara, Ceph inotarisa zvakanyanya kuyedza kupfuura Gluster yekubudirira. Zvakare, kana uchishandisa zvigadzirwa izvi, zvinofanirwa kutarisisa chinhu chakakosha - iyi idanho repamusoro rehunyanzvi, ruzivo uye hunyanzvi nekusimbisa kukuru paLinux, nekuti zvakakosha kuendesa, kugadzirisa uye kuchengetedza zvese nemazvo. izvo zvinoisa zvakanyanya mutoro uye mutoro kune maneja.
Vstorage
Iyo yekuvaka inotaridzika zvakanyanya kunakidza , iyo inogona kushandiswa pamwe chete ne hypervisor pane imwechete nodes, pane imwechete , asi zvakakosha kuti ugadzirise zvese nemazvo kuti uwane kuita kwakanaka. Kureva, kuendesa chigadzirwa chakadaro kubva mubhokisi pane chero gadziriso pasina kufunga nezve kurudziro zvinoenderana nemavakirwo zvichave zviri nyore, asi zvisingaite.
Chii chinogona kugarisana chekuchengetedza padivi pemasevhisi e kvm-qemu hypervisor, uye aya angori mashoma masevhisi uko compact optimal hierarchy yezvikamu zvakawanikwa: sevhisi yemutengi yakaiswa kuburikidza neFUSE (yakagadziridzwa, kwete yakavhurika sosi), MDS metadata sevhisi. (Metadata sevhisi), sevhisi Chunk service data blocks, iyo padanho remuviri yakaenzana nedhisiki imwe uye ndizvo zvese. Panyaya yekumhanya, hongu, zvakaringana kushandisa dhizaini-yekushivirira chirongwa chine replicas mbiri, asi kana ukashandisa caching uye matanda paSSD madhiraivha, ipapo kukanganisa-kushivirira coding (kubvisa coding kana raid6) inogona kuvharika zvine mutsindo pane hybrid scheme kana kunyange zvirinani pane ese flash. Pane kusavimbika neEC (bvisa coding): kana uchichinja imwe data block, zvinodikanwa kuverengera zvakare huwandu hwehuwandu. Kuti ipfuure kurasikirwa kwakabatana nekuvhiya uku, Ceph inonyorera EC zvishoma nezvishoma uye matambudziko ekuita anogona kuitika panguva yekukumbira, apo, semuenzaniso, mabhuroko ese anoda kuverengwa, uye kana iri Virtuozzo Storage, kunyora kwakachinja mabhuroki kunoitwa. uchishandisa iyo "log-yakagadziriswa faira system" nzira, iyo inoderedza parity kuverenga mutengo. Kufungidzira zvingangoita sarudzo nekukasira kwebasa ne uye pasina EC, kune - iyo nhamba inogona kunge yakaenzana zvichienderana nehuwandu hwehuwandu hwemugadziri wezvigadzirwa, asi mugumisiro wekuverenga rubatsiro rwakanaka pakuronga kugadzirisa.
Dhiyagiramu yakapfava yezvikamu zvekuchengetera hairevi kuti zvikamu izvi hazvitore asi kana iwe ukaverenga ese mutengo pamberi, unogona kuvimba nekubatana padyo ne hypervisor.
Pane chirongwa chekuenzanisa kushandiswa kwezviwanikwa zvehardware neCeph uye Virtuozzo kuchengetedza masevhisi.
Kana kare zvaikwanisika kuenzanisa Gluster neCeph vachishandisa zvinyorwa zvekare, vachishandisa mitsara inonyanya kukosha kubva kwavari, zvino neVirtuozzo zvakanyanya kuoma. Iko hakuna zvinyorwa zvakawanda pamusoro pechigadzirwa ichi uye ruzivo runogona kungotorwa kubva pane zvinyorwa pa kana muchiRussia kana tikafunga Vstorage sechichengetedzo chinoshandiswa mune dzimwe hyperconverged mhinduro mumakambani akadai uye Acronis.
Ini ndichaedza kubatsira netsananguro yezvivakwa izvi, saka pachave nekamwe magwaro, asi zvinotora nguva yakawanda kuti unzwisise zvinyorwa iwe pachako, uye zvinyorwa zviripo zvinogona kungoshandiswa sereferensi nekudzokorora tafura. zvemukati kana kutsvaga nekiyi izwi.
Ngatitarisei maitiro ekurekodha mune yakasanganiswa hardware kumisikidzwa ine zvikamu zvinotsanangurwa pamusoro: kurekodha kunotanga kuenda kune iyo node yakatangwa nemutengi (iyo FUSE mount point service), asi iyo Metadata Service (MDS) master component ichaita hongu. tungamira mutengi zvakananga kune inodiwa chunk sevhisi (yekuchengetedza sevhisi CS zvidhinha), ndiko kuti, MDS haibatanidzi mukurekodha maitiro, asi inongotungamira sevhisi kune inodiwa chunk. Kazhinji, tinogona kupa fananidzo yekurekodha nekudira mvura mumadhiramu. Imwe neimwe dhiramu ndeye 256MB data block.
Ndiko kuti, imwe dhisiki imwe nhamba yemabhodhoro akadaro, ndiko kuti, vhoriyamu yedhisiki yakakamurwa ne256MB. Kopi imwe neimwe inogoverwa kune imwe node, yechipiri inenge yakafanana kune imwe node, nezvimwewo ... Kana tine replicas nhatu uye pane SSD disks for cache (yekuverenga nekunyora matanda), ipapo kusimbiswa kwekunyora kuchaitika mushure mekunyora. irogi kuSSD, uye parallel reset kubva kuSSD inoenderera paHDD, sekunge kumashure. Panyaya yematatu akadzokorora, rekodhi ichaitwa mushure mekusimbiswa kubva kuSSD yetatu node. Zvinogona kuita sekuti huwandu hwekumhanya kwekunyora kwemaSSD matatu hunogona kukamurwa nevatatu uye isu tichawana kumhanya kwekunyora kweimwe replica, asi makopi akanyorwa zvakafanana uye network Latency kumhanya inowanzo kwira kupfuura iyo yeSSD, uye kutaura zvazviri kunyora kuita kuchaenderana netiweki. Panyaya iyi, kuti uone IOPS chaiyo, unofanirwa kurodha Vstorage yese nemazvo , ndiko kuti, kuyedza mutoro chaiwo, uye kwete chiyeuchidzo uye cache, pazvinofanirwa kufunga nezveiyo chaiyo data block saizi, nhamba yeshinda, nezvimwe.
Iyo yataurwa pamusoro apa yekurekodha log paSSD inoshanda nenzira yekuti kana data rangopinda mairi, rinobva raverengwa nesevhisi uye rinonyorerwa kuHDD. Kune akati wandei metadata masevhisi (MDS) pa cluster uye nhamba yavo inotarwa nequorum, iyo inoshanda zvinoenderana nePaxos algorithm. Kubva pakuona kwemutengi, iyo FUSE gomo poindi inzvimbo yekuchengetera folda iyo inoonekwa panguva imwe chete kune ese node musumbu, imwe neimwe node ine yakamisikidzwa mutengi zvinoenderana neiyi musimboti, saka kuchengetedza uku kunowanikwa kune imwe neimwe node.
Nokuda kwekuita kweimwe yenzira dzakatsanangurwa pamusoro apa, zvakakosha zvikuru, panguva yekuronga uye yekuendesa, kunyatsogadzirisa network, apo pachava nekuenzana nekuda kwekuunganidza uye kusarudzwa nenzira yakarurama network network bandwidth. Mukuunganidza, zvakakosha kusarudza iyo chaiyo hashing mode uye furemu saizi. Kune zvakare mutsauko wakasimba kwazvo kubva kuSDS yakatsanangurwa pamusoro, iyi fuse ine fast nzira tekinoroji muVirtuozzo Storage. Iyo, mukuwedzera kune yemazuva ano fuse, kusiyana nemamwe akavhurika sosi mhinduro, zvakanyanya kuwedzera IOPS uye inobvumidza iwe kuti usaganhurwe neyakachinjika kana yakatwasuka kuyera. Kazhinji, zvichienzaniswa nemapurani anotsanangurwa pamusoro apa, iyi inotaridzika ine simba, asi nekuda kwekunakidzwa kwakadaro, hongu, iwe unofanirwa kutenga marezinesi, kusiyana neCeph uye Gluster.
Kupfupisa, tinogona kuratidza pamusoro pevatatu: Virtuozzo Kuchengeta inotora nzvimbo yekutanga maererano nekuita uye kuvimbika kwekuvaka, Ceph inotora nzvimbo yechipiri, uye Gluster inotora nzvimbo yechitatu.
Maitiro ayo Virtuozzo Storage yakasarudzwa: iyo yakakwana seti yezvivakwa zvezvivakwa, yakagadziridzwa yeiyi nzira yeFuse nenzira inokurumidza, inochinjika seti yezvigadziriso zvehardware, kushomeka kwekushandisa uye kugona kugovera nekombuta (computing/virtualization), ndiko kuti, inonyatsokodzera hyperconverged solution , iyo yaari chikamu. Nzvimbo yechipiri iCeph nekuti inogadzira zvivakwa zvakanyanya kana ichienzaniswa neGluster, nekuda kwekushanda kwayo mumabhuraki, pamwe neakawanda anochinjika mamiriro uye kugona kushanda mumasumbu makuru.
Pane zvirongwa zvekunyora kuenzanisa pakati pevSAN, Space Direct Storage, Vstorage uye Nutanix Storage, kuedza Vstorage paHPE neHuawei midziyo, pamwe chete nemamiriro ekubatanidza Vstorage nekunze kwekuchengetedza hardware systems, saka kana iwe wakafarira chinyorwa, chingave. zvakanaka kuwana mhinduro kubva kwauri, izvo zvinogona kuwedzera kurudziro yezvinyorwa zvitsva, uchifunga nezve zvaunotaura uye zvishuwo.
Source: www.habr.com