Mushure megore rakanyarara mubudiriro kushanda pabazi idzva rekutadza-kushivirira kugovera faira system ΠΈ wechipiri kusunungurwa mumiriri. Munguva pfupi yapfuura shanduko yevaridzi vekambani inogadzira LizardFS, manejimendi matsva akatorwa uye vagadziri vakatsiviwa. Kwemakore maviri apfuura, purojekiti yakabviswa munharaunda uye haina kutarisisa zvakakwana kwairi, asi timu nyowani ine chinangwa chekumutsiridza hukama hwekare nenharaunda uye kutanga kudyidzana kwayo. Iyo kodhi yeprojekiti yakanyorwa muC uye C ++ mitauro uye pasi peGPLv3 rezinesi.
LizardFS iyo yakagoverwa cluster file system, iyo inokutendera iwe kugovera data kune akasiyana maseva, asi kupa mukana kune iwo muchimiro chechikamu chimwe chete chikuru, icho chinoshandiswa nenzira yakafanana kune yechinyakare disk partitions. Chikamu chakamisikidzwa neLizardFS chinotsigira POSIX faira hunhu, ACLs, makiyi, zvigadziko, pombi, mafaira emidziyo, ekufananidzira uye yakaoma link. Iyo sisitimu haina kana imwe poindi yekutadza; zvese zvikamu zvakawandisa. Kufanana kwekushanda kwedata kunotsigirwa (vatengi vakati wandei vanogona kuwana mafaera panguva imwe chete).
Kuve nechokwadi chekushivirira kukanganisa, iyo data inokamurwa kuita replicas, iyo inogovaniswa munzvimbo dzakasiyana siyana ine redundancy (makopi akati wandei anoiswa pane akasiyana node); kana node kana madhiraivha akatadza, sisitimu inoramba ichishanda pasina kurasikirwa neruzivo uye otomatiki kugovera iyo data. tichifunga nezvemanodhi asara. Kuti uwedzere chengetedzo, zvinokwana kubatanidza node nyowani kwairi pasina kumisa basa rekugadzirisa (iyo system pachayo inodzokorora chikamu che data kumaseva matsva uye inoyera kuchengetedza ichifunga nezvemaseva matsva). Iwe unogona kuita zvimwe chete kuti uderedze saizi ye cluster - unogona kungodzima midziyo isingachashandi iri kubviswa kubva muhurongwa.
Data uye metadata zvakachengetwa zvakasiyana. Kuti ushande, zvinokurudzirwa kuisa maviri metadata maseva anoshanda mune tenzi-nhapwa modhi, pamwe neanosvika maviri ekuchengetedza data maseva (chunkserver). Pamusoro pezvo, kuchengetedza metadata, maseva elogi anogona kushandiswa kuchengetedza ruzivo nezve shanduko mune metadata uye inobvumidza iwe kudzoreredza kushanda kana chiitiko chakakuvadzwa kune ese aripo metadata maseva. Imwe neimwe faira yakakamurwa kuita zvidhinha (chunks), kusvika ku64 MB muhukuru. Mabhuroki anogovaniswa pakati pemasevha ekuchengetera zvinoenderana neakasarudzwa kudzokorora modhi: chiyero (yakajeka kutsunga kwenhamba yemakopi anofanirwa kuiswa panzvimbo dzakasiyana, kusanganisira maererano nemadhairekitori ega - kune yakakosha data nhamba yemakopi inogona kuwedzerwa, uye data isingakoshi yakaderedzwa), XOR (RAID5) uye EC (RAID6).
Kuchengeta kunogona kukwira kusvika petabyte saizi. Nzvimbo dzekushandisa dzinosanganisira kuchengetedza, kuchengetwa kwemifananidzo yemuchina chaiwo, data yemultimedia, backups, shandisa seDRC (Disaster Recovery Center) uye sekuchengetedza mumasumbu epamusoro ekombuta. LizardFS inopa kumhanya kwakanyanya kuverenga kwemafaira echero saizi, uye kana ichinyora, inoratidza kuita kwakanaka pakunyora mafaira makuru uye epakati nepakati, kana pasina kugadziridzwa nguva dzose, basa rakasimba rine mafaera akavhurika, uye mashandiro enguva imwe chete ane boka remafaira madiki.
Pakati pezvinhu zveFS, munhu anogona zvakare kuona kuvepo kwerutsigiro rwezvipfupi, kuratidza mamiriro emafaira pane imwe nguva, uye yakavakirwa-mukati meseji ye "recycle bin" (mafaira haabviswe nekukurumidza uye anowanikwa kupora kwenguva yakati). Kuwanikwa kune chikamu kunogona kudzikiswa neIP kero kana password (yakafanana neNFS). Kune quota uye mhando yemasevhisi manejimendi masisitimu ayo anobvumidza iwe kudzikamisa saizi uye bandwidth kune mamwe mapoka evashandisi. Zvinokwanisika kugadzira nzvimbo dzekuchengetera nzvimbo dzakagoverwa, zvikamu izvo zviri munzvimbo dzakasiyana dze data.
Iyo LizardFS chirongwa chakavambwa muna 2013 seforogo , uye inosiyana zvakanyanya pamberi peiyo nzira yekudzokorodza yakavakirwa paReed-Solomon kukanganisa kururamisa macode (anofanana neraidzN), yakawedzera rutsigiro rweACL, kuvapo kwemutengi weWindows platform, mamwe optimizations (semuenzaniso, kana uchibatanidza mutengi uye sevha yekuchengetedza, zvivharo, kana zvichibvira, zvinotumirwa nenode yemazuva ano, uye metadata yakachengetwa mundangariro), imwe inoshanduka-shanduka inogadzirisa system, tsigiro yekuverenga data kumberi, dhairekitori quotas uye mukati rework.
LizardFS 3.13.0 yakarongerwa kuburitswa mukupera kwaZvita. Iyo huru innovation yeLizardFS 3.13 iko kushandiswa kwekubvumirana kwegorgorithm kuti ive nechokwadi chekutadza kushivirira (kuchinja master server kana kutadza) (inoshandisa isu pachedu kuita kweRaft, iyo yaimboshandiswa muzvigadzirwa zvekutengesa). Kushandisa uRaft kunorerutsa gadziriso uye kunoderedza kutadza kudzoreredza kunonoka, asi kunoda anokwana matatu anoshanda node, imwe yacho inoshandiswa quorum.
Dzimwe shanduko: mutengi mutsva wakavakirwa paFUSE3 subsystem, kugadzirisa matambudziko nekugadzirisa kukanganisa, iyo nfs-ganesha plugin yakanyorwa patsva mumutauro weC. Kwidziridzo 3.13.0-rc2 inogadzirisa akati wandei akakosha tsikidzi akaita yapfuura bvunzo kuburitswa kwe3.13 bazi kusashanda (zvigadziriso zvebazi re3.12 hazvisati zvaburitswa, uye kuvandudzwa kubva ku3.12 kusvika 3.13 kuchiri kutungamirira kupedzisa kurasikirwa kwedata).
Muna 2020, basa richatarisa mukusimudzira
, itsva yakanyorwa zvachose LizardFS kernel, iyo, maererano nevagadziri, ichapa kuwedzera katatu mukushanda kana ichienzaniswa nebazi 3.12. Agama ichachinja kuenda kune chiitiko-inofambiswa dhizaini, asynchronous kupinza / kubuda kwakavakirwa. , shanda zvakanyanya munzvimbo yemushandisi (kudzikisa kutsamira pane kernel caching michina). Pamusoro pezvo, itsva debugging subsystem uye inetiweki chiitiko analyzer ine rutsigiro rwekuita otomatiki tuning ichapihwa.
Mutengi weLizardFS achawedzera tsigiro yakazara yekushandura kunyorera mashandiro, izvo zvichavandudza kuvimbika kwekudzoreredza njodzi, kugadzirisa matambudziko anomuka kana vatengi vakasiyana vachigovana kuwana kune imwechete data, uye kubvumira kwakakosha kuvandudzwa kwekuita. Mutengi anozoendeswa kune yayo yega network subsystem inoshanda munzvimbo yemushandisi. Yekutanga kushanda prototype yeLizardFS yakavakirwa paAgama yakarongwa kuve yakagadzirira muchikamu chechipiri che2020. Panguva imwecheteyo, vanovimbisa kushandisa zvishandiso zvekubatanidza LizardFS neKubernetes chikuva.
Source: opennet.ru