Patatha chaka chonse kukhazikika ikugwira ntchito panthambi yatsopano yamafayilo omwe amagawira zolakwika и wachiwiri womasulidwa posachedwa Kampani yomwe ikupanga LizardFS yasintha umwini, ndi oyang'anira atsopano ndi opanga. Kwa zaka ziwiri zapitazi, polojekitiyi yadzitalikirana ndi anthu ammudzi ndipo sinapereke chisamaliro choyenera, koma gulu latsopanoli likufuna kukonzanso ubale wake wakale ndi anthu ammudzi ndikukhazikitsa mgwirizano wapafupi. Khodi ya polojekitiyi imalembedwa mu C ndi C ++ ndi pansi pa layisensi ya GPLv3.
LizardFS Dongosolo la fayilo la cluster lomwe limalola kuti deta imwazike pamaseva angapo koma ifikiridwe ngati gawo limodzi, lalikulu, lofanana ndi magawo achikhalidwe a disk. Gawo lokhazikitsidwa ndi LizardFS limathandizira mafayilo a POSIX, ma ACL, maloko, soketi, mapaipi, mafayilo a chipangizo, maulalo ophiphiritsa, ndi maulalo olimba. Dongosolo ilibe mfundo imodzi yolephera, ndipo zigawo zonse ndizosowa. Ntchito zofananira za data zimathandizidwa (makasitomala angapo amatha kupeza mafayilo nthawi imodzi).
Kuti muwonetsetse kulekerera zolakwika, deta imagawidwa m'makalata omwe amagawidwa m'malo osiyanasiyana ndi redundancy (makopi angapo ali pamagulu osiyanasiyana). Pakachitika node kapena kulephera kuyendetsa galimoto, dongosololi likupitilizabe kugwira ntchito popanda kutayika kwa data ndikugawanso deta potengera ma node otsala. Kuti muwonjezere zosungirako, ingolumikizani ma node atsopano kwa izo popanda nthawi yokonzekera (dongosololi limangobwereza deta ina ku ma seva atsopano ndikugwirizanitsanso zosungirako kutengera ma seva atsopano). Njira yofananayo ingagwiritsidwe ntchito kuchepetsa kukula kwa masango—kungochotsa zida zomwe zatha zomwe zachotsedwa.
Deta ndi metadata zimasungidwa padera. Ndibwino kuti muyike ma seva awiri a metadata omwe akugwira ntchito mu master-slave mode, komanso ma seva awiri osungira deta (chunkservers). Ma seva a log angagwiritsidwenso ntchito posunga zosunga zobwezeretsera metadata. Amasunga zambiri zokhudzana ndi kusintha kwa metadata ndikulola kuchira pakawonongeka ma seva onse omwe alipo. Fayilo iliyonse imagawidwa kukhala midadada (chunks) mpaka 64 MB kukula. Mitsuko imagawidwa m'maseva osungiramo zinthu molingana ndi njira yobwereza yosankhidwa: muyezo (kulongosola momveka bwino chiwerengero cha makope oti aikidwe pamagulu osiyanasiyana, kuphatikizapo kugwirizanitsa ndi zolemba zapayekha-chiwerengero cha makope chikhoza kuwonjezeka kwa deta yofunikira ndikuchepa kwa deta yosafunika), XOR (RAID5), ndi EC (RAID6).
Zosungirako zimatha kukula mpaka ma petabytes. Mapulogalamuwa akuphatikiza kusungitsa zakale, kusunga zithunzi zamakina, ma multimedia data, zosunga zobwezeretsera, kuzigwiritsa ntchito ngati Disaster Recovery Center (DRC), komanso kusungirako m'magulu apakompyuta ochita bwino kwambiri. LizardFS imapereka kuthamanga kwapamwamba kwambiri kwa mafayilo amtundu uliwonse, ndikuwonetsa kulemba bwino kwa mafayilo onse akuluakulu ndi apakatikati, pamene palibe zosinthidwa nthawi zonse, ntchito yaikulu yokhala ndi mafayilo otseguka, kapena ntchito imodzi yokhala ndi mafayilo ang'onoang'ono ambiri.
Zina mwamafayilo amaphatikizanso thandizo lachithunzithunzi, lomwe limawonetsa mawonekedwe a mafayilo panthawi inayake, komanso "bin" yomangidwanso (mafayilo samachotsedwa nthawi yomweyo ndipo amakhalabe kuti abwezeretsedwe kwakanthawi). Kufikira magawowa kumatha kuletsedwa ndi adilesi ya IP kapena mawu achinsinsi (ofanana ndi NFS). Chiwerengero ndi njira zoyendetsera ntchito zilipo kuti zichepetse kukula ndi bandwidth pamagulu ena ogwiritsa ntchito. Njira zosungirako zogawidwa m'malo zimatha kupangidwa, ndi magawo omwe ali m'malo osiyanasiyana a data.
Ntchito ya LizardFS idakhazikitsidwa mu 2013 ngati foloko , ndipo imasiyana makamaka pakukhalapo kwa njira yobwerezabwereza kutengera ma code okonza zolakwika a Reed-Solomon (ofanana ndi raidzN), chithandizo cha ACL chowonjezera, komanso kukhalapo kwa kasitomala wa nsanjayi. Windows, makonzedwe owonjezera (mwachitsanzo, pophatikiza kasitomala ndi seva yosungira, ma block amaperekedwa kuchokera ku node yomwe ilipo nthawi iliyonse ikatheka, ndipo metadata imasungidwa mu memory), makina osinthika kwambiri, othandizira kuwerenga deta yoyambirira, kuchuluka kwa ma directory, ndi kukonzanso kwamkati.
LizardFS 3.13.0 ikuyembekezeka kutulutsidwa kumapeto kwa Disembala. Kupanga kwakukulu kwa LizardFS 3.13 ndiko kugwiritsa ntchito algorithm yogwirizana kuti atsimikizire kulolerana kwa zolakwika (kusintha ma seva akuluakulu pakalephera). (Amagwiritsa ntchito eni ake a uRaft, omwe amagwiritsidwa ntchito kale pazinthu zamalonda.) Kugwiritsa ntchito uRaft kumathandizira kukhazikitsa ndikuchepetsa kulephera kuchira, koma kumafuna ma node osachepera atatu, imodzi yomwe imakhala ngati quorum.
Kusintha kwina kumaphatikizapo kasitomala watsopano pogwiritsa ntchito FUSE3 subsystem, kukonza zolakwika, ndikulembanso nfs-ganesha plugin mu C. Kusintha 3.13.0-rc2 kukonza zolakwika zingapo zovuta zomwe zinapangitsa kuti mayesero am'mbuyo a 3.13 asagwiritsidwe ntchito (zokonza za nthambi ya 3.12 sizinasindikizidwebe, ndi kutayika kwa data 3.112).
Mu 2020, ntchito idzayang'ana pa chitukuko
, kernel yatsopano, yolembedwanso kwathunthu ya LizardFS, yomwe, malinga ndi omanga, idzapereka kuwonjezeka katatu poyerekeza ndi nthambi ya 3.12. Agama idzakhala ndi kusintha kwa zomangamanga zomwe zimayendetsedwa ndi zochitika, zosagwirizana ndi I/O kutengera , ikugwira ntchito makamaka pamalo ogwiritsira ntchito (kuchepetsa kudalira njira zosungira kernel). Kuphatikiza apo, njira yatsopano yosinthira zolakwika ndi makina osanthula zochitika pamaneti okhala ndi chithandizo cha autotuning cha magwiridwe antchito adzaperekedwa.
Makasitomala a LizardFS adzakulitsidwa ndi chithandizo chonse cha kumasulira, zomwe zithandizira kudalirika kwa kubwezeretsa masoka, kuthana ndi zovuta zomwe zimabuka makasitomala ambiri akapeza zomwezo, ndikuwongolera magwiridwe antchito. Makasitomala adzasamutsidwa kupita kumalo ake ochezera a pa intaneti. Chiwonetsero choyamba chogwira ntchito cha LizardFS chochokera ku Agama chakonzekera gawo lachiwiri la 2020. Panthawi imodzimodziyo, zida zogwirizanitsa za LizardFS ndi nsanja ya Kubernetes zimalonjezedwa.
Source: opennet.ru
