Patatha chaka chonse kukhazikika kugwira ntchito panthambi yatsopano yamafayilo omwe amagawira zolakwika ΠΈ wachiwiri womasulidwa. Posachedwapa kusintha kwa eni ake a kampani yomwe ikupanga LizardFS, kasamalidwe katsopano kadatengedwa ndipo opanga adasinthidwa. Kwa zaka ziwiri zapitazi, polojekitiyi idachotsedwa m'deralo ndipo sinapereke chisamaliro chokwanira, koma gulu latsopanoli likufuna kutsitsimutsa ubale wakale ndi anthu ammudzi ndikukhazikitsa mgwirizano wapamtima nawo. Khodi ya polojekitiyi imalembedwa m'zilankhulo za C ndi C ++ ndi pansi pa layisensi ya GPLv3.
BuluziFS dongosolo logawidwa la masango, lomwe limakupatsani mwayi wogawa deta pamaseva osiyanasiyana, koma perekani mwayi wopezeka nawo mu mawonekedwe a gawo limodzi lalikulu, lomwe limagwiritsidwa ntchito mofanana ndi magawo azikhalidwe a disk. Gawo lokhazikitsidwa ndi LizardFS limathandizira mawonekedwe a fayilo ya POSIX, ma ACL, maloko, soketi, mapaipi, mafayilo azipangizo, maulalo ophiphiritsa komanso olimba. Dongosolo ilibe mfundo imodzi yolephera; zigawo zonse ndizosowa. Kufanana kwa ntchito za data kumathandizidwa (makasitomala angapo amatha kupeza mafayilo nthawi imodzi).
Kuonetsetsa kulolerana kwa zolakwika, deta imagawidwa m'ma replicas, omwe amagawidwa m'malo osiyanasiyana ndi redundancy (makopi angapo amaikidwa pamagulu osiyanasiyana); ngati node kapena ma drive akulephera, dongosololi likupitiriza kugwira ntchito popanda kutaya chidziwitso ndikugawanso deta. poganizira mfundo zotsalira. Kuti muwonjezere zosungirako, ndikwanira kulumikiza ma node atsopano kwa izo popanda kuyimitsa ntchito yokonza (dongosolo lokhalo limapereka gawo la deta ku ma seva atsopano ndikulinganiza zosungirako poganizira ma seva atsopano). Mungachite zomwezo kuti muchepetse kukula kwa masango - mutha kungoletsa zida zosatha zomwe zikuchotsedwa mudongosolo.
Deta ndi metadata zimasungidwa padera. Kuti mugwiritse ntchito, tikulimbikitsidwa kukhazikitsa ma seva awiri a metadata omwe akugwira ntchito mu master-slave mode, komanso ma seva awiri osungira deta (chunkserver). Kuphatikiza apo, kuti musunge metadata, ma seva a log angagwiritsidwe ntchito kusungira zambiri zakusintha kwa metadata ndikukulolani kuti mubwezeretse ntchito pakawonongeka ma seva onse omwe alipo. Fayilo iliyonse imagawidwa kukhala midadada (chunks), mpaka 64 MB kukula. Mipikisano imagawidwa pakati pa ma seva osungiramo molingana ndi njira yobwereza yosankhidwa: muyezo (kutsimikiza momveka bwino kwa chiwerengero cha makope oti aikidwe pamagulu osiyanasiyana, kuphatikizapo zokhudzana ndi zolemba zapadera - pa deta yofunikira chiwerengero cha makope chikhoza kuwonjezeka, ndi kwa deta yosafunikira yachepetsedwa), XOR (RAID5) ndi EC (RAID6).
Kusungirako kumatha kukula mpaka kukula kwa petabyte. Malo ogwiritsira ntchito akuphatikizapo kusungirako zakale, kusungirako zithunzi zamakina, ma multimedia data, zosunga zobwezeretsera, kugwiritsa ntchito ngati DRC (Disaster Recovery Center) komanso kusungirako m'magulu apakompyuta ochita bwino kwambiri. LizardFS imapereka liwiro lowerengera kwambiri pamafayilo amtundu uliwonse, ndipo polemba, imawonetsa magwiridwe antchito abwino polemba mafayilo akulu akulu ndi apakatikati, pomwe palibe kusinthidwa kosalekeza, ntchito yayikulu yokhala ndi mafayilo otseguka, komanso magwiridwe antchito anthawi imodzi magulu ang'onoang'ono owona.
Zina mwazinthu za FS, mutha kuzindikiranso kupezeka kwa chithandizo chazithunzi, kuwonetsa mawonekedwe a mafayilo panthawi inayake, komanso kukhazikitsidwa kwa "recycle bin" (mafayilo samachotsedwa nthawi yomweyo ndipo amapezeka kuchira kwakanthawi). Kufikira magawo kumatha kuchepetsedwa ndi adilesi ya IP kapena mawu achinsinsi (ofanana ndi NFS). Pali magawo ndi njira zoyendetsera ntchito zomwe zimakulolani kuchepetsa kukula ndi bandwidth pamagulu ena a ogwiritsa ntchito. Ndizotheka kupanga malo osungiramo malo omwe amagawidwa, magawo omwe ali m'malo osiyanasiyana a deta.
Ntchito ya LizardFS idakhazikitsidwa mu 2013 ngati foloko , ndipo zimasiyana makamaka pamaso pa njira yobwerezabwereza yochokera ku Reed-Solomon zolakwika zowongolera zizindikiro (zofanana ndi raidzN), chithandizo chokulitsidwa cha ACL, kukhalapo kwa kasitomala pa nsanja ya Windows, kukhathamiritsa kowonjezera (mwachitsanzo, pophatikiza kasitomala ndi makasitomala). seva yosungirako, midadada, ngati n'kotheka, imatumizidwa ndi node yamakono, ndipo metadata imasungidwa m'makumbukidwe), dongosolo losinthika losinthika, kuthandizira kuwerengera deta, quotas quotas ndi rework mkati.
LizardFS 3.13.0 ikuyembekezeka kutulutsidwa kumapeto kwa Disembala. Kupanga kwakukulu kwa LizardFS 3.13 ndikugwiritsa ntchito algorithm yogwirizana kuti muwonetsetse kulekerera zolakwika (kusintha ma seva ambuye ngati kulephera) (imagwiritsa ntchito kukhazikitsidwa kwathu kwa uRaft, yomwe idagwiritsidwa ntchito kale pazinthu zamalonda). Kugwiritsa ntchito uRaft kumathandizira kasinthidwe ndikuchepetsa kuchedwa kuchira, koma kumafuna ma node osachepera atatu, imodzi yomwe imagwiritsidwa ntchito pa quorum.
Zosintha zina: kasitomala watsopano kutengera gawo laling'ono la FUSE3, kuthetsa mavuto ndi kukonza zolakwika, plugin ya nfs-ganesha yalembedwanso m'chinenero cha C. Kusintha kwa 3.13.0-rc2 kumakonza zolakwika zingapo zomwe zidapangitsa kuti mayeso am'mbuyo a nthambi ya 3.13 asagwiritsidwe ntchito (zokonza za nthambi ya 3.12 sizinasindikizidwe, ndipo zosintha kuchokera ku 3.12 mpaka 3.13 zimatsogolerabe kutayika kwa data).
Mu 2020, ntchito idzayang'ana pakukula
, kernel yatsopano yolembedwanso kwathunthu ya LizardFS, yomwe, malinga ndi omanga, idzapereka kuwonjezeka katatu poyerekeza ndi nthambi 3.12. Agama isintha kupita ku zomangamanga zoyendetsedwa ndi zochitika, zolowetsamo / zotuluka , gwirani ntchito makamaka pamalo ogwiritsira ntchito (kuchepetsa kudalira njira zosungira kernel). Kuphatikiza apo, njira yatsopano yosinthira zolakwika ndi makina osanthula zochitika pamaneti omwe ali ndi chithandizo chowongolera magwiridwe antchito adzaperekedwa.
Makasitomala a LizardFS adzawonjezera chithandizo chokwanira pakumasulira ntchito zolembera, zomwe zithandizira kudalirika kwa kubwezeretsa masoka, kuthetsa mavuto omwe amabuka pamene makasitomala osiyanasiyana amagawana nawo deta yomweyi, ndikulola kusintha kwakukulu kwa magwiridwe antchito. Makasitomala adzasamutsidwa ku netiweki yake yaying'ono yomwe ikugwira ntchito pamalo ogwiritsa ntchito. Mtundu woyamba wa LizardFS wozikidwa pa Agama wakonzedwa kuti ukhale wokonzeka mu gawo lachiwiri la 2020. Nthawi yomweyo, amalonjeza kukhazikitsa zida zophatikizira LizardFS ndi nsanja ya Kubernetes.
Source: opennet.ru