Ngemva kokuthula unyaka wonke ekuthuthukisweni ukusebenza egatsheni elisha lesistimu yefayela esabalalisiwe ebekezelela amaphutha ΠΈ ikhandidethi lokukhululwa kwesibili. Muva nje ushintsho lwabanikazi benkampani ethuthukisa i-LizardFS, abaphathi abasha bamukelwa futhi abathuthukisi bashintshwa. Eminyakeni emibili edlule, iphrojekthi ihoxisiwe emphakathini futhi ayizange inake ngokwanele, kodwa ithimba elisha lihlose ukuvuselela ubudlelwano bangaphambili nomphakathi futhi lisungule ukuxhumana okuseduze nalo. Ikhodi yephrojekthi ibhalwe ngezilimi ze-C no-C ++ futhi ngaphansi kwelayisensi ye-GPLv3.
I-LizardFS uhlelo lwefayela leqoqo elisabalalisiwe, elikuvumela ukuthi usabalalise idatha kumaseva ahlukene, kodwa unikeze ukufinyelela kuwo ngendlela yokuhlukanisa okukodwa okukhulu, okusetshenzwa ngendlela efanayo nokuhlukaniswa kwediski yendabuko. Ingxenye efakiwe ene-LizardFS isekela izici zefayela ze-POSIX, ama-ACL, izingidi, amasokhethi, amapayipi, amafayela edivayisi, izixhumanisi ezingokomfanekiso neziqinile. Isistimu ayinalo iphuzu elilodwa lokwehluleka; zonke izingxenye azinamsebenzi. Ukufana kokusebenza kwedatha kuyasekelwa (amaklayenti amaningana angafinyelela amafayela ngesikhathi esisodwa).
Ukuqinisekisa ukubekezelelwa kwamaphutha, idatha ihlukaniswa ngama-replicas, asatshalaliswa ezindaweni ezahlukahlukene ngokuphindaphindeka (amakhophi amaningana abekwe ezindaweni ezihlukene); uma ama-node noma amadrayivu ehluleka, uhlelo luyaqhubeka nokusebenza ngaphandle kokulahlekelwa kolwazi futhi lusabalalisa kabusha idatha ngokuzenzakalelayo. kucatshangelwa amanodi asele. Ukwandisa isitoreji, kwanele ukuxhuma ama-node amasha kuso ngaphandle kokumisa umsebenzi wokulungisa (uhlelo ngokwalo luphindaphinda ingxenye yedatha kumaseva amasha futhi lulinganise isitoreji ngokucabangela amaseva amasha). Ungenza okufanayo ukuze unciphise usayizi weqoqo - ungamane ukhubaze okokusebenza okungasasebenzi okukhishwa ohlelweni.
Idatha nemethadatha kugcinwa ngokuhlukana. Ukuze usebenze, kunconywa ukufaka amaseva amabili emethadatha asebenza kumodi ye-master-slave, kanye okungenani namaseva amabili okugcina idatha (i-chunkserver). Ukwengeza, ukuze wenze ikhophi yemethadatha, amaseva elogi angasetshenziswa ukugcina ulwazi mayelana nezinguquko kumethadatha futhi akuvumela ukuba ubuyisele ukusebenza uma kwenzeka umonakalo kuwo wonke amaseva emethadatha akhona. Ifayela ngalinye lihlukaniswe ngamabhulokhi (izingcezu), afika ku-64 MB ngosayizi. Amabhulokhi asatshalaliswa phakathi kwamaseva esitoreji ngokuhambisana nemodi yokuphindaphinda ekhethiwe: okujwayelekile (ukunqunywa okucacile kwenani lamakhophi azobekwa ezindaweni ezihlukene, okuhlanganisa ngokuhlobene nezinkomba ngazinye - kudatha ebalulekile inani lamakhophi lingandiswa, futhi idatha engabalulekile incishisiwe), i-XOR (RAID5) ne-EC (RAID6).
Isitoreji singafika kumasayizi e-petabyte. Izindawo zokufaka isicelo zihlanganisa ukugcinwa kwengobo yomlando, ukugcinwa kwezithombe zemishini ebonakalayo, idatha yemidiya eningi, izipele, ukusetshenziswa njenge-DRC (Isikhungo Sokubuyisela Inhlekelele) kanye nanjengesitoreji kumaqoqo ekhompyutha asebenza kahle kakhulu. I-LizardFS inikeza isivinini sokufunda esiphezulu kakhulu samafayela anoma yimuphi usayizi, futhi lapho ubhala, ubonisa ukusebenza kahle lapho ubhala wonke amafayela amakhulu naphakathi nendawo, lapho kungekho ukuguqulwa okuqhubekayo, umsebenzi onzima onamafayela avulekile, kanye nokusebenza kwesikhathi esisodwa inqwaba yamafayela amancane.
Phakathi kwezici ze-FS, umuntu angakwazi futhi ukuqaphela ukuba khona kokusekelwa kwezifinyezo, okubonisa isimo samafayela ngesikhathi esithile, kanye nokuqaliswa okwakhelwe ngaphakathi "kwe-recycle bin" (amafayela awasuswa ngokushesha futhi ayatholakala ukuphumula isikhathi eside). Ukufinyelela ukwahlukanisa kungakhawulwa ngekheli le-IP noma iphasiwedi (efana ne-NFS). Kukhona isilinganiso kanye nekhwalithi yezindlela zokuphatha isevisi ezikuvumela ukuthi ukhawule usayizi nomkhawulokudonsa ezigabeni ezithile zabasebenzisi. Kungenzeka ukudala izindawo zokugcina ezisatshalaliswa ngokwezwe, izingxenye zazo ezitholakala ezindaweni ezihlukene zedatha.
Iphrojekthi ye-LizardFS yasungulwa ngo-2013 njengemfoloko , futhi ihluke kakhulu lapho kukhona imodi yokuphindaphinda esekelwe kumakhodi okulungisa amaphutha eReed-Solomon (afana ne-raidzN), ukwesekwa okunwetshiwe kwe-ACL, ukuba khona kweklayenti yesikhulumi se-Windows, ukulungiselelwa okwengeziwe (ngokwesibonelo, lapho kuhlanganiswa iklayenti kanye iseva yesitoreji, amabhlogo, uma kungenzeka, athunyelwa nge-node yamanje, futhi imethadatha igcinwe kunqolobane yememori), uhlelo lokumisa oluguquguqukayo, ukusekelwa kokufundwa kwedatha, ama-quotas wemibhalo kanye nokusebenza kabusha kwangaphakathi.
I-LizardFS 3.13.0 ihlelelwe ukuthi ikhishwe ekupheleni kukaDisemba. Ukuqamba okusha okuyinhloko kwe-LizardFS 3.13 ukusetshenziswa kwe-algorithm yokuvumelana ukuze kuqinisekiswe ukubekezelelana kwamaphutha (ukushintsha amaseva amakhulu uma kwenzeka kwehluleka) (isebenzisa ukwethulwa kwethu kwe-uRaft, ebisetshenziswa ngaphambilini emikhiqizweni yezentengiso). Ukusebenzisa i-uRaft kwenza ukumisa kube lula futhi kunciphisa ukubambezeleka kokutholwa kokwehluleka, kodwa kudinga okungenani ama-node amathathu asebenzayo, eyodwa yawo esetshenziselwa ikhoramu.
Ezinye izinguquko: iklayenti elisha elisekelwe ohlelweni olungaphansi lwe-FUSE3, ukuxazulula izinkinga ngokulungiswa kwephutha, i-plugin ye-nfs-ganesha ibhalwe kabusha ngolimi lwe-C. Buyekeza okuthi 3.13.0-rc2 lungisa iziphazamisi ezimbalwa ezibalulekile ezenze ukukhishwa kokuhlolwa kwangaphambilini kwegatsha elingu-3.13 kungasebenziseki (izilungiso zegatsha le-3.12 azikakashicilelwa, futhi isibuyekezo esisuka ku-3.12 siye ku-3.13 sisaholela ekuqedeni ukulahleka kwedatha).
Ngo-2020, umsebenzi uzogxila ekuthuthukisweni
, i-kernel entsha ye-LizardFS ebhalwe kabusha ngokuphelele, okuthi, ngokusho kwabathuthukisi, izohlinzeka ngokukhuphuka okuphindwe kathathu ekusebenzeni uma kuqhathaniswa negatsha 3.12. I-Agama izoshintshela esakhiweni esiqhutshwa umcimbi, okokufaka okuvumelanayo/okuphumayo okusekelwe , sebenza ngokuyinhloko esikhaleni somsebenzisi (ukunciphisa ukuncika ezindleleni zokulondoloza i-kernel). Ukwengeza, isistimu engaphansi entsha yokususa iphutha kanye nesihlaziyi somsebenzi wenethiwekhi esinosekelo lokushuna okuzenzakalelayo kokusebenza kuzonikezwa.
Iklayenti le-LizardFS lizokwengeza ukwesekwa okugcwele kokusebenza kokubhala inguqulo, okuzokwenza ngcono ukuthembeka kokuthola inhlekelele, kuxazulule izinkinga eziphakamayo lapho amakhasimende ahlukene ehlanganyela ukufinyelela kudatha efanayo, futhi avumele ukuthuthukiswa kokusebenza okuphawulekayo. Iklayenti lizodluliselwa kusistimu yalo engaphansi yenethiwekhi esebenza endaweni yomsebenzisi. I-prototype yokuqala esebenzayo ye-LizardFS esekwe ku-Agama ihlelelwe ukuthi ibe isilungile ngekota yesibili ka-2020. Ngesikhathi esifanayo, bathembisa ukusebenzisa amathuluzi okuhlanganisa i-LizardFS nesiteji se-Kubernetes.
Source: opennet.ru