Bayan tsawon shekara guda a cikin ci gaba aiki akan sabon reshe na tsarin fayil ɗin da aka rarraba mara haƙuri и dan takarar saki na biyu. Kwanan nan canji na masu kamfanin haɓaka LizardFS, an karɓi sabon gudanarwa kuma an maye gurbin masu haɓakawa. A cikin shekaru biyu da suka gabata an janye aikin daga cikin al'umma kuma ba a kula da shi sosai ba, amma sabuwar tawagar ta yi niyyar farfado da alakar da ta gabata da al'umma tare da kulla alaka ta kut da kut da shi. An rubuta lambar aikin a cikin harsunan C da C++ da ƙarƙashin lasisin GPLv3.
LizardFS tsarin fayil ɗin cluster da aka rarraba, wanda ke ba ka damar rarraba bayanai a cikin sabobin daban-daban, amma samar da damar yin amfani da su a cikin nau'i mai girma guda ɗaya, wanda aka yi aiki tare da irin wannan hanyar zuwa sassan faifai na gargajiya. Bangare da aka ɗora tare da LizardFS yana goyan bayan halayen fayil na POSIX, ACLs, makullai, kwasfa, bututu, fayilolin na'ura, alamomi da hanyoyin haɗin kai. Tsarin ba shi da maki guda na gazawa; duk abubuwan da aka gyara ba su da yawa. Ana tallafawa daidaita ayyukan bayanai (abokan ciniki da yawa suna iya samun damar fayiloli lokaci guda).
Don tabbatar da haƙurin kuskure, an raba bayanan zuwa kwafi, waɗanda aka rarraba a cikin nodes daban-daban tare da sakewa (ana sanya kwafi da yawa akan nodes daban-daban); idan nodes ko tuƙi sun gaza, tsarin yana ci gaba da aiki ba tare da asarar bayanai ba kuma yana sake rarraba bayanan ta atomatik. la'akari da sauran nodes. Don fadada ajiyar ajiya, ya isa ya haɗa sababbin nodes zuwa gare shi ba tare da dakatar da aiki don kiyayewa ba (tsarin da kansa ya sake yin wani ɓangare na bayanan zuwa sababbin sabobin kuma yana daidaita ma'auni tare da la'akari da sababbin sabobin). Hakanan zaka iya yin haka don rage girman gungu - zaka iya kawai musaki kayan aikin da ba a gama ba waɗanda ake cirewa daga tsarin.
Ana adana bayanai da metadata daban. Don aiki, ana ba da shawarar shigar da sabar metadata guda biyu da ke aiki a cikin yanayin bawa, da kuma aƙalla sabar ajiyar bayanai guda biyu (chunkserver). Bugu da ƙari, don madadin metadata, ana iya amfani da sabar log don adana bayanai game da canje-canje a cikin metadata kuma su ba ku damar maido da aiki a yayin lalacewa ga duk sabar metadata data kasance. Kowane fayil an raba shi zuwa tubalan (chunks), har zuwa 64 MB a girman. Ana rarraba tubalan tsakanin sabobin ajiya daidai da yanayin da aka zaɓa na maimaitawa: daidaitaccen (bayanin ƙayyadaddun ƙayyadaddun adadin kwafin da za a sanya akan nodes daban-daban, gami da dangane da kundayen adireshi guda ɗaya - don mahimman bayanai ana iya ƙara adadin kwafin, kuma don an rage bayanan da ba su da mahimmanci), XOR (RAID5) da EC (RAID6).
Ma'ajiya na iya haɓaka har zuwa girman petabyte. Wuraren aikace-aikacen sun haɗa da adanawa, adana hotunan injin kama-da-wane, bayanan multimedia, madadin ajiya, amfani da matsayin DRC (Cibiyar Farfaɗo da Bala'i) da azaman ajiya a cikin gungu na ƙididdiga masu inganci. LizardFS yana ba da saurin karantawa sosai don fayiloli na kowane girman, kuma lokacin rubutawa, yana nuna kyakkyawan aiki yayin rubuta manyan fayiloli masu girma da matsakaici, lokacin da babu gyare-gyare akai-akai, aiki mai ƙarfi tare da buɗe fayilolin, da ayyukan lokaci ɗaya tare da gunkin kananan fayiloli.
Daga cikin fasalulluka na FS, wanda zai iya lura da kasancewar goyan bayan hotuna, yana nuna yanayin fayiloli a wani lokaci, da aiwatar da aiwatar da "sake yin fa'ida" (ba a share fayilolin nan da nan kuma suna samuwa ga dawo da wani lokaci). Ana iya iyakance isa ga bangare ta adireshin IP ko kalmar sirri (mai kama da NFS). Akwai ƙididdiga da ingancin hanyoyin sarrafa sabis waɗanda ke ba ku damar iyakance girman da bandwidth don wasu nau'ikan masu amfani. Yana yiwuwa a ƙirƙiri wuraren ajiya da aka rarraba a geographically, sassan da ke cikin cibiyoyin bayanai daban-daban.
An kafa aikin LizardFS a cikin 2013 a matsayin cokali mai yatsa , kuma ya bambanta da yawa a gaban yanayin kwafi dangane da lambobin gyara kuskuren Reed-Solomon (mai kama da raidzN), faɗaɗa goyon bayan ACL, kasancewar abokin ciniki don dandamali na Windows, ƙarin haɓakawa (misali, lokacin haɗa abokin ciniki da ƙari). uwar garken ajiya, tubalan, idan zai yiwu, ana aika tare da kumburi na yanzu, kuma ana adana metadata a cikin ƙwaƙwalwar ajiya), tsarin daidaitawa mafi sauƙi, goyon baya don karanta bayanan gaba, ƙididdiga na shugabanci da sake yin aiki na ciki.
LizardFS 3.13.0 yana shirin fitowa a ƙarshen Disamba. Babban haɓakar LizardFS 3.13 shine amfani da algorithm yarjejeniya don tabbatar da haƙurin kuskure (canza uwar garken sabobin idan ya gaza) (yana amfani da namu aiwatar da uRaft, wanda aka yi amfani da shi a baya a samfuran kasuwanci). Amfani da uRaft yana sauƙaƙa daidaitawa kuma yana rage jinkirin dawo da gazawa, amma yana buƙatar aƙalla nodes ɗin aiki guda uku, ɗaya daga cikinsu ana amfani dashi don ƙima.
Sauran canje-canje: sabon abokin ciniki dangane da tsarin FUSE3, magance matsaloli tare da gyara kuskure, nfs-ganesha plugin an sake rubuta shi cikin harshen C. Sabunta 3.13.0-rc2 yana gyara kurakurai masu mahimmanci da yawa waɗanda suka sanya fitar da gwajin baya na reshen 3.13 mara amfani (ba a buga gyara ga reshen 3.12 ba, kuma sabuntawa daga 3.12 zuwa 3.13 har yanzu yana haifar da cikakkiyar asarar bayanai).
A cikin 2020, aikin zai mayar da hankali kan haɓakawa
, sabon kwaya LizardFS da aka sake rubutawa gaba ɗaya, wanda, bisa ga masu haɓakawa, zai samar da haɓakar haɓaka sau uku idan aka kwatanta da reshe na 3.12. Agama zai canza zuwa tsarin gine-ginen da ke gudana, tushen shigarwa/fitarwa asynchronous , Yi aiki da farko a cikin sararin mai amfani (don rage dogaro ga hanyoyin caching kernel). Bugu da ƙari, za a ba da sabon tsarin gyara kurakurai da mai nazarin ayyukan cibiyar sadarwa tare da goyan baya don daidaitawa ta atomatik.
Abokin ciniki na LizardFS zai ƙara cikakken goyon baya ga ayyukan rubutu na sigar, wanda zai inganta amincin dawowar bala'i, magance matsalolin da suka taso lokacin da abokan ciniki daban-daban ke raba damar yin amfani da bayanai iri ɗaya, kuma suna ba da damar haɓaka ayyukan haɓaka mai mahimmanci. Za a canja wurin abokin ciniki zuwa tsarin cibiyar sadarwarsa da ke aiki a cikin sarari mai amfani. Samfurin aiki na farko na LizardFS dangane da Agama ana shirin kasancewa a shirye a cikin kwata na biyu na 2020. A lokaci guda, sun yi alkawarin aiwatar da kayan aiki don haɗawa da LizardFS tare da dandalin Kubernetes.
source: budenet.ru