{"id":52513,"date":"2019-11-10T00:00:00","date_gmt":"2019-11-09T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/obnovlenie-klasternoj-fajlovoj-sistemy-lizardfs-3-13-0-rc2"},"modified":"2020-02-18T14:00:15","modified_gmt":"2020-02-18T11:00:15","slug":"obnovlenie-klasternoj-fajlovoj-sistemy-lizardfs-3-13-0-rc2","status":"publish","type":"post","link":"https:\/\/prohoster.info\/hr\/blog\/news\/obnovlenie-klasternoj-fajlovoj-sistemy-lizardfs-3-13-0-rc2","title":{"rendered":"A\u017euriranje klasterskog datote\u010dnog sustava LizardFS 3.13.0-rc2","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Nakon jednogodi\u0161nje pauze u razvoju ponovo je<\/a><\/noindex> nastavljena rad na novoj grani distribuiranog sustava datoteka otpornog na gre\u0161ke LizardF 3.13<\/a><\/noindex> i objavljeno<\/a><\/noindex> drugi kandidat za izdanja. Nedavno dogodilo se<\/a><\/noindex> promjena vlasnika tvrtke koja razvija LizardFS, novo vodstvo preuzelo je kontrolu i promijenili su se programeri. Posljednje dvije godine projekt se povukao iz zajednice i nije joj posve\u0107ivao dovoljnu pa\u017enju, ali novi tim namjerava obnoviti prethodne odnose s zajednicom i uspostaviti blisku suradnju. Kod projekta napisan je na jezicima C i C++ i distribuira se<\/a><\/noindex> pod licencom GPLv3. <\/p>\n

LizardFS je postao<\/a><\/noindex> je distribuirani klaster sustav datoteka koji omogu\u0107ava raspodjelu podataka po razli\u010ditim poslu\u017eiteljima, ali pristup njima prezentira u obliku jedinstvene velike particije, s kojom se upravlja analogno kao s tradicionalnim diskovnim particijama. U montiranoj particiji s LizardFS podr\u017eavaju se POSIX atributi datoteka, ACL, zaklju\u010davanja, socketi, cijevi, datoteke ure\u0111aja, simboli\u010dke i tvrde poveznice. Sustav nema jedinstvenu to\u010dku kvara, svi su komponente rezervne. Podr\u017eava se paralelizacija operacija s podacima (vi\u0161e klijenata mo\u017ee istovremeno pristupati datotekama).<\/p>\n

Za osiguranje otpornosti na kvarove, podaci se dijele na replikate koji se raspore\u0111uju po razli\u010ditim \u010dvorovima sa rezervacijom (na razli\u010ditim \u010dvorovima se smje\u0161taju vi\u0161e kopija) \u2014 u slu\u010daju kvara \u010dvorova ili diskova, sustav nastavlja rad bez gubitka informacija i automatski redistribuira podatke prema preostalim \u010dvorovima. Za pro\u0161irenje pohrane dovoljno je priklju\u010diti nove \u010dvorove bez zaustavljanja rada na odr\u017eavanju (sustav sam replicira dio podataka na nove poslu\u017eitelje i uravnote\u017eava pohranu uzimaju\u0107i u obzir nove poslu\u017eitelje). Sli\u010dno se mo\u017ee postupiti i za smanjenje veli\u010dine klastera \u2014 jednostavno se mo\u017ee isklju\u010diti zastarjela oprema iz sustava.<\/p>\n

Podaci i metapodaci se \u010duvaju odvojeno. Preporu\u010duje se postavljanje dva poslu\u017eitelja metapodataka koji rade u master-slave re\u017eimu, kao i najmanje dva poslu\u017eitelja za pohranu podataka (chunkserver). Dodatno, za rezerviranje metapodataka mogu se koristiti log poslu\u017eitelji koji pohranjuju informacije o promjeni metapodataka i omogu\u0107uju oporavak u slu\u010daju kvara svih postoje\u0107ih poslu\u017eitelja metapodataka. Svaka datoteka se dijeli na bloke (chunk) veli\u010dine do 64 MB. Blokovi se raspore\u0111uju po poslu\u017eiteljima za pohranu u skladu s odabranim re\u017eimom replikacije: standardni (izrijekom odre\u0111ivanje broja kopija za smje\u0161taj na razli\u010ditim \u010dvorovima, uklju\u010duju\u0107i vezano za odre\u0111ene kataloge \u2014 za va\u017ene podatke broj kopija mo\u017ee se pove\u0107ati, a za nebitne smanjiti), XOR (RAID5) i EC (RAID6).<\/p>\n

Skladi\u0161te se mo\u017ee skalirati do petabajtnih veli\u010dina. Me\u0111u podru\u010djima primene mogu se pomenuti vo\u0111enje arhiva, \u010duvanje slika virtuelnih ma\u0161ina, multimedijskih podataka, rezervnih kopija, kori\u0161\u0107enje kao DRC (Centar za oporavak od katastrofa) i kao skladi\u0161te u klasterima visokih performansi. LizardFS obezbe\u0111uje veoma visoku brzinu \u010ditanja datoteka bilo koje veli\u010dine, a prilikom pisanja pokazuje dobru performansu prilikom celokupnog zapisivanja velikih i srednjih datoteka, kada nema konstantnih modifikacija, intenzivnog rada sa otvorenim datotekama ili pojedina\u010dnih operacija sa gomilom malih datoteka.<\/p>\n

\"A\u017euriranje<\/a><\/noindex><\/center><\/p>\n

Me\u0111u zna\u010dajkama FS-a tako\u0111er se mo\u017ee istaknuti podr\u0161ka za snimke koje odra\u017eavaju stanje datoteka u odre\u0111eno vrijeme, te ugra\u0111ena implementacija \u201ekante za sme\u0107e\u201d (datoteke se ne bri\u0161u odmah i neko vrijeme su dostupne za oporavak). Pristup odjeljku mo\u017ee biti ograni\u010den prema IP-adresi ili lozinki (po uzoru na NFS). Postoje mehanizmi kvota i upravljanja kvalitetom usluge koji omogu\u0107uju ograni\u010denje veli\u010dine i propusnosti za odre\u0111ene kategorije korisnika. Mogu\u0107e je stvaranje teritorijalno distribuiranih pohrana \u010diji su segmenti smje\u0161teni u razli\u010ditim podatkovnim centrima. <\/p>\n

Projekt LizardFS osnovan je 2013. godine kao fork MooseFS<\/a><\/noindex>, i razlikuje se, prije svega, prisutno\u0161\u0107u na\u010dina replikacije temeljenog na Reed-Solomonovim kodovima (analog raidzN), pro\u0161irenom podr\u0161kom za ACL, prisutno\u0161\u0107u klijenta za Windows, dodatnim optimizacijama (na primjer, pri kombiniranju klijenta i poslu\u017eitelja za pohranu, blokovi se, kada je to mogu\u0107e, daju s trenutnog \u010dvora, a metapodaci se ke\u0161iraju u memoriji), fleksibilnijim sustavom pode\u0161avanja, podr\u0161kom za proaktivno \u010ditanje podataka, kvotama za kataloge i unutarnjim preinakama.<\/p>\n

LizardFS 3.13.0 planira se objaviti krajem decembra. Glavna novost LizardFS 3.13 je upotreba algoritma za dostizanje konsenzusa za obezbe\u0111ivanje otpornosti na gre\u0161ke (prebacivanje master servera u slu\u010daju kvara) Raft<\/a><\/noindex> (koristi se vlastita implementacija uRaft, koja je ranije kori\u0161\u0107ena u komercijalnim proizvodima). Kori\u0161\u0107enje uRaft pojednostavljuje pode\u0161avanje i smanjuje ka\u0161njenja prilikom oporavka od kvara, ali zahteva najmanje tri radna \u010dvora, od kojih se jedan koristi za kvorum. <\/p>\n

Od drugih izmena: novi klijent zasnovan na FUSE3 podsistemu, re\u0161avanje problema sa ispravljanjem gre\u0161aka, nfs-ganesha plugin je ponovo napisan u C jeziku. U a\u017euriranju 3.13.0-rc2 ispravljeno je nekoliko kriti\u010dnih gre\u0161aka koje su prethodne testne verzije grane 3.13 \u010dinile prakti\u010dno neupotrebljivima (ispravke za granu 3.12 jo\u0161 nisu objavljene, a nadogradnja sa 3.12 na 3.13 i dalje dovodi do potpunog gubitka podataka).<\/p>\n

U 2020. godini rad \u0107e biti fokusiran na razvoj
\nAgama<\/a><\/noindex>, novog potpuno prepisanog jezgra LizardFS-a, koje, prema re\u010dima developera, obezbedi\u0107e tri puta ve\u0107u efikasnost u pore\u0111enju sa granom 3.12. U Agama \u0107e biti sproveden prelazak na arhitekturu zasnovanu na doga\u0111ajima (event driven), asinhrono ulaz\/izlaz zasnovano na asio<\/a><\/noindex>, rad prete\u017eno u korisni\u010dkom prostoru (kako bi se smanjila zavisnost od mehanizama ke\u0161iranja jezgra). Dodatno \u0107e biti ponu\u0111en novi sistem za debagovanje i analiti\u010dar mre\u017ene aktivnosti sa podr\u0161kom za automatsko pode\u0161avanje performansi. <\/p>\n

U klijent LizardFS bit \u0107e dodana potpuna podr\u0161ka za verzioniranje operacija zapisivanja, \u0161to \u0107e pobolj\u0161ati pouzdanost oporavka nakon kvara, rije\u0161iti probleme koji nastaju prilikom zajedni\u010dkog pristupa razli\u010ditih klijenata istim podacima i omogu\u0107iti zna\u010dajno pove\u0107anje performansi. Klijent \u0107e biti preba\u010den na vlastiti mre\u017eni podsustav koji radi u korisni\u010dkom prostoru. Prvi radni prototip LizardFS na bazi Agama planira se pripremiti u drugom kvartalu 2020. godine. U to vrijeme tako\u0111er se o\u010dekuje implementacija sredstava za integraciju LizardFS s platformom Kubernetes.<\/p>\n

<\/a><\/noindex><\/p>\n

Izvor: opennet.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041f\u043e\u0441\u043b\u0435 \u0433\u043e\u0434\u0438\u0447\u043d\u043e\u0433\u043e \u0437\u0430\u0442\u0438\u0448\u044c\u044f \u0432 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0435 \u0432\u043e\u0437\u043e\u0431\u043d\u043e\u0432\u0438\u043b\u0430\u0441\u044c \u0440\u0430\u0431\u043e\u0442\u0430 \u043d\u0430\u0434 \u043d\u043e\u0432\u043e\u0439 \u0432\u0435\u0442\u043a\u043e\u0439 \u043e\u0442\u043a\u0430\u0437\u043e\u0443\u0441\u0442\u043e\u0439\u0447\u0438\u0432\u043e\u0439 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0444\u0430\u0439\u043b\u043e\u0432\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u044b LizardF 3.13 \u0438 \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043d \u0432\u0442\u043e\u0440\u043e\u0439 \u043a\u0430\u043d\u0434\u0430\u0434\u0430\u0442 \u0432 \u0440\u0435\u043b\u0438\u0437\u044b. \u041d\u0435\u0434\u0430\u0432\u043d\u043e \u043f\u0440\u043e\u0438\u0437\u043e\u0448\u043b\u0430 \u0441\u043c\u0435\u043d\u0430 \u0432\u043b\u0430\u0434\u0435\u043b\u044c\u0446\u0435\u0432 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438, \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u044e\u0449\u0435\u0439 LizardFS, \u0431\u044b\u043b\u043e \u043f\u0440\u0438\u043d\u044f\u0442\u043e \u043d\u043e\u0432\u043e\u0435 \u0440\u0443\u043a\u043e\u0432\u043e\u0434\u0441\u0442\u0432\u043e \u0438 \u0441\u043c\u0435\u043d\u0438\u043b\u0438\u0441\u044c \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u0447\u0438\u043a\u0438. \u041f\u043e\u0441\u043b\u0435\u0434\u043d\u0438\u0435 \u0434\u0432\u0430 \u0433\u043e\u0434\u0430 \u043f\u0440\u043e\u0435\u043a\u0442 \u043e\u0442\u0441\u0442\u0440\u0430\u043d\u0438\u043b\u0441\u044f \u043e\u0442 \u0441\u043e\u043e\u0431\u0449\u0435\u0441\u0442\u0432\u0430 \u0438 \u043d\u0435 \u0443\u0434\u0435\u043b\u044f\u043b \u0435\u043c\u0443 \u0434\u043e\u043b\u0436\u043d\u043e\u0433\u043e \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u044f, \u043d\u043e \u043d\u043e\u0432\u0430\u044f \u043a\u043e\u043c\u0430\u043d\u0434\u0430 \u043d\u0430\u043c\u0435\u0440\u0435\u043d\u0430 \u0432\u043e\u0437\u0440\u043e\u0434\u0438\u0442\u044c \u043f\u0440\u0435\u0436\u043d\u0438\u0435 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":52514,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-52513","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47A\u017euriranje klasterskog datote\u010dnog sustava LizardFS 3.13.0-rc2 | ProHoster","description":"Nakon godi\u0161nje stanke u razvoju, obnavlja se rad na novoj grani otporne distribuirane datote\u010dne.","canonical_url":"https:\/\/prohoster.info\/hr\/blog\/news\/obnovlenie-klasternoj-fajlovoj-sistemy-lizardfs-3-13-0-rc2","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"hr_HR","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u0431\u043d\u043e\u0432\u043b\u0435\u043d\u0438\u0435 \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u043d\u043e\u0439 \u0444\u0430\u0439\u043b\u043e\u0432\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u044b LizardFS 3.13.0-rc2 | ProHoster","og:description":"\u041f\u043e\u0441\u043b\u0435 \u0433\u043e\u0434\u0438\u0447\u043d\u043e\u0433\u043e \u0437\u0430\u0442\u0438\u0448\u044c\u044f \u0432 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0435 \u0432\u043e\u0437\u043e\u0431\u043d\u043e\u0432\u0438\u043b\u0430\u0441\u044c \u0440\u0430\u0431\u043e\u0442\u0430 \u043d\u0430\u0434 \u043d\u043e\u0432\u043e\u0439 \u0432\u0435\u0442\u043a\u043e\u0439 \u043e\u0442\u043a\u0430\u0437\u043e\u0443\u0441\u0442\u043e\u0439\u0447\u0438\u0432\u043e\u0439 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0444\u0430\u0439\u043b\u043e\u0432\u043e\u0439.","og:url":"https:\/\/prohoster.info\/hr\/blog\/news\/obnovlenie-klasternoj-fajlovoj-sistemy-lizardfs-3-13-0-rc2","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-11-09T21:00:00+00:00","article:modified_time":"2020-02-18T11:00:15+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"52513","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-24 03:51:39","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 17:15:56","updated":"2026-01-24 03:51:39","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/posts\/52513","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/comments?post=52513"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/posts\/52513\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/media\/52514"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/media?parent=52513"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/categories?post=52513"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/tags?post=52513"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}