Tom qab ib xyoos ntev lull nyob rau hauv txoj kev loj hlob ua hauj lwm rau ib ceg tshiab ntawm ib tug txhaum-tolerant faib ntaub ntawv system ΠΈ thib ob tso tus neeg sib tw. Tsis ntev los no kev hloov pauv ntawm cov tswv ntawm lub tuam txhab tsim LizardFS, kev tswj hwm tshiab tau txais yuav thiab cov neeg tsim khoom raug hloov. Tau ob xyoos dhau los, qhov project tau raug tshem tawm ntawm lub zej zog thiab tsis tau them nyiaj txaus rau nws, tab sis pab pawg tshiab npaj siab rov ua kom muaj kev sib raug zoo yav dhau los nrog zej zog thiab tsim kom muaj kev sib raug zoo nrog nws. Qhov project code yog sau ua lus C thiab C ++ thiab nyob rau hauv GPLv3 daim ntawv tso cai.
Looj Yaj ib qho kev faib cov ntaub ntawv hauv pawg, uas tso cai rau koj faib cov ntaub ntawv hla cov servers sib txawv, tab sis muab kev nkag mus rau lawv nyob rau hauv daim ntawv ntawm ib qho kev faib loj, uas yog ua haujlwm nrog zoo ib yam li cov kev faib disk ib txwm muaj. Lub mounted muab faib nrog LizardFS txhawb POSIX cov ntaub ntawv cwj pwm, ACLs, xauv, qhov (socket), cov kav dej, cov ntaub ntawv ntaus ntawv, cov cim thiab cov txuas nyuaj. Lub kaw lus tsis muaj ib qho kev ua tsis tiav; tag nrho cov khoom siv rov ua dua. Parallelization ntawm cov ntaub ntawv ua haujlwm tau txais kev txhawb nqa (ntau tus neeg siv khoom tuaj yeem nkag mus rau cov ntaub ntawv ib txhij).
Txhawm rau kom ntseeg tau tias kev zam txim txhaum cai, cov ntaub ntawv raug muab faib ua cov khoom sib txawv, uas tau muab faib thoob plaws ntawm cov nodes nrog redundancy (ntau cov ntawv luam tau muab tso rau ntawm cov nodes sib txawv); yog cov nodes lossis drives tsis ua haujlwm, lub kaw lus tseem ua haujlwm yam tsis muaj cov ntaub ntawv poob thiab cia li rov faib cov ntaub ntawv. noj mus rau hauv tus account qhov seem nodes. Txhawm rau nthuav dav qhov chaw cia, nws txaus los txuas cov nodes tshiab rau nws yam tsis tas yuav tsum ua haujlwm rau kev saib xyuas (lub kaw lus nws tus kheej replicates ib feem ntawm cov ntaub ntawv rau cov servers tshiab thiab sib npaug ntawm qhov chaw khaws cia suav nrog cov servers tshiab). Koj tuaj yeem ua tib yam los txo qhov loj ntawm pawg - koj tuaj yeem yooj yim lov tes taw cov cuab yeej siv uas tau raug tshem tawm ntawm qhov system.
Cov ntaub ntawv thiab metadata raug muab cais. Rau kev ua haujlwm, nws raug nquahu kom nruab ob lub metadata servers ua haujlwm hauv hom qhev, nrog rau tsawg kawg ob lub chaw khaws ntaub ntawv (chunkserver). Tsis tas li ntawd, txhawm rau thaub qab metadata, cav servers tuaj yeem siv los khaws cov ntaub ntawv hais txog kev hloov pauv hauv metadata thiab tso cai rau koj rov ua haujlwm thaum muaj kev puas tsuaj rau tag nrho cov metadata servers uas twb muaj lawm. Txhua cov ntaub ntawv tau muab faib ua cov blocks (chunks), txog li 64 MB loj. Blocks raug faib tawm ntawm cov chaw khaws cia raws li cov kev xaiv rov ua dua: tus qauv (kev txiav txim siab meej ntawm cov ntawv luam uas yuav tsum tau muab tso rau ntawm cov nodes sib txawv, suav nrog kev cuam tshuam rau tus kheej cov npe - rau cov ntaub ntawv tseem ceeb cov ntawv luam tuaj yeem nce ntxiv, thiab rau Cov ntaub ntawv tsis tseem ceeb txo), XOR (RAID5) thiab EC (RAID6).
Kev khaws cia tuaj yeem ntsuas txog qhov ntau thiab tsawg petabyte. Cov cheeb tsam ntawm daim ntawv thov suav nrog kev khaws cia, khaws cia ntawm cov duab tshuab virtual, cov ntaub ntawv multimedia, thaub qab, siv raws li DRC (Disaster Recovery Center) thiab khaws cia hauv cov kev ua haujlwm siab. LizardFS muab kev nyeem ntawv ceev heev rau cov ntaub ntawv ntawm txhua qhov loj me, thiab thaum sau ntawv, nws qhia tau hais tias kev ua tau zoo thaum sau tag nrho cov ntaub ntawv loj thiab nruab nrab, thaum tsis muaj kev hloov kho tas li, kev ua haujlwm hnyav nrog qhib cov ntaub ntawv, thiab ua haujlwm ib zaug nrog ib qho pawg ntawm cov ntaub ntawv me me.
Ntawm cov yam ntxwv ntawm FS, ib tus tuaj yeem nco ntsoov qhov muaj kev txhawb nqa rau snapshots, xav txog lub xeev cov ntaub ntawv nyob rau lub sijhawm, thiab kev siv ua ke ntawm "recycle bin" (cov ntaub ntawv tsis raug tshem tawm tam sim ntawd thiab muaj rau rov qab rau qee lub sijhawm). Kev nkag mus rau qhov muab faib tuaj yeem txwv los ntawm IP chaw nyob lossis tus password (zoo ib yam li NFS). Muaj quota thiab zoo ntawm cov kev pab cuam tswj mechanisms uas tso cai rau koj txwv qhov loj thiab bandwidth rau tej pawg neeg siv. Nws muaj peev xwm tsim cov chaw khaws cia hauv thaj chaw, cov ntu uas nyob hauv cov chaw sib txawv.
Qhov project LizardFS tau tsim nyob rau hauv 2013 raws li ib tug diav rawg , thiab sib txawv feem ntau nyob rau hauv lub xub ntiag ntawm ib tug replication hom raws li Reed-Solomon yuam kev kho codes (analogous rau raidzN), nthuav ACL kev them nyiaj yug, muaj ib tug neeg siv rau lub qhov rais platform, ntxiv optimizations (piv txwv li, thaum muab ib tug neeg siv thiab. cov neeg rau zaub mov cia, thaiv, yog tias ua tau, raug xa mus nrog cov node tam sim no, thiab cov metadata yog cached hauv lub cim xeeb), lub kaw lus hloov tau yooj yim dua, kev txhawb nqa rau cov ntaub ntawv nyeem ua ntej, cov npe quotas thiab rov ua haujlwm sab hauv.
LizardFS 3.13.0 tau teem sijhawm tso tawm thaum lub Kaum Ob Hlis kawg. Lub ntsiab innovation ntawm LizardFS 3.13 yog kev siv qhov kev pom zoo algorithm los xyuas kom meej qhov ua txhaum cai (hloov cov tswv servers thaum tsis ua haujlwm) (siv peb tus kheej kev siv ntawm uRaft, uas yav tas los siv hauv cov khoom lag luam). Siv uRaft ua kom yooj yim rau kev teeb tsa thiab txo qis kev ua haujlwm rov qab qeeb, tab sis yuav tsum muaj tsawg kawg yog peb qhov chaw ua haujlwm, ib qho yog siv rau pawg pawg.
Lwm yam kev hloov pauv: tus neeg siv khoom tshiab raws li FUSE3 subsystem, daws teeb meem nrog kev kho qhov yuam kev, nfs-ganesha plugin tau rov sau ua lus C. Hloov kho 3.13.0-rc2 kho ntau yam kab mob tseem ceeb uas ua rau kev sim dhau los ntawm 3.13 ceg siv tsis tau (kho rau 3.12 ceg tseem tsis tau luam tawm, thiab qhov hloov tshiab ntawm 3.12 txog 3.13 tseem ua rau kom tiav cov ntaub ntawv poob).
Hauv 2020, kev ua haujlwm yuav tsom mus rau kev txhim kho
, ib tug tshiab tag rewritten LizardFS kernel, uas, raws li cov developers, yuav muab ib tug peb-fold nce nyob rau hauv kev ua tau zoo piv rau ceg 3.12. Agama yuav hloov mus rau qhov kev tshwm sim-tsav architecture, asynchronous input / output raws li , ua haujlwm feem ntau hauv cov neeg siv qhov chaw (kom txo qis kev vam khom ntawm kernel caching mechanisms). Tsis tas li ntawd, ib qho tshiab debugging subsystem thiab lub network kev soj ntsuam kev ua haujlwm nrog kev txhawb nqa rau kev ua haujlwm pib-tuning yuav raug muab.
Tus neeg siv LizardFS yuav ntxiv kev txhawb nqa tag nrho rau kev sau ntawv ua haujlwm, uas yuav txhim kho kev ntseeg siab ntawm kev puas tsuaj rov qab los, daws cov teeb meem uas tshwm sim thaum cov neeg siv sib txawv sib koom nkag mus rau tib cov ntaub ntawv, thiab tso cai rau kev txhim kho kev ua tau zoo. Tus neeg siv yuav raug xa mus rau nws tus kheej network subsystem ua haujlwm hauv cov neeg siv qhov chaw. Thawj tus qauv ua haujlwm ntawm LizardFS raws li Agama tau npaj yuav npaj rau lub quarter thib ob ntawm 2020. Tib lub sijhawm, lawv cog lus tias yuav siv cov cuab yeej rau kev sib koom ua ke LizardFS nrog Kubernetes platform.
Tau qhov twg los: opennet.ru