Molo, kutsha nje ndiye ndadibana nomsebenzi onomdla wokuseta indawo yokugcina yokugcina inani elikhulu lezixhobo zebhloko.
Rhoqo ngeveki sixhasa bonke oomatshini abakwilifu lethu, ke kufuneka ukwazi ukukhonza amawaka ee-backups kwaye uyenze ngokukhawuleza nangokufanelekileyo.
Ngelishwa ulungelelwaniso olungagqibekanga UQHAGAMBO5, UQHAGAMBO6 kulo mzekelo, asiyi kusondela ukususela inkqubo yokubuyisela kwiidiski ezinkulu ezifana neyethu iya kuba yinde kabuhlungu kwaye inokwenzeka ukuba ayinakuphela.
Makhe sijonge ezinye iindlela:
-Ifana ne-RAID5, i-RAID6, kodwa kunye nenqanaba lokulingana okwenziwa ngokwezifiso. Kule meko, ugcino alwenziwanga ibhlokhi ngebhloko, kodwa kwinto nganye ngokwahlukileyo. Eyona ndlela ilula yokuzama ukucima ikhowudi kukwandisa .
luphawu olungakhutshwanga ngoku lwe-ZFS. Ngokungafaniyo ne-RAIDZ, i-DRAID inebhloko esasaziweyo yomlinganiso kwaye, ngexesha lokubuyisela, isebenzisa zonke iidiski zoluhlu ngokukhawuleza, ngenxa yokuba iphila ngcono kwiintsilelo zediski kwaye iphinde ibuyele ngokukhawuleza emva kokusilela.
Iseva iyafumaneka Fujitsu Primergy RX300 S7 ngeprosesa Intel Xeon CPU E5-2650L 0 @ 1.80GHz, iinkuni ezisithoba ze-RAM I-Samsung DDR3-1333 8Gb PC3L-10600R ECC ibhalisiwe (M393B1K70DH0-YH9), ishelufu yedisk I-Supermicro SuperChassis 847E26-RJBOD1idityaniswe nge I-Dual LSI SAS2X36 Expander kunye neediski ezingama-45 Seagage ST6000NM0115-1YZ110 kwi 6TB nganye.
Ngaphambi kokuba sithathe isigqibo malunga nantoni na, kufuneka kuqala sivavanye kakuhle yonke into.
Ukwenza oku, ndilungiselele kwaye ndivavanye ulungelelwaniso olwahlukeneyo. Ukwenza oku, ndisebenzise i-minio, esebenza njenge-backend ye-S3 kwaye iqhube ngeendlela ezahlukeneyo ngenani elahlukileyo leethagethi.
Ngokusisiseko, i-minio case yavavanywa kwi-erasure coding vs raid software enenani elifanayo leediski kunye needisks ze-parity, kwaye ezi zezi: RAID6, RAIDZ2 kunye ne-DRAID2.
Ireferensi: xa uqhuba i-minio ngethagethi enye kuphela, i-minio isebenza kwimowudi yesango ye-S3, inika inkqubo yakho yefayile yendawo njengogcino lwe-S3. Ukuba uqala i-minio ngeethagethi ezininzi, ngoko imowudi ye-Erasure Coding iya kuvula ngokuzenzekelayo, eya kusasaza idatha phakathi kweethagethi zakho kunye nokunikezelwa kokunyamezela impazamo.
Ngokungagqibekanga, i-minio iyahlula iithagethi zibe ngamaqela eediski ezili-16, apho iqela ngalinye linamacandelo amabini. Ezo. Iidrive ezimbini zinokusilela ngexesha elinye ngaphandle kokulahleka kwedatha.
Ukuvavanya ukusebenza, ndasebenzisa iidiski ze-16 ze-6TB nganye kwaye ndabhala izinto ezincinci ze-1MB ngobukhulu kuzo, oku kuchazwe ngokuchanekileyo umthwalo wethu wexesha elizayo, ekubeni zonke izixhobo zokulondoloza zanamhlanje zahlula idatha kwiibhloko zeemegabytes ezininzi kwaye zibhale ngale ndlela.
Ukuqhuba ibhentshi, i-s3bench utility isetyenzisiwe, eqaliswa kwi-remote server kwaye ithumela amashumi amawaka ezinto ezinjalo kwi-minio kwimisonto elikhulu. Ndaza ngendlela efanayo ndazama ukubacela babuye.
Iziphumo zomda ziboniswa kolu luhlu lulandelayo:
Njengoko sibona, i-minio kwimowudi yayo yokucima ikhowudi isebenza kakubi kakhulu ekubhaleni kune-minio esebenza phezulu kwe-software ye-RAID6, i-RAIDZ2 kunye ne-DRAID2 kuqwalaselo olufanayo.
Ndahlule uvavanyo minio kwi ext4 vs XFS. Okumangalisayo kukuba, kuhlobo lwam lomsebenzi, i-XFS yayicotha kakhulu kune-ext4.
Kwibhetshi yokuqala yovavanyo, uMdadm ubonise ukongama kwiZFS, kodwa kamva ukuba unokuphucula ukusebenza kwe-ZFS ngokuseta olu khetho lulandelayo:
xattr=sa atime=off recordsize=1Mkwaye emva koko iimvavanyo kunye neZFS zaba ngcono kakhulu.
Unokuqaphela kwakhona ukuba i-DRAID ayiboneleli ngenzuzo enkulu yokusebenza ngaphezulu kwe-RAIDZ, kodwa kwithiyori kufuneka ikhuseleke kakhulu.
Kwiimvavanyo ezimbini zokugqibela, ndazama ukuhambisa imethadatha (ekhethekileyo) kunye ne-ZIL (log) kwisibuko esivela kwi-SSD. Kodwa ukususwa kweemethadatha akuzange kunikeze inzuzo enkulu kwisantya sokubhala, kunye nokususwa kwe-ZIL, yam betha isilingi ngokusetyenziswa kwe-100%, ke ndicinga ukuba olu vavanyo aluphumelelanga. Andiqondi ukuba ukuba ndine-SSD ngokukhawuleza, mhlawumbi oku kunokuphucula kakhulu iziphumo zam, kodwa, ngelishwa, andizange ndibe nazo.
Ekugqibeleni, ndaye ndagqiba ekubeni ndibambelele kwi-DRAID kwaye nangona imeko yayo ye-beta, sesona sisombululo sikhawulezayo nesisebenzayo kwimeko yethu.
Ndenze i-DRAID2 elula kuqwalaselo ngamaqela amathathu kunye neendawo ezimbini ezisasaziweyo:
# zpool status data
pool: data
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
data ONLINE 0 0 0
draid2:3g:2s-0 ONLINE 0 0 0
sdy ONLINE 0 0 0
sdam ONLINE 0 0 0
sdf ONLINE 0 0 0
sdau ONLINE 0 0 0
sdab ONLINE 0 0 0
sdo ONLINE 0 0 0
sdw ONLINE 0 0 0
sdak ONLINE 0 0 0
sdd ONLINE 0 0 0
sdas ONLINE 0 0 0
sdm ONLINE 0 0 0
sdu ONLINE 0 0 0
sdai ONLINE 0 0 0
sdaq ONLINE 0 0 0
sdk ONLINE 0 0 0
sds ONLINE 0 0 0
sdag ONLINE 0 0 0
sdi ONLINE 0 0 0
sdq ONLINE 0 0 0
sdae ONLINE 0 0 0
sdz ONLINE 0 0 0
sdan ONLINE 0 0 0
sdg ONLINE 0 0 0
sdac ONLINE 0 0 0
sdx ONLINE 0 0 0
sdal ONLINE 0 0 0
sde ONLINE 0 0 0
sdat ONLINE 0 0 0
sdaa ONLINE 0 0 0
sdn ONLINE 0 0 0
sdv ONLINE 0 0 0
sdaj ONLINE 0 0 0
sdc ONLINE 0 0 0
sdar ONLINE 0 0 0
sdl ONLINE 0 0 0
sdt ONLINE 0 0 0
sdah ONLINE 0 0 0
sdap ONLINE 0 0 0
sdj ONLINE 0 0 0
sdr ONLINE 0 0 0
sdaf ONLINE 0 0 0
sdao ONLINE 0 0 0
sdh ONLINE 0 0 0
sdp ONLINE 0 0 0
sdad ONLINE 0 0 0
spares
s0-draid2:3g:2s-0 AVAIL
s1-draid2:3g:2s-0 AVAIL
errors: No known data errorsEwe, siqikelele ugcino, ngoku malunga nento esiza kuyigcina. Apha ngokukhawuleza ndifuna ukuthetha ngezisombululo ezithathu endikwazile ukuzizama, kwaye oku:
- ifolokhwe , isisombululo esizinikezeleyo se-block block, sinokuhlanganiswa okuqinileyo kunye neCeph. Uyakwazi ukuthatha umahluko phakathi kwe-snapshots kwaye wenze i-backup eyongeziweyo kubo. Ixhasa inani elikhulu le-backends yokugcina, kubandakanywa zombini zendawo kunye ne-S3. Ifuna isiseko sedatha esahlukileyo ukugcina itheyibhile ye-hash yokudibanisa. Kweminyus: ebhalwe ngepython, ine-cli engaphenduliyo kancinane.
- ifolokhwe , isixhobo esaziwayo nesiqinisekisiweyo sogcino, sinokugcina idatha kwaye siyikhuphe kakuhle. Iyakwazi ukugcina ii-backups zombini kwindawo kunye nakwiseva ekude nge-scp. Iyakwazi ukugcina izixhobo zebhlokhi ukuba iqaliswe ngeflegi --special, ye-minuses: xa udala i-backup, i-repository ivaliwe ngokupheleleyo, ngoko ke kuyacetyiswa ukuba wenze i-repository eyahlukileyo kumatshini ngamnye wenyani, ngokomgaqo oku akuyona ingxaki, kuba kulula kakhulu ukwenza.
yiprojekthi ephuhlisayo esebenzayo, ebhalwe ekuhambeni, ngokukhawuleza ngokwaneleyo kwaye ixhasa inani elikhulu lokugcinwa ngasemva, phakathi apho kukho zombini ugcino lwendawo kunye nescp, S3 nokunye okuninzi. Ngokwahlukileyo, ndingathanda ukuqaphela ukuba kukho into eyenziwe ngokukodwa kwi-restic, ekuvumela ukuba ukhuphe ngokukhawuleza ugcino ukuze usetyenziswe kude. Kuzo zonke ezi zingentla, ndithande kakhulu. Uyakwazi ukugcina kwi-stdin. Phantse akukho bubi bubonakalayo, kodwa kukho izinto ezininzi:
-
Okokuqala, ndazama ukuyisebenzisa kwimodi yokugcina ekwabelwana ngayo kubo bonke oomatshini benyani (njengeBenji) kwaye yade yasebenza kakuhle, kodwa imisebenzi yokubuyisela ithathe ixesha elide kakhulu, kuba. ngalo lonke ixesha phambi kokuba i-restic izame ukufunda imethadatha yazo zonke ii-backups. Le ngxaki yasonjululwa ngokulula, njengakwi-borg, ngokwenza indawo yokugcina eyahlukileyo kumatshini ngamnye onenyani. Le ndlela ibonakalise ukuba isebenza kakhulu kulawulo logcino ngokunjalo. Iindawo zokugcina ezahlukeneyo zinokuba negama eliyimfihlo elahlukileyo lokufikelela kwidatha, kwaye asinako ukoyika ukuba irepo yehlabathi inokwaphuka ngandlela thile. Ukuzala amagcisa amatsha kulula njengogcino lweborg.
Kuyo nayiphi na imeko, ukuphinda-phinda kwenziwa kuphela xa kuthelekiswa noguqulelo lwangaphambili lwe-backup, i-backup yangaphambili imiselwa ngumendo wogcino olukhankanyiweyo, ke ukuba uxhasa izinto ezahlukeneyo ukusuka kwi-stdin ukuya kwindawo yogcino eqhelekileyo, ungalibali ukucacisa. ukhetho
--stdin-filename, okanye ucacise ukhetho ngexesha ngalinye--parent.
-
Okwesibini, ukubuyisela kwistdout kuthatha ixesha elininzi kunokubuyisela kwisixokelelwano sefayile ngenxa yokungqamana kwayo. Kwixesha elizayo, siceba ukongeza kufutshane inkxaso yokugcina izixhobo block.
-
Okwesithathu, kuyacetyiswa ukuba kusetyenziswe okwangoku , ngokuba uguqulelo 0.9.6 has a bug kunye recovery elide iifayile ezinkulu.
Ukuvavanya ukusebenza kakuhle kwe-backup kunye nesantya sokubhala / ukubuyisela kwi-backup, ndenze indawo yokugcina eyahlukileyo kwaye ndazama ukugcina umfanekiso omncinci womatshini obonakalayo (21 GB). Ii-backups ezimbini zenziwe ngaphandle kokutshintsha i-original, kusetyenziswa isisombululo ngasinye esidwelisiweyo ukujonga ukuba kukhawuleza kangakanani / kucotha kangakanani idatha ekhutshiweyo.
Njengoko sibona, i-Borg Backup ineyona ndlela ilungileyo yokugcina i-backup, kodwa ilahlekelwa ngokubhekiselele kokubini ukubhala kunye nokubuyisela isantya.
I-Restic ivele yakhawuleza kune-Benji Backup, kodwa kuthatha ixesha elide ukubuyisela kwi-stdout, kwaye, ngelishwa, ayikwazi ukubhala ngokuthe ngqo kwisixhobo sebhlokhi.
Emva kokulinganisa zonke iingenelo kunye nokubi, ndagqiba ekubeni ndiyeke ukuphumla Ρ iseva yokuphumla njengesona sisombululo siluncedo nesithembisayo sogcino.
Kwesi sikrini, unokubona ukuba ikhonkco le-10-gigabit lisetyenziswa njani ngokupheleleyo kunye nee-backups ezininzi ezisebenza ngaxeshanye. Kuyafaneleka ukuba uqaphele ukuba ukusetyenziswa kwediski akuphakamisi ngaphezu kwe-30%.
Ndandonwabile ngakumbi ngesiphumo!
umthombo: www.habr.com