Lesi sihloko sizocubungula isofthiwe yokusekelayo okuthi, ngokwephula ukusakazwa kwedatha ibe izingxenye ezihlukene (izingcezu), yakha inqolobane.
Izingxenye zenqolobane zingacindezelwa ngokwengeziwe futhi zibethelwe, futhi okubaluleke kakhulu - phakathi nezinqubo zokulondoloza eziphindaphindiwe - ziphinde zisetshenziswe.
Ikhophi eyisipele kunqolobane enjalo iwuchungechunge lwezingxenye ezixhunywe kwezinye, ngokwesibonelo, ngokusekelwe emisebenzini ehlukahlukene yama-hashi.
Kunezixazululo eziningana ezifanayo, ngizogxila ku-3: i-zbackup, i-borgbackup ne-restic.
Imiphumela elindelwe
Njengoba bonke abafake izicelo bedinga ukwakhiwa kwendawo yokugcina izinto ngandlela thile, enye yezinto ezibaluleke kakhulu kuzoba ukulinganisa usayizi wendawo yokugcina. Ngokufanelekile, ubukhulu bayo akufanele bube ngaphezu kuka-13 GB ngokwendlela eyamukelekayo, noma ngaphansi - ngaphansi kokwenziwa kahle.
Kufiseleka kakhulu futhi ukwazi ukwenza amakhophi ayisipele wamafayela ngokuqondile, ngaphandle kokusebenzisa izigcinamlando njenge-tar, kanye nokusebenza nge-ssh/sftp ngaphandle kwamathuluzi engeziwe afana ne-rsync nama-sshfs.
Ukuziphatha lapho udala izipele:
- Usayizi wendawo yokugcina uzolingana nosayizi wezinguquko, noma ngaphansi.
- Umthwalo osindayo we-CPU ulindelekile uma kusetshenziswa ukuminyanisa kanye/noma ukubethela, futhi inethiwekhi ephakeme kakhulu nomthwalo wediski kungenzeka uma inqubo yokufaka kungobo yomlando kanye/noma yokubethela isebenza kuseva yokugcina isipele.
- Uma indawo yokugcina ilimele, iphutha elibambezelekile kungenzeka kokubili lapho udala izipele ezintsha nalapho uzama ukubuyisela. Kudingeka ukuhlela izinyathelo ezengeziwe zokuqinisekisa ubuqotho benqolobane noma usebenzise amathuluzi akhelwe ngaphakathi ukuhlola ubuqotho bayo.
Ukusebenza ngetiyela kuthathwa njengenani lereferensi, njengoba kuboniswe kwesinye sezindatshana ezedlule.
Ihlola i-zbackup
Indlela evamile ye-zbackup iwukuthi uhlelo luthola ezindaweni zokusakaza zedatha equkethe idatha efanayo, bese liyicindezela ngokuzikhethela futhi liyibethele, lilondoloze indawo ngayinye kanye kuphela.
Ukuphindaphinda kusebenzisa umsebenzi we-hashi wendandatho engamabhithi angu-64 onewindi elislayidayo ukuze uhlole ukufana kwe-byte-by-byte ngokumelene namabhulokhi edatha akhona (okufana nendlela i-rsync ekusebenzisa ngayo).
I-lzma ne-lzo enemicu eminingi isetshenziselwa ukucindezela, nama-aes ekubetheleni. Izinguqulo zakamuva zinekhono lokususa idatha endala endaweni yokugcina esikhathini esizayo.
Uhlelo lubhalwe ku-C++ ngokuncika okuncane. Umbhali ngokusobala ugqugquzelwe indlela engu-unix, ngakho-ke uhlelo lwamukela idatha ku-stdin lapho ludala izipele, lukhiqiza ukusakazwa kwedatha okufanayo ku-stdout lapho kubuyiselwa. Ngakho-ke, i-zbackup ingasetshenziswa "njengebhulokhi yokwakha" enhle kakhulu lapho ubhala izixazululo zakho zokulondoloza. Isibonelo, umbhali wendatshana usebenzise lolu hlelo njengethuluzi eliyisipele lemishini yasekhaya kusukela cishe ngo-2014.
Ukusakazwa kwedatha kuzoba yitiyela elivamile ngaphandle kwalapho kushiwo ngenye indlela.
Ake sibone ukuthi ithini imiphumela:
Umsebenzi uhlolwe ngezinketho ezi-2:
- i-repository iyadalwa futhi i-zbackup yethulwa kuseva ngedatha yomthombo, bese okuqukethwe kwendawo yokugcina kudluliselwa kuseva yokugcina isipele.
- i-repository idalwe kuseva yokugcina ikhophi yasenqolobaneni, i-zbackup yethulwa nge-ssh kuseva yokugcina isipele, futhi idatha ithunyelwa kuyo ngepayipi.
Imiphumela yenketho yokuqala yaba kanje: 43m11s - uma usebenzisa indawo yokugcina engabhaliwe kanye ne-compressor ye-lzma, i-19m13s - lapho ushintsha i-compressor nge-lzo.
Ukulayisha kuseva ngedatha yoqobo bekungokulandelayo (isibonelo esine-lzma siyaboniswa; nge-lzo bekukhona cishe isithombe esifanayo, kodwa isabelo se-rsync sasicishe sibe ingxenye yesine yesikhathi):
Kuyacaca ukuthi inqubo enjalo yokusekelayo ifaneleka kuphela izinguquko ezingandile nezincane. Kutuswa kakhulu futhi ukukhawulela i-zbackup kuntambo engu-1, ngaphandle kwalokho kuzoba nomthwalo we-CPU ophakeme kakhulu, ngoba Uhlelo luhle kakhulu ekusebenzeni ngemicu eminingi. Umthwalo kudiski wawumncane, ngokuvamile owawungeke ubonakale ngesistimu engaphansi yesimanje ye-ssd-based disk. Ungakwazi futhi ukubona ngokucacile ukuqala kwenqubo yokuvumelanisa idatha egciniwe kuseva ekude; isivinini sokusebenza sifana ne-rsync evamile futhi sincike ekusebenzeni kwesistimu engaphansi yediski yeseva yokugcina isipele. Ububi bale ndlela ukugcinwa kwenqolobane yendawo futhi, ngenxa yalokho, ukuphindwaphindwa kwedatha.
Okuthakazelisa kakhulu futhi okusebenzayo ekusebenzeni inketho yesibili, ukusebenzisa i-zbackup ngqo kuseva yokugcina isipele.
Okokuqala, sizohlola ukusebenza ngaphandle kokusebenzisa ukubethela nge-lzma compressor:
Isikhathi sokusebenza sokuhlolwa ngakunye:
Yethula 1
Yethula 2
Yethula 3
39 m45s
40 m20s
40 m3s
7 m36s
8 m3s
7 m48s
15 m35s
15 m48s
15 m38s
Uma unika amandla ukubethela usebenzisa ama-aes, imiphumela iseduze kakhulu:
Isikhathi sokusebenza kudatha efanayo, ngokubethela:
Yethula 1
Yethula 2
Yethula 3
43 m40s
44 m12s
44 m3s
8 m3s
8 m15s
8 m12s
15 m0s
15 m40s
15 m25s
Uma ukubethela kuhlanganiswa nokucindezelwa kusetshenziswa i-lzo, kubukeka kanjena:
Amahora okusebenza:
Yethula 1
Yethula 2
Yethula 3
18 m2s
18 m15s
18 m12s
5 m13s
5 m24s
5 m20s
8 m48s
9 m3s
8 m51s
Usayizi wenqolobane ewumphumela ubucishe ufane ku-13GB. Lokhu kusho ukuthi ukuphindaphinda kusebenza ngendlela efanele. Futhi, kudatha esivele icindezelwe, ukusebenzisa i-lzo kunikeza umphumela obonakalayo; ngokwesikhathi esiphelele sokusebenza, i-zbackup isondela eduze nokuphindaphindeka/okuphindwe kabili, kodwa isale ngemuva kwaleyo esekelwe ku-librsync izikhathi ezingu-2-5.
Izinzuzo zisobala - ukonga isikhala sediski kuseva yokugcina isipele. Ngokuqondene namathuluzi okuhlola i-repository, umbhali we-zbackup akawanikezi; kunconywa ukusebenzisa uhlu lwediski olubekezelela iphutha noma umhlinzeki wamafu.
Sekukonke, umbono omuhle kakhulu, naphezu kokuthi iphrojekthi imile iminyaka engaba ngu-3 (isicelo sokugcina isici sasicishe sibe unyaka odlule, kodwa ngaphandle kwempendulo).
Ihlola i-borgbackup
I-Borgbackup iyimfoloko ye-attic, enye isistimu efana ne-zbackup. Ibhalwe ku-python, inohlu lwamakhono afana ne-zbackup, kodwa futhi inga:
- Faka ama-backups nge-fuse
- Hlola okuqukethwe kwenqolobane
- Sebenza kumodi yeseva yeklayenti
- Sebenzisa ama-compressor ahlukahlukene ukuze uthole idatha, kanye nokunqunywa kwe-heuristic kohlobo lwefayela lapho ulicindezela.
- Izinketho ezi-2 zokubethela, i-aes no-blake
- Ithuluzi elakhelwe ngaphakathi le
amasheke okusebenza
borgbackup benchmark crud ssh://backup_server/repo/path local_dir
Imiphumela yaba kanje:
I-CZ-BIG 96.51 MB/s (10 100.00 MB amafayela awuziro: 10.36s)
RZ-BIG 57.22 MB/s (10 100.00 MB amafayela awuziro: 17.48s)
UZ-BIG 253.63 MB/s (10 100.00 MB amafayela awuziro: 3.94s)
I-DZ-BIG 351.06 MB/s (10 100.00 MB amafayela awuziro: 2.85s)
I-CR-BIG 34.30 MB/s (10 100.00 MB amafayela angahleliwe: 29.15s)
RR-BIG 60.69 MB/s (10 100.00 MB amafayela angahleliwe: 16.48s)
UR-BIG 311.06 MB/s (10 100.00 MB amafayela angahleliwe: 3.21s)
DR-BIG 72.63 MB/s (10 100.00 MB amafayela angahleliwe: 13.77s)
I-CZ-MEDIUM 108.59 MB/s (1000 1.00 MB amafayela awuziro: 9.21s)
I-RZ-MEDIUM 76.16 MB/s (1000 1.00 MB amafayela awuziro: 13.13s)
UZ-MEDIUM 331.27 MB/s (1000 1.00 MB amafayela awuziro: 3.02s)
I-DZ-MEDIUM 387.36 MB/s (1000 1.00 MB amafayela awuziro: 2.58s)
I-CR-MEDIUM 37.80 MB/s (1000 1.00 MB amafayela angahleliwe: 26.45s)
I-RR-MEDIUM 68.90 MB/s (1000 1.00 MB amafayela angahleliwe: 14.51s)
I-UR-MEDIUM 347.24 MB/s (1000 1.00 MB amafayela angahleliwe: 2.88s)
DR-MEDIUM 48.80 MB/s (1000 1.00 MB amafayela angahleliwe: 20.49s)
I-CZ-SMALL 11.72 MB/s (10000 Amafayela angu-10.00 kB wonke aziro: 8.53s)
RZ-OKUNCANE 32.57 MB/s (10000 Amafayela angu-10.00 kB wonke aziro: 3.07s)
UZ-EMNCANE 19.37 MB/s (10000 Amafayela angu-10.00 kB wonke aziro: 5.16s)
I-DZ-SMALL 33.71 MB/s (10000 Amafayela angu-10.00 kB wonke aziro: 2.97s)
I-CR-SMALL 6.85 MB/s (10000 10.00 kB amafayela angahleliwe: 14.60s)
I-RR-SMALL 31.27 MB/s (10000 10.00 kB amafayela angahleliwe: 3.20s)
I-UR-SMALL 12.28 MB/s (10000 10.00 kB amafayela angahleliwe: 8.14s)
DR-SMALL 18.78 MB/s (10000 10.00 kB amafayela angahleliwe: 5.32s)
Lapho kuhlolwa, i-compression heuristics izosetshenziselwa ukunquma uhlobo lwefayela (ukucindezela okuzenzakalelayo), futhi imiphumela izoba kanje:
Okokuqala, ake sihlole ukuthi isebenza kanjani ngaphandle kokubethela:
Amahora okusebenza:
Yethula 1
Yethula 2
Yethula 3
4 m6s
4 m10s
4 m5s
56s
58s
54s
1 m26s
1 m34s
1 m30s
Uma unika amandla ukugunyazwa kwenqolobane (imodi eqinisekisiwe), imiphumela izobe ivaliwe:
Amahora okusebenza:
Yethula 1
Yethula 2
Yethula 3
4 m11s
4 m20s
4 m12s
1 m0s
1 m3s
1 m2s
1 m30s
1 m34s
1 m31s
Lapho ukubethela kwe-aes kwenziwa kwasebenza, imiphumela ayizange yonakale kakhulu:
Yethula 1
Yethula 2
Yethula 3
4 m55s
5 m2s
4 m58s
1 m0s
1 m2s
1 m0s
1 m49s
1 m50s
1 m50s
Futhi uma ushintsha ama-aes abe ngu-blake, isimo sizothuthuka ngokuphelele:
Amahora okusebenza:
Yethula 1
Yethula 2
Yethula 3
4 m33s
4 m43s
4 m40s
59s
1 m0s
1 m0s
1 m38s
1 m43s
1 m40s
Njengasendabeni ye-zbackup, usayizi wenqolobane wawungu-13GB futhi ngaphansi kancane, okulindeleke ngokuvamile. Ngijabule kakhulu ngesikhathi sokusebenza; kuqhathaniswa nezixazululo ezisuselwa ku-librsync, ehlinzeka ngamakhono abanzi kakhulu. Ngijabule futhi ngekhono lokusetha amapharamitha ahlukahlukene ngokusebenzisa okuguquguqukayo kwemvelo, okunikeza inzuzo enkulu kakhulu uma usebenzisa i-borgbackup kwimodi ezenzakalelayo. Ngiphinde ngajabula ngomthwalo ngesikhathi sokwenza isipele: ukwahlulela ngomthwalo weprosesa, i-borgbackup isebenza ngentambo engu-1.
Kwakungekho bubi obuthile lapho uyisebenzisa.
ukuhlolwa kwe-restic
Naphezu kweqiniso lokuthi i-restic iyisixazululo esisha (abantu bokuqala ababili bayaziwa emuva ngo-2 nangaphezulu), inezici ezinhle kakhulu. Ibhalwe kokuthi Hamba.
Uma iqhathaniswa ne-zbackup, inikeza futhi:
- Ihlola ubuqotho benqolobane (okuhlanganisa nokuhlola izingxenye).
- Uhlu olukhulu lwezivumelwano ezisekelwayo nabahlinzeki bokugcina izipele, kanye nokusekelwa kwe-rclone - rsync yezixazululo zamafu.
- Ukuqhathanisa ama-backups angu-2 nomunye.
- Ukukhweza indawo yokugcina nge-fuse.
Ngokuvamile, uhlu lwezici luseduze ne-borgbackup, kwezinye izindawo ngaphezulu, kwezinye kancane. Esinye sezici ukuthi ayikho indlela yokukhubaza ukubethela, ngakho-ke izipele zizohlala zibethelwe. Ake sibone ngokwenza lokho okungakhanywa kule software:
Imiphumela yaba kanje:
Amahora okusebenza:
Yethula 1
Yethula 2
Yethula 3
5 m25s
5 m50s
5 m38s
35s
38s
36s
1 m54s
2 m2s
1 m58s
Imiphumela yokusebenza iphinde iqhathaniswe nezixazululo ezisekelwe ku-rsync futhi, ngokuvamile, iseduze kakhulu ne-borgbackup, kodwa umthwalo we-CPU uphakeme (izintambo eziningi ezisebenzayo) kanye ne-sawtooth.
Ngokunokwenzeka, uhlelo lukhawulelwe ukusebenza kwe-subsystem yediski kuseva yokugcina idatha, njengoba kwakunjalo nge-rsync. Usayizi wenqolobane wawungu-13GB, njenge-zbackup noma i-borgbackup, kwakungekho bubi obusobala lapho usebenzisa lesi sixazululo.
Imiphumela
Eqinisweni, bonke abakhethiwe bathole imiphumela efanayo, kodwa ngamanani ahlukene. I-Borgbackup yenze kahle kakhulu kunakho konke, i-restic ibihamba kancane, i-zbackup cishe ayifaneleki ukuqala ukuyisebenzisa,
futhi uma isivele iyasetshenziswa, zama ukuyishintsha ibe yi-borgbackup noma i-restic.
okutholakele
Isixazululo esithembisa kakhulu sibonakala sinokwethenjelwa, ngoba... nguye onesilinganiso esingcono kakhulu samakhono ejubaneni lokusebenza, kodwa okwamanje masingajahi eziphethweni ezijwayelekile.
I-Borgbackup empeleni ayimbi kakhulu, kodwa i-zbackup cishe ishintshwe kangcono. Yiqiniso, i-zbackup isengasetshenziselwa ukuqinisekisa ukuthi umthetho we-3-2-1 uyasebenza. Isibonelo, ngaphezu kwe-(lib)izinsiza zokusekela ezisekelwe ku-rsync.
Isimemezelo
Isipele Ingxenye 5: Ukuhlola i-bacula ne-veeam backup ye-linux
Isipele Ingxenye 6: Ukuqhathanisa Amathuluzi Okwenza Ikhophi Yasenqolobaneni
Isipele Ingxenye 7: Iziphetho
Kuthunyelwe ngu: UPavel Demkovich
Source: www.habr.com