Wannan labarin zai yi la'akari da software na ajiya wanda, ta hanyar karya rafin bayanai zuwa sassa daban-daban (chunks), yana samar da ma'ajin ajiya.
Za a iya ƙara matsawa abubuwan da aka adana da kuma rufaffen su, kuma mafi mahimmanci - yayin da ake maimaita matakan wariyar ajiya - sake amfani da su.
Kwafin ajiyar ajiya a cikin irin wannan ma'ajiyar shine jerin abubuwan haɗin da aka haɗa da juna, alal misali, dangane da ayyukan hash iri-iri.
Akwai mafita iri ɗaya da yawa, zan mayar da hankali kan 3: zbackup, borgbackup da restic.
Sakamakon da ake tsammani
Tunda duk masu neman izini suna buƙatar ƙirƙirar ma'ajiyar ta wata hanya ko wata, ɗayan mahimman abubuwan shine ƙididdige girman ma'ajiyar. Da kyau, girmansa bai kamata ya wuce 13 GB ba bisa ga hanyar da aka yarda da ita, ko ma ƙasa da haka - ƙarƙashin ingantaccen haɓakawa.
Hakanan yana da matuƙar kyawawa don samun damar ƙirƙirar kwafin fayiloli kai tsaye, ba tare da amfani da rumbun adana bayanai kamar tar ba, da kuma aiki tare da ssh/sftp ba tare da ƙarin kayan aikin kamar rsync da sshfs ba.
Hali lokacin ƙirƙirar madadin:
- Girman ma'ajiyar zai kasance daidai da girman canje-canje, ko ƙasa da haka.
- Ana sa ran nauyin CPU mai nauyi lokacin amfani da matsawa da/ko ɓoyewa, kuma babban hanyar sadarwa da nauyin faifai yana yiwuwa idan tsarin adanawa da/ko tsarin ɓoyewa yana gudana akan sabar ajiyar ajiya.
- Idan ma'ajiyar ta lalace, kuskuren jinkiri yana yiwuwa duka lokacin ƙirƙirar sabbin maajiyar da lokacin ƙoƙarin maidowa. Wajibi ne a tsara ƙarin matakan don tabbatar da amincin ma'ajiyar ko amfani da kayan aikin da aka gina don bincika amincinsa.
Ana ɗaukar aiki tare da kwalta azaman ƙimar tunani, kamar yadda aka nuna a ɗaya daga cikin labaran da suka gabata.
Gwajin zbackup
Babban tsarin zbackup shine shirin yana samuwa a cikin wuraren shigar bayanan da aka shigar masu dauke da bayanai iri daya, sannan ya matsa da rufaffen su, yana adana kowane yanki sau daya kawai.
Deduplication yana amfani da aikin hash na zobe 64-bit tare da taga mai zamewa don bincika matches byte-by-byte da tubalan bayanan data kasance (mai kama da yadda rsync ke aiwatar da shi).
Ana amfani da lzma da lzo da yawa don matsawa, da kuma aes don ɓoyewa. Sabbin sigogin suna da ikon share tsoffin bayanai daga ma'ajiyar a nan gaba.
An rubuta shirin a cikin C++ tare da ƙarancin dogaro. Da alama marubucin ya sami wahayi ta hanyar unix-way, don haka shirin yana karɓar bayanai akan stdin lokacin ƙirƙirar madadin, yana samar da irin wannan rafi na bayanai akan stdout lokacin maidowa. Don haka, za'a iya amfani da zbackup azaman "tushe mai kyau" lokacin rubuta naku mafita na madadin. Alal misali, marubucin labarin ya yi amfani da wannan shirin a matsayin babban kayan aiki na kayan aiki na gida tun kimanin 2014.
Rafin bayanan zai zama kwalta ta yau da kullun sai dai in an bayyana hakan.
Bari mu ga menene sakamakon:
An duba aikin a cikin zaɓuɓɓuka biyu:
- an ƙirƙiri ma'adana kuma an ƙaddamar da zbackup akan uwar garken tare da bayanan tushen, sannan ana canza abubuwan da ke cikin ma'ajiyar zuwa uwar garken ajiyar ajiyar ajiya.
- an ƙirƙiri wurin ajiya akan uwar garken ajiyar ajiyar ajiya, ana ƙaddamar da zbackup ta hanyar ssh akan uwar garken ajiyar ajiya, kuma ana aika bayanai zuwa gare shi ta hanyar bututu.
Sakamakon zaɓi na farko shine kamar haka: 43m11s - lokacin amfani da ma'ajin da ba a ɓoye ba da kuma kwampreso lzma, 19m13s - lokacin maye gurbin kwampreso da lzo.
Nauyin da ke kan uwar garken tare da ainihin bayanan ya kasance kamar haka (misali tare da lzma an nuna shi; tare da lzo akwai kusan hoto ɗaya, amma rabon rsync ya kasance kusan kwata na lokaci):
A bayyane yake cewa irin wannan tsari na madadin ya dace ne kawai don ƙananan ƙananan canje-canje. Hakanan yana da kyau a iyakance zbackup zuwa zaren 1, in ba haka ba za a sami nauyin CPU mai girma sosai, saboda Shirin yana da kyau sosai a aiki a cikin zaren da yawa. Nauyin da ke kan faifan ya yi ƙanƙanta, wanda gabaɗaya ba za a iya gane shi ba tare da tsarin ssd na zamani na tushen faifai. Hakanan zaka iya ganin farkon aiwatar da daidaita bayanan ma'ajiyar bayanai zuwa sabar mai nisa; saurin aiki yana kama da rsync na yau da kullun kuma ya dogara da aikin ƙaramin tsarin diski na uwar garken ajiyar ajiya. Rashin lahani na wannan hanyar shine adana ma'ajiyar gida kuma, a sakamakon haka, kwafin bayanai.
Ƙarin ban sha'awa kuma mai dacewa a aikace shine zaɓi na biyu, yana gudana zbackup kai tsaye a kan uwar garken ajiyar ajiya.
Da farko, za mu bincika aikin ba tare da amfani da ɓoyewa tare da kwampreso lzma ba:
Lokacin gudu na kowane gwajin gwaji:
Kaddamar da 1
Kaddamar da 2
Kaddamar da 3
39 m45s
40 m20s
40 m3s
7 m36s
8 m3s
7 m48s
15 m35s
15 m48s
15 m38s
Idan kun kunna boye-boye ta amfani da aes, sakamakon yana kusa:
Lokacin aiki akan bayanai iri ɗaya, tare da ɓoyewa:
Kaddamar da 1
Kaddamar da 2
Kaddamar da 3
43 m40s
44 m12s
44 m3s
8 m3s
8 m15s
8 m12s
15 m0s
15 m40s
15 m25s
Idan an haɗa ɓoye ɓoye tare da matsawa ta amfani da lzo, yayi kama da haka:
Hakan aiki:
Kaddamar da 1
Kaddamar da 2
Kaddamar da 3
18 m2s
18 m15s
18 m12s
5 m13s
5 m24s
5 m20s
8 m48s
9 m3s
8 m51s
Girman ma'ajiyar da aka samu ya yi daidai da 13GB. Wannan yana nufin cewa cirewa yana aiki daidai. Hakanan, akan bayanan da aka riga aka matsa, ta amfani da lzo yana ba da sakamako mai ban mamaki; dangane da jimlar lokacin aiki, zbackup ya zo kusa da kwafi/ kwafi, amma yana bayan waɗanda suka dogara da librsync ta sau 2-5.
Fa'idodin a bayyane suke - adana sararin faifai akan uwar garken ma'ajiyar ajiya. Dangane da kayan aikin duba ma'ajiya, marubucin zbackup bai samar da su ba; ana ba da shawarar yin amfani da tsararrun faifai masu jurewa kuskure ko mai ba da girgije.
Gabaɗaya, ra'ayi mai kyau sosai, duk da cewa aikin ya tsaya har yanzu kusan shekaru 3 (buƙatar fasalin ƙarshe ta kusan shekara ɗaya da ta gabata, amma ba tare da amsa ba).
Gwajin borgbackup
Borgbackup cokali mai yatsu ne na ɗaki, wani tsarin kama da zbackup. An rubuta shi cikin Python, yana da jerin iyakoki kama da zbackup, amma kuma yana iya:
- Dutsen madadin ta hanyar fuse
- Duba abubuwan da ke cikin ma'ajiya
- Yi aiki a yanayin abokin ciniki-uwar garken
- Yi amfani da compressors daban-daban don bayanai, da kuma ƙayyadaddun ƙayyadaddun nau'in fayil ɗin lokacin damfara shi.
- Zaɓuɓɓukan ɓoyewa 2, aes da blake
- Gina-in kayan aiki don
duban aiki
borgbackup benchmark crud ssh://backup_server/repo/path local_dir
Sakamakon ya kasance kamar haka:
CZ-BIG 96.51 MB/s (10 100.00 MB duk fayilolin-sifili: 10.36s)
RZ-BIG 57.22 MB/s (10 100.00 MB duk fayilolin-sifili: 17.48s)
UZ-BIG 253.63 MB/s (10 100.00 MB duk fayilolin-sifili: 3.94s)
DZ-BIG 351.06 MB/s (10 100.00 MB duk fayilolin-sifili: 2.85s)
CR-BIG 34.30 MB/s (10 100.00 MB fayilolin bazuwar: 29.15s)
RR-BIG 60.69 MB/s (10 100.00 MB fayilolin bazuwar: 16.48s)
UR-BIG 311.06 MB/s (10 100.00 MB fayilolin bazuwar: 3.21s)
DR-BIG 72.63 MB/s (10 100.00 MB fayilolin bazuwar: 13.77s)
CZ-MATSAKI 108.59 MB/s (1000 1.00 MB duk fayilolin-sifili: 9.21s)
RZ-MATSAKI 76.16 MB/s (1000 1.00 MB duk fayilolin-sifili: 13.13s)
UZ-MATSAYI 331.27 MB/s (1000 1.00 MB duk fayilolin-sifili: 3.02s)
DZ-MATSAKI 387.36 MB/s (1000 1.00 MB duk fayilolin-sifili: 2.58s)
CR-MEDIUM 37.80 MB/s (1000 1.00 MB fayilolin bazuwar: 26.45s)
RR-MEDIUM 68.90 MB/s (1000 1.00 MB fayilolin bazuwar: 14.51s)
UR-MEDIUM 347.24 MB/s (1000 1.00 MB fayilolin bazuwar: 2.88s)
DR-MEDIUM 48.80 MB/s (1000 1.00 MB fayilolin bazuwar: 20.49s)
CZ-SMALL 11.72 MB/s (10000 10.00 kB duk fayilolin-sifili: 8.53s)
RZ-SMALL 32.57 MB/s (10000 10.00 kB duk fayilolin-sifili: 3.07s)
UZ-SMALL 19.37 MB/s (10000 10.00 kB duk fayilolin-sifili: 5.16s)
DZ- SMALL 33.71 MB/s (10000 10.00 kB duk fayilolin-sifili: 2.97s)
CR-SMALL 6.85 MB/s (10000 10.00kB fayilolin bazuwar: 14.60s)
RR-SMALL 31.27 MB/s (10000 10.00kB fayilolin bazuwar: 3.20s)
UR-SMALL 12.28 MB/s (10000 10.00kB fayilolin bazuwar: 8.14s)
DR-SMALL 18.78 MB/s (10000 10.00kB fayilolin bazuwar: 5.32s)
Lokacin gwaji, za a yi amfani da na'urar matsawa don tantance nau'in fayil ɗin (matsi auto), kuma sakamakon zai kasance kamar haka:
Da farko, bari mu duba yadda yake aiki ba tare da ɓoyewa ba:
Hakan aiki:
Kaddamar da 1
Kaddamar da 2
Kaddamar da 3
4 m6s
4 m10s
4 m5s
56s
58s
54s
1 m26s
1 m34s
1 m30s
Idan kun kunna izinin ma'ajiya (ingantaccen yanayin), sakamakon zai kasance kusa:
Hakan aiki:
Kaddamar da 1
Kaddamar da 2
Kaddamar da 3
4 m11s
4 m20s
4 m12s
1 m0s
1 m3s
1 m2s
1 m30s
1 m34s
1 m31s
Lokacin da aka kunna aes boye-boye, sakamakon bai tabarba sosai ba:
Kaddamar da 1
Kaddamar da 2
Kaddamar da 3
4 m55s
5 m2s
4 m58s
1 m0s
1 m2s
1 m0s
1 m49s
1 m50s
1 m50s
Kuma idan kun canza aes zuwa blake, lamarin zai inganta gaba daya:
Hakan aiki:
Kaddamar da 1
Kaddamar da 2
Kaddamar da 3
4 m33s
4 m43s
4 m40s
59s
1 m0s
1 m0s
1 m38s
1 m43s
1 m40s
Kamar a cikin yanayin zbackup, girman ma'ajiyar ya kasance 13GB har ma da ɗan ƙasa kaɗan, wanda gabaɗaya ana tsammanin. Na yi matukar farin ciki da lokacin gudu; yana da kwatankwacin mafita dangane da librsync, yana ba da damar fa'ida sosai. Na kuma yi farin ciki da ikon saita sigogi daban-daban ta hanyar masu canjin yanayi, wanda ke ba da fa'ida mai mahimmanci lokacin amfani da boorgbackup a cikin yanayin atomatik. Na kuma gamsu da nauyin yayin madadin: yin hukunci da nauyin mai sarrafawa, borgbackup yana aiki a cikin zaren 1.
Babu takamaiman rashin amfani yayin amfani da shi.
jarrabawar hutu
Duk da cewa restic ne wani fairly sabon bayani (na farko 2 'yan takara da aka sani a baya a 2013 da kuma mazan), yana da quite mai kyau halaye. An rubuta a cikin Go.
Idan aka kwatanta da zbackup, yana kuma bayar da:
- Duba amincin ma'ajiyar (ciki har da dubawa a sassa).
- Babban jerin ƙa'idodi na tallafi da masu samarwa don adana abubuwan ajiya, kazalika da goyan bayan rclone - rsync don mafita ga girgije.
- Kwatanta 2 backups da juna.
- Hawan ma'ajiyar ta hanyar fuse.
Gabaɗaya, lissafin fasalulluka yana kusa da borgbackup, a wasu wurare ƙari, a wasu ƙasa. Ɗaya daga cikin fasalulluka shine cewa babu wata hanya ta musaki ɓoyayyen ɓoyayyen ɓoyayyen ɓoyayyiyar, sabili da haka kwafin madadin koyaushe za a ɓoye shi. Bari mu ga a aikace abin da za a iya matsi daga wannan software:
Sakamakon ya kasance kamar haka:
Hakan aiki:
Kaddamar da 1
Kaddamar da 2
Kaddamar da 3
5 m25s
5 m50s
5 m38s
35s
38s
36s
1 m54s
2 m2s
1 m58s
Sakamakon wasan kwaikwayon kuma yana kwatankwacin mafita na tushen rsync kuma, gabaɗaya, yana kusa da borgbackup, amma nauyin CPU ya fi girma (Zaren da yawa suna gudana) da sawtooth.
Mafi mahimmanci, shirin yana iyakance ta hanyar aiwatar da tsarin tsarin faifai akan uwar garken ajiyar bayanai, kamar yadda ya riga ya kasance tare da rsync. Girman ma'ajiyar ya kasance 13GB, kamar zbackup ko borgbackup, babu wata fa'ida a bayyane yayin amfani da wannan maganin.
Результаты
A gaskiya ma, duk 'yan takarar sun sami sakamako iri ɗaya, amma a farashi daban-daban. Borgbackup yayi mafi kyau duka, restic ya ɗan yi hankali, zbackup mai yiwuwa bai cancanci fara amfani da shi ba,
kuma idan an riga an fara amfani da shi, gwada canza shi zuwa borgapup ko restic.
binciken
Mafi kyawun mafita ga alama ya kasance mai tsauri, saboda ... shi ne wanda ke da mafi kyawun rabo na iya aiki zuwa saurin aiki, amma bari mu yi gaggawar zuwa ga ƙarshe na gaba ɗaya a yanzu.
Borgbackup a zahiri ba shi da muni, amma zbackup mai yiwuwa an fi maye gurbinsa. Gaskiya, ana iya amfani da zbackup don tabbatar da cewa tsarin 3-2-1 yana aiki. Misali, ban da (lib) wuraren ajiya na tushen rsync.
Sanarwa
Ajiyayyen Sashe na 5: Gwajin bacula da madadin veeam don Linux
Ajiyayyen Sashe na 6: Kwatanta Kayan Ajiyayyen
Ajiyayyen Sashe na 7: Kammalawa
Wanda ya buga: Pavel Demkovich
source: www.habr.com