Zosunga zobwezeretsera Gawo 3: Kuunikanso ndi Kuyesa kubwereza, kubwereza

Cholemba ichi chikukambirana za zida zosunga zobwezeretsera zomwe zimasunga zosunga zobwezeretsera popanga zosunga zakale pa seva yosunga zobwezeretsera.

Zina mwa zomwe zimakwaniritsa zofunikira ndizobwerezabwereza (zomwe zimakhala ndi mawonekedwe abwino ngati deja dup) ndi duplicati.

Chida china chodabwitsa kwambiri chosunga zobwezeretsera ndi dar, koma popeza chili ndi mndandanda wambiri wazosankha - njira yoyesera imakhudza pafupifupi 10% ya zomwe imatha - sitikuyesa ngati gawo lazomwe zikuchitika.

Zotsatira zoyembekezeredwa

Popeza onse awiri amapanga zolemba zakale mwanjira ina, phula lokhazikika litha kugwiritsidwa ntchito ngati kalozera.

Kuphatikiza apo, tiwona momwe kusungirako deta pa seva yosungira kumakulitsidwa bwino popanga makope osunga zosunga zobwezeretsera omwe ali ndi kusiyana kokha pakati pa kukopera kwathunthu ndi momwe mafayilo alili pano, kapena pakati pa zosungidwa zakale ndi zaposachedwa (zowonjezera, zochepera, ndi zina). .

Khalidwe popanga ma backups:

1. Mafayilo ochepa pa seva yosungira zosunga zobwezeretsera (oyerekeza ndi kuchuluka kwa makope osunga zobwezeretsera kapena kukula kwa data mu GB), koma kukula kwawo ndi kwakukulu (makumi mpaka mazana a megabytes).
2. Kukula kosungirako kudzaphatikizanso zosintha - palibe zobwereza zomwe zidzasungidwe, chifukwa chake kukula kwake kudzakhala kocheperako poyerekeza ndi pulogalamu ya rsync.
3. Yembekezerani katundu wolemetsa wa CPU mukamagwiritsa ntchito kukanikiza ndi/kapena kubisa, ndipo mwina ma netiweki apamwamba kwambiri ndi disk katundu ngati zosungirako ndi/kapena kubisa zikuyenda pa seva yosunga zosunga zobwezeretsera.

Tiyeni tiyendetse lamulo ili ngati mtengo wamawu:

cd /src/dir; tar -cf - * | ssh backup_server "cat > /backup/dir/archive.tar"

Zotsatira zake zinali motere:

Nthawi yochitira 3m12s. Zitha kuwoneka kuti liwiro limachepa ndi disk subsystem ya seva yosungira zosunga zobwezeretsera, monga chitsanzo ndi rsync. Mofulumira pang'ono, chifukwa ... kujambula kumapita ku fayilo imodzi.

Komanso, kuti tiyese kukakamiza, tiyeni tigwiritse ntchito njira yomweyo, koma yambitsani kukanikiza kumbali ya seva yosunga zobwezeretsera:

cd /src/dir; tar -cf - * | ssh backup_server "gzip > /backup/dir/archive.tgz"

Zotsatira zake ndi:

Nthawi yochitira 10m11s. Chofunikira kwambiri kuti botolo ndi kompresa yoyenda kamodzi pacholandira.

Lamulo lomwelo, koma ndi kukakamiza kumasamutsidwa ku seva ndi deta yoyambirira kuyesa lingaliro lakuti botolo ndi compressor yokhala ndi ulusi umodzi.

cd /src/dir; tar -czf - * | ssh backup_server "cat > /backup/dir/archive.tgz"

Zinakhala chonchi:

Nthawi yophedwa inali 9m37s. Katundu pachimake chimodzi ndi kompresa amawoneka bwino, chifukwa Kuthamanga kwa ma netiweki ndi katundu pa source disk subsystem ndizofanana.

Kuti muyese kubisa, mutha kugwiritsa ntchito openssl kapena gpg polumikiza lamulo lina openssl kapena gpg mu pipe. Kuti mudziwe padzakhala lamulo monga ili:

cd /src/dir; tar -cf - * | ssh backup_server "gzip | openssl enc -e -aes256 -pass pass:somepassword -out /backup/dir/archive.tgz.enc"

Zotsatira zinatuluka motere:

Nthawi yopha idakhala 10m30s, popeza njira ziwiri zinali kuyenda kumbali yolandirira - botolo limakhalanso compressor yokhala ndi ulusi umodzi, kuphatikiza kubisa kwakung'ono.

UPD: Pempho la bliznezz ndikuwonjezera mayeso ndi pigz. Mukangogwiritsa ntchito kompresa, zingatenge 6m30s, ngati muwonjezeranso encryption, ingakhale pafupifupi 7m. Kuviika mu graph yapansi ndi chosungira cha disk chosasunthika:

Kuyesa kobwereza

Duplicity ndi pulogalamu ya python yosunga zosunga zobwezeretsera popanga zolemba zosungidwa mumtundu wa tar.

Pazosungira zakale, librsync imagwiritsidwa ntchito, kotero mutha kuyembekezera zomwe zafotokozedwamo post m'mbuyomu mu mndandanda.

Zosunga zobwezeretsera zitha kubisidwa ndikusainidwa pogwiritsa ntchito gnupg, zomwe ndizofunikira mukamagwiritsa ntchito othandizira osiyanasiyana kusunga zosunga zobwezeretsera (s3, backblaze, gdrive, etc.)

Tiyeni tiwone zotsatira zake:

Izi ndi zotsatira zomwe timapeza tikamathamanga popanda kubisa

wowononga

Nthawi yothamanga ya mayeso aliwonse:

Launch 1
Launch 2
Launch 3

16 m33 ku
17 m20 ku
16 m30 ku

8 m29 ku
9 m3 ku
8 m45 ku

5 m21 ku
6 m04 ku
5 m53 ku

Ndipo nazi zotsatira pamene gnupg encryption yayatsidwa, ndi kukula kwakukulu kwa 2048 bits:

Nthawi yogwiritsira ntchito pa data yomweyi, ndi kubisa:

Launch 1
Launch 2
Launch 3

17 m22 ku
17 m32 ku
17 m28 ku

8 m52 ku
9 m13 ku
9 m3 ku

5 m48 ku
5 m40 ku
5 m30 ku

Kukula kwa chipika kunasonyezedwa - 512 megabytes, yomwe ikuwonekera bwino m'magrafu; Kuchuluka kwa purosesa kunakhalabe pa 50%, zomwe zikutanthauza kuti pulogalamuyo sigwiritsa ntchito purosesa imodzi yokha.

Mfundo yoyendetsera pulogalamuyo ikuwonekeranso bwino: adatenga kachidutswa kakang'ono, kakanikizira, ndikutumiza ku seva yosungira zosunga zobwezeretsera, yomwe imatha kuchedwa.
Chinthu china ndi nthawi yodziwikiratu yoyendetsa pulogalamuyo, zomwe zimadalira kukula kwa deta yomwe yasinthidwa.

Kuthandizira kubisa sikunawonjezere nthawi yoyendetsera pulogalamuyo, koma kumawonjezera kuchuluka kwa purosesa ndi 10%, yomwe ikhoza kukhala bonasi yabwino.

Tsoka ilo, pulogalamuyi sinathe kuzindikira bwino momwe zinthu ziliri ndikusinthiranso chikwatu, ndipo kukula kwake kosungirako kudakhala kofanana ndi kukula kwa zosinthazo (ie, zonse 18GB), koma kuthekera kogwiritsa ntchito seva yosadalirika kuti zisungidwe bwino. chimakwirira khalidwe ili.

Kuyesa kobwereza

Pulogalamuyi imalembedwa mu C # ndipo imayenda pogwiritsa ntchito malaibulale angapo ochokera ku Mono. Pali GUI komanso mtundu wa CLI.

Mndandanda wazinthu zazikuluzikulu ndizofanana ndi kubwereza, kuphatikizapo osunga zosunga zobwezeretsera zosiyanasiyana, komabe, mosiyana ndi kubwerezabwereza, zinthu zambiri zimapezeka popanda zida za chipani chachitatu. Kaya uku ndikuwonjezera kapena kuchotsera kutengera vuto lenileni, koma kwa oyamba kumene, ndikosavuta kukhala ndi mndandanda wazonse zomwe zili patsogolo pawo nthawi imodzi, m'malo mowonjezeranso phukusi la python, monga momwe zilili. vuto ndi duplicity.

Chinthu china chaching'ono - pulogalamuyo imalemba mwachangu nkhokwe ya sqlite m'malo mwa wogwiritsa ntchito yemwe amayambitsa zosunga zobwezeretsera, chifukwa chake muyenera kuwonetsetsanso kuti nkhokwe yofunikira imatchulidwa molondola nthawi iliyonse ikayamba kugwiritsa ntchito cli. Mukamagwira ntchito kudzera pa GUI kapena WEBGUI, zambiri zidzabisidwa kwa wogwiritsa ntchito.

Tiyeni tiwone zomwe yankho ili lingatulutse:

Mukayimitsa kubisa (ndipo WEBGUI sakulimbikitsani kuchita izi), zotsatira zake ndi izi:

Maola ogwira ntchito:

Launch 1
Launch 2
Launch 3

20 m43 ku
20 m13 ku
20 m28 ku

5 m21 ku
5 m40 ku
5 m35 ku

7 m36 ku
7 m54 ku
7 m49 ku

Ndi kubisa kothandizidwa, pogwiritsa ntchito aes, zikuwoneka motere:

Maola ogwira ntchito:

Launch 1
Launch 2
Launch 3

29 m9 ku
30 m1 ku
29 m54 ku

5 m29 ku
6 m2 ku
5 m54 ku

8 m44 ku
9 m12 ku
9 m1 ku

Ndipo ngati mugwiritsa ntchito pulogalamu yakunja gnupg, zotsatirazi zimatuluka:

Launch 1
Launch 2
Launch 3

26 m6 ku
26 m35 ku
26 m17 ku

5 m20 ku
5 m48 ku
5 m40 ku

8 m12 ku
8 m42 ku
8 m15 ku

Monga mukuwonera, pulogalamuyo imatha kugwira ntchito zingapo, koma izi sizipangitsa kuti ikhale yankho labwino kwambiri, ndipo ngati mufananiza ntchito yobisa, ikuyambitsa pulogalamu yakunja.
zidakhala zothamanga kuposa kugwiritsa ntchito laibulale kuchokera pagulu la Mono. Izi zikhoza kukhala chifukwa chakuti pulogalamu yakunja imakhala yabwino kwambiri.

Chinthu china chabwino chinali chakuti kukula kwa malo osungiramo zinthu kumatenga ndendende monga momwe deta yosinthidwa, i.e. duplicati adazindikira dzina lachikwatu ndikuwongolera izi moyenera. Izi zitha kuwoneka poyesa mayeso achiwiri.

Ponseponse, malingaliro abwino a pulogalamuyi, kuphatikiza kukhala ochezeka kwa ongoyamba kumene.

Zotsatira

Onse awiri adagwira ntchito pang'onopang'ono, koma kawirikawiri, poyerekeza ndi phula wamba, pali kupita patsogolo, osachepera ndi duplicati. Mtengo wa kupita patsogolo koteroko umawonekeranso - cholemetsa chodziwika
purosesa. Mwambiri, palibe kupatuka kwapadera pakulosera zotsatira.

anapezazo

Ngati simuyenera kuthamangira kulikonse, komanso kukhala ndi purosesa yopuma, njira zilizonse zomwe zaganiziridwa zidzachita, mulimonse, ntchito zambiri zachitika zomwe siziyenera kubwerezedwanso polemba zolemba za wrapper pamwamba pa phula. . Kukhalapo kwa encryption ndi chinthu chofunikira kwambiri ngati seva yosunga zosunga zobwezeretsera singadalitsidwe kwathunthu.

Poyerekeza ndi mayankho zochokera rsync - magwiridwe antchito amatha kuipiraipira kangapo, ngakhale kuti mu mawonekedwe ake oyera phula amagwira ntchito 20-30% mwachangu kuposa rsync.
Pali zosunga pakukula kwa malo osungira, koma ndi duplicati.

Kulengeza

Zosunga zobwezeretsera, gawo 1: Chifukwa chiyani zosunga zobwezeretsera ndizofunikira, kuwunikanso njira, matekinoloje
Kusunga zosunga zobwezeretsera, gawo 2: Unikani ndi kuyesa zida zosunga zobwezeretsera za rsync
Zosunga zobwezeretsera Gawo 3: Unikaninso ndikuyesa kubwereza, kubwereza, kubwereza kwa deja
Zosunga zobwezeretsera Gawo 4: Zbackup, restic, borgbackup review ndi kuyesa
Zosunga zobwezeretsera, gawo 5: Kuyesa bacula ndi veeam zosunga zobwezeretsera za linux
Zosunga zobwezeretsera Gawo 6: Kuyerekeza Zida zosunga zobwezeretsera
Zosunga zobwezeretsera Gawo 7: Mapeto

Wolemba: Pavel Demkovich

Source: www.habr.com