Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Wannan bayanin kula yana magana ne akan kayan aikin ajiya waɗanda ke aiwatar da madogara ta hanyar ƙirƙirar rumbun adana bayanai akan sabar madadin.

Daga cikin waɗanda suka cika buƙatun akwai duplicity (wanda ke da kyakkyawar dubawa a cikin nau'in deja dup) da kwafi.

Wani kayan aikin ajiya na ban mamaki shine dar, amma tunda yana da jerin zaɓuɓɓuka masu yawa - hanyoyin gwaji sun ƙunshi kusan kashi 10% na abin da yake iyawa - ba mu gwada shi a matsayin wani ɓangare na zagayowar yanzu.

Sakamakon da ake tsammani

Tun da ’yan takarar biyu suna ƙirƙirar rumbun adana bayanai ta hanya ɗaya ko wata, ana iya amfani da kwalta ta yau da kullun azaman jagora.

Bugu da ƙari, za mu ƙididdige yadda aka inganta ma'ajiyar bayanai akan uwar garken ma'aji ta hanyar ƙirƙirar kwafin madadin da ke ɗauke da kawai bambanci tsakanin cikakken kwafi da yanayin fayilolin, ko tsakanin bayanan da suka gabata da na yanzu (ƙara, raguwa, da sauransu.) .

Hali lokacin ƙirƙirar madadin:

  1. Ƙananan adadin fayiloli akan uwar garken ajiyar ajiya (kwatankwacin adadin kwafin ajiya ko girman bayanai a cikin GB), amma girmansu yana da girma sosai (dubun zuwa ɗaruruwan megabyte).
  2. Girman ma'ajiyar zai haɗa da canje-canje kawai - ba za a adana kwafi ba, don haka girman ma'ajiyar zai zama ƙasa da software na tushen rsync.
  3. Yi tsammanin nauyin CPU mai nauyi lokacin amfani da matsawa da/ko ɓoyewa, kuma wataƙila babban cibiyar sadarwa da nauyin faifai idan tsarin adanawa da/ko tsarin ɓoyewa yana gudana akan uwar garken ajiyar ajiya.

Bari mu gudanar da umarni mai zuwa azaman ƙimar tunani:

cd /src/dir; tar -cf - * | ssh backup_server "cat > /backup/dir/archive.tar"

Sakamakon aiwatar da hukuncin ya kasance kamar haka:

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Lokacin aiwatarwa 3m12s. Ana iya ganin cewa gudun yana iyakance ta tsarin tsarin diski na uwar garken ajiyar ajiya, kamar yadda a cikin misali tare da rsync. Kawai dan sauri, saboda... rikodin yana zuwa fayil ɗaya.

Hakanan, don kimanta matsawa, bari mu gudanar da zaɓi iri ɗaya, amma ba da damar matsawa a gefen uwar garken madadin:

cd /src/dir; tar -cf - * | ssh backup_server "gzip > /backup/dir/archive.tgz"

Sakamakon shine:

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Lokacin aiwatarwa 10m11s. Mafi kusantar kwalabe shine kwampreso mai gudana guda ɗaya akan ƙarshen karɓa.

Umurni iri ɗaya, amma tare da matsawa zuwa uwar garken tare da ainihin bayanan don gwada hasashen cewa ƙwanƙwan kwalba shine kwampreso mai zaren guda ɗaya.

cd /src/dir; tar -czf - * | ssh backup_server "cat > /backup/dir/archive.tgz"

Ya kasance kamar haka:

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Lokacin aiwatarwa shine 9m37s. The load a kan daya core ta kwampreso a fili bayyane, saboda Gudun canja wurin hanyar sadarwa da lodi akan tsarin faifan tushen tushen suna kama da juna.

Don kimanta ɓoyewa, zaku iya amfani da openssl ko gpg ta haɗa ƙarin umarni openssl ko gpg cikin bututu. Domin tunani za a yi umarni kamar haka:

cd /src/dir; tar -cf - * | ssh backup_server "gzip | openssl enc -e -aes256 -pass pass:somepassword -out /backup/dir/archive.tgz.enc"

Sakamakon ya fito kamar haka:

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Lokacin aiwatarwa ya zama 10m30s, tun da matakai 2 ke gudana akan ɓangaren karɓa - ƙwanƙwasa ta sake zama kwampreso mai zaren guda ɗaya, tare da ƙaramin ɓoyewa sama.

UPS: A buƙatar bliznezz Ina ƙara gwaje-gwaje tare da pigz. Idan kuna amfani da kwampreso kawai, zai ɗauki 6m30s, idan kuma kun ƙara ɓoyewa, zai zama kusan 7m. Tsomawa a cikin jadawali na ƙasa shine ma'ajiyar diski mara ruwa:

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Kwafin gwaji

Duplicity software ce ta Python don adanawa ta ƙirƙirar rufaffiyar rumbun adana bayanai a tsarin kwalta.

Don ƙarin kayan tarihin, ana amfani da librsync, don haka kuna iya tsammanin halin da aka bayyana a ciki post na baya a cikin jerin.

Ana iya rufaffen bayanan ajiya da sanya hannu ta amfani da gnupg, wanda ke da mahimmanci yayin amfani da masu samarwa daban-daban don adana madogara (s3, backblaze, gdrive, da sauransu)

Bari mu ga menene sakamakon:

Waɗannan su ne sakamakon da muka samu lokacin da muke gudana ba tare da ɓoyewa ba

mai ɓarna

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Lokacin gudu na kowane gwajin gwaji:

Kaddamar da 1
Kaddamar da 2
Kaddamar da 3

16 m33s
17 m20s
16 m30s

8 m29s
9 m3s
8 m45s

5 m21s
6 m04s
5 m53s

Kuma ga sakamakon lokacin da aka kunna ɓoyayyen gnupg, tare da girman maɓalli na 2048 bits:

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Lokacin aiki akan bayanai iri ɗaya, tare da ɓoyewa:

Kaddamar da 1
Kaddamar da 2
Kaddamar da 3

17 m22s
17 m32s
17 m28s

8 m52s
9 m13s
9 m3s

5 m48s
5 m40s
5 m30s

An nuna girman toshe - 512 megabyte, wanda ke bayyane a fili a cikin jadawali; A zahiri lodin processor ya kasance a 50%, wanda ke nufin cewa shirin ba ya amfani da abin sarrafawa fiye da ɗaya.

Ka'idar aikin shirin ita ma a bayyane take: sun ɗauki wani yanki na bayanai, sun matsa, kuma sun aika zuwa uwar garken ajiyar ajiya, wanda zai iya zama a hankali.
Wani fasalin kuma shine lokacin tafiyar da shirin, wanda ya dogara kawai akan girman bayanan da aka canza.

Aiwatar da ɓoyayyen ɓoyayyen abu bai ƙara haɓaka lokacin tafiyar da shirin ba, amma ya ƙara nauyin kayan sarrafawa da kusan 10%, wanda zai iya zama kyakkyawan kari.

Abin baƙin ciki shine, wannan shirin ya kasa gano ainihin halin da ake ciki tare da canza sunan directory, kuma sakamakon girman ma'ajin ya zama daidai da girman sauye-sauye (watau duk 18GB), amma ikon yin amfani da uwar garken da ba a amince da shi ba don madadin a sarari. ya rufe wannan hali.

Kwafin gwaji

An rubuta wannan software a cikin C # kuma tana aiki ta amfani da saitin ɗakunan karatu daga Mono. Akwai GUI da kuma sigar CLI.

Matsakaicin lissafin manyan fasalulluka yayi kama da kwafi, gami da masu samar da ma'ajiya daban-daban, duk da haka, ba kamar kwafi ba, yawancin fasaloli suna samuwa ba tare da kayan aikin ɓangare na uku ba. Ko wannan ƙari ne ko ragi ya dogara da takamaiman shari'ar, amma ga masu farawa, zai fi sauƙi a sami jerin duk abubuwan da ke gabansu lokaci ɗaya, maimakon shigar da ƙarin fakiti don python, kamar yadda yake. al'amarin tare da duplicity.

Wani ƙaramin nuance - shirin yana rubuta bayanan sqlite na gida a madadin mai amfani wanda ya fara madadin, don haka kuna buƙatar tabbatar da cewa an ƙayyade bayanan da ake buƙata daidai duk lokacin da aka fara aiwatar da amfani da cli. Lokacin aiki ta hanyar GUI ko WEBGUI, cikakkun bayanai za a ɓoye daga mai amfani.

Bari mu ga abubuwan da wannan maganin zai iya haifarwa:

Idan kun kashe boye-boye (kuma WEBGUI baya bada shawarar yin wannan), sakamakon sune kamar haka:

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Hakan aiki:

Kaddamar da 1
Kaddamar da 2
Kaddamar da 3

20 m43s
20 m13s
20 m28s

5 m21s
5 m40s
5 m35s

7 m36s
7 m54s
7 m49s

Tare da kunna boye-boye, ta amfani da aes, yayi kama da haka:

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Hakan aiki:

Kaddamar da 1
Kaddamar da 2
Kaddamar da 3

29 m9s
30 m1s
29 m54s

5 m29s
6 m2s
5 m54s

8 m44s
9 m12s
9 m1s

Kuma idan kuna amfani da shirin gnupg na waje, sakamako masu zuwa suna fitowa:

Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi

Kaddamar da 1
Kaddamar da 2
Kaddamar da 3

26 m6s
26 m35s
26 m17s

5 m20s
5 m48s
5 m40s

8 m12s
8 m42s
8 m15s

Kamar yadda kake gani, shirin zai iya aiki a cikin zaren da yawa, amma wannan ba ya sa ya zama mafi kyawun bayani, kuma idan kun kwatanta aikin ɓoyewa, yana ƙaddamar da shirin waje.
ya zama sauri fiye da amfani da ɗakin karatu daga saitin Mono. Wannan na iya zama saboda gaskiyar cewa shirin na waje ya fi ingantawa.

Wani abu mai kyau shi ne gaskiyar cewa girman ma'ajiyar yana ɗaukar daidai daidai da ainihin bayanan da aka canza, watau. duplicati ya gano wani sabon suna kuma ya kula da wannan yanayin daidai. Ana iya ganin wannan lokacin gudanar da gwaji na biyu.

Gabaɗaya, kyakkyawan ra'ayi game da shirin, gami da yin abota da sabbin abokai.

Результаты

Duk 'yan takarar biyu sun yi aiki a hankali a hankali, amma gabaɗaya, idan aka kwatanta da kwalta ta yau da kullun, ana samun ci gaba, aƙalla tare da kwafi. Farashin irin wannan ci gaba kuma a bayyane yake - nauyi mai gani
mai sarrafawa. Gabaɗaya, babu sabani na musamman wajen hasashen sakamakon.

binciken

Idan ba kwa buƙatar gaggawa a ko'ina, kuma kuna da na'urar sarrafa kayan aiki, kowane ɗayan mafita da aka yi la'akari zai yi, a kowane hali, an yi ayyuka da yawa waɗanda bai kamata a maimaita su ta hanyar rubuta rubutun nannade a saman kwalta ba. . Kasancewar boye-boye abu ne mai matukar mahimmanci idan uwar garken don adana kwafin ajiyar ba za a iya amincewa da shi gabaɗaya ba.

Idan aka kwatanta da tushen mafita rsync - Ayyukan na iya zama mafi muni sau da yawa, duk da cewa a cikin tsaftataccen tsari tar ya yi aiki da sauri 20-30% fiye da rsync.
Akwai tanadi akan girman ma'ajiyar, amma tare da kwafi kawai.

Sanarwa

Ajiyayyen, Sashe na 1: Me yasa ake buƙatar madadin, bayyani na hanyoyin, fasaha
Ajiyayyen Sashe na 2: Bita da gwada kayan aikin madadin tushen rsync
Ajiyayyen Sashe na 3: Bita da gwada kwafi, kwafi, deja dup
Ajiyayyen Sashe na 4: Bita da gwaji zbackup, restic, borgbackup
Ajiyayyen Sashe na 5: Gwajin bacula da madadin veeam don Linux
Ajiyayyen Sashe na 6: Kwatanta Kayan Ajiyayyen
Ajiyayyen Sashe na 7: Kammalawa

Wanda ya buga: Pavel Demkovich

source: www.habr.com

Add a comment