Maqaalkani waxa uu tixgelin doonaa software-ka kaydka ah, kaas oo, jebinta qulqulka xogta qaybo gaar ah (qaybo), oo sameeya kayd.
Qaybaha kaydinta waa la sii adkeyn karaa oo la sir dhigi karaa, iyo tan ugu muhiimsan - inta lagu jiro hababka kaydinta ee soo noqnoqda - dib ayaa loo isticmaali karaa.
Koobiga kaydka ah ee kaydka noocaas ah waa silsilad magac leh oo qaybo isku xidhan, tusaale ahaan, oo ku salaysan hawlo kala duwan oo xashiish ah.
Waxaa jira dhowr xal oo la mid ah, waxaan diiradda saari doonaa 3: zbackup, borgbackup iyo restic.
Natiijooyinka la filayo
Maadaama dhammaan codsadayaashu ay u baahan yihiin abuurista kayd hal ama hab kale, mid ka mid ah arrimaha ugu muhiimsan ayaa noqon doona in la qiyaaso xajmiga kaydka. Fikrad ahaan, cabbirkeedu waa inuusan ka badneyn 13 GB sida ku cad habka la aqbalay, ama xitaa ka yar - oo ku xiran hagaajin wanaagsan.
Waxa kale oo aad loo jecel yahay in si toos ah loo abuuro nuqullo kayd ah oo faylasha ah, iyada oo aan la isticmaalin kaydiyeyaasha sida tar, iyo sidoo kale la shaqeynta ssh / sftp iyada oo aan lahayn qalab dheeraad ah sida rsync iyo sshfs.
Dabeecada marka la abuurayo gurmad:
- Baaxadda kaydku waxay la mid noqon doontaa cabbirka isbeddellada, ama ka yar.
- Culays culus oo CPU ah ayaa la filayaa marka la isticmaalayo isku-buufin iyo/ama sireed, iyo shabakad aad u saraysa iyo culayska diskku waxay u badan tahay haddii kaydinta iyo/ama habka sirtu ay ku socoto kayd kaydinta kaydinta.
- Haddii kaydka uu dhaawacmo, khalad daah ayaa u badan marka la abuurayo kayd cusub iyo marka la isku dayayo in la soo celiyo. Waa lagama maarmaan in la qorsheeyo tallaabooyin dheeraad ah si loo xaqiijiyo hufnaanta kaydka ama isticmaal qalab ku dhex jira si loo hubiyo daacadnimadeeda.
Ku shaqaynta daamurka waxaa loo qaataa qiime tixraac ahaan, sida lagu muujiyay mid ka mid ah maqaalladii hore.
Tijaabinta zbackup
Habka guud ee zbackup waa in barnaamijku ka helo meelaha xogta gelinta ah ee ka kooban xog isku mid ah, ka dibna si ikhtiyaari ah u cadaadi oo u sir, aag kastana hal mar keliya badbaadiya.
Kala soocida waxay isticmaashaa xashiish giraanta 64-bit ah oo leh daaqad simbiriirixan leh si loo hubiyo u dhigma byte-by-byte ka dhanka ah blocks xogta jira (oo la mid ah sida rsync u fuliso).
lzma iyo lzo oo isku xidhan oo badan ayaa loo isticmaalaa isku-buufinta, iyo aes sirta Noocyadii ugu dambeeyay waxay awood u leeyihiin inay ka tirtiraan xogta hore ee kaydka mustaqbalka.
Barnaamijku wuxuu ku qoran yahay C++ oo leh ku-tiirsanaanta ugu yar. Qoraagu waxa uu si cad u dhiirigeliyay unix-way, sidaa darteed barnaamijku waxa uu aqbalaa xogta stdin marka la abuurayo kayd, isaga oo soo saaraya xog isku mid ah oo ku saabsan stdout marka dib loo soo celinayo. Sidaa darteed, zbackup waxaa loo isticmaali karaa sidii "dhisme dhisme" aad u wanaagsan markaad qorayso xalalkaaga kaydinta. Tusaale ahaan, qoraaga maqaalku wuxuu barnaamijkan u isticmaalay sidii qalabka ugu muhiimsan ee kaydinta mashiinnada guriga ilaa qiyaastii 2014.
Qulqulka xogta ayaa noqon doona daamur joogto ah ilaa si kale loo sheego.
Aan aragno waxa natiijadu tahay:
Shaqada waxaa lagu hubiyay 2 doorasho:
- kayd ayaa la abuuray oo zbackup ayaa lagu bilaabay server-ka xogta isha, ka dibna waxa ku jira kaydinta waxaa loo wareejiyaa kaydinta kaydinta.
- kayd ayaa lagu abuuray kaydka kaydinta kaydinta, zbackup waxa lagu bilaabay ssh ee kaydinta kaydinta, xogtana waxa loogu soo diraa tuubada
Natiijooyinka doorashada koowaad waxay ahaayeen sida soo socota: 43m11s - marka la isticmaalayo bakhaar aan qarsoodi ahayn iyo kombaresarada lzma, 19m13s - marka la beddelo kombaresarada lzo.
Culayska ku jira server-ka xogta asalka ah wuxuu ahaa sida soo socota (tusaale leh lzma ayaa la muujiyay; lzo waxaa jiray qiyaastii sawir isku mid ah, laakiin saamiga rsync wuxuu ahaa qiyaastii rubuc wakhtiga):
Way caddahay in habka gurmadku uu ku habboon yahay oo keliya isbeddellada yar yar iyo kuwa dhifka ah. Waxa kale oo aad lagula talinayaa in la xaddido zbackup ilaa 1 thread, haddii kale waxaa jiri doona culeys aad u sarreeya oo CPU ah, sababtoo ah Barnaamijku aad buu ugu wanagsan yahay ka shaqaynta dunta badan. Culayska saxanku wuu yaraa, kaas oo guud ahaan aan lagu dareemi karin nidaamka-ssd-ka ee casriga ah ee diskka. Waxa kale oo aad si cad u arki kartaa bilawga habka isku-darka xogta kaydka ee server-ka fog; Xawaaraha hawlgalku wuxuu la mid yahay rsync caadiga ah waxayna ku xiran tahay waxqabadka nidaamka hoose ee diskka ee kaydinta kaydinta. Khasaaraha habkani waa kaydinta kaydka maxaliga ah iyo, natiijada, nuqul ka mid ah xogta.
Xiiso badan oo lagu dabaqi karo ficil ahaan waa ikhtiyaarka labaad, oo si toos ah u socodsiinaya zbackup serverka kaydinta kaydinta.
Marka hore, waxaan tijaabin doonaa hawlgalka annagoo adeegsanayna sirta kombaresarada lzma:
Wakhtiga uu socdo imtixaan kasta:
Bilaabida 1
Bilaabida 2
Bilaabida 3
39m45s
40m20s
40m3s
7m36s
8m3s
7m48s
15m35s
15m48s
15m38s
Haddii aad karti u siiso sireeynta addoo isticmaalaya aes, natiijadu aad bay u dhowdahay:
Wakhtiga ku shaqaynta isla xogta, oo leh sirin:
Bilaabida 1
Bilaabida 2
Bilaabida 3
43m40s
44m12s
44m3s
8m3s
8m15s
8m12s
15m0s
15m40s
15m25s
Haddii siraynta lagu daro cadaadis la isticmaalayo lzo, waxay u egtahay sidan:
Saacadaha shaqada:
Bilaabida 1
Bilaabida 2
Bilaabida 3
18m2s
18m15s
18m12s
5m13s
5m24s
5m20s
8m48s
9m3s
8m51s
Baaxadda kaydka natiijadu waxay la mid ahayd 13GB. Tani waxay ka dhigan tahay in ka-saarista si sax ah u shaqeyneyso. Sidoo kale, xogta horeba loo cufay, iyadoo la adeegsanayo lzo waxay ku siinaysaa saamayn la dareemi karo; marka la eego wadarta wakhtiga hawlgalka, zbackup wuxuu ku dhow yahay nuqulka / nuqulka, laakiin wuxuu ka dambeeyaa kuwa ku saleysan librsync 2-5 jeer.
Faa'iidooyinka ayaa iska cad - badbaadinta booska diskka ee kaydinta kaydinta. Xagga aaladaha hubinta kaydinta, qoraaga zbackup ma bixiyo iyaga; waxaa lagu talinayaa in la isticmaalo saxanka u dulqaadan kara cilladaha ama bixiyaha daruuraha.
Guud ahaan, aragti aad u wanaagsan, inkastoo xaqiiqda ah in mashruuca uu taagnaa ilaa 3 sano (codsigii ugu dambeeyay ee muujinta wuxuu ahaa sanad ka hor, laakiin jawaab la'aan).
Tijaabinta borgbackup
Borgbackup waa fargeeto saqaf ah, nidaam kale oo la mid ah zbackup. Lagu qoray Python, waxa ay leedahay liis awoodo la mid ah zbackup, laakiin waxa kale oo ay kartaa:
- Ku dheji kaydinta fiyuuska
- Hubi waxa ku jira kaydka
- Ku shaqee qaabka macmiilka-serverka
- Isticmaal kombaresarada kala duwan ee xogta, iyo sidoo kale go'aaminta heuristic ee nooca faylka marka la cadaadiyo.
- 2 ikhtiyaar oo sir ah, aes iyo blake
- Qalabka lagu dhex dhisay
hubinta waxqabadka
borgbackup benchmark crud ssh://backup_server/repo/path local_dir
Natiijadu waxay noqotay sidatan:
CZ-BIG 96.51 MB/s (10 100.00 MB dhammaan faylasha eber: 10.36s)
RZ-BIG 57.22 MB/s (10 100.00 MB dhammaan faylasha eber: 17.48s)
UZ-BIG 253.63 MB/s (10 100.00 MB dhammaan faylasha eber: 3.94s)
DZ-BIG 351.06 MB/s (10 100.00 MB dhammaan faylasha eber: 2.85s)
CR-BIG 34.30 MB/s (10 100.00 MB faylasha random: 29.15s)
RR-BIG 60.69 MB/s (10 100.00 MB faylasha random: 16.48s)
UR-BIG 311.06 MB/s (10 100.00 MB faylasha random: 3.21s)
DR-BIG 72.63 MB/s (10 100.00 MB faylasha random: 13.77s)
CZ-DHEXE 108.59 MB/s (1000 1.00 MB dhammaan faylasha eber: 9.21s)
RZ-DHEXE 76.16 MB/s (1000 1.00 MB dhammaan faylasha eber: 13.13s)
UZ-DHEXE 331.27 MB/s (1000 1.00 MB dhammaan faylasha eber: 3.02s)
DZ-DHEXE 387.36 MB/s (1000 1.00 MB dhammaan faylasha eber: 2.58s)
CR-DHEXE 37.80 MB/s (1000 1.00 MB faylasha random: 26.45s)
RR-DHEXE 68.90 MB/s (1000 1.00 MB faylasha random: 14.51s)
UR-DHEXE 347.24 MB/s (1000 1.00 MB faylasha random: 2.88s)
DR-DHEXE 48.80 MB/s (1000 1.00 MB faylasha random: 20.49s)
CZ-YAR 11.72 MB/s (10000 10.00 kB dhammaan- eber faylasha: 8.53s)
RZ-YAR 32.57 MB/s (10000 10.00 kB dhammaan- eber faylasha: 3.07s)
UZ-YAR 19.37 MB/s (10000 10.00 kB dhammaan- eber faylasha: 5.16s)
DZ-YAR 33.71 MB/s (10000 10.00 kB dhammaan- eber faylasha: 2.97s)
CR-YAR 6.85 MB/s (10000 10.00 kB faylasha random: 14.60s)
RR-YAR 31.27 MB/s (10000 10.00 kB faylasha random: 3.20s)
UR-SMALL 12.28 MB/s (10000 10.00 kB faylasha random: 8.14s)
DR-YAR 18.78 MB/s (10000 10.00 kB faylasha random: 5.32s)
Marka la tijaabinayo, heuristics cadaadis ayaa loo isticmaali doonaa si loo go'aamiyo nooca faylka (cadaadiska auto), natiijaduna waxay noqon doontaa sida soo socota:
Marka hore, aan eegno sida ay u shaqeyso qarsoodi la'aan:
Saacadaha shaqada:
Bilaabida 1
Bilaabida 2
Bilaabida 3
4m6s
4m10s
4m5s
56s
58s
54s
1m26s
1m34s
1m30s
Haddii aad karti u siiso oggolaanshaha kaydka (qaab la xaqiijiyay), natiijadu waxay noqon doontaa mid dhow:
Saacadaha shaqada:
Bilaabida 1
Bilaabida 2
Bilaabida 3
4m11s
4m20s
4m12s
1m0s
1m3s
1m2s
1m30s
1m34s
1m31s
Markii aes encryption la hawlgeliyay, natiijadu aad ugama xumaanin:
Bilaabida 1
Bilaabida 2
Bilaabida 3
4m55s
5m2s
4m58s
1m0s
1m2s
1m0s
1m49s
1m50s
1m50s
Oo haddii aad u beddesho midab madow, xaaladdu si buuxda ayay u fiicnaan doontaa:
Saacadaha shaqada:
Bilaabida 1
Bilaabida 2
Bilaabida 3
4m33s
4m43s
4m40s
59s
1m0s
1m0s
1m38s
1m43s
1m40s
Sida kiiska zbackup, cabbirka kaydku wuxuu ahaa 13GB iyo xitaa wax yar, taas oo guud ahaan la filayo. Aad ayaan ugu riyaaqay wakhtiga orodka; waxay la mid tahay xalalka ku salaysan librsync, oo bixisa awoodo aad u balaadhan. Waxa kale oo aan ku faraxsanahay awoodda aan u leeyahay in aan dejiyo cabbirro kala duwan iyada oo loo marayo doorsoomayaasha deegaanka, taas oo siinaysa faa'iido aad u daran marka la isticmaalayo borgapup si toos ah. Waxaan sidoo kale ku faraxsanaa culeyska inta lagu jiro kaydinta: adoo xukumaya culeyska processor-ka, borgapup wuxuu ku shaqeeyaa 1 dun.
Ma jirin wax khasaare ah oo gaar ah marka la isticmaalayo.
baaritaanka nasinta
In kasta oo xaqiiqda ah in nasashada uu yahay xal cusub oo caddaalad ah (2da musharax ee ugu horreeya ayaa dib loo yaqaan 2013 iyo wixii ka weyn), waxay leedahay sifooyin wanaagsan. Waxaa lagu qoray Go.
Marka la barbar dhigo zbackup, waxay sidoo kale bixisaa:
- Hubinta daacadnimada kaydka (oo ay ku jirto hubinta qaybaha).
- Liis weyn oo borotokool la taageeray iyo bixiyeyaasha kaydinta kaydka, iyo sidoo kale taageerada rclone - rsync for Cloud Solutions.
- Isbarbardhigga 2 nuqul oo midba midka kale ah.
- Ku dhejinta kaydka iyada oo loo marayo fiyuuska.
Guud ahaan, liiska sifooyinku aad bay ugu dhow yihiin borgoup, meelaha qaar in ka badan, kuwa kalena ka yar. Mid ka mid ah sifooyinka ayaa ah in aysan jirin qaab lagu baabi'iyo sirta, sidaas darteed nuqullada kaydinta ayaa had iyo jeer la sir doona. Aynu si dhab ah u aragno waxa laga tuujin karo software-kan:
Natiijadu waxay noqotay sidatan:
Saacadaha shaqada:
Bilaabida 1
Bilaabida 2
Bilaabida 3
5m25s
5m50s
5m38s
35s
38s
36s
1m54s
2m2s
1m58s
Natiijooyinka wax qabadku waxay sidoo kale la barbar dhigi karaan xalalka rsync-ku-salaysan iyo, guud ahaan, aad ugu dhow borggapup, laakiin culeyska CPU ayaa ka sarreeya ( threads badan oo socda) iyo sawtooth.
Inta badan, barnaamijku wuxuu ku xaddidan yahay waxqabadka nidaamka hoose ee diskka ee server-ka kaydinta xogta, sidii horeba kiiska rsync. Cabbirka kaydku wuxuu ahaa 13GB, sida zbackup ama borgbackup, ma jirin wax khasaare ah oo muuqda markii la isticmaalayo xalkan.
Π Π΅Π·ΡΠ»ΡΡΠ°ΡΡ
Dhab ahaantii, dhammaan musharraxiintu waxay gaadheen natiijooyin isku mid ah, laakiin qiimo kala duwan. Borgbackup si fiican ayuu u sameeyay, nasteexadu wax yar ayuu ka yara gaabiyey, zbackup malaha uma qalmo in la bilaabo isticmaalka,
iyo haddii hore loo isticmaalay, isku day inaad u beddesho borgoup ama nasasho.
natiijooyinka
Xalka ugu rajada leh wuxuu u muuqdaa mid nasasho leh, sababtoo ah ... waa kan leh saamiga ugu fiican ee awoodaha xawaaraha hawlgalka, laakiin yeynan ku degdegin gabagabada guud hadda.
Borgbackup asal ahaan ma ahan mid ka xun, laakiin zbackup waxay u badan tahay in si wanaagsan loo bedelay. Run, zbackup weli waa la isticmaali karaa si loo hubiyo in xeerka 3-2-1 uu shaqeeyo. Tusaale ahaan, marka lagu daro (lib) xarumaha kaydinta ku salaysan ee rsync.
Ogeysiis
Kaabta Qaybta 5: Tijaabinta bacula iyo kaydinta veeam ee linux
Kaabta Qaybta 6: Isbarbardhigga Aaladaha kaabta
Kaabta Qaybta 7: Gabagabada
Waxaa dhejiyay: Pavel Demkovich
Source: www.habr.com