Vatengi vedu veTurkey vakatikumbira kuti tigadzirise zvakanaka backup yenzvimbo yavo yedata. Tiri kuita mapurojekiti akafanana muRussia, asi pano nyaya yacho yaive yakawanda nezvekutsvaga nzira yekuzviita.
Yakapiwa: kune nzvimbo yekuchengetedza yeS3, kune Veritas NetBackup, iyo yakawana hutsva hwakawedzerwa kushanda kwekufambisa data kune chinhu chekuchengetedza, ikozvino nerutsigiro rwekubvisa, uye pane dambudziko nenzvimbo yekusununguka munzvimbo ino yekuchengetedza.
Basa: kugadzira zvese kuitira kuti maitiro ekuchengetedza makopi ekuchengetedza ari kukurumidza uye akachipa.
Chaizvoizvo, izvi zvisati zvaitika, zvese muS3 aingova mafaera, uye aya aive akakwana akakandwa emichina yakakosha yedata data. Ndiko kuti, haina kunyatsogadziriswa, asi zvese zvakashanda pakutanga. Iye zvino yave nguva yekuzvifunga uye kuzviita nemazvo.
Mufananidzo unoratidza zvatakasvika:
Sezvauri kuona, yekutanga backup yakaitwa zvishoma nezvishoma (70 Mb / s), uye yakatevera backups yemasystem akafanana aikurumidza.
Chaizvoizvo, kumberi kune zvimwe zvishoma zvimwe nezve izvo zvimiro zviripo.
Backup logs kune avo vakagadzirira kuverenga hafu yepeji yekurasaYakazara ne rescan
Zvita 18, 2018 12:09:43 PM - Info bpbkar (pid=4452) accelerator yakatumira 14883996160 bytes kunze kwe14883994624 bytes kune server, optimization 0.0%
Zvita 18, 2018 12:10:07 PM - Info NBCC (pid=23002) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Report=PDDO Stats (multi-threaded stream inoshandiswa) ye (NBCC): scanned: 14570817 KB, CR yakatumirwa: 1760761 KB, CR yakatumirwa pamusoro peFC: 0 KB, dedup: 87.9%, cache yadzimwa
Full
Zvita 18, 2018 12:13:18 PM - Info bpbkar (pid=2864) accelerator yakatumira 181675008 bytes kunze kwe14884060160 bytes kune server, optimization 98.8%
Dec 18, 2018 12:13:40 PM - Info NBCC (pid=23527) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Report=PDDO Stats for (NBCC): scanned: 14569706 KB, CR yakatumirwa: 45145 KB, CR yakatumirwa pamusoro peFC: 0 KB, dedup: 99.7%, cache yadzimwa
Inonakidza
Zvita 18, 2018 12:15:32 PM - Info bpbkar (pid=792) accelerator yakatumira 9970688 bytes kunze kwe14726108160 bytes kune server, optimization 99.9%
Dec 18, 2018 12:15:53 PM - Info NBCC (pid=23656) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Report=PDDO Stats for (NBCC): scanned: 14383788 KB, CR yakatumirwa: 15700 KB, CR yakatumirwa pamusoro peFC: 0 KB, dedup: 99.9%, cache yadzimwa
Full
Zvita 18, 2018 12:18:02 PM - Info bpbkar (pid=3496) accelerator yakatumira 171746816 bytes kunze kwe14884093952 bytes kune server, optimization 98.8%
Dec 18, 2018 12:18:24 PM - Info NBCC (pid=23878) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Report=PDDO Stats for (NBCC): scanned: 14569739 KB, CR yakatumirwa: 34120 KB, CR yakatumirwa pamusoro peFC: 0 KB, dedup: 99.8%, cache yadzimwa
Dambudziko nderei
Vatengi vanoda kuita backups kakawanda sezvinobvira uye vachengete zvakachipa sezvinobvira. Zvakanakisa kuzvichengeta zvakachipa muzvinhu zvekuchengetedza zvakadai seS3, nekuti ndizvo zvakachipa pamutengo wesevhisi paMegabyte kubva kwaunogona kudzoreredza backup munguva yakafanira. Kana paine yakawanda yekuchengetedza, inova isingadhure zvakanyanya, nekuti yakawanda yekuchengetedza inogarwa nemakopi eiyo data. Panyaya yeHaaS yevaTurkey vaunoshanda navo, chengetedzo inogona kuverengerwa ne80-90%. Zviripachena kuti izvi zvinechekuita kune yavo chaiyo, asi ini ndaizonyatsovimba ne50% sekuru.
Kugadzirisa dambudziko, vatengesi vakuru vagara vagadzira magedhi eAmazon S3. Nzira dzavo dzose dzinoenderana neS3 yemunharaunda chero bedzi vachitsigira Amazon API. MuTurkey data center, kuchengetedza kunoitwa kuS3 yedu, uyewo muT-III "Compressor" muRussia, sezvo chirongwa ichi chebasa chakashanda zvakanaka kwatiri.
Uye yedu S3 inoenderana zvizere neAmazon S3 backup nzira. Ndokunge, ese maturusi ekuchengetedza anotsigira nzira idzi anotendera iwe kukopa zvese kune yakadaro chengetedzo "kunze kwebhokisi."
Veritas NetBackup yakawedzera iyo CloudCatalyst chimiro:
Kureva kuti, pakati pemichina inoda kutsigirwa uye gedhi, pane yepakati Linux sevha kuburikidza iyo backup traffic kubva kune SRK vamiririri inopfuura uye inodzorwa panhunzi isati yaendesa kuS3. Kana kare kwaiva ne 30 backups ye 20 GB ine compression, ikozvino (nekuda kwekufanana kwemashini) vhoriyamu yavo yave 90% idiki. Iyo injini yekubvisa inoshandiswa zvakafanana kana uchichengeta pamadhisiki enguva dzose uchishandisa Netbackup.
Hezvino zvinoitika pamberi pesevha yepakati:
Isu takaedza uye tikasvika pamhedzisiro yekuti kana yaitwa munzvimbo dzedu dzedata, izvi zvinochengetedza nzvimbo muS3 kuchengetedza isu uye nevatengi. Semuridzi wenzvimbo dzekutengesa data, hongu, isu tinochaja zvinoenderana nehuwandu hwakatorwa, asi zvichiri kutibatsira zvakanyanya - nekuti isu tinotanga kuita mari kune dzimwe nzvimbo dzinotyisa musoftware, uye kwete pakurenda Hardware. Zvakanaka, uye uku ndiko kuderedzwa kwemari yemukati.
Logs228 Jobs (0 Yakaiswa Mutsara 0 Inoshanda 0 Yakamirira Kuedzazve 0 Yakamiswa 0 Haina Kukwana 228 Yaitwa β 13 yakasarudzwa)
(Sefa Yashandiswa [13])
Job Id Type State State Details Status Job Policy Basa Rondedzero Client Media Server Kutanga Nguva Yakapfuura Nguva Yekupedzisira Nguva Yekuchengeta Chikamu Kuedza Kushanda Kilobytes Mafaira Pathname % Yakazara (Inofungidzirwa) Job PID Muridzi Copy Mubereki Basa ID KB/Sec Active Tanga Active Elapsed Robot Vault Profile Session ID Media yekubvisa Dhata Movement Off-Host Type Master Priority Deduplication Rate Yekufambisa Accelerator Optimization Instance kana Database Govera Host
β 1358 Snapshot Done 0 VMware β NGNCloudADC NBCC Dec 18, 2018 12:16:19 PM 00:02:18 Dec 18, 2018 12:18:37 PM STU_DP_S3_****backup 1 100 1358 Dec 18 Dec 2018, 12 16 Dec 27 midzi :00:02 PM 10:0:XNUMX Instant Recovery Disk Standard WIN-*********** XNUMX
1360 Chengetedzo Yaitwa 0 VMware Yakazara NGNCloudADC NBCC Zvita 18, 2018 12:16:48 PM 00:01:39 Dec 18, 2018 12:18:27 PM STU_DP_S3_****backup 1 14,535,248:149654 100 23858 1358 335,098 18 2018 % 12 16 48 00 01 Zvita 39 , 0 99.8:99:XNUMX PM XNUMX:XNUMX:XNUMX Instant Recovery Disk Standard WIN-************* XNUMX XNUMX% XNUMX%
1352 0:18 PM 2018:12:14 Instant Recovery Disk Standard WIN-*********** 04
1354 Backup Done 0 VMware Incremental NGNCloudADC NBCC Dec 18, 2018 12:14:34 PM 00:01:21 Dec 18, 2018 12:15:55 PM STU_DP_S3_****backup 1 14,380,965 147% 100 Zvita 23617 , 1352 500,817:18:2018 PM 12:14:34 Instant Recovery Disk Standard WIN-************** 00 01% 21%
1347 0:18 PM 2018:12:11 Instant Recovery Disk Standard WIN-*********** 45
1349 Chengetedzo Yaitwa 0 VMware Yakazara NGNCloudADC NBCC Zvita 18, 2018 12:12:02 PM 00:01:41 Dec 18, 2018 12:13:43 PM STU_DP_S3_****backup 1 14,535,215:149653 100 23508 1347 316,319 18 2018 % 12 12 02 00 01 Zvita 41 , 0 99.7:99:XNUMX PM XNUMX:XNUMX:XNUMX Instant Recovery Disk Standard WIN-************* XNUMX XNUMX% XNUMX%
1341 0:18 PM 2018:12:05 Instant Recovery Disk Standard WIN-*********** 28
1342 Backup Done 0 VMware Full_Rescan NGNCloudADC NBCC Dec 18, 2018 12:05:47 PM 00:04:24 Dec 18, 2018 12:10:11 PM STU_DP_S3_****backup 1 14,535,151 149653 % midzi 100 22999 1341 Dec 70,380 , 18 2018:12:05 PM 47:00:04 Instant Recovery Disk Standard WIN-*********** 24 0% 87.9%
1339 Snapshot Done 150 VMware - NGNCloudADC NBCC Dec 18, 2018 11:05:46 AM 00:00:53 Dec 18, 2018 11:06:39 AM STU_DP_S3_****backup 1 100 1339% 18 2018 11% 05:46 AM 00:00:53 Instant Recovery Disk Standard WIN-*********** 0
1327 Snapshot Done 0 VMware - *******.********.cloud NBCC Dec 17, 2018 12:54:42 PM 05:51:38 Dec 17, 2018 6:46:20 PM STU_DP_S3_**** backup 1 100% mudzi 1327 Dec 17, 2018 12:54:42 PM 05:51:38 Instant Recovery Disk Standard WIN-*********** 0
1328 Chengetedzo Yaitwa 0 VMware Yakazara *******.********.cloud NBCC Zvita 17, 2018 12:55:10 PM 05:29:21 Dec 17, 2018 6:24:31 PM STU_DP_S3_**** backup 1 222,602,719 258932 100% 12856 mudzi 1327 11,326 Dec 17, 2018 12:55:10 PM 05:29:21 Instant Recovery Disk*0 WIN Standard . 87.9%
1136 Snapshot Done 0 VMware - *******.********.cloud NBCC Dec 14, 2018 4:48:22 PM 04:05:16 Dec 14, 2018 8:53:38 PM STU_DP_S3_**** backup 1 100% mudzi 1136 Dec 14, 2018 4:48:22 PM 04:05:16 Instant Recovery Disk Standard WIN-*********** 0
1140 Backup Yaitwa 0 VMware Full_Scan *******.********.cloud NBCC Dec 14, 2018 4:49:14 PM 03:49:58 Dec 14, 2018 8:39:12 PM STU_DP_S3_****backup 1 217,631,332 255465 100% 26438 midzi 1136 15,963 Dec 14, 2018 4:49:14 PM 03:49:58 Instant Recovery Disk*0****45.2 WIN-% 0%
Iyo accelerator inobvumidza iwe kuderedza traffic kubva kune vamiririri, nekuti Chete shanduko yedata inofambiswa, ndiko kuti, kunyangwe yakazara backups haina kukwidzwa zvachose, sezvo sevha yenhau inounganidza inotevera yakazara backups kubva mukuwedzera backups.
Iyo yepakati sevha ine yayo yekuchengetera, kwainonyora "cache" yedata uye inochengetedza dhatabhesi yekubvisa.
Iyo yakazara architecture inoita seizvi:
- Iyo master server inogadzirisa zvigadziriso, zvigadziriso, nezvimwe uye iri mugore.
- Iyo midhiya sevha (yepakati * nix muchina) inofanirwa kunge iri padyo neakarenda masisitimu maererano nekuwanikwa kwenetiweki. Pano, kudzoreredzwa kwema backups kubva kumashini akachengetwa anoitwa.
- Pamichina inotsigirwa pane vamiririri vanowanzotumira kune media server chete izvo zvisiri mukuchengetedza kwayo.
Izvo zvese zvinotanga ne scan yakazara - iyi izere-yakazara backup yakazara. Panguva ino, sevha yevhidhiyo inotora zvese, inozvinyora uye yozviendesa kuS3. Iyo yekumhanyisa kune media server yakaderera, asi kubva pairi yakakwira. Mhedziso huru isimba rekombuta reseva.
Iwo anotevera backups anogadzirwa akakwana kubva pakuona kwese masisitimu, asi muchokwadi iwo chinhu chakafanana neanogadzira akazara backups. Ndokunge, iyo chaiyo yekuchinjisa uye kurekodha kune midhiya server inoitika chete yeaya mabhuroki edata anga asati asangana nawo muVM backups kare. Uye chete iwo madhibhiti data ane hashi isiri mu media server's deduplication dhatabhesi anotamiswa uye anorekodhwa muS3. Nemashoko akareruka, ichi chinhu chisati chamboonekwa mune chero backup yeVM imwechete kare.
Panguva yekudzoreredza, sevha yenhau inokumbira izvo zvinodiwa zvakadzikiswa zvinhu kubva kuS3, inodzoreredza iyo uye inoendesa kune iyo IRB agents, i.e. zvakakosha kufunga nezvehuwandu hwemotokari panguva yekudzorera, iyo ichave yakaenzana nehuwandu hwemashoko ari kudzorerwa.
Heano maitiro ayo
Uye hechino chimwe chidimbu chematanda169 Jobs (0 Yakaiswa Mutsara 0 Inoshanda 0 Yakamirira Kuedzazve 0 Yakamiswa 0 Haina Kukwana 169 Yaitwa β 1 yakasarudzwa)
Job Id Type State State Details Status Job Policy Basa Rondedzero Client Media Server Kutanga Nguva Yakapfuura Nguva Yekupedzisira Nguva Yekuchengeta Chikamu Kuedza Kushanda Kilobytes Mafaira Pathname % Yakazara (Inofungidzirwa) Job PID Muridzi Copy Mubereki Basa ID KB/Sec Active Tanga Active Elapsed Robot Vault Profile Session ID Media yekubvisa Dhata Movement Off-Host Type Master Priority Deduplication Rate Yekufambisa Accelerator Optimization Instance kana Database Govera Host
- 1372 Kudzoreredza Kwaitwa 0 NBPR01 NBCC Zvita 19, 2018 1:05:58 PM 00:04:32 Zvita 19, 2018 1:10:30 PM 1 14,380,577 1 100% 8548 1372 Dec 70,567 19 2018 ROOT :1 :06 PM 00:00:04 WIN-************** 30
Kuvimbika kwedata kunovimbiswa nekuchengetedzwa kweS3 pachayo - kune yakanaka redundancy ipapo yekudzivirira kubva mukutadza kwehardware senge yakafa hard drive spindle.
Iyo media server inoda 4 TB yecache - iyi ikurudziro yeVeritas yakaderera saizi. Zvakawanda zviri nani, asi ndizvo zvatakaita.
Mugumisiro
Mumwe mudiwa paakakanda 3 GB muS20 yedu, isu takachengeta 60 GB, nekuti tinopa katatu geo-reservation yedata. Ikozvino kune traffic shoma shoma, iyo yakanaka kune chiteshi uye nemitengo yekuchengetedza.
Muchiitiko ichi, nzira dzakavharwa kupfuura "Internet huru", asi iwe unogona kutyaira motokari kuburikidza neVPN L2 pamusoro peInternet, asi zviri nani kuisa sevha yevhidhiyo pamberi pekupinda kwemupi.
Kana iwe uchida kudzidza nezve maficha aya munzvimbo dzedu dzeRussia data kana uine mibvunzo nezve kuita kumba, bvunza mune zvakataurwa kana neemail. [email inodzivirirwa].
Source: www.habr.com