Ungahlanganisa kanjani isitoreji sama-backups endaweni yokugcina into kuze kufike ku-90%

Amakhasimende ethu aseTurkey asicele ukuthi silungiselele kahle ikhophi yasenqolobaneni yesikhungo sawo sedatha. Senza amaphrojekthi afanayo eRussia, kodwa lapha indaba yayimayelana nokucwaninga indlela engcono kakhulu yokuwenza.

Kunikezwe: kukhona isitoreji se-S3 sendawo, kukhona i-Veritas NetBackup, ethole ukusebenza okusha okunwetshiwe kokuhambisa idatha kusitoreji sento, manje ngokusekelwa ukuphindaphinda, futhi kunenkinga yesikhala samahhala kulesi sitoreji sendawo.

Umsebenzi: ukwenza yonke into ukuze inqubo yokugcina amakhophi ayisipele isheshe futhi ingabizi.

Empeleni, ngaphambi kwalokhu, yonke into ku-S3 yayingamafayela nje, futhi lawa kwakungamaqoqo aphelele emishini ebalulekile yesikhungo sedatha. Okusho ukuthi, akuthuthukisiwe kakhulu, kepha konke kusebenze ekuqaleni. Manje sekuyisikhathi sokukucacisa futhi ukwenze kahle.

Isithombe sibonisa lokho esize kukho:

Ungahlanganisa kanjani isitoreji sama-backups endaweni yokugcina into kuze kufike ku-90%

Njengoba ubona, isipele sokuqala senziwe kancane (70 Mb/s), futhi izipele ezalandela zamasistimu afanayo zazishesha kakhulu.

Eqinisweni, kuqhubeke kunemininingwane emincane yokuthi yiziphi izici ezikhona.

Yenza ikhophi yasenqolobaneni yalabo abalungele ukufunda ingxenye yekhasi lokulahlaIgcwele ngokuskena kabusha
Dec 18, 2018 12:09:43 PM β€” Ulwazi bpbkar (pid=4452) isisheshisi sithumele amabhayithi angu-14883996160 kumabhayithi angu-14883994624 kuseva, ukulungiselelwa okungu-0.0%
Dec 18, 2018 12:10:07 PM - Ulwazi NBCC (pid=23002) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Umbiko=Izibalo ze-PDDO (kusetshenziswe ukusakaza okunemicu eminingi) ye-(NBCC): iskeniwe: 14570817 KB, i-CR ithunyelwe: 1760761 KB, i-CR ithunyelwe nge-FC: 0 KB, i-dedup: 87.9%, inqolobane ivaliwe

Full
Dec 18, 2018 12:13:18 PM β€” Ulwazi bpbkar (pid=2864) isisheshisi sithumele amabhayithi angu-181675008 kumabhayithi angu-14884060160 kuseva, ukulungiselelwa okungu-98.8%
Dec 18, 2018 12:13:40 PM - Ulwazi NBCC (pid=23527) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Umbiko=Izibalo ze-PDDO ze (NBCC): iskeniwe: 14569706 KB, i-CR ithunyelwe: 45145 KB, i-CR ithunyelwe nge-FC: 0 KB, i-dedup: 99.7%, inqolobane ivaliwe

Ukunciphisa
Dec 18, 2018 12:15:32 PM β€” Ulwazi bpbkar (pid=792) isisheshisi sithumele amabhayithi angu-9970688 kumabhayithi angu-14726108160 kuseva, ukulungiselelwa okungu-99.9%
Dec 18, 2018 12:15:53 PM - Ulwazi NBCC (pid=23656) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Umbiko=Izibalo ze-PDDO ze (NBCC): iskeniwe: 14383788 KB, i-CR ithunyelwe: 15700 KB, i-CR ithunyelwe nge-FC: 0 KB, i-dedup: 99.9%, inqolobane ivaliwe

Full
Dec 18, 2018 12:18:02 PM β€” Ulwazi bpbkar (pid=3496) isisheshisi sithumele amabhayithi angu-171746816 kumabhayithi angu-14884093952 kuseva, ukulungiselelwa okungu-98.8%
Dec 18, 2018 12:18:24 PM - Ulwazi NBCC (pid=23878) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Umbiko=Izibalo ze-PDDO ze (NBCC): iskeniwe: 14569739 KB, i-CR ithunyelwe: 34120 KB, i-CR ithunyelwe nge-FC: 0 KB, i-dedup: 99.8%, inqolobane ivaliwe

Yini inkinga

Amakhasimende afuna ukwenza izipele kaningi ngangokunokwenzeka futhi azigcine ngeshibhile ngangokunokwenzeka. Kungcono ukuwagcina ngokushibhile ezindaweni ezigcina izinto ezifana ne-S3, ngoba ashibhe kakhulu ngenani lesevisi ngeMegabyte ngayinye ukusuka lapho ungabuyisela khona ikhophi yasenqolobaneni ngesikhathi esifanele. Uma kunesipele esiningi, akushibhile kakhulu, ngoba isitoreji esiningi sihlala amakhophi edatha efanayo. Endabeni ye-HaaS yozakwethu baseTurkey, isitoreji singancishiswa cishe ngama-80-90%. Kuyacaca ukuthi lokhu kuhlobene ngokuqondile nokucaciswa kwabo, kodwa ngingathembela kumkhulu okungenani ongu-50%.

Ukuxazulula inkinga, abathengisi abakhulu sekuyisikhathi eside benza amasango e-Amazon S3. Zonke izindlela zabo ziyahambisana ne-S3 yendawo inqobo nje uma besekela i-Amazon API. Esikhungweni sedatha saseTurkey, kwenziwa isipele ku-S3 yethu, kanye naku-T-III β€œCompressor” yaseRussia, njengoba lolu hlelo lokusebenza lusisebenzele kahle.

Futhi i-S3 yethu iyahambisana ngokugcwele nezindlela zokulondoloza i-Amazon S3. Okusho ukuthi, wonke amathuluzi okulondoloza asekela lezi zindlela akuvumela ukuthi ukopishe yonke into kusitoreji esinjalo "ngaphandle kwebhokisi."

I-Veritas NetBackup yengeze isici se-CloudCatalyst:

Ungahlanganisa kanjani isitoreji sama-backups endaweni yokugcina into kuze kufike ku-90%

Okusho ukuthi, phakathi kwemishini edinga ukusekelwa kanye nesango, kukhona iseva ye-Linux ephakathi lapho kudlula khona ithrafikhi eyisipele evela kuma-ejenti e-SRK futhi iphindwe kabili ngaphambi kokuyidlulisela ku-S3. Uma ngaphambili bekukhona ama-backups angama-30 we-20 GB ngokucindezelwa, manje (ngenxa yokufana kwemishini) ivolumu yabo isibe yi-90% encane. Injini yokukhishwa isetshenziswa ngendlela efanayo nalapho ugcina kumadiski avamile usebenzisa i-Netbackup.

Nakhu okwenzeka ngaphambi kweseva emaphakathi:

Ungahlanganisa kanjani isitoreji sama-backups endaweni yokugcina into kuze kufike ku-90%

Sihlolile futhi safinyelela esiphethweni sokuthi lapho kusetshenziswa ezikhungweni zethu zedatha, lokhu konga isikhala kusitoreji se-S3 sethu nakumakhasimende. Njengomnikazi wezikhungo zedatha yezohwebo, vele, siyakhokhisa ngokuya ngevolumu ethathiwe, kodwa kusenenzuzo enkulu nakithi - ngoba siqala ukwenza imali ezindaweni eziyingozi kakhulu kusoftware, hhayi ekuqashiseni ihadiwe. Hhayi-ke, futhi lokhu kungukuncipha kwezindleko zangaphakathi.

IzingodoImisebenzi engama-228 (0 Kulayini 0 Iyasebenza 0 Ilinde Ukuzama Futhi 0 Imisiwe 0 Ayiphelele 228 Kwenziwe β€” 13 kukhethiwe)
(Kusetshenziswe Isihlungi [13])

I-ID Yomsebenzi Uhlobo Lwemininingwane Yesifunda Yesifunda Isimo Inqubomgomo Yomsebenzi Uhlelo Lomsebenzi Ishejuli Yeklayenti Leseva Yezindaba Isikhathi Sokuqala Esidlulile Isikhathi Sokuphela Isikhathi Seyunithi Yesitoreji Umzamo Wokusebenza Amafayela Ama-Kilobytes Umzila % Qedela (Kulinganiselwe) Umnikazi We-PID Yomsebenzi Kopisha I-ID Yomzali Womsebenzi KB/Sec Qala Iseshini Yephrofayela Esebenzayo Edlulile I-Robot Vault Imidiya ye-ID Yokukhipha Ukuhamba Kwedatha Ngaphandle Kokubamba Uhlobo Oluyinhloko Lokudonswa Kwezinga Lokudonswa Kwezinga Lokusheshisa Isinyathelo Sokuthuthukisa Isisheshisi Sokuthutha noma Umsingathi Wokwabelana Wesizindalwazi
β€” 1358 Snapshot Kwenziwe 0 VMware β€” NGNCloudADC NBCC Dec 18, 2018 12:16:19 PM 00:02:18 Dec 18, 2018 12:18:37 PM STU_DP_S3_****isipele 1 100 1358 Dec 18 Dec 2018 Dec 12 :16:27 PM 00:02:10 I-Instant Recovery Disk Standard WIN-*********** 0
1360 Ukwenza Ikhophi Yasenqolobaneni Kwenziwe 0 VMware Okugcwele NGNCloudADC NBCC Dec 18, 2018 12:16:48 PM 00:01:39 Dec 18, 2018 12:18:27 PM STU_DP_S3_****isipele 1 14,535,248 149654 100 23858 1358 335,098 18 2018 12 Disemba 16 , 48 00:01:39 PM 0:99.8:99 Instant Recovery Disk Standard WIN-************* XNUMX XNUMX% XNUMX%
1352 Snapshot Kwenziwe 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:14:04 PM 00:02:01 Dec 18, 2018 12:16:05 PM STU_DP_S3_****isipele 1 100% impande 1352 Dec 18: 2018 Dec 12 14:14 PM 00:01:51 I-Instant Recovery Disk Standard WIN-*********** 0
1354 Ukwenza Ikhophi Yasenqolobaneni Kwenziwe 0 I-VMware Incremental NGNCloudADC NBCC Dec 18, 2018 12:14:34 PM 00:01:21 Dec 18, 2018 12:15:55 PM STU_DP_S3_****isipele 1 14,380,965% 147 Disemba 100 , 23617 1352:500,817:18 PM 2018:12:14 I-Instant Recovery Disk Standard WIN-************** 34 00% 01%
1347 Snapshot Kwenziwe 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:11:45 PM 00:02:08 Dec 18, 2018 12:13:53 PM STU_DP_S3_****isipele 1 100% impande 1347 Dec 18: 2018 Dec 12 11:45 PM 00:02:08 I-Instant Recovery Disk Standard WIN-*********** 0
1349 Ukwenza Ikhophi Yasenqolobaneni Kwenziwe 0 VMware Okugcwele NGNCloudADC NBCC Dec 18, 2018 12:12:02 PM 00:01:41 Dec 18, 2018 12:13:43 PM STU_DP_S3_****isipele 1 14,535,215 149653 100 23508 1347 316,319 18 2018 12 Disemba 12 , 02 00:01:41 PM 0:99.7:99 Instant Recovery Disk Standard WIN-************* XNUMX XNUMX% XNUMX%
1341 Snapshot Kwenziwe 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:05:28 PM 00:04:53 Dec 18, 2018 12:10:21 PM STU_DP_S3_****isipele 1 100% impande 1341 Dec 18: 2018 Dec 12 05:28 PM 00:04:53 I-Instant Recovery Disk Standard WIN-*********** 0
1342 Ukwenza Ikhophi Yasenqolobaneni Kwenziwe 0 VMware Full_Rescan NGNCloudADC NBCC Dec 18, 2018 12:05:47 PM 00:04:24 Dec 18, 2018 12:10:11 PM STU_DP_S3_****isipele 1 14,535,151 149653% impande 100 22999 1341 Dec 70,380 , 18 2018:12:05 PM 47:00:04 Instant Recovery Disk Standard WIN-*********** 24 0% 87.9%

1339 Snapshot Kwenziwe 150 VMware - NGNCloudADC NBCC Dec 18, 2018 11:05:46 AM 00:00:53 Dec 18, 2018 11:06:39 AM STU_DP_S3_****isipele impande 1 100: 1339 18% 2018:11 AM 05:46:00 I-Instant Recovery Disk Standard WIN-*********** 00
1327 Snapshot Kwenziwe 0 VMware - *******.********.cloud NBCC Dec 17, 2018 12:54:42 PM 05:51:38 Dec 17, 2018 6:46:20 PM STU_DP_S3_****isipele esingu-1 100% impande 1327 Dec 17, 2018 12:54:42 PM 05:51:38 I-Instant Recovery Disk Standard WIN-*********** 0
1328 Ukwenza Ikhophi Yasenqolobaneni Kwenziwe 0 VMware Igcwele *******.********.cloud NBCC Dec 17, 2018 12:55:10 PM 05:29:21 Dec 17, 2018 6:24:31 PM STU_DP_S3_****isipele 1 222,602,719 258932 100% 12856 impande 1327 11,326 Dec 17, 2018 12:55:10 PM 05:29:21 I-Instant Recovery % Disk*0 WINA-87.9 WIN. 0%
1136 Snapshot Kwenziwe 0 VMware - *******.********.cloud NBCC Dec 14, 2018 4:48:22 PM 04:05:16 Dec 14, 2018 8:53:38 PM STU_DP_S3_****isipele esingu-1 100% impande 1136 Dec 14, 2018 4:48:22 PM 04:05:16 I-Instant Recovery Disk Standard WIN-*********** 0
1140 Ukwenza Ikhophi Yasenqolobaneni Kwenziwe 0 VMware Full_Scan *******.********.cloud NBCC Dec 14, 2018 4:49:14 PM 03:49:58 Dec 14, 2018 8:39:12 PM STU_DP_S3_****isipele 1 217,631,332 255465 100% 26438 impande 1136 15,963 Dec 14, 2018 4:49:14 PM 03:49:58 Instant Recovery Disk*****0% WIN. 45.2%

I-accelerator ikuvumela ukuthi unciphise ithrafikhi evela kubasebenzeli, ngoba Izinguquko zedatha kuphela ezidluliselwayo, okungukuthi, ngisho nezipele ezigcwele azilayishwa ngokuphelele, njengoba iseva yemidiya iqoqa izipele ezigcwele ezilandelayo kusukela kuzipele ezikhulayo.

Iseva emaphakathi inokugcina kwayo, lapho ibhala khona β€œinqolobane” yedatha futhi igcine isizindalwazi ukuze idonswe.

I-architecture ephelele ibukeka kanje:

  1. Iseva eyinhloko ilawula ukumisa, izibuyekezo, njll. futhi itholakala emafini.
  2. Iseva yemidiya (emaphakathi *umshini we-nix) kufanele ibekwe eduze nezinhlelo ezingasasebenzi ngokuya ngokufinyeleleka kwenethiwekhi. Lapha, ukuphindaphinda kwama-backups kuyo yonke imishini egodliwe kuyenziwa.
  3. Emishinini eyenziwe ikhophi yasenqolobaneni kunama-ejenti ngokuvamile athumela kuseva yemidiya kuphela lokho okungekho endaweni yayo yokugcina.

Konke kuqala ngokuskena okugcwele - lesi isipele esigcwele ngokugcwele. Kuleli qophelo, iseva yemidiya ithatha konke, ikukhiphe futhi ikudlulisele ku-S3. Isivinini esiya kuseva yemidiya siphansi, kodwa sisuka kuso siphezulu. Umkhawulo oyinhloko amandla ekhompyutha weseva.

Izipele ezilandelayo zenziwa ziphelele ngokombono wawo wonke amasistimu, kodwa empeleni ziyinto efana nezipele ezigcwele zokwenziwa. Okusho ukuthi, ukudlulisa nokurekhoda kwangempela kuseva yemidiya kwenzeka kuphela kulawo mabhulokhi wedatha angakahlangabezwana nawo kuzipele ze-VM ngaphambilini. Futhi yilawo mabhulokhi wedatha kuphela i-hashi yawo engekho kusizindalwazi sokudonswa kweseva yemidiya adluliswayo futhi aqoshwe ku-S3. Ngamagama alula, lokhu kuyinto engakaze ibonwe kunoma yisiphi isipele se-VM eyodwa ngaphambilini.

Ngesikhathi sokubuyisela, iseva yemidiya icela izinto ezidingekayo ezikhishiwe ku-S3, izibuyisele emanzini futhi izidlulisele kuma-ejenti e-IRB, i.e. kuyadingeka ukucabangela umthamo wethrafikhi ngesikhathi sokubuyiselwa, okuzolingana nevolumu yangempela yedatha ebuyiselwayo.

Nakhu ukuthi kubukeka kanjani:

Ungahlanganisa kanjani isitoreji sama-backups endaweni yokugcina into kuze kufike ku-90%

Futhi nansi enye ingxenye yezingodoImisebenzi engama-169 (0 Kulayini 0 Iyasebenza 0 Ilinde Ukuzama Futhi 0 Imisiwe 0 Ayiphelele 169 Kwenziwe β€” 1 kukhethiwe)

I-ID Yomsebenzi Uhlobo Lwemininingwane Yesifunda Yesifunda Isimo Inqubomgomo Yomsebenzi Uhlelo Lomsebenzi Ishejuli Yeklayenti Leseva Yezindaba Isikhathi Sokuqala Esidlulile Isikhathi Sokuphela Isikhathi Seyunithi Yesitoreji Umzamo Wokusebenza Amafayela Ama-Kilobytes Umzila % Qedela (Kulinganiselwe) Umnikazi We-PID Yomsebenzi Kopisha I-ID Yomzali Womsebenzi KB/Sec Qala Iseshini Yephrofayela Esebenzayo Edlulile I-Robot Vault Imidiya ye-ID Yokukhipha Ukuhamba Kwedatha Ngaphandle Kokubamba Uhlobo Oluyinhloko Lokudonswa Kwezinga Lokudonswa Kwezinga Lokusheshisa Isinyathelo Sokuthuthukisa Isisheshisi Sokuthutha noma Umsingathi Wokwabelana Wesizindalwazi
- 1372 Ukubuyisela Kwenziwe 0 NBPR01 NBCC Dec 19, 2018 1:05:58 PM 00:04:32 Dec 19, 2018 1:10:30 PM 1 14,380,577 1 100% 8548 1372 Dec 70,567 ROOT :19 :2018 PM 1:06:00 WINA-************** 00

Ubuqotho bedatha buqinisekiswa ngokuvikeleka kwe-S3 ngokwayo - kukhona ukuphindaphinda okuhle lapho ukuze kuvikelwe ekuhlulekeni kwehadiwe okufana ne-dead hard drive spindle.

Iseva yemidiya idinga u-4 TB wenqolobane - lesi isincomo sikasayizi omncane we-Veritas. Okuningi kungcono, kodwa yilokho esikwenzile.

Umphumela

Lapho uzakwethu ephonsa u-3 GB ku-S20 yethu, sigcine u-60 GB, ngoba sihlinzeka ngokubhukwa kwe-geo kathathu kwedatha. Manje kunethrafikhi encane kakhulu, elungele isiteshi kanye nezindleko zokugcina.

Kulesi simo, imizila ivaliwe "i-intanethi enkulu", kodwa ungakwazi ukushayela ithrafikhi nge-VPN L2 nge-intanethi, kodwa kungcono ukufaka iseva yemidiya ngaphambi kokungena komhlinzeki.

Uma ungathanda ukufunda ngalezi zici ezikhungweni zethu zedatha zaseRussia noma unemibuzo mayelana nokusebenzisa ekhaya, buza kumazwana noma nge-imeyili [i-imeyili ivikelwe].

Source: www.habr.com

Engeza amazwana