Makasitomala athu aku Turkey adatipempha kuti tikonze zosunga zobwezeretsera pamalo awo a data. Tikuchita ntchito zofananira ku Russia, koma apa nkhaniyi inali yokhudza kufufuza momwe tingachitire bwino.
Kuperekedwa: pali malo osungiramo a S3, pali Veritas NetBackup, yomwe yapeza ntchito yatsopano yowonjezerapo yosunthira deta kusungirako zinthu, tsopano ndi chithandizo cha deduplication, ndipo pali vuto ndi malo osungiramo malo osungirako malo.
Ntchito: kupanga chilichonse kuti njira yosungira zosunga zobwezeretsera ikhale yachangu komanso yotsika mtengo.
Kwenikweni, izi zisanachitike, chilichonse mu S3 chinali mafayilo chabe, ndipo awa anali makina ofunikira a data center. Izi ndiye kuti, sizokonzedwa bwino, koma zonse zidagwira ntchito poyambira. Tsopano ndi nthawi yoti muganizire ndikuchita bwino.
Chithunzichi chikuwonetsa zomwe tidabwerako:
Monga mukuwonera, zosunga zobwezeretsera zoyamba zidapangidwa pang'onopang'ono (70 Mb / s), ndipo zosunga zobwezeretsera zamakina omwewo zidali mwachangu kwambiri.
M'malo mwake, pali zina zambiri pazomwe zilipo.
Zosungira zosunga zobwezeretsera za omwe ali okonzeka kuwerenga theka la tsamba la kutayaWodzaza ndi rescan
Dec 18, 2018 12:09:43 PM - Info bpbkar (pid=4452) accelerator inatumiza 14883996160 byte kuchokera ku 14883994624 byte ku seva, kukhathamiritsa 0.0%
Dec 18, 2018 12:10:07 PM - Info NBCC (pid=23002) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Report=Ziwerengero za PDDO (mitsinje yamitundu yambiri yogwiritsidwa ntchito) ya (NBCC): yojambulidwa: 14570817 KB, CR inatumiza: 1760761 KB, CR inatumiza FC: 0 KB, dedup: 87.9%, cache yazimitsidwa
Full
Dec 18, 2018 12:13:18 PM - Info bpbkar (pid=2864) accelerator inatumiza 181675008 byte kuchokera ku 14884060160 byte ku seva, kukhathamiritsa 98.8%
Dec 18, 2018 12:13:40 PM - Info NBCC (pid=23527) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Report=PDDO Stats za (NBCC): scanned: 14569706 KB, CR inatumiza: 45145 KB, CR inatumizidwa pa FC: 0 KB, dedup: 99.7%, cache yazimitsidwa
Zosakaniza
Dec 18, 2018 12:15:32 PM - Info bpbkar (pid=792) accelerator inatumiza 9970688 byte kuchokera ku 14726108160 byte ku seva, kukhathamiritsa 99.9%
Dec 18, 2018 12:15:53 PM - Info NBCC (pid=23656) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Report=PDDO Stats za (NBCC): scanned: 14383788 KB, CR inatumiza: 15700 KB, CR inatumizidwa pa FC: 0 KB, dedup: 99.9%, cache yazimitsidwa
Full
Dec 18, 2018 12:18:02 PM - Info bpbkar (pid=3496) accelerator inatumiza 171746816 byte kuchokera ku 14884093952 byte ku seva, kukhathamiritsa 98.8%
Dec 18, 2018 12:18:24 PM - Info NBCC (pid=23878) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Report=PDDO Stats za (NBCC): scanned: 14569739 KB, CR inatumiza: 34120 KB, CR inatumizidwa pa FC: 0 KB, dedup: 99.8%, cache yazimitsidwa
Vuto ndi chiyani
Makasitomala amafuna kupanga zosunga zobwezeretsera pafupipafupi momwe angathere ndikuzisunga motchipa momwe angathere. Ndikwabwino kuzisunga zotsika mtengo m'malo osungira zinthu monga S3, chifukwa ndizotsika mtengo kwambiri pamtengo wautumiki pa Megabyte kuchokera pomwe mutha kubweza zosunga zobwezeretsera munthawi yoyenera. Pakakhala zosunga zobwezeretsera zambiri, zimakhala zotsika mtengo kwambiri, chifukwa zosungirako zambiri zimakhala ndi zolemba zomwezo. Pankhani ya HaaS ya anzawo aku Turkey, kusungirako kumatha kukhala kolimba ndi pafupifupi 80-90%. Ziri zoonekeratu kuti izi zikugwirizana makamaka ndi zenizeni zawo, koma ndithudi ndikudalira osachepera 50% agogo aamuna.
Kuti athetse vutoli, ogulitsa akuluakulu akhala akupanga kale zipata za Amazon S3. Njira zawo zonse zimagwirizana ndi S3 yakomweko bola amathandizira Amazon API. M'malo osungiramo data ku Turkey, zosunga zobwezeretsera zimapangidwira ku S3 yathu, komanso mu T-III "Compressor" ku Russia, popeza dongosolo lantchitoli latigwirira ntchito bwino.
Ndipo S3 yathu imagwirizana kwathunthu ndi njira zosunga zobwezeretsera za Amazon S3. Ndiye kuti, zida zonse zosunga zobwezeretsera zomwe zimathandizira njirazi zimakupatsani mwayi wokopera chilichonse kumalo osungirako "kunja kwa bokosi."
Veritas NetBackup adawonjezera mawonekedwe a CloudCatalyst:
Ndiye kuti, pakati pa makina omwe amayenera kuthandizidwa ndi chipata, pali seva yapakatikati ya Linux yomwe magalimoto osunga zobwezeretsera kuchokera kwa othandizira a SRK amadutsa ndikusinthidwa pa ntchentche asanasamutsire ku S3. Ngati kale panali zosungira 30 za 20 GB ndi kuponderezedwa, tsopano (chifukwa cha kufanana kwa makina) voliyumu yawo yakhala yochepa 90%. Injini ya deduplication imagwiritsidwa ntchito mofananamo posungira pa disks wamba pogwiritsa ntchito Netbackup.
Izi ndi zomwe zimachitika pamaso pa seva yapakatikati:
Tinayesa ndipo tinapeza kuti tikamagwiritsidwa ntchito m'malo athu a deta, izi zimasunga malo mu yosungirako S3 kwa ife ndi makasitomala. Monga mwiniwake wa malo ogulitsa malonda, ndithudi, timalipira malinga ndi kuchuluka kwa ndalama zomwe zimagwiritsidwa ntchito, komabe zimakhala zopindulitsa kwambiri kwa ifenso - chifukwa timayamba kupanga ndalama pa malo owopsa kwambiri mu mapulogalamu, osati pa hardware yobwereka. Chabwino, ndipo uku ndikuchepetsa ndalama zamkati.
MitengoNtchito 228 (0 Pamzere 0 Yogwira 0 Kudikirira Kuyesanso 0 Yayimitsidwa 0 Yosakwanira 228 Yachitika β 13 yasankhidwa)
(Zosefera Zagwiritsidwa Ntchito [13])
Job Id Type State State Details Status Job Policy Job Client Media Server Start Time Inapita Nthawi Yotsiriza Yosungirako Unit Kuyesa Kugwira Ntchito Mafayilo a Kilobytes Pathname% Malizitsani (Akuyerekeza) Job PID Owner Copy Kholo Job ID KB/Sec Yogwira Yambani Yogwira Itatha Robot Vault Profile Session ID Media Kuti Muyike Kusuntha Kwama data Off-Host Type Master Priority Deduplication Rate Transport Accelerator Optimization Instance kapena Database Share Host
β 1358 Snapshot Done 0 VMware β NGNCloudADC NBCC Dec 18, 2018 12:16:19 PM 00:02:18 Dec 18, 2018 12:18:37 PM STU_DP_S3_****zosunga zobwezeretsera 1 100 1358 18 Dec 2018 muzu 12 :16:27 PM 00:02:10 Instant Recovery Disk Standard WIN-*********** 0
1360 zosunga zobwezeretsera Zachitika 0 VMware Full NGNCloudADC NBCC Dec 18, 2018 12:16:48 PM 00:01:39 Dec 18, 2018 12:18:27 PM STU_DP_S3_****zosunga zobwezeretsera 1 14,535,248 149654 100 23858 1358 335,098 18 2018 12 16 48 00 01 39 0 99.8 Dec 99 , XNUMX XNUMX:XNUMX:XNUMX PM XNUMX:XNUMX:XNUMX Instant Recovery Disk Standard WIN-************* XNUMX XNUMX% XNUMX%
1352 Snapshot Done 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:14:04 PM 00:02:01 Dec 18, 2018 12:16:05 PM STU_DP_S3_****zosunga zobwezeretsera 1 100% 1352 Dec 18: 2018 Dec 12 14:14 PM 00:01:51 Instant Recovery Disk Standard WIN-*********** 0
1354 zosunga zobwezeretsera Zachitika 0 VMware Incremental NGNCloudADC NBCC Dec 18, 2018 12:14:34 PM 00:01:21 Dec 18, 2018 12:15:55 PM STU_DP_S3_****zosunga zobwezeretsera 1 14,380,965% 147 100 23617 Dec 1352 , 500,817 18:2018:12 PM 14:34:00 Instant Recovery Disk Standard WIN-************* 01 21% 0%
1347 Snapshot Done 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:11:45 PM 00:02:08 Dec 18, 2018 12:13:53 PM STU_DP_S3_****zosunga zobwezeretsera 1 100% 1347 Dec 18: 2018 Dec 12 11:45 PM 00:02:08 Instant Recovery Disk Standard WIN-*********** 0
1349 zosunga zobwezeretsera Zachitika 0 VMware Full NGNCloudADC NBCC Dec 18, 2018 12:12:02 PM 00:01:41 Dec 18, 2018 12:13:43 PM STU_DP_S3_****zosunga zobwezeretsera 1 14,535,215 149653 100 23508 1347 316,319 18 2018 12 12 02 00 01 41 0 99.7 Dec 99 , XNUMX XNUMX:XNUMX:XNUMX PM XNUMX:XNUMX:XNUMX Instant Recovery Disk Standard WIN-************* XNUMX XNUMX% XNUMX%
1341 Snapshot Done 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:05:28 PM 00:04:53 Dec 18, 2018 12:10:21 PM STU_DP_S3_****zosunga zobwezeretsera 1 100% 1341 Dec 18: 2018 Dec 12 05:28 PM 00:04:53 Instant Recovery Disk Standard WIN-*********** 0
1342 zosunga zobwezeretsera Zachitika 0 VMware Full_Rescan NGNCloudADC NBCC Dec 18, 2018 12:05:47 PM 00:04:24 Dec 18, 2018 12:10:11 PM STU_DP_S3_****zosunga zobwezeretsera 1% mizu 14,535,151 149653% 100 22999 1341 70,380 Dec 18 , 2018 12:05:47 PM 00:04:24 Instant Recovery Disk Standard WIN-*********** 0 87.9% 0%
1339 Snapshot Done 150 VMware - NGNCloudADC NBCC Dec 18, 2018 11:05:46 AM 00:00:53 Dec 18, 2018 11:06:39 AM STU_DP_S3_****zosunga zobwezeretsera 1 100 1339% 18 Dec 2018% 11:05 AM 46:00:00 Instant Recovery Disk Standard WIN-*********** 53
1327 Snapshot Done 0 VMware - *******.********.cloud NBCC Dec 17, 2018 12:54:42 PM 05:51:38 Dec 17, 2018 6:46:20 PM STU_DP_S3_****zosunga zobwezeretsera 1 100% mizu 1327 Dec 17, 2018 12:54:42 PM 05:51:38 Instant Recovery Disk Standard WIN-*********** 0
1328 Zosunga Zosungidwa Zachitika 0 VMware Full *******************.cloud NBCC Dec 17, 2018 12:55:10 PM 05:29:21 Dec 17, 2018 6:24:31 PM STU_DP_S3_****zosunga zobwezeretsera 1 222,602,719 258932 100% 12856 mizu 1327 11,326 Dec 17, 2018 12:55:10 PM 05:29:21 Instant Recovery % Diski *0 * 87.9 ****WIN-Standa0 XNUMX%
1136 Snapshot Done 0 VMware - *******.********.cloud NBCC Dec 14, 2018 4:48:22 PM 04:05:16 Dec 14, 2018 8:53:38 PM STU_DP_S3_****zosunga zobwezeretsera 1 100% mizu 1136 Dec 14, 2018 4:48:22 PM 04:05:16 Instant Recovery Disk Standard WIN-*********** 0
1140 Zosunga Zosungidwa Zachitika 0 VMware Full_Scan *******.********.cloud NBCC Dec 14, 2018 4:49:14 PM 03:49:58 Dec 14, 2018 8:39:12 PM STU_DP_S3_****zosunga zobwezeretsera 1 217,631,332 255465 100% 26438 mizu 1136 15,963 Dec 14, 2018 4:49:14 PM 03:49:58 Instant Recovery Disk *0**** 45.2 WIN-0. XNUMX%
The accelerator imakulolani kuti muchepetse magalimoto kuchokera kwa othandizira, chifukwa Kusintha kwa data kokha kumapatsirana, ndiko kuti, ngakhale zosunga zobwezeretsera zonse sizimakwezedwa kwathunthu, popeza seva yapa media imasonkhanitsa zosunga zobwezeretsera zonse kuchokera pazosunga zochulukirapo.
Seva yapakatikati ili ndi zosungira zake, pomwe imalemba "cache" ya data ndikusunga nkhokwe kuti ichotsedwe.
Zomangamanga zonse zikuwoneka motere:
- Seva yayikulu imayendetsa kasinthidwe, zosintha, ndi zina zambiri ndipo ili mumtambo.
- Seva yapa media (makina apakati * nix) iyenera kukhala pafupi kwambiri ndi machitidwe osafunikira malinga ndi kupezeka kwa maukonde. Apa, kuchotsedwa kwa zosunga zobwezeretsera kumakina onse osungidwa kumachitika.
- Pa makina ochirikizidwa pali othandizira omwe nthawi zambiri amatumiza ku seva ya media zokha zomwe sizili m'malo ake.
Zonse zimayamba ndi kusanthula kwathunthu - uku ndikusunga kwathunthu. Pakadali pano, seva yapa media imatenga chilichonse, ndikuchichotsa ndikuchisamutsira ku S3. Kuthamanga kwa seva yapa media ndikotsika, koma kuchokera pamenepo ndikwambiri. Cholepheretsa chachikulu ndi mphamvu yamakompyuta ya seva.
Ma backups otsatirawa amapangidwa athunthu kuchokera pamawonekedwe a machitidwe onse, koma kwenikweni ali ngati ma backups opangidwa. Ndiko kuti, kusamutsa kwenikweni ndi kujambula ku seva yapa media kumapezeka kokha mwa midadada ya data yomwe sinakumanepo nayo mu zosunga zobwezeretsera za VM kale. Ndipo ma block okhawo omwe ma hashi sali mu media media deduplication database amasamutsidwa ndikujambulidwa mu S3. M'mawu osavuta, ichi ndi chinthu chomwe sichinawonekepo pakusunga kulikonse kwa VM imodzi m'mbuyomu.
Pakubwezeretsanso, seva yapa media imapempha zinthu zofunika kuchotsedwa kuchokera ku S3, kuzibwezeretsanso ndikuzitumiza kwa othandizira a IRB, i.e. m'pofunika kuganizira kuchuluka kwa magalimoto panthawi yobwezeretsa, yomwe idzakhala yofanana ndi kuchuluka kwa deta yomwe ikubwezeretsedwa.
Nazi zomwe zikuwoneka:
Ndipo apa pali chidutswa china cha zipikaNtchito 169 (0 Pamzere 0 Yogwira 0 Kudikirira Kuyesanso 0 Yayimitsidwa 0 Yosakwanira 169 Yachitika β 1 yasankhidwa)
Job Id Type State State Details Status Job Policy Job Client Media Server Start Time Inapita Nthawi Yotsiriza Yosungirako Unit Kuyesa Kugwira Ntchito Mafayilo a Kilobytes Pathname% Malizitsani (Akuyerekeza) Job PID Owner Copy Kholo Job ID KB/Sec Yogwira Yambani Yogwira Itatha Robot Vault Profile Session ID Media Kuti Muyike Kusuntha Kwama data Off-Host Type Master Priority Deduplication Rate Transport Accelerator Optimization Instance kapena Database Share Host
- 1372 Bwezeretsani Kwachitika 0 NBPR01 NBCC Dec 19, 2018 1:05:58 PM 00:04:32 Dec 19, 2018 1:10:30 PM 1 14,380,577 1 100% 8548 ROOT, 1372 Dec 70,567 19, 2018 1 06 00 :00 :04 PM 30:90000:XNUMX KUPAMBANA-************** XNUMX
Kukhulupirika kwa data kumatsimikiziridwa ndi kutetezedwa kwa S3 palokha - pali redundancy yabwino pamenepo kuti muteteze ku zolephera za Hardware monga spindle yakufa ya hard drive.
Seva yapa media ikufunika 4 TB ya cache - awa ndi malingaliro ochepa a Veritas. Zambiri ndizabwino, koma ndi zomwe tidachita.
Zotsatira
Mnzathu ataponya 3 GB mu S20 yathu, tidasunga 60 GB, chifukwa timapereka kusungitsa data katatu. Tsopano pali magalimoto ochepa, omwe ndi abwino panjira komanso pamitengo yosungira.
Pankhaniyi, misewu imatsekedwa kupitirira "Internet yaikulu", koma mukhoza kuyendetsa magalimoto kudzera VPN L2 pa intaneti, koma ndi bwino kukhazikitsa seva ya media pamaso pa khomo la wothandizira.
Ngati mukufuna kudziwa za izi m'malo athu aku Russia kapena muli ndi mafunso okhudza kukhazikitsa kunyumba, funsani ndemanga kapena imelo [imelo ndiotetezedwa].
Source: www.habr.com