Pehea e hoʻopaʻa i ka mālama ʻana i nā waihona i ka waiho ʻana i nā mea a hiki i 90%

Ua noi mai kā mākou mea kūʻai Turkish iā mākou e hoʻonohonoho pono i kā lākou kikowaena data. Ke hana nei mākou i nā papahana like ma Rūsia, akā eia ka moʻolelo e pili ana i ka noiʻi ʻana pehea e hana ai.

Hāʻawi ʻia: aia kahi waihona S3 kūloko, aia ʻo Veritas NetBackup, ka mea i loaʻa i nā hana hou i hoʻonui ʻia no ka neʻe ʻana i ka ʻikepili i ka waiho ʻana o nā mea, i kēia manawa me ke kākoʻo no ka hoʻokaʻawale ʻana, a aia kahi pilikia me ka wahi kūʻokoʻa i kēia waihona kūloko.

Hana: e hana i nā mea āpau i wikiwiki a maʻalahi ke kaʻina o ka mālama ʻana i nā kope kope.

ʻOiaʻiʻo, ma mua o kēia, ʻo nā mea a pau ma S3 he faila wale nō, a he mau pahu piha kēia o nā mīkini koʻikoʻi o ke kikowaena data. ʻO ia hoʻi, ʻaʻole i hoʻopaʻa ʻia, akā ua hana nā mea āpau i ka hoʻomaka. ʻO ka manawa kēia e noʻonoʻo ai a hana pono.

Hōʻike ke kiʻi i kā mākou i hele mai ai:

Pehea e hoʻopaʻa i ka mālama ʻana i nā waihona i ka waiho ʻana i nā mea a hiki i 90%

E like me kāu e ʻike ai, ua hana mālie ʻia ka waihona mua (70 Mb/s), a ʻoi aku ka wikiwiki o ka hoʻihoʻi ʻana o nā ʻōnaehana like.

ʻOiaʻiʻo, ʻoi aku ka nui o nā kikoʻī e pili ana i nā hiʻohiʻona.

Hoʻopaʻa moʻolelo no ka poʻe mākaukau e heluhelu i ka hapalua ʻaoʻao o ka dumpPiha me ka scan hou
Dec 18, 2018 12:09:43 PM — ʻIke bpbkar (pid=4452) accelerator hoʻouna 14883996160 bytes mai 14883994624 bytes i ke kikowaena, optimization 0.0%
Dec 18, 2018 12:10:07 PM - Info NBCC (pid=23002) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Hōʻike = PDDO Stats (multi-threaded stream i hoʻohana ʻia) no (NBCC): nānā ʻia: 14570817 KB, CR i hoʻouna ʻia: 1760761 KB, CR i hoʻouna ʻia ma FC: 0 KB, wehe ʻia: 87.9%, hoʻopaʻa ʻia ka cache

Full
Dec 18, 2018 12:13:18 PM — ʻIke bpbkar (pid=2864) accelerator hoʻouna 181675008 bytes mai 14884060160 bytes i ke kikowaena, optimization 98.8%
Dec 18, 2018 12:13:40 PM - Info NBCC (pid=23527) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Hōʻike=PDDO Stats no (NBCC): nānā ʻia: 14569706 KB, hoʻouna ʻia ʻo CR: 45145 KB, hoʻouna ʻia ʻo CR ma FC: 0 KB, wehe ʻia: 99.7%, hoʻopaʻa ʻia ka cache

Hoʻonuiʻia
Dec 18, 2018 12:15:32 PM — ʻIke bpbkar (pid=792) accelerator hoʻouna 9970688 bytes mai 14726108160 bytes i ke kikowaena, optimization 99.9%
Dec 18, 2018 12:15:53 PM - Info NBCC (pid=23656) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Hōʻike=PDDO Stats no (NBCC): nānā ʻia: 14383788 KB, hoʻouna ʻia ʻo CR: 15700 KB, hoʻouna ʻia ʻo CR ma FC: 0 KB, wehe ʻia: 99.9%, hoʻopaʻa ʻia ka cache

Full
Dec 18, 2018 12:18:02 PM — ʻIke bpbkar (pid=3496) accelerator hoʻouna 171746816 bytes mai 14884093952 bytes i ke kikowaena, optimization 98.8%
Dec 18, 2018 12:18:24 PM - Info NBCC (pid=23878) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Hōʻike=PDDO Stats no (NBCC): nānā ʻia: 14569739 KB, hoʻouna ʻia ʻo CR: 34120 KB, hoʻouna ʻia ʻo CR ma FC: 0 KB, wehe ʻia: 99.8%, hoʻopaʻa ʻia ka cache

He aha ka pilikia

Makemake nā mea kūʻai e hana i nā waihona i nā manawa a pau e hiki ai a mālama iā lākou e like me ka hiki. ʻOi aku ka maikaʻi o ka mālama liʻiliʻi ʻana iā lākou i loko o nā waihona mea e like me S3, no ka mea, ʻoi aku ka liʻiliʻi o ke kumukūʻai o ka lawelawe ma Megabyte mai kahi e hiki ai iā ʻoe ke ʻōwili i kahi hoʻihoʻi i ka manawa kūpono. Ke nui ka waihona, ʻaʻole lilo ia i mea maʻalahi, no ka mea, ʻo ka hapa nui o ka waihona e noho ʻia e nā kope o ka ʻikepili like. I ka hihia o HaaS o nā hoa hana Turkish, hiki ke hoʻopaʻa ʻia ka mālama ʻana ma kahi o 80-90%. Ua maopopo e pili pono ana kēia i kā lākou mau kikoʻī, akā e manaʻo maoli wau i ka liʻiliʻi o 50% kupuna kāne.

No ka hoʻoponopono ʻana i ka pilikia, ua hana nā mea kūʻai nui i nā puka i Amazon S3. Hoʻopili ko lākou mau ala āpau me S3 kūloko ke kākoʻo lākou i ka Amazon API. Ma ke kikowaena data Turkish, hana ʻia ke kākoʻo i kā mākou S3, a me ka T-III "Compressor" ma Rusia, no ka mea ua hana maikaʻi kēia ʻano hana no mākou.

A paʻa loa kā mākou S3 me nā ala hoʻihoʻi Amazon S3. ʻO ia hoʻi, ʻo nā mea hana kākoʻo āpau e kākoʻo ana i kēia mau ʻano hana e ʻae iā ʻoe e kope i nā mea āpau i kēlā waihona "ma waho o ka pahu."

Ua hoʻohui ʻo Veritas NetBackup i ka hiʻohiʻona CloudCatalyst:

Pehea e hoʻopaʻa i ka mālama ʻana i nā waihona i ka waiho ʻana i nā mea a hiki i 90%

ʻO ia hoʻi, ma waena o nā mīkini e pono e kākoʻo ʻia a me ka ʻīpuka, aia kahi kikowaena Linux waena kahi e hele ai nā kaʻa hoʻihoʻi mai nā ʻelele SRK a wehe ʻia i ka lele ma mua o ka hoʻoili ʻana iā S3. Inā ma mua he 30 mau kākoʻo o 20 GB me ka hoʻopaʻa ʻana, i kēia manawa (ma muli o ka like o nā mīkini) ua lilo kā lākou leo ​​i 90% liʻiliʻi. Hoʻohana ʻia ka ʻenekini deduplication e like me ka mālama ʻana i nā disks maʻamau me ka hoʻohana ʻana iā Netbackup.

Eia ka mea ma mua o ke kikowaena waena:

Pehea e hoʻopaʻa i ka mālama ʻana i nā waihona i ka waiho ʻana i nā mea a hiki i 90%

Ua hoʻāʻo mākou a hiki i ka hopena i ka wā i hoʻokō ʻia ai i loko o kā mākou mau kikowaena data, mālama kēia i ka wahi i ka waihona S3 no mākou a no nā mea kūʻai aku. E like me ka mea nona nā kikowaena ʻikepili pāʻoihana, ʻoiaʻiʻo, ke hoʻopiʻi nei mākou e like me ka leo i noho ʻia, akā ʻoi aku ka maikaʻi no mākou - no ka mea, hoʻomaka mākou e loaʻa kālā ma nā wahi scalable i ka lako polokalamu, ʻaʻole ma ka hoʻolimalima ʻana i nā lako. ʻAe, a he hōʻemi kēia i nā koina kūloko.

Nā lāʻau lāʻau228 Hana (0 Queue 0 Active 0 Kali no ka ho'āʻo hou 0 Hoʻopanee ʻia 0 Paʻa ʻole 228 Hana — 13 i koho ʻia)
(Hoʻohana ʻia ke kānana [13])

ʻAno Id ʻAno Mokuʻāina Mokuʻāina Kūlana Kūlana Kūlana Hana Ka Papa Hana Mea Kūʻai Kūʻai Kūʻai Kūʻai Kūʻai Kūikawā Hoʻomaka Wā Hoʻopau Manawa Manawa Hoʻāʻo ʻana i ka hana Kilobytes Files Pathname % Paʻa (Manaʻo ʻia) Paʻa (Manaʻo ʻia) Ka mea nona ka PID hana kope makua Job ID KB/Sec Active Start Active Elapsed Robot Vault Profile Session ID Media no ke kipaku ʻana i ka neʻe ʻana o ka ʻikepili i waho-host Type Master Priority Deduplication Rate Transport Accelerator Optimization Instance or Database Share Host
— 1358 Snapshot Hana ʻia 0 VMware — NGNCloudADC NBCC Dec 18, 2018 12:16:19 PM 00:02:18 Dec 18, 2018 12:18:37 PM STU_DP_S3_****backup 1 100% Dec 1358. :18:2018 PM 12:16:27 Hoʻihoʻi koke i ka Disk Standard WIN-********** 00
Hana ʻia 1360 Backup 0 VMware Full NGNCloudADC NBCC Dec 18, 2018 12:16:48 PM 00:01:39 Dec 18, 2018 12:18:27 PM STU_DP_S3_****backup 1 14,535,248 149654 100 23858 Dec 1358 , 335,098 18:2018:12 PM 16:48:00 ʻO ka hoʻihoʻi koke ʻana Disk Standard WIN-************* 01 39% 0%
1352 Paʻi Paʻi Hana ʻia 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:14:04 PM 00:02:01 Dec 18, 2018 12:16:05 PM STU_DP_S3_****backup 1 100% kumu 1352 Dec. 18:2018 PM 12:14:14 Kōmike Hoʻihoʻi koke i ka Disk Standard WIN-********** 00
1354 Hana ʻia ka hoʻihoʻi ʻana 0 VMware Incremental NGNCloudADC NBCC Dec 18, 2018 12:14:34 PM 00:01:21 Dec 18, 2018 12:15:55 PM STU_DP_S3_****backup 1 14,380,965 147 100 23617 Dec 1352 , 500,817 18:2018:12 PM 14:34:00 Hoʻoponopono koke i ka Disk Standard WIN-********** 01 21% 0%
1347 Paʻi Paʻi Hana ʻia 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:11:45 PM 00:02:08 Dec 18, 2018 12:13:53 PM STU_DP_S3_****backup 1 100% kumu 1347 Dec. 18:2018 PM 12:11:45 Kōmike Hoʻihoʻi koke i ka Disk Standard WIN-********** 00
Hana ʻia 1349 Backup 0 VMware Full NGNCloudADC NBCC Dec 18, 2018 12:12:02 PM 00:01:41 Dec 18, 2018 12:13:43 PM STU_DP_S3_****backup 1 14,535,215 149653 100 23508 Dec 1347 , 316,319 18:2018:12 PM 12:02:00 ʻO ka hoʻihoʻi koke ʻana Disk Standard WIN-************* 01 41% 0%
1341 Paʻi Paʻi Hana ʻia 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:05:28 PM 00:04:53 Dec 18, 2018 12:10:21 PM STU_DP_S3_****backup 1 100% kumu 1341 Dec. 18:2018 PM 12:05:28 Kōmike Hoʻihoʻi koke i ka Disk Standard WIN-********** 00
1342 Hana Hana ʻia 0 VMware Full_Rescan NGNCloudADC NBCC Dec 18, 2018 12:05:47 PM 00:04:24 Dec 18, 2018 12:10:11 PM STU_DP_S3_****backup 1 14,535,151, 149653 100 Dek 22999 , 1341 70,380:18:2018 PM 12:05:47 Hoʻoponopono koke i ka Disk Standard WIN-************ 00 04% 24%

1339 Paʻi Paʻi Hana ʻia 150 VMware - NGNCloudADC NBCC Dec 18, 2018 11:05:46 AM 00:00:53 Dec 18, 2018 11:06:39 AM STU_DP_S3_****backup 1 100% Dec 1339, 18% kumu 2018. 11:05 AM 46:00:00 ʻO ka hoʻihoʻi koke ʻana i ka Disk Standard WIN-********** 53
1327 Paʻi Paʻi Hana 0 VMware - *******.********.cloud NBCC Dec 17, 2018 12:54:42 PM 05:51:38 Dec 17, 2018 6:46:20 PM STU_DP_S3_****backup 1 100% root 1327 Dec 17, 2018 12:54:42 PM 05:51:38 Instant Recovery Disk Standard WIN-*********** 0
1328 Hana Hana ʻia 0 VMware piha *******.********.cloud NBCC Dec 17, 2018 12:55:10 PM 05:29:21 Dec 17, 2018 6:24:31 PM STU_DP_S3_****backup 1 222,602,719 258932 100% 12856 root 1327 11,326 Dec 17, 2018 12:55:10 PM 05:29:21 Instant Recovery Disk Standard WIN-*********** 0%
1136 Paʻi Paʻi Hana 0 VMware - *******.********.cloud NBCC Dec 14, 2018 4:48:22 PM 04:05:16 Dec 14, 2018 8:53:38 PM STU_DP_S3_****backup 1 100% root 1136 Dec 14, 2018 4:48:22 PM 04:05:16 Instant Recovery Disk Standard WIN-*********** 0
Hana ʻia 1140 Backup 0 VMware Full_Scan *******.********.cloud NBCC Dec 14, 2018 4:49:14 PM 03:49:58 Dec 14, 2018 8:39:12 PM STU_DP_S3_****backup 1 217,631,332 255465 100% 26438 root 1136 15,963 Dec 14, 2018 4:49:14 PM 03:49:58 Instant Recovery Disk Standard WIN-*********** % WIN-************ % 0%

Hāʻawi ka accelerator iā ʻoe e hōʻemi i ke kaʻa mai nā mea hana, no ka mea Hoʻololi ʻia nā hoʻololi ʻikepili wale nō, ʻo ia hoʻi, ʻaʻole i hoʻouka ʻia nā hoʻihoʻi piha ʻana, no ka mea, e hōʻiliʻili ke kikowaena media i nā hoʻihoʻi piha hope mai nā waihona hoʻonui.

Loaʻa i ka kikowaena waena kona waihona ponoʻī, kahi e kākau ai i kahi "cache" o ka ʻikepili a mālama i kahi waihona no ka wehe ʻana.

Penei ke ano o ka hale hana piha:

  1. Mālama ka haku kikowaena i ka hoʻonohonoho, nā mea hou, a me nā mea ʻē aʻe a aia ma ke ao.
  2. Pono ke kikowaena media (intermediate *nix machine) i kahi kokoke loa i nā ʻōnaehana redundant e pili ana i ka hiki ke komo i ka pūnaewele. Ma ʻaneʻi, hoʻopau ʻia ka unuhi ʻana o nā waihona mai nā mīkini i mālama ʻia.
  3. Ma nā mīkini i kākoʻo ʻia aia nā ʻelele e hoʻouna maʻamau i ka server media wale nō i ka mea ʻaʻole i loko o kāna waihona.

Hoʻomaka ia me ka scan piha - ʻo ia kahi waihona piha piha piha. I kēia manawa, lawe ke kikowaena media i nā mea a pau, hoʻokaʻawale iā ia a hoʻoili iā ia i S3. He haʻahaʻa ka wikiwiki i ke kikowaena media, akā ʻoi aku ka kiʻekiʻe. ʻO ka palena nui ka mana helu o ke kikowaena.

Hoʻopiha piha ʻia nā waihona ma hope mai ka manaʻo o nā ʻōnaehana āpau, akā i ka ʻoiaʻiʻo he mea like lākou me nā backup piha synthetic. ʻO ia hoʻi, ʻo ka hoʻoili maoli ʻana a me ka hoʻopaʻa ʻana i ka server media e loaʻa wale i kēlā mau poloka ʻikepili i ʻike ʻole ʻia ma nā backup VM ma mua. A ʻo kēlā mau poloka ʻikepili wale nō ʻaʻole i loaʻa ka hash i loko o ka waihona deduplication o ka server media e hoʻoili ʻia a hoʻopaʻa ʻia ma S3. I nā huaʻōlelo maʻalahi, he mea kēia i ʻike ʻole ʻia ma kekahi waihona o kahi VM hoʻokahi ma mua.

I ka wā o ka hoʻihoʻi ʻana, noi ke kikowaena media i nā mea i hoʻokaʻawale ʻia mai S3, hoʻihoʻi hou iā lākou a hoʻoili iā lākou i nā mea hana IRB, ʻo ia hoʻi. pono e noʻonoʻo i ka nui o ke kaʻa i ka wā o ka hoʻihoʻi ʻana, e like me ka nui maoli o ka ʻikepili i hoʻihoʻi ʻia.

Eia he mea like e like me kēia:

Pehea e hoʻopaʻa i ka mālama ʻana i nā waihona i ka waiho ʻana i nā mea a hiki i 90%

A eia kekahi ʻāpana lāʻau169 Hana (0 Queue 0 Active 0 Kali no ka ho'āʻo hou 0 Hoʻopanee ʻia 0 Paʻa ʻole 169 Hana — 1 i koho ʻia)

ʻAno Id ʻAno Mokuʻāina Mokuʻāina Kūlana Kūlana Kūlana Hana Ka Papa Hana Mea Kūʻai Kūʻai Kūʻai Kūʻai Kūʻai Kūikawā Hoʻomaka Wā Hoʻopau Manawa Manawa Hoʻāʻo ʻana i ka hana Kilobytes Files Pathname % Paʻa (Manaʻo ʻia) Paʻa (Manaʻo ʻia) Ka mea nona ka PID hana kope makua Job ID KB/Sec Active Start Active Elapsed Robot Vault Profile Session ID Media no ke kipaku ʻana i ka neʻe ʻana o ka ʻikepili i waho-host Type Master Priority Deduplication Rate Transport Accelerator Optimization Instance or Database Share Host
- 1372 Hoʻihoʻi i hana ʻia 0 NBPR01 NBCC Dec 19, 2018 1:05:58 PM 00:04:32 Dec 19, 2018 1:10:30 PM 1 14,380,577 1 100% 8548 Dec 1372 ROOT :70,567 PM 19:2018:1 WIN-************ 06

Hoʻopaʻa ʻia ka pono o ka ʻikepili e ka pale o S3 ponoʻī - aia ka redundancy maikaʻi ma laila e pale aku ai i nā hemahema o ka lako e like me ka spindle hard drive.

Pono ke kikowaena media i 4 TB o ka cache - ʻo ia ka ʻōlelo aʻoaʻo liʻiliʻi o Veritas. ʻOi aku ka maikaʻi, akā ʻo ia kā mākou i hana ai.

ʻO ka hopena

I ka wā i hoʻolei aku ai kahi hoa i ka 3 GB i kā mākou S20, mālama mākou i 60 GB, no ka mea, hāʻawi mākou i nā ʻikepili geo-reserve triple. I kēia manawa, ʻoi aku ka liʻiliʻi o nā kaʻa, maikaʻi ia no ke kahawai a no ka mālama ʻana i nā uku.

I kēia hihia, ua pani ʻia nā ala ma mua o ka "Internet nui", akā hiki iā ʻoe ke hoʻokele i nā kaʻa ma VPN L2 ma luna o ka Pūnaewele, akā ʻoi aku ka maikaʻi o ka hoʻokomo ʻana i ka kikowaena media ma mua o ke komo ʻana o ka mea hoʻolako.

Inā makemake ʻoe e aʻo e pili ana i kēia mau hiʻohiʻona ma kā mākou mau kikowaena data Lūkini a i ʻole he nīnau e pili ana i ka hoʻokō ʻana ma ka home, e nīnau i nā ʻōlelo a i ʻole ma ka leka uila. [pale ʻia ka leka uila].

Source: www.habr.com

Pākuʻi i ka manaʻo hoʻopuka