Abokan cinikinmu na Turkiyya sun nemi mu tsara maajiyar bayanai da kyau don cibiyar bayanan su. Muna yin irin wannan ayyuka a Rasha, amma a nan labarin ya fi game da binciken yadda ya fi dacewa don yin shi.
An ba da: akwai wurin ajiyar S3 na gida, akwai Veritas NetBackup, wanda ya sami sabon aikin fadadawa don matsar da bayanai zuwa ajiyar abubuwa, yanzu tare da tallafi don ƙaddamarwa, kuma akwai matsala tare da sarari kyauta a cikin wannan ajiyar gida.
Aiki: don yin komai domin tsarin adana kwafin ajiyar yana da sauri da arha.
A zahiri, kafin wannan, duk abin da ke cikin S3 fayiloli ne kawai, kuma waɗannan cikakkun simintin gyare-gyare ne na injuna masu mahimmanci na cibiyar bayanai. Wato, ba a inganta shi sosai ba, amma duk abin da ya yi aiki a farkon. Yanzu lokaci ya yi da za a gane shi kuma a yi shi daidai.
Hoton yana nuna abin da muka zo:
Kamar yadda kake gani, an yi ajiyar farko a hankali (70 Mb/s), kuma bayanan da suka biyo baya na tsarin iri ɗaya sun fi sauri.
A zahiri, a gaba akwai ƙarin cikakkun bayanai game da abubuwan da ke akwai.
Ajiyayyen rajistan ayyukan ga waɗanda suke shirye su karanta rabin shafi na jujiCike da sake dubawa
Dec 18, 2018 12:09:43 PM — Bayanin bpbkar (pid=4452) mai haɓakawa ya aika 14883996160 bytes daga 14883994624 bytes zuwa sabar, ingantawa 0.0%
Dec 18, 2018 12:10:07 PM - Bayanin NBCC (pid=23002) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Rahoton=Kididdigar PDDO (rafi mai zaren da aka yi amfani da shi) don (NBCC): dubawa: 14570817 KB, CR ya aika: 1760761 KB, CR ya aika sama da FC: 0 KB, dedup: 87.9%, kashe cache
Full
Dec 18, 2018 12:13:18 PM — Bayanin bpbkar (pid=2864) mai haɓakawa ya aika 181675008 bytes daga 14884060160 bytes zuwa sabar, ingantawa 98.8%
Dec 18, 2018 12:13:40 PM - Bayanin NBCC (pid=23527) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Rahoton=Kididdigar PDDO don (NBCC): an duba: 14569706 KB, CR ya aika: 45145 KB, CR ya aika sama da FC: 0 KB, dedup: 99.7%, an kashe cache
Ƙari
Dec 18, 2018 12:15:32 PM — Bayanin bpbkar (pid=792) mai haɓakawa ya aika 9970688 bytes daga 14726108160 bytes zuwa sabar, ingantawa 99.9%
Dec 18, 2018 12:15:53 PM - Bayanin NBCC (pid=23656) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Rahoton=Kididdigar PDDO don (NBCC): an duba: 14383788 KB, CR ya aika: 15700 KB, CR ya aika sama da FC: 0 KB, dedup: 99.9%, an kashe cache
Full
Dec 18, 2018 12:18:02 PM — Bayanin bpbkar (pid=3496) mai haɓakawa ya aika 171746816 bytes daga 14884093952 bytes zuwa sabar, ingantawa 98.8%
Dec 18, 2018 12:18:24 PM - Bayanin NBCC (pid=23878) StorageServer=PureDisk_rhceph_rawd:s3.cloud.ngn.com.tr; Rahoton=Kididdigar PDDO don (NBCC): an duba: 14569739 KB, CR ya aika: 34120 KB, CR ya aika sama da FC: 0 KB, dedup: 99.8%, an kashe cache
Menene matsalar
Abokan ciniki suna son yin wariyar ajiya sau da yawa kamar yadda zai yiwu kuma a adana su cikin arha gwargwadon yiwu. Zai fi kyau a adana su da arha a cikin ma'ajiyar abubuwa kamar S3, saboda su ne mafi arha a farashin sabis a kowace Megabyte daga inda za ku iya jujjuya wariyar ajiya cikin lokaci mai dacewa. Lokacin da akwai mai yawa madadin, ya zama ba mai arha sosai, domin mafi yawan ma'ajiyar da aka shagaltar da kwafin bayanai iri daya. A cikin yanayin HaaS na abokan aikin Turkiyya, ana iya ƙididdige ajiya da kusan 80-90%. A bayyane yake cewa wannan yana da alaƙa musamman da ƙayyadaddun su, amma tabbas zan ƙidaya aƙalla kakan 50%.
Don magance matsalar, manyan dillalai sun daɗe suna yin ƙofofin zuwa Amazon S3. Duk hanyoyin su sun dace da S3 na gida muddin suna goyan bayan API na Amazon. A cikin cibiyar bayanai na Turkiyya, ana yin madadin zuwa S3 ɗinmu, da kuma a cikin T-III "Compressor" a Rasha, tun da wannan tsarin aikin ya yi aiki sosai a gare mu.
Kuma S3 ɗinmu ya dace da hanyoyin madadin Amazon S3. Wato, duk kayan aikin ajiya waɗanda ke goyan bayan waɗannan hanyoyin suna ba ku damar kwafin komai zuwa irin wannan ma'ajiyar “daga cikin akwatin.”
Veritas NetBackup ya kara fasalin CloudCatalyst:
Wato, tsakanin injunan da ake buƙatar tallafi da kuma ƙofar, akwai matsakaicin uwar garken Linux wanda ke ba da ajiyar kuɗi daga wakilan SRK kuma ana cire su akan tashi kafin a tura shi zuwa S3. Idan a baya akwai 30 backups na 20 GB tare da matsawa, yanzu (saboda kamanni na inji) girman su ya zama 90% karami. Ana amfani da injin cirewa daidai da lokacin adanawa akan faifai na yau da kullun ta amfani da Netbackup.
Ga abin da ya faru kafin matsakaicin uwar garken:
Mun gwada kuma mun yanke shawarar cewa lokacin da aka aiwatar a cikin cibiyoyin bayanan mu, wannan yana adana sarari a cikin ajiyar S3 a gare mu da abokan ciniki. A matsayin mai mallakar cibiyoyin bayanan kasuwanci, ba shakka, muna caji gwargwadon adadin da aka shagaltar da mu, amma har yanzu yana da fa'ida sosai a gare mu kuma - saboda muna fara samun kuɗi akan ƙarin wuraren da za'a iya daidaitawa a cikin software, ba akan hayar kayan aiki ba. To, kuma wannan shine raguwar farashin ciki.
LogsAyyuka 228 (0 jere 0 Aiki 0 Jiran Sake gwadawa 0 An dakatar da shi 0 Bai cika 228 Anyi ba - 13 aka zaɓa)
(Tace Tace [13])
Nau'in Aiki Id Nau'in Jiha Cikakkun Bayanan Matsayi Matsayin Manufofin Ayuba Jadawalin Aiki Abokin Watsa Labarai Mai Sabar Farko Lokaci Tsare Lokaci Ƙarshen Lokaci Ajiye Unit Ƙoƙarin Ayyukan Fayilolin Fayilolin Kilobytes Sunan % Cikak (Kimanin) Ma'aikacin PID Kwafi Iyayen Aiki ID KB/Sec Farawa Mai Aiki Mai Haɓaka Zama na Bayanan Bayanin Robot Vault Kafofin watsa labarai na ID don Fitar da Motsin Bayanai na Kashe Mai watsa shiri Nau'in Jagora na Farkon Fitar da Matsakaicin Haɓaka Matsalolin Sufuri ko Rarraba Mai watsa shiri na Database.
- 1358 Hoto Anyi 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:16:19 PM 00:02:18 Dec 18, 2018 12:18:37 PM STU_DP_S3_****Ajiyayyen 1 100% Tushen 1358 Dec 18 :2018:12 PM 16:27:00 Matsakaicin faifan Farfadowa kai tsaye WIN-************* 02
1360 Ajiyayyen Anyi 0 VMware Cikakkun NGNCloudADC NBCC Dec 18, 2018 12:16:48 PM 00:01:39 Dec 18, 2018 12:18:27 PM STU_DP_S3_****Ajiyayyen 1 14,535,248 149654 Disamba 100 .
1352 Hoto Anyi 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:14:04 PM 00:02:01 Dec 18, 2018 12:16:05 PM STU_DP_S3_****Ajiyayyen 1 100% Tushen 1352 18 2018:12 PM 14:14:00 Matsakaicin faifan Farko na Gaggawa WIN-************* 01
1354 An Yi Ajiyayyen 0 VMware Ƙarfafa NGNCloudADC NBCC Dec 18, 2018 12:14:34 PM 00:01:21 Dec 18, 2018 12:15:55 PM STU_DP_S3_****Ajiyayyen 1 14,380,965% 147 100 23617 1352 500,817 Disamba 18 .
1347 Hoto Anyi 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:11:45 PM 00:02:08 Dec 18, 2018 12:13:53 PM STU_DP_S3_****Ajiyayyen 1 100% Tushen 1347 18 2018:12 PM 11:45:00 Matsakaicin faifan Farko na Gaggawa WIN-************* 02
1349 Ajiyayyen Anyi 0 VMware Cikakkun NGNCloudADC NBCC Dec 18, 2018 12:12:02 PM 00:01:41 Dec 18, 2018 12:13:43 PM STU_DP_S3_****Ajiyayyen 1 14,535,215 149653 Disamba 100 .
1341 Hoto Anyi 0 VMware - NGNCloudADC NBCC Dec 18, 2018 12:05:28 PM 00:04:53 Dec 18, 2018 12:10:21 PM STU_DP_S3_****Ajiyayyen 1 100% Tushen 1341 18 2018:12 PM 05:28:00 Matsakaicin faifan Farko na Gaggawa WIN-************* 04
1342 Ajiyayyen Anyi 0 VMware Full_Rescan NGNCloudADC NBCC Dec 18, 2018 12:05:47 PM 00:04:24 Dec 18, 2018 12:10:11 PM STU_DP_S3_****Ajiyayyen 1 14,535,151 149653 100 Dec 22999.
1339 Hoto Anyi 150 VMware - NGNCloudADC NBCC Dec 18, 2018 11:05:46 AM 00:00:53 Dec 18, 2018 11:06:39 AM STU_DP_S3_****Ajiyayyen 1 100% Tushen 1339 18% 2018:11 AM 05:46:00 Nau'in Farko na Farko na Gaggawa WIN - *********** 00
1327 Hoto Anyi 0 VMware - *******.********.cloud NBCC Dec 17, 2018 12:54:42 PM 05:51:38 Dec 17, 2018 6:46:20 PM STU_DP_S3_****Ajiyayyen 1 100% tushen 1327 Dec 17, 2018 12:54:42 PM 05:51:38 Matsakaicin Farko na Farko WIN-************** 0
1328 Ajiyayyen Anyi 0 VMware Cikak *******.********.Cloud NBCC Dec 17, 2018 12:55:10 PM 05:29:21 Dec 17, 2018 6:24:31 PM STU_DP_S3_****wariyar ajiya 1 222,602,719 258932 100% 12856 tushen 1327 11,326 Dec 17, 2018 12:55:10 PM 05:29:21 Nan take Maida Disk Standard WIN-***0 87.9%
1136 Hoto Anyi 0 VMware - *******.********.cloud NBCC Dec 14, 2018 4:48:22 PM 04:05:16 Dec 14, 2018 8:53:38 PM STU_DP_S3_****Ajiyayyen 1 100% tushen 1136 Dec 14, 2018 4:48:22 PM 04:05:16 Matsakaicin Farko na Farko WIN-************** 0
1140 Ajiyayyen Anyi 0 VMware Cikakken_Scan *******.********.girgije NBCC Dec 14, 2018 4:49:14 PM 03:49:58 Dec 14, 2018 8:39:12 PM STU_DP_S3_****Ajiyayyen 1 217,631,332 255465 100% 26438 tushen 1136 15,963 Dec 14, 2018 4:49:14 PM 03:49:58 Nan take Maida Disk Standard WIN-% 0****45.2 0%
Mai haɓakawa yana ba ku damar rage zirga-zirga daga wakilai, saboda Canje-canjen bayanai ne kawai ake watsawa, wato, ko da cikakkun bayanai ba a ɗora su gaba ɗaya ba, tunda uwar garken mai jarida tana tattara cikakkun bayanai na gaba daga madaidaitan kari.
Matsakaicin uwar garken yana da ma'ajiyar kansa, inda yake rubuta "cache" na bayanai kuma yana kula da bayanan bayanai don ƙaddamarwa.
Cikakken tsarin gine-gine yayi kama da haka:
- Babban uwar garken yana sarrafa tsari, sabuntawa, da sauransu kuma yana cikin gajimare.
- Ya kamata uwar garken mai jarida (matsakaici * inji nix) ya kasance kusa da tsarin da ba a iya amfani da su ba dangane da samun damar hanyar sadarwa. Anan, ana cire kwafi daga duk injunan da aka tanada.
- A kan injunan da aka ba da tallafi akwai wakilai waɗanda galibi ke aikawa zuwa uwar garken mai jarida kawai abin da ba ya cikin ma'ajiyarsa.
Duk yana farawa da cikakken scan - wannan cikakken cikakken ma'auni ne. A wannan lokaci, uwar garken mai jarida yana ɗaukar komai, ya cire shi kuma ya canza shi zuwa S3. Gudun zuwa uwar garken kafofin watsa labaru yana da ƙasa, amma daga gare ta ya fi girma. Babban iyakance shine ikon sarrafa kwamfuta na uwar garken.
Ana yin madaidaitan abubuwan da ke biyo baya daga mahangar dukkan tsarin, amma a zahiri wani abu ne kamar cikakken madadin roba. Wato, ainihin canja wuri da rikodi zuwa uwar garken kafofin watsa labarai yana faruwa ne kawai na waɗancan tubalan bayanan da ba a ci karo da su ba a madadin VM a da. Kuma kawai waɗancan tubalan bayanan waɗanda hash ɗin ba ya cikin ma'ajin adana bayanan uwar garken kafofin watsa labarai ana canjawa wuri kuma ana yin rikodin su a cikin S3. A cikin kalmomi masu sauƙi, wannan wani abu ne da ba a taɓa gani ba a kowane madadin VM guda ɗaya a baya.
A lokacin da ake maidowa, uwar garken kafofin watsa labaru na buƙatar abubuwan da suka wajaba daga S3, ta sake mayar da su zuwa ga wakilan IRB, watau. wajibi ne a yi la'akari da yawan zirga-zirga a lokacin dawowa, wanda zai zama daidai da ainihin adadin bayanan da aka mayar.
Ga yadda yake kama da:
Ga kuma wani guntun katakoAyyuka 169 (0 jere 0 Aiki 0 Jiran Sake gwadawa 0 An dakatar da shi 0 Bai cika 169 Anyi ba - 1 aka zaɓa)
Nau'in Aiki Id Nau'in Jiha Cikakkun Bayanan Matsayi Matsayin Manufofin Ayuba Jadawalin Aiki Abokin Watsa Labarai Mai Sabar Farko Lokaci Tsare Lokaci Ƙarshen Lokaci Ajiye Unit Ƙoƙarin Ayyukan Fayilolin Fayilolin Kilobytes Sunan % Cikak (Kimanin) Ma'aikacin PID Kwafi Iyayen Aiki ID KB/Sec Farawa Mai Aiki Mai Haɓaka Zama na Bayanan Bayanin Robot Vault Kafofin watsa labarai na ID don Fitar da Motsin Bayanai na Kashe Mai watsa shiri Nau'in Jagora na Farkon Fitar da Matsakaicin Haɓaka Matsalolin Sufuri ko Rarraba Mai watsa shiri na Database.
- 1372 Mayar da Akayi 0 NBPR01 NBCC Dec 19, 2018 1:05:58 PM 00:04:32 Dec 19, 2018 1:10:30 PM 1 14,380,577 1 100% 8548 1372OT 70,567:19 2018 :1 PM 06:00:00 WIN-************ 04
Ana tabbatar da amincin bayanan ta hanyar kariyar S3 da kanta - akwai sakewa mai kyau a can don karewa daga gazawar hardware kamar mataccen tulin tukwane.
Sabar mai jarida tana buƙatar 4 TB na cache - wannan shine mafi ƙarancin shawarar girman Veritas. Ƙari ya fi kyau, amma abin da muka yi ke nan.
Sakamakon
Lokacin da abokin tarayya ya jefa 3 GB a cikin S20 namu, mun adana 60 GB, saboda muna ba da ajiyar bayanai sau uku. Yanzu akwai ƙarancin zirga-zirgar zirga-zirgar ababen hawa, wanda ke da kyau duka ga tashar da kuma kuɗin kuɗin ajiya.
A wannan yanayin, an rufe hanyoyin da suka wuce "babban Intanet", amma zaka iya fitar da zirga-zirga ta hanyar VPN L2 akan Intanet, amma yana da kyau a shigar da uwar garken kafofin watsa labarai kafin ƙofar mai badawa.
Idan kuna sha'awar koyo game da waɗannan fasalulluka a cikin cibiyoyin bayanan mu na Rasha ko kuna da tambayoyi game da aiwatarwa a gida, tambaya a cikin sharhi ko ta imel [email kariya].
source: www.habr.com