S3 umyalo wokugcina into uhumushe i-athikili mayelana nemibandela ebalulekile lapho ukhetha isitoreji sento. Ngezansi umbhalo ovela kumbhali.
Uma kuziwa ekugcinweni kwento, abantu bavame ukucabanga ngesici esisodwa kuphela - intengo nge-TB/GB ngayinye. Yebo, le metric ibalulekile, kodwa yenza indlela ibe ohlangothini olulodwa futhi ilinganise isitoreji sento nethuluzi lokugcina kungobo yomlando. Futhi, le ndlela yehlisa ukubaluleka kokugcinwa kwento yesitaki sobuchwepheshe bebhizinisi.
Lapho ukhetha isitoreji sezinto, kufanele unake izici ezinhlanu:
- ukusebenza;
- scalability;
- iyahambisana ne-S3;
- impendulo yokwehluleka;
- ubuqotho.
Lezi zici ezinhlanu zingamamethrikhi amasha okugcinwa kwento, kanye nezindleko. Ake sizicabangele zonke.
Ukukhiqiza
Izitolo zezinto zomdabu azisebenzi kahle. Abahlinzeki besevisi bahlale benikela kuye ukuze baphishekele amanani aphansi. Nokho, izinto zihlukile ngesitoreji sezinto zesimanje.
Ijubane lokugcinwa okuhlukahlukene lisondela noma lidlule i-Hadoop. Izidingo zesimanje zejubane lokufunda nokubhala: kusuka ku-10 GB / s kuma-hard drive, kufika ku-35 GB / s ye-NVMe.
Lo mkhawulokudonsa wanele i-Spark, Presto, Tensorflow, Teradata, Vertica, Splunk nezinye izinhlaka zesimanje zekhompyutha kusitaki sezibalo. Iqiniso lokuthi izizindalwazi ze-MPP zilungiselwe ukugcinwa kwezinto kusho ukuthi iya ngokuya isetshenziswa njengendawo yokulondoloza eyinhloko.
Uma isistimu yakho yokugcina inganikezi isivinini esidingekayo, awukwazi ukusebenzisa idatha futhi ukhiphe amanani kuyo. Ngisho noma ubuyisa idatha isuka endaweni oyigcinayo iye esakhiweni sokucubungula esesikhumbuzweni, usadinga umkhawulokudonsa ukuze udlulise idatha iye noma isuke enkumbulweni. Ezitolo zezinto eziphelelwe yisikhathi, akwanele.
Leli iphuzu elibalulekile: imethrikhi yokusebenza entsha eyokuqala, hhayi ukubambezeleka. Iyadingeka kudatha engakala futhi iyinto evamile kungqalasizinda yedatha yanamuhla.
Futhi nakuba amabhentshimakhi eyindlela enhle yokulinganisa ukusebenza, awakwazi ukukalwa ngokunembile ngaphambi kokusebenzisa uhlelo lokusebenza endaweni. Kuphela ngemva kokuba singakwazi ukusho ukuthi i-bottleneck ikuphi: ku-software, amadiski, inethiwekhi, noma ezingeni lekhompyutha.
I-Scalability
I-scalability ibhekisela enanini lama-petabyte alingana endaweni yamagama eyodwa. Abathengisi bathi kulula ukukala, kodwa thulani mayelana nokuthi izinhlelo ezinkulu ze-monolithic ziba ntekenteke, zibe yinkimbinkimbi, zingazinzi, futhi zibize kanjani njengoba zikala.
Isilinganiso esisha sokukala inombolo yezikhala zamagama noma amaklayenti ongawanikeza. Imethrikhi ithathwa ngokuqondile kuma-hyperscaler, lapho amabhulokhi wokwakha isitoreji mancane kodwa afinyelela ezigidini zamayunithi. Ngokuvamile, lena imethrikhi yamafu.
Uma amabhulokhi wokwakha emancane, kulula ukuwalungiselela, okungukuthi, ukunikeza ukuvikeleka, ukulawula ukufinyelela, ukuphathwa kwenqubomgomo, umjikelezo wempilo, kanye nezibuyekezo ngaphandle kokuphazamiseka. Futhi ekugcineni uqinisekise ukusebenza. Ubukhulu bebhulokhi yokwakha buwumsebenzi wokulawulwa kwendawo yokuhluleka, futhi yile ndlela amasistimu aqinile akhiwe ngayo.
Amaklayenti amaningi anezici eziningi. Ngenkathi isilungiselelo sisho indlela izinhlangano ezihlinzeka ngayo ngokufinyelela kudatha nezinhlelo zokusebenza, siphinde sibhekisele ezinhlelweni ngokwazo kanye nengqondo engemuva kokuhlukaniswa kwazo.
Izici zendlela yesimanje yamaklayenti amaningi:
- Ngesikhashana nje, inani lamakhasimende lingakhula lisuka kumakhulu ambalwa liye ezigidini ezimbalwa.
- Amaklayenti ahlukene ngokuphelele komunye nomunye. Lokhu kuzivumela ukuthi zisebenzise izinguqulo ezihlukene zesofthiwe efanayo futhi zigcine izinto ezinokulungiselelwa okuhlukile, izimvume, izici, amaleveli okuphepha, namaleveli esevisi. Lokhu kuyadingeka lapho ukala amaseva amasha, ukuthuthukiswa, kanye nezindawo.
- Isitoreji singakala ngokunwebeka, izinsiza zinikezwa ngokufunwa.
- Umsebenzi ngamunye uqhutshwa yi-API futhi uzenzakalela ngaphandle kokungenelela komuntu.
- Isoftware ingasingathwa ezitsheni futhi isebenzise amasistimu omculo ajwayelekile afana ne-Kubernetes.
I-S3 iyahambisana
I-Amazon S3 API iyindinganiso ye-de facto yokugcina into. Umthengisi ngamunye wesofthiwe yesitoreji sezinto uthi uyahambisana nayo. Ukuhambisana ne-S3 kuyinto kanambambili: kungenzeka ukuthi isetshenziswe ngokugcwele, noma ayisetshenziswa.
Empeleni, kunamakhulu nezinkulungwane zezimo lapho kukhona okungahambanga kahle uma usebenzisa isitoreji sento. Ikakhulukazi kusukela kubathengisi besofthiwe yokuphathelene namasevisi. Amacala ayo okusetshenziswa ayinhloko ukugcinwa kwengobo yomlando okuqondile noma ukwenza isipele, ngakho-ke kunezizathu ezimbalwa zokubiza i-API, izimo zokusebenzisa zifana.
Izinzuzo ezibalulekile zesofthiwe yomthombo ovulekile. Ihlanganisa izimo eziningi ezinqenqemeni ezinikezwe usayizi nezinhlobonhlobo zezinhlelo zokusebenza, amasistimu okusebenza, nezakhiwo zehadiwe.
Konke lokhu kubalulekile kubathuthukisi bohlelo lokusebenza, ngakho-ke kufanelekile ukuhlola uhlelo lokusebenza nabahlinzeki besitoreji. Umthombo ovulekile wenza inqubo ibe lula - kulula ukuqonda ukuthi iyiphi inkundla elungele isicelo sakho. Umhlinzeki angasetshenziswa njengendawo eyodwa yokungena kuma-vaults, okusho ukuthi izohambisana nezidingo zakho.
Umthombo ovulekile usho ukuthi izinhlelo zokusebenza azithathi hlangothi futhi zisobala kakhulu. Lokhu kuqinisekisa umjikelezo wokuphila kwesicelo eside.
Kanye namanothi ambalwa mayelana nomthombo ovulekile kanye ne-S3.
Uma usebenzisa uhlelo lokusebenza lwedatha enkulu, i-S3 SELECT ithuthukisa ukusebenza nokusebenza kahle ngohlelo lobukhulu. Ikwenza lokhu ngokusebenzisa i-SQL ukuthola kuphela izinto ozidingayo esitolo.
Iphuzu eliyinhloko ukusekelwa kwezaziso zebhakede. Izaziso zebhakede zisiza ukusebenzisa ikhompyutha ngaphandle kweseva, okuyingxenye ebalulekile yanoma iyiphi i-microservice architecture elethwa njengesevisi. Uma kucatshangelwa ukuthi isitoreji sento empeleni siyisitoreji samafu, leli khono liba bucayi lapho izinhlelo zokusebenza zamafu zisebenzisa isitoreji sento.
Okokugcina, ukuqaliswa kwe-S3 kufanele kusekele ama-API wokubethela ohlangothini lweseva ye-Amazon S3: SSE-C, SSE-S3, SSE-KMS. Kungcono nakakhulu uma i-S3 isekela ukuvikelwa kokuphazamiseka, okuvikeleke ngempela.
Impendulo yokwehluleka
Imethrikhi okungenzeka ukuthi ngokuvamile ayinakwa ukuthi isistimu ikusingatha kanjani ukwehluleka. Ukwehluleka kwenzeka ngenxa yezizathu ezahlukahlukene, futhi isitolo sezinto kufanele sikuphathe konke.
Isibonelo, kunephuzu elilodwa lokwehluleka, imethrikhi yalokhu inguziro.
Ngeshwa, amasistimu amaningi okugcina izinto asebenzisa amanodi akhethekile okufanele avunyelwe ukuze iqoqo lisebenze kahle. Lokhu kufaka phakathi amanodi egama noma amaseva emethadatha - lokhu kudala iphuzu elilodwa lokwehluleka.
Ngisho nalapho kunamaphuzu amaningi okuhluleka, ikhono lokumelana nokwehluleka okuyinhlekelele libalulekile. Amadrayivu ayahluleka, iziphakeli ziyehluleka. Okubalulekile wukudala isofthiwe edizayinelwe ukuphatha ukwehluleka njengokujwayelekile. Uma idiski noma i-node ihluleka, isofthiwe enjalo izoqhubeka nokusebenza ngaphandle kwezinguquko.
Ukusula okwakhelwe ngaphakathi nokuvikelwa kokucekelwa phansi kwedatha kuqinisekisa ukuthi ungalahlekelwa amadiski amaningi noma ama-node njengoba unamabhulokhi okulingana - ngokuvamile uhhafu wamadiski. Futhi kuphela lapho isofthiwe ngeke ikwazi ukubuyisela idatha.
Ukwehluleka akuvamile ukuhlolwa ngaphansi komthwalo, kodwa ukuhlolwa okunjalo kuyadingeka. Ukulingisa ukwehluleka ngaphansi komthwalo kuzobonisa izindleko ezinqwabelene ezitholwe ngemva kokwehluleka.
Ukuvumelana
Isilinganiso sokungaguquguquki esingu-100% siphinde sibizwe ngokuthi ukuhambisana okuqinile. Ukuvumelana kuyingxenye ebalulekile yanoma iyiphi isistimu yokugcina, kodwa ukuvumelana okuqinile akuvamile. Isibonelo, i-Amazon S3 ListObject ayihambisani ngokuqinile, igcina kuphela ekugcineni.
Kusho ukuthini ukungaguquguquki okuqinile? Kuyo yonke imisebenzi ngemva kokusebenza kwe-PUT okuqinisekisiwe, okulandelayo kufanele kube yiqiniso:
- Inani elibuyekeziwe liyabonakala uma ufunda kunoma iyiphi indawo.
- Isibuyekezo sivikelwe ukungaphumeleli kwenodi.
Lokhu kusho ukuthi uma ukhipha ipulaki phakathi kokurekhodwa, akukho okuzolahleka. Isistimu ayibuyiseli idatha eyonakele noma ephelelwe yisikhathi. Lena ibha ephezulu ebaluleke kakhulu ezimeni eziningi, kusukela kuzinhlelo zokusebenza zokwenziwayo kuya ekwenzeni ikhophi yasenqolobaneni nokuthola.
isiphetho
Lawa amamethrikhi amasha esitoreji sezinto abonisa amaphethini okusetshenziswa ezinhlanganweni zanamuhla lapho ukusebenza, ukungaguquguquki, ukukala, izizinda ezinephutha, nokuhambisana kwe-S3 kuyizithiyo zokwakha zezinhlelo zokusebenza zamafu nokuhlaziya idatha enkulu. Ngincoma ukusebenzisa lolu hlu ngaphezu kwentengo lapho wakha izitaki zedatha zesimanje.
Mayelana nokugcinwa kwento ye-Mail.ru Cloud Solutions: .
Okunye ongakufunda:
- .
- .
- .
Source: www.habr.com