Umarnin ajiya abu S3 fassara labarin game da waɗanne ma'auni suke da mahimmanci yayin zabar ajiyar abu. Mai zuwa shine rubutun daga mahallin marubucin.
Idan ya zo ga ajiyar abubuwa, mutane yawanci suna tunanin abu ɗaya kawai: farashin kowane TB/GB. Tabbas, wannan ma'aunin yana da mahimmanci, amma yana mai da tsarin zuwa gefe ɗaya kuma yana daidaita ma'ajiyar abu tare da kayan aikin adana kayan tarihi. Bugu da ƙari, wannan hanyar tana rage mahimmancin ajiyar abu don tarin fasahar kamfani.
Lokacin zabar ajiyar abu, ya kamata ku kula da halaye guda biyar:
- aiki;
- scalability;
- S3 masu jituwa;
- amsa ga kasawa;
- mutunci.
Waɗannan halaye guda biyar sababbin ma'auni ne don ajiyar abu, tare da farashi. Mu duba su duka.
Yawan aiki
Shagunan kayan gargajiya ba su da aiki. Masu ba da sabis a koyaushe suna sadaukar da shi don neman ƙarancin farashi. Duk da haka, tare da kayan ajiya na zamani abubuwa sun bambanta.
Tsarukan ajiya iri-iri suna kusanci ko ma wuce saurin Hadoop. Bukatun zamani don karantawa da rubuta saurin gudu: daga 10 GB/s don rumbun kwamfyuta, har zuwa 35 GB/s don NVMe.
Wannan kayan aikin ya wadatar don Spark, Presto, Tensorflow, Teradata, Vertica, Splunk da sauran tsarin sarrafa kwamfuta na zamani a cikin tarin nazari. Gaskiyar cewa ana saita ma'ajin bayanai na MPP don ajiyar abu yana nuna cewa ana ƙara amfani da shi azaman ma'aji na farko.
Idan tsarin ajiyar ku bai samar da saurin da kuke buƙata ba, ba za ku iya amfani da bayanan ku fitar da ƙima daga gare ta ba. Ko da ka maido da bayanai daga ma'adanar abu zuwa tsarin sarrafa ƙwaƙwalwar ajiya, har yanzu za ka buƙaci bandwidth don canja wurin bayanai zuwa kuma daga ƙwaƙwalwar ajiya. Shagunan kayan gado ba su da isassun sa.
Wannan shine mahimmin batu: sabon ma'aunin aikin aiki shine fitarwa, ba latency ba. Ana buƙatar bayanai a sikelin kuma shine al'ada a cikin kayan aikin bayanai na zamani.
Duk da yake maƙasudi hanya ce mai kyau don ƙayyade aiki, ba za a iya auna daidai ba kafin gudanar da aikace-aikacen a cikin yanayi. Bayan haka ne kawai za ku iya faɗi inda ainihin ƙwanƙwasa yake: a cikin software, diski, cibiyar sadarwa ko a matakin kwamfuta.
Ƙimar ƙarfi
Scalability yana nufin adadin petabytes waɗanda suka dace da sararin suna ɗaya. Abin da dillalai ke iƙirari mai sauƙin ƙima ne, abin da ba sa faɗi shi ne cewa yayin da suke auna, manyan tsarin monolithic sun zama mara ƙarfi, sarƙaƙƙiya, maras ƙarfi, da tsada.
Sabuwar ma'auni don daidaitawa shine adadin wuraren suna ko abokan ciniki da zaku iya yi wa hidima. Ana ɗaukar ma'auni kai tsaye daga hyperscalers, inda ginshiƙan ginin ajiya ƙanana ne amma sikelin zuwa biliyoyin raka'a. Gabaɗaya, wannan ma'aunin girgije ne.
Lokacin da tubalan ginin ƙanana, sun fi sauƙi don ingantawa don tsaro, ikon samun dama, gudanar da manufofin, gudanarwa na rayuwa, da sabuntawa marasa lalacewa. Kuma a ƙarshe tabbatar da yawan aiki. Girman ginin ginin yana aiki ne na ikon sarrafawa na yankin gazawar, wanda shine yadda ake gina tsarin juriya sosai.
Multi-manyan yana da halaye da yawa. Yayin da girman ke magana kan yadda ƙungiyoyi ke ba da damar yin amfani da bayanai da aikace-aikace, hakanan yana nufin aikace-aikacen kansu da dabarun keɓe su daga juna.
Halayen tsarin zamani na abokin ciniki da yawa:
- A cikin ɗan gajeren lokaci, adadin abokan ciniki na iya girma daga ɗari da yawa zuwa miliyan da yawa.
- Abokan ciniki sun ware gaba ɗaya daga juna. Wannan yana ba su damar gudanar da nau'ikan software iri ɗaya da adana abubuwa tare da daidaitawa daban-daban, izini, fasali, tsaro da matakan kulawa. Wannan yana da mahimmanci lokacin ƙira zuwa sabbin sabobin, sabuntawa, da juzu'i.
- Ma'ajiyar tana da ƙarfi da ƙarfi, ana ba da albarkatun bisa buƙata.
- API ɗin yana sarrafa kowane aiki kuma ana sarrafa shi ta atomatik ba tare da sa hannun ɗan adam ba.
- Ana iya ɗaukar software a cikin kwantena kuma amfani da daidaitattun tsarin ƙungiyar kade kamar Kubernetes.
S3 masu jituwa
Amazon S3 API shine ma'auni na gaskiya don ajiyar abu. Kowane mai siyar da software na ajiya yana da'awar dacewa da ita. Daidaitawa tare da S3 shine binary: ko dai an aiwatar da shi gaba ɗaya ko ba haka ba.
A aikace, akwai ɗaruruwa ko dubban al'amuran gefen inda wani abu ke faruwa ba daidai ba lokacin amfani da ajiyar abu. Musamman daga masu samar da software da ayyuka na mallakar mallaka. Babban lamuran amfaninsa shine adanawa kai tsaye ko madadin, don haka akwai ƴan dalilai don kiran API, shari'o'in amfani sun yi kama da juna.
Bude tushen software yana da fa'idodi masu mahimmanci. Ya ƙunshi mafi yawan yanayin yanayi, da aka ba da girma da iri-iri na aikace-aikace, tsarin aiki, da kayan gine-ginen hardware.
Duk wannan yana da mahimmanci ga masu haɓaka aikace-aikacen, don haka yana da daraja gwada aikace-aikacen tare da masu samar da ajiya. Buɗe tushen yana sauƙaƙe tsari - yana da sauƙin fahimtar abin da dandamali ya dace don aikace-aikacen ku. Ana iya amfani da mai badawa azaman wuri guda na shigarwa cikin ajiya, ma'ana zai biya bukatun ku.
Buɗe tushen yana nufin: aikace-aikacen ba a haɗa su da mai siyarwa ba kuma sun fi bayyane. Wannan yana tabbatar da tsawon rayuwar aikace-aikacen.
Kuma 'yan ƙarin bayanin kula game da buɗaɗɗen tushe da S3.
Idan kuna gudanar da babban aikace-aikacen bayanai, S3 SELECT yana haɓaka aiki da inganci ta tsari mai girma. Yana yin haka ta amfani da SQL don dawo da abubuwan da kuke buƙata kawai daga ma'adana.
Mahimmin batu shine goyan baya ga sanarwar guga. Sanarwa na guga suna sauƙaƙe ƙididdiga marasa uwar garken, muhimmin sashi na kowane gine-ginen microservice wanda aka isar dashi azaman sabis. Ganin cewa ma'ajiyar abu tana da inganci ma'ajiyar gajimare, wannan damar ta zama mai mahimmanci lokacin da ake amfani da ma'ajin abu ta aikace-aikacen tushen girgije.
A ƙarshe, aiwatar da S3 dole ne ya goyi bayan ɓoyayyen ɓoyayyen sabar-gefen APIs na SSE-C: SSE-C, SSE-S3, SSE-KMS. Ko mafi kyau, S3 yana goyan bayan kariyar tamper wanda ke da aminci da gaske.
Martani ga gazawa
Ma'auni wanda wataƙila sau da yawa ana yin watsi da shi shine yadda tsarin ke tafiyar da gazawa. Rashin gazawa yana faruwa saboda dalilai iri-iri, kuma dole ne a adana abu ya kula da su duka.
Misali, akwai maki guda na gazawa, ma'aunin wannan sifili ne.
Abin takaici, yawancin tsarin ajiyar abubuwa suna amfani da nodes na musamman waɗanda dole ne a kunna su don gungu suyi aiki yadda ya kamata. Waɗannan sun haɗa da nodes na suna ko sabar metadata - wannan yana haifar da faɗuwar maki guda ɗaya.
Ko da inda akwai maki da yawa na gazawa, ikon jure rashin gazawar bala'i shine mafi mahimmanci. Disks sun kasa, sabobin sun kasa. Makullin shine ƙirƙirar software da aka ƙera don ɗaukar gazawa azaman yanayin al'ada. Idan diski ko kumburi ya gaza, irin wannan software za ta ci gaba da aiki ba tare da canje-canje ba.
Kariyar da aka gina a ciki daga shafewar bayanai da lalata bayanai yana tabbatar da cewa za ku iya rasa yawancin fayafai ko nodes kamar yadda kuke da tubalan daidaitawa-yawanci rabin faifai. Sai kawai software ɗin ba zata iya dawo da bayanai ba.
Ba kasafai ake gwada gazawar a ƙarƙashin kaya ba, amma ana buƙatar irin wannan gwajin. Yin kwaikwayon gazawar lodi zai nuna jimlar farashin da aka yi bayan gazawar.
Daidaitawa
Makin daidaito na 100% kuma ana kiransa daidaitaccen daidaito. Daidaituwa shine maɓalli mai mahimmanci na kowane tsarin ajiya, amma daidaito mai ƙarfi yana da wuya. Misali, Amazon S3 ListObject ba daidai ba ne, yana da daidaito kawai a ƙarshe.
Menene ma'anar daidaitattun daidaito? Don duk ayyukan da ke biyo bayan aikin PUT da aka tabbatar, dole ne masu zuwa su faru:
- Ƙimar da aka sabunta tana bayyane lokacin karantawa daga kowane kumburi.
- Ana kiyaye sabuntawa daga rashin nasarar kumburin kumburi.
Wannan yana nufin cewa idan ka ja filogi a tsakiyar rikodin, babu abin da zai rasa. Tsarin baya dawo da gurbatattun bayanai ko tsofaffin bayanai. Wannan babban mashaya ce mai mahimmanci a cikin al'amuran da yawa, daga aikace-aikacen ma'amala zuwa madadin da dawo da su.
ƙarshe
Waɗannan sabbin ma'auni ne na ajiyar abubuwa waɗanda ke nuna tsarin amfani a cikin ƙungiyoyin yau, inda aiki, daidaito, daidaitawa, yanki mara kyau da daidaitawar S3 sune tubalan ginin aikace-aikacen girgije da manyan bayanan ƙididdiga. Ina ba da shawarar yin amfani da wannan jeri ban da farashi lokacin gina tarin bayanan zamani.
Game da Mail.ru Cloud Solutions ajiya: .
Me kuma za a karanta:
- .
- .
- .
source: www.habr.com