S3 umyalelo wokugcina into iguqulelwe inqaku malunga nokuba yeyiphi imigaqo ebalulekileyo xa ukhetha ukugcinwa kwezinto. Oku kulandelayo sisicatshulwa ngokwembono yombhali.
Xa kuziwa ekugcinweni kwezinto, abantu bacinga kuphela ngento enye: ixabiso nge-TB / GB. Ewe kunjalo, le metric ibalulekile, kodwa yenza indlela ijonge kwicala elinye kwaye ilinganisa ukugcinwa kwento kunye nesixhobo sogcino olugciniweyo. Ngaphezu koko, le ndlela inciphisa ukubaluleka kokugcinwa kwezinto kwisitaki setekhnoloji yeshishini.
Xa ukhetha ukugcinwa kwezinto, kufuneka ubeke ingqalelo kwiimpawu ezintlanu:
- ukusebenza;
- ukwanda;
- I-S3 iyahambelana;
- impendulo kwiintsilelo;
- ingqibelelo.
Ezi mpawu zintlanu ziimetrics ezintsha zokugcina into, kunye neendleko. Masizijonge zonke.
Imveliso
Iivenkile zezinto zemveli ziswele ukusebenza. Ababoneleli ngenkonzo basoloko beyincama besukela amaxabiso aphantsi. Nangona kunjalo, ngezinto zanamhlanje zokugcina izinto zahlukile.
Iinkqubo ezahlukeneyo zokugcina zisondela okanye zigqithise isantya seHadoop. Iimfuno zanamhlanje zesantya sokufunda nokubhala: ukusuka kwi-10 GB/s kwii-hard drives, ukuya kuthi ga kwi-35 GB/s ye-NVMe.
Oku kuphuma kwanele kwi-Spark, i-Presto, i-Tensorflow, i-Teradata, i-Vertica, i-Splunk kunye nezinye izikhokelo zekhompyutheni zanamhlanje kwi-stack yokuhlalutya. Inyani yokuba i-database ye-MPP ilungiselelwe ukugcinwa kwezinto ibonisa ukuba iya isetyenziswa kakhulu njengendawo yokugcina ephambili.
Ukuba inkqubo yakho yokugcina ayiboneleli ngesantya oyifunayo, awukwazi ukusebenzisa idatha kunye nexabiso lokukhupha kuyo. Nokuba ubuyisela idatha kwindawo yokugcina into kwisakhiwo sokusebenza kwimemori, uya kusafuna i-bandwidth ukuze udlulisele idatha ukuya nokusuka kwimemori. Iivenkile zezinto zelifa aziyonelanga.
Eli lelona nqaku liphambili: i-metric yokusebenza entsha yi-output, hayi i-latency. Ifuneka kwidatha kwisikali kwaye iyinto eqhelekileyo kwiziseko zolwazi lwangoku.
Ngelixa i-benchmarks iyindlela efanelekileyo yokumisela ukusebenza, ayinakulinganiswa ngokuchanekileyo ngaphambi kokuqhuba isicelo kwindawo. Kuphela emva kokuba ungatsho ukuba iphi na i-bottleneck: kwi-software, iidiski, inethiwekhi okanye kwinqanaba lekhompyutha.
Ukubaleka
I-scalability ibhekisa kwinani leepetabytes ezingena kwindawo enye yegama. Abathengisi babanga ukuba kulula ukulinganisa, into abangayithethiyo kukuba njengoko bekhula, iinkqubo ezinkulu ze-monolithic ziba buthathaka, zintsonkothile, zingazinzi, kwaye ziyabiza.
I-metric entsha yokwaleka linani lezithuba zamagama okanye abathengi onokuthi ubabonelele. I-metric ithathwa ngokuthe ngqo kwi-hyperscalers, apho iibhloko zokwakha zokugcina zincinci kodwa zilinganisa kwiibhiliyoni zeeyunithi. Ngokubanzi, le yi-metric yefu.
Xa iibhloko zokwakha zincinci, zilula ukulungiselela ukhuseleko, ulawulo lokufikelela, ulawulo lomgaqo-nkqubo, ulawulo lwe-lifecycle, kunye nohlaziyo olungaphazamisi. Kwaye ekugqibeleni uqinisekise imveliso. Ubungakanani bebhloko yesakhiwo ngumsebenzi wokulawulwa kommandla wokungaphumeleli, yindlela eyakhiwe ngayo iinkqubo ezinokuqina.
I-multi-tenancy ineempawu ezininzi. Ngelixa i-dimension ithetha ngendlela imibutho enikezela ngayo ukufikelela kwidatha kunye nezicelo, ikwabhekisa kwizicelo ngokwazo kunye neengqiqo ezisemva zokuzahlula omnye komnye.
Iimpawu zendlela yanamhlanje kubathengi abaninzi:
- Ngexesha elifutshane, inani labathengi lingakhula ukusuka kumakhulu aliqela ukuya kwizigidi ezininzi.
- Abathengi bahlulwe ngokupheleleyo omnye komnye. Oku kuvumela ukuba baqhube iinguqulelo ezahlukeneyo zesoftware efanayo kunye nokugcina izinto ezinobumbeko, iimvume, iimpawu, ukhuseleko kunye nokugcinwa kwamanqanaba. Oku kuyimfuneko xa ulinganisa kwiiseva ezintsha, uhlaziyo, kunye nejografi.
- Ukugcinwa kwe-elastically scalable, izibonelelo zinikezelwa ngokufunwa.
- Umsebenzi ngamnye ulawulwa yi-API kwaye izenzekelayo ngaphandle kokungenelela komntu.
- Isoftware inokubanjwa kwizikhongozeli kwaye isebenzise iinkqubo eziqhelekileyo zookhestra ezifana neKubernetes.
I-S3 iyahambelana
I-Amazon S3 API ngumgangatho we-de facto wokugcinwa kwezinto. Yonke into yokugcina umthengisi wesoftware ubanga ukuhambelana nayo. Ukuhambelana ne-S3 kubini: mhlawumbi iphunyezwe ngokupheleleyo okanye ayiphunyezwanga.
Enyanisweni, kukho amakhulu okanye amawaka eemeko apho kukho into engahambi kakuhle xa usebenzisa ukugcinwa kwezinto. Ngokukodwa ababoneleli besoftware kunye neenkonzo zobunini. Iimeko zayo eziphambili zokusetyenziswa kukugcinwa ngokuthe ngqo okanye ukugcina, ngoko ke kukho izizathu ezimbalwa zokubiza i-API, iimeko zokusetyenziswa zi-homogeneous.
Isoftware yomthombo ovulekileyo ineenzuzo ezibalulekileyo. Igubungela uninzi lweemeko zomda, ngokunikwa ubungakanani kunye neentlobo ezahlukeneyo zezicelo, iinkqubo zokusebenza, kunye nolwakhiwo lwehardware.
Konke oku kubalulekile kubaphuhlisi besicelo, ngoko kuyafaneleka ukuvavanya isicelo kunye nababoneleli bokugcina. Umthombo ovulekileyo wenza inkqubo ibe lula-kulula ukuqonda ukuba leliphi iqonga elilungele isicelo sakho. Umboneleli unokusetyenziswa njengendawo enye yokungena kwindawo yokugcina, oku kuthetha ukuba iya kuhlangabezana neemfuno zakho.
Umthombo ovulekileyo uthetha: izicelo azibotshelelwanga kumthengisi kwaye ziselubala ngakumbi. Oku kuqinisekisa ubomi besicelo eside.
Kwaye amanqaku ambalwa ngakumbi malunga nomthombo ovulekileyo kunye ne-S3.
Ukuba usebenzisa usetyenziso lwedatha enkulu, i-S3 KHETHA iphucula ukusebenza kunye nokusebenza kakuhle ngomyalelo wobukhulu. Ikwenza oku ngokusebenzisa iSQL ukufumana kuphela izinto ozifunayo kwindawo yokugcina.
Inqaku eliphambili linkxaso yezaziso zebhakethi. Izaziso zebhakethi ziququzelela i-serverless computing, icandelo elibalulekileyo lalo naluphi na ulwakhiwo lwe-microservice olunikezelwa njengenkonzo. Ngenxa yokuba ukugcinwa kwezinto kukugcinwa kwelifu ngokufanelekileyo, esi sixhobo siba sibaluleke kakhulu xa ukugcinwa kwezinto kusetyenziswa kwizicelo ezisekelwe kwifu.
Ekugqibeleni, ukuphunyezwa kwe-S3 kufuneka kuxhase i-APIs ye-Amazon S3 ye-server-side encryption: SSE-C, SSE-S3, SSE-KMS. Okungcono, i-S3 ixhasa ukhuseleko lwe-tamper olukhuseleke ngokwenene.
Impendulo kwiintsilelo
I-metric edla ngokungahoywa yindlela inkqubo yokusingatha ukusilela. Ukungaphumeleli kwenzeka ngenxa yezizathu ezahlukeneyo, kwaye ukugcinwa kwezinto kufuneka kuzisingathe zonke.
Ngokomzekelo, kukho inqaku elinye lokungaphumeleli, i-metric yale nto ingu-zero.
Ngelishwa, iinkqubo ezininzi zokugcina izinto zisebenzisa ii-nodes ezikhethekileyo ekufuneka zenziwe ukuba i-cluster isebenze ngokufanelekileyo. Ezi ziquka iindawo zamagama okanye iiseva zemethadatha - oku kudala inqaku elinye lokusilela.
Nokuba kukho amanqaku amaninzi okusilela, ukukwazi ukumelana nokusilela okuyintlekele kubaluleke kakhulu. Iidiski ziyasilela, iiseva ziyasilela. Isitshixo kukwenza isoftware eyenzelwe ukujongana nokungaphumeleli njengemeko eqhelekileyo. Ukuba idiski okanye i-node ayiphumelelanga, isoftware enjalo iya kuqhubeka isebenza ngaphandle kotshintsho.
Ukhuseleko olwakhelwe ngaphakathi ekucinyweni kwedatha kunye nokuthotywa kwedatha kuqinisekisa ukuba unokuphulukana neediski ezininzi okanye ii-node njengoko uneebhloko zokulingana-ngokuqhelekileyo isiqingatha sediski. Kuphela kulapho isoftware iya kukwazi ukubuyisela idatha.
Ukungaphumeleli kunqabile ukuvavanywa phantsi komthwalo, kodwa uvavanyo olunjalo lunyanzelekile. Ukulinganisa ukungaphumeleli komthwalo kuya kubonisa iindleko ezipheleleyo ezenziwe emva kokungaphumeleli.
Ukungqinelana
Inqaku lokungqinelana kwe-100% likwabizwa ngokuba kukuhambelana okungqongqo. Ukuhambelana yinxalenye ephambili kuyo nayiphi na inkqubo yokugcina, kodwa ukuhambelana okuqinileyo kunqabile. Ngokomzekelo, i-Amazon S3 ListObject ayihambelani ngokungqongqo, iyahambelana kuphela ekupheleni.
Kuthetha ukuthini ukungaguquguquki okungqongqo? Kuyo yonke imisebenzi elandela ukusebenza kwePUT eqinisekisiweyo, oku kulandelayo kufuneka kwenzeke:
- Ixabiso elihlaziyiweyo liyabonakala xa ufunda kuyo nayiphi na indawo.
- Uhlaziyo lukhuselwe ngokuchasene nokusilela kwe-node.
Oku kuthetha ukuba ukuba utsala iplagi phakathi kokurekhoda, akukho nto iya kulahleka. Inkqubo ayiphindi ibuyise idatha eyonakeleyo okanye ephelelwe lixesha. Le yibha ephezulu ebaluleke kakhulu kwiimeko ezininzi, ukusuka kwizicelo zentengiselwano ukuya kwi-backup kunye nokubuyisela.
isiphelo
Ezi imitha zokugcinwa kwezinto ezintsha ezibonisa iipatheni zokusetyenziswa kwimibutho yanamhlanje, apho ukusebenza, ukuhambelana, ukulinganisa, i-fault domains kunye ne-S3 ehambelanayo ziyibhloko zokwakha zezicelo zefu kunye nohlalutyo lwedatha enkulu. Ndincoma ukusebenzisa olu luhlu ukongeza kwixabiso xa ukwakhiwa kwedatha yanamhlanje.
Malunga ne-Mail.ru Cloud Solutions yokugcina into: .
Yintoni enye ekufuneka uyifunde:
- .
- .
- .
umthombo: www.habr.com