Amafu afana nebhokisi yomlingo - ubuza into oyifunayo, kwaye izixhobo zivele zivele ngaphandle kwendawo. Oomatshini benyani, oovimba beenkcukacha, inethiwekhi - konke oku kokwakho kuphela. Kukho abanye abaqeshi bamafu, kodwa kwi-Universe yakho nguwe wedwa umlawuli. Uqinisekile ukuba uya kuhlala ufumana izibonelelo ezifunekayo, awuthathi mntu ingqalelo kwaye unquma ngokuzimeleyo ukuba inethiwekhi iya kuba njani. Usebenza njani lo mlingo owenza ukuba ilifu labele izibonelelo kwaye lihlukanise ngokupheleleyo abaqeshi omnye komnye?
Ilifu le-AWS yinkqubo entsonkothileyo eyi-mega-super ethe yavela ngokuguqukayo ukusukela ngo-2006. Inxalenye yolu phuhliso lwenzeka Vasily Pantyukhin -I-Amazon Web Services Architect. Njengomyili wezakhiwo, ufumana ukujonga kwangaphakathi kungekuphela nje kwisiphumo sokugqibela, kodwa nakwimingeni eyoyiswa yi-AWS. Okukhona ukuqonda okukhulu kwendlela esebenza ngayo inkqubo, kokukhona intembeko inkulu. Ke ngoko, uVasily uya kubelana ngeemfihlo zeenkonzo zefu ze-AWS. Apha ngezantsi kuyilo lweeseva ze-AWS ezibonakalayo, i-elastic database scalability, i-database ye-Amazon yesiko kunye neendlela zokunyusa ukusebenza koomatshini benyani ngelixa ngaxeshanye behlisa ixabiso labo. Ulwazi lweendlela zoyilo lweAmazon luya kukunceda usebenzise iinkonzo ze-AWS ngokufanelekileyo kwaye kunokukunika imibono emitsha yokwakha izisombululo zakho.
Malunga nesithethi: uVasily Pantyukhin () waqala njengomlawuli we-Unix kwiinkampani ze-.ru, wasebenza kwi-hardware enkulu ye-Sun Microsystem iminyaka eyi-6, kwaye washumayela ihlabathi le-data-centric kwi-EMC iminyaka eyi-11. Ngokwendalo yavela kumafu abucala, kwaye ngo-2017 yafudukela kuluntu. Ngoku unikezela ngeengcebiso zobuchwepheshe ukunceda ukuhlala nokuphuhlisa kwifu le-AWS.
Ukuziphendulela: yonke into engezantsi luluvo lukaVasily kwaye inokungahambelani nesikhundla seeNkonzo zeWebhu zeAmazon. Ingxelo elisekelwe kuyo eli nqaku iyafumaneka kwitshaneli yethu yeYouTube.
Kutheni ndithetha ngesixhobo seAmazon?
Imoto yam yokuqala yayinokuhanjiswa ngesandla. Kwaba kuhle ngenxa yemvakalelo yokuba ndiyakwazi ukuqhuba imoto kwaye ndilawule ngokupheleleyo. Ndikwathandile nokuba ndiwuqonda kakuhle umgaqo wokusebenza kwawo. Ngokwendalo, bendicinga ukuba ubume bebhokisi buyinto yakudala - into efana nebhokisi yegiya kwibhayisekile.
Yonke into yayilungile, ngaphandle kwento enye - ukuxinga kwiindlela zokuhamba. Kubonakala ngathi uhleli kwaye ungenzi nto, kodwa uhlala utshintsha iigiya, ucinezela i-clutch, igesi, i-brake-ikwenza udinwe ngokwenene. Ingxaki yokuxinana kweemoto yasonjululwa kancinane xa usapho lwafumana imoto ezenzekelayo. Ngelixa ndiqhuba, bendinexesha lokucinga ngento ethile kwaye ndimamele i-audiobook.
Enye imfihlakalo yavela ebomini bam, kuba ndiyeka ngokupheleleyo ukuqonda indlela imoto yam isebenza ngayo. Imoto yanamhlanje sisixhobo esinzima. Imoto iqhelana ngaxeshanye ukuya kuninzi lweeparamitha ezahlukeneyo: ukucinezela igesi, ibhuleki, isitayile sokuqhuba, umgangatho wendlela. Andisayiqondi ukuba isebenza njani kwakhona.
Xa ndiqala ukusebenza kwilifu le-Amazon, yayiyimfihlakalo nakum. Kuphela le mfihlelo ngumyalelo wobukhulu obukhulu, kuba kukho umqhubi omnye emotweni, kwaye kwi-AWS kukho izigidi zazo. Bonke abasebenzisi ngaxeshanye baqhube, cinezela irhasi kunye nebhuleki. Kuyamangalisa ukuba baye apho bafuna khona - kummangaliso kum! Inkqubo ilungelelanisa ngokuzenzekelayo, izikali kunye nokulungelelanisa kumsebenzisi ngamnye ukuze kubonakale kuye ukuba uyedwa kule ndalo iphela.
Umlingo waphela kancinci xa ndaya kusebenza njengomakhi eAmazon. Ndabona ukuba zeziphi iingxaki esijongene nazo, indlela esizisombulula ngayo, kunye nendlela esiphuhlisa ngayo iinkonzo. Ngokukhula kokuqonda malunga nendlela esebenza ngayo inkqubo, ukuzithemba ngakumbi kwinkonzo kubonakala. Ke ndifuna ukwabelana ngomfanekiso wento ephantsi kwe-hood yelifu le-AWS.
Siza kuthetha ngantoni
Ndikhethe indlela eyahluka-hlukeneyo - ndakhetha iinkonzo ezi-4 ezinomdla ezifanele ukuthetha ngazo.
Ukulungiselela iseva. Amafu e-Ephemeral anomfanekiso obonakalayo: amaziko edatha ebonakalayo apho kukho iiseva ezibonakalayo ezidumayo, ezishushu kwaye zidanyaza ngezibane.
imisebenzi Serverless (Lambda) mhlawumbi yeyona nkonzo inobungozi kwilifu.
Ukwandiswa kweDatabase. Ndiza kukuxelela malunga nendlela esakha ngayo idatabase yethu enokulinganiswa.
Ukwandiswa kwenethiwekhi. Inxalenye yokugqibela apho ndiya kuvula isixhobo sothungelwano lwethu. Le yinto emangalisayo - wonke umsebenzisi welifu ukholelwa ukuba uyedwa efini kwaye akababoni abanye abaqeshi kwaphela.
Phawula. Eli nqaku liza kuxoxa ngokulungiswa kweseva kunye nokulinganiswa kwedatha. Siza kuqwalasela ukulinganisa kwenethiwekhi kwinqaku elilandelayo. Iphi imisebenzi engenaseva? Kwapapashwa umbhalo owahlukileyo malunga nabo “" Ithetha ngeendlela ezininzi ezahlukeneyo zokukala, kwaye ixoxa ngokweenkcukacha ngesisombululo seFirecracker-i-symbiosis yeempawu ezilungileyo zomatshini obonakalayo kunye nezikhongozeli.
Iiseva
Ilifu liyi-ephemeral. Kodwa le ephemerality isenomfanekiso wokwenyama - iiseva. Ekuqaleni, i-architecture yabo yayiyiklasiki. I-chipset ye-x86 eqhelekileyo, amakhadi womnatha, i-Linux, i-Xen hypervisor apho oomatshini benyani baqaliswa khona.
Ngo-2012, olu yilo lwahlangabezana nemisebenzi yalo kakuhle. I-Xen yi-hypervisor enkulu, kodwa ine-drawback enye enkulu. Wanele umphezulu ophezulu wokulinganisa isixhobo. Njengoko amatsha, amakhadi enethiwekhi akhawulezayo okanye iidrive ze-SSD zifumaneka, le nto iphezulu iba phezulu kakhulu. Indlela yokujongana nale ngxaki? Sigqibe kwelokuba sisebenze kumacala amabini ngexesha elinye- lungisa zombini izixhobo kunye nehypervisor. Umsebenzi unzima kakhulu.
Ukuphucula i-hardware kunye ne-hypervisor
Ukwenza yonke into ngexesha elinye kwaye ukwenza kakuhle akuyi kusebenza. Yintoni "elungileyo" nayo yayingacacanga ekuqaleni.
Sagqiba ekubeni sithathe indlela yokuziphendukela kwemvelo - sitshintsha into enye ebalulekileyo yolwakhiwo kwaye siyiphose kwimveliso.
Sinyathela kwireki nganye, simamela izikhalazo kunye neengcebiso. Emva koko sitshintsha elinye icandelo. Ke, ngokunyuswa okuncinci, sitshintsha kakhulu lonke uyilo olusekwe kwimpendulo evela kubasebenzisi kunye nenkxaso.
Utshintsho lwaqala ngo-2013 kunye neyona nto inzima kakhulu - inethiwekhi. IN C3 iimeko, i-Network Accelerator khadi ekhethekileyo yongezwa kwikhadi lenethiwekhi eqhelekileyo. Yayidityaniswe ngokoqobo kunye nentambo emfutshane ye-loopback kwipaneli yangaphambili. Ayintle, kodwa ayibonakali efini. Kodwa unxibelelwano oluthe ngqo kunye ne-hardware luphucule ngokusisiseko i-jitter kunye nokuhanjiswa kwenethiwekhi.
Okulandelayo sagqiba ekubeni siphucule ukufikelela kwibhloko yokugcina idatha ye-EBS - i-Elastic Block Storage. Yindibaniselwano yenethiwekhi kunye nokugcinwa. Ubunzima kukuba ngelixa amakhadi eNethiwekhi ye-Accelerator ekhoyo kwimarike, kwakungekho ndlela yokuthenga ngokulula i-Storeji ye-Accelerator hardware. Ngoko siye sajika kwisiqalo Annapurna Labs, owaphuhlisa iitshiphusi ezikhethekileyo ze-ASIC kuthi. Bavumela ukuba imiqulu ye-EBS ekude ifakwe njengezixhobo ze-NVMe.
Kwiimeko C4 sisombulule iingxaki ezimbini. Eyokuqala kukuba siphumeze isiseko sekamva elithembisayo, kodwa elitsha ngelo xesha, iteknoloji yeNVMe. Okwesibini, sikhuphe kakhulu iprosesa esembindini ngokudlulisela inkqubo yezicelo kwi-EBS kwikhadi elitsha. Kwavela kakuhle, ke ngoku iAnnapurna Labs iyinxalenye yeAmazon.
NgoNovemba 2017, siye saqonda ukuba yayilixesha lokutshintsha i-hypervisor ngokwayo.
I-hypervisor entsha yaphuhliswa ngokusekelwe kwiimodyuli ze-kernel ze-KVM ezilungisiweyo.
Yenze ukuba kube lula ukunciphisa ngokusisiseko ukulinganiswa kwesixhobo kunye nokusebenza ngokuthe ngqo nee-ASIC ezintsha. Iziganeko C5 yayingoomatshini bokuqala abane-hypervisor entsha esebenza phantsi kwe-hood. Samthiya igama nitro.
Ukuvela kweemeko kumgca wexesha.
Zonke iintlobo ezintsha zoomatshini ezibonakalayo eziye zavela ukususela ngoNovemba 2017 ziqhuba kule hypervisor. Iimeko ze-Bare Metal azinayo i-hypervisor, kodwa zikwabizwa ngokuba yiNitro, ekubeni zisebenzisa amakhadi eNitro akhethekileyo.
Kwiminyaka emibini ezayo, inani leentlobo zeemeko zeNitro zadlula isibini seshumi elinesibini: A1, C5, M5, T3 kunye nabanye.
Iintlobo zemizekelo.
Basebenza njani oomatshini beNitro bale mihla
Zinezixhobo ezintathu eziphambili: i-hypervisor ye-Nitro (ixoxwe ngasentla), i-chip yokhuseleko kunye namakhadi e-Nitro.
Itshiphu yokhuseleko idityaniswe ngqo kwi-motherboard. Ilawula imisebenzi emininzi ebalulekileyo, njengokulawula ukulayishwa kwe-OS yenginginya.
amakhadi Nitro - Zine iindidi zazo. Zonke ziphuhliswa yi-Annapurna Labs kwaye zisekelwe kwii-ASIC eziqhelekileyo. Ezinye ze-firmware yazo ziqhelekile.
Iintlobo ezine zamakhadi eNitro.
Elinye lamakhadi lenzelwe ukusebenza kunye inethiwekhiVPC. Le yinto ebonakalayo koomatshini benyani njengekhadi lenethiwekhi ENA-Elastic Network Adapter. Ikwafaka i-traffic xa uyihambisa ngenethiwekhi yomzimba (siya kuthetha ngale nto kwicandelo lesibini lenqaku), ilawula i-firewall yamaQela oKhuseleko, kwaye inoxanduva lokuhamba kunye nezinye izinto zenethiwekhi.
Khetha amakhadi asebenza ngokugcina ibhloko I-EBS kunye neediski ezakhelwe kumncedisi. Zibonakala kumatshini undwendwe virtual njengoko Iiadaptha zeNVMe. Bakwanoxanduva lokufihla idatha kunye nokubeka iliso kwidiski.
Inkqubo yamakhadi e-Nitro, i-hypervisor kunye ne-chip yokhuseleko ihlanganiswe kwinethiwekhi ye-SDN okanye Inethiwekhi echaziweyo yesoftware. Inoxanduva lokulawula le nethiwekhi (i-Control Plane) ikhadi lomlawuli.
Ewe kunjalo, siyaqhubeka nokuphuhlisa ii-ASIC ezintsha. Ngokomzekelo, ekupheleni kwe-2018 bakhulula i-chip ye-Inferentia, evumela ukuba usebenze ngokufanelekileyo ngemisebenzi yokufunda ngomatshini.
Inferentia Machine Learning Processor chip.
Isiseko seDatha esinoKhuleka
Isiseko sedatha yemveli sinesakhiwo esinemaleko. Ukuba senza lula kakhulu, la manqanaba alandelayo ayahlulwa.
- SQL - umxhasi kunye nesicelo se-dispatchers sisebenza kuyo.
- Izibonelelo iintengiselwano - yonke into icacile apha, i-ACID kunye nayo yonke loo nto.
- Ugcino, ebonelelwa ngamachibi e-buffer.
- Ukugawulwa kwemithi - ibonelela ngomsebenzi ngeelog zokuphinda zenziwe kwakhona. Kwi-MySQL zibizwa ngokuba yi-Bin Logs, kwi-PosgreSQL - Bhala iiLogi zangaphambili (WAL).
- Ukugcina – ukurekhoda ngokuthe ngqo kwidisk.
Ulwakhiwo lwesiseko sedatha.
Kukho iindlela ezahlukeneyo zokukala oovimba beenkcukacha: ukwahlula, ukwabelwa Akukho nto yokwakha, iidiski ekwabelwana ngazo.
Nangona kunjalo, zonke ezi ndlela zigcina isakhiwo sedatha ye-monolithic efanayo. Oku kunciphisa kakhulu ukukala. Ukusombulula le ngxaki, siphuhlise eyethu idatabase − IAmazon Aurora. Iyahambelana neMySQL kunye nePostgreSQL.
IAmazon Aurora
Ingcamango yoyilo oluphambili kukuhlula amanqanaba okugcina kunye nokugawulwa kwemithi kwisiseko sedatha engundoqo.
Ukujonga phambili, ndiza kuthi senze inqanaba lecaching lizimele. Uyilo luyayeka ukuba yi-monolith, kwaye sifumana idigri ezongezelelweyo zenkululeko ekulinganiseni iibhloko zomntu ngamnye.
Amanqanaba okungena kunye nokugcinwa ahlukile kwisiseko sedatha.
I-DBMS yendabuko ibhala idatha kwisistim sokugcina ngendlela yeebhloko. EAmazon Aurora, senze ugcino oluhlakaniphile olunokuthetha ulwimi phinda-logs. Ngaphakathi, indawo yokugcina ijika iilogi zibe ziibhloko zedatha, ibeka iliso kwingqibelelo yabo kwaye igcina i-backups ngokuzenzekelayo.
Le ndlela ikuvumela ukuba uphumeze izinto ezinomdla njenge ikloni. Isebenza ngokukhawuleza nangokwezoqoqosho ngakumbi ngenxa yokuba ayifuni ukwenza ikopi epheleleyo yazo zonke iinkcukacha.
Uluhlu lokugcina luphunyezwa njengenkqubo esasazwayo. Iqulathe inani elikhulu kakhulu labancedisi bomzimba. Ilog nganye ye-redo icutshungulwa kwaye igcinwe ngaxeshanye amaqhina amathandathu. Oku kuqinisekisa ukukhuselwa kwedatha kunye nokulinganisa umthwalo.
Ukufunda ukukala kunokufezekiswa kusetyenziswa iikopi ezifanelekileyo. Ukugcinwa okwabiweyo kuphelisa imfuno yongqamaniso phakathi komzekelo wesiseko sedatha, apho sibhala khona idatha, kunye neekopi eziseleyo. Idatha yangoku iqinisekisiwe ukuba iyafumaneka kuzo zonke iikopi.
Ingxaki kuphela kukugcina idatha endala kwiikopi zokufunda. Kodwa le ngxaki iyasonjululwa ugqithiselo lwazo zonke iilog zokuphinda zenziwe ukuphindaphinda ngaphezulu kwenethiwekhi yangaphakathi. Ukuba ilogi ikwi-cache, iphawulwe njengengalunganga kwaye ibhalwe ngaphezulu. Ukuba ayikho kwi-cache, iyalahlwa nje.
Siye salungisa ugcino.
Uyenza njani imilinganiselo yeDBMS
Apha, ukulinganisa okuthe tye kunzima kakhulu. Ngoko ke masiye ezantsi kwindlela ebethiweyo ukukala okuthe nkqo okuqhelekileyo.
Makhe sicinge ukuba sinesicelo esinxibelelana ne-DBMS nge-master node.
Xa ulinganisa ngokuthe nkqo, sabela indawo entsha eya kuba neeprosesa ezininzi kunye nememori.
Emva koko, sitshintsha isicelo ukusuka kwi-master node endala ukuya kwentsha. Iingxaki ziyavela.
- Oku kuya kufuna ixesha elibalulekileyo lokunciphisa isicelo.
- I-master node entsha iya kuba ne-cache ebandayo. Ukusebenza kweDatabase kuya kuba kuninzi kuphela emva kokuba i-cache ishushu.
Indlela yokuphucula imeko? Misela i-proxy phakathi kwesicelo kunye ne-master node.
Iza kusinika ntoni le nto? Ngoku zonke izicelo akufuneki ziqondiswe kwakhona ngesandla kwindawo entsha. Ukutshintsha kungenziwa phantsi kweproksi kwaye ngokukhawuleza kuyakhawuleza.
Kubonakala ngathi ingxaki isonjululwe. Kodwa hayi, sisabandezeleka ngenxa yesidingo sokufudumala i-cache. Ukongeza, ingxaki entsha ibonakala - ngoku i-proxy yindawo enokuthi ingaphumeleli.
Isisombululo sokugqibela kunye neAmazon Aurora serverless
Sazicombulula njani ezi ngxaki?
Ushiye ummeli. Lo ayingomzekelo owahlukileyo, kodwa iqela elipheleleyo elisasaziweyo le proxies apho izicelo ziqhagamshela kuvimba wedatha. Kwimeko yokungaphumeleli, nayiphi na i-nodes inokutshintshwa ngokukhawuleza ngokukhawuleza.
Kongezwe ichibi leendawo ezifudumeleyo ezinobungakanani obahlukeneyo. Ngoko ke, ukuba kuyimfuneko ukunika i-node entsha yesayizi enkulu okanye encinci, ifumaneka ngokukhawuleza. Akukho sidingo sokulinda ukuba ilayishe.
Yonke inkqubo yokulinganisa ilawulwa yinkqubo ekhethekileyo yokubeka iliso. Ukubeka iliso rhoqo kubeka esweni imeko ye-master node yangoku. Ukuba ibona, umzekelo, ukuba umthwalo weprosesa ufikelele kwixabiso elibalulekileyo, ikwazisa i-pool yeemeko ezifudumeleyo malunga nesidingo sokwabela i-node entsha.
Iiproksi ezisasaziweyo, iimeko ezifudumeleyo kunye nokubeka iliso.
I-node enamandla afunekayo iyafumaneka. Amachibi e-buffer akhutshelwa kuyo, kwaye inkqubo iqala ukulinda umzuzu okhuselekileyo wokutshintsha.
Ngokuqhelekileyo ixesha lokutshintsha liza ngokukhawuleza. Emva koko unxibelelwano phakathi kwe-proxy kunye ne-master node endala imisiwe, zonke iiseshoni zitshintshelwa kwi-node entsha.
Sebenza ngesiseko sedatha kwakhona.
Igrafu ibonisa ukuba ukumiswa kufutshane kakhulu. Igrafu eluhlaza okwesibhakabhaka ibonisa umthwalo, kwaye amanyathelo abomvu abonisa amaxesha okunyusa. Iidiphu zexesha elifutshane kwigrafu eluhlaza ngokuchanekileyo koko kulibaziseka okufutshane.
Ngendlela, i-Amazon Aurora ikuvumela ukuba ugcine imali ngokupheleleyo kwaye ucime i-database xa ingasetyenziswa, umzekelo, ngeempelaveki. Emva kokumisa umthwalo, i-DB inciphisa ngokuthe ngcembe amandla ayo kwaye icime ixesha elithile. Xa umthwalo ubuya, uya kuvuka kakuhle kwakhona.
Kwinxalenye elandelayo yebali malunga nesixhobo seAmazon, siza kuthetha malunga nokukalwa kwenethiwekhi. Bhalisa kwaye uhlale ubukele ukuze ungaphoswa linqaku.
phezu UVasily Pantyukhin uya kunika ingxelo "" Ziziphi iipatheni zoyilo lweenkqubo ezisasazwayo ezisetyenziswa ngabaphuhlisi base-Amazon, zeziphi izizathu zokungaphumeleli kwenkonzo, yintoni i-architecture esekelwe kwiCell, i-Constant Work, i-Shuffle Sharding - iya kuba yinto enomdla. Ngaphantsi kwenyanga kude kube yinkomfa - . Oktobha 24 ukunyuka kwexabiso lokugqibela.
umthombo: www.habr.com