Isikali senethiwekhi ye-Amazon Web Services yizindawo ezingama-69 emhlabeni jikelele ezifundeni ezingama-22: i-USA, i-Europe, i-Asia, i-Afrika ne-Australia. Indawo ngayinye iqukethe izikhungo zedatha ezingafika kweziyisi-8 - Izikhungo Zokucubungula Idatha. Isikhungo sedatha ngasinye sinezinkulungwane noma amakhulu ezinkulungwane zamaseva. Inethiwekhi iklanywe ngendlela yokuthi zonke izimo ezingenakwenzeka zokucima zicatshangelwe. Isibonelo, zonke izifunda zihlukanisiwe ukusuka kwenye, futhi izindawo zokufinyeleleka zihlukaniswa ngamabanga amakhilomitha ambalwa. Ngisho noma usika ikhebula, isistimu izoshintshela eziteshini eziyisipele, futhi ukulahleka kolwazi kuzolingana namaphakethe edatha ambalwa. U-Vasily Pantyukhin uzokhuluma ngokuthi yiziphi ezinye izimiso inethiwekhi eyakhelwe phezu kwayo nokuthi yakhiwe kanjani.
Vasily Pantyukhin waqala njengomphathi we-Unix ezinkampanini ze-.ru, wasebenza ku-Hardware enkulu ye-Sun Microsystem iminyaka engu-6, futhi washumayela umhlaba wedatha-centric iminyaka engu-11 ku-EMC. Ivele yashintsha yaba amafu ayimfihlo, yabe isiyiswa emphakathini. Manje, njengomakhi we-Amazon Web Services, unikeza izeluleko zobuchwepheshe ukuze asize aphile futhi athuthuke efwini le-AWS.
Engxenyeni edlule ye-trilogy ye-AWS, u-Vasily ucwaninge ekwakhiweni kwamaseva aphathekayo kanye nokukalwa kwedathabheyisi. Amakhadi e-Nitro, i-hypervisor esekwe ku-KVM yangokwezifiso, isizindalwazi se-Amazon Aurora - ngakho konke lokhu kundaba "" Funda ukuze uthole umongo noma ubuke izinkulumo.
Le ngxenye izogxila ekulinganisweni kwenethiwekhi, enye yezinhlelo eziyinkimbinkimbi kakhulu ku-AWS. Ukuziphendukela kwemvelo kusuka kunethiwekhi eyisicaba kuya ku-Virtual Private Cloud kanye nomklamo wayo, izinsizakalo zangaphakathi ze-Blackfoot ne-HyperPlane, inkinga yomakhelwane onomsindo, futhi ekugcineni - isikali senethiwekhi, umgogodla kanye nezintambo ezibonakalayo. Mayelana nakho konke lokhu ngaphansi kokunqunywa.
Ukuzihlangula: yonke into engezansi ingumbono womuntu siqu kaVasily futhi ingase ingahambelani nesikhundla se-Amazon Web Services.
Ukukala kwenethiwekhi
Ifu le-AWS laqalwa ngo-2006. Inethiwekhi yakhe yayingajwayelekile - inesakhiwo esiyisicaba. Uhlu lwamakheli ayimfihlo lwaluvamile kubo bonke abaqashi bamafu. Lapho uqala umshini omusha we-virtual, uthole ngephutha ikheli le-IP elitholakalayo kulobu bubanzi.
Le ndlela yayilula ukuyisebenzisa, kodwa ikhawulele ukusetshenziswa kwefu. Ikakhulukazi, bekunzima kakhulu ukuthuthukisa izixazululo ezixubile ezihlanganisa amanethiwekhi ayimfihlo phansi kanye naku-AWS. Inkinga ejwayeleke kakhulu bekungububanzi bamakheli e-IP agqagqene.
I-Virtual Private Cloud
Ifu kuvele ukuthi liyafuneka. Sesifikile isikhathi sokucabanga ngokuqina kanye nokwenzeka kokusetshenziswa kwayo ngamashumi ezigidi zabaqashi. Inethiwekhi eyisicaba isiphenduke isithiyo esikhulu. Ngakho-ke, sicabange ukuthi singabahlukanisa kanjani abasebenzisi kusuka komunye nomunye ezingeni lenethiwekhi ukuze bakwazi ukukhetha ngokuzimela ububanzi be-IP.
Iyiphi into yokuqala efika engqondweni uma ucabanga ngokuhlukaniswa kwenethiwekhi? Impela IVLAN ΠΈ I-VRF - Umzila Obonakalayo Nokudlulisa.
Ngeshwa, akuzange kusebenze. I-VLAN ID ingamabhithi ayi-12 kuphela, okusinika amasegimenti angawodwa angama-4096 kuphela. Ngisho namaswishi amakhulu kakhulu angasebenzisa ama-VRF ayizinkulungwane ezingu-1-2. Ukusebenzisa i-VRF ne-VLAN ndawonye kusinikeza ama-subnet ayizigidi ezimbalwa. Lokhu akwanele ngempela kumashumi ezigidi zabaqashi, ngamunye wabo okufanele akwazi ukusebenzisa ama-subnet amaningi.
Futhi ngeke sikwazi ukuthenga inombolo edingekayo yamabhokisi amakhulu, isibonelo, kwaCisco noma kuJuniper. Kunezizathu ezimbili: kuyabiza, futhi asifuni ukuba semseni wezinqubomgomo zabo zokuthuthukisa kanye nokuchibiyela.
Kunesiphetho esisodwa kuphela - zenzele esakho isixazululo.
Ngo-2009 samemezela I-VPC - I-Virtual Private Cloud. Igama linamathele futhi manje abahlinzeki abaningi bamafu nabo bayalisebenzisa.
I-VPC iyinethiwekhi ebonakalayo I-SDN (I-Software Defined Network). Sinqume ukungasunguli amaphrothokholi akhethekile kumazinga we-L2 ne-L3. Inethiwekhi isebenza nge-Ethernet ejwayelekile ne-IP. Ukuze kudluliselwe kunethiwekhi, ithrafikhi yomshini ebonakalayo ifakwe kusisonga sethu sephrothokholi. Ikhombisa i-ID engeye-VPC yesiqashi.
Kuzwakala kulula. Nokho, kunezinselele zobuchwepheshe ezimbalwa ezingathi sΓna ezidinga ukunqotshwa. Isibonelo, kuphi futhi kanjani idatha ekumephini amakheli abonakalayo e-MAC/IP, i-VPC ID kanye ne-MAC/IP ephathekayo ehambisanayo. Esikalini se-AWS, leli ithebula elikhulu okufanele lisebenze ngokubambezeleka okuncane kokufinyelela. Unesibopho salokhu isevisi yokwenza imephu, esatshalaliswa ungqimba oluncane kuyo yonke inethiwekhi.
Emishinini yesizukulwane esisha, i-encapsulation yenziwa ngamakhadi we-Nitro ezingeni le-hardware. Ezimweni ezindala, i-encapsulation kanye ne-decapsulation kusekelwe kwisofthiwe.
Ake sibone ukuthi isebenza kanjani ngokwemibandela evamile. Ake siqale ngezinga le-L2. Ake sicabange ukuthi sinomshini obonakalayo one-IP 10.0.0.2 kuseva ebonakalayo 192.168.0.3. Ithumela idatha kumshini we-virtual 10.0.0.3, ohlala ku-192.168.1.4. Isicelo se-ARP siyakhiqizwa futhi sithunyelwe ekhadini lenethiwekhi le-Nitro. Ukwenza kube lula, sicabanga ukuthi yomibili imishini ebonakalayo ihlala ku-VPC "eluhlaza" efanayo.
Imephu ithatha indawo yekheli lomthombo ngelayo futhi idlulisela phambili uhlaka lwe-ARP kusevisi yokwenza imephu.
Isevisi yokwenza imephu ibuyisela ulwazi oludingekayo ukuze ludluliselwe ngenethiwekhi ye-L2 ebonakalayo.
Ikhadi le-Nitro empendulweni ye-ARP lingena esikhundleni se-MAC kunethiwekhi yangempela nekheli eliku-VPC.
Lapho sidlulisela idatha, sigoqa i-MAC enengqondo ne-IP esonga nge-VPC. Sidlulisela konke lokhu ngenethiwekhi ebonakalayo sisebenzisa umthombo ofanele kanye namakhadi e-IP Nitro okuyiwa kuwo.
Umshini ophathekayo lapho iphakheji lihloselwe khona ukwenza isheke. Lokhu kuyadingeka ukuze kuvinjwe ukuthi kube khona ukuphangwa kwamakheli. Umshini uthumela isicelo esikhethekile kusevisi yokwenza imephu futhi uyabuza: βKusuka emshinini womzimba 192.168.0.3 ngithole iphakethe elihloselwe u-10.0.0.3 ku-VPC eluhlaza okwesibhakabhaka. Ingabe usemthethweni?
Isevisi yokwenza imephu ihlola ithebula layo lokwabiwa kwensiza futhi ivumele noma yenqabe iphakethe ukuthi lidlule. Kuzo zonke izimo ezintsha, ukuqinisekiswa okwengeziwe kushumekwe emakhadini e-Nitro. Akunakwenzeka ukudlula ngisho nangokwethiyori. Ngakho-ke, ukukhohlisa izinsiza kwenye i-VPC ngeke kusebenze.
Okulandelayo, idatha ithunyelwa emshinini we-virtual ehloselwe wona.
Isevisi yokwenza imephu iphinde isebenze njengerutha enengqondo yokudlulisa idatha phakathi kwemishini ebonakalayo kuma-subnet ahlukene. Yonke into ilula ngokomqondo, ngeke ngiye ngemininingwane.
Kuvela ukuthi lapho udlulisela iphakethe ngalinye, amaseva aphendukela kusevisi yemephu. Ungabhekana kanjani nokubambezeleka okungenakugwema? Ukulondoloza inqolobane, kunjalo.
Ubuhle ukuthi awudingi ukufaka inqolobane yonke itafula elikhulu. Iseva ebonakalayo isingatha imishini ebonakalayo evela kwinani elincane lama-VPC. Udinga kuphela ukufaka kunqolobane imininingwane mayelana nalawa ma-VPC. Ukudlulisa idatha kwamanye ama-VPC ekucushweni "okuzenzakalelayo" akukavumeleki. Uma ukusebenza okufana ne-VPC-peering kusetshenziswa, ulwazi mayelana nama-VPC ahambisanayo luyalayishwa kunqolobane.
Silungise ukudluliswa kwedatha ku-VPC.
I-Blackfoot
Yini okufanele uyenze ezimeni lapho ithrafikhi idinga ukudluliselwa ngaphandle, isibonelo ku-inthanethi noma nge-VPN phansi? Uyasisiza lapha I-Blackfoot - Isevisi yangaphakathi ye-AWS. Ithuthukiswe ithimba lethu laseNingizimu Afrika. Yingakho le nkonzo iqanjwe ngephengwini ehlala eNingizimu Afrika.
I-Blackfoot inqamula ithrafikhi futhi yenza okudingekayo ngayo. Idatha ithunyelwa ku-inthanethi njengoba injalo.
Idatha inqanyuliwe futhi isongwe kabusha ku-IPsec lapho usebenzisa i-VPN.
Uma usebenzisa i-Direct Connect, ithrafikhi imakwa futhi ithunyelwe ku-VLAN efanele.
I-HyperPlane
Lena isevisi yokulawula ukugeleza kwangaphakathi. Amasevisi amaningi enethiwekhi adinga ukugadwa ukugeleza kwedatha. Isibonelo, uma usebenzisa i-NAT, isilawuli sokugeleza kufanele siqinisekise ukuthi i-IP:imbobo ebhangqiwe yendawo okuyiwa kuyo inembobo ephumayo ehlukile. Endabeni ye-balancer I-NLB - Isilinganisi Somthwalo Wenethiwekhi, ukugeleza kwedatha kufanele ngaso sonke isikhathi kuqondiswe emshinini ofanayo oqondisiwe. I-Security Groups iyi-firewall esemthethweni. Iqapha ithrafikhi engenayo futhi ivule ngokusobala izimbobo zokugeleza kwephakethe eliphumayo.
Efwini le-AWS, izidingo zokubambezeleka kokudlulisela ziphezulu kakhulu. Yingakho ke I-HyperPlane okubalulekile ekusebenzeni kwayo yonke inethiwekhi.
IHyperplane yakhelwe emishinini ebonakalayo ye-EC2. Awukho umlingo lapha, ubuqili kuphela. Iqhinga ukuthi lena imishini ebonakalayo ene-RAM enkulu. Imisebenzi iyenzeka futhi yenziwa kumemori kuphela. Lokhu kukuvumela ukuthi ufinyelele ukubambezeleka kwamashumi ama-microsecond kuphela. Ukusebenza ngediski kuzobulala wonke umkhiqizo.
I-Hyperplane iyisistimu esabalalisiwe yenombolo enkulu yemishini enjalo ye-EC2. Umshini ngamunye obonakalayo unomkhawulokudonsa ongu-5 GB/s. Kuyo yonke inethiwekhi yesifunda, lokhu kunikeza ama-terabits amangalisayo womkhawulokudonsa futhi kuvumela ukucutshungulwa izigidi zokuxhuma ngomzuzwana.
I-HyperPlane isebenza kuphela ngokusakazwayo. Iphakethe le-VPC encapsulation lisobala ngokuphelele kulo. Ukuba sengozini okungaba khona kule sevisi yangaphakathi kusazovimbela ukuhlukaniswa kwe-VPC ukuthi kuphuke. Amaleveli angezansi anesibopho sokuvikeleka.
Umakhelwane onomsindo
Kusenenkinga umakhelwane onomsindo - umakhelwane onomsindo. Ake sicabange ukuthi sinamanodi angu-8. Lawa ma-node acubungula ukugeleza kwabo bonke abasebenzisi bamafu. Konke kubonakala kuhamba kahle futhi umthwalo kufanele usatshalaliswe ngokulinganayo kuwo wonke ama-node. Amanodi anamandla kakhulu futhi kunzima ukuwalayisha kakhulu.
Kodwa sakha i-architecture yethu ngokusekelwe ngisho nezimo ezingalindelekile.
Amathuba aphansi akusho ukuthi akunakwenzeka.
Singacabanga ngesimo lapho umsebenzisi oyedwa noma ngaphezulu angakhiqiza umthwalo omningi kakhulu. Wonke ama-HyperPlane node abandakanyeka ekucubunguleni lo mthwalo futhi abanye abasebenzisi bangase bahlangabezane nohlobo oluthile lokushaywa kokusebenza. Lokhu kwephula umqondo wefu, lapho abaqashi abangenalo ikhono lokuthonyana.
Indlela yokuxazulula inkinga yomakhelwane onomsindo? Into yokuqala efika engqondweni ukuhlukanisa. Amanodi ethu angu-8 ahlukaniswe ngokunengqondo abe izingcezu ezi-4 zamanodi angu-2 ngayinye. Manje umakhelwane onomsindo uzophazamisa ingxenye yesine kuphela yabo bonke abasebenzisi, kodwa uzobaphazamisa kakhulu.
Asenzeni izinto ngendlela ehlukile. Sizokwaba amanodi ama-3 kuphela kumsebenzisi ngamunye.
Iqhinga ukwabela amanodi ngokungahleliwe kubasebenzisi abahlukene. Esithombeni esingezansi, umsebenzisi oluhlaza unqamula ama-node nomunye wabasebenzisi ababili - oluhlaza okotshani nowolintshi.
Ngamanodi angu-8 nabasebenzisi abangu-3, ββamathuba okuthi umakhelwane onomsindo anqamule omunye wabasebenzisi angama-54%. Kungaleli thuba lapho umsebenzisi oluhlaza ezoba nomthelela kwabanye abaqashi. Ngesikhathi esifanayo, ingxenye kuphela yomthwalo wayo. Esibonelweni sethu, leli thonya lizobonakala okungenani ngandlela thile hhayi kuwo wonke umuntu, kodwa kuphela ingxenye yesithathu yabo bonke abasebenzisi. Lokhu sekuvele kuwumphumela omuhle.
Inombolo yabasebenzisi abazophambana
Amathuba ngamaphesenti
0
18%
1
54%
2
26%
3
2%
Ake silethe isimo eduze neqiniso - ake sithathe ama-node angu-100 nabasebenzisi abangu-5 kuma-node angu-5. Kulokhu, awekho amanodi azophambana namathuba angu-77%.
Inombolo yabasebenzisi abazophambana
Amathuba ngamaphesenti
0
77%
1
21%
2
1,8%
3
0,06%
4
0,0006%
5
0,00000013%
Esimeni sangempela, ngenani elikhulu lamanodi we-HyperPlane nabasebenzisi, umthelela ongaba khona womakhelwane onomsindo kwabanye abasebenzisi mncane. Le ndlela ibizwa ngokuthi ukuxuba sharding - shuffle sharding. Yehlisa umthelela omubi wokuhluleka kwamanodi.
Izinsizakalo eziningi zakhiwe ngesisekelo se-HyperPlane: I-Network Load Balancer, i-NAT Gateway, i-Amazon EFS, i-AWS PrivateLink, i-AWS Transit Gateway.
Isikali senethiwekhi
Manje ake sikhulume ngesilinganiso senethiwekhi ngokwayo. Ngo-Okthoba 2019 i-AWS inikezela ngezinsizakalo zayo ku 22 izifunda, futhi kuhlelwa ezinye ezingu-9.
- Isifunda ngasinye siqukethe Izindawo Ezitholakalayo ezimbalwa. Bangu-69 emhlabeni jikelele.
- I-AZ ngayinye iqukethe Izikhungo Zokucubungula Idatha. Azikho ngaphezu kuka-8 sezizonke.
- Isikhungo sedatha sigcina inani elikhulu lamaseva, amanye afinyelela ku-300.
Manje ake silinganisele konke lokhu, siphindaphinde futhi sithole isibalo esihlaba umxhwele esibonisayo Amazon cloud scale.
Ziningi izixhumanisi ezibonakalayo phakathi Kwezindawo Zokutholakala kanye nesikhungo sedatha. Kwesinye sezifunda zethu ezinkulu, iziteshi ezingama-388 zibekwe nje ukuze kuxhumane ne-AZ phakathi kwesinye nezikhungo zokuxhumana nezinye izifunda (Izikhungo Zokuthutha). Sekukonke lokhu kunikeza crazy 5000 Tbit.
I-Backbone AWS yakhelwe ngokukhethekile futhi yenzelwe amafu. Sakha eziteshini 100 GB / s. Siwalawula ngokuphelele, ngaphandle kwezifunda zase-China. I-traffic ayihlanganyelwa nemithwalo yezinye izinkampani.
Yiqiniso, akuwona kuphela umhlinzeki wefu onenethiwekhi yangasese yomgogodla. Ziyanda izinkampani ezinkulu ezilandela le ndlela. Lokhu kuqinisekiswa abacwaningi abazimele, isibonelo kusuka .
Igrafu ibonisa ukuthi isabelo sabahlinzeki bokuqukethwe nabahlinzeki bamafu siyakhula. Ngenxa yalokhu, isabelo se-inthanethi sabahlinzeki bomgogodla sihlala sincipha.
Ngizochaza ukuthi kungani lokhu kwenzeka. Ngaphambilini, izinsiza eziningi zewebhu bezifinyeleleka futhi zisetshenziswa ngokuqondile ku-inthanethi. Namuhla, amaseva andayo atholakala efwini futhi afinyeleleka nge CDN - Inethiwekhi Yokusabalalisa Okuqukethwe. Ukuze ufinyelele insiza, umsebenzisi uhamba nge-inthanethi kuphela aye ku-CDN PoP eseduze - Iphuzu Lobukhona. Isikhathi esiningi kuba ndawana thize eduzane. Bese ishiya i-inthanethi yomphakathi futhi indize ngomgogodla wangasese inqamule i-Atlantic, isibonelo, futhi ifinyelele ngqo esisetshenziswa.
Ngiyazibuza ukuthi i-Intanethi izoshintsha kanjani eminyakeni eyi-10 uma lo mkhuba uqhubeka?
Iziteshi ezibonakalayo
Ososayensi abakayitholi indlela yokwandisa ijubane lokukhanya endaweni yonke, kodwa baye benza intuthuko enkulu ezindleleni zokukudlulisa nge-optical fiber. Njengamanje sisebenzisa izintambo ze-fiber ezingu-6912. Lokhu kusiza ukukhulisa kakhulu izindleko zokufakwa kwazo.
Kwezinye izifunda kufanele sisebenzise izintambo ezikhethekile. Isibonelo, esifundeni sase-Sydney sisebenzisa izintambo ezinombala okhethekile ngokumelene nomuhlwa.
Akekho ongagonyiwe ezinkingeni futhi kwesinye isikhathi iziteshi zethu ziyalimala. Isithombe esingakwesokudla sibonisa izintambo ezibonakalayo kwesinye sezifunda zaseMelika ezidatshulwe izisebenzi zokwakha. Ngenxa yale ngozi, kwalahleka amaphakethe angu-13 kuphela, okuyinto emangalisayo. Nakulokhu futhi - 13 kuphela! Isistimu ishintshele eziteshini eziyisipele ngokushesha - isikali siyasebenza.
Sigijimele kwezinye zezinsizakalo zamafu ze-Amazon nobuchwepheshe. Ngithemba ukuthi okungenani unombono othile wesilinganiso semisebenzi onjiniyela bethu okufanele bayixazulule. Ngokwami, lokhu ngikuthola kujabulisa kakhulu.
Lena ingxenye yokugcina ye-trilogy evela kuVasily Pantyukhin mayelana nedivayisi ye-AWS. IN izingxenye zichaza ukwenziwa ngcono kweseva kanye nokukalwa kwedathabhesi, kanye nokungaphakathi - imisebenzi engenaseva kanye neFirecracker.
In ngoNovemba uVasily Pantyukhin uzokwabelana ngemininingwane emisha yedivayisi ye-Amazon. Yena mayelana nezimbangela zokwehluleka kanye nokwakhiwa kwezinhlelo ezisatshalaliswa e-Amazon. Okthoba 24 kusengenzeka ithikithi ngentengo enhle, bese ukhokha kamuva. Sikulindile kwa-HighLoad++, woza sixoxe!
Source: www.habr.com