Ubungakanani benethiwekhi yeeNkonzo zeWebhu ye-Amazon yimimandla ye-69 emhlabeni jikelele kwimimandla ye-22: i-USA, iYurophu, i-Asia, i-Afrika kunye ne-Australia. Indawo nganye iqulathe ukuya kuthi ga kwi-8 amaziko edatha-Amaziko oCwangciso lweDatha. Iziko ngalinye ledatha linamawaka okanye amakhulu amawaka eeseva. Uthungelwano luyilwe ngendlela yokuba zonke iimeko ezingalindelekanga zokucima zithathelwe ingqalelo. Umzekelo, yonke imimandla ibekwe yodwa enye kwenye, kwaye iindawo zofikelelo zohlulwe kumgama weekhilomitha eziliqela. Nokuba unqumle ikhebula, inkqubo iya kutshintshela kumajelo ogcino, kwaye ukulahleka kolwazi kuya kuba neepakethi ezimbalwa zedatha. UVasily Pantyukhin uya kuthetha malunga nokuba yeyiphi enye imigaqo yenethiwekhi eyakhiwe ngayo kunye nendlela eyakhiwe ngayo.
Vasily Pantyukhin waqala njengomlawuli we-Unix kwiinkampani ze-.ru, wasebenza kwi-hardware enkulu ye-Sun Microsystem iminyaka eyi-6, kwaye washumayela ihlabathi le-data-centric iminyaka eyi-11 kwi-EMC. Ngokwendalo yavela kumafu abucala, emva koko yafudukela kuluntu. Ngoku, njengomakhi weeNkonzo zeWebhu ye-Amazon, unikezela ngeengcebiso zobuchwepheshe ukunceda ukuhlala nokuphuhlisa kwifu le-AWS.
Kwinxalenye yangaphambili ye-trilogy ye-AWS, uVasily uhlolisise kuyilo lweeseva eziphathekayo kunye nokulinganiswa kwedatha. Amakhadi e-Nitro, i-hypervisor esekwe kwi-KVM, i-database ye-Amazon Aurora - malunga nayo yonke le nto kwizinto "" Funda umxholo okanye ukubukela iintetho.
Le nxalenye iya kugxila ekulinganisweni kwenethiwekhi, enye yezona nkqubo zinzima kwi-AWS. Ukuziphendukela kwemvelo ukusuka kwinethiwekhi ye-flat ukuya kwi-Virtual Private Cloud kunye noyilo lwayo, iinkonzo zangaphakathi ze-Blackfoot kunye ne-HyperPlane, ingxaki yommelwane onomsindo, kwaye ekupheleni - umlinganiselo womnatha, umqolo kunye neentambo zomzimba. Malunga nayo yonke le nto phantsi kokusikwa.
Ukuziphendulela: yonke into engezantsi luluvo lukaVasily kwaye inokungahambelani nesikhundla seeNkonzo zeWebhu zeAmazon.
Ukwandiswa kwenethiwekhi
Ilifu le-AWS lasungulwa ngo-2006. Uthungelwano lwakhe lwaluyinto yakudala - kunye nesakhiwo esisicaba. Uluhlu lweedilesi zabucala lwaluqhelekile kubo bonke abaqashi bamafu. Xa uqala umatshini omtsha wenyani, ufumene ngempazamo idilesi ye-IP ekhoyo kolu luhlu.
Le ndlela yayilula ukuyisebenzisa, kodwa ngokusisiseko yanciphisa ukusetyenziswa kwelifu. Ngokukodwa, kwakunzima kakhulu ukuphuhlisa izisombululo ezixubeneyo ezidibanisa uthungelwano lwabucala emhlabeni nakwi-AWS. Eyona ngxaki ixhaphakileyo ibikuluhlu lweedilesi ze-IP ezidlulanayo.
Ilifu labucala elifihlakeleyo
Ilifu lajika lafuneka. Ixesha lifikile lokucinga malunga nokunciphisa kunye nokwenzeka kokusetyenziswa ngamashumi ezigidi zabaqeshi. Uthungelwano oluthe tyaba lube ngumqobo omkhulu. Ke ngoko, sicinge malunga nendlela yokwahlula abasebenzisi omnye komnye kwinqanaba lenethiwekhi ukuze bakwazi ukukhetha ngokuzimeleyo uluhlu lwe-IP.
Yeyiphi into yokuqala ethi qatha engqondweni xa ucinga ngokubekwa wedwa kwenethiwekhi? Ngokuqinisekileyo IVLAN ΠΈ I-VRF -Umzila obonakalayo kunye noThutho.
Ngelishwa, ayizange isebenze. I-ID ye-VLAN yi-bits ye-12 kuphela, esinika kuphela amacandelo angama-4096 kuphela. Nokutshintsha okukhulu kunokusebenzisa ubukhulu be-1-2 amawaka eVRF. Ukusebenzisa iVRF kunye neVLAN kunye kusinika izigidi ezimbalwa zeesubnets. Oku ngokuqinisekileyo akwanelanga kumashumi ezigidi zabaqeshi, nganye kuzo kufuneka ikwazi ukusebenzisa ii-subnets ezininzi.
Kananjalo asinakukwazi ukuthenga inani elifunekayo leebhokisi ezinkulu, umzekelo, kwiCisco okanye kwiJuniper. Kukho izizathu ezibini: iyabiza kakhulu, kwaye asifuni kuba nenceba yophuhliso lwabo kunye nemigaqo-nkqubo yokuchwetheza.
Sinye kuphela isigqibo - zenzele esakho isisombululo.
Ngo-2009 sabhengeza VPC - Ilifu labucala elifihlakeleyo. Igama linamathele kwaye ngoku abaninzi ababoneleli belifu bayalisebenzisa.
I-VPC yinethiwekhi yenyani SDN (Inethiwekhi echaziweyo yeSoftware). Saye sagqiba ekubeni singayileli iiprothokholi ezikhethekileyo kumanqanaba e-L2 kunye ne-L3. Inethiwekhi isebenza kwi-Ethernet eqhelekileyo kunye ne-IP. Ukusasaza kwinethiwekhi, itrafikhi yomatshini wenyani ifakwe kweyethu iprotocol wrapper. Ibonisa i-ID ye-VPC yomqeshi.
Ivakala ilula. Nangona kunjalo, kukho imingeni enzima yobugcisa ekufuneka yoyiswe. Ngokomzekelo, apho kwaye njani ukugcina idatha kwimephu ye-MAC / IP idilesi ye-IP, i-ID ye-VPC kunye ne-MAC / IP ehambelanayo. Kwisikali se-AWS, le yitafile enkulu ekufuneka isebenze ngokulibaziseka okuncinci kofikelelo. Uxanduva loku inkonzo yeemephu, esasazwa kwinqanaba elincinci kuyo yonke inethiwekhi.
Kwimishini yesizukulwana esitsha, i-encapsulation yenziwa ngamakhadi e-Nitro kwinqanaba le-hardware. Kwiimeko ezindala, i-encapsulation kunye ne-decapsulation isekwe kwisoftware.
Makhe sibone indlela esebenza ngayo ngokubanzi. Masiqale ngenqanaba le-L2. Makhe sicinge ukuba sinomatshini wenyani kunye ne-IP 10.0.0.2 kwiseva yomzimba 192.168.0.3. Ithumela idatha kwi-virtual machine 10.0.0.3, ehlala kwi-192.168.1.4. Isicelo se-ARP senziwa kwaye sithunyelwe kwinethiwekhi yekhadi le-Nitro. Ukwenza lula, sicinga ukuba bobabini oomatshini bokwenene bahlala kwiVPC "eblue" efanayo.
Imephu ithatha indawo yedilesi yemvelaphi ngeyayo kwaye idlulisela isakhelo se-ARP kwinkonzo yokubonisa.
Inkonzo yemephu ibuyisela ulwazi oluyimfuneko ekugqithiseni nge-L2 inethiwekhi ebonakalayo.
Ikhadi le-Nitro kwimpendulo ye-ARP ithatha indawo ye-MAC kwinethiwekhi yomzimba kunye nedilesi kwi-VPC.
Xa udlulisela idatha, sisonga i-MAC enengqiqo kunye ne-IP kwi-wrapper ye-VPC. Sihambisa konke oku kuthungelwano lwenyama sisebenzisa umthombo ofanelekileyo kunye nokusingwa kwamakhadi e-IP Nitro.
Umatshini womzimba apho ipakethe imiselwe khona wenza itshekhi. Oku kuyimfuneko ukuthintela ukuba nokwenzeka kwe-spoofing yedilesi. Umatshini uthumela isicelo esikhethekileyo kwinkonzo yeemephu kwaye uyabuza: "Ukusuka kumatshini womzimba 192.168.0.3 ndifumene ipakethi ehloselwe i-10.0.0.3 kwi-VPC eluhlaza okwesibhakabhaka. Ngaba usemthethweni?
Inkonzo yemephu ijonga itafile yolwabiwo lwezixhobo kwaye ivumela okanye iyala ipakethi ukuba idlule. Kuzo zonke iimeko ezintsha, ukuqinisekiswa okongeziweyo kufakwe kumakhadi eNitro. Akunakwenzeka ukuyigqitha nkqu nethiyori. Ke ngoko, ukuxhaphaza izixhobo kwenye iVPC akuyi kusebenza.
Okulandelayo, idatha ithunyelwa kumatshini obonakalayo ekujoliswe kuwo.
Inkonzo yemephu ikwasebenza njenge-router enengqiqo yokudlulisa idatha phakathi koomatshini benyani kwii-subnets ezahlukeneyo. Yonke into ilula ngokwengqiqo, andizukungena kwiinkcukacha.
Kuvela ukuba xa uhambisa ipakethe nganye, iiseva ziphendukela kwinkonzo yemephu. Indlela yokujongana nokulibaziseka okungenakuthintelwa? Ugcino, kanjalo.
Ubuhle kukuba awudingi ukufihla yonke itafile enkulu. Umncedisi wenyama ubamba oomatshini benyani ukusuka kwinani elincinci leeVPCs. Ufuna kuphela i-cache ulwazi malunga nezi VPC. Ukudlulisa idatha kwezinye ii-VPC kwi-"default" yoqwalaselo akukabikho semthethweni. Ukuba ukusebenza okufana neVPC-peering kusetyenziswa, ngoko ulwazi malunga neeVPC ezihambelanayo zifakwe kwi-cache.
Siye salungisa ukuhanjiswa kwedatha kwiVPC.
Blackfoot
Yintoni enokuyenza kwiimeko apho i-traffic kufuneka idluliselwe ngaphandle, umzekelo kwi-Intanethi okanye nge-VPN emhlabeni? Iyasinceda apha Blackfoot -Inkonzo yangaphakathi ye-AWS. Iphuhliswa liqela lethu loMzantsi Afrika. Yiyo loo nto le nkonzo ithiywe ngegama likanombombiya ohlala eMzantsi Afrika.
I-Blackfoot i-decapsulates traffic kwaye yenza oko kufunekayo ngayo. Idatha ithunyelwa kwi-Intanethi njengoko injalo.
Idatha ikhutshwe kwaye iphinde ifakwe kwi-IPsec xa usebenzisa i-VPN.
Xa usebenzisa uQhagamshelwano oluNgqo, itrafikhi iphawulwa kwaye ithunyelwe kwiVLAN efanelekileyo.
HyperPlane
Le yinkonzo yolawulo lwangaphakathi. Iinkonzo ezininzi zenethiwekhi zifuna ukubekwa esweni idatha yokuhamba ithi. Umzekelo, xa usebenzisa i-NAT, ulawulo lokuqukuqela kufuneka luqinisekise ukuba i-IP nganye:indawo yokufikela ngababini inezibuko eliphumayo elilodwa. Kwimeko yomlinganisi NLB - Network Load Balancer, ukuhamba kwedatha kufuneka kuhlale kubhekiswa kumatshini ofanayo ekujoliswe kuwo. Amaqela oKhuseleko ludonga lomlilo olusemthethweni. Ibeka iliso kwi-traffic engenayo kwaye ivule ngokufihlakeleyo izibuko zokuhamba kwepakethi ephumayo.
Kwilifu le-AWS, iimfuno zokuhanjiswa kwexesha elide ziphezulu kakhulu. Kunjalo ngoba HyperPlane ibaluleke kakhulu ekusebenzeni kwayo yonke inethiwekhi.
IHyperplane yakhiwe koomatshini benyani be-EC2. Akukho mlingo apha, buqhinga kuphela. Iqhinga kukuba ezi oomatshini virtual kunye RAM enkulu. Imisebenzi iyenzeka kwaye yenziwa kwinkumbulo kuphela. Oku kukuvumela ukuba ufezekise ukulibaziseka kwamashumi kuphela ee-microseconds. Ukusebenza ngediski kuya kubulala yonke imveliso.
IHyperplane yinkqubo esasaziweyo enani elikhulu loomatshini beEC2. Umatshini ngamnye wenyani une-bandwidth ye-5 GB / s. Kuyo yonke inethiwekhi yengingqi, oku kubonelela ngeendlela ezimangalisayo ze-bandwidth kwaye ivumela ukusetyenzwa izigidi zonxibelelwano ngomzuzwana.
IHyperPlane isebenza kuphela ngemisinga. Ukufakwa kwepakethe ye-VPC kucace ngokupheleleyo kuyo. Ukuba semngciphekweni okunokubakho kule nkonzo yangaphakathi kuya kuhlala kukuthintela ukwahlukaniswa kweVPC ukuba kwaphulwe. Amanqanaba angezantsi anoxanduva lokhuseleko.
Ummelwane ongxolayo
Kusekho ingxaki ummelwane ongxolayo - ummelwane ongxolayo. Makhe sicinge ukuba sineendawo ezisi-8. Ezi nodi zicubungula ukuhamba kwabo bonke abasebenzisi bamafu. Yonke into ibonakala ilungile kwaye umthwalo kufuneka usasazwe ngokulinganayo kuzo zonke iindawo. IiNodes zinamandla kakhulu kwaye kunzima ukuzilayisha kakhulu.
Kodwa sakha uyilo lwethu ngokusekwe kwiimeko ezingalindelekanga.
Amathuba aphantsi akuthethi ukuba akunakwenzeka.
Sinokucinga ngemeko apho umsebenzisi omnye okanye ngaphezulu angenza umthwalo omninzi kakhulu. Zonke iinodi zeHyperPlane zibandakanyeka ekusebenzeni lo mthwalo kwaye abanye abasebenzisi banokuba namava ohlobo oluthile lomsebenzi. Oku kophula ingqikelelo yelifu, apho abaqeshi bangenakho ukuphembelelana.
Indlela yokusombulula ingxaki yommelwane onomsindo? Into yokuqala ethi qatha engqondweni kukwabelana. Iinodi zethu ezisi-8 zahlulwe ngokwengqiqo zibe zii-4 shards ze-2 nodes nganye. Ngoku ummelwane onomsindo uya kuphazamisa kuphela ikota yabo bonke abasebenzisi, kodwa iya kubaphazamisa kakhulu.
Masenze izinto ngokwahlukileyo. Siya kwabela iindawo ezi-3 kuphela kumsebenzisi ngamnye.
Ubuqhetseba kukubonelela ngokungenamkhethe iinodi kubasebenzisi abahlukeneyo. Kulo mfanekiso ungezantsi, umsebenzisi oluhlaza udibanisa iindawo kunye nomnye wabasebenzisi ababini - eluhlaza kunye ne-orenji.
Ngama-8 nodes kunye nabasebenzisi be-3, amathuba okuba ummelwane onomsindo odibanisa nomnye wabasebenzisi yi-54%. Kungale meko yokuba umsebenzisi oluhlaza uya kuba nefuthe kwabanye abaqashi. Ngelo xesha, inxalenye kuphela yomthwalo wayo. Kumzekelo wethu, le mpembelelo iya kubonakala ngandlela-thile kungekhona kumntu wonke, kodwa kuphela kwisithathu kubo bonke abasebenzisi. Esi sele sisiphumo esihle.
Inani labasebenzisi abazakunqumlana
Okunokwenzeka ngepesenti
0
18%
1
54%
2
26%
3
2%
Masisondeze imeko kwinyani - masithathe ii-nodes ze-100 kunye nabasebenzisi aba-5 kwii-nodes ezi-5. Kule meko, akukho nanye i-nodes iya kunqumla kunye namathuba angama-77%.
Inani labasebenzisi abazakunqumlana
Okunokwenzeka ngepesenti
0
77%
1
21%
2
1,8%
3
0,06%
4
0,0006%
5
0,00000013%
Kwimeko yokwenyani, kunye nenani elikhulu le-HyperPlane node kunye nabasebenzisi, impembelelo enokubakho yommelwane onomsindo kwabanye abasebenzisi incinci. Le ndlela ibizwa ngokuba ukudibanisa ukudibanisa - shuffle sharding. Inciphisa isiphumo esibi sokungaphumeleli kwe-node.
Iinkonzo ezininzi zakhiwe ngesiseko se-HyperPlane: I-Network Load Balancer, i-NAT Gateway, i-Amazon EFS, i-AWS PrivateLink, i-AWS Transit Gateway.
Isikali sothungelwano
Ngoku makhe sithethe ngomlinganiselo wothungelwano ngokwalo. Ngo-Okthobha ka-2019 i-AWS ibonelela ngeenkonzo zayo Imimandla engama-22, yaye ezisi-9 ezingakumbi zicetywayo.
- Ummandla ngamnye uneeNdawo zokuFumana ezininzi. Kukho ama-69 kuwo kwihlabathi jikelele.
- I-AZ nganye inamaziko oCwangciso lweDatha. Akukho ngaphezu kwe-8 kubo bebonke.
- Iziko ledatha ligcina inani elikhulu leeseva, ezinye zifikelela kwi-300.
Ngoku masenze iavareji kuyo yonke le nto, siphindaphindeke kwaye sifumane umfanekiso onomtsalane obonisayo Amazon cloud scale.
Kukho amakhonkco amaninzi okubona phakathi kweeNdawo zokuFumana kunye neziko ledatha. Komnye wemimandla yethu emikhulu, iziteshi ze-388 zibekwe nje kunxibelelwano lwe-AZ phakathi komnye nomnye kunye namaziko onxibelelwano kunye neminye imimandla (Amaziko oThutho). Iyonke le inika crazy 5000 Tbit.
Umqolo we-AWS yakhelwe ngokukodwa kwaye ilungiselelwe ilifu. Siyakha kumajelo 100 GB / s. Sizilawula ngokupheleleyo, ngaphandle kwemimandla yaseTshayina. I-Trafiki ayabelwana nemithwalo yezinye iinkampani.
Ngokuqinisekileyo, ayithina kuphela umboneleli wefu onenethiwekhi yangasese yangasese. Ziya zisanda iinkampani ezinkulu ezilandela le ndlela. Oku kuqinisekiswa ngabaphandi abazimeleyo, umzekelo ukusuka .
Igrafu ibonisa ukuba isabelo sababoneleli bomxholo kunye nababoneleli befu sikhula. Ngenxa yoko, isabelo se-intanethi ye-intanethi yababoneleli be-backbone sihlala sihla.
Ndiza kukuchazela ukuba kutheni le nto isenzeka. Ngaphambili, uninzi lweenkonzo zewebhu bezifikeleleka kwaye zisetyenziswa ngokuthe ngqo kwi-Intanethi. Namhlanje, iiseva ezininzi ngakumbi zibekwe efini kwaye ziyafikeleleka nge CDN - INethiwekhi yoKwabiwa koMxholo. Ukufikelela kwisixhobo, umsebenzisi uya kwi-Intanethi kuphela kwi-CDN PoP ekufutshane - Indawo yoBukho. Amaxesha amaninzi iba kwindawo ekufutshane. Emva koko ishiya i-Intanethi yoluntu kwaye ibhabha nge-backbone yangasese ngaphesheya kweAtlantiki, umzekelo, kwaye ifike ngqo kwisixhobo.
Ndiyazibuza ukuba i-Intanethi iya kutshintsha njani kwiminyaka eyi-10 ukuba lo mkhwa uyaqhubeka?
Imijelo ebonakalayo
Iingcali zenzululwazi azikaqinisi indlela yokunyusa isantya sokukhanya kwi-Universe, kodwa zenze inkqubela phambili enkulu kwiindlela zokuyihambisa nge-fiber optical. Ngoku sisebenzisa iintambo zefayibha ezingama-6912. Oku kunceda ukwandisa kakhulu iindleko zofakelo lwazo.
Kweminye imimandla kufuneka sisebenzise iintambo ezikhethekileyo. Ngokomzekelo, kwingingqi yaseSydney sisebenzisa iintambo ezineengubo ezikhethekileyo ezichasene neentubi.
Akukho mntu ukhuselekile kwiingxaki kwaye ngamanye amaxesha amajelo ethu wonakaliswa. Ifoto esekunene ibonisa iintambo zokukhanya komnye wemimandla yaseMelika ezakrazulwa ngabasebenzi bokwakha. Ngenxa yengozi, iipakethi zedatha ze-13 kuphela zalahleka, okumangalisayo. Kwakhona kwakhona - kuphela 13! Inkqubo ngokoqobo itshintshelwe ngokukhawuleza kwiitshaneli zokugcina - isikali siyasebenza.
Siye sagabadela kwezinye zeenkonzo zamafu kunye nobuchwepheshe beAmazon. Ndiyathemba ukuba ubuncinci unombono wobungakanani bemisebenzi ekufuneka iinjineli zethu ziyisombulule. Mna ngokwam, ndikufumanisa kumnandi kakhulu oku.
Le nxalenye yokugqibela ye-trilogy evela kuVasily Pantyukhin malunga nesixhobo se-AWS. IN iinxalenye zichaza usetyenziso lweseva kunye nokukalwa kwedathabheyisi, kwaye ngaphakathi - imisebenzi engenamncedisi kunye neFirecracker.
phezu ngoNovemba uVasily Pantyukhin uya kubelana ngeenkcukacha ezintsha zesixhobo se-Amazon. Yena malunga nezizathu zokungaphumeleli kunye noyilo lweenkqubo ezisasazwayo e-Amazon. I-24 kaOktobha isenokwenzeka itikiti ngexabiso elihle, kwaye uhlawule kamva. Sikulindile eHighLoad++, yiza size sithethe!
umthombo: www.habr.com