Qaphela. transl.: I-Daimation ingenye yezinsizakalo zokubamba amavidiyo ezinkulu kakhulu emhlabeni futhi ngenxa yalokho ingumsebenzisi we-Kubernetes ophawulekayo. Kulesi sihloko, umakhi wesistimu uDavid Donchez wabelana ngemiphumela yokudala inkundla yokukhiqiza yenkampani esekelwe ku-K8s, eyaqala ngokufakwa kwefu ku-GKE futhi yaphela njengesixazululo se-hybrid, esivumela izikhathi zokuphendula ezingcono kanye nokonga izindleko zengqalasizinda.
Ukunquma ukwakha kabusha i-Core API eminyakeni emithathu edlule, besifuna ukuthuthukisa indlela esebenza kahle kakhulu yokusingatha izinhlelo zokusebenza nokwenza kube lula . Ngale njongo, sinqume ukusebenzisa inkundla ye-orchestration yesiqukathi futhi sakhetha ngokwemvelo i-Kubernetes.
Kungani kufaneleka ukwakha inkundla yakho esekelwe ku-Kubernetes?
I-Production-level API ngokushesha kusetshenziswa i-Google Cloud
Ihlobo 2016
Eminyakeni emithathu edlule, ngokushesha ngemuva kokuba i-Dailydie ithengwe ngu , amathimba ethu onjiniyela agxile emgomweni owodwa womhlaba wonke: ukwakha umkhiqizo omusha ngokuphelele we-Daimation.
Ngokusekelwe ekuhlaziyeni kwethu kweziqukathi, izixazululo ze-orchestration, nolwazi lwethu lwangaphambilini, siyaqiniseka ukuthi i-Kubernetes iyisinqumo esifanele. Abanye abathuthukisi base bevele benokuqonda imiqondo eyisisekelo futhi bazi ukuthi isetshenziswa kanjani, okwakuyinzuzo enkulu ekuguqulweni kwengqalasizinda.
Ngokombono wengqalasizinda, kwakudingeka isistimu enamandla futhi eguquguqukayo ukuze isingathe izinhlobo ezintsha zezinhlelo zokusebenza zomdabu wamafu. Sikhethe ukuhlala efwini ekuqaleni kohambo lwethu ukuze sakhe inkundla eqine kakhulu endaweni ngokuthula kwengqondo. Sinqume ukusebenzisa izinhlelo zethu zokusebenza sisebenzisa i-Google Kubernetes Engine, nakuba sasazi ukuthi kungekudala sizothuthela ezikhungweni zethu zedatha futhi sisebenzise isu elixubile.
Kungani ukhethe i-GKE?
Senze lokhu kukhetha ngenxa yezizathu zobuchwepheshe. Ngaphezu kwalokho, bekudingeka ukuthi kuhlinzekwe ngokushesha ingqalasizinda ehlangabezana nezidingo zebhizinisi lenkampani. Sinezidingo ezithile zokusingatha izicelo, ezifana nokusatshalaliswa kwendawo, ukukala nokubekezelela amaphutha.
Amaqoqo e-GKE e- Dailymotion
Njengoba Dailymotion kuyinkundla yevidiyo etholakala emhlabeni wonke, besifuna ngempela ukuthuthukisa ikhwalithi yensizakalo ngokunciphisa isikhathi sokulinda (ukubambezeleka)... Ngaphambilini ibitholakala kuphela eParis, obekungafanelekile. Bengifuna ukukwazi ukusingatha izicelo hhayi eYurophu kuphela, kodwa nase-Asia nase-USA.
Lokhu kuzwela ekubambezelekeni kwakusho ukuthi umsebenzi obalulekile kufanele wenziwe ekwakhiweni kwenethiwekhi yesikhulumi. Nakuba izinsiza eziningi zamafu zikuphoqa ukuthi udale eyakho inethiwekhi esifundeni ngasinye bese uzixhuma nge-VPN noma uhlobo oluthile lwesevisi ephethwe, i-Google Cloud ikuvumele ukuthi udale inethiwekhi eyodwa esebenziseka kalula ehlanganisa zonke izifunda ze-Google. Lokhu kuhlanganisa okukhulu mayelana nokusebenza nokusebenza kahle kwesistimu.
Ngaphezu kwalokho, izinsiza zenethiwekhi nezilinganisi zokulayisha ezivela ku-Google Cloud zenza umsebenzi omuhle kakhulu. Bavele bakuvumela ukuthi usebenzise amakheli e-IP omphakathi angenasizathu avela esifundeni ngasinye, futhi iphrothokholi ye-BGP emangalisayo inakekela konke okusele (okungukuthi, ukuqondisa kabusha abasebenzisi kuqoqo eliseduze). Ngokusobala, uma kwenzeka ukwehluleka, ithrafikhi izoya ngokuzenzakalela kwesinye isifunda ngaphandle kokungenelela komuntu.
Ukwengamela i-Google Load Balancing
Inkundla yethu iphinde isebenzise kakhulu ama-GPU. I-Google Cloud ikuvumela ukuthi uwasebenzise ngempumelelo kakhulu ngqo kumaqoqo e-Kubernetes.
Ngaleso sikhathi, ithimba lengqalasizinda laligxile kakhulu esitakini sefa esisetshenziswe kumaseva aphathekayo. Kungakho ukusebenzisa isevisi ephethwe (okuhlanganisa ochwepheshe be-Kubernetes) kuhlangabezane nezimfuneko zethu futhi kusivumela ukuba siqeqeshe amaqembu ukuze asebenze namaqoqo endawo.
Ngenxa yalokho, sikwazile ukuqala ukuthola ithrafikhi yokukhiqiza engqalasizinda ye-Google Cloud ezinyangeni eziyisi-6 kuphela kuqale umsebenzi.
Kodwa-ke, naphezu kwezinzuzo eziningi, ukusebenza nomhlinzeki wamafu kuhlotshaniswa nezindleko ezithile, ezingakhula kuye ngomthwalo. Kungakho sihlaziye ngokucophelela isevisi ngayinye ephethwe esiyisebenzisile, ngethemba lokuthi sizoyisebenzisa emagcekeni esikhathini esizayo. Eqinisweni, ukuqaliswa kwamaqoqo endawo kwaqala ekupheleni kuka-2016 futhi isu elixubile laqalwa ngesikhathi esifanayo.
Ukwethulwa kwenkundla ye-orchestration yesiqukathi sendawo Dailymotion
Ikwindla 2016
Ezimweni lapho sonke isitaki sesilungele ukukhiqizwa, futhi sisebenze ku-API , kwase kuyisikhathi sokugxila kumaqoqo esifunda.
Ngaleso sikhathi, abasebenzisi bebebuka amavidiyo angaphezu kwezigidigidi ezi-3 njalo ngenyanga. Yebo, sibe nenethiwekhi yethu yokulethwa kokuqukethwe okubanzi iminyaka eminingi. Besifuna ukusizakala ngalesi simo futhi sikhiphe amaqoqo e-Kubernetes ezikhungweni zedatha ezikhona.
Ingqalasizinda ye-Daimation ibihlanganisa amaseva angaphezu kwezinkulungwane ezi-2,5 ezikhungweni zedatha eziyisithupha. Zonke zicushwe kusetshenziswa i-Saltstack. Saqala ukulungiselela zonke izindlela zokupheka ezidingekayo zokudala ama-master node abasebenzi, kanye neqoqo njlld.
Ingxenye yenethiwekhi
Inethiwekhi yethu igudluzwe ngokuphelele. Iseva ngayinye ikhangisa i-IP yayo kunethiwekhi isebenzisa i-Exabgp. Siqhathanise ama-plugin amaningi enethiwekhi futhi okuwukuphela kwawo owanelisa zonke izidingo (ngenxa yendlela ye-L3 esetshenzisiwe) kwaba . Ingena kahle kumodeli yengqalasizinda yenethiwekhi ekhona.
Njengoba besifuna ukusebenzisa zonke izakhi zengqalasizinda ezitholakalayo, into yokuqala obekufanele siyenze kwakuwukuthola insiza yenethiwekhi yekhaya (esetshenziswa kuwo wonke amaseva): siyisebenzisele ukukhangisa ububanzi bamakheli e-IP kunethiwekhi ngamanodi e-Kubernetes. Sivumele u-Calico ukuthi anikeze amakheli e-IP kuma-pods, kodwa asizange futhi asikayisebenziseli izikhathi ze-BGP kumishini yenethiwekhi. Eqinisweni, umzila uphathwa yi-Exabgp, ekhangisa ama-subnet asetshenziswa yi-Calico. Lokhu kusivumela ukuthi sifinyelele noma iyiphi i-pod kusuka kunethiwekhi yangaphakathi (futhi ikakhulukazi kusuka kubalinganisi bomthwalo).
Siyiphatha kanjani ithrafikhi ye-ingress
Ukuze kuqondiswe kabusha izicelo ezingenayo kusevisi oyifunayo, kunqunywe ukusebenzisa i-Ingress Controller ngenxa yokuhlanganiswa kwayo nezinsiza zokungena ze-Kubernetes.
Eminyakeni emithathu edlule, isilawuli se-nginx-ingress-isilawuli esivuthiwe kakhulu: I-Nginx yayinesikhathi eside ikhona futhi yaziwa ngokuzinza nokusebenza kwayo.
Kusistimu yethu, sinqume ukubeka izilawuli kumaseva azinikezele we-10-Gigabit blade. Isilawuli ngasinye besixhunywe ekugcineni kwe-kube-apiserver yeqoqo elihambisanayo. Lezi ziphakeli ziphinde zasebenzisa i-Exabgp ukukhangisa amakheli e-IP omphakathi noma ayimfihlo. I-topology yethu yenethiwekhi isivumela ukuthi sisebenzise i-BGP kusuka kulezi zilawuli ukuhambisa yonke ithrafikhi ngqo kuma-pods ngaphandle kokusebenzisa isevisi efana ne-NodePort. Le ndlela isiza ukugwema ithrafikhi evundlile phakathi kwama-node futhi ithuthukise ukusebenza kahle.
Ukuhamba kwethrafikhi kusuka ku-inthanethi kuya kuma-pods
Manje njengoba sesiyiqonda inkundla yethu eyingxubevange, singangena sijule enqubweni yokuthutha kwethrafikhi ngokwayo.
Ukufuduka kwethrafikhi kusuka ku-Google Cloud kuya kungqalasizinda ye-Daimation
Ikwindla 2018
Ngemva kweminyaka ecishe ibe mibili yokwakha, ukuhlola, nokushuna, ekugcineni sibe nesitaki esigcwele se-Kubernetes esilungele ukwamukela ithrafikhi ethile.
Isu lamanje lomzila lilula, kodwa lanele ukuhlangabezana nezidingo. Ngokungeziwe kuma-IP omphakathi (ku-Google Cloud ne-Dailization), i-AWS Route 53 isetshenziselwa ukusetha izinqubomgomo nokuqondisa kabusha abasebenzisi kuqoqo esilithandayo.
Isibonelo senqubomgomo yomzila usebenzisa Umzila 53
Nge-Google Cloud lokhu kulula njengoba sabelana nge-IP eyodwa kuwo wonke amaqoqo futhi umsebenzisi uqondiswa kabusha kuqoqo eliseduze le-GKE. Kumaqoqo ethu ubuchwepheshe buhlukile, njengoba ama-IP awo ehlukile.
Ngesikhathi sokufuduka, sazama ukuqondisa kabusha izicelo zesifunda kumaqoqo afanelekile futhi sahlola izinzuzo zale ndlela.
Ngenxa yokuthi amaqoqo ethu e-GKE alungiselwe ukukala ngokuzenzakalelayo kusetshenziswa i-Custom Metrics, ayakhuphuka/ehla ngokusekelwe kuthrafikhi engenayo.
Kwimodi evamile, yonke ithrafikhi yesifunda iqondiswe kuqoqo lendawo, futhi i-GKE isebenza njengendawo yokugcina uma kunezinkinga (ukuhlolwa kwezempilo kwenziwa nguMzila 53).
...
Ngokuzayo, sifuna ukwenza ngokuzenzakalelayo ngokugcwele izinqubomgomo zomzila ukuze sizuze isu elihlanganisiwe elizimele eliqhubeka lithuthukisa ukufinyeleleka kwabasebenzisi. Ngakolunye uhlangothi, izindleko zamafu zehliswe kakhulu futhi izikhathi zokuphendula ze-API zehlisiwe. Siyayethemba inkundla yefu ewumphumela futhi silungele ukuqondisa kabusha ithrafikhi eyengeziwe kuyo uma kudingeka.
I-PS evela kumhumushi
Ungase futhi ube nentshisekelo kokunye okuthunyelwe kwakamuva kwe-Dailymotion mayelana ne-Kubernetes. Inikezelwe ekuhanjisweni kwezicelo nge-Helm kumaqoqo amaningi e-Kubernetes kanye cishe inyanga edlule.
Funda futhi kubhulogi yethu:
- Β«".
- Β«";
- Β«";
- Β«";
- Β«";
- Β«";
- Β«";
- Β«";
- Β«";
- Β«";
- Β«".
Source: www.habr.com