Cube-on-cube, metaclusters, zisa, kugawa kwazinthu

Mpunga. 1. Kubernetes ecosystem pa Alibaba Cloud

Kuyambira 2015, Alibaba Cloud Container Service ya Kubernetes (ACK) yakhala imodzi mwazinthu zomwe zikukula mwachangu ku Alibaba Cloud. Imathandizira makasitomala ambiri komanso imathandizira zomanga zamkati za Alibaba ndi ntchito zina zamtambo zakampani.

Monga momwe zilili ndi zotengera zofananira zochokera kwa omwe amapereka mitambo padziko lonse lapansi, zomwe timakonda kwambiri ndizodalirika komanso kupezeka. Chifukwa chake, nsanja yowopsa komanso yofikirika padziko lonse lapansi yapangidwira masauzande masauzande a magulu a Kubernetes.

M'nkhaniyi, tidzagawana zomwe takumana nazo poyang'anira magulu ambiri a Kubernetes pazipangizo zamtambo, komanso mamangidwe a nsanja yapansi.

kulowa

Kubernetes yakhala muyezo wazinthu zosiyanasiyana zolemetsa pamtambo. Monga momwe tawonetsera mkuyu. 1 pamwambapa, mapulogalamu ochulukirachulukira a Alibaba Cloud tsopano akuyenda pamagulu a Kubernetes: mapulogalamu apamwamba komanso opanda malire, komanso oyang'anira mapulogalamu. Kuwongolera kwa Kubernetes nthawi zonse kwakhala nkhani yosangalatsa komanso yofunikira pazokambirana kwa mainjiniya omwe amamanga ndi kukonza zomangamanga. Zikafika kwa opereka mtambo ngati Alibaba Cloud, nkhani yakukweza imabwera patsogolo. Momwe mungasamalire magulu a Kubernetes pamlingo uwu? Takambirana kale njira zabwino zoyendetsera magulu akuluakulu a Kubernetes 10-node. Inde, ili ndi vuto losangalatsa la makulitsidwe. Koma pali sikelo ina: kuchuluka masango okha.

Takambirana nkhaniyi ndi ogwiritsa ntchito ambiri a ACK. Ambiri aiwo amasankha kuthamanga ambiri, kapena mazana, amagulu ang'onoang'ono kapena apakatikati a Kubernetes. Pali zifukwa zabwino za izi: kuchepetsa kuwonongeka komwe kungachitike, kulekanitsa magulu amagulu osiyanasiyana, kupanga magulu oyesera. Ngati ACK ikufuna kutumikira omvera padziko lonse lapansi ndi chitsanzo chogwiritsira ntchito ichi, iyenera kuyang'anira modalirika komanso moyenera magulu ambiri m'madera oposa 20.

Mpunga. 2. Mavuto oyang'anira kuchuluka kwamagulu a Kubernetes

Kodi zovuta zazikulu zoyendetsera magulu pamlingo uwu ndi ziti? Monga momwe tawonetsera pachithunzichi, pali zinthu zinayi zofunika kuthana nazo:

• Heterogeneity

ACK iyenera kuthandizira magulu osiyanasiyana, kuphatikiza okhazikika, opanda seva, Edge, Windows, ndi ena angapo. Magulu osiyanasiyana amafunikira zosankha zosiyanasiyana, zigawo, ndi mitundu yochitira. Makasitomala ena amafunikira kuthandizidwa ndikusintha kwamilandu yawo.

• Makulidwe osiyanasiyana amagulu

Magulu amasiyana kukula kwake, kuchokera ku mfundo zingapo zokhala ndi makoko pang'ono mpaka makumi masauzande a node okhala ndi makoko masauzande. Zofuna zothandizira zimasiyananso kwambiri. Kugawidwa kolakwika kwa zinthu kumatha kusokoneza magwiridwe antchito kapena kupangitsa kulephera.

• Mabaibulo osiyanasiyana

Kubernetes ikukula mwachangu kwambiri. Mabaibulo atsopano amatulutsidwa miyezi ingapo iliyonse. Makasitomala amakhala okonzeka kuyesa zatsopano. Chifukwa chake akufuna kuyika zoyeserera pamasinthidwe atsopano a Kubernetes ndi katundu wopanga paokhazikika. Kuti akwaniritse izi, ACK iyenera kupereka mitundu yatsopano ya Kubernetes kwa makasitomala ndikusunga zosinthika.

• Kutsata Chitetezo

Magulu amagawidwa kumadera osiyanasiyana. Chifukwa chake, ayenera kutsatira zofunikira zosiyanasiyana zachitetezo ndi malamulo aboma. Mwachitsanzo, gulu ku Europe liyenera kukhala logwirizana ndi GDPR, pomwe mtambo wachuma ku China uyenera kukhala ndi zigawo zina zachitetezo. Zofunikira izi ndizovomerezeka ndipo sizovomerezeka kuzinyalanyaza, chifukwa izi zimapanga chiopsezo chachikulu kwa makasitomala a mtambo.

Pulatifomu ya ACK idapangidwa kuti ithetse mavuto ambiri omwe ali pamwambapa. Pakali pano imayang'anira modalirika komanso mokhazikika magulu opitilira 10 a Kubernetes padziko lonse lapansi. Tiyeni tiwone momwe izi zidakwaniritsidwira, kuphatikiza ndi mfundo zingapo zazikulu zamapangidwe / kamangidwe.

kamangidwe

Cube-on-cube ndi uchi

Mosiyana ndi utsogoleri wapakati, zomangamanga zokhazikitsidwa ndi ma cell nthawi zambiri zimagwiritsidwa ntchito kukulitsa nsanja kupitilira malo amodzi a data kapena kukulitsa kuchuluka kwa kubwezeretsa masoka.

Chigawo chilichonse mu Alibaba Cloud chimakhala ndi madera angapo (AZ) ndipo nthawi zambiri chimafanana ndi malo enaake a data. M'dera lalikulu (monga Huangzhou), nthawi zambiri pamakhala masauzande ambiri amakasitomala a Kubernetes omwe akuyenda ACK.

ACK imayang'anira magulu awa a Kubernetes pogwiritsa ntchito Kubernetes palokha, kutanthauza kuti tili ndi Kubernetes metacluster yomwe ikuyenda kuti tiyang'anire magulu a kasitomala Kubernetes. Zomangamangazi zimatchedwanso "kube-on-kube" (KoK). Zomangamanga za KoK zimathandizira kasamalidwe kamagulu amakasitomala chifukwa kutumiza masango ndikosavuta komanso kotsimikizika. Chofunika kwambiri, titha kugwiritsanso ntchito zida zaku Kubernetes. Mwachitsanzo, kuyang'anira ma seva a API kudzera mu kutumiza, kugwiritsa ntchito etcd woyendetsa kuti ayang'anire angapo etcds. Kubwereza kotere nthawi zonse kumabweretsa chisangalalo chapadera.

Ma metacluster angapo a Kubernetes amayikidwa mkati mwa dera limodzi, kutengera kuchuluka kwa makasitomala. Timatcha ma cell a metacluster. Pofuna kuteteza kulephera kwa chigawo chonse, ACK imathandizira kutumizidwa kwamitundu yambiri m'dera limodzi: metacluster imagawira zigawo zazikulu zamagulu amakasitomala a Kubernetes kudutsa madera angapo ndikuyendetsa nthawi imodzi, ndiko kuti, munjira zambiri. Kuonetsetsa kudalirika ndi kudalirika kwa mbuye, ACK imakonza kuyika kwa zigawo ndikuonetsetsa kuti seva ya API ndi etcd zili pafupi.

Mtunduwu umakupatsani mwayi wowongolera Kubernetes moyenera, mosinthika komanso modalirika.

Kukonzekera kwazinthu za Metacluster

Monga tanenera kale, kuchuluka kwa ma metacluster m'chigawo chilichonse kumadalira kuchuluka kwa makasitomala. Koma ndi liti kuti muwonjezere metacluster yatsopano? Ili ndi vuto lakukonzekera zinthu. Monga lamulo, ndi chizolowezi kupanga chatsopano pamene ma metacluster omwe alipo atha mphamvu zawo zonse.

Tiyeni titenge zopezera maukonde mwachitsanzo. Muzomangamanga za KoK, zigawo za Kubernetes zochokera kumagulu a kasitomala zimayikidwa ngati ma pod mu metacluster. Timagwiritsa ntchito Terway (Mkuyu 3) ndi pulogalamu yowonjezera yopangidwa ndi Alibaba Cloud yoyendetsera kasamalidwe ka chidebe. Imakhala ndi ndondomeko zambiri zachitetezo ndikukulolani kuti mulumikizane ndi makasitomala amtambo wachinsinsi (VPCs) kudzera pa Alibaba Cloud Elastic Networking Interface (ENI). Kuti tigawire bwino zopezeka pa netiweki pama node, ma pod ndi ntchito mu metacluster, tiyenera kuyang'anira momwe zimagwiritsidwira ntchito mumtambo wachinsinsi. Zida za maukonde zikatha, selo yatsopano imapangidwa.

Kuti tidziwe kuchuluka kwamagulu amakasitomala mu metacluster iliyonse, timaganiziranso ndalama zathu, zofunikira za kachulukidwe, kuchuluka kwazinthu, zofunikira zodalirika ndi ziwerengero. Chisankho chopanga metacluster yatsopano chimapangidwa kutengera chidziwitso chonsechi. Chonde dziwani kuti timagulu tating'onoting'ono titha kukula kwambiri m'tsogolomu, chifukwa chake kugwiritsa ntchito zida kumawonjezeka ngakhale kuchuluka kwamagulu sikunasinthe. Nthawi zambiri timasiya malo aulere okwanira kuti gulu lirilonse likule.

Mpunga. 3. Terway network zomangamanga

Kuchulukitsa zigawo za wizard pamagulu a kasitomala

Zida za Wizard zimakhala ndi zofunikira zosiyanasiyana. Iwo amadalira chiwerengero cha nodes ndi pods mu masango, chiwerengero cha olamulira osakhala ovomerezeka / ogwira ntchito omwe amagwirizana ndi APIServer.

Ku ACK, gulu lililonse lamakasitomala a Kubernetes limasiyana ndi kukula komanso nthawi yothamanga. Palibe kasinthidwe kachilengedwe koyika zigawo za wizard. Ngati tiyika molakwika malire otsika kwa kasitomala wamkulu, ndiye kuti gulu lake silingathe kuthana ndi katunduyo. Ngati muyika malire apamwamba kwambiri amagulu onse, zothandizira zidzawonongeka.

Kuti mupeze malonda obisika pakati pa kudalirika ndi mtengo, ACK imagwiritsa ntchito mtundu wamtundu. Mwakutero, timatanthauzira mitundu itatu yamagulu: yaying'ono, yapakatikati ndi yayikulu. Mtundu uliwonse uli ndi mbiri yosiyana yogawa zida. Mtunduwu umatsimikiziridwa potengera kuchuluka kwa zigawo za wizard, kuchuluka kwa node, ndi zina. Mtundu wa masango ukhoza kusintha pakapita nthawi. ACK imayang'anira zinthu izi mosalekeza ndipo imatha kukweza / kutsika moyenerera. Mtundu wa masango ukasinthidwa, kugawa kwazinthu kumasinthidwa zokha ndi kulowererapo kochepa kwa ogwiritsa ntchito.

Tikuyesetsa kukonza makinawa ndi makulitsidwe owoneka bwino komanso kukonzanso mitundu yolondola kwambiri kuti zosinthazi zichitike bwino komanso kuti zikhale zomveka bwino pazachuma.

Mpunga. 4. Wanzeru Mipikisano siteji mtundu kusintha

Kusintha kwa magulu a kasitomala pamlingo

Magawo am'mbuyomu adafotokoza mbali zina zakuwongolera magulu ambiri a Kubernetes. Komabe, pali vuto lina lomwe liyenera kuthetsedwa: kusinthika kwamagulu.

Kubernetes ndiye "Linux" ya dziko lamtambo. Imasinthidwa mosalekeza ndipo imakhala modular. Tiyenera nthawi zonse kupereka mitundu yatsopano kwa makasitomala athu, kukonza zofooka ndikusintha magulu omwe alipo, komanso kuyang'anira kuchuluka kwazinthu zokhudzana ndi izi (CSI, CNI, Plugin Chipangizo, Scheduler Plugin ndi ena ambiri).

Tiyeni titenge kasamalidwe ka gawo la Kubernetes monga chitsanzo. Poyamba, tinapanga dongosolo lapakati lolembetsa ndi kuyang'anira zigawo zonsezi zolumikizidwa.

Mpunga. 5. Zigawo zosinthika ndi pluggable

Musanayambe kupita patsogolo, muyenera kuonetsetsa kuti zosinthazo zidapambana. Kuti tichite izi, tapanga dongosolo lowonera magwiridwe antchito a zigawo. Cheke ikuchitika isanayambe ndi pambuyo pomwe.

Mpunga. 6. Kufufuza koyambirira kwa zigawo zamagulu

Kuti musinthe mwachangu komanso modalirika zigawozi, njira yotumizira mosalekeza imagwira ntchito mothandizidwa ndi kupititsa patsogolo pang'ono (grayscale), kuyimitsa ndi ntchito zina. Olamulira a Standard Kubernetes sali oyenerera pankhaniyi. Choncho, kuti tiyendetse zigawo zamagulu, tapanga gulu la olamulira apadera, kuphatikizapo plugin ndi gawo lothandizira lothandizira (sidecar management).

Mwachitsanzo, wolamulira wa BroadcastJob adapangidwa kuti azisintha zigawo pamakina aliwonse ogwira ntchito kapena kuyang'ana ma node pamakina aliwonse. Ntchito ya Broadcast imayendetsa pod pa node iliyonse pagulu, ngati DaemonSet. Komabe, DaemonSet nthawi zonse imasunga pod ikuyenda kwa nthawi yayitali, pomwe BroadcastJob imayigwetsa. Woyang'anira Broadcast amakhazikitsanso ma pod pamanode omwe angolumikizana kumene ndikuyambitsa ma node ndi zofunikira. Mu June 2019, tidatsegula gwero la injini ya OpenKruise automation, yomwe ife timagwiritsa ntchito mkati mwa kampani.

Mpunga. 7. OpenKurise ikukonzekera kuchitidwa kwa ntchito ya Broadcast pama node onse

Kuti tithandizire makasitomala kusankha masanjidwe oyenera amagulu, timaperekanso mbiri yakale, kuphatikiza mbiri ya Serverless, Edge, Windows, ndi Bare Metal. Pamene malo akuchulukira komanso zosowa zamakasitomala athu zikukula, tidzawonjezera mbiri kuti tichepetse njira yotopetsa yokhazikitsira.

Mpunga. 8. Zapamwamba komanso zosinthika zamagulu amitundu yosiyanasiyana

Kuwoneka kwapadziko lonse m'malo opangira data

Monga tawonera m'munsimu mkuyu. 9, Alibaba Cloud Container ntchito yamtambo yayikidwa m'magawo makumi awiri padziko lonse lapansi. Chifukwa cha kukula uku, chimodzi mwa zolinga zazikulu za ACK ndikuwunika mosavuta momwe masango akuthamangira kuti ngati gulu la kasitomala likukumana ndi vuto, tikhoza kuyankha mwamsanga. Mwa kuyankhula kwina, muyenera kubwera ndi yankho lomwe lingakuthandizeni kuti muthe kusonkhanitsa ziwerengero moyenera komanso mosamala mu nthawi yeniyeni kuchokera kumagulu a makasitomala m'madera onse - ndikuwonetsa zotsatira zake.

Mpunga. 9. Kutumizidwa padziko lonse lapansi kwa Alibaba Cloud Container service m'magawo makumi awiri

Monga machitidwe ambiri owunikira a Kubernetes, timagwiritsa ntchito Prometheus ngati chida chathu chachikulu. Pa metacluster iliyonse, othandizira a Prometheus amatenga ma metric awa:

• Ma metric a OS monga zothandizira (CPU, memory, disk, etc.) ndi network bandwidth.
• Ma metrics a metacluster ndi kasitomala cluster management system, monga kube-apiserver, kube-controller-manager ndi kube-scheduler.
• Metrics kuchokera kubernetes-state-metrics ndi cadvisor.
• etcd ma metric monga disk kulemba nthawi, kukula kwa database, machulukidwe a kulumikizana pakati pa node, ndi zina.

Ziwerengero zapadziko lonse lapansi zimasonkhanitsidwa pogwiritsa ntchito njira yophatikizira magulu ambiri. Dongosolo loyang'anira kuchokera ku metacluster iliyonse limayamba kuphatikizidwa m'chigawo chilichonse kenako ndikutumizidwa ku seva yapakati yomwe ikuwonetsa chithunzi chonse. Chilichonse chimagwira ntchito pogwiritsa ntchito njira ya federal. Seva ya Prometheus pamalo aliwonse a data imasonkhanitsa ma metrics kuchokera ku data center, ndipo seva yapakati ya Prometheus ili ndi udindo wosonkhanitsa deta. AlertManager zikugwirizana ndi chapakati Prometheus ndipo, ngati n'koyenera, amatumiza machenjezo kudzera DingTalk, imelo, SMS, etc. Visualization - ntchito Grafana.

Pa chithunzi 10, njira yowunikira ikhoza kugawidwa m'magulu atatu:

• Mulingo wamalire

Wosanjikiza patali kwambiri ndi pakati. Prometheus Edge Server imayenda mu metacluster iliyonse, kusonkhanitsa ma meta kuchokera kumagulu a meta ndi makasitomala mkati mwa netiweki yomweyo.

• Cascade level

Ntchito ya Prometheus cascade layer ndikusonkhanitsa deta yowunikira kuchokera kumadera angapo. Ma seva awa amagwira ntchito pamlingo wa magawo akuluakulu monga China, Asia, Europe ndi America. Magulu akamakula, chigawochi chikhoza kugawidwa, ndiyeno seva ya Prometheus ya cascade idzawonekera m'chigawo chilichonse chachikulu chatsopano. Ndi njira iyi, mutha kukulitsa bwino ngati pakufunika.

• Gawo lapakati

Seva yapakati ya Prometheus imagwirizanitsa ndi ma seva onse a cascade ndipo imapanga deta yomaliza. Pakudalirika, zochitika ziwiri zapakati za Prometheus zidakwezedwa m'malo osiyanasiyana, olumikizidwa ndi ma seva omwewo.

Mpunga. 10. Zomangamanga zapadziko lonse lapansi zoyang'anira magawo osiyanasiyana zochokera ku Prometheus federation mechanism

Chidule

Mayankho amtambo a Kubernetes akupitilizabe kusintha makampani athu. Ntchito ya Alibaba Cloud imakhala yotetezeka, yodalirika komanso yogwira ntchito kwambiri - ndi imodzi mwazabwino kwambiri za Kubernetes cloud hosting. Gulu la Alibaba Cloud limakhulupirira kwambiri mfundo za Open Source ndi gulu lotseguka. Tidzapitirizabe kugawana nzeru zathu m'munda wogwiritsira ntchito ndi kuyang'anira matekinoloje amtambo.

Source: www.habr.com