Namhlanje ndiceba ukuthetha malunga nendlela yokubhala izicelo kwaye zeziphi iimfuno zesicelo sakho ukuze sisebenze kakuhle eKubernetes. Ukuze kungabikho ntloko ngesicelo, ukuze ungaqali kwaye wakhe nawaphi na "amaqhekeza" ajikeleze kuwo-kwaye yonke into isebenza ngendlela uKubernetes afuna ngayo.
Le ntetho iyinxalenye ye "" Unokujonga iintetho zethiyori ezivulekileyo zeSikolo sangokuhlwa . Kwabo bakhetha umbhalo kunevidiyo, silungiselele eli nqaku.
Igama lam nguPavel Selivanov, okwangoku ndiyinjineli ye-DevOps ehamba phambili kwi-Mail.ru Cloud Solutions, senza "amafu", senza ulawulo lwe-Kubernetes njalo njalo. Imisebenzi yam ngoku ibandakanya uncedo kuphuhliso, ukukhupha la mafu, ukukhupha izicelo esizibhalayo kunye nokuphuhlisa ngokuthe ngqo izixhobo esizibonelela kubasebenzisi bethu.
Ndiye ndenza i-DevOps, ndicinga ukuba okokugqibela, mhlawumbi, iminyaka emithathu. Kodwa, ngokomgaqo, bendisenza into eyenziwa yiDevOps malunga neminyaka emihlanu ngoku. Ngaphambi koko, bendibandakanyeka kakhulu kwizinto zolawulo. Ndaqala ukusebenza noKubernetes kwakudala - mhlawumbi malunga neminyaka emine sele idlulile oko ndaqalisa ukusebenza nayo.
Ngokubanzi, ndaqala xa i-Kubernetes yayiyi-version 1.3, mhlawumbi, kwaye mhlawumbi i-1.2 - xa yayisebuncinaneni bayo. Ngoku ayisekho ebuntwaneni bayo - kwaye kuyacaca ukuba kukho imfuno enkulu kwimarike yeenjineli ezingathanda ukukwazi ukwenza iKubernetes. Kwaye iinkampani zinemfuno ephezulu kakhulu yabantu abanjalo. Ngoko ke, eneneni, le ntetho yavela.
Ukuba sithetha ngokwesicwangciso sento endiza kuthetha ngayo, ikhangeleka ngolu hlobo, kwizibiyeli kubhalwe (TL;DR) - βinde kakhulu; sukufunda". Inkcazo-ntetho yam namhlanje iya kuba nezintlu ezingenasiphelo.
Enyanisweni, mna ngokwam andizithandi iintetho ezinjalo xa zenziwe, kodwa lo ngumxholo othi xa ndilungiselela le ntetho, andizange ndiqonde indlela yokulungelelanisa olu lwazi ngokwahlukileyo.
Ngokuba, ngokubanzi, olu lwazi luyi "ctrl+c, ctrl+v", phakathi kwezinye izinto, iWiki yethu kwicandelo le-DevOps, apho sibhale iimfuno zabaphuhlisi: "bafana, ukuze siqalise isicelo sakho Kubernetes, kufanele kube nje. β
Yiyo loo nto unikezelo lwajika lwaba luluhlu olukhulu. Uxolo. Ndizakuzama ukuxelela kangangoko ndinako ukuze kungakruquki ukuba kuyenzeka.
Siza kujonga ntoni ngoku:
- ezi, okokuqala, zikhuni (iilogi zesicelo?), Yintoni enokuyenza ngayo kwi-Kubernetes, into enokuyenza ngayo, into ekufuneka ibe yiyo;
- ukuba wenze ntoni ngolungelelwaniso kwi-Kubernetes, zeziphi ezona ndlela zilungileyo nezimbi kakhulu zokuqwalasela isicelo se-Kubernetes;
- Makhe sithethe malunga nokuba zithini iitshekhi zokufikeleleka ngokubanzi, ukuba kufuneka zibukeke njani;
- masithethe malunga nokuba yintoni ukuvalwa okuthandekayo;
- masithethe ngezibonelelo kwakhona;
- Makhe sichukumise isihloko sogcino lwedatha kwakhona;
- kwaye ekugqibeleni ndiza kukuxelela ukuba leliphi igama elisetyenziswayo elilifu elingaziwayo. Ubungqingqwa bamafu, njengesichazi seli gama.
Izigodo
Ndicebisa ukuqala ngezigodo- apho ezi zigodo kufuneka zityholwe eKubernetes. Ngoku uqalise isicelo kwi-Kubernetes. Ngokweeklasikhi, izicelo zangaphambili zihlala zibhala iilogi kwindawo ethile kwifayile. Usetyenziso olubi lubhale iilog kwifayile kulawulo lwasekhaya lomphuhlisi oqalise isicelo. Izicelo ezilungileyo zibhale iilog kwifayile kwindawo ethile /var/log.
Ngokunjalo, ngokubhekele phaya, abalawuli abalungileyo babenezinto ezithile ezicwangcisiweyo kwiziseko zabo ezinokuthi ezi zikhuni zikwazi ukujikeleza - i-rsyslog efanayo, ejonga ezi zigodo kwaye xa kukho into eyenzekayo kubo, zininzi zazo, idala iikopi zokugcina, ibeka iilog apho. , isusa iifayile ezindala, ngaphezu kweveki, iinyanga ezintandathu kunye nezinye. Kwithiyori, kufuneka sibe namalungiselelo ukwenzela ukuba ngenxa yokuba isicelo sibhala iilogi, indawo kwiiseva zokuvelisa (iiseva zokulwa?) Ayipheli. Kwaye, ngokufanelekileyo, yonke imveliso ayizange ime ngenxa yezigodo.
Xa sifudukela kwihlabathi le-Kubernetes kwaye siqhuba into efanayo apho, into yokuqala onokuyihlawula ingqalelo kukuba abantu, njengoko bebhala iilogi kwifayile, baqhubeka bebhala.
Kuyavela ukuba ukuba sithetha nge-Kubernetes, indawo efanelekileyo yokubhala iilogi kwindawo ethile ukusuka kwisitya se-docker kukubhala nje ukusuka kwisicelo ukuya kwinto ebizwa ngokuba yi-Stdout / Stderr, oko kukuthi, imijelo ephumayo yenkqubo yokusebenza, isiphumo semposiso eqhelekileyo . Le yeyona ndlela ichanekileyo, ilula kwaye inengqiqo yokubeka izingodo kumgaqo kwiDocker kwaye ngokukodwa eKubernetis. Kuba ukuba isicelo sakho sibhala iilogi kwi-Stdout / Stderr, ngoko kuya kwi-Docker kunye ne-Kubernetes yokongeza ukuba uthathe isigqibo sokuba wenze ntoni ngezi zigodo. I-Docker iya kwakha ngokungagqibekanga iifayile zayo ezikhethekileyo kwifomathi ye-JSON.
Nanku umbuzo ophakamayo, uza kwenza ntoni ngokulandelayo ngezi zigodo? Eyona ndlela ilula icacile, sinamandla okwenza kubectl logs kwaye ujonge ezi zigodo zezi "pods". Kodwa, mhlawumbi, oku ayisiyondlela ilungileyo kakhulu - enye into ekufuneka yenziwe ngeelog.
Okwangoku, makhe sithethe ngexesha elifanayo, ekubeni sithintele kwisihloko sezigodo, malunga nento efana nezigodo kufuneka zibukeke. Okokuthi, oku akusebenzi ngokuthe ngqo kwi-Kubernetes, kodwa xa siqala ukucinga malunga nokuba senze ntoni ngezigodo, kuya kuba kuhle ukucinga ngale nto.
Sidinga uhlobo oluthile lwesixhobo, ngendlela enobubele, eya kuthatha ezi zigodo ezifakwa kwi-docker yethu kwiifayile zayo kwaye zizithumele kwenye indawo. Ngokubanzi, sihlala sisungula uhlobo oluthile lwearhente ngaphakathi Kubernetes ngendlela yeDaemonSet - umqokeleli welog, exelelwa ngokulula apho iilog eziqokelelwa nguDocker zibekwe phi. Kwaye le arhente iqokelelayo izithatha ngokulula, mhlawumbi ide izicazulule endleleni, mhlawumbi izityebise ngolwazi lwemeta olongezelelweyo kwaye, ekugqibeleni, izithumela kwindawo ethile ukuze zigcinwe. Ukwahluka sele kusenzeka apho. Eyona nto ixhaphakileyo yi-Elasticsearch, apho unokugcina khona iilog kwaye unokuzifumana ngokulula ukusuka apho. Emva koko, usebenzisa isicelo, usebenzisa i-Kibana, umzekelo, yakha iigrafu ezisekelwe kuzo, zakha izilumkiso ezisekelwe kuzo, njalo njalo.
Olona luvo lubalulekileyo, ndifuna ukuyiphinda kwakhona, kukuba ngaphakathi kweDocker, ngakumbi ngaphakathi kweKubernetes, ukugcina izingodo zakho kwifayile ngumbono ombi kakhulu.
Kuba okokuqala, kunzima ukufumana iilog ngaphakathi kwesikhongozeli kwifayile. Kuya kufuneka uqale ungene kwisitya, wenze apho, emva koko ujonge iinkuni. Inqaku elilandelayo kukuba ukuba unamalogi kwifayile, ke izikhongozeli zihlala zinendawo encinci kwaye akukho zixhobo eziqhelekileyo ezifunekayo kumsebenzi oqhelekileyo kunye nezigodo. Zingcwabe, zijonge, zivule kumhleli wombhalo. Umzuzu olandelayo xa sinezigodo kwifayile ngaphakathi kwesitya, ukuba le nto isusiwe, uyaqonda, izigodo ziya kufa kunye nayo. Ngokufanelekileyo, nakuphi na ukuqalisa kwakhona kwesingxobo kuthetha ukuba akusekho zigodo. Kwakhona, ukhetho olubi.
Kwaye inqaku lokugqibela lelokuba ngaphakathi kwizikhongozeli uqhele ukuba nesicelo sakho kwaye yiyo loo nto-idla ngokuba yeyona nkqubo isebenzayo. Akukho ntetho konke konke malunga nayo nayiphi na inkqubo enokujikelezisa iifayile ngeelog zakho. Ngokukhawuleza ukuba iilogi ziqala ukubhalwa kwifayile, oku kuthetha ukuba, ndixolele, siya kuqala ukulahlekelwa ngumncedisi wokuvelisa. Kuba, okokuqala, kunzima ukuzifumana, akukho mntu ubalandelayo, kwaye akukho mntu ubalawulayo - ngokufanelekileyo, ifayile ikhula ngokungenasiphelo de indawo kumncedisi iphele. Ke ngoko, nditsho kwakhona ukuba ukungena kwiDocker, ngakumbi eKubernetes, kwifayile luluvo olubi.
Inqaku elilandelayo, apha ndifuna ukuthetha ngale nto kwakhona - ekubeni sichukumisa isihloko sezigodo, kuya kuba kuhle ukuthetha malunga nendlela iilogi kufuneka zijonge ngayo ukuze kube lula ukusebenza nazo. Njengoko benditshilo, isihloko asihambelani ngokuthe ngqo neKubernetes, kodwa sihambelana kakuhle nesihloko seDevOps. Kwisihloko sophuhliso lwenkcubeko kunye nobuhlobo phakathi kwala masebe mabini ahlukeneyo - i-Dev kunye ne-Ops, ukuze wonke umntu akhululeke.
Oku kuthetha ukuba ngokufanelekileyo, namhlanje, iilogi kufuneka zibhalwe ngefomathi ye-JSON. Ukuba unesicelo esingaqondakaliyo sakho, esibhala iilogi kwiifomathi ezingaqondakaliyo ngenxa yokuba ufaka uhlobo oluthile lokushicilela okanye into enjalo, ngoko lixesha lokukhangela uhlobo oluthile lwesakhelo se-google, uhlobo oluthile lwe-wrapper evumela ukuba uphumeze ukugawulwa kwesiqhelo; yenza iiparamitha zokuloga kwi-JSON phaya, kuba i-JSON yifomati elula, ukuyicazulula kulula.
Ukuba i-JSON yakho ayisebenzi ngokwemigaqo ethile, akukho mntu waziyo ukuba yintoni na, ngoko ubuncinane bhala iilog kwifomathi enokwahlulwa. Apha, endaweni yoko, kufanelekile ukucinga malunga nenyaniso yokuba, umzekelo, ukuba usebenzisa iqela lezikhongozeli okanye iinkqubo nje nge nginx, kwaye nganye ineseto zayo zokugawulwa kwemithi, ngoko kubonakala ngathi kuya kuba nzima kakhulu kuwe. zicazulule. Kuba kumzekelo omtsha wenginx kufuneka ubhale eyakho isahluli, kuba babhala iilog ngokwahlukileyo. Kwakhona, bekufanelekile ukucinga malunga nokuqinisekisa ukuba zonke ezi ziganeko ze-nginx zinesimo esifanayo sokugawulwa kwemithi, kwaye babhala zonke iilog zabo ngokupheleleyo ngokufanayo. Kukwasebenza okufanayo kuzo zonke izicelo.
Ekugqibeleni, ndifuna ukongeza amafutha emlilweni, ngokufanelekileyo, iifomathi zefomathi ezininzi kufuneka ziphetshwe. Nantsi into, ukuba uke wasebenza kunye nabaqokeleli belog, ngoko kunokwenzeka ukuba ubonile oko bakuthembisayo, ukuba banokusebenza kunye neelog zemigca emininzi, bazi ukuba baqokelele njani, njalo njalo. Enyanisweni, ngokombono wam, akukho mqokeleli omnye namhlanje unokuqokelela iilogi zemigca emininzi ngokuqhelekileyo, ngokupheleleyo kwaye ngaphandle kwamaphutha. Ngendlela yomntu, ukuze kube lula kwaye kungabi nampazamo.
Kodwa umkhondo wesitaki uhlala ungowoluhlu lwemigca emininzi kunye nendlela yokuziphepha. Umbuzo apha kukuba ilogi yirekhodi yomsitho, kwaye i-stactrace ayisiyologi. Ukuba siqokelela iinkuni kwaye sizibeke ndaweni ithile kwi-Elasticsearch kwaye emva koko sizobe iigrafu kuzo, sakhe ezinye iingxelo zomsebenzisi kwindawo yakho, emva koko xa ufumana umkhondo wesitaki, oko kuthetha ukuba kukho into ebingalindelekanga eyenzekayo kwisicelo sakho. Kwaye kunengqiqo ukulayisha ngokuzenzekelayo umkhondo we-stack kwindawo ethile kwinkqubo enokubalandela.
Le yisoftware (iSentry efanayo) eyenzelwe ngokukodwa ukusebenza ngomkhondo wesitaki. Inokwenza ngokukhawuleza imisebenzi ezenzekelayo, ibanike umntu othile, isilumkiso xa i-stacttraces isenzeka, iqela lezi stacttraces ngohlobo olunye, njalo njalo. Ngokomgaqo, akunangqiqo ukuthetha malunga ne-stactraces xa sithetha ngeelogi, kuba ezi zinto, emva koko, zizinto ezahlukeneyo ezineenjongo ezahlukeneyo.
Isimo
Okulandelayo sithetha ngoqwalaselo kwi-Kubernetes: ukwenza ntoni ngayo kunye nendlela izicelo ezingaphakathi kwe-Kubernetes kufuneka ziqwalaselwe. Ngokubanzi, ndihlala ndisithi iDocker ayikho malunga nezikhongozeli. Wonke umntu uyazi ukuba iDocker imalunga nezikhongozeli, kwanabo bangakhange basebenze noDocker kakhulu. Ndiyaphinda, iDocker ayithethi malunga nezikhongozeli.
I-Docker, ngokombono wam, imalunga nemigangatho. Kwaye kukho imigangatho kuyo yonke into: imigangatho yokwakha isicelo sakho, imigangatho yokufaka isicelo sakho.
Kwaye le nto - besiyisebenzisa ngaphambili, iye yaduma ngakumbi ngokufika kwezikhongozeli - le nto ibizwa ngokuba yi-ENV (imo engqongileyo) izinto eziguquguqukayo, oko kukuthi, izinto eziguquguqukayo zemo engqongileyo ezikwinkqubo yakho yokusebenza. Ngokuqhelekileyo oku kuyindlela efanelekileyo yokuqwalasela isicelo sakho, kuba ukuba unezicelo kwi-JAVA, i-Python, i-Hamba, i-Perl, uThixo akavumeli, kwaye bonke banokufunda i-database host host, umsebenzisi wedatha, ii-password variables, ngoko ilungile. Unezicelo kwiilwimi ezine ezahlukeneyo ezilungiselelwe kwisicwangciso sedatha ngendlela efanayo. Azisekho iindlela ezahlukeneyo zokujonga.
Yonke into inokuqwalaselwa kusetyenziswa iinguqu ze-ENV. Xa sithetha ngeKubernetes, kukho indlela entle yokubhengeza izinto eziguquguqukayo ze-ENV kanye ngaphakathi kokusasazwa. Ngokufanelekileyo, ukuba sithetha ngedatha eyimfihlo, ngoko sinokutyhala ngokukhawuleza idatha eyimfihlo ukusuka kwii-variables ze-ENV (i-passwords kwi-database, njl. njl.) ibe yimfihlo, yenza iqoqo eliyimfihlo kwaye ubonise kwinkcazo ye-ENV kwi-Deployment ukuba asiyikuvakalisa ngokuthe ngqo. ixabiso lalo mahluko, kunye nexabiso lalo tshintsho lwegama lokugqitha liza kufundwa kwimfihlo. Oku kukuziphatha okusemgangathweni kwe-Kubernetes. Kwaye olu lolona khetho lufanelekileyo lokuqwalasela izicelo zakho. Kanye kwinqanaba lekhowudi, kwakhona oku kusebenza kubaphuhlisi. Ukuba uyi-DevOps, unokubuza: βBafo, nceda ufundise isicelo sakho ukufunda izinto eziguquguqukayo zokusingqongileyo. Kwaye sonke siya konwaba."
Ukuba wonke umntu enkampanini ufunda izinto ezifanayo ezibizwa ngegama lendalo, oko kulungile. Ukuze kungenzeki ukuba abanye balinde i-database ye-postgres, abanye balinde igama ledatha, abanye balindele enye into, abanye balindele i-dbn yolunye uhlobo, ukwenzela ukuba, ngokufanelekileyo, kukho ukufana.
Ingxaki iza xa uneenguqu ezininzi zemo engqongileyo kangangokuba uvule nje ukusasazwa- kwaye kukho amakhulu amahlanu emigca yokuguquguquka kokusingqongileyo. Kule meko, unezinto eziguquguqukayo zokusingqongileyo - kwaye akusekho mfuneko yokuba uzithuthumbise. Kule meko, kuya kuba nengqiqo ukuqala ukusebenzisa i-configs. Oko kukuthi, qeqesha isicelo sakho ukuba sisebenzise uqwalaselo.
Umbuzo kuphela kukuba uqwalaselo ayisiyiyo le uyicingayo. Config.pi ayilolungiselelo olulungele ukusetyenziswa. Okanye uqwalaselo oluthile kwifomathi yakho, ngenye indlela enesiphiwo - oku ayisiyiyo uqwalaselo endithetha ngalo.
Le nto ndithetha ngayo lulungelelwaniso kwiifomati ezamkelekileyo, oko kukuthi, ngowona mgangatho udumileyo ngumgangatho we.yaml. Icacile indlela yokuyifunda, iyafundeka ngabantu, icacile indlela yokuyifunda kwisicelo.
Ngokufanelekileyo, ukongeza kwi-YAML, usenokuthi, umzekelo, usebenzise i-JSON, ukwahlulahlula kumalunga ne-YAML malunga nokufunda uqwalaselo lwesicelo ukusuka apho. Kuyaphawuleka ukuba kunzima ngakumbi ukuba abantu bafunde. Ungazama ifomathi, a la ini. Kukulungele ukufunda, ngokwembono yabantu, kodwa kunokuba nzima ukuyiqhuba ngokuzenzekelayo, ngengqiqo yokuba ukuba ufuna ukuvelisa eyakho imimiselo, ifomathi ye-ini isenokuba sele iphazamisekile ukuyivelisa.
Kodwa kuyo nayiphi na imeko, nayiphi na ifomathi oyikhethayo, ingongoma kukuba ukusuka kwindawo yokujonga i-Kubernetes ilunge kakhulu. Ungabeka lonke uqwalaselo lwakho ngaphakathi Kubernetes, kwiConfigMap. Kwaye emva koko thatha le configmap kwaye uyicele ukuba inyuswe ngaphakathi kwipod yakho kulawulo oluthile, apho isicelo sakho sizakufunda uqwalaselo kule configmap ngokungathi yifayile nje. Oku, enyanisweni, yinto elungileyo ukuyenza xa unokhetho oluninzi loqwalaselo kwisicelo sakho. Okanye luhlobo nje lolwakhiwo oluntsonkothileyo, kukho indlwane.
Ukuba une configmap, ngoko ungafundisa kakuhle isicelo sakho, umzekelo, ukulandelela ngokuzenzekelayo utshintsho kwifayile apho uqwalaselo lunyuswe khona, kwaye ulayishe kwakhona ngokuzenzekelayo isicelo sakho xa utshintsho lutshintsha. Oku kuya kuba yinto efanelekileyo ngokubanzi.
Kwakhona, sele ndithethile ngale nto - ulwazi oluyimfihlo alukho kwi-configmap, ulwazi oluyimfihlo alukho kwizinto eziguquguqukayo, ulwazi oluyimfihlo alukho kwiimfihlo. Ukusuka apho, qhagamshela olu lwazi luyimfihlo kwidiplomacy. Ngokuqhelekileyo sigcina zonke iinkcazo zezinto ze-Kubernetes, i-deployments, i-configmaps, iinkonzo kwi-git. Ngokufanelekileyo, ukubeka igama eliyimfihlo kwi-database kwi-git, nokuba yi-git yakho, onayo ngaphakathi kwinkampani, ngumbono ombi. Kuba, ubuncinci, i-git ikhumbula yonke into kwaye ukususa amagama ayimfihlo apho akukho lula.
Ukujonga impilo
Inqaku elilandelayo yile nto kuthiwa yiHealth check. Ngokubanzi, ukujonga impilo kukutshekishwa nje ukuba isicelo sakho siyasebenza. Kwangaxeshanye, sihlala sithetha ngezicelo ezithile zewebhu, ezithi, ngokufanelekileyo, ukusuka kwindawo yokujonga impilo (kungcono ukuba ungaguquleli apha nangaphezulu) le iya kuba yi-URL ekhethekileyo, abayenzayo njenge. umgangatho, badla ngokwenza /health.
Xa ufikelela kule URL, ngokufanelekileyo, isicelo sethu sithi "ewe, kulungile, yonke into ilungile kum, 200" okanye "hayi, yonke into ayilungile kum, malunga nama-500." Ngokufanelekileyo, ukuba isicelo sethu asiyiyo i-http, ayisiyosicelo sewebhu, ngoku sithetha ngolunye uhlobo lwe-daemon, sinokufumanisa ukuba singenza njani ukuhlolwa kwezempilo. Okokuthi, akuyimfuneko, ukuba isicelo asikho i-http, ngoko yonke into isebenza ngaphandle kokujonga impilo kwaye oku akunakwenziwa nangayiphi na indlela. Ungaphinda uhlaziye ulwazi oluthile kwifayile, unokuza nomyalelo okhethekileyo wedaemon yakho, njenge, daemon status, eya kuthi "ewe, yonke into ilungile, i-daemon iyasebenza, iyaphila."
Yenzelwe ntoni? Into yokuqala kunye neyona nto icacileyo mhlawumbi kutheni kufuneka ukuhlolwa kwezempilo - ukuqonda ukuba isicelo siyasebenza. Ndithetha ukuthi, bubudenge nje, xa iphezulu ngoku, ibonakala ngathi iyasebenza, ukuze uqiniseke ukuba iyasebenza. Kwaye kuvela ukuba isicelo siyasebenza, isitya siyasebenza, umzekelo uyasebenza, yonke into ilungile - kwaye ke abasebenzisi sele benqumle zonke iinombolo zefowuni kwinkxaso yobugcisa kwaye bathi "uyintoni ..., wena ndalala, akukho nto isebenzayo."
Ukujonga impilo yindlela nje yokubona ngokwembono yomsebenzisi ukuba iyasebenza. Enye yeendlela. Masiyibeke ngolu hlobo. Ukususela kumbono we-Kubernetes, oku kuyindlela yokuqonda xa isicelo siqala, kuba siyaqonda ukuba kukho umehluko phakathi kwexesha lokusungulwa kwesitya, senziwe kwaye saqalwa, kwaye xa isicelo saqaliswa ngokuthe ngqo kule ngqungquthela. Kuba ukuba sithatha i-avareji yesicelo se-java kwaye sizame ukuyisungula kwindawo yokubeka, emva koko imizuzwana engamashumi amane, okanye umzuzu, okanye ishumi, inokuqala kakuhle. Kule meko, unokunkqonkqoza ubuncinane kumachweba ayo, akayi kuphendula apho, oko kukuthi, akukakulungeli ukufumana i-traffic.
Kwakhona, ngoncedo lokujonga impilo kwaye ngoncedo lokuba sijika apha, sinokuqonda kwi-Kubernetes ukuba akusiyo kuphela isitya esiye savuka kwisicelo, kodwa isicelo ngokwaso siqalile, sele siphendula ukuhlola impilo, okuthetha ukuba sinokuthumela itrafikhi apho.
Le nto ndithetha ngayo ngoku ibizwa ngokuba ziimvavanyo zokuLungela/Ukuphila ngaphakathi Kubernetes; ngokufanelekileyo, uvavanyo lwethu lokulungela lunoxanduva lokufumaneka kwesicelo ekulinganiseni. Oko kukuthi, ukuba uvavanyo lokulungela luyenziwa kwisicelo, ngoko yonke into ilungile, i-traffic traffic iya kwisicelo. Ukuba iimvavanyo zokulungela azenziwanga, ngoko isicelo asithathi nxaxheba, lo mzekelo awuthathi nxaxheba ekulinganiseni, uyasuswa ekulinganiseni, i-traffic traffic ayihambi. Ngokufanelekileyo, iimvavanyo ze-Liveness ngaphakathi kwe-Kubernetes ziyafuneka ukuze ukuba isicelo sibambekile, sinokuphinda siqalwe. Ukuba uvavanyo lokuphila alusebenzi kwisicelo esichazwe kwi-Kubernetes, ngoko ke isicelo asisuswanga nje ekulinganiseni, siqaliswa kwakhona.
Kwaye nantsi ingongoma ebalulekileyo endifuna ukuyikhankanya: ukusuka kwindawo ebonakalayo, uvavanyo lokulungela ludla ngokusetyenziswa rhoqo kwaye lufuneka kakhulu kunovavanyo lokuphila. Oko kukuthi, ukubhengeza ngokulula ukulungela kunye novavanyo lokuphila, kuba uKubernetes angayenza loo nto, kwaye masisebenzise yonke into enokuyenza, ayingombono ulunge kakhulu. Ndiza kucacisa ukuba kutheni. Ngenxa yokuba inqaku lesibini kuvavanyo kukuba iya kuba licebo elilungileyo ukujonga inkonzo esisiseko kuhlolo lwempilo yakho. Oku kuthetha ukuba ukuba unesicelo sewebhu esinika ulwazi oluthile, oluthi ke lona, ββngokwendalo, luthathe kwindawo ethile. Kwisiseko sedatha, umzekelo. Ewe, igcina ulwazi oluza kule REST API kwisiseko sedatha enye. Ke, ngokufanelekileyo, ukuba i-healthcheck yakho iphendula nje ngokuqhagamshelwana ne-slashhealth, isicelo sithi "200, kulungile, yonke into ilungile," kwaye kwangaxeshanye indawo egciniweyo yesicelo sakho ayifumaneki, kwaye isicelo sezempilo sithi "200, kulungile, yonke into ilungile. β- Olu lujongo olubi lwempilo. Le ayisiyiyo indlela ekumele isebenze ngayo.
Oko kukuthi, isicelo sakho, xa isicelo sifika kuso /health, ayiphenduli nje, β200, okβ, iqala iya, umzekelo, kwisiseko sedatha, izama ukuqhagamshela kuyo, yenza into esisiseko kakhulu apho, njengokukhetha enye, ijonga nje ukuba kukho unxibelelwano kwi ugcino lwedatha kwaye ungabuza kwisiseko sedatha. Ukuba konke oku kuphumelele, impendulo ithi "200, ok." Ukuba ayiphumelelanga, ithi kukho impazamo, i-database ayifumaneki.
Ke ngoko, kulo mba, ndibuyela kwakhona kuvavanyo lokuLungela/Ukuphila - kutheni ufuna uvavanyo lokulungela, kodwa uvavanyo lokuphila lusabuza. Kuba ukuba uchaza iitshekhi zezempilo kanye njengoko benditshilo, kuya kuvela ukuba ayifumaneki kwicandelo lomzekeloΠ² ΠΈΠ»ΠΈ ΡΠΎ Π²ΡΠ΅Ρ
instancekwisiseko sedatha, umzekelo. Xa ubhengeza uvavanyo lokulungela, impilo yethu yaqala ukungaphumeleli, kwaye ngokufanelekileyo zonke izicelo apho uvimba wedatha ungafikeleleki, zicinywa ngokulula kwi-balance kwaye enyanisweni "zixhoma" kwimeko yokungahoywa kwaye zilinda ugcino lwazo. umsebenzi.
Ukuba sibhengeze uvavanyo lokuphila, ke khawufane ucinge, uvimba wethu wogcino-lwazi wophukile, kwaye kwi-Kubernetes yakho isiqingatha sayo yonke into iqala ukuqalisa kwakhona kuba uvavanyo lwe-liveness aluphumeleli. Oku kuthetha ukuba kufuneka uqalise kwakhona. Ayisiyiyo yonke le nto uyifunayo, ndinamava obuqu ekusebenzeni. Sasinesicelo sokuxoxa esasibhalwe kwi-JS kwaye sondliwa kwi-database ye-Mongo. Kwaye ingxaki yayikukuba ekuqaleni komsebenzi wam kunye noKubernetes, sachaza ukulungela, ukuphila kweemvavanyo kumgaqo wokuba uKubernetes angayenza, ngoko siya kuyisebenzisa. Ngokufanelekileyo, ngaxa lithile iMongo yaba "yincinci" encinci kwaye isampuli yaqala ukusilela. Ngako oko, ngokovavanyo lwemvula, iipods zaqala "ukubulala".
Njengoko uqonda, xa "babulawa", le yingxoxo, oko kukuthi, kukho uxhulumaniso oluninzi oluvela kubaxhasi abaxhomekeke kuyo. Kwakhona "babulawa" - hayi, hayi abathengi, kuphela unxibelelwano - hayi bonke ngaxeshanye, kwaye ngenxa yokuba ababulawanga ngaxeshanye, abanye ngaphambili, abanye kamva, abaqali ngokufanayo. ixesha. Kunye nomgangatho oqhelekileyo, asinakukwazi ukuqikelela ngokuchaneka kwe-millisecond ixesha lokuqala kwesicelo ngexesha ngalinye, ngoko bayenza umzekelo omnye ngexesha. Enye i-infospot iphakama, yongezwa kwi-bancing, bonke abathengi beza apho, abanako ukumelana nomthwalo onjalo, kuba iyodwa, kwaye, ngokuthetha, kukho ishumi elinesibini elisebenza apho, kwaye liyawa. Olandelayo uyaphakama, wonke umthwalo uphezu kwakhe, naye uyawa. Kulungile, ezi ngxangxasi ziqhubeleka nokuhla. Ekugqibeleni, ukuba oku kwasonjululwa njani - kuye kwafuneka ukuba simise ngokungqongqo i-traffic yabasebenzisi kwesi sicelo, zonke iimeko ziphakame kwaye emva koko siqalise zonke i-traffic yabasebenzisi ngaxeshanye ukuze sele isasazwe kuzo zonke iimeko ezilishumi.
Ukuba bekungelulo olu vavanyo lwempilo lubhengezwe, olunokuthi lunyanzelise ukuba luqale ngokutsha, isicelo ngesisisingathe kakuhle. Kodwa yonke into esuka ekulinganiseni ikhutshaziwe kuthi, kuba i-database ayifumaneki kwaye bonke abasebenzisi "bawile". Emva koko, xa le datha ifumaneka, yonke into ifakwe ekulinganiseni, kodwa izicelo akufuneki ziqale kwakhona, kwaye akukho mfuneko yokuchitha ixesha kunye nezixhobo kule nto. Bonke sele belapha, balungele ukugcwala, ke itrafikhi ivula nje, yonke into ilungile - isicelo sisendaweni, yonke into iyaqhubeka nokusebenza.
Ke ngoko, ukulungela kunye neemvavanyo zokuphila zahlukile, nangaphezulu, unokwenza ngokwethiyori iishekethi ezahlukeneyo zempilo, uhlobo olunye lweradii, uhlobo olunye lwe-liv, umzekelo, kwaye ujonge izinto ezahlukeneyo. Ngexesha lovavanyo lokulungela, jonga ii-backends zakho. Kwaye kuvavanyo lokuphila, umzekelo, awukhangeli ukusuka kwinqanaba lokujonga ukuba uvavanyo lokuphila luyisicelo nje esiphendulayo, ukuba luyakwazi ukuphendula konke.
Kuba uvavanyo lokuphila, ngokubanzi, kuxa "sibambekile." I-loop engapheliyo iqalile okanye enye into - kwaye akukho zicelo zisetyenzwayo. Ke ngoko, kuyavakala ukuba bahlukane - kwaye basebenzise ingqiqo eyahlukileyo kubo.
Ngokumalunga nento ekufuneka uyiphendule xa usenza uvavanyo, xa ujonga impilo. Yintlungu nje ngenene. Abo baqheleneyo nale nto baya kuhleka - kodwa ngokunyanisekileyo, ndibone iinkonzo ebomini bam eziphendula "200" kwi-XNUMX% yamatyala. Oko kukuthi, ngubani ophumeleleyo. Kodwa kwangaxeshanye emzimbeni wempendulo babhala "impazamo enjalo nenje."
Oko kukuthi, isimo sokuphendula siza kuwe - yonke into iphumelele. Kodwa kwangaxeshanye, kufuneka ucazulule umzimba, kuba umzimba uthi "uxolo, isicelo siphelile ngempazamo" kwaye oku kuyinyani. Ndayibona le nto ebomini.
Kwaye ukuze abanye abantu bangayifumani into ehlekisayo, kwaye abanye bayifumana ibuhlungu kakhulu, kusafanelekile ukunamathela kumgaqo olula. Ekuhloleni impilo, kwaye ngokomgaqo xa usebenza kunye nezicelo zewebhu.
Ukuba yonke into ihambe kakuhle, ke uphendule ngempendulo yamakhulu amabini. Ngokomgaqo, nayiphi na impendulo yamakhulu amabini iya kuhambelana nawe. Ukuba ufunda i-ragsy kakuhle kwaye uyazi ukuba ezinye iimeko zokuphendula zahlukile kwezinye, phendula ngezifanelekileyo: 204, 5, 10, 15, nokuba yintoni na. Ukuba ayilunganga kakhulu, ke "ngoziro ezimbini." Ukuba yonke into ihamba kakubi kwaye isheke lezempilo aliphenduli, ke uphendule nangayiphi na ikhulu elinesihlanu. Kwakhona, ukuba uyayiqonda indlela yokuphendula, ukuba iimeko zokuphendula zahluke njani enye kwenye. Ukuba awuqondi, ke i-502 lukhetho lwakho lokuphendula kwi-healthchecks ukuba kukho into engahambi kakuhle.
Le yenye inqaku, ndifuna ukubuyisela kancinci malunga nokujonga iinkonzo ezisezantsi. Ukuba uqala, umzekelo, ukujonga zonke iinkonzo ezisisiseko ezimi emva kwesicelo sakho - yonke into ngokubanzi. Yintoni esiyifumanayo kwimbono ye-microservice architecture, sinengcamango efana "nokudibanisa okuphantsi" - oko kukuthi, xa iinkonzo zakho zixhomekeke kancinci omnye komnye. Ukuba enye yazo iyasilela, zonke ezinye ngaphandle kokusebenza ziya kuqhubeka zisebenza. Eminye yemisebenzi ayisebenzi. Ngokufanelekileyo, ukuba ubopha zonke ii-healthchecks omnye komnye, uya kugqiba ngento enye ewela kwisiseko, kwaye ngenxa yokuba yawa, zonke ii-healtchecks zazo zonke iinkonzo ziqala ukusilela-kwaye kukho iziseko zophuhliso ngokubanzi. Uyilo olupheleleyo lwe-microservice No. Yonke into yaba mnyama apho.
Ngoko ke, ndifuna ukuphinda oku kwakhona ukuba kufuneka uhlolisise iinkonzo ezisisiseko, ezo ngaphandle kokuba isicelo sakho kwikhulu leepesenti lamatyala asikwazi ukwenza umsebenzi walo. Oko kukuthi, kunengqiqo ukuba ukuba une-REST API apho umsebenzisi agcina khona kwisiseko sedatha okanye afumane kwakhona kwi-database, ngoko ke ngokungabikho kwedatha, awukwazi ukuqinisekisa umsebenzi kunye nabasebenzisi bakho.
Kodwa ukuba abasebenzisi bakho, xa ubakhupha kwi-database, bayongezelelwa ngenye i-metadata, ukusuka kwenye i-backend, oyifaka ngaphambi kokuthumela impendulo kwi-frontend - kwaye le backend ayifumaneki, oku kuthetha ukuba unika phendula ngaphandle kwenxalenye yemetadata.
Okulandelayo, sikwanawo omnye wemiba ebuhlungu xa usungula izicelo.
Ngapha koko, oku akusebenzi kuphela kwi-Kubernetes ngokubanzi; kwenzekile ukuba inkcubeko yohlobo oluthile lophuhliso lobuninzi kunye ne-DevOps ngokukodwa yaqala ukusasazeka ngexesha elifanayo ne-Kubernetes. Ke ngoko, ngokubanzi, kuye kwavela ukuba kufuneka usivale ngobubele isicelo sakho ngaphandle kweKubernetes. Kwanangaphambi kokuba uKubernetes, abantu benze oku, kodwa ngokufika kweKubernetes, saqala ukuthetha ngayo ngobuninzi.
Ukuvalwa kweGraceful
Ngokubanzi, yintoni iGraceful Shutdown kwaye kutheni ifuneka? Oku kumalunga naxa isicelo sakho sintlitheka ngesizathu esithile, kufuneka wenze app stop - okanye ufumana, umzekelo, umqondiso ovela kwinkqubo yokusebenza, isicelo sakho kufuneka siyiqonde kwaye senze into malunga nayo. Eyona meko imbi kakhulu, kunjalo, kuxa isicelo sakho sifumana i-SIGTERM kwaye ifana ne- "SIGTERM, masixhome, sisebenze, singenzi nto." Olu lukhetho olubi.
Ukhetho oluphantse lube lubi ngokulinganayo kuxa isicelo sakho sifumana i-SIGTERM kwaye ifana βbathe segterm, oko kuthetha ukuba siyaphela, khange ndibone, andazi naziphi na izicelo zomsebenzisi, andazi ukuba luhlobo luni lwe izicelo endisebenza kuzo ngoku, bathi SIGTERM, oko kuthetha ukuba siyaphela " Oku kukwayindlela embi.
Yeyiphi inketho elungileyo? Inqaku lokuqala kukuthathela ingqalelo ukugqitywa kwemisebenzi. Olona khetho lulungileyo kukuba umncedisi wakho aphinde athathele ingqalelo into ayenzayo xa efumana i-SIGTERM.
I-SIGTERM i-shutdown ethambileyo, yenzelwe ngokukodwa, inokubanjwa kwinqanaba lekhowudi, inokucutshungulwa, ithi ngoku, linda, siza kuqala sigqibe umsebenzi esinawo, emva koko siya kuphuma.
Ukusuka kumbono weKubernetes, yile nto ikhangeleka ngayo. Xa sisithi kwipod esebenza kwiqela le-Kubernetes, "Nceda yima, uhambe," okanye uqalise kwakhona, okanye uhlaziyo lwenzeka xa uKubernetes ephinda ephinda iipods, uKubernetes uthumela umyalezo ofanayo we-SIGTERM kwipod, ulinde. ixesha elithile, kwaye, eli lixesha alilindileyo, likwaqwalaselwe, kukho iparameter ekhethekileyo kwiidiploma kwaye ibizwa ngokuba yiGraceful ShutdownTimeout. Njengoko uqonda, akubizwanga nto, kwaye akukho nto sithetha ngayo ngoku.
Apho singatsho ngokuthe ngqo ukuba kufuneka silinde ixesha elingakanani phakathi kwexesha esithumela ngalo i-SIGTERM kwisicelo kwaye xa siqonda ukuba isicelo sibonakala ngathi siyaphambana ngento ethile okanye "sibambekile" kwaye asiyi kuphelisa - kwaye kufuneka yithumele SIGKILL, oko kukuthi, ugqibezele umsebenzi wayo. Oko kukuthi, ngokufanelekileyo, sinohlobo oluthile lwe-daemon esebenzayo, luqhuba imisebenzi. Siyaqonda ukuba ngokwe-avareji imisebenzi yethu esebenza kuyo i-daemon ayihlali ngaphezu kwemizuzwana engama-30 ngexesha. Ngokufanelekileyo, xa i-SIGTERM ifika, siyaqonda ukuba i-daemon yethu, ubukhulu becala, inokugqiba imizuzwana engama-30 emva kwe-SIGTERM. Siyibhala, umzekelo, imizuzwana engama-45 ukuba kunokwenzeka kwaye sithi SIGTERM. Emva koko silinda imizuzwana engama-45. Kwithiyori, ngeli xesha idemon ifanele ukuba iwugqibile umsebenzi wayo kwaye igqibe ngokwayo. Kodwa ukuba ngequbuliso ayikwazanga, oko kuthetha ukuba kusenokwenzeka ukuba ibambekile-ayisaqhubeki nezicelo zethu ngokwesiqhelo. Kwaye kwimizuzwana engama-45 unako ngokukhuselekileyo, eneneni, umbethelele phantsi.
Kwaye apha, eneneni, kwanemiba emi-2 inokuthathelwa ingqalelo. Okokuqala, qonda ukuba ukuba ufumene isicelo, uqale ukusebenza nayo ngandlela-thile kwaye awuzange unike impendulo kumsebenzisi, kodwa ufumene i-SIGTERM, umzekelo. Kunengqiqo ukuyicokisa kwaye unike impendulo kumsebenzisi. Eli linqaku lokuqala kulo mba. Inqaku lesibini apha kukuba, ukuba ubhala esakho isicelo, yakha ngokubanzi i-architecture ngendlela yokuba ufumane isicelo sesicelo sakho, emva koko uqale umsebenzi othile, uqale ukukhuphela iifayile kwenye indawo, ukukhuphela i-database, kunye nantoni na. - Oko. Ngokubanzi, umsebenzisi wakho, isicelo sakho sixhomekeke kwisiqingatha seyure kwaye ulindele ukuba umphendule - ngoko, kunokwenzeka ukuba, kufuneka usebenze kwi-architecture. Oko kukuthi, thatha nje ingqalelo nokuba nengqondo eqhelekileyo ukuba ukuba imisebenzi yakho imfutshane, kuyavakala ukuyihoya i-SIGTERM kwaye uyiguqule. Ukuba imisebenzi yakho inde, ngoko ayinangqondo ukuyihoya i-SIGTERM kulo mzekelo. Kunengqiqo ukuyila ngokutsha i-architecture ukuphepha imisebenzi emide kangaka. Ukuze abasebenzisi bangahlali nje kwaye balinde. Andazi, yenza uhlobo oluthile lwe-websocket apho, yenza iigwegwe ezibuyela umva ukuba umncedisi wakho uya kuba sele ethumela kumxhasi, nantoni na eyenye, kodwa unganyanzeli umsebenzisi ukuba axhonywe kangangesiqingatha seyure kwaye ulinde nje iseshoni de ube wena. mphendule. Ngenxa yokuba kungalindelekanga apho inokuthi iphuke khona.
Xa isicelo sakho siphelisiwe, kufuneka unikeze ikhowudi yokuphuma efanelekileyo. Oko kukuthi, ukuba isicelo sakho sicelwe ukuba sivale, siyeke, kwaye ikwazile ukuzimisa ngokuqhelekileyo, ngoko awudingi ukubuyisela uhlobo oluthile lwekhowudi yokuphuma 1,5,255 njalo njalo. Nantoni na engeyiyo ikhowudi ye-zero, ubuncinci kwiinkqubo zeLinux, ndiqinisekile ngale nto, ithathwa njengengaphumelelanga. Oko kukuthi, kuqwalaselwa ukuba isicelo sakho kulo mzekelo siphelile ngempazamo. Ngokufanelekileyo, ngendlela enobubele, ukuba isicelo sakho sigqityiwe ngaphandle kwempazamo, uthi 0 kwisiphumo. Ukuba isicelo sakho asiphumeleli ngesizathu esithile, uthi non-0 kwimveliso. Kwaye ungasebenza ngolu lwazi.
Kwaye ukhetho lokugqibela. Kubi xa umsebenzisi wakho ethumela isicelo kwaye ejinga isiqingatha seyure ngelixa usiqhuba. Kodwa ngokubanzi, ndingathanda ukuthetha malunga nokuba yintoni eyixabisa ngokubanzi kwicala lomthengi. Ayinamsebenzi ukuba unesicelo esiphathwayo, isiphelo sangaphambili, njl. Kuyimfuneko ukuba kuthathelwe ingqalelo ukuba ngokubanzi iseshoni yomsebenzisi inokupheliswa, nantoni na inokwenzeka. Isicelo sinokuthunyelwa, umzekelo, singalungiswanga kwaye akukho mpendulo ibuyisiweyo. Umphambili wakho okanye isicelo sakho esiphathwayo-nasiphi na i-frontend ngokubanzi, masiyibeke ngolo hlobo-kufuneka siyithathele ingqalelo le nto. Ukuba usebenza ngee-websockets, le yeyona ntlungu imbi kakhulu endakha ndanayo.
Xa abaphuhlisi bezinye iingxoxo eziqhelekileyo bengazi ukuba, kuvela, i-websocket inokophuka. Kubo, xa kukho into eyenzekayo kwi-proxy, sitshintsha nje i-config, kwaye yenza ukulayisha kwakhona. Ngokwemvelo, zonke iiseshini ezihlala ixesha elide zikrazukile kule meko. Abaphuhlisi beza kuthi bebaleka bathi: βBafo, nenza ntoni, incoko yonakele kubo bonke abathengi bethu!β Sithi kubo: βNenza ntoni? Ngaba abathengi bakho abakwazi ukuphinda baqhagamshele? Bathi: "Hayi, sifuna iiseshini zingaqhawuki." Ngamafutshane, yimbudane le. Icala lomxhasi kufuneka lithathelwe ingqalelo. Ngokukodwa, njengoko nditshoyo, ngeeseshoni ezihlala ixesha elide ezifana ne-websockets, inokuphuka kwaye, ingaqatshelwanga ngumsebenzisi, kufuneka ukwazi ukubuyisela iiseshoni ezinjalo. Kwaye ke yonke into iphelele.
Izibonelelo
Ngokwenyani, apha ndiza kukuxelela nje ibali elithe ngqo. Kwakhona kubomi benene. Eyona nto igulayo endakha ndayiva malunga nezibonelelo.
Izibonelelo kule meko, ndiyathetha, uhlobo oluthile lwezicelo, imida onokuthi uyibeke kwiipods kumaqela akho eKubernetes. Eyona nto ihlekisayo endayivayo kumphuhlisi ... Omnye wabaphuhlisi endisebenza nabo kwindawo yangaphambili yomsebenzi wakhe wathi: "Isicelo sam asiyi kuqalisa kwiqela." Ndajonga ukuze ndibone ukuba ayiqali, kodwa yayingangeni kwizibonelelo, okanye babebeke imida emincinci kakhulu. Ngokufutshane, isicelo asikwazi ukuqalisa ngenxa yezibonelelo. Ndithi: "Ayizukuqala ngenxa yezixhobo, uthatha isigqibo sokuba ufuna kangakanani kwaye usete ixabiso elaneleyo." Uthi: βLuluphi uhlobo loncedo?β Ndaqala ukumchazela ukuba i-Kubernetes, imida kwizicelo kunye ne-blah, blah, blah kufuneka ibekwe. Le ndoda yaphulaphula imizuzu emihlanu, yanqwala yathi: βNdize apha ukuza kusebenza njengomakhi, andifuni kwanto malunga nazo naziphi na izixhobo. Ndize apha ukuze ndibhale ikhowudi kwaye yiloo nto. " Kubuhlungu. Lo ngumbono olusizi kakhulu ngokwembono yomphuhlisi. Ingakumbi kwihlabathi langoku, ngoko kuthetha, kwi-devops eqhubekayo.
Kutheni izibonelelo zifuneka kwaphela? Kukho iintlobo ezi-2 zezibonelelo kwi-Kubernetes. Ezinye zibizwa ngokuba zizicelo, ezinye zibizwa ngokuba yimida. Ngezibonelelo siya kuqonda ukuba kukho izithintelo ezimbini kuphela ezisisiseko. Oko kukuthi, imida yexesha le-CPU kunye nemida ye-RAM kwisitya esisebenza kwi-Kubernetes.
Umda ubeka umda ophezulu malunga nendlela ubutyebi obunokusetyenziswa ngayo kwisicelo sakho. Oko kukuthi, ngokufanelekileyo, ukuba uthi i-1GB ye-RAM kwimida, isicelo sakho asiyi kukwazi ukusebenzisa ngaphezu kwe-1GB ye-RAM. Kwaye ukuba ngokukhawuleza ufuna kwaye uzama ukwenza oku, ngoko inkqubo ebizwa ngokuba yi-oom killer, ngaphandle kwememori, oko kukuthi, iya kuza ibulale isicelo sakho - oko kukuthi, iya kuqala kwakhona. Usetyenziso aluyi kuphinda luqale ngokusekwe kwi-CPU. Ngokubhekiselele kwi-CPU, ukuba isicelo sizama ukusebenzisa kakhulu, ngaphezu kokuchazwa kwimida, i-CPU iya kukhethwa ngokungqongqo. Oku akukhokelela ekuqaliseni kwakhona. Lo ngumda - lo ngumda ophezulu.
Kwaye kukho isicelo. Isicelo yindlela uKubernetes ayiqonda ngayo indlela iindawo ezikwiqela lakho leKubernetes ezihlaliswa ngayo zizicelo. Oko kukuthi, isicelo luhlobo oluthile lokuzibophelela kwisicelo sakho. Itsho into endifuna ukuyisebenzisa: "Ndingathanda ukuba ugcine le CPU ingako kunye nale nkumbulo ingako kum." Isifaniso esilula ngolo hlobo. Kuthekani ukuba sine-node ene-node, andazi, i-8 CPUs iyonke. Kwaye i-pod ifika apho, izicelo zayo zithi 1 CPU, oku kuthetha ukuba i-node ine-7 CPUs esele. Oko kukuthi, ngokufanelekileyo, ngokukhawuleza ukuba i-8 pods ifike kule node, nganye ine-CPU eyi-1 kwizicelo zabo, i-node, njengokungathi isuka kwindawo yokujonga i-Kubernetes, iphelelwe yi-CPU kunye neepods ezininzi ezinezicelo azikwazi iqaliswe kule node. Ukuba zonke ii-node ziphuma kwi-CPU, ke i-Kubernetes iya kuqalisa ukuthi akukho ndawo zifanelekileyo kwiqela lokusebenzisa ii-pods zakho kuba i-CPU iphelile.
Kutheni izicelo zifuneka kwaye kutheni ngaphandle kwezicelo, ndicinga ukuba akukho mfuneko yokuqalisa nantoni na eKubernetes? Makhe sibe nomfanekiso ngqondweni wemeko. Usungula isicelo sakho ngaphandle kwezicelo, uKubernetes akazi ukuba ingakanani na into onayo, zeziphi iindawo onokuthi uzityhalele kuzo. Kulungile, uyatyhala, atyhale, atyhale kwiindawo zokuhlala. Ngexesha elithile, uya kuqalisa ukufumana itrafikhi kwisicelo sakho. Kwaye enye yezicelo iqala ngokukhawuleza ukusebenzisa izixhobo ukuya kwimida enayo ngokwemida. Kuvela ukuba kukho esinye isicelo esikufutshane kwaye sikwadinga izixhobo. I-node eneneni iqala ukuphelelwa zizibonelelo ngokwasemzimbeni, umzekelo, OP. I-node eneneni iqala ukuphelelwa ngumzimba kwizixhobo, umzekelo, imemori yokufikelela ngokungahleliwe (RAM). Xa i-node iphelelwa ngamandla, okokuqala kuzo zonke i-docker iya kuyeka ukuphendula, emva koko i-cubelet, emva koko i-OS. Bazakusuka bangabikho zingqondweni kwaye YONKE INTO ngokuqinisekileyo iya kuyeka ukukusebenzela. Oko kukuthi, oku kuya kukhokelela ekubeni i-node yakho ibambeke kwaye kuya kufuneka uyiqalise kwakhona. Ngokufutshane, imeko ayintle kakhulu.
Kwaye xa unezicelo, imida ayahlukanga kakhulu, ubuncinci amaxesha amaninzi ngaphezu kwemida okanye izicelo, ngoko unokuba nokuzaliswa okuqhelekileyo, okunengqiqo kwezicelo kuzo zonke iindawo zamaqela e-Kubernetes. Kwangelo xesha, uKubernetes phantse uyazi ukuba ingakanani into ebeka kuyo, ingakanani into esetyenziswa apho. Oko kukuthi, lixesha nje elinjalo. Kubalulekile ukuyiqonda. Kwaye kubalulekile ukulawula ukuba oku kubonisiwe.
Ukugcinwa kwedatha
Inqaku lethu elilandelayo limalunga nokugcinwa kwedatha. Yintoni onokuyenza kunye nabo kwaye ngokubanzi, yintoni onokuyenza ngokuzingisa eKubernetes?
Ndicinga, kwakhona, ngaphakathi kwethu , kwakukho isihloko malunga nedatha yedatha kwi-Kubernetes. Kwaye kum kubonakala ngathi ndiyayazi into oye waxelelwa ngabalingane bakho xa ubuzwa: "Ngaba kunokwenzeka ukuba usebenzise ugcino lwedatha eKubernetes?" Ngesizathu esithile, kubonakala kum ukuba oogxa bakho bekufuneka bakuxelele ukuba ukuba ubuza umbuzo ukuba kunokwenzeka ukuqhuba i-database kwi-Kubernetes, ngoko akunakwenzeka.
Ingqiqo apha ilula. Ukuba kunjalo, ndiza kuchaza kwakhona, ukuba ungumntu opholileyo ngokwenene onokukha inkqubo yokunyamezela impazamo ngokufanelekileyo yokugcinwa kwenethiwekhi esasaziweyo, qonda ukuba ungangena njani ugcino lwedatha kulo mzekelo, indlela amafu azalelwa ngayo kwizikhongozeli kufuneka asebenze. kuvimba weenkcukacha ngokubanzi. Ngokunokwenzeka, awunambuzo malunga nendlela yokuyiqhuba. Ukuba unombuzo onjalo, kwaye ufuna ukuqiniseka ukuba yonke into iyenzeka kwaye imele ukufa kwimveliso kwaye ingaze iwe, ke oku akwenzeki. Uqinisekisiwe ukuba uzidubule enyaweni ngale ndlela. Ngoko ke kungcono ukuba ungakwenzi.
Yintoni ekufuneka siyenze ngedatha isicelo sethu esingathanda ukuyigcina, eminye imifanekiso elayishwa ngabasebenzisi, ezinye izinto ezenziwa sisicelo sethu ngexesha lokusebenza kwayo, ekuqaleni, umzekelo? Yintoni onokuyenza nabo eKubernetes?
Ngokubanzi, ngokufanelekileyo, ewe, ewe, iKubernetes iyilwe kakuhle kakhulu kwaye yayiqale yakhawulelwa izicelo ezingenammiselo. Oko kukuthi, kwezo zicelo zingagcini ulwazi konke konke. Oku kufanelekile.
Kodwa, ngokuqinisekileyo, ukhetho olufanelekileyo alusoloko lukho. Ke ngoku? Inqaku lokuqala kunye nelona lilula kukuthatha uhlobo oluthile lwe-S3, kungekhona nje into eyenziwa ekhaya, engacacanga ukuba isebenza njani, kodwa kumboneleli othile. Umboneleli olungileyo, oqhelekileyo- kwaye ufundise isicelo sakho ukusebenzisa i-S3. Oko kukuthi, xa umsebenzisi wakho efuna ukulayisha ifayile, yithi "apha, nceda, yilayishe kwi-S3." Xa efuna ukuyifumana, yithi: "Nali ikhonkco eliya ku-S3 emva kwaye uyithathe apha." Oku kufanelekile.
Ukuba ngequbuliso ngenxa yesizathu esithile olu khetho lufanelekileyo alulunganga, unesicelo ongasibhalanga, awusiphuhlisanga, okanye luhlobo oluthile lwelifa elibi, alinakusebenzisa iprotocol ye-S3, kodwa kufuneka isebenze nabalawuli basekhaya iifolda zalapha. Thatha into engaphezulu okanye encinci, sebenzisa iKubernetes. Oko kukuthi, ukubiyela uCeph kwangoko kwimisebenzi encinci, kubonakala kum, luluvo olubi. Kuba uCeph, ewe, ulungile kwaye usefashonini. Kodwa ukuba awuyiqondi kakuhle into oyenzayo, emva kokuba ubeke into kwiCeph, unokulula kwaye ungaze uyikhuphe apho kwakhona. Ngenxa yokuba, njengoko uyazi, i-Ceph igcina idatha kwi-cluster yayo kwifom ye-binary, kwaye kungekhona kwifom yeefayile ezilula. Ngoko ke, ukuba ngequbuliso iqoqo leCeph liyaphuka, ngoko kukho ithuba elipheleleyo neliphezulu lokuba awusoze ufumane idatha yakho ukusuka apho kwakhona.
Siza kuba nekhosi kwiCeph, unako .
Ke ngoko, kungcono ukwenza into elula njengeseva ye-NFS. I-Kubernetes inokusebenza nabo, unganyusa ulawulo phantsi komncedisi we-NFS - isicelo sakho sifana nje nolawulo lwasekhaya. Kwangaxeshanye, ngokwemvelo, kufuneka uqonde ukuba, kwakhona, kufuneka wenze into nge-NFS yakho, kufuneka uqonde ukuba ngamanye amaxesha inokungafikeleleki kwaye uqwalasele umbuzo wento oya kuyenza kule meko. Mhlawumbi kufuneka igcinwe kwindawo ethile kumatshini owahlukileyo.
Inqaku elilandelayo endithethe ngalo lelokuba wenze ntoni ukuba isicelo sakho sivelisa ezinye iifayile ngexesha lokusebenza. Umzekelo, xa iqala, ivelisa ifayile engatshintshiyo, esekwe kulwazi oluthile olufunyanwa sisicelo kuphela ngexesha lokuqaliswa. Okomzuzwana. Ukuba akukho datha ingako, akufuneki uzikhathaze konke konke, vele uzifakele esi sicelo kwaye usebenze. Umbuzo kuphela apha kukuba, khangela. Ngokuqhelekileyo, zonke iintlobo zeenkqubo zelifa, ezifana ne-WordPress kunye nokunye, ngokukodwa ngokuguqulwa kolunye uhlobo lweeplagi ezihlakaniphile, abaphuhlisi be-PHP abahlakaniphile, bahlala bekwazi ukwenza oko ukuze bazenzele uhlobo oluthile lwefayile ngokwabo. Ngokufanelekileyo, enye ivelisa ifayile enye, eyesibini ivelisa ifayile yesibini. Bahlukile. Ulungelelwaniso lwenzeka kwiqela le-Kubernetes labathengi ngamabona-ndenzile. Ngokufanelekileyo, kuvela ukuba abayazi indlela yokusebenzisana ngomzekelo. Omnye unika ulwazi olunye, omnye unika umsebenzisi olunye ulwazi. Le yinto omele uyiphephe. Oko kukuthi, eKubernetes, yonke into oyisungulayo iqinisekisiwe ukuba iyakwazi ukusebenza kwiimeko ezininzi. Kuba iKubernetes yinto ehambayo. Ngokufanelekileyo, unokuhambisa nantoni na, nanini na xa efuna, ngaphandle kokucela nabani na. Ngoko ke, kufuneka uthembele kule nto. Yonke into eqaliswe kwimeko enye iya kusilela kungekudala. Okukhona ubhukisha ngakumbi, kokukhona kungcono. Kodwa kwakhona, ndithi, ukuba uneefayile ezimbalwa ezinjalo, ngoko unokuzibeka phantsi kwakho, zilinganisa isixa esincinci. Ukuba kukho ezinye zazo, akufuneki uzityhalele ngaphakathi kwisitya.
Ndiyakucebisa ukuba kukho into emangalisayo kwi-Kubernetes, ungasebenzisa ivolumu. Ngokukodwa, kukho umthamo wohlobo olungenanto lwe-dir. Oko kukuthi, kukuba i-Kubernetes iya kwenza ngokuzenzekelayo uvimba weefayili zayo zenkonzo kwiseva apho uqale khona. Yaye uya kukunika ukuze ukwazi ukuyisebenzisa. Inye kuphela ingongoma ebalulekileyo. Oko kukuthi, idatha yakho ayiyi kugcinwa ngaphakathi kwesikhongozeli, kodwa endaweni yomninimzi osebenza kuyo. Ngaphezu koko, i-Kubernetes inokulawula i-dirs enjalo engenanto phantsi koqwalaselo oluqhelekileyo kwaye iyakwazi ukulawula ubungakanani bayo obukhulu kwaye ingavumeli ukuba igqithwe. Inqaku lodwa kukuba into oyibhalileyo kwi-dir engenanto ayilahlekanga ngexesha lokuqalisa kwakhona kwe-pod. Oko kukuthi, ukuba i-pod yakho iwela ngephutha kwaye ivuke kwakhona, ulwazi kwi-dir engenanto aluyi kuhamba naphi na. Unokuyisebenzisa kwakhona kwisiqalo esitsha-kwaye kulungile. Ukuba i-pod yakho ishiya kwindawo ethile, ngoko ngokwemvelo uya kushiya ngaphandle kwedatha. Oko kukuthi, ngokukhawuleza ukuba i-pod evela kwindawo apho yaqaliswa khona nge-dir engenanto iyanyamalala, i-dir engenanto iyacinywa.
Yintoni enye elungileyo malunga ne-dir engenanto? Ngokomzekelo, inokusetyenziswa njenge-cache. Makhe sicinge ukuba usetyenziso lwethu luvelisa into ngokubhabha, lunike abasebenzisi, kwaye luyenze ixesha elide. Ngoko ke, isicelo, umzekelo, sivelisa kwaye sinikezela kubasebenzisi, kwaye kwangaxeshanye sigcina kwindawo ethile, ukwenzela ukuba ngexesha elizayo umsebenzisi eze into efanayo, uya kukhawuleza ukunika ngokukhawuleza ukuveliswa. I-dir engenanto inokucelwa ku-Kubernetes ukuba yenze kwimemori. Kwaye ke, iicache zakho zinokusebenza ngokubanzi ngesantya sombane - ngokwesantya sokufikelela kwidisk. Oko kukuthi, une-dir engenanto kwimemori, kwi-OS igcinwe kwimemori, kodwa kuwe, kumsebenzisi ongaphakathi kwipod, kubonakala ngathi kuluhlu lwendawo. Awudingi usetyenziso ukuze ufundise ngokukodwa nawuphi na umlingo. Uthatha nje ngokuthe ngqo kwaye ubeke ifayile yakho kuluhlu, kodwa, eneneni, kwinkumbulo kwi-OS. Oku kukwayinto elula kakhulu ngokwemigaqo yeKubernetes.
Zeziphi iingxaki anazo uMinio? Ingxaki enkulu ngeMinio kukuba ukuze le nto isebenze, kufuneka isebenze kwindawo ethile, kwaye kufuneka kubekho uhlobo oluthile lwefayile yefayile, oko kukuthi, ukugcinwa. Kwaye apha sidibana neengxaki ezifanayo noCeph anazo. Oko kukuthi, iMinio kufuneka igcine iifayile zayo kwenye indawo. Lujongano lweHTTP kwiifayile zakho. Ngaphezu koko, ukusebenza ngokucacileyo kuhlwempuzekile kunaleyo ye-Amazon's S3. Ngaphambili, ayizange ikwazi ukugunyazisa ngokufanelekileyo umsebenzisi. Ngoku, njengoko ndiyazi, sele ikwazi ukudala iibhakethi ezinezigunyaziso ezahlukeneyo, kodwa kwakhona, kubonakala kum ukuba ingxaki enkulu, ngoko kuthetha, inkqubo yokugcina engaphantsi kobuncinci.
I-Empty dir kwinkumbulo iyichaphazela njani imida? Ayichaphazeli imida nangayiphi na indlela. Ilele kwinkumbulo yomninimzi, kwaye hayi kwinkumbulo yesikhongozeli sakho. Oko kukuthi, isikhongozeli sakho asiyiboni i-dir engenanto kwinkumbulo njengenxalenye yememori yayo. Umamkeli uyakubona oku. Ngokufanelekileyo, ewe, ukusuka kwindawo yokujonga i-kubernetes, xa uqala ukusebenzisa le nto, kuya kuba kuhle ukuqonda ukuba unikezela ngenxalenye yememori yakho kwi-dir engenanto. Kwaye ngokufanelekileyo, qonda ukuba imemori inokuphelelwa kuphela ngenxa yezicelo, kodwa nangenxa yokuba umntu ubhalela ezi dirs zingenanto.
Ukuba namafu
Kwaye i-subtopic yokugqibela yintoni i-Cloudnative. Kutheni ifuneka? Ukuba namafu njalo njalo.
Oko kukuthi, ezo zicelo zikwaziyo kwaye zibhaliwe ukuze zisebenze kwisiseko selifu sanamhlanje. Kodwa, eneneni, i-Cloudnative inomnye umba onjalo. Ukuba oku ayisiyiyo kuphela isicelo esithathela ingqalelo zonke iimfuno zesiseko selifu sanamhlanje, kodwa iyayazi nendlela yokusebenza nesi siseko selifu sanamhlanje, sebenzisa inzuzo kunye nokungalunganga kwinto yokuba isebenza kula mafu. Musa nje ukugqithisa kwaye usebenze emafini, kodwa sebenzisa inzuzo yokusebenza efini.
Makhe sithathe uKubernetes njengomzekelo. Isicelo sakho sisebenza kwi-Kubernetes. Isicelo sakho sinokuhlala sisenza iakhawunti yenkonzo. Oko kukuthi, i-akhawunti yogunyaziso kwi-Kubernetes ngokwayo kwiseva yayo. Yongeza amanye amalungelo esiwadingayo apho. Kwaye unokufikelela ku-Kubernetes ngaphakathi kwesicelo sakho. Yintoni onokuyenza ngale ndlela? Ngokomzekelo, kwisicelo, fumana idatha malunga nokuba ezinye izicelo zakho zikhona, ezinye iimeko ezifanayo zikhoyo, kwaye kunye ngandlela-thile iqoqo phezu kwe-Kubernetes, ukuba kukho imfuneko enjalo.
Kwakhona, siye saba netyala mva nje. Sinomlawuli omnye obeka esweni umgca. Kwaye xa eminye imisebenzi emitsha ibonakala kulo mgca, iya kwi-Kubernetes - kwaye ngaphakathi kwe-Kubernetes yenza i-pod entsha. Inika le pod umsebenzi omtsha kwaye ngaphakathi kwesakhelo sale pod, i-pod yenza umsebenzi, ithumela impendulo kumlawuli ngokwawo, kwaye umlawuli ke enze into ngolu lwazi. Umzekelo, yongeza i-database. Oko kukuthi, kwakhona, oku kukudibanisa kwinto yokuba isicelo sethu sisebenza eKubernetes. Sinokusebenzisa i-Kubernetes eyakhelwe-ngaphakathi ukusebenza ngokwayo ukuze ngandlela ithile sandise kwaye senze ukusebenza kwesicelo sethu kube lula ngakumbi. Oko kukuthi, musa ukufihla uhlobo oluthile lomlingo malunga nendlela yokuqalisa isicelo, indlela yokuqalisa umsebenzi. Kwi-Kubernetes, uthumela ngokulula isicelo kwi-app ukuba isicelo sibhalwe kwiPython.
Kuyafana nokuba sihamba ngaphaya kweKubernetes. SineKubernetes yethu ibaleka kwenye indawo- ilungile ukuba ikuhlobo oluthile lwamafu. Kwakhona, singasebenzisa, kwaye nokuba kufuneka, ndiyakholwa, sisebenzise ubunakho belifu ngokwalo apho siqhuba khona. Ukususela kwizinto ezisisiseko esizinikwa lilifu. Ukulinganisa, oko kukuthi, sinokwenza i-balancers yamafu kwaye siyisebenzise. Oku kuluncedo ngokuthe ngqo koko sinokukusebenzisa. Ngenxa yokuba ukulinganisa ilifu, okokuqala, ngokulula kususa uxanduva kuthi ngendlela esebenza ngayo, indlela eqwalaselwe ngayo. Kwaye kulunge kakhulu, kuba i-Kubernetes eqhelekileyo inokudibanisa namafu.
Okufanayo kuya kumlinganiselo. I-Kubernetes rhoqo inokudibanisa nababoneleli bamafu. Uyayazi indlela yokuqonda ukuba ukuba i-cluster iphuma kwi-nodes, oko kukuthi, indawo ye-node iphelile, ngoko kufuneka udibanise - i-Kubernetes ngokwayo iya kwongeza ii-nodes ezintsha kwi-cluster yakho kwaye iqalise ukukhupha ii-pods kubo. Oko kukuthi, xa umthwalo wakho ufika, inani leziko liqala ukwanda. Xa ii-nodes kwi-cluster ziphela ezi pods, i-Kubernetes isungula ii-nodes ezintsha kwaye, ngokufanelekileyo, inani leepods lisenokunyuka. Kwaye iluncedo kakhulu. Eli lithuba elithe ngqo lokukala iqela kubhabho. Akunjalo ngokukhawuleza, ngengqiqo yokuba akusiyo isibini, kufana nomzuzu ukwenzela ukongeza iinodi ezintsha.
Kodwa kumava am, kwakhona, yeyona nto ipholileyo endakha ndayibona. Xa iqela le-Cloudnative lilinganiswe ngexesha losuku. Yayiyinkonzo yokubuyela umva eyayisetyenziswa ngabantu abakwiofisi engasemva. Okokuthi, beza emsebenzini ngo-9 ekuseni, baqale ukungena kwi-system, kwaye ngokufanelekileyo, i-Cloudnative cluster, apho iqhuba khona yonke into, iqala ukuvuvukala, iqalise iipods ezintsha ukuze wonke umntu oza emsebenzini asebenze kunye nesicelo. Xa bephuma emsebenzini ngentsimbi yesi-8:6 okanye ngentsimbi yesi-30 ngokuhlwa, amaqela e-Kubernetes aqaphela ukuba akukho mntu usebenzisa isicelo kwakhona kwaye aqale ukuncipha. Ukonga ukuya kuthi ga kuma-XNUMX ekhulwini kuqinisekisiwe. Yayisebenza eAmazon ngelo xesha; ngelo xesha kwakungekho mntu eRashiya owayenokwenza kakuhle ngolo hlobo.
Ndiza kukuxelela ngokuthe ngqo, ukonga ziipesenti ezingama-30 kuba sisebenzisa iKubernetes kwaye sithatha ithuba lobuchule belifu. Ngoku oku kunokwenziwa eRashiya. Andiyi kubhengeza nabani na, kunjalo, kodwa masithi kukho ababoneleli abanokwenza oku, babonelele ngaphandle kwebhokisi ngeqhosha.
Kukho inqaku lokugqibela endingathanda kwakhona ukutsalela ingqalelo yakho kuyo. Ukuze isicelo sakho, isiseko sakho sibe yi-Cloudnative, kuyavakala ukuba ekugqibeleni uqalise ukulungelelanisa indlela ebizwa ngokuba yi-Infrastructure as a Code.Oko kukuthi, oku kuthetha ukuba isicelo sakho, okanye endaweni yoko isiseko sakho, siyafuneka ngendlela efanayo ncam ne-Code ikhowudi Chaza isicelo sakho, ingqiqo ishishini lakho ngohlobo lwekhowudi. Kwaye usebenze nayo njengekhowudi, oko kukuthi, yivavanye, uyikhuphe, uyigcine kwi-git, sebenzisa i-CICD kuyo.
Kwaye yile nto kanye ekuvumelayo, okokuqala, ukuba uhlale unolawulo kwiziseko zophuhliso lwakho, ukuhlala uqonda ukuba ikweyiphi na imeko. Okwesibini, kunqandwe imisebenzi eyenziwa ngesandla ebangela iimpazamo. Okwesithathu, kuphephe oko kubizwa ngokuba yi-turnover, xa ufuna rhoqo ukwenza imisebenzi yezandla efanayo. Okwesine, ikuvumela ukuba uphinde ukhawuleze kakhulu xa usilela. E-Russia, rhoqo xa ndithetha ngale nto, kuhlala kukho inani elikhulu labantu abathi: "Ewe, kucacile, kodwa uneendlela, ngokufutshane, akukho mfuneko yokulungisa nantoni na." Kodwa yinyani. Ukuba kukho into ephukileyo kwisiseko sakho, ngoko ke ukusuka kwindawo yokujonga indlela ye-Cloudnative kunye nombono we-Infrastructure njengeKhowudi, kunokuba uyilungise, ukuya kumncedisi, uqikelele ukuba yintoni ephukile kwaye uyilungise, kulula. ukucima umncedisi kwaye uyidale kwakhona. Kwaye konke oku ndiya kubuyiselwa.
Yonke le miba kuxoxwe ngayo ngokubanzi apha . Ngokulandela ikhonkco unokuziqhelanisa neprogram kunye neemeko. Eyona nto iluncedo kukuba uyakwazi ukufunda uKubernetes ngokufunda ekhaya okanye usebenze iiyure ezi-1-2 ngosuku.
umthombo: www.habr.com