I-slurm: Kubernetes inzulu. Inkqubo kunye neebhonasi

Nge-27-29 kaMeyi sibambe i-Slurm yesine: enzulu kwi-Kubernetes.

Ibhonasi: izifundo ze-intanethi kwiDocker, Ansible, Ceph
Sithathelwe kwizihloko ze-Slurm ezibalulekileyo ekusebenzeni ne-Kubernetes, kodwa azihambelani ngokuthe ngqo neek8s. Njani, kutheni kwaye kwenzeka ntoni - phantsi kokunqunyulwa.
Bonke abathathi-nxaxheba baseSlurm 4 baya kuba nako ukufikelela kwezi khosi.

Ukubuyisela imali epheleleyo ngosuku lokuqala
ESt. Petersburg Slurm, abathathi-nxaxheba ababini bemka uphononongo olubi kakhulu. Indlela endazisola ngayo ngokuba kwakungenakwenzeka ukuba ndibuyele umva ngexesha kunye nokwahlukana nabo ngaphandle kwamabango.
Ukuba ufumanisa into ongayithandiyo ngeSlurm, Usuku lokuqala bhalela nawuphi na kubaququzeleli. Siza kuvala ukufikelela kunye nokubuyisela ixabiso elipheleleyo lokuthatha inxaxheba.

Abacebisi bobugcisa
Ukuba nabani na uyazi NguDmitry Simonov (waseka iklabhu yabalawuli bezobugcisa), sammema kwi-Slurm (ukufunda, kungekhona ukwenza). Wathembisa ukuba uza kucebisa wonke umntu. Oku akunakwenzeka ukuba kube nomdla kubalawuli kunye nabaphuhlisi, kodwa kuya kuba nomdla kakhulu kubaphathi be-IT.

Yintoni iSlurm

I-Slurm-4: ikhosi esisiseko (ngoMeyi 27-29)
Yenzelwe abo babona i-Kubernetes okokuqala okanye bafuna ukucwangcisa ulwazi lwabo.
Umthathi-nxaxheba ngamnye uya kwenza iqela lakhe kwilifu le-Selectel kwaye athumele isicelo apho.

Ixabiso: 25 lamawaka

Inkqubo

Umxholo #1: Intshayelelo yeKubernetes, amacandelo aphambili
• Intshayelelo kubuchwepheshe be-k8s. Inkcazo, isicelo, iikhonsepthi
• IPod, iReplicaSet, ukusasazwa, iNkonzo, i-Ingress, iPV, iPVC, iConfigMap, iMfihlo
• Ziqhelise

Umxholo wesi-2: Uyilo lweQela, amacandelo aphambili, ukunyamezela impazamo, inethiwekhi ye-k8s
• Uyilo lweqela, amacandelo aphambili, ukunyamezela iimpazamo
• inethiwekhi ye-k8s

Umxholo #3: Kubespray, ukulungiswa kunye nokuseta iqela leKubernetes
• IKubespray, ulungelelwaniso kunye nohlengahlengiso lweqela leKubernetes
• Ziqhelise

Umxholo #4: I-Ceph, ukusekwa kweqela kunye neempawu zokusebenza kwimveliso
• ICeph, ukusekwa kweqela kunye neempawu zokusebenza kwimveliso
• Ukuziqhelanisa: ukuseta i-ceph

Umxholo #5: I-Kubernetes Abstractions ephucukileyo
• I-DaemonSet, StatefulSet, RBAC, Job, CronJob, Pod Scheduling, InitContainer

Umxholo #6: Intshayelelo yeHelm
• Intshayelelo yeHelm
• Ziqhelise

Umxholo #7: Iinkonzo zokupapasha kunye nezicelo
• Isishwankathelo seendlela zokupapasha inkonzo: NodePort vs LoadBalancer vs Ingress
• Isilawuli sokungena (Nginx): ukulungelelanisa i-traffic engenayo
• Umphathi we-Сert: fumana ngokuzenzekelayo izatifikethi ze-SSL/TLS
• Ziqhelise

Umxholo #8: Ukugawulwa kwemithi kunye nokubeka iliso
• Ukujongwa kweqela, iPrometheus
• Ukugawulwa kweqela, Fluentd/Elastic/Kibana
• Ziqhelise

Umxholo we-9: CI / CD, ukusasazwa kwesakhiwo kwiqela ukusuka ekuqaleni

Umxholo we-10: Umsebenzi osebenzayo, i-dockerization yesicelo kunye nokuqaliswa kwi-cluster

Iwebhusayithi yeSlurm

I-MegaSlurm: izifundo eziphambili (ngoMeyi 31-Juni 2)
Yenzelwe iinjineli zeKubernetes kunye nabayili bezakhiwo, kunye nabaphumelele izifundo ezisisiseko.
Simisela iqela ukuze ngaxeshanye siqalise uhlaziyo lwamacandelo eqela kunye nokusasazwa kwiqela.

Ixabiso: amawaka angama-60 (amawaka angama-45 kubathathi-nxaxheba be-Slurm-4)

Inkqubo

Umxholo #1: Inkqubo yokudala iqela le-failover ukusuka ngaphakathi
• Ukusebenza neKubespray
• Ufakelo lwamalungu awongezelelweyo
• Uvavanyo lweqela kunye nokusombulula ingxaki
• Ziqhelise

Umxholo #2: Ugunyaziso kwiqela usebenzisa umboneleli wangaphandle
• I-LDAP (Nginx + Python)
• OIDC (Dex + Gangway)
• Ziqhelise

Umxholo #3: Umgaqo-nkqubo wothungelwano
• Intshayelelo kwi-CNI
• UMgaqo-nkqubo woKhuseleko lweNethiwekhi
• Ziqhelise

Umxholo #4: Khusela kwaye usetyenziso olufumanekayo kakhulu kwiqela
• PodSecurityPolicy
• I-PodDisruptionBudget

Umxholo #5: Kubernetes. Makhe sijonge phantsi kwe-hood
• Ubume bomlawuli
• Abaqhubi kunye neeCRD
• Ziqhelise

Umxholo #6: Usetyenziso oluqinisekileyo kwiqela
• Ukuphehlelelwa kweqela ledathabheyisi kusetyenziswa iPostgreSQL njengomzekelo
• Ukusungula iqela leRabbitMQ
• Ziqhelise

Umxholo #7: Ukugcina iiMfihlo
• Ukulawula iimfihlo kwi-Kubernetes
• Ivault

Umxholo #8: I-Horizontal Pod Autoscaler
• Ithiyori
• Ziqhelise

Umxholo #9: Ugcino kunye noBuyiselo kwiNtlekele
• Ugcino lweCluster kunye nokubuyisela usebenzisa i-Heptio Velero (eyayisakuba yi-Ark) kunye nokunye
• Ziqhelise

Umxholo #10: Ukusasazwa kwesicelo
•I-Lint
• Itempleyithi kunye nezixhobo zokusasaza
• Amacebo okusasaza

Umxholo we-11: Umsebenzi osebenzayo
• Ukwakha i-CI/CD yokusasazwa kwezicelo
• Uhlaziyo lweqela

Iwebhusayithi yeMegaSlurm

Docker, Ansible kunye neCeph

Ukuvakasha kwimbali

I-Slurm yokuqala yayilingelo. Izithethi zayigqiba ngokoqobo intetho yazo eqongeni, kwaye kubaphulaphuli kuhleli abalawuli abakwinqanaba kangangokuba kwade kwafika ixesha lokubamema njengezithethi.

Ikhosi yokwenene eyisiseko yenzeke kwi-Slurm yesibini: I-80% yabathathi-nxaxheba babona uKubernetes okokuqala, kwaye okwesithathu akazange asebenze noDocker.
Kwakucacile ukuba kwakunzima kangakanani ukuba abantu baphulaphule intetho kwi-Docker kusasa kwaye basebenze nayo kwimodi yokulwa ngokuhlwa.
UCeph ubangele ubunzima obuninzi. Ngaphezu koko, kwakukho abantu be-20 kubaphulaphuli ababefuna ngokuqinisekileyo ukuchaza uCeph, kunye nenye i-60 eyayingadingi i-Ceph.

Kwi-Slurm yesithathu, sihambise i-Docker kunye ne-Ansible kwiiwebinars ezahlukeneyo, sikhulula ixesha elingakumbi le-Kubernetes. Isisombululo saba yinto esebenzayo kwisiseko kwaye saphuhliswa ngaphantsi kokuphunyezwa: intetho yayingenamdla kubafana abanamava, kwaye ingxoxo yayingathandeki kubaqalayo.

Kwi-Slurm yesine, senze izifundo ze-intanethi kwi-Docker, i-Ansible kunye ne-Ceph. Ingcamango ilula: abo bayidingayo baya kuthatha ikhosi ngokucingisisayo, abo bangayidingiyo baya kuyihoya ngokuzolileyo. Ngokujonga iqela labavavanyi, ikhosi yeDocker ithatha iiyure ezingama-6-8. Ansible no Ceph abakayibali.

Iphepha elichazayo ukuba awusenanto oyifunayo:

• ikhosi yovavanyo. Ezinye izigqibo mhlawumbi ziya kubonakala zingaphumeleli.
• iqonga (Stepik.org) likrwada, kwaye asizange sisebenze nalo ngaphambili. Kuya kubakho amaqhuma kunye nama-snags.
• Ikhosi yavavanywa kuphela kubasebenzi baseSouthbridge. Ngokuqinisekileyo kuya kufuneka ugqibezele into njengoko uhamba.

Ngenye imini kwincoko yeSlurm yokuqala bakhumbula indlela eyayipholile kwaye yayimnandi ngayo, ngaphandle kwazo zonke izinto ezoyikisayo zombutho. Eyokuqala ukufumana eyona mbonakalo icacileyo. Makhe sibone ukuba kwenzeka ntoni kubafundi bokuqala bezifundo ze-intanethi. 🙂

umthombo: www.habr.com