Slurm: Kubernetes kwambiri. Pulogalamu ndi mabonasi

Pa Meyi 27-29 tikugwira Slurm yachinayi: yozama pa Kubernetes.

Slurm: Kubernetes kwambiri. Pulogalamu ndi mabonasi

Bonasi: Maphunziro a pa intaneti pa Docker, Ansible, Ceph
Tachokera ku mitu ya Slurm yomwe ili yofunika kugwira ntchito ndi Kubernetes, koma osakhudzana mwachindunji ndi ma k8. Momwe, chifukwa ndi zomwe zidachitika - pansi pa odulidwa.
Onse omwe atenga nawo mbali pa Slurm 4 adzakhala ndi mwayi wopeza maphunzirowa.

Kubweza ndalama zonse patsiku loyamba
Ku St. Petersburg Slurm, otenga nawo mbali awiri adachoka ndemanga zoipa kwambiri. Ndinanong'oneza bondo kuti sikunali kotheka kubwerera m'mbuyo ndikusiyana nawo popanda zonena.
Mukapeza zomwe simukuzikonda za Slurm, tsiku loyamba lembani kwa aliyense wa okonza. Tiyimitsa kupeza ndikubweza mtengo wathunthu wotenga nawo mbali.

Alangizi aukadaulo
Ngati wina akudziwa Wotchedwa Dmitry Simonov (anapanga kalabu ya otsogolera luso), tinamuitanira ku Slurm (kukaphunzira, osati kuchita). Analonjeza kuti adzalangiza aliyense. Izi sizingakhale zokondweretsa kwa olamulira ndi omanga, koma zidzakhala zosangalatsa kwambiri kwa oyang'anira IT.

Kodi Slurm ndi chiyani

Slurm: Kubernetes kwambiri. Pulogalamu ndi mabonasi

Slurm-4: Maphunziro oyambira (Meyi 27-29)
Zapangidwira iwo omwe amawona Kubernetes kwa nthawi yoyamba kapena akufuna kukonza chidziwitso chawo.
Aliyense adzipangira gulu lawo mumtambo wa Selectel ndikugwiritsa ntchito pulogalamuyi pamenepo.

Mtengo: 25 zikwi

Pulogalamuyo

Mutu #1: Chiyambi cha Kubernetes, zigawo zazikulu
• Chidziwitso chaukadaulo wa k8s. Kufotokozera, kugwiritsa ntchito, malingaliro
• Pod, ReplicaSet, Deployment, Service, Ingress, PV, PVC, ConfigMap, Chinsinsi
• Yesetsani

Mutu Nambala 2: Mapangidwe a magulu, zigawo zikuluzikulu, kulekerera zolakwika, k8s network
• Mapangidwe amagulu, zigawo zikuluzikulu, kulolerana kolakwa
• maukonde a k8s

Mutu #3: Kubespray, kukonza ndi kukhazikitsa gulu la Kubernetes
• Kubespray, kasinthidwe ndi kusintha kwa gulu la Kubernetes
• Yesetsani

Mutu #4: Ceph, khwekhwe la magulu ndi mawonekedwe ogwirira ntchito popanga
• Ceph, khwekhwe la magulu ndi mawonekedwe a ntchito yopanga
• Yesani: kukhazikitsa ceph

Mutu #5: Zapamwamba za Kubernetes Abstractions
• DaemonSet, StatefulSet, RBAC, Job, CronJob, Pod Scheduling, InitContainer

Mutu #6: Mau oyamba a Helm
• Mau oyamba a Helm
• Yesetsani

Mutu #7: Ntchito zofalitsa ndi kugwiritsa ntchito
• Chidule cha njira zosindikizira ntchito: NodePort vs LoadBalancer vs Ingress
• Ingress controller (Nginx): kusanja magalimoto omwe akubwera
• Сert-manager: pezani zokha ziphaso za SSL/TLS
• Yesetsani

Mutu #8: Kudula mitengo ndikuwunika
• Kuwunika kwamagulu, Prometheus
• Kudula mitengo m'magulu, Fluentd/Elastic/Kibana
• Yesetsani

Mutu 9: CI / CD, kutumizidwa kwa nyumba kumagulu kuyambira pachiyambi

Mutu 10: Ntchito yothandiza, kugwiritsa ntchito dockerization ndikuyambitsa gulu

Webusayiti ya Slurm

MegaSlurm: maphunziro apamwamba (May 31 - June 2)
Zopangidwira mainjiniya a Kubernetes ndi omanga, komanso omaliza maphunziro a maziko.
Timakonza gululo kuti nthawi yomweyo tiyambitse zosintha zamagulu amagulu ndikutumiza ku cluster.

Mtengo: 60 zikwi (45 kwa omwe atenga nawo gawo Slurm-4)

Pulogalamuyo

Mutu #1: Njira yopangira gulu la failover kuchokera mkati
• Kugwira ntchito ndi Kubespray
• Kuyika zigawo zowonjezera
• Kuyesa magulu ndi kuthetsa mavuto
• Yesetsani

Mutu #2: Chilolezo mugulu pogwiritsa ntchito wothandizira wakunja
• LDAP (Nginx + Python)
• OIDC (Dex + Gangway)
• Yesetsani

Mutu #3: Mfundo za Network
• Chiyambi cha CNI
• Network Security Policy
• Yesetsani

Mutu #4: Mapulogalamu otetezedwa komanso opezeka kwambiri pagulu
• PodSecurityPolicy
• PodDisruptionBudget

Mutu #5: Kubernetes. Tiyeni tiyang'ane pansi pa hood
• Kapangidwe ka owongolera
• Othandizira ndi ma CRD
• Yesetsani

Mutu #6: Ntchito zokhazikika mumagulu
• Kukhazikitsa gulu la database pogwiritsa ntchito PostgreSQL monga chitsanzo
• Kukhazikitsa gulu la RabbitMQ
• Yesetsani

Mutu #7: Kusunga Zinsinsi
• Kuwongolera zinsinsi ku Kubernetes
• Chipinda chogona

Mutu #8: Horizontal Pod Autoscaler
• Chiphunzitso
• Yesetsani

Mutu #9: Kusunga zosunga zobwezeretsera ndi Kubwezeretsa Masoka
• Kusunga ndi kubwezeretsa Cluster pogwiritsa ntchito Heptio Velero (omwe kale anali Ark) ndi etcd
• Yesetsani

Mutu #10: Kutumiza Ntchito
•Lint
• Ma templates ndi zida zotumizira
• Njira zotumizira anthu

Mutu 11: Ntchito yothandiza
• Kumanga CI/CD kuti atumize ntchito
• Kusintha kwamagulu

Webusayiti ya MegaSlurm

Docker, Ansible ndi Ceph

Slurm: Kubernetes kwambiri. Pulogalamu ndi mabonasi

Ulendo wakumbiri

Slurm yoyamba inali kuyesa. Okambawo anamaliza nkhani zawo kwenikweni pa siteji, ndipo mwa omvera munakhala olamulira amlingo wakuti inali nthaŵi yowaitanira iwo monga okamba nkhani.

Maphunziro enieni enieni adachitika pa Slurm yachiwiri: 80% ya omwe adatenga nawo gawo adawona Kubernetes koyamba, ndipo wachitatu anali asanagwirepo ntchito ndi Docker.
Zinali zoonekeratu kuti zinali zovuta kuti anthu azimvetsera nkhani ya Docker m'mawa ndikugwira nawo ntchito madzulo.
Ceph idayambitsa zovuta zambiri. Komanso, panali anthu 20 mwa omvera omwe amafunikiradi kufotokozera Ceph, ndi ena 60 omwe sanafune Ceph nkomwe.

Kwa Slurm yachitatu, tidasuntha Docker ndi Ansible kukhala ma webinars osiyana, kumasula nthawi yochulukirapo kwa Kubernetes. Yankho lake linakhala lothandiza kwenikweni komanso losatukuka pakukhazikitsa: nkhaniyo inali yosasangalatsa kwa anyamata odziwa zambiri, ndipo zokambiranazo zinali zosasangalatsa kwa oyamba kumene.

Kwa Slurm yachinayi, tidapanga maphunziro apa intaneti pa Docker, Ansible ndi Ceph. Lingaliro ndi losavuta: iwo omwe amawafuna adzatenga maphunzirowo moganizira, omwe sakuwafuna adzanyalanyaza modekha. Kutengera gulu la oyesa, maphunziro a Docker amatenga maola 6-8. Ansible ndi Ceph sanachedwe.

Chodzikanira:

  • maphunziro oyesera. Zosankha zina mwina sizingapambane.
  • nsanja (Stepik.org) ndi yankhanza, ndipo sitinagwirepo nayo ntchito. Pakhoza kukhala zokopa ndi zokopa.
  • Maphunzirowa adayesedwa pa ogwira ntchito aku Southbridge okha. Ndithudi mudzayenera kumaliza chinachake pamene mukupita.

Slurm: Kubernetes kwambiri. Pulogalamu ndi mabonasi

Tsiku lina pocheza ndi Slurm yoyamba adakumbukira momwe zinalili zoziziritsa kukhosi komanso zosangalatsa, ngakhale zinali zowopsa za bungwe. Woyamba kupeza zowoneka bwino kwambiri. Tiyeni tiwone zomwe zimachitika kwa ophunzira oyamba a maphunziro a pa intaneti. 🙂

Slurm: Kubernetes kwambiri. Pulogalamu ndi mabonasi

Source: www.habr.com

Kuwonjezera ndemanga