Slurm: Kubernetes yakanyanya. Chirongwa uye mabhonasi

Musi waMay 27-29 tiri kubata yechina Slurm: yakasimba paKubernetes.

Slurm: Kubernetes yakanyanya. Chirongwa uye mabhonasi

Bhonasi: online makosi paDocker, Ansible, Ceph
Isu takatora kubva kuSlurm misoro yakakosha pakushanda neKubernetes, asi haina hukama zvakananga nek8s. Sei, sei uye chii chakaitika - pasi pekucheka.
Vese vatori vechikamu veSlurm 4 vachawana mukana kune aya makosi.

Mari yakazara pazuva rekutanga
PaSt. Petersburg Slurm, vatori vechikamu vaviri vakaenda wongororo dzakaipa zvakanyanya. Ndakademba sei kuti zvaisaita kuti ndidzoke nguva yakare tigoparadzana navo pasina kutaurirana.
Kana iwe ukaona zvausingade zvachose nezveSlurm, zuva rekutanga nyorera chero wevarongi. Tichadzima kuwana uye kudzosera mutengo wakazara wekutora chikamu.

Technical consultants
Kana paine anoziva Dmitry Simonov (akaumba kirabhu yevatungamiriri vehunyanzvi), takamukoka kuSlurm (kuti adzidze, kwete kuita). Akavimbisa kupa munhu wese zano. Izvi hazvigone kuve zvekufarira kune vatariri nevagadziri, asi zvichave zvinonakidza kune mamaneja eIT.

Chii chinonzi Slurm

Slurm: Kubernetes yakanyanya. Chirongwa uye mabhonasi

Slurm-4: kosi yekutanga (Chivabvu 27-29)
Yakagadzirirwa avo vanoona Kubernetes kekutanga kana vanoda kuronga ruzivo rwavo.
Mumwe nemumwe anotora chikamu achagadzira yavo sumbu muSelectel gore uye voisa application ipapo.

Mutengo: 25 zviuru

Purogiramu

Nyaya #1: Nhanganyaya kuKubernetes, zvinhu zvikuru
• Nhanganyaya kune k8s tekinoroji. Tsanangudzo, mashandisirwo, pfungwa
• Podhi, ReplicaSet, Deployment, Sevhisi, Ingress, PV, PVC, ConfigMap, Chakavanzika
• Dzidzira

Nyaya Nhamba 2: Cluster design, zvikamu zvikuru, kukanganisa kushivirira, k8s network
• Cluster design, zvikamu zvikuru, kukanganisa kushivirira
• k8s network

Nyaya #3: Kubespray, kugadzirisa uye kumisikidza boka reKubernetes
• Kubespray, kugadzirisa uye kugadzirisa kweKubernetes cluster
• Dzidzira

Nyaya #4: Ceph, cluster setup uye maficha ekushanda mukugadzira
• Ceph, cluster setup uye maitiro ekushanda mukugadzirwa
• Dzidzira: kuseta ceph

Nyaya #5: Yepamberi Kubernetes Abstractions
• DaemonSet, StatefulSet, RBAC, Job, CronJob, Pod Sduling, InitContainer

Nyaya #6: Nhanganyaya kuHelm
• Nhanganyaya kuHelm
• Dzidzira

Nyaya #7: Kutsikisa masevhisi uye maapplication
• Pfupiso yenzira dzekutsikisa basa: NodePort vs LoadBalancer vs Ingress
• Ingress controller (Nginx): kuenzanisa traffic inouya
• Sert-maneja: tora otomatiki zvitupa zveSSL/TLS
• Dzidzira

Nyaya #8: Kutema nekutarisa
• Cluster monitoring, Prometheus
• Kutema matanda, Fluentd/Elastic/Kibana
• Dzidzira

Nyaya Nhamba 9: CI / CD, chivako chekuendesa kune chikwata kubva pakutanga

Nyaya Nhamba 10: Basa rinoshanda, kushandisa dockerization uye kutanga muboka

Slurm webhusaiti

MegaSlurm: kosi yepamusoro (Chivabvu 31 - Chikumi 2)
Yakagadzirirwa Kubernetes mainjiniya uye vagadziri, pamwe nehwaro kosi vakapedza kudzidza.
Isu tinogadzirisa iyo cluster kuitira kuti panguva imwe chete titange kugadziridzwa kwezvikamu zvemasumbu uye kutumira kune sumbu.

Mutengo: zviuru makumi matanhatu (60 zviuru zveSlurm-45 vatori vechikamu)

Purogiramu

Nyaya #1: Maitiro ekugadzira failover cluster kubva mukati
• Kushanda neKubespray
• Kuiswa kwezvimwe zvikamu
• Cluster test uye troubleshooting
• Dzidzira

Nyaya #2: Mvumo muchikwata uchishandisa mupi wekunze
• LDAP (Nginx + Python)
• OIDC (Dex + Gangway)
• Dzidzira

Nyaya #3: Network policy
• Nhanganyaya kuCNI
• Network Security Policy
• Dzidzira

Nyaya #4: Chengetedza uye inowanikwa zvakanyanya muchikwata
• PodSecurityPolicy
• PodDisruptionBudget

Nyaya #5: Kubernetes. Ngatitarisei pasi pehood
• Chimiro chemutongi
• Vashandi uye maCRD
• Dzidzira

Nhaurirano #6: Zvikumbiro zvakarongeka muchikwata
• Kutangisa dhatabhesi cluster uchishandisa PostgreSQL semuenzaniso
• Kutangisa RabbitMQ cluster
• Dzidzira

Nyaya #7: Kuchengeta Zvakavanzika
• Kugadzirisa zvakavanzika muKubernetes
• Vault

Nyaya #8: Horizontal Pod Autoscaler
• Dzidziso
• Dzidzira

Nyaya #9: Backup uye Njodzi Kudzoreredza
• Cluster backup uye kupora uchishandisa Heptio Velero (yaimbova Areka) uye etcd
• Dzidzira

Nyaya #10: Kuendeswa Kwekushandisa
•Lint
• Templating uye deployment maturusi
• Nzira dzekuparadzira

Nha. 11: Basa rinoshanda
• Kuvaka CI/CD yekuendesa chikumbiro
• Cluster update

MegaSlurm webhusaiti

Docker, Ansible uye Ceph

Slurm: Kubernetes yakanyanya. Chirongwa uye mabhonasi

History tour

Yekutanga Slurm yaive kuyedza. Vakurukuri vakapedza mharidzo dzavo chaidzo pachikuva, uye muvateereri maigara vatariri venhanho zvokuti yakanga yava nguva yokuvakoka sevakurukuri.

Kosi chaiyo yakakosha yakaitika paSlurm yechipiri: 80% yevatori vechikamu vakaona Kubernetes kekutanga, uye chetatu akange asati amboshanda naDocker.
Zvaive pachena kuti zvaive zvakaoma sei kuti vanhu vateerere hurukuro paDocker mangwanani uye vashande nayo mukurwisa mode manheru.
Ceph yakakonzera matambudziko mazhinji. Uyezve, pakanga paine vanhu makumi maviri muvateereri vaifanira kunyatsotsanangura Ceph, uye vamwe makumi matanhatu vaisada Ceph zvachose.

Kune yechitatu Slurm, takafambisa Docker uye Ansible mumawebhusaiti akasiyana, tichisunungura imwe nguva yeKubernetes. Mhinduro yakazova inoshanda muchokwadi uye isina kuvandudzwa mukuita: hurukuro yacho yakanga isingafadzi kune vakomana vane ruzivo, uye nhaurirano yacho yakanga isingafadzi kune vanotanga.

Kune yechina Slurm, takaita online makosi paDocker, Ansible uye Ceph. Pfungwa yacho iri nyore: avo vanoida vanozotora kosi vachifunga, avo vasingaide vanoifuratira vakanyarara. Tichitonga neboka revanoedza, kosi yeDocker inotora maawa matanhatu-6. Ansible naCeph havasati vavhara.

Disiki:

  • experimental course. Zvimwe zvisarudzo zvingava zvisina kubudirira.
  • puratifomu (Stepik.org) haina kunaka, uye isu hatina kumboshanda nayo kare. Panogona kunge pave nemapundu uye snags.
  • Kosi yacho yakaedzwa chete kuvashandi veSouthbridge. Chokwadi uchafanira kupedza chimwe chinhu sezvaunoenda.

Slurm: Kubernetes yakanyanya. Chirongwa uye mabhonasi

Rimwe zuva mukutaura kwekutanga Slurm vakarangarira kutonhorera uye kunakidza kwazvaive, kunyangwe zvese zvaityisa musangano. Yekutanga kuwana zvinonyatsojeka zvinoonekwa. Ngationei zvinoitika kuvadzidzi vekutanga ve online makosi. 🙂

Slurm: Kubernetes yakanyanya. Chirongwa uye mabhonasi

Source: www.habr.com

Voeg