Slurm: Kubernetes hnyav heev. Program thiab nyiaj tshwj xeeb

Thaum Lub Tsib Hlis 27-29 peb tab tom tuav plaub Slurm: mob siab rau Kubernetes.

Slurm: Kubernetes hnyav heev. Program thiab nyiaj tshwj xeeb

Ntxiv: Cov chav kawm online ntawm Docker, Ansible, Ceph
Peb tau muab los ntawm Slurm cov ncauj lus uas tseem ceeb rau kev ua haujlwm nrog Kubernetes, tab sis tsis cuam tshuam ncaj qha rau k8s. Yuav ua li cas, yog vim li cas thiab dab tsi tshwm sim - nyob rau hauv lub txiav.
Txhua tus neeg koom nrog Slurm 4 yuav nkag mus rau cov kev kawm no.

Tag nrho cov nyiaj rov qab rau thawj hnub
Ntawm St. Petersburg Slurm, ob tug neeg koom nrog tawm mus kev tshuaj xyuas tsis zoo heev. Yuav ua li cas kuv tu siab tias nws tsis tuaj yeem rov qab mus rau lub sijhawm thiab koom nrog lawv yam tsis muaj kev sib tham.
Yog tias koj pom dab tsi koj tsis nyiam txog Slurm, thawj hnub sau ntawv mus rau ib qho ntawm cov koom haum. Peb yuav lov tes taw kev nkag mus thiab rov qab them tag nrho cov nqi koom nrog.

Cov kws pab tswv yim
Yog leej twg paub Dmitry Simonov (nws tsim ib lub club ntawm cov thawj coj ua haujlwm), peb tau caw nws mus rau Slurm (los kawm, tsis ua haujlwm). Nws tau cog lus tias yuav qhia txhua tus. Qhov no tsis zoo li yuav txaus siab rau cov thawj coj thiab cov neeg tsim tawm, tab sis nws yuav txaus siab rau cov thawj coj IT.

Slurm yog dab tsi

Slurm: Kubernetes hnyav heev. Program thiab nyiaj tshwj xeeb

Slurm-4: Hoob kawm theem pib (Tsib Hlis 27-29)
Tsim los rau cov neeg uas pom Kubernetes thawj zaug lossis xav ua kom lawv txoj kev paub.
Txhua tus neeg koom yuav tsim lawv tus kheej pawg hauv Selectel huab thiab xa daim ntawv thov rau ntawd.

Nqe: 25 txhiab

Qhov kev pab cuam

Ntsiab lus #1: Taw qhia rau Kubernetes, cov khoom tseem ceeb
• Taw qhia txog k8s technology. Kev piav qhia, kev siv, kev xav
• Pod, ReplicaSet, Deployment, Service, Ingress, PV, PVC, ConfigMap, Secret
• xyaum

Ntsiab lus No. 2: Cluster design, main components, fault tolerance, k8s network
• Cluster tsim, lub ntsiab Cheebtsam, txhaum kam rau ua
• k8s network

Ntsiab lus #3: Kubespray, kho thiab teeb tsa Kubernetes pawg
• Kubespray, configuration thiab tuning ntawm Kubernetes pawg
• xyaum

Lub ntsiab lus # 4: Ceph, pawg teeb tsa thiab cov yam ntxwv ntawm kev ua haujlwm hauv kev tsim khoom
• Ceph, pawg teeb tsa thiab cov yam ntxwv ntawm kev ua haujlwm hauv kev tsim khoom
• Xyaum: teeb tsa ceph

Ntsiab lus #5: Advanced Kubernetes Abstractions
• DaemonSet, StatefulSet, RBAC, Txoj hauj lwm, CronJob, Pod Scheduling, InitContainer

Ntsiab lus #6: Taw qhia rau Helm
• Taw qhia txog Helm
• xyaum

Ntsiab lus #7: Publishing services and applications
• Txheej txheem cej luam ntawm cov kev pab cuam tshaj tawm txoj kev: NodePort vs LoadBalancer vs Ingress
• Ingress controller (Nginx): ntsuas cov tsheb thauj mus los
• Tus thawj tswj hwm: tau txais daim ntawv pov thawj SSL/TLS
• xyaum

Ntsiab lus #8: Kev txiav txim thiab saib xyuas
• Saib xyuas pawg, Prometheus
• Cluster loging, Fluentd/Elastic/Kibana
• xyaum

Ntsiab Lus No. 9: CI/CD, tsim kev xa mus rau ib pawg los ntawm kos

Ntsiab Lus No 10: Kev ua haujlwm zoo, kev siv dockerization thiab tso rau hauv ib pawg

Slurm lub vev xaib

MegaSlurm: Chav kawm qib siab (Tsib Hlis 31 - Lub Rau Hli 2)
Tsim los rau Kubernetes engineers thiab architects, nrog rau cov kawm tiav qib siab.
Peb teeb tsa cov pawg kom ib txhij tso qhov hloov tshiab ntawm pawg pawg thiab xa mus rau pawg.

Nqe: 60 (45 txhiab rau Slurm-4 koom)

Qhov kev pab cuam

Ntsiab lus # 1: Cov txheej txheem ntawm kev tsim ib qho kev poob qis los ntawm sab hauv
• Ua haujlwm nrog Kubespray
• Txhim kho cov khoom siv ntxiv
• Kev ntsuam xyuas pawg thiab kev daws teeb meem
• xyaum

Ntsiab lus #2: Kev tso cai nyob rau hauv pawg siv tus neeg muab kev pab sab nraud
• LDAP (Nginx + Python)
• ODC (Dex + Gangway)
• xyaum

Ntsiab lus #3: Network txoj cai
• Taw qhia rau CNI
• Network Security Policy
• xyaum

Ntsiab lus #4: Muaj kev nyab xeeb thiab muaj ntau daim ntawv thov hauv pawg
• PodSecurityPolicy
• PodDisruptionBudget

Ntsiab lus #5: Kubernetes. Wb saib hauv qab lub hood
• Tus qauv tswj
• Cov neeg ua haujlwm thiab CRDs
• xyaum

Ntsiab lus #6: Cov ntawv teev npe hauv ib pawg
• Tua tawm ib pawg database siv PostgreSQL ua piv txwv
• Tua tawm RabbitMQ pawg
• xyaum

Ntsiab lus #7: Khaws Cov Ntaub Ntawv
• Tswj cov lus zais hauv Kubernetes
• Vault

Ntsiab lus #8: Kab rov tav Pod Autoscaler
• Kev xav
• xyaum

Ntsiab lus #9: thaub qab thiab kev puas tsuaj rov qab
• Cluster thaub qab thiab rov qab siv Heptio Velero (yav tas los Ark) thiab lwm yam
• xyaum

Ntsiab lus #10: Daim ntawv thov Deployment
•Lint
• Templates thiab deploying tools
• Cov tswv yim xa tawm

Ntsiab Lus No 11: Kev ua haujlwm zoo
• Tsim CI/CD rau kev xa daim ntawv thov
• Hloov tshiab pawg

MegaSlurm lub vev xaib

Docker, Ansible thiab Ceph

Slurm: Kubernetes hnyav heev. Program thiab nyiaj tshwj xeeb

Excursion rau lub keeb kwm

Thawj Slurm yog ib qho kev sim. Cov neeg hais lus ua tiav lawv cov lus tshaj tawm hauv theem, thiab hauv cov neeg tuaj saib zaum cov thawj coj ntawm ib qib uas nws yog lub sijhawm los caw lawv los ua tus hais lus.

Cov chav kawm tiag tiag tau tshwm sim ntawm Slurm thib ob: 80% ntawm cov neeg koom tau pom Kubernetes thawj zaug, thiab ib feem peb tsis tau ua haujlwm nrog Docker.
Nws yog qhov tseeb tias nws nyuaj npaum li cas rau tib neeg los mloog kev qhuab qhia ntawm Docker thaum sawv ntxov thiab ua haujlwm nrog nws hauv kev sib ntaus sib tua thaum yav tsaus ntuj.
Ceph ua rau muaj kev nyuaj heev. Ntxiv mus, muaj 20 tus neeg hauv cov neeg tuaj saib uas xav tau los piav qhia Ceph, thiab lwm 60 tus uas tsis xav tau Ceph kiag li.

Rau qhov thib peb Slurm, peb tau tsiv Docker thiab Ansible mus rau hauv cov webinars cais, tso sijhawm ntau ntxiv rau Kubernetes. Cov kev daws teeb meem tau muab tso rau hauv cov ntsiab lus tseem ceeb thiab tsis tsim nyog rau kev siv: cov lus qhuab qhia tsis txaus siab rau cov neeg paub txog, thiab kev sib tham tsis txaus siab rau cov pib tshiab.

Rau thib plaub Slurm, peb tau kawm online ntawm Docker, Ansible thiab Ceph. Lub tswv yim yog yooj yim: cov neeg uas xav tau nws yuav kawm cov kev xav, cov neeg uas tsis xav tau nws yuav calmly tsis quav ntsej nws. Kev txiav txim los ntawm pab pawg neeg xeem, chav kawm Docker siv sijhawm 6-8 teev. Ansible thiab Ceph tseem tsis tau clocked.

Tsis lees paub:

  • kev sim. Qee qhov kev txiav txim siab yuav ua tsis tiav.
  • lub platform (Stepik.org) yog crude, thiab peb tsis tau ua hauj lwm nrog nws ua ntej. Tej zaum yuav muaj pob thiab snags.
  • Cov chav kawm tau raug sim tsuas yog rau cov neeg ua haujlwm Southbridge. Muaj tseeb koj yuav tau ua kom tiav ib yam dab tsi thaum koj mus.

Slurm: Kubernetes hnyav heev. Program thiab nyiaj tshwj xeeb

Tsuas yog lwm hnub hauv kev sib tham ntawm thawj Slurm lawv nco qab tias nws txias thiab lom zem npaum li cas, txawm tias tag nrho cov koom haum txaus ntshai. Thawj qhov kom tau txais kev xav pom tseeb tshaj plaws. Cia peb pom dab tsi tshwm sim rau thawj cov tub ntxhais kawm ntawm cov kev kawm online. 🙂

Slurm: Kubernetes hnyav heev. Program thiab nyiaj tshwj xeeb

Tau qhov twg los: www.hab.com

Ntxiv ib saib