Slurm: Kubernetes m. Shirin da kari

A kan Mayu 27-29 muna riƙe da Slurm na huɗu: m akan Kubernetes.

Bonus: darussan kan layi akan Docker, Mai yiwuwa, Ceph
Mun samo daga batutuwan Slurm waɗanda ke da mahimmanci don aiki tare da Kubernetes, amma ba su da alaƙa kai tsaye da k8s. Ta yaya, me yasa da abin da ya faru - a ƙarƙashin yanke.
Duk mahalarta Slurm 4 za su sami damar zuwa waɗannan darussan.

Cikakken dawo da kudi a ranar farko
A St. Petersburg Slurm, mahalarta biyu sun tafi musamman korau reviews. Yadda na yi nadama cewa ba zai yiwu in koma cikin lokaci ba in rabu da su ba tare da da'awar juna ba.
Idan kun gano abin da ba ku so game da Slurm, ranar farko rubuta zuwa ga kowane daga cikin masu shirya. Za mu kashe damar shiga kuma mu mayar da cikakken farashin shiga.

Masu ba da shawara na fasaha
Idan wani ya sani Dmitry Simonov (ya kafa kungiyar daraktocin fasaha), mun gayyace shi zuwa Slurm (don yin karatu, ba don yin ba). Ya yi alkawarin ba kowa shawara. Wannan ba shi yiwuwa ya zama abin sha'awa ga masu gudanarwa da masu haɓakawa, amma zai kasance mai ban sha'awa sosai ga manajojin IT.

Menene Slurm

Slurm-4: babban darasi (Mayu 27-29)
An tsara shi don waɗanda suka ga Kubernetes a karon farko ko kuma suna so su tsara ilimin su.
Kowane ɗan takara zai ƙirƙiri gungu nasu a cikin gajimaren Selectel kuma su tura aikace-aikacen a can.

Farashin: 25

Shirin

Maudu'i #1: Gabatarwa zuwa Kubernetes, manyan abubuwan haɗin gwiwa
Gabatarwa zuwa fasahar k8s. Bayani, aikace-aikace, ra'ayoyi
• Pod, ReplicaSet, Aiwatar da, Sabis, Ingress, PV, PVC, ConfigMap, Asirin
• Gwaji

Maudu'i No. 2: Ƙirar gungun, manyan abubuwan haɗin gwiwa, rashin haƙuri, cibiyar sadarwar k8s
• Ƙirar tagulla, manyan abubuwan haɗin gwiwa, haƙurin kuskure
• k8s cibiyar sadarwa

Taken #3: Kubespray, kunnawa da kafa gungu na Kubernetes
• Kubespray, daidaitawa da daidaita tarin Kubernetes
• Gwaji

Taken #4: Ceph, saitin tari da fasalulluka na aiki a samarwa
• Ceph, saitin tari da fasali na aiki a samarwa
Ayyuka: kafa ceph

Maudu'i #5: Babban Kubernetes Abstractions
• DaemonSet, StatefulSet, RBAC, Aiki, CronJob, Tsarin Pod, InitContainer

Take #6: Gabatarwa zuwa Helm
Gabatarwa zuwa Helm
• Gwaji

Take #7: Buga sabis da aikace-aikace
• Bayanin hanyoyin buga sabis: NodePort vs LoadBalancer vs Ingress
• Mai sarrafa Ingress (Nginx): daidaita zirga-zirga mai shigowa
• Manajan Sarrafa: sami takaddun SSL/TLS ta atomatik
• Gwaji

Take #8: Shiga da saka idanu
• Kulawa ta gungu, Prometheus
• Gungura gungu, Fluentd/Elastic/Kibana
• Gwaji

Maudu'i No. 9: CI/CD, ginin gini zuwa gungu daga karce

Maudu'i No. 10: Aiki na yau da kullun, ƙaddamar da aikace-aikacen da ƙaddamarwa cikin tari

Gidan yanar gizon Slurm

MegaSlurm: babban kwas (Mayu 31 - Yuni 2)
An ƙera shi don injiniyoyin Kubernetes da masu gine-gine, da kuma waɗanda suka kammala kwas ɗin tushe.
Muna saita tarin ta yadda za mu ƙaddamar da sabuntawar abubuwan tari da turawa zuwa gungu.

Farashin: 60 (duba 45 don mahalarta Slurm-4)

Shirin

Maudu'i #1: Tsarin ƙirƙirar gungu mai gazawa daga ciki
• Yin aiki tare da Kubespray
• Shigar da ƙarin abubuwa
• Gwajin tari da magance matsala
• Gwaji

Take #2: Izini a cikin tari ta amfani da mai bada waje
• LDAP (Nginx + Python)
• OIDC (Dex + Gangway)
• Gwaji

Maudu'i #3: Manufar hanyar sadarwa
Gabatarwa zuwa CNI
• Manufar Tsaro ta hanyar sadarwa
• Gwaji

Maudu'i #4: Amintattun aikace-aikace masu inganci a cikin tari
•PodSecurityPolicy
• Kudiddigar Kuɗi

Maudu'i #5: Kubernetes. Bari mu duba ƙarƙashin hular
• Tsarin sarrafawa
• Masu aiki da CRDs
• Gwaji

Maudu'i #6: Manyan aikace-aikace a cikin gungu
• Ƙaddamar da tarin bayanai ta amfani da PostgreSQL a matsayin misali
• Ƙaddamar da gungu na RabbitMQ
• Gwaji

Take #7: Kiyaye Sirri
• Gudanar da sirri a cikin Kubernetes
• Vault

Taken #8: Horizontal Pod Autoscaler
• Ka'idar
• Gwaji

Taken #9: Ajiyayyen da Farfadowar Bala'i
Ajiyayyen tagulla da farfadowa ta amfani da Heptio Velero (tsohon Ark) da sauransu
• Gwaji

Take #10: Aiwatar da Aikace-aikacen
•Lint
• Samfura da tura kayan aikin
• Dabarun turawa

Maudu'i No. 11: Aiki Mai Aiki
• Gina CI / CD don ƙaddamar da aikace-aikacen
• Sabunta tari

Gidan yanar gizon MegaSlurm

Docker, Mai yiwuwa da Ceph

Yawon shakatawa zuwa tarihin

Slurm na farko gwaji ne. Masu jawabai sun kammala gabatarwa a zahiri a kan mataki, kuma a cikin masu sauraro sun zauna masu gudanar da irin wannan matakin cewa lokaci yayi da za a gayyace su a matsayin masu magana.

Hakikanin mahimmancin hanya ya faru a Slurm na biyu: 80% na mahalarta sun ga Kubernetes a karon farko, kuma na uku bai taba yin aiki tare da Docker ba.
Ya bayyana sarai yadda yake da wahala mutane su saurari lacca akan Docker da safe kuma suyi aiki tare da ita cikin yanayin fama da yamma.
Ceph ya haifar da matsaloli da yawa. Bugu da ƙari, akwai mutane 20 a cikin masu sauraro waɗanda tabbas suna buƙatar bayyana Ceph, da kuma wani 60 waɗanda ba sa buƙatar Ceph kwata-kwata.

Don Slurm na uku, mun matsar Docker da Mai yiwuwa a cikin rukunin yanar gizon daban, yana ba da ƙarin lokaci don Kubernetes. Maganin ya zama mai amfani a zahiri kuma ba a inganta shi ba a cikin aiwatarwa: lacca ba ta da sha'awa ga ƙwararrun samari, kuma tattaunawar ba ta da sha'awa ga masu farawa.

Don Slurm na huɗu, mun yi darussan kan layi akan Docker, Mai yiwuwa da Ceph. Tunani mai sauƙi ne: waɗanda suke buƙatarta za su ɗauki kwas ɗin cikin tunani, waɗanda ba sa buƙata za su yi watsi da shi cikin nutsuwa. Yin hukunci ta ƙungiyar masu gwadawa, tsarin Docker yana ɗaukar awanni 6-8. Mai yiwuwa kuma Ceph ba su yi agogo ba tukuna.

Bayarwa:

• hanya na gwaji. Wataƙila wasu yanke shawara ba za su yi nasara ba.
• dandalin (Stepik.org) danye ne, kuma ba mu yi aiki da shi ba. Wataƙila za a sami bumps da ƙugiya.
• An gwada kwas ɗin ne kawai akan ma'aikatan Southbridge. Tabbas za ku gama wani abu yayin da kuke tafiya.

Kamar sauran rana a cikin hira na Slurm na farko sun tuna yadda abin ya kasance mai sanyi da jin daɗi, duk da abubuwan ban tsoro na ƙungiya. Na farko don samun mafi kyawun ra'ayi. Bari mu ga abin da ya faru da daliban farko na darussan kan layi. 🙂

source: www.habr.com