Slurm: gonye rakashanduka kuita shavishavi

Slurm: gonye rakashanduka kuita shavishavi

  1. Slurm inobvumidza iwe kuti upinde mumusoro weKubernetes kana kuvandudza ruzivo rwako.
  2. Vatori vechikamu vanofara. Kune vashomanana chete vevaya vasina kudzidza chero chinhu chitsva kana kuti vasina kugadzirisa matambudziko avo. Kudzoserwa kwemari kusingaverengeki kwezuva rekutanga ("Kana iwe uchinzwa kuti Slurm haina kukukodzera, isu tichadzosera mutengo wakazara wetiketi") yakashandiswa nemunhu mumwe chete, achipembedza kuti akawedzera simba rake.
  3. Iyo inotevera Slurm ichaitika mukutanga kwaSeptember muSt. Selectel, mutsigiri wedu wechigarire, anopa kwete gore rezvimire chete, asiwo imba yake yemusangano.
  4. Tiri kudzokorora Slurm yakakosha (Gunyana 9-11) uye kuunza chirongwa chitsva: DevOps Slurm (Gunyana 4-6).

Chii chinonzi Slurm uye chachinja sei?

Gore rapfuura, takauya nepfungwa yekuitisa makosi paKubernetes. Muna Nyamavhuvhu '18, Slurm-1 yakaitika: yakaoma, neinoenderera mberi (apo mharidzo yapera pachikuva), neboka rezvinetso zvezuva nezuva. Miedzo inobatanidza: vatori vechikamu vekutanga Slurm, seFellowship yeRing, vachiri kutaurirana.

Slurm: gonye rakashanduka kuita shavishavi
Izvi ndizvo zvakaita Slurm-1

Pakutanga Slurm, pfungwa yekubata MegaSlurm yakazvarwa. Takabvunza vanhu misoro yavaifarira, uye muna October takaita kosi yepamusoro β€œNekukumbira vatori vechikamu.” Yakazove chiitiko chinonakidza, asi chenguva imwe chete. Pakazosvika Chivabvu '19 takagadzirira kosi yepamberi, ine pfungwa dzayo uye nhoroondo yemukati.

Mukufamba kwegore, Slurm yakachinja musangano:
- Docker naAnisble vakabviswa muchirongwa chikuru ndokuitwa akaparadzana online makosi.
- Yakarongeka tekinoroji rutsigiro iyo inobatsira vadzidzi kugadzirisa masumbu ekudzidza.
β€” Vatauri vava nerutsigiro rwenzira.

Slurm: gonye rakashanduka kuita shavishavi
Chikwata chakagadzira Slurm 4

Mhinduro kubva kuvatori vechikamu

Imwe rekodhi yakaiswa: 170 vatori vechikamu pane yakakosha Slurm, makumi manomwe neshanu paMegaSlurm.

Slurm: gonye rakashanduka kuita shavishavi

Slurm-4
101 kubva pavanhu 170 vakazadza fomu remhinduro.

Kubernetes ave pachena here?
41 - Handisati ndanzwisisa k8s, asi ndiri kuona pekuchera.
36 - Ndakanga ndisingazive k8s kare, asi ikozvino ndazvifunga.
23 - Ndakaziva k8s kare, asi ikozvino ndoziva zviri nani.
1 - Ini handina kudzidza chero chinhu chitsva.
0 - Hapana chandainzwisisa nezve k8s.

Unoda sei kusimba kweSlurm?

16 vanhu vanofunga kuti Slurm iri nyore uye inononoka, uye vanhu gumi nevaviri vanofunga kuti yakanyanya kuoma uye nekukurumidza. Zvakanaka kune vamwe vose.

Wagadzirisa dambudziko rawanga uchienda kuSlurm naro here?

90 - Hongu.
11 - Kwete.

MegaSlurm

Vanhu makumi mana vakazadza fomu remhinduro. 40 vanhu vakati zvaive nyore uye zvinononoka. Munhu 2 haana kugadzirisa dambudziko raaienda naro kuMega. Zvimwe zvacho zvakanaka.

Ongororo yeSlurm pa https://serveradmin.ru

Wongororo yevatauri

Slurm: gonye rakashanduka kuita shavishavi

Kana paSt. Petersburg Slurm munaFebruary pakanga pane vakawanda vanotanga, ipapo paMoscow Slurm vanhu vakawanda vakanga vatoedza Kubernetes. Paive nemibvunzo yakawanda yepamusoro yakaita kuti ufunge.

Kana ku St. Petersburg vakabvunza kuti taizobudisa rinhi fork yedu ye kubespray, zvino kuMoscow vakatobvunza kuti sei tichikumbira kushandisa fork yedu kwete kutora kubespray yepakutanga. Uku ndiko kutove kufunga kwakaoma kwevakuru vepakati.

Chiitiko chacho chakanga chakaoma, vanhu vakaita zvikanganiso zvakawanda, uye ndizvo zvakanaka: unoda kukanganisa paunenge uchidzidza, uye kwete muhondo.

Taigara tichisangana nemiganho pakuwana zvitupa, miganho pakurodha kubva kuGithub, nezvimwe. Uhwu ndihwo hupenyu - isu panguva imwe chete takaisa anenge mazana maviri masumbu muSelectel gore. Hapana anogadzirira zviwanikwa zvavo uye miganhu yeizvi.

Kuziviswa kweSlurm kuSelectel

β†’ Kunyoresa kweSlurm-5
Mutengo: 25 β‚½

Purogiramu:

Nyaya #1: Nhanganyaya kuKubernetes, zvinhu zvikuru
- Nhanganyaya kune k8s tekinoroji. Tsanangudzo, mashandisirwo, pfungwa
- Pod, ReplicaSet, Deployment, Service, Ingress, PV, PVC, ConfigMap, Chakavanzika

Nyaya Nhamba 2: Cluster design, zvikamu zvikuru, kukanganisa kushivirira, k8s network
-Cluster dhizaini, zvakakosha zvikamu, kukanganisa kushivirira
- k8s network

Nyaya #3: Kubespray, kugadzirisa uye kumisikidza boka reKubernetes
-Kubespray, kumisikidzwa uye kugadzirisa kweKubernetes cluster

Nyaya #4: Yepamberi Kubernetes Abstractions
-DaemonSet, StatefulSet, RBAC, Job, CronJob, Pod Kuronga, InitContainer

Nyaya #5: Kutsikisa masevhisi uye maapplication
-Kutarisisa kwesevhisi yekushambadzira nzira: NodePort vs LoadBalancer vs Ingress
- Ingress controller (Nginx): kuenzanisa traffic inouya
-Sert-maneja: tora otomatiki zvitupa zveSSL/TLS

Nyaya #6: Nhanganyaya kuHelm

Nyaya #7: Kuisa cert-maneja

Nyaya #8: Ceph: β€œita sezvandinoita” kuisa

Nyaya #9: Kutema nekutarisa
- Cluster yekutarisa, Prometheus
- Kutema matanda, Fluentd/Elastic/Kibana

Nyaya #10: Cluster update

Nyaya Nhamba 11: Basa rinoshanda, kushandisa dockerization uye kutanga muboka

Makosi paDocker uye Ansible pane stepik.org anosanganisirwa mumutengo.

β†’ Kunyoresa kweSlurm DevOps
Mutengo: 45 β‚½

Purogiramu:

Nyaya #1: Nhanganyaya kuGit
- Yekutanga mirairo git init, zvipira, wedzera, diff, log, chimiro, dhonza, sunda
- Kumisikidza nharaunda yenzvimbo: kurudziro inoshanda
- Git kuyerera, matavi uye ma tag, batanidza mazano
-Kushanda neakawanda kure repo

Nyaya #2: Kushandirapamwe neGit
- GitHub kuyerera
- Fork, bvisa, dhonza chikumbiro
-Kupokana, kuburitswa, zvakare nezve Gitflow uye kumwe kuyerera zvine chekuita nezvikwata

Nyaya #3: CI/CD sumo kune otomatiki
-Otomatiki mugit (bots, sumo kuCI, hoko)
- Zvishandiso (bash, gadzira, gradle)
- Mitsetse yegungano refekitari uye mashandisiro avo muIT

Nyaya #4: CI/CD: Kushanda neGitlab
- Vaka, edza, shandisa
-Matanho, akasiyana, kutonga kwekuita (chete, riini, zvinosanganisira)

Nyaya #5: Kushanda nechishandiso kubva padanho rekusimudzira
- Isu tinonyora microservice muPython (kusanganisira bvunzo)
-Kushandisa docker-compose mukusimudzira

Nyaya #6: Zvivakwa seKodhesi
- IaC: nzira yezvivakwa sekodhi
- IaC inoshandisa Terraform semuenzaniso
- IaC uchishandisa Ansible semuenzaniso
- Kushaya simba, declarativeness
- Dzidzira kugadzira Ansible playbooks
-Kugadzirisa kuchengetedza, kubatirana, kushandisa otomatiki

Nyaya #7: Kuyedzwa kwezvivakwa
-Kuyedza uye kuenderera kusanganisa neMolecule uye Gitlab CI

Nyaya Nhamba 8: Automation yekusimudza maseva
-Kuunganidza mifananidzo
- PXE uye DHCP

Nyaya #9: Infrastructure Automation
- Muenzaniso webasa rekuvaka remvumo pamaseva
- ChatOps (kubatanidzwa kwevatumwa ipapo nemapaipi)

Nyaya #10: Chengetedzo otomatiki
-Kusaina CI/CD zvigadzirwa
- Kusagadzikana kwekuongorora

Nyaya #11: Kuongorora
- Tsanangudzo yeSLA, SLO, Kukanganisa Budget uye mamwe mazwi anotyisa kubva munyika yeSRE
- SRE: SLI uye SLO yekutarisa maitiro
- SRE: Dzidzira kushandisa Kukanganisa Budget
- SRE: Kukanganisa uye kushanda mutoro manejimendi (apigateway, sevhisi mesh, wedunhu mabreak)
-Kuongorora mapaipi uye metrics ekusimudzira

Source: www.habr.com

Voeg