"Hope izano rakaipa." SRE yakasimba muMoscow, Kukadzi 3-5

Tiri kuzivisa kosi yekutanga inoshanda paSRE muRussia: Slurm SRE.

Munguva yezvakanyanya isu tichapedza mazuva matatu tichivaka, kuputsa, kugadzirisa uye kugadzirisa aggregator webhusaiti yekutengesa matikiti emufirimu.

"Hope izano rakaipa." SRE yakasimba muMoscow, Kukadzi 3-5

Isu takasarudza aggregator yetikiti nekuti ine akawanda ekutadza zviitiko: kuwanda kwevashanyi uye DDoS kurwiswa, kutadza kweimwe yeakawanda akakosha mamicroservices (mvumo, kuchengetedza, kubhadhara kubhadhara), kusawanikwa kweimwe yeakawanda mabhaisikopo (data exchange about zvigaro zviripo uye zvakachengetwa), uyezve pasi pasi.

Isu tichagadzira iyo pfungwa yeKuvimbika kune yedu aggregator saiti, iyo yatichawedzera kuvandudza muInjiniya, ongorora dhizaini kubva pakuona kweSRE, sarudza metrics, kumisikidza yavo yekutarisa, kubvisa zviitiko zvinobuda, kudzidzisa basa rechikwata nezviitiko. mumamiriro ezvinhu ari pedyo nekurwa, ronga kubvunzurudza .

Chirongwa ichi chinofambiswa nevashandi veBooking.com neGoogle.
Panguva ino hakuzovi nekutora chikamu kure: kosi inovakwa pakudyidzana kwemunhu uye kushanda pamwe chete.

Tsanangudzo pasi pekucheka

Vatauri

Ivan Kruglov
Mugadziri Mukuru paBooking.com (Netherlands)
Kubva paakajoinha Booking.com muna 2013, akashanda pamapurojekiti ezvivakwa sekuparadzira meseji kutumira uye kugadzirisa, BigData uye web-stack, kutsvaga.
Parizvino kushanda pazvinhu zvekuvaka gore remukati uye Service Mesh.

Ben Tyler
Mugadziri Mukuru paBooking.com (USA)
Yakabatanidzwa mukuvandudza kwemukati kweBooking.com papuratifomu.
Nyanzvi mune sevhisi mesh / sevhisi kuwanikwa, batch basa kuronga, chiitiko mhinduro uye postmortem maitiro.
Anotaura uye anodzidzisa muchiRussia.

Evgeniy Varavva
General Developer paGoogle (San Francisco).
Chiitiko kubva kune yakakwira-mutoro mapurojekiti ewebhu kutsvagisa mune komputa kuona uye marobhoti.
Kubva 2011, ave achibatanidzwa mukugadzira uye kushanda kwemaitiro akagoverwa paGoogle, achitora chikamu muhupenyu huzere hwepurojekiti: conceptualization, dhizaini uye dhizaini, kutanga, kupeta uye ese epakati matanho.

Eduard Medvedev
CTO kuTungsten Labs (Germany)
Akashanda seinjiniya kuStackStorm, ane mutoro weChatOps mashandiro epuratifomu. Yakagadziridzwa uye yakaitwa ChatOps yedata center automation. Mutauri pamusangano weRussia uye wepasi rose.

Purogiramu

Chirongwa ichi chiri kuvandudzwa. Zvino zvinoita seizvi, muna Kukadzi inogona kuvandudza nekuwedzera.

Nyaya #1: Nheyo dzekutanga uye nzira dzeSRE

  • Chii chinotora kuti uve SRE?
  • DevOps vs SRE
  • Nei vagadziri vachikoshesa SRE uye vakasuruvara zvikuru kana vasipo muchirongwa
  • SLI, SLO uye SLA
  • Kukanganisa bhajeti uye basa rayo muSRE

Nyaya #2: Dhizaini yeakagoverwa masisitimu

  • Application architecture uye kushanda
  • Non-Abstract Yakakura System Dhizaini
  • Kushanda / Dhizaini yekutadza
  • gRPC kana REST
  • Versioning uye kumashure kuenderana

Nyaya #3: Kuti chirongwa cheSRE chinogamuchirwa sei

  • Maitiro akanakisa kubva kuSRE
  • Chirongwa chekugamuchira chirongwa
  • Kutema miti, metrics, kutsvaga
  • Kutora CI/CD mumaoko edu

Nyaya Nhamba 4: Kugadzira uye kutangwa kwehurongwa hwakagoverwa

  • Reverse engineering - iyo system inoshanda sei?
  • Isu tinobvumirana paSLI uye SLO
  • Dzidzira kugona kuronga
  • Kutangisa traffic kune application, vashandisi vedu vanotanga "kuishandisa".
  • Kutangisa Prometheus, Grafana, Elastic

Nhaurirano #5: Kutarisisa, Kutariswa uye Kuzivisa

  • Monitoring vs. Kucherechedzwa
  • Kumisikidza kutarisa uye kunyevera nePrometheus
  • Kutarisisa kunoshanda kweSLI uye SLO
  • Zviratidzo vs. Zvinokonzera
  • Black-Bhokisi vs. White-Bhokisi Monitoring
  • Yakagoverwa kutarisa kwekushandisa uye kuwanikwa kweseva
  • 4 zviratidzo zvegoridhe (anomaly kuonekwa)

Nyaya Nha

  • Kushanda pasi pekumanikidzwa
  • Kukundikana-jekiseni
  • Chaos Monkey

Nyaya #7: Chiitiko chekupindura maitiro

  • Stress manejimendi algorithm
  • Kudyidzana pakati pevatori vechiitiko
  • Postmortem
  • Kugovera ruzivo
  • Kuumba tsika
  • Fault monitoring
  • Kuita hurukuro isina mhosva

Nhaurirano #8: Maitiro Ekutakura Mitoro

  • Load balancing
  • Kukanganisa kwechishandiso kushivirira: edzazve, nguva yekupera, jekiseni rekukundikana, redunhu rinotyora
  • DDoS (kugadzira mutoro) + Cascading Failures

Nyaya #9: Chiitiko Mhinduro

  • Kubvisa
  • On-Call Dzidzira
  • Mhando dzakasiyana siyana dzetsaona (kuyedza, shanduko yekuchinja, kutadza kwehardware)
  • Chiitiko manejimendi protocol

Nyaya #10: Kuongororwa uye kugadzirisa matambudziko

  • Kutema miti
  • Kugadzirisa
  • Dzidzira kuongorora uye kugadzirisa pane yedu application

Nyaya #11: Kuyedzwa kwekuvimbika kweSystem

  • Stress Testing
  • Configuration test
  • Performance test
  • Canary kuburitswa

Nyaya 12: Basa rakazvimirira uye kuongorora

Zvinokurudzirwa uye zvinodiwa kune vatori vechikamu

SRE ibasa rechikwata. Tinokurudzira zvikuru kutora kosi sechikwata. Ndosaka tichipa zvidzikiso zvakakura zvezvikwata zvakagadzirira-zvakagadzirwa.

Mutengo wekosi i60 β‚½ pamunhu.
Kana kambani ikatumira boka revanhu 5+ - 40 β‚½.

Iyo kosi inovakwa paKubernetes. Kuti upfuure, unofanirwa kuziva Kubernetes padanho rekutanga. Kana ukasashanda naye, unogona kuenda kuburikidza neSlurm Basic (ΠΎΠ½Π»Π°ΠΉΠ½ kana yakanyanya Mbudzi 18-20).
Mukuwedzera, iwe unofanirwa kuve nehunyanzvi muLinux uye kuziva Gitlab uye Prometheus.

kunyoresa

Kana iwe uine pfungwa yakaoma yekutora chikamu, semuenzaniso, kune CEO, CTO uye timu yevagadziri kuti vauye kuzodzidza, uye kuti vapinde muinternship vachifunga nezve manejimendi vertical, ndinyorere ini mune yako meseji.

Source: www.habr.com

Voeg