Gulu lathu limakonda zoyeserera. Chilichonse cha Slurm sichimangobwerezabwereza cham'mbuyomo, koma kusinkhasinkha pazochitika ndi kusintha kuchokera ku zabwino kupita ku zabwino. Koma ndi tinaganiza zogwiritsa ntchito mtundu watsopano - kupatsa ophunzira mikhalidwe yoyandikira kwambiri "kulimbana".
Ngati tifotokoza mwachidule zomwe tidachita pamaphunzirowa: "Timamanga, timaphwanya, timakonza;
tikuphunzira." SRE ndiyofunika pang'ono m'malingaliro chabe - kungochita, mayankho enieni, mavuto enieni.
Ophunzirawo adagawidwa m'magulu kuti mzimu wampikisano wamphamvu usalole aliyense kugona kapena kuyambitsa "Mbalame Zolusa" pa iPhone, potsatira chitsanzo cha Dmitry Anatolyevich.
Mavuto, glitches, nsikidzi ndi ntchito zinaperekedwa kwa ophunzira ndi alangizi anayi. Ivan Kruglov, Principal Developer at Booking.com (Netherlands). Ben Tyler, Woyambitsa Wamkulu ku Booking.com (USA). Eduard Medvedev, CTO ku Tungsten Labs (Germany). Evgeniy Varavva, wopanga wamkulu ku Google (San Francisco).
Komanso, otenga nawo mbali amagawidwa m'magulu ndikupikisana wina ndi mnzake. Zosangalatsa?
Ivan, Ben, Eduard ndi Evgeniy akuyang'ana osauka a Slurm SRE omwe ali ndi Leninist okoma mtima asanayambe mpikisano.
Kenako ntchito:
Ndife athu, tidzamanga dziko latsopano...
Pali webusayiti yophatikiza matikiti amakanema. Zochitika zimapangidwa ndi alangizi muzochitika zomwe zidakonzedweratu (ngakhale palibe amene amapatula kutukuka kwamakono komanso kobisika), momwe tsambalo limagwirira ntchito limafotokozedwa ndi ma metric osiyanasiyana. Mavuto amatha kukhala osiyana kwambiri: matikiti a Moulin Rouge theatre samayikidwa mu database; zikwangwani zamakanema ndi zisudzo zimayikidwa munkhokwe mumasekondi opitilira 10; kufotokoza filimu payekha amaundana; 0,1% ya maoda asungidwa kale; Nthawi ndi nthawi njira yoyendetsera ndalama imawonongeka kwa mphindi imodzi kapena ziwiri. Ndipo zambiri, zambiri, zambiri zosasangalatsa zomwe zitha kukumana ndi wochita nawo Slurm SRE pantchito yake yeniyeni.
Ndife okonzeka kuthana ndi chilichonse ... ndi aliyense.
Webusaiti yathu yoleza mtima imakhala ndi ma microservice angapo. Ntchito yake ndikuphatikiza ziwonetsero, mitengo ndi mipando yomwe ilipo kuchokera kumakanema onse; imawonetsa zolengeza zamakanema, imakulolani kusankha kanema, chiwonetsero, holo ndi malo, buku ndikulipira matikiti. Nthawi zambiri, chilichonse chomwe wowonera amatha kungolota. Koma wogwiritsa ntchito samakayikira ngakhale kulimbana kwakukulu kwa kukhazikika ndi kupezeka kwa tsambalo kukuchitika mkati.
Pamalo ozama, tidapanga zizindikiro za SLO, SLI, SLA, zomanga zomanga ndi zomangamanga, tidatumiza malowa, kukhazikitsa kuwunika ndi kuchenjeza. Ndipo timapita.
SLO, SLI, SLA
SLI - zizindikiro za msinkhu wa utumiki. Ma SLO ndi zolinga za mulingo wautumiki. SLA - mgwirizano mulingo wautumiki.
SLA ndi njira ya ITIL yomwe imatanthawuza mgwirizano wokhazikika pakati pa kasitomala wa ntchito ndi wopereka, womwe uli ndi kufotokozera za utumiki, ufulu ndi udindo wa maphwando ndipo, chofunika kwambiri, mlingo wogwirizana wa khalidwe loperekedwa kwa izi. utumiki.
SLO ndi cholinga cha mulingo wautumiki: mtengo womwe chandamale kapena kuchuluka kwamitengo yamtundu wautumiki womwe umayesedwa ndi SLI. Mtengo wabwinobwino wa SLO ndi "SLI β€ Target" kapena "Lower Limit β€ SLI β€ Upper Limit".
SLI ndi chizindikiro cha mlingo wa utumiki-chiwerengero chodziwika bwino cha gawo limodzi la mlingo wa utumiki woperekedwa. Kwa mautumiki ambiri, SLI yofunikira imatengedwa ngati kupempha latency - zimatenga nthawi yayitali bwanji kubwezera yankho ku pempho. Ma SLI ena odziwika amaphatikizapo kuchuluka kwa zolakwika, zomwe nthawi zambiri zimawonetsedwa ngati kachigawo kakang'ono ka zopempha zonse zomwe zalandilidwa, ndi kutulutsa kwadongosolo, zomwe nthawi zambiri zimayesedwa pazopempha pamphindikati.
Choyamba, tidzathyola ndege, ndiyeno atsikana, ndiyeno atsikana ...
Zinthu zamkati ndi zakunja zidayamba "kuwononga" SLO kuyambira mphindi zoyambirira. Chilichonse chinagwera pamitu ya olamulira-zolakwa za otukula, kulephera kwa zomangamanga, kuchuluka kwa alendo, ndi kuukira kwa DDoS. Chilichonse chomwe chimayipitsa SLO.
"- Okondedwa otenga nawo mbali, ndikufulumira kukusangalatsani, chinthu choyamba chomwe mumalephera ndi ... chilichonse!"
Ali m'njira, okamba nkhani adakambirana za kukhazikika, bajeti yolakwika, kuyesa kuyesa, kuyang'anira zosokoneza ndi katundu wa ntchito.
Ife sitiri stoker, si akalipentala...
Kenaka ophunzirawo anayamba kukonza zinthu - chinthu chachikulu ndikumvetsetsa zomwe mungatenge poyamba.
"- Ambuye, sindinawonepo kuti ikusweka motere, mumkhalidwe woterewu komanso momwemo!"
Choncho, panachitika ngozi. Ntchito yokonza malipiro yatsika. Kodi mungatani kuti mubwezeretse magwiridwe antchito munthawi yochepa kwambiri?
Akatswiri, akuyang'ana mwachikondi kwa omwe atenga nawo mbali, akukonzekera chinyengo china.
Gulu lirilonse limapanga ntchito ya gulu kuti lithetse ngozi - limaphatikizapo anzawo, limadziwitsa anthu omwe ali ndi chidwi (okhudzidwa). PanthaΕ΅i imodzimodziyo, zinthu zofunika kwambiri zimaikidwa. Mwanjira imeneyi, otenga nawo mbali adaphunzitsidwa kuti azigwira ntchito movutikira nthawi yochepa kwambiri.
"Ndi zoopsa zotani zomwe zatuluka?!"
Exhale ... ndikumaliza masewerawa
Pamodzi ndi okamba nkhani, vuto lililonse litathetsedwa ndipo malowo adakhazikika kwakanthawi, gululo linaphunzira zochitikazo kuchokera ku SRE. Tinasanthula mavutowo mwatsatanetsatane - zomwe zimayambitsa zochitika, kupita patsogolo kwa kuthetsa. Pambuyo pake, onse a gulu ndi gulu komanso palimodzi, tinapanga zisankho za momwe tingawatetezere: momwe mungapititsire kuwunikira, momwe mungasinthire mwanzeru zomangamanga, momwe mungasinthire njira yachitukuko ndi ntchito, momwe mungakonzere malamulo. Okambawo adawonetsa mchitidwe wochita post-mortem.
βNdaninso akufuna kuzunzidwa! -ine!"
Kupambana kwamagulu kunalembedwa mosamalitsa komanso momveka bwino pa boardboard yamagetsi.
Kwa malo oyamba - bonasi kuchokera kwa okhudzidwa.
Source: www.habr.com