CASE method: humane monitoring

CASE method: humane monitoring
Dziiiiin! Nws yog 3 sawv ntxov, koj tau npau suav zoo, thiab tam sim ntawd muaj ib tug hu. Koj ua haujlwm rau lub lim tiam no, thiab pom tau tias muaj qee yam tshwm sim. Lub kaw lus automated hu kom paub tias qhov tsis raug. Qhov no yog ib qho tseem ceeb ntawm kev tswj xyuas cov khoos phis tawj niaj hnub no, tab sis cia saib yuav ua li cas kom cov ntawv ceeb toom zoo dua rau tib neeg.

Tau txais kev paub txog kev saib xyuas lub tswv yim, yug ntau xyoo ntawm kuv txoj haujlwm hauv pab pawg saib xyuas sib txawv. Nws tau raug cuam tshuam los ntawm phau Vajlugkub tiag los ntawm Rob Evashchuk Kuv Philosophy ntawm Alerting (Kuv Daim Ntawv Ceeb Toom Philosophy) suav nrog hauv phau ntawv ntawm Google SRE, thiab phau ntawv los ntawm John Alspaugh Kev txiav txim siab rau Alert Design (Cov lus ceeb toom ntawm kev teeb tsa kev ceeb toom).

Kelly Dunn, Arijit Mukheryi: koj puas xav tau ntau tus thwjtim? ΠΈ Maxim Petazzoni - Ua tsaug rau koj txoj kev pab kho cov ntawv tshaj tawm.

CASE yog dab tsi?

Kuv txiav txim siab tuaj nrog tus tsiaj ntawv zoo nkauj zoo li Brendan Gregg's USE method los yog Tom Wilkie txoj kev RED. kuv hu nws CAS method. Nws piav txog plaub lub ntsiab lus uas yuav tsum tau saib xyuas thaum ua haujlwm nrog kev saib xyuas tsis siv neeg:

Yog tias koj siv CASE, koj kho cov ntawv ceeb toom nrog kev noj qab haus huv indifference thiab tsis txhob tsa tib neeg thaum hmo ntuj. Kev soj ntsuam xyuas yuav tsum tau soj ntsuam tsis tu ncua kom muaj txiaj ntsig thiab ua tau zoo. Thaum ib tug neeg tau txais kev ceeb toom, lawv yuav muaj cov qauv kev xav zoo dua thiab kev ntseeg siab dua.

Yuav kom nws nco qab yooj yim dua, xav txog tias koj xav tau CASE [uas yog, rooj plaub, laj thawj - tus neeg txhais lus sau tseg] kom pom tseeb txhua qhov ceeb toom. :sunglasses:

Thiab yog vim li cas tag nrho cov no?

Kev ua haujlwm tuaj yeem ua rau mob. Rau ntau yam. Thiab CASE yuav tsis tshem lawv tag nrho. Tab sis nrog nws, koj yuav sawv thaum hmo ntuj kom cov ntawv ceeb toom zoo dua. Txoj kev no suav nrog ntau lub koom haum txheej txheem uas yuav pab tau rau qhov teeb meem no.

Kev zoo nkauj ntawm RED thiab USE txoj kev yog tias nrog lawv cov kev pab peb tsis tsuas yog paub yuav ua li cas ua haujlwm, tab sis kuj hais lus tib yam nrog ib leeg. Kuv txoj kev cia siab yog tias CASE txoj kev yuav ua rau nws yooj yim dua los tham txog cov ntawv ceeb toom uas tiv thaiv peb cov kab ke tab sis ua kom peb cov npoj yaig tsis khoom.

Lub ntsiab lus yog tias koj yuav tsum tsim kom muaj kab lis kev cai hauv koj lub koom haum uas cov ntawv ceeb toom raug kho nrog kev noj qab haus huv indifference. Cov ntawv ceeb toom tuaj yeem tsim rau lub hom phiaj tshwj xeeb, tab sis nws tsis yog qhov tseeb tias lawv yuav tsis poob nqi tom qab. Vim li cas peb thiaj teeb tsa qhov kev ceeb toom no? Ntev npaum li cas nws cov txheej txheem tau hloov kho? Nrog CASE, cov lus nug no tuaj yeem teb tau.

Context-Havy - ntsiab lus khi

3 teev sawv ntxov tsis yog lub sijhawm zoo tshaj plaws los nyeem cov lus uas muaj ntau lo lus ntse. Yuav kom teb tau zoo, koj xav tau cov ntaub ntawv. Qhov zoo tshaj plaws, qhov no yuav tsum yog cov ntaub ntawv hais txog qhov teeb meem tshwj xeeb, uas cov ntsiab lus tseem ceeb tam sim ntawd, thiab cov ntawv ceeb toom yuav tsum tau teeb tsa kom qhov no ua tau. Qhov no yog "kev soj ntsuam" thiab "kev taw qhia" los ntawm OODA rov. Nws tsis yog qhov txaj muag los siv sijhawm rau kev teeb tsa no, vim tias tsis tu ncua cuam tshuam tus neeg tseem kim dua. Wb sib hwm.

CASE method: humane monitoring
Teeb meem muaj ntau qhov chaw. Tshwj xeeb yog dab.

Kuv tuaj yeem pab tus tub ceev xwm li cas? Thawj qhov uas tus tub ceev xwm pom pom yog kev ceeb toom, yog li nws tsim txhua qhov kev xav ntawm nws lub hauv paus. Tom qab ntawd nws saib cov lus qhia thiab dashboards, tab sis puas muaj ib txwm muaj cov ntaub ntawv ntawm kev ceeb toom tshwj xeeb, thiab tsis yog cov ntaub ntawv dav dav? Alspaugh qhia β€œxav seb koj yuav txhais li cas lossis teb rau qhov kev ceeb toom” (swb 29)1. Kev ceeb toom zoo yog tsom rau tus neeg ua haujlwm, tsis yog teeb tsa los ntawm qhov pib.

Yog li ntawm no yog qee cov tswv yim yuav ua li cas los txhim kho cov ntsiab lus ceeb toom:

  • Qhia tus neeg siv tej yam muaj txiaj ntsig thiab tsim tshwj xeeb, thiab tsis yog cov lus qhia zoo tib yam lossis lub dashboard. Yav dhau los, cov txiv neej thiab kuv tau siv kev tshawb nrhiav dashboards teeb tsa rau cov ntawv ceeb toom tshwj xeeb. Qhov no yuav pab yog tias qhov teeb meem paub, tab sis tsuas yog ua rau lwm tus tsis meej pem. Peb yuav tsum nrhiav qhov sib npaug ntawm no.
  • Qhia peb txog keeb kwm ntawm kev ceeb toom: puas yog tshiab? Nws puas ua haujlwm ntau zaus? Puas yog raws caij nyoog?
  • Qhia cov kev hloov tsis ntev los no rau lub xeev system. Puas muaj dab tsi hloov tsis ntev los no? (Piv txwv li, kev xa tawm lossis ua kom muaj / tsis ua haujlwm.)
  • Qhia cov kev sib raug zoo thiab muab cov ntaub ntawv rau cov qauv kev puas siab puas ntsws: qhov system dependencies yuav tsum pom meej meej, zoo dua nrog qhov qhia txog kev ua haujlwm.
  • Txuas tus neeg siv ceev nrooj nrog pab pawg: lawv puas tuaj yeem pom cov xwm txheej tsis tu ncua lossis lawv puas tuaj yeem nrhiav pom lwm tus hauv tuam txhab tau txais kev ceeb toom? Program kev tswj qhov xwm txheej qhib?

Qhov zoo tshaj plaws, qhov kev tswj xyuas qhov xwm txheej yuav muab cov lus qhia txog yuav ua li cas txhawm rau txhim kho cov ntsiab lus ceeb toom ntawm kev tshawb nrhiav qhov xwm txheej. Muaj ib txwm ua haujlwm!

Actionable - tswv yim nqi

Tus tub ceev xwm puas yuav tsum ua ib yam dab tsi los teb rau qhov kev ceeb toom? Yog tias koj tsis xav ua dab tsi lossis tsis paub meej tias yuav ua li cas, vim li cas koj thiaj li tsa nws? Koj yuav tsum zam cov ntawv ceeb toom uas cuam tshuam cov neeg ua haujlwm thiab tsis tas yuav tsum ua.

Saib post ntawm imgur.com

Kuv yuav ua li cas? Koj xav li cas?

Yav dhau los, thaum cov txheej txheem yooj yim thiab pab pawg me, peb teeb tsa kev saib xyuas tsuas yog nyob rau saum cov khoom. Kev ceeb toom tias cov khoom thauj ntawm lub heap tau nce ntxiv yuav ua rau peb cov ntsiab lus yog tias qhov kev pabcuam tom qab ua haujlwm tsis zoo. Ntawm qhov loj, cov ntawv ceeb toom no tsuas yog tsim kev tsis meej pem vim tias peb lub tshuab ua haujlwm ib txwm ua haujlwm nyob rau hauv lub xeev ntawm degradation ntawm qhov sib txawv loj. Qhov no sai ua rau qaug zog los ntawm kev ceeb toom thiab, ntawm chav kawm, kom poob ntawm rhiab heev. Yog li ntawd, tus tub ceev xwm tsis quav ntsej lossis txawm lim cov ntawv ceeb toom thiab tsis tas yuav teb rau lawv raws li xav tau. Tsis txhob poob rau hauv qhov ntxiab no! Tsis txhob teeb tsa tag nrho cov ntawv ceeb toom nyob rau hauv kab thiab tom qab ntawd xa lawv los ntawm email rau qee qhov godforsaken folder.

Nov yog daim ntawv ceeb toom nrog tus nqi siv tau zoo li:

  • Kev ceeb toom yuav tsum tau ua ntau dua li tsuas yog tshaj tawm xov xwm.
  • Qhov kev txiav txim no yog qhov nyuaj los yog pheej hmoo rau automate. Yog tias qhov kev txiav txim tuaj yeem ua haujlwm tau, ces automate nws, tsis txhob ua phem rau tib neeg!
  • Daim ntawv ceeb toom muaj cov lus qhia ceev ceev hauv daim ntawv cov ntawv cog lus qib kev pabcuam (SLA) lub rov qab lub sij hawm phiaj (RTO). Tus tub ceev xwm lub luag haujlwm tuaj yeem qhib lub koom haum qhov kev tswj xyuas qhov xwm txheej.

Kuv xav qhia meej: Kuv tsis tau hais tias cov ntawv ceeb toom tsuas yog tuaj rau SLOs tseem ceeb tshaj plaws (cov hom phiaj kev pabcuam) rau API. Kev saib xyuas SLO yog tas li fragmented thiab faib thiab xav tau tib txoj hauv kev rau txhua qhov kev pabcuam. Nws yog qhov tseeb tias koj yuav tau taug qab SLOs tseem ceeb tshaj plaws rau cov neeg siv khoom uas them koj. Tab sis cov txheej txheem SLOs, xws li databases, kuj yuav tsum tau saib xyuas. Tsis ntev koj yuav tau nrog cov neeg siv khoom sab hauv thiab txhawb nqa lawv. Thiab yog li ntawm ad infinitum.

Symptom-based - tsom rau cov tsos mob

Txawm hais tias koj nyiam lossis tsis nyiam, koj tab tom ua haujlwm hauv kev faib tawm (Kavaj)2. Raws li qhov tshwm sim, koj siv cov tswv yim sib txawv los cais cov kev pabcuam thiab tiv thaiv lawv los ntawm kev ua tsis tiav (Trainor et al.)3. Thiab txawm hais tias ncua sij hawm khaws cov khib nyiab los yog cov lus nug hauv cov ntaub ntawv stalled qhia txog cov teeb meem, tsis tas yuav maj kho lawv yog tias cov neeg siv tsis muaj teeb meem yav tom ntej.

Cov no yog cov cim tseem ceeb thiab tej zaum yuav muaj txiaj ntsig zoo, tab sis yog tias lawv tsis cuam tshuam cov neeg siv, ces nws tsis ceev txaus los cuam tshuam tus neeg saib xyuas. Cov ntawv ceeb toom ua rau yog cov duab ntawm peb cov qauv kev puas siab puas ntsws hais txog qhov tsis ua haujlwm. Nws yog qhov zoo dua los taug qab cov tsos mob tseem ceeb dua li sim sau txhua qhov ua rau ua tsis tiav.

Txhawm rau ua kom cov ntawv ceeb toom muaj txiaj ntsig, tsom mus rau ntsuas kev ua tau zoo, tseem ceeb rau cov neeg siv. Evashchuk hu qhov no "kev saib xyuas rau cov neeg siv." Nco ntsoov tias txoj kev xav no yuav tsum tau siv thoob plaws hauv lub koom haum. Yog tias ib qho kev pabcuam muaj teeb meem ceev rau qhov chaw tob hauv cov txheej txheem, pab pawg tsim nyog yuav saib xyuas lawv. Kev tiv thaiv kab ke los ntawm cov kev ua tsis tiav no yog ib qho teeb meem nkaus xwb (Trainer et al., seem ntawm cov tswv yim los txo cov kev cuam tshuam tseem ceeb)3.

Cov tsos mob tsis txawv txav

Richard Cook qhia peb tias cov txheej txheem nyuaj yog tag nrho ntawm qhov tsis zoo, qhov tsis txaus thiab teeb meem4. Sim sau tag nrho cov laj thawj uas ua tau yog txoj haujlwm Sisyphean. Koj sim piav qhia txog cov teeb meem, tab sis lawv hloov txhua lub sijhawm. Cindy Sridharan ntseeg hais tias "cov kab ke tsis tas yuav tsum nyob hauv qhov zoo tshaj plaws txhua ob" thiab nws yog qhov zoo dua los siv tib neeg txoj hauv kev ("Distributed Systems Observability" (β€œKev Saib Xyuas Cov Txheej Txheem Sib Txuas”), 7)5.

Tsis txhob ceeb toom tom qab muaj xwm txheej

Feem ntau, cov ntawv ceeb toom rau cov laj thawj raug teeb tsa los kho qhov xwm txheej. Thiab cov ntawv ceeb toom txwv no hais txog qhov tseeb ntawm qhov tshwm sim ua rau muaj kev nkag siab tsis tseeb ntawm kev nyab xeeb, vim hais tias lub kaw lus txhua zaus tuaj nrog txoj hauv kev tshiab los rhuav tshem.

Tsis txhob dag los ntawm kev ceeb toom. Zoo dua xav:

  • Vim li cas ho tsis ceeb toom cov tsos mob tshwm sim?
  • Nws puas yuav pab tau kom txhim kho cov ntsiab lus rau tus neeg siv?
  • Yuav ua li cas soj ntsuam cov cuab yeej txhim kho kom kuaj xyuas sai dua, tsis yog sau cov ntawv ceeb toom txog dab tsi tshwm sim?

Kev soj ntsuam cov cuab yeej rau kev kuaj mob tsuas yog pab tau yog tias koj xav tias lawv yog ib txoj hauv kev txav ntawm cov tsos mob mus rau kev daws teeb meem. Yog tsis muaj kev tawm tswv yim no, koj tsuas yog yuav raug foob nrog cov ntawv ceeb toom lig thiab cov duab qhia txog kev ua tsis tiav yav dhau los - thiab tsis yog ib lo lus hais txog yav tom ntej. Qhov no yog lub sijhawm zoo rau lub koom haum txav los ntawm kev tiv thaiv mus rau kev tawm tsam. Thiab cov neeg tsim khoom thiab cov neeg tswj xyuas cov khoom yuav muaj qhov kev cia siab zoo ib yam thiab cov hom phiaj meej. Cov ntaub ntawv - CASE (:wink:) - yog qhov tseeb rau txhua qhov kev ceeb toom.

Cov ntawv ceeb toom raws li laj thawj yog zam tau rau hauv kev sib haum xeeb

Qee lub sij hawm peb lub kaw lus cia peb xaiv me ntsis ntawm cov lus ceeb toom raws li qhov ua rau. Thiab qee zaum cov neeg ua haujlwm nkag siab zoo kawg nkaus tias cov tsos mob yuav ua rau muaj kev tsis ua haujlwm, thiab yog li ntawd muaj txiaj ntsig zoo. Tej zaum koj tsuas yog tsis paub tseeb tias muaj dab tsi tshwm sim thiab teeb tsa cov ntawv ceeb toom kom nyob rau sab nyab xeeb. Vam tias qhov kev txiav txim no yog ib ntus kom txog thaum peb tuaj yeem hloov kho qhov system los daws qhov teeb meem kev ua haujlwm.
Khaws lwm yam khoom ntawm CASE hauv siab thaum cuam tshuam nrog cov xwm txheej no. Tsuas yog vim nws yog ib ntus tsis txhais hais tias koj tuaj yeem nres xav nrog koj lub taub hau.

Kev ntsuas - ntsuas

Txhua qhov kev hloov pauv rau lub kaw lus (cov cai tshiab, cov txheej txheem tshiab, txhua yam tshiab) nthuav dav qhov kev ua tsis tiav (Cook, 3).4 Cov ntawv ceeb toom no puas tseem ua haujlwm raws li qhov xav tau? Ntshiab thiab tam sim no cov qauv kev puas siab puas ntsws ntawm cov tshuab thiab kev paub txog kev teb rau qee cov ntawv ceeb toom tiv thaiv txoj hauv kev - Cov no yog cov yam ntxwv tseem ceeb lub koom haum kawm-oriented. Cov kev tsis zoo nyob rau hauv lub tshuab yog hloov zuj zus mus tas li, thiab peb yuav tsum ua raws li lawv.

Koj yuav tsum tau ntsuas qhov zoo ntawm txhua qhov kev ceeb toom kom ntseeg tau tias lawv ua haujlwm raws li qhov xav tau. Nyob zoo cov thawj coj! Nws yuav yooj yim dua rau koj pab pawg yog tias koj pab lawv tsim cov txheej txheem no! Nov yog qee cov tswv yim ntsuam xyuas:

  • Siv chaos engineering, hnub ua si los yog lwm txoj kev kuaj kev ceeb toom. Pab neeg no tuaj yeem ua lawv tus kheej yam tsis tas yuav cia siab rau kev tswj hwm qhov xwm txheej hnyav!
  • Muab cov ntaub ntawv sau tseg ntawm txhua qhov xwm txheej ntsig txog kev ceeb toom rau hauv koj qhov kev tswj hwm qhov xwm txheej. Kos qhov muaj txiaj ntsig, tsim kev puas tsuaj, tsis tsim nyog, tsis meej, thiab lwm yam. Siv lawv raws li kev tawm tswv yim.
  • Cov ntawv ceeb toom txoj cai tau tshwm sim tsis tshua muaj thiab raug sim ua tib zoo. Nco ntsoov tias txhua qhov txuas ua haujlwm, taw tes rau cov ntsiab lus raug, thiab lwm yam.
  • Yog tias qhov kev ceeb toom tsis tau hluav taws kub lossis hluav taws kub ntau dhau, muaj qee yam tsis raug rau nws. Kho nws los yog tshem tawm. Ceev faj ntawm kev ua siab ntev lossis kev ua si!
  • Teem lub sij hawm ceeb toom nrog cov hnub tas sij hawm. Yog tias hnub tas sij hawm tau tas sij hawm, ntsuas qhov kev ceeb toom uas siv CASE txoj kev thiab hloov kho lub sij hawm. Ib yam li cov zaub mov, xyuas cov hnub tas sij hawm tsis tu ncua.
  • Simplify cov txheej txheem ntawm kev txhim kho cov ntawv ceeb toom. Siv kev saib xyuas raws li cov cai thiab khaws cov ntawv ceeb toom hauv Git repository. Rub cov lus thov pab koom nrog pab pawg thiab muab keeb kwm ntawm cov ntawv ceeb toom yav dhau los rau koj. Thiab koj yuav tsis ntshai hloov cov ntawv ceeb toom lossis thov kev tso cai los ntawm cov neeg ua haujlwm rau lawv.
  • Teeb tsa kev tawm tswv yim rau cov ntawv ceeb toom, txawm tias nws yooj yim Google daim ntawv, yog li cov tub ceev xwm lub luag haujlwm cim cov ntawv ceeb toom tsis muaj txiaj ntsig lossis cuam tshuam. Embed ib qhov txuas lossis hu mus rau qhov kev ceeb toom nws tus kheej thiab tshuaj xyuas koj cov lus tawm tswv yim tsis tu ncua.
  • Tsim ib txoj cai hauv pab pawg - cia cov neeg ua haujlwm hauv lub luag haujlwm kom yooj yim lub luag haujlwm thaum muaj kev ua haujlwm me me. Thov kom txhua yam tom qab koj ua tau zoo dua li yav dhau los.

xaus

Kuv ntseeg tias CASE txoj kev pab cov neeg tsim khoom thiab cov koom haum sib tham txog kev teeb tsa thiab xa cov ntawv ceeb toom tsis siv neeg. Ib tus neeg tsim tawm tuaj yeem pib ntsuas cov ntawv ceeb toom siv txoj hauv kev CASE, thiab tom qab ntawd tag nrho lub koom haum yuav koom nrog lwm tus neeg tsim khoom, kev tswj hwm, thiab kev tswj hwm qhov xwm txheej kom khaws cov ntawv ceeb toom kom zoo. Qhov no tsis tas yuav muaj cov cuab yeej tshwj xeeb lossis cov txheej txheem nyuaj.

Tag nrho kev lag luam yuav tsum xav txog tib neeg qhov tseem ceeb thaum ua haujlwm yam tsis muaj kev cuam tshuam rau cov neeg siv khoom zoo tshaj plaws. Tag nrho cov cuab yeej thiab kev coj ua no tuaj yeem thiab yuav tsum tau txhim kho. Kuv vam tias txoj kev CASE yuav pab tau qhov no.

Txaus siab rau cov ntawv ceeb toom zoo dua!
CASE method: humane monitoring

Tau qhov twg los: www.hab.com

Ntxiv ib saib