PagerDuty, kapena Chifukwa Chake Dipatimenti Yogwira Ntchito Singathe Kugona Usiku

Pamene dongosololi ndi lovuta kwambiri, limakhala lodzaza ndi mitundu yonse ya zidziwitso. Ndipo pakufunika kuchitapo kanthu ku zidziwitso zomwezi, kuziphatikiza ndi kuziwona m'maganizo. Ndikuganiza kuti izi ndizochitika zomwe anthu ambiri amazidziwa mpaka kuchita mantha.

Yankho lomwe lidzakambidwe silinali losayembekezereka, koma kusaka sikubweza nkhani yonse pamutuwu.

Chifukwa chake, ndidaganiza zogawana zomwe FunCorp idakumana nazo ndikulankhula za momwe ntchitoyo imapangidwira, omwe amayimba, chifukwa chiyani komanso momwe mungayang'anire zonse.

PagerDuty, kapena Chifukwa Chake Dipatimenti Yogwira Ntchito Singathe Kugona Usiku

Kodi PagerDuty ndi chiyani?

Kotero, kuti tithetse mavuto onsewa, tinayamba kufunafuna chida chothandiza. Pambuyo pofufuza, tinasankha PagerDuty. PD inkawoneka kwa ife ngati yankho lathunthu komanso lalifupi lokhala ndi zophatikizika zambiri ndi zoikamo. Kodi iye ndi wotani?

Mwachidule, PagerDuty ndi nsanja yopangira zochitika zomwe zimatha kukonza zochitika zomwe zikubwera kudzera muzophatikizira zosiyanasiyana, kukhazikitsa malamulo a ntchito ndikudziwitsa injiniya yemwe ali pantchitoyo malinga ndi momwe zachitikira (pamlingo wapamwamba - kuyimba, pamlingo wotsika - kukankha kuchokera ku pulogalamu / SMS).

Kodi wogwira ntchito ndi ndani?

Awa mwina ndi malo oyamba kuyamba kukhazikitsa PD.

Ku FunCorp, monga makampani ena, pali udindo wolemekezeka wantchito. Amapatsirana kuchokera kwa injiniya kupita ku injiniya kamodzi patsiku. Pali chotchedwa mzere woyamba ndi wachiwiri woyankha ku chenjezo lochokera ku PagerDuty. Tiyerekeze kuti chenjezo lofunika kwambiri lifika, ndipo ngati mphindi 10 pambuyo pa kuyitanira kwa wogwira ntchito kuchokera pamzere woyamba palibe chomwe chikuchitika (ie, sichinasamutsidwe ku chidziwitso chovomerezeka kapena kuthetsedwa), kuyitana kumapita kwachiwiri. ntchito injiniya. Izi zimakonzedwa mu PagerDuty yokha kudzera mu Ndondomeko za Escalation.

PagerDuty, kapena Chifukwa Chake Dipatimenti Yogwira Ntchito Singathe Kugona Usiku

Ngati wachiwiri wantchitoyo sayankha, chidziwitsocho chimabwereranso chachikulu kwa wogwira ntchito.

Chifukwa chake, chenjezo lililonse lomwe likubwera patsogolo silingasinthidwe. 

Tsopano tiyeni tione kumene zochitika zingachokere.

Timagwiritsa ntchito zophatikiza ziti?

PD imalandira zochitika zambiri zosiyanasiyana kuchokera ku mautumiki osiyanasiyana. Pakali pano tili ndi pafupifupi 25 ntchito zotere, ndipo kuti tizigwiritsa ntchito timagwiritsa ntchito zophatikizira zokonzeka kale.

  • Prometheus

Njira yayikulu yosonkhanitsira ma metrics ndi Prometheus. Zambiri zalembedwa kale pa HabrΓ©, ndingonena kuti tili ndi angapo a iwo m'malo osiyanasiyana: wina amasonkhanitsa ma metrics kuchokera kumakina ndi ma dockers, wina kuchokera ku Amazon services, wachitatu kuchokera ku makina a hardware. Telegraf imagwiritsidwa ntchito makamaka ngati metrics exporter.

  • Email

Panonso, ndikuganiza, zonse zikuwonekera bwino pamutuwu. Kuphatikiza uku kumagwiritsidwa ntchito kutumiza zidziwitso kuchokera ku zolemba zina zochitidwa ndi cron. PD imakupatsani adilesi inayake yomwe mumatumizako makalata. Popanga ntchito yokhala ndi kuphatikiza koteroko, mutha kukhazikitsa zofunikira, momwe zochitika zomwe zikubwera zidzasinthidwe, momwe mungapangire chenjezo (pa chilembo chilichonse chomwe chikubwera, chilembo chomwe chikubwera + lamulo linalake, ndi zina).

PagerDuty, kapena Chifukwa Chake Dipatimenti Yogwira Ntchito Singathe Kugona Usiku

  • lochedwa

Malingaliro anga, kuphatikiza kosangalatsa kwambiri. Pali nthawi zina zomwe zimachitika koma sizimakhudzidwa ndi zochitika. Chifukwa chake, tidawonjezera kuphatikiza kuchokera ku Slack kuti tipange chochitika. Ndiye kuti, mutha kulembera Slack yamakampani /callofduty zonse zimachedwa ndipo zidzasweka posachedwa ndipo PD idzakonza ndikutumiza zomwe zachitika kwa injiniya wantchito.

Timachita:

PagerDuty, kapena Chifukwa Chake Dipatimenti Yogwira Ntchito Singathe Kugona Usiku

Tikuwona:

PagerDuty, kapena Chifukwa Chake Dipatimenti Yogwira Ntchito Singathe Kugona Usiku

  • API

Kuphatikiza kwa HTTP. M'malo mwake, palibe chosangalatsa apa, kungopempha POST yokhala ndi thupi mumtundu wa JSON. Mwachitsanzo, chinthu chosangalatsa: timachigwiritsa ntchito poyang'anira kunja pogwiritsa ntchito https://www.statuscake.com/. Ntchitoyi imayang'ana kupezeka kwa masamba athu kuchokera kumadera osiyanasiyana padziko lapansi. Ngati tilandira nambala yoyankhira yosavomerezeka (mwachitsanzo, 502), chochitika chimapangidwa ndiyeno zonse zimatsata unyolo womwe wafotokozedwa pamwambapa. StatusCake palokha imatha kuyang'anira ma URL amkati, satifiketi ya SSL kapena kutha kwa domain.

  • LibreNMS

Ili ndi dongosolo lina lowunika, mutha kuwerenga zambiri za izo patsamba lawo https://www.librenms.org/. Ndi chithandizo chake, timayang'anira ma network ndi iDRAC kuchokera ku maseva.

PagerDuty, kapena Chifukwa Chake Dipatimenti Yogwira Ntchito Singathe Kugona Usiku

Panalinso zophatikizira monga Datadog, CloudWatch. Mutha kuwona zambiri za zomwe zidawachitikira pomwe pano.

Kuwonetseratu

Njira yayikulu yofotokozera zochitika ndi Slack. Zochitika zonse zomwe zikubwera ku PD zimalembedwera kumacheza apadera, ndipo ngati mawonekedwe awo asintha, izi zimawonetsedwanso pamacheza.

PagerDuty, kapena Chifukwa Chake Dipatimenti Yogwira Ntchito Singathe Kugona Usiku

Mpata utapezeka wowonetsa zidziwitso zothandiza paziwonetsero za oyang'anira atapachikidwa padenga, tinazindikira mwadzidzidzi kuti ife (mu dipatimenti ya devops) tinalibe chilichonse chowonetsa. Pali Grafana yodabwitsa, koma siyimakhudza chilichonse, ndipo ogwira ntchito amalandila zidziwitso, osati ma chart.

Pambuyo pofufuza mozama koma osachita bwino pa GitHub pa "board" yachidule komanso yodziwitsa za PD, tinaganiza zolemba zathu - zokhazo zomwe timafunikira. Ngakhale poyamba panali lingaliro lowonetsera mawonekedwe a PD okha, zinkawoneka zovuta kwambiri.

Kuti mulembe, zomwe muyenera kuchita ndikupeza kiyi kuchokera ku PD yokhala ndi ufulu wowerengera.
Ndipo izi ndi zomwe tili nazo:

PagerDuty, kapena Chifukwa Chake Dipatimenti Yogwira Ntchito Singathe Kugona Usiku

Chophimbacho chikuwonetsa zomwe zikuchitika panopo, dzina la injiniya wapano yemwe ali pantchito kuchokera pandandanda yosankhidwa, ndi nthawi yopanda chochitika chofunikira kwambiri (gulu lomwe lili ndi chochitika chofunikira kwambiri liziwonetsedwa mofiira).

Onani magwero a kukhazikitsa uku.

Chotsatira chake, tinalandira dashboard yabwino yowonera zochitika zathu zonse. Ndikhala wokondwa ngati ena a inu apeza zomwe takumana nazo kukhala zothandiza.

Source: www.habr.com

Kuwonjezera ndemanga