Isu takafunga nezve kugadzira yekutarisa sisitimu padanho rekugadzira zvikwata zvechigadzirwa. Zvakava pachena kuti bhizinesi redu - kushandiswa - hakuwire muzvikwata izvi. Nei zvakadaro?
Icho chokwadi ndechekuti zvikwata zvedu zvese zvakavakwa zvakatenderedza ega ega ruzivo masisitimu, mamicroservices uye kumberi, saka zvikwata hazvione hutano hwese hwese system yese. Semuenzaniso, vangave vasingazive kuti chimwe chikamu chidiki muyakadzika backend chinokanganisa kumberi kumagumo. Chiyero chavo chekufarira chinogumira kune masisitimu ayo system yavo yakabatanidzwa nayo. Kana boka nebasa rayo A rinenge risina kubatana nebasa B, saka sevhisi yakadai inenge isingaonekwe kuchikwata.
Boka redu, zvakare, rinoshanda nemasisitimu akanyatso kubatanidzwa kune mumwe nemumwe: kune akawanda hukama pakati pavo, ichi chivakwa chakakura kwazvo. Uye kushanda kwechitoro chepamhepo kunoenderana neaya masisitimu (atinawo, nenzira, nhamba huru).
Saka zvinozoitika kuti dhipatimendi redu harisi rechero timu, asi riri padiki padivi. Munyaya iyi yese, basa redu nderekunyatsonzwisisa mashandiro anoita masisitimu eruzivo, kushanda kwawo, kusanganisa, software, network, hardware, uye kuti zvese izvi zvakabatana sei kune mumwe nemumwe.
Chikuva panoshanda zvitoro zvedu zvepamhepo chinotaridzika seizvi:
- mberi
- hofisi yepakati
- hofisi kumashure
Hazvina mhosva kuti tingade sei, hazviitike kuti masisitimu ese ashande zvakanaka uye zvisina mhosva. Pfungwa, zvakare, nhamba yehurongwa uye kubatanidzwa - nechinhu chakafanana neyedu, zvimwe zviitiko hazvidzivisiki, pasinei nehutano hwekuedzwa. Uyezve, zvose zviri mukati megadziriro yakasiyana uye maererano nekubatanidzwa kwavo. Uye iwe unofanirwa kutarisa mamiriro epuratifomu zvizere, uye kwete chero chikamu chayo chega.
Sezvineiwo, papuratifomu-yakafara yekutarisa hutano inofanirwa kuve otomatiki. Uye takasvika pakutarisisa sechikamu chisingadzivisiki cheichi chiitiko. Pakutanga, yakavakirwa chete chikamu chepamberi, nepo nyanzvi dzenetiweki, software uye hardware maneja vaive uye vachiri neavo ega-ne-layer ekutarisa masisitimu. Vanhu vese ava vaitevera kutariswa padanho ravo chete; hapana aive nekunzwisisa kwakadzama.
Semuenzaniso, kana muchina chaiwo ukadonha, kazhinji kacho chete maneja ane mutoro wehardware uye muchina chaiwo anoziva nezvazvo. Mumamiriro ezvinhu akadai, timu yekumberi yakaona chokwadi chekupunzika kweapp, asi yanga isina data nezvekuparara kwemuchina chaiwo. Uye maneja anogona kuziva kuti mutengi ndiani uye ave nepfungwa yakaoma yezvirikuitwa pamushini uyu chaiwo, chero iri imwe mhando yeprojekiti hombe. Anogona kunge asingazivi nezvevadiki. Chero zvazvingava, mutungamiri anofanira kuenda kumuridzi uye kubvunza kuti chii chiri pamushini uyu, chii chinoda kudzorerwa uye chii chinoda kuchinjwa. Uye kana chimwe chinhu chakakomba chakaputsika, vakatanga kumhanya vachitenderera - nekuti hapana akaona hurongwa hwakazara.
Pakupedzisira, nyaya dzakadaro dzakasiyana dzinobata kumberi kwese, vashandisi uye yedu yepakati bhizinesi basa - online kutengesa. Sezvo isu tisiri chikamu chechikwata, asi tiri kuita basa reese ecommerce application sechikamu chechitoro chepamhepo, takatora basa rekugadzira yakazara yekutarisa sisitimu ye ecommerce chikuva.
Sistimu chimiro uye stack
Takatanga nekuona akati wandei ekutarisisa masisitimu edu, mukati umo isu taizoda kuunganidza metrics. Uye izvi zvese zvaida kusanganiswa, izvo zvatakaita padanho rekutanga. Parizvino padanho rino tave kupedzisa kuunganidzwa kwemhando yepamusoro-soro yemetrics pamateru edu ese kuitira kuti tivake kuwirirana uye kunzwisisa kuti masisitimu anofurirana sei.
Kushaikwa kwekutarisa kwakazara pamatanho ekutanga ekutanga application (kubvira patakatanga kuivaka apo mazhinji masisitimu aive mukugadzirwa) zvakatungamira kune chokwadi chekuti isu taive nechikwereti chakakura chehunyanzvi chekumisikidza kutarisa kwepuratifomu yese. Hatina kukwanisa kutarisa kumisikidza yekutarisa kune imwe IS uye kushanda kunze kwekuiongorora zvakadzama, sezvo mamwe masisitimu aizosara asina kutarisa kwenguva yakati. Kuti tigadzirise dambudziko iri, takaona runyoro rwemametric anonyanya kudiwa ekuongorora mamiriro ehurongwa hweruzivo nedanho ndokutanga kuishandisa.
Naizvozvo vakasarudza kudya nzou muzvidimbu.
Sisitimu yedu ine:
- hardware;
- operating system;
- software;
- UI zvikamu mukutarisa application;
- business metrics;
- kubatanidza zvikumbiro;
- kuchengetedzwa kwemashoko;
- network;
- traffic balancer.
Pakati pehurongwa uhu huri kuzvitarisa. Kuti unzwisise kazhinji mamiriro ehurongwa hwese, iwe unofanirwa kuziva zviri kuitika nemaapplication pane ese aya maseru uye pane yese seti yemashandisirwo.
Saka, nezve stack.
Isu tinoshandisa yakavhurika sosi software. Pakati tine Zabbix, iyo yatinoshandisa zvakanyanya seyambiro system. Wese munhu anoziva kuti yakanakira kutariswa kwezvivakwa. Izvi zvinorevei? Chaizvo izvo zvakaderera-level metrics iyo kambani yega yega inochengetedza yayo yedata data ina (uye Sportmaster ine yayo data nzvimbo) - server tembiricha, ndangariro mamiriro, raid, network mudziyo metrics.
Isu takabatanidza Zabbix neTeregiramu messenger neMicrosoft Teams, ayo anoshandiswa zvakanyanya muzvikwata. Zabbix inovhara mutsetse weiyo chaiyo network, hardware uye imwe software, asi haisi panacea. Isu tinopfumisa iyi data kubva kune mamwe masevhisi. Semuenzaniso, padanho rehardware, tinobatanidza zvakananga kuburikidza neAPI kune yedu virtualization system uye kuunganidza data.
Chii chimwe. Pamusoro peZabbix, isu tinoshandisa Prometheus, iyo inotibvumira kutarisa metrics mune ine simba nharaunda application. Ndokunge, isu tinogona kugashira mametric ekushandisa kuburikidza neHTTP endpoint uye kusanetsekana kuti ndeapi metrics yekuisa mairi uye isingaite. Kubva pane iyi data, mibvunzo yekuongorora inogona kugadzirwa.
Data masosi emamwe mazinga, semuenzaniso, bhizinesi metrics, yakakamurwa kuita zvikamu zvitatu.
Chekutanga, aya mabhizinesi ekunze masisitimu, Google Analytics, isu tinounganidza metrics kubva mumatanda. Kubva kwavari tinowana data pamusoro pevashandisi vanoshanda, shanduko uye zvimwe zvese zvine chekuita nebhizinesi. Chechipiri, iyi iUI yekutarisa system. Inofanira kutsanangurwa zvakadzama.
Pane imwe nguva takatanga nekuedza kwemanyore uye yakakura kuita otomatiki bvunzo dzekushanda uye kubatanidzwa. Kubva pane izvi takaita kutarisa, tichisiya chete basa guru, uye tichivimba nemakasi akagadzikana sezvinobvira uye asingashanduki kazhinji nekufamba kwenguva.
Chimiro chechikwata chitsva chinoreva kuti zviitiko zvese zvekushandisa zvinongogumira kuzvikwata zvechigadzirwa, saka takamira kuita kuyedza kwakachena. Pane kudaro, takaita UI yekutarisa kubva kubvunzo, yakanyorwa muJava, Selenium uye Jenkins (inoshandiswa senzira yekutanga nekugadzira mishumo).
Takava nemiedzo yakawanda, asi pakupedzisira takasarudza kuenda kumugwagwa mukuru, iyo yepamusoro-yepamusoro metric. Uye kana isu tiine akawanda chaiwo bvunzo, zvichave zvakaoma kuchengetedza iyo data kusvika parizvino. Kuburitswa kwega kwega kunotevera kuchatyora zvakanyanya sisitimu yese, uye zvese zvatichaita kuzvigadzirisa. Naizvozvo, takatarisa pazvinhu zvakakosha izvo zvisingawanzo chinja, uye tinongozviongorora.
Chekupedzisira, chechitatu, iyo data sosi inzvimbo yepakati yekutema matanda. Isu tinoshandisa Elastic Stack yematanda, uye isu tinokwanisa kudhonza iyi data mune yedu yekutarisa sisitimu yebhizinesi metrics. Pamusoro peizvi zvese, isu tine yedu Monitoring API sevhisi, yakanyorwa muPython, iyo inobvunza chero masevhisi kuburikidza neAPI uye inounganidza data kubva kwavari muZabbix.
Chimwe chinhu chakakosha chekutarisa kuona. Yedu yakavakirwa paGrafana. Iyo inomira pakati pemamwe masisitimu ekuona mukuti inokutendera iwe kuti utarise metrics kubva kwakasiyana data masosi pane dashboard. Tinogona kuunganidza mametric epamusoro-soro echitoro chepamhepo, semuenzaniso, nhamba yemirairo yakaiswa muawa yekupedzisira kubva kuDBMS, maitiro ekuita kweOS iyo chitoro ichi chepamhepo chiri kushanda kubva kuZabbix, uye metrics ezviitiko zvekushandisa uku. kubva kuPrometheus. Uye izvi zvese zvichange zviri pane imwe dashboard. Zvakajeka uye zvinowanikwa.
Rega ndicherechedze nezve chengetedzo - parizvino tiri kupedzisa sisitimu, yatinozobatanidza neyepasi rose yekutarisa system. Mukuona kwangu, matambudziko makuru ayo e-commerce anotarisana nawo mumunda wekuchengetedza ruzivo ane hukama ne bots, parsers uye brute force. Tinofanira kuramba takatarisa pane izvi, nokuti zvose izvi zvinogona kukanganisa zvakanyanya kushanda kwezvikumbiro zvedu uye mukurumbira wedu kubva kune imwe nzvimbo yebhizimisi. Uye nesata yakasarudzwa isu tinobudirira kuvhara aya mabasa.
Imwe pfungwa yakakosha ndeyekuti iyo application layer inounganidzwa naPrometheus. Iye pachake akabatanidzwawo neZabbix. Uye isu zvakare tine saitipeed, sevhisi inotibvumira kuona ma paramita akadai sekumhanyisa kurodha kwepeji redu, mabhodhoro, kupa peji, kurodha zvinyorwa, nezvimwewo, zvakare API yakabatanidzwa. Saka metrics edu anounganidzwa muZabbix, uye nekudaro, isu tinoyambirawo kubva ipapo. Yese yambiro parizvino inotumirwa kune huru nzira dzekutumira (parizvino iemail uye teregiramu, MS Teams zvakare ichangobva kubatana). Pane zvirongwa zvekusimudzira yambiro kune yakadaro iyo smart bots inoshanda sevhisi uye inopa ruzivo rwekutarisa kune ese anofarira zvigadzirwa zvikwata.
Kwatiri, mametrics akakosha kwete chete kune ega ega eruzivo masisitimu, asiwo mametrics ezvese zvivakwa zvinoshandiswa nemaapplication: masumbu emasevha emuviri anomhanyisa michina, traffic balance, Network Load Balancers, network pachayo, kushandiswa kwenzira dzekutaurirana. . Kuwedzera metrics edu pachedu data nzvimbo (tine akati wandei awo uye zvivakwa zvakakura kwazvo).
Zvakanakira hurongwa hwedu hwekutarisa ndezvekuti nerubatsiro rwayo tinoona mamiriro ehutano hwese masisitimu uye tinokwanisa kuongorora maitiro avo pane mumwe nemumwe uye pane zvakagovaniswa zviwanikwa. Uye pakupedzisira, zvinotitendera kuti tiite zvekuronga zviwanikwa, rinovawo basa redu. Isu tinodzora server zviwanikwa - dziva mukati me-e-commerce, komisheni uye decommission michina mitsva, kutenga mimwe michina mitsva, kuita ongororo yekushandisa zviwanikwa, nezvimwe. Gore rega rega, zvikwata zvinoronga mapurojekiti matsva, gadzira masisitimu avo, uye zvakakosha kuti isu tivape zviwanikwa.
Uye nerubatsiro rwemetrics, tinoona mafambiro ekushandisa zviwanikwa nehurongwa hwedu hweruzivo. Uye kubva pavari tinogona kuronga chimwe chinhu. Padanho rekuona, tinounganidza data uye tinoona ruzivo rwehuwandu huripo hwezviwanikwa nedata data. Uye nechekare mukati me data data unogona kuona kudzokorodza, kugovera chaiko, uye kushandiswa kwezviwanikwa. Zvakare, zvese nemasevha akamira uye mashini chaiwo uye masumbu emaseva emuviri pane aya ese machina emagetsi ari kutenderera zvine simba.
Matarisiro
Iye zvino isu tine musimboti wehurongwa seyakagadzirira, asi pachine zvakawanda zvezvinhu zvichiri kuda kugadzirwa. Zvirinani, iyi idanho rekuchengetedza ruzivo, asi zvakakoshawo kuti usvike kunetiweki, gadzira yambiro uye kugadzirisa nyaya yekuwirirana. Isu tine akawanda akaturikidzana uye masisitimu, uye pane imwe neimwe layer pane akawanda akawanda metrics. Inoshanduka kuva matryoshka kusvika pachiyero che matryoshka.
Basa redu nderekupedzisira taita ziviso dzakakodzera. Semuenzaniso, kana paine dambudziko nehardware, zvakare, nemuchina chaiwo, uye pakanga paine yakakosha application, uye sevhisi haina kutsigirwa neimwe nzira. Isu tinoona kuti virtual muchina wafa. Ipapo bhizinesi metrics ichakuzivisa iwe: vashandisi vanyangarika kumwe kunhu, hapana shanduko, iyo UI mune interface haisipo, software nemasevhisi akafawo.
Mumamiriro ezvinhu aya, tichagamuchira spam kubva kune zviziviso, uye izvi hazvichakodzeri muchimiro chemaitiro ekutarisa akakodzera. Mubvunzo wekubatana unomuka. Naizvozvo, zvine musoro, sisitimu yedu yekutarisa inofanira kuti: "Varume, muchina wenyu wenyama wafa, uye pamwe nawo iyi application uye aya metrics," nerubatsiro rweyambiro imwe chete, panzvimbo yekutiza nehasha nezana rekuzivisa. Inofanira kutaurira chinhu chikuru - chikonzero, chinobatsira kukurumidza kubvisa dambudziko nekuda kwekugara kwayo.
Yedu yekuzivisa sisitimu uye yambiro yekugadzirisa yakavakirwa kutenderedza XNUMX-awa hotline sevhisi. Yese yambiro inoonekwa seyakafanira-kuve uye inosanganisirwa mucheki list inotumirwa ikoko. Yambiro yega yega inofanirwa kunge ine tsananguro: zvakaitika, zvazvinoreva, zvazvinokanganisa. Uye zvakare chinongedzo kune dashboard uye mirairo pane zvekuita mune iyi kesi.
Izvi zvese zvinoenderana nezvinodiwa pakuvaka yambiro. Ipapo mamiriro acho anogona kukura mumativi maviri - kungave kune dambudziko uye rinoda kugadziriswa, kana pakave nekutadza muhurongwa hwekutarisa. Asi mune chero mamiriro ezvinhu, iwe unofanirwa kuenda uye kuzviona.
Paavhareji, isu zvino tinogashira anenge zana chenjedzo pazuva, tichifunga nezve chokwadi chekuti kuwirirana kwezviyeuchidzo hakusati kwagadzirwa zvakanaka. Uye kana isu tichida kuita tekinoroji basa, uye isu nekumanikidza kudzima chimwe chinhu, nhamba yavo inowedzera zvakanyanya.
Pamusoro pekutarisa masisitimu atinoshanda uye kuunganidza metrics anoonekwa akakosha kudivi redu, iyo yekutarisa system inotibvumira kuunganidza data yezvikwata zvezvigadzirwa. Ivo vanogona kukanganisa kuumbwa kwemametrics mukati meruzivo masisitimu atinotarisisa.
Watinoshanda naye anogona kuuya kuzokumbira kuwedzera imwe metric inozobatsira isu nechikwata. Kana, semuenzaniso, timu inogona kunge isina kukwana metrics yatinayo; ivo vanofanirwa kuteedzera mamwe chaiwo. MuGrafana, isu tinogadzira nzvimbo yechikwata chega chega uye tinopa admin kodzero. Zvakare, kana timu ichida madhibhodhi, asi ivo pachavo havagone / vasingazive maitirwo, tinovabatsira.
Sezvo isu tiri kunze kwekuyerera kwekugadzira kukosha kwechikwata, kuburitswa kwavo uye kuronga, isu zvishoma nezvishoma tiri kusvika pamhedzisiro yekuti kuburitswa kwese masisitimu hakuna musono uye kunogona kuburitswa zuva nezuva pasina kubatana nesu. Uye zvakakosha kuti isu titarise izvi zvinoburitswa, nekuti zvinogona kukanganisa kushanda kwechikumbiro uye kutyora chimwe chinhu, uye izvi zvakakosha. Kugadzirisa kuburitswa, isu tinoshandisa Bamboo, kubva kwatinogamuchira data kuburikidza neAPI uye tinogona kuona kuti ndezvipi zvakaburitswa zvakaburitswa mune masystem eruzivo uye chimiro chavo. Uye chinonyanya kukosha ndechekuti inguvai. Isu tinosimudzira mamaki ekuburitsa pane makuru akakosha metrics, ayo anooneka anoratidza zvakanyanya kana paine matambudziko.
Nenzira iyi tinogona kuona kuwirirana pakati pekuburitswa kutsva uye matambudziko ari kubuda. Pfungwa huru ndeyekunzwisisa kuti system inoshanda sei pamatanho ese, nekukurumidza kuisa dambudziko uye kurigadzirisa nekukurumidza. Mushure mezvose, zvinowanzoitika kuti izvo zvinotora nguva yakawanda hazvisi kugadzirisa dambudziko, asi kutsvaga chikonzero.
Uye munzvimbo ino mune ramangwana tinoda kutarisa kune proactivity. Zvakanaka, ndinoda kuziva nezve dambudziko rinouya mberi, uye kwete shure kwechokwadi, kuitira kuti ndigone kudzivirira pane kurigadzirisa. Dzimwe nguva maalarm emanyepo ehurongwa hwekutarisisa anoitika, zvese nekuda kwekukanganisa kwevanhu uye nekuda kwekuchinja kwekushandisa. Uye isu tinoshanda pane izvi, tigadzirise, uye tinoedza kunyevera vashandisi vanoishandisa nesu nezve izvi zvisati zvaitika chero kukanganisa kweiyo monitoring system. , kana kuita zviitiko izvi muhwindo rehunyanzvi.
Saka, iyo system yakatangwa uye yave ichishanda zvinobudirira kubva pakutanga kwechirimo ... uye iri kuratidza purofiti chaiyo. Ehe, iyi haisiriyo vhezheni yayo yekupedzisira; tichave tichiunza akawanda akawanda anobatsira maficha. Asi izvozvi, nekubatanidzwa kwakawanda uye maapplication, yekutarisa otomatiki haidzivisike.
Kana iwe zvakare uchitarisisa mapurojekiti makuru ane huwandu hwakakosha hwekubatanidzwa, nyora mune zvakataurwa kuti ndeipi sirivha bullet yawakawana kune iyi.
Source: www.habr.com