Molo, igama lam ngu-Evgeniy, ndingumkhokeli weqela le-B2B kwiCitymobil. Omnye wemisebenzi yeqela lethu kukuxhasa ukudityaniswa kwe-odolo yeeteksi kumaqabane, kunye nokuqinisekisa inkonzo ezinzileyo kufuneka sisoloko siyiqonda into eyenzekayo kwiinkonzo zethu ezincinci. Kwaye oku kufuneka uhlale ubeka iliso kwiilogi.
Kwi-Citymobil, sisebenzisa i-ELK stack (i-ElasticSearch, i-Logstash, i-Kibana) ukusebenza kunye nezigodo, kwaye umthamo wedatha efunyenwe apho mkhulu kakhulu. Kobu bunzima bezicelo, kunzima kakhulu ukufumana iingxaki ezinokuvela emva kokuthunyelwa kwekhowudi entsha. Kwaye ukuchonga ngokucacileyo, i-Kibana inecandelo leDashboard.
Kukho amanqaku ambalwa kuHabrΓ© anemizekelo yendlela yokuseta isitaki se-ELK sokufumana kunye nokugcina idatha, kodwa akukho zixhobo ezifanelekileyo ekudaleni iDashboard. Ngoko ke, ndifuna ukubonisa indlela yokwenza umboniso obonakalayo wedatha esekelwe kwiilogi ezingenayo e-Kibana.
Yenza ngokwezifiso
Ukwenza kucace ngakumbi, ndenze umfanekiso weDocker kunye ne-ELK kunye neFayilebeat. Kwaye wabeka encinci kwisitya kwi-Go, leyo kumzekelo wethu izakuvelisa iilog zovavanyo. Andiyi kuchaza ngokweenkcukacha ukucwangciswa kwe-ELK; kukho okwaneleyo okubhaliweyo malunga noku kuHabrΓ©.
Ukuvala indawo yokugcina kunye noqwalaselo docker-compose kunye nezicwangciso ze-ELK, kwaye uyiqalise ngomyalelo docker-compose up. Andongezi isitshixo ngabom. -dukubona inkqubo yesitaki se-ELK.
git clone https://github.com/et-soft/habr-elk
cd habr-elk
docker-compose up
Ukuba yonke into iqwalaselwe ngokuchanekileyo, ngoko siya kubona ukungena kwiilogi (mhlawumbi kungekhona ngokukhawuleza, inkqubo yokuqalisa isitya kunye nesitaki sonke sinokuthatha imizuzu emininzi):
{"type":"log","@timestamp":"2020-09-20T05:55:14Z","tags":["info","http","server","Kibana"],"pid":6,"message":"http server running at http://0:5601"}
Ngedilesi localhost:5061 I-Kibana kufuneka ivule.
Into kuphela esiyidingayo ukuyiqwalasela kukwenza i-Index Pattern ye-Kibana ngolwazi malunga nokuba yeyiphi idatha ekufuneka iboniswe. Ukwenza oku, masenze isicelo se-curl okanye senze uthotho lweentshukumo kumzobo womzobo.
$ curl -XPOST -D- 'http://localhost:5601/api/saved_objects/index-pattern'
-H 'Content-Type: application/json'
-H 'kbn-xsrf: true'
-d '{"attributes":{"title":"logstash-*","timeFieldName":"@timestamp"}}'
Kuyilwa iPatheni yesalathiso nge-GUI
Ukuqwalasela, khetha icandelo loFumana kwimenyu esekhohlo kwaye ufike kwi-Index ipatheni yokudala iphepha.
Ngokunqakraza kwiqhosha elithi "Yenza isalathisi", sithathwa kwiphepha lokudala isalathisi. Kwindawo ethi "Igama lepateni yesalathisi", faka "logstash-*". Ukuba yonke into iqwalaselwe ngokuchanekileyo, ngaphantsi kwe-Kibana iya kubonisa izalathisi eziwela phantsi kolawulo.
Kwiphepha elilandelayo, khetha indawo ephambili enesitampu sexesha, kwimeko yethu kunjalo @timestamp.
Ngenxa yoko, iphepha lezicwangciso zesalathiso liya kuvela, kodwa akukho manyathelo ongezelelweyo afunekayo kuthi ngoku.
Ngoku sinokubuyela kwicandelo le-Discover, apho siza kubona amangeno elogi.
Dashboard
Kwimenyu ekhohlo, cofa kwi Dashboard icandelo lokudala kwaye ufike kwiphepha elihambelanayo.
Cofa ku "Yenza ideshibhodi entsha" kwaye ufike kwiphepha lokongeza izinto kwiDashboard.
Cofa kwiqhosha elithi "Yenza entsha", kwaye inkqubo iya kukukhuthaza ukuba ukhethe uhlobo lokubonisa idatha. Kukho inani elikhulu labo e-Kibana, kodwa siya kujonga ekudaleni umboniso wegraphical "Vertical Bar" kunye ne-tabular "Itheyibhile yeDatha". Ezinye iintlobo zonikezelo ziqwalaselwe ngendlela efanayo.
Ezinye izinto ezikhoyo zibhalwe u-B no-E, nto leyo ebonisa ukuba ifomathi iyavavanywa okanye ikwi-beta. Ngokuhamba kwexesha, ifomathi inokutshintsha okanye ilahleke ngokupheleleyo kwi-Kibana.
Ibha ethe nkqo
Kumzekelo "weBar ethe nkqo", masenze i-histogram yomlinganiselo weempendulo eziphumeleleyo nezingaphumeleliyo kwinkonzo yethu. Emva kokugqiba useto, siya kufumana le grafu ilandelayo:
Siya kuhlela njengempumelelo zonke izicelo kunye nesimo sokuphendula <400, kwaye njengengxaki ->= 400.
Ukudala itshathi ethi "Vertical Bar", kufuneka sikhethe umthombo wedatha. Khetha iPatheni yeSalathisi esiye sayenza ngaphambili.
Ngokungagqibekanga, xa ukhetha umthombo wedatha, igrafu enye eqhubekayo iya kuvela. Masiyimise.
Kwibhloko ye "Buckets", nqakraza iqhosha elithi "Yongeza", khetha "X-asis" kwaye ulungise i-axis ye-X. Masicwangcise i-timestamps yeerekhodi ezingena kwilogi ecaleni kwayo. Kwindawo ethi "Aggregation", khetha "Umhla we-Histogram", kwaye kwi "Field" khetha "@timestamp", ebonisa intsimi yesikhashana. Masishiye "ubuncinci bekhefu" kwimeko ye "Auto", kwaye iya kulungelelanisa ngokuzenzekelayo kwisiboniso sethu.
Ngokucofa iqhosha elithi "Hlaziya", siza kubona igrafu enenani lezicelo rhoqo ngemizuzwana engama-30.
Ngoku makhe simise iikholamu kwi-axis engu-Y. Ngoku sibonisa inani elipheleleyo lezicelo kwixesha elikhethiweyo.
Masitshintshe ixabiso elithi "Aggregation" kwi "Sum Bucket", eya kusivumela ukuba sidibanise idatha kwizicelo eziphumeleleyo nezingaphumeleli. KwiBhakethi -> Ibhloko yoHlanganiso, khetha udibaniso ngo βIzihluziβ kwaye usete ukuhluza nge βstatusCode>= 400β. Kwaye kwibala elithi "Ileyibhile yesiko" sibonisa igama lethu lesalathisi somboniso ocacileyo ngakumbi kwi-legend kwitshathi kunye noluhlu oluqhelekileyo.
Ngokucofa iqhosha elithi "Hlaziya" phantsi kwebhloko yesethingi, sifumana igrafu ngemibuzo enengxaki.
Ukuba ucofa kwisangqa ecaleni kwebali, iwindow iya kuvela apho unokutshintsha umbala wemiqolo.
Ngoku masifake idatha kwizicelo eziyimpumelelo kwitshathi. Kwicandelo elithi "Metrics", cofa iqhosha elithi "Yongeza" kwaye ukhethe "Y-axis".
Kwimetriki eyenziweyo senza useto olufanayo njengezicelo ezinempazamo. Kuphela kwisihluzi sibonisa "ikhowudi yesimo <400".
Ngokutshintsha umbala wekholamu entsha, sifumana umboniso womlinganiselo wezicelo eziyingxaki kunye eziyimpumelelo.
Ngokucofa iqhosha elithi "Gcina" phezulu kwesikrini kwaye uchaze igama, siya kubona igrafu yokuqala kwiDashboard.
Itheyibhile yeDatha
Ngoku makhe sijonge imboniselo yetheyibhile βyeDathaβ. Masenze itheyibhile enoluhlu lwazo zonke ii-URL bekukho izicelo kuzo kunye nenani lezi zicelo. Njengoko kumzekelo we-Vertical Bar, siqala ngokukhetha umthombo wedatha.
Emva koku, itafile enekholamu enye iya kuboniswa kwisikrini, ebonisa inani elipheleleyo lezicelo zekhefu lexesha elikhethiweyo.
Siza kutshintsha kuphela ibhloko ethi "Buckets". Cofa iqhosha elithi "Yongeza" kwaye ukhethe "Yahlula imiqolo".
Kwindawo ethi "Aggregation", khetha "Imiqathango". Kwaye kwintsimi ethi "Field" evelayo, khetha "url.keyword".
Ngokuchaza ixabiso elithi "Url" kwindawo ethi "Ileyibhile yesiko" kwaye ucofe u-"Hlaziya", siya kufumana itheyibhile esiyifunayo kunye nenani lezicelo ze-URL nganye kwixesha elikhethiweyo.
Phezulu kwesikrini, cofa iqhosha elithi "Gcina" kwakhona kwaye uchaze igama letafile, umzekelo ii-Urls. Masibuyele kwiDashboard kwaye sibone iimbono zombini zenziwe.
Ukusebenza ngeDashboard
Xa udala iDashboard, sibeka kuphela iiparameters zokujonga ezisisiseko kwizicwangciso zento yokubonisa. Akukho sizathu sokucacisa idatha yokucoca kwizinto, umzekelo, "uluhlu lomhla", "ukucoca nge-usergent", "ukucoca ngelizwe lesicelo", njl. Kulunge ngakumbi ukucacisa ixesha elifunekayo okanye ukuseta ukucoca okuyimfuneko kwiqela lenjongo yombuzo, ebekwe ngaphezulu kwezinto.
Izihluzi ezongeziweyo kule njongo ziya kusetyenziswa kwiDashboard yonke, kwaye zonke izinto zokubonisa ziya kuhlengahlengiswa ngokwedatha ehluziweyo yangoku.
isiphelo
I-Kibana sisixhobo esinamandla esikuvumela ukuba ubone ngeso lengqondo nayiphi na idatha ngendlela efanelekileyo. Ndizamile ukubonisa ukusetwa kweentlobo ezimbini eziphambili zomboniso. Kodwa ezinye iindidi ziqwalaselwe ngendlela efanayo. Kwaye ubuninzi boseto endilushiye ngasemva kwemifanekiso luya kukuvumela ukuba uguqule ngokulula iitshathi ukuze zihambelane neemfuno zakho.
umthombo: www.habr.com