Sawubona, igama lami ngingu-Eugene, ngingumholi weqembu le-B2B e-Citymobil. Omunye wemisebenzi yethimba lethu ukusekela ukuhlanganiswa koku-oda itekisi kozakwethu, futhi ukuze siqinisekise isevisi ezinzile, kufanele siqonde njalo ukuthi kwenzekani ezinsizeni zethu ezincane. Futhi ngenxa yalokhu udinga ukuqapha njalo izingodo.
E-Citymobil, sisebenzisa isitaki se-ELK (ElasticSearch, Logstash, Kibana) ukuze sisebenze ngamalogi, futhi inani ledatha ezayo lapho likhulu. Ukuthola izinkinga kule nqwaba yezicelo ezingase zivele ngemva kokuthunyelwa kwekhodi entsha kunzima kakhulu. Futhi ngokuhlonza kwabo okubonakalayo, i-Kibana inesigaba seDashboard.
Kunezindatshana ezimbalwa ezimayelana no-HabrΓ© ezinezibonelo zokuthi ungasetha kanjani isitaki se-ELK ukuze wamukele futhi ugcine idatha, kodwa azikho izinto ezidingekayo ekudaleni Ideshibhodi. Ngakho-ke, ngifuna ukukhombisa ukuthi ungakha kanjani ukumelelwa okubonakalayo kwedatha ngokusekelwe kulogi engenayo e-Kibana.
Yenza ngokwezifiso
Ukwenza kucace, ngidale isithombe se-Docker nge-ELK neFilebeat. Futhi ibekwe esitsheni esincane ku-Go, okuyisibonelo sethu esizokhiqiza izingodo zokuhlola. Ngeke ngichaze ngokuningiliziwe ukucushwa kwe-ELK, kukhona okwanele okubhaliwe ngakho ku-HabrΓ©.
Khipha indawo yokugcina docker-compose kanye nezilungiselelo ze-ELK, futhi uyethule ngomyalo docker-compose up. Ngenhloso engengezi ukhiye -dukuze ubone ukuqhubeka kwesitaki se-ELK.
git clone https://github.com/et-soft/habr-elk
cd habr-elk
docker-compose up
Uma yonke into ilungiswe kahle, khona-ke sizobona ukungena kulogi (mhlawumbe hhayi ngokushesha, inqubo yokuqalisa isitsha esinesitaki sonke ingathatha imizuzu embalwa):
{"type":"log","@timestamp":"2020-09-20T05:55:14Z","tags":["info","http","server","Kibana"],"pid":6,"message":"http server running at http://0:5601"}
Ngekheli localhost:5061 I-Kibana kufanele ivule.
Okuwukuphela kwento esidinga ukuyilungisa ukudala Iphethini Yenkomba ye-Kibana enolwazi mayelana nokuthi iyiphi idatha okufanele siyibonise. Ukwenza lokhu, sizokwenza isicelo se-curl noma senze uchungechunge lwezenzo kusixhumi esibonakalayo sesithombe.
$ curl -XPOST -D- 'http://localhost:5601/api/saved_objects/index-pattern'
-H 'Content-Type: application/json'
-H 'kbn-xsrf: true'
-d '{"attributes":{"title":"logstash-*","timeFieldName":"@timestamp"}}'
Ukudala Iphethini Yenkomba nge-GUI
Ukuze ulungiselele, khetha isigaba se-Discover kumenyu engakwesokunxele, bese ufika ekhasini lokudala iphethini ye-Index.
Ngokuchofoza inkinobho ethi "Dala iphethini yenkomba", sifika ekhasini lokudala inkomba. Kunkambu ethi "Igama lephethini yenkomba", faka "logstash-*". Uma konke kulungiselelwe kahle, ngezansi kwe-Kibana kuzobonisa izinkomba eziwela ngaphansi komthetho.
Ekhasini elilandelayo, khetha inkambu yokhiye enesitembu sesikhathi, kithi kunjalo @timestamp.
Njengomphumela, ikhasi lezilungiselelo zenkomba lizovela, kodwa asikho esinye isenzo esidingekayo kithi ngalesi sikhathi.
Manje singaya esigabeni se-Discover futhi, lapho sizobona khona okufakiwe kwelogi.
Dashboard
Kumenyu engakwesokunxele, chofoza engxenyeni yokudala Ideshibhodi bese ufika ekhasini elihambisanayo.
Chofoza okuthi "Dala ideshibhodi entsha" futhi ufike ekhasini lokwengeza izinto Kudeshibhodi.
Chofoza inkinobho ethi "Dala okusha", futhi isistimu izokwazisa ukuthi ukhethe uhlobo lwesibonisi sedatha. I-Kibana inenani elikhulu lazo, kodwa sizobheka ekudaleni ukumelwa kwesithombe se-"Vertical Bar" kanye nethebula "Ithebula Ledatha". Ezinye izinhlobo zesethulo zicushwe ngendlela efanayo.
Ezinye izinto ezitholakalayo zilebulwe ngo-B no-E, okusho ukuthi ifomethi ingeyokuhlola noma isekuhlolweni kwe-beta. Ngokuhamba kwesikhathi, ifomethi ingase ishintshe noma inyamalale ngokuphelele ku-Kibana.
Ibha Eme mpo
Ukuze uthole isibonelo "Ibha Emile", masidale i-histogram yesilinganiso sezimo zokuphendula eziyimpumelelo nezingaphumeleli zesevisi yethu. Ekupheleni kwezilungiselelo, sithola igrafu elandelayo:
Sizohlukanisa zonke izicelo ngesimo sokuphendula esingu- <400 njengempumelelo, futhi >= 400 njengeziyinkinga.
Ukuze udale ishadi elithi "Ibha Emile", sidinga ukukhetha umthombo wedatha. Khetha Iphethini Yenkomba esiyidalile ekuqaleni.
Ngokuzenzakalelayo, kuzovela igrafu eyodwa eqinile ngemva kokukhetha umthombo wedatha. Asiyimise.
Kubhulokhi ethi "Amabhakede", cindezela inkinobho "Engeza", khetha "X-asis" bese usetha i-eksisi X. Masibeke eceleni izitembu zesikhathi zokwamukela okufakiwe kulogi. Enkambini ethi "Aggregation", khetha "Idethi ye-Histogram", bese kokuthi "Inkambu" khetha okuthi "@timestamp", okubonisa inkambu yesikhathi. Asishiye "Isikhawu esincane" kusimo "Sokuzenzakalela", futhi sizozijwayeza ngokuzenzakalelayo kusibonisi sethu.
Ngokuchofoza inkinobho ethi "Buyekeza", sizobona igrafu enenani lezicelo njalo ngemizuzwana engama-30.
Manje ake simise amakholomu eduze kwe-eksisi engu-Y. Manje sibonisa inani eliphelele lezicelo esikhathini esikhethiwe.
Masiguqule inani elithi "Ukuhlanganisa" libe "Ibhakede Lesamba", elizosivumela ukuthi sihlanganise idatha yezicelo eziyimpumelelo nezingaphumeleli. Ebhakedeni -> Ibhulokhi yokuhlanganisa, khetha ukuhlanganisa ngokuthi "Izihlungi" bese usetha ukuhlunga ngokuthi "statusCode >= 400". Futhi kunkambu ethi "Ilebula yangokwezifiso", sibonisa igama lethu lenkomba ukuze sibonise okuqondakalayo kunganekwane eseshadini kanye nakuhlu olujwayelekile.
Ngokuchofoza inkinobho ethi "Buyekeza" ngaphansi kwebhulokhi yezilungiselelo, sizothola igrafu enezicelo zezinkinga.
Uma uchofoza kumbuthano oseduze kwenganekwane, kuzovela iwindi lapho ungashintsha khona umbala wamakholomu.
Manje ake sengeze idatha yezicelo eziphumelele eshadini. Esigabeni esithi "Amamethrikhi", chofoza inkinobho ethi "Engeza" bese ukhetha u-"Y-axis".
Kumethrikhi edaliwe, senza izilungiselelo ezifanayo nezezicelo eziyiphutha. Kusihlungi kuphela esicacisa "i-statusCode <400".
Ngokushintsha umbala wekholomu entsha, sithola ukuboniswa kwesilinganiso sezicelo eziyinkinga neziyimpumelelo.
Ngokuchofoza inkinobho ethi βLondolozaβ phezulu esikrinini futhi ucacise igama, sizobona ishadi lokuqala Kudeshibhodi.
Ithebula Lemininingwane
Manje cabangela ukubuka kwethebula "Ithebula Ledatha". Ake sakhe ithebula elinohlu lwawo wonke ama-URL ayeceliwe kanye nenani lalezo zicelo. Njengesibonelo Sebha Emile, siqala ngokukhetha umthombo wedatha.
Ngemva kwalokho, ithebula elinekholomu eyodwa lizovezwa esikrinini, elibonisa inani eliphelele lezicelo zesikhawu sesikhathi esikhethiwe.
Sizoshintsha kuphela ibhulokhi ethi "Amabhakede". Chofoza inkinobho ethi "Engeza" bese ukhetha "Hlukanisa imigqa".
Kunkambu ethi "Aggregation", khetha "Imigomo". Futhi emkhakheni ovelayo "Insimu" khetha "url.keyword".
Ngokucacisa inani le-"Url" kunkambu ethi "Ilebula yangokwezifiso" bese uchofoza okuthi "Buyekeza", sizothola ithebula esilifunayo elinenani lezicelo ze-URL ngayinye yesikhathi esikhethiwe.
Phezulu esikrinini, chofoza inkinobho ethi "Londoloza" futhi futhi ucacise igama lethebula, isibonelo ama-Url. Masibuyele emuva kokuthi Ideshibhodi futhi sibone kudaliwe kokubili ukubuka.
Ukusebenza ngedeshibhodi
Lapho sidala Ideshibhodi, sibeka kuphela imingcele yokubuka eyinhloko kuzilungiselelo zento yokubonisa. Akunangqondo ukucacisa idatha yezihlungi ezintweni, isibonelo, "ibanga ledethi", "ukuhlunga nge-usergent", "ukuhlunga ngezwe lesicelo", njll. Kungcono kakhulu ukucacisa isikhathi osifunayo noma usethe ukuhlunga okudingekayo kuphaneli yombuzo, etholakala ngaphezu kwezinto.
Izihlungi ezengezwe kuleli phaneli zizosetshenziswa kuyo yonke Ideshibhodi, futhi zonke izinto eziboniswayo zizokwakhiwa kabusha ngokuvumelana nedatha yangempela ehlungiwe.
isiphetho
I-Kibana iyithuluzi elinamandla elikuvumela ukuthi ubone ngeso lengqondo noma iyiphi idatha ngendlela elula. Ngizamile ukukhombisa ukulungiselelwa kwezinhlobo ezimbili eziyinhloko zokubonisa. Kodwa ezinye izinhlobo zicushwa ngendlela efanayo. Futhi ubuningi bezilungiselelo engizishiye βngemuva kwezigcawuβ kuzokuvumela ukuthi wenze ngendlela evumelana nezimo kakhulu amashadi ukuze ahambisane nezidingo zakho.
Source: www.habr.com