{"id":32322,"date":"2019-10-31T21:46:21","date_gmt":"2019-10-31T18:46:21","guid":{"rendered":"https:\/\/prohoster.info\/blog\/kak-my-stroili-monitoring-na-prometheus-clickhouse-i-elk\/"},"modified":"2019-10-31T21:46:21","modified_gmt":"2019-10-31T18:46:21","slug":"kak-my-stroili-monitoring-na-prometheus-clickhouse-i-elk","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/kak-my-stroili-monitoring-na-prometheus-clickhouse-i-elk","title":{"rendered":"Si si po nd\u00ebrtimin e monitorimit me Prometheus, Clickhouse dhe ELK","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>M\u00eb quajn\u00eb Anton Baderin. Punoj n\u00eb Qendr\u00ebn e Teknologjive t\u00eb Larta dhe merrem me administrimin e sistemeve. Nj\u00eb muaj m\u00eb par\u00eb p\u00ebrfunduam konferenc\u00ebn ton\u00eb korporative, ku ndam\u00eb p\u00ebrvoj\u00ebn e akumuluar me komunitetin IT t\u00eb qytetit ton\u00eb. Fol\u00ebm p\u00ebr monitorimin e aplikacioneve web. Materiali ishte i destinuar p\u00ebr nivelin junior ose mesatar, ata q\u00eb nuk e kishin nd\u00ebrtuar k\u00ebt\u00eb proces nga zero.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Si si po nd\u00ebrtimin e monitorimit me Prometheus, Clickhouse dhe ELK\" src=\"\/wp-content\/uploads\/2019\/04\/c181509e6a10dd7562f361f328446d61.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Guri i themelit, q\u00eb q\u00ebndron n\u00eb baz\u00eb t\u00eb \u00e7do sistemi monitorimi \u2014 zgjidhja e problemeve t\u00eb biznesit. Monitorimi p\u00ebr monitorimin nuk i intereson ask\u00ebnd. \u00c7far\u00eb d\u00ebshiron biznesi? Q\u00eb gjith\u00e7ka t\u00eb funksionoj\u00eb shpejt dhe pa gabime. Biznesi d\u00ebshiron proaktivitet, q\u00eb ne vet\u00eb t\u00eb identifikojm\u00eb problemet n\u00eb funksionimin e sh\u00ebrbimit dhe t'i zgjidhim ato sa m\u00eb shpejt t\u00eb jet\u00eb e mundur. K\u00ebto, n\u00eb thelb, jan\u00eb detyrat q\u00eb kam zgjidhur gjat\u00eb gjith\u00eb vitit t\u00eb kaluar n\u00eb projektin e nj\u00eb nga klient\u00ebve tan\u00eb.<\/p>\n<p><noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<h2 id=\"o-proekte\">P\u00ebr projektin<\/h2>\n<p><\/p>\n<p>Projekti \u2014 nj\u00eb nga programet m\u00eb t\u00eb m\u00ebdha t\u00eb besnik\u00ebris\u00eb n\u00eb vend. Ndihmojm\u00eb rrjetet me pakic\u00eb t\u00eb rrisin frekuenc\u00ebn e shitjeve p\u00ebrmes mjeteve t\u00eb ndryshme marketingu si kartat bonus. N\u00eb total, projekti p\u00ebrfshin 14 aplikacione, t\u00eb cilat funksionojn\u00eb n\u00eb dhjet\u00eb servera.<\/p>\n<p><\/p>\n<p>Gjat\u00eb procesit t\u00eb intervistave, kam v\u00ebn\u00eb re se administratoret nuk e qasen gjithmon\u00eb si duhet monitorimin e aplikacioneve web: ende shum\u00eb ndalen te metriku i sistemit operativ, her\u00eb pas here monitorojn\u00eb sh\u00ebrbimet.<\/p>\n<p><\/p>\n<p>N\u00eb rastin tim, m\u00eb par\u00eb, n\u00eb baz\u00ebn e sistemit t\u00eb monitorimit t\u00eb klientit ishte Icinga. Ajo nuk zbulonte ashtu si\u00e7 duhej problemet e p\u00ebrmendura m\u00eb par\u00eb. Shpesh, klienti vet\u00eb na informonte p\u00ebr problemet dhe jo m\u00eb pak na mungonin t\u00eb dh\u00ebnat p\u00ebr t\u00eb kuptuar shkakun.<\/p>\n<p><\/p>\n<p>P\u00ebrve\u00e7 k\u00ebsaj, kishte nj\u00eb kuptim t\u00eb qart\u00eb p\u00ebr pamund\u00ebsin\u00eb e zhvillimit t\u00eb saj t\u00eb m\u00ebtejsh\u00ebm. Mendoj, ata q\u00eb jan\u00eb t\u00eb njohur me Icinga do t\u00eb m\u00eb kuptojn\u00eb. K\u00ebshtu, vendos\u00ebm t\u00eb riparojm\u00eb plot\u00ebsisht sistemin e monitorimit t\u00eb aplikacioneve web n\u00eb projekt.<\/p>\n<p><\/p>\n<h2 id=\"prometheus\">Prometheus<\/h2>\n<p><\/p>\n<p>Zgjedh\u00ebm Prometheus, duke u bazuar n\u00eb tri tregues t\u00eb r\u00ebnd\u00ebsish\u00ebm:<\/p>\n<p><\/p>\n<ol>\n<li>Nj\u00eb num\u00ebr i madh metricash t\u00eb disponueshme. N\u00eb rastin ton\u00eb, ato jan\u00eb 60 mij\u00eb. Sigurisht, vlen t\u00eb theksohet se shumica d\u00ebrrmuese e tyre nuk p\u00ebrdoren (ndoshta rreth 95%). N\u00eb an\u00ebn tjet\u00ebr, t\u00eb gjitha jan\u00eb relativisht t\u00eb lira. Kjo \u00ebsht\u00eb nj\u00eb tjet\u00ebr ekstrem p\u00ebr ne, krahasuar me Icinga, q\u00eb kemi p\u00ebrdorur m\u00eb par\u00eb. Atje, shtimi i metricave ishte ve\u00e7an\u00ebrisht i dhimbsh\u00ebm: ato q\u00eb kishim ishin t\u00eb shtrenjta (mjafton t\u00eb shikosh burimet e \u00e7do plugin). \u00c7do plugin ishte nj\u00eb skritp n\u00eb Bash ose Python, qasja e t\u00eb cilit ishte e shtrenjt\u00eb n\u00eb terma t\u00eb burimeve t\u00eb konsumuar.<\/li>\n<li>Ky sistem konsumon nj\u00eb sasi relativisht t\u00eb vog\u00ebl burimesh. P\u00ebr t\u00eb gjitha metricat tona, mjaftojn\u00eb 600 Mb RAM, 15% e nj\u00eb b\u00ebrthame dhe disa dhjet\u00ebra IOPS. Sigurisht, duhet t\u00eb aktivizojm\u00eb eksportuesit e metricave, por t\u00eb gjith\u00eb jan\u00eb shkruar n\u00eb Go dhe gjithashtu nuk jan\u00eb t\u00eb uritur. Nuk mendoj se n\u00eb realitetet moderne kjo \u00ebsht\u00eb nj\u00eb problem. <\/li>\n<li>Ofron mund\u00ebsin\u00eb e kalimit n\u00eb Kubernetes. Duke marr\u00eb parasysh planet e klientit \u2014 zgjedhja \u00ebsht\u00eb e qart\u00eb. <\/li>\n<\/ol>\n<p><\/p>\n<h2 id=\"elk\">ELK<\/h2>\n<p><\/p>\n<p>M\u00eb par\u00eb, ne nuk mbledhim dhe nuk p\u00ebrpunojm\u00eb log\u00ebt. Disavantazhet jan\u00eb t\u00eb qarta p\u00ebr t\u00eb gjith\u00eb. Ne zgjodh\u00ebm ELK, pasi kishim eksperienc\u00eb t\u00eb m\u00ebparshme me k\u00ebt\u00eb sistem. Atje ruajm\u00eb vet\u00ebm log\u00ebt e aplikacioneve. Kriteret kryesore p\u00ebr p\u00ebrzgjedhjen ishin k\u00ebrkimi n\u00eb tekst t\u00eb plot\u00eb dhe shpejt\u00ebsia e tij.<\/p>\n<p><\/p>\n<h2 id=\"slickhouse\">Clickhouse<\/h2>\n<p><\/p>\n<p>Fillimisht, zgjedhja ra mbi InfluxDB. Ne e dinim nevoj\u00ebn p\u00ebr mbledhjen e log\u00ebve Nginx, statistikat nga pg_stat_statements, ruajtjen e t\u00eb dh\u00ebnave historike t\u00eb Prometheus. Influx nuk na p\u00eblqeu, pasi nga koha n\u00eb koh\u00eb filloi t\u00eb konsumonte shum\u00eb memorje dhe rr\u00ebzohej. P\u00ebr m\u00eb tep\u00ebr, ne do t\u00eb doja t\u00eb grumbulloja k\u00ebrkesat sipas remote_addr, nd\u00ebrsa grumbullimi n\u00eb k\u00ebt\u00eb DB \u00ebsht\u00eb vet\u00ebm sipas etiketave. Etiketat jan\u00eb t\u00eb shtrenjta (memorie), numri i tyre \u00ebsht\u00eb n\u00eb m\u00ebnyr\u00eb t\u00eb kusht\u00ebzuar i kufizuar.<\/p>\n<p><\/p>\n<p>Ne filluam k\u00ebrkimin nga fillimi. Na nevojitej nj\u00eb baz\u00eb analitike me konsum minimal burimesh, idealisht me kompresimin e t\u00eb dh\u00ebnave n\u00eb disk.<\/p>\n<p><\/p>\n<p>Clickhouse plot\u00ebson t\u00eb gjitha k\u00ebto kritere, dhe n\u00eb asnj\u00eb rast nuk kemi penduar p\u00ebr zgjedhjen. Ne nuk shkruajm\u00eb ndonj\u00eb volum t\u00eb jasht\u00ebzakonsh\u00ebm t\u00eb dh\u00ebnash (numri i futjeve \u00ebsht\u00eb rreth pes\u00eb mij\u00eb n\u00eb minut\u00eb).<\/p>\n<p><\/p>\n<h2 id=\"newrelic\">NewRelic<\/h2>\n<p><\/p>\n<p>NewRelic historikisht ka qen\u00eb me ne, pasi ishte zgjedhja e klientit. Ajo p\u00ebrdoret si APM.<\/p>\n<p><\/p>\n<h2 id=\"zabbix\">Zabbix<\/h2>\n<p><\/p>\n<p>Ne p\u00ebrdorim Zabbix ekskluzivisht p\u00ebr monitorimin e Black Box t\u00eb API-ve t\u00eb ndryshme.<\/p>\n<p><\/p>\n<h2 id=\"opredelenie-podhoda-k-monitoringu\">P\u00ebrcaktimi i qasjes ndaj monitorimit<\/h2>\n<p><\/p>\n<p>Na p\u00eblqente t\u00eb dekompozonim detyr\u00ebn dhe k\u00ebshtu t\u00eb sistematizonim qasjen ndaj monitorimit.<\/p>\n<p><\/p>\n<p>P\u00ebr k\u00ebt\u00eb arsye, un\u00eb e kam ndar\u00eb sistemin ton\u00eb n\u00eb nivele t\u00eb ndryshme:<\/p>\n<p><\/p>\n<ul>\n<li>\u2018hardueri\u2019 dhe VMS;<\/li>\n<li>sistemi operativ;<\/li>\n<li>sh\u00ebrbimet sistemore, staku i softuerit;<\/li>\n<li>aplikacioni;<\/li>\n<li>logjika e biznesit.<\/li>\n<\/ul>\n<p><\/p>\n<p>Pse \u00ebsht\u00eb i dobish\u00ebm ky qasje:<\/p>\n<p><\/p>\n<ul>\n<li>ne dim\u00eb kush \u00ebsht\u00eb p\u00ebrgjegj\u00ebs p\u00ebr funksionimin e secilit nivel dhe, duke u bazuar n\u00eb k\u00ebt\u00eb, mund t\u00eb d\u00ebrgojm\u00eb alarme;<\/li>\n<li>mund t\u00eb p\u00ebrdorim struktur\u00ebn p\u00ebr t\u00eb shuar alarmet \u2014 do t\u00eb ishte e \u00e7uditshme t\u00eb d\u00ebrgonim nj\u00eb alarm p\u00ebr mosfunksionimin e baz\u00ebs s\u00eb t\u00eb dh\u00ebnave, kur n\u00eb p\u00ebrgjith\u00ebsi makina virtuale nuk \u00ebsht\u00eb n\u00eb dispozicion.<\/li>\n<\/ul>\n<p><\/p>\n<p>Duke pasur parasysh se detyra jon\u00eb \u00ebsht\u00eb t\u00eb identifikojm\u00eb shkeljet n\u00eb funksionimin e sistemit, duhet t\u00eb evidentojm\u00eb nj\u00eb set metricash n\u00eb \u00e7do nivel, t\u00eb cilat ia vlen t\u00eb merren parasysh gjat\u00eb shkruarjes s\u00eb rregullave t\u00eb alarmin. M\u00eb posht\u00eb do t\u00eb kalojm\u00eb n\u00eb nivelet \u2018VMS\u2019, \u2018Sistemi Operativ\u2019 dhe \u2018Sh\u00ebrbimet Sistemore, Staku i Softuerit\u2019.<\/p>\n<p><\/p>\n<h2 id=\"virtualnye-mashiny\">Makinat virtuale<\/h2>\n<p><\/p>\n<p><a class=\"wpil_keyword_link\" href=\"https:\/\/prohoster.info\/sq\/\"   title=\"Hosting\" data-wpil-keyword-link=\"linked\"  data-wpil-monitor-id=\"2329\">Hosting<\/a> na ndan procesorin, disku, memorjen dhe rrjetin. Dhe p\u00ebr dy t\u00eb parat pat\u00ebm disa probleme. Pra, metricat:<\/p>\n<p><\/p>\n<p>Koha e vjedhur e CPU \u2014 kur blini nj\u00eb virtual si n\u00eb Amazon (p.sh. t2.micro), duhet t\u00eb kuptoni se ju jepet jo nj\u00eb b\u00ebrtham\u00eb t\u00eb plot\u00eb t\u00eb procesorit, por vet\u00ebm nj\u00eb kuot\u00eb t\u00eb koh\u00ebs s\u00eb tij. Dhe kur ta shpenzoni, procesori do t\u00eb filloj\u00eb t\u00eb merret nga ju.<\/p>\n<p><\/p>\n<p>Kjo metrik\u00eb lejon t\u00eb monitoroni k\u00ebto momente dhe t\u00eb merrni vendime. P\u00ebr shembull, a duhet t\u00eb merrni nj\u00eb tarif\u00eb m\u00eb t\u00eb madhe apo t\u00eb ndajm\u00eb p\u00ebrpunimin e detyrave pasive dhe k\u00ebrkesat n\u00eb API n\u00eb t\u00eb ndryshme <a class=\"wpil_keyword_link\" href=\"https:\/\/prohoster.info\/sq\/server\/dts-los-angeles\/\"   title=\"server\u00eb\" data-wpil-keyword-link=\"linked\"  data-wpil-monitor-id=\"3493\">server\u00eb<\/a>.<\/p>\n<p><\/p>\n<p>IOPS + Koha e pritjes s\u00eb CPU iowait \u2014 p\u00ebr ndonj\u00eb arsyetim, shum\u00eb hoste n\u00eb re shpesh d\u00ebshtojn\u00eb n\u00eb dh\u00ebnien e IOPS. M\u00eb shum\u00eb, nj\u00eb grafik me IOPS t\u00eb ul\u00ebt p\u00ebr ta nuk \u00ebsht\u00eb nj\u00eb argument. Prandaj \u00ebsht\u00eb e r\u00ebnd\u00ebsishme t\u00eb grumbullojm\u00eb edhe CPU iowait. Me k\u00ebt\u00eb \u00e7ift grafik\u00ebsh \u2014 me IOPS t\u00eb ul\u00ebt dhe pritje t\u00eb lart\u00eb t\u00eb hyrjeve-daljeve \u2014 mund t\u00eb flasim me hostin dhe t\u00eb zgjidhim problemin.<\/p>\n<p><\/p>\n<h2 id=\"operacionnaya-sistema\">Sistemi operativ<\/h2>\n<p><\/p>\n<p>Metricat e sistemit operativ:<\/p>\n<p><\/p>\n<ul>\n<li>numri i memories s\u00eb disponueshme n\u00eb %;<\/li>\n<li>aktiviteti i p\u00ebrdorimit t\u00eb swap: vmstat swapin, swapout;<\/li>\n<li>numri i inode-ve t\u00eb disponuesh\u00ebm dhe hap\u00ebsira e lir\u00eb n\u00eb sistemin e skedar\u00ebve n\u00eb %<\/li>\n<li>ngarkesa mesatare;<\/li>\n<li>numri i lidhjeve n\u00eb gjendje tw;<\/li>\n<li>mbushja e tabel\u00ebs conntrack;<\/li>\n<li>cil\u00ebsia e funksionimit t\u00eb rrjetit mund t\u00eb monitorohet me ndihm\u00ebn e utilitetit ss, me paket\u00ebn iproute2 \u2014 duke marr\u00eb nga dalja e saj treguesin e RTT-lidhjeve dhe grupuar sipas portit destinacion.<\/li>\n<\/ul>\n<p><\/p>\n<p>Po ashtu, n\u00eb nivelin e sistemit operativ kemi nj\u00eb entitet t\u00eb till\u00eb, si proceset. \u00cbsht\u00eb e r\u00ebnd\u00ebsishme t\u00eb evidentojm\u00eb nj\u00eb set procesesh n\u00eb sistem q\u00eb luajn\u00eb nj\u00eb rol t\u00eb r\u00ebnd\u00ebsish\u00ebm n\u00eb funksionimin e tij. N\u00ebse, p\u00ebr shembull, keni disa pgpool, \u00ebsht\u00eb e nevojshme t\u00eb grumbulloni informacion p\u00ebr secilin prej tyre.<\/p>\n<p><\/p>\n<p>Seti i metricave \u00ebsht\u00eb si m\u00eb posht\u00eb:<\/p>\n<p><\/p>\n<ul>\n<li>CPU;<\/li>\n<li>memoria \u2014 n\u00eb radh\u00eb t\u00eb par\u00eb, rezidente;<\/li>\n<li>IO \u2014 idealisht n\u00eb IOPS;<\/li>\n<li>FileFd \u2014 hapjet dhe kufiri;<\/li>\n<li>d\u00ebshtimet e r\u00ebnd\u00ebsishme t\u00eb faqeve \u2014 k\u00ebshtu do t\u00eb mund t\u00eb kuptoni se cili proces \u00ebsht\u00eb duke swap-uar.<\/li>\n<\/ul>\n<p><\/p>\n<p>E gjith\u00eb monitorimi yn\u00eb \u00ebsht\u00eb e vendosur n\u00eb Docker; p\u00ebr mbledhjen e t\u00eb dh\u00ebnave t\u00eb metrikave p\u00ebrdorim Cadvisor. N\u00eb makinat e tjera p\u00ebrdorim process-exporter.<\/p>\n<p><\/p>\n<h2 id=\"sistemnye-servisy-stek-po\">Sh\u00ebrbimet sistemor, staku i softuerit<\/h2>\n<p><\/p>\n<p>\u00c7do aplikacion ka specifik\u00ebn e vet, dhe \u00ebsht\u00eb e v\u00ebshtir\u00eb t\u00eb ve\u00e7osh nj\u00eb grup t\u00eb caktuar metrikash.<\/p>\n<p><\/p>\n<p>Grupi universale \u00ebsht\u00eb:<\/p>\n<p><\/p>\n<ul>\n<li>norma e k\u00ebrkesave;<\/li>\n<li>numri i gabimeve;<\/li>\n<li>latenca;<\/li>\n<li>saturation.<\/li>\n<\/ul>\n<p><\/p>\n<p>Shembujt m\u00eb t\u00eb duksh\u00ebm t\u00eb monitorimit n\u00eb k\u00ebt\u00eb nivel jan\u00eb \u2014 Nginx dhe PostgreSQL.<\/p>\n<p><\/p>\n<p>Sh\u00ebrbimi m\u00eb i ngarkuar n\u00eb sistemin ton\u00eb \u00ebsht\u00eb databaza. M\u00eb par\u00eb, ne kishim probleme mjaft shpesh p\u00ebr t\u00eb zbuluar \u00e7far\u00eb po b\u00ebnte databaza.<\/p>\n<p><\/p>\n<p>Ne pam\u00eb nj\u00eb ngarkes\u00eb t\u00eb lart\u00eb n\u00eb disqe, por log-et e ngadalta nuk tregonin asgj\u00eb n\u00eb t\u00eb v\u00ebrtet\u00eb. K\u00ebt\u00eb problem e zgjidh\u00ebm me ndihm\u00ebn e pg_stat_statements, nj\u00eb paraqitje ku grumbullohet statistika mbi k\u00ebrkesat.<\/p>\n<p><\/p>\n<p>Kjo \u00ebsht\u00eb gjith\u00e7ka q\u00eb i nevojitet administratorit.<\/p>\n<p><\/p>\n<p>Nd\u00ebrtojm\u00eb grafike aktiviteti t\u00eb k\u00ebrkesave p\u00ebr lexim dhe shkrim:<\/p>\n<p>\n<img decoding=\"async\" alt=\"Si si po nd\u00ebrtimin e monitorimit me Prometheus, Clickhouse dhe ELK\" src=\"\/wp-content\/uploads\/2019\/04\/f838b7759221b284c06941291fa186df.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<img decoding=\"async\" alt=\"Si si po nd\u00ebrtimin e monitorimit me Prometheus, Clickhouse dhe ELK\" src=\"\/wp-content\/uploads\/2019\/04\/ea8684ea81f21c8d762a606aeb8342a3.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>E gjith\u00eb kjo \u00ebsht\u00eb e thjesht\u00eb dhe e qart\u00eb, \u00e7do k\u00ebrkes\u00eb ka ngjyr\u00ebn e saj.<\/p>\n<p><\/p>\n<p>Nj\u00eb shembull po ashtu i duksh\u00ebm \u2014 log-et e Nginx. Nuk \u00ebsht\u00eb e habitshme q\u00eb pak kush i p\u00ebrpunon ato ose i p\u00ebrmend n\u00eb list\u00ebn e detyrueshme. Formati standard nuk \u00ebsht\u00eb shum\u00eb informues dhe \u00ebsht\u00eb e nevojshme q\u00eb t\u00eb zgjerohet.<\/p>\n<p><\/p>\n<p>Personalizova aq, sa shtova request_time, upstream_response_time, body_bytes_sent, request_length, request_id. Nd\u00ebrtojm\u00eb grafike t\u00eb koh\u00ebs s\u00eb p\u00ebrgjigjes dhe numrit t\u00eb gabimeve:<\/p>\n<p>\n<img decoding=\"async\" alt=\"Si si po nd\u00ebrtimin e monitorimit me Prometheus, Clickhouse dhe ELK\" src=\"\/wp-content\/uploads\/2019\/04\/e517f15303f8fa780d40b7f7e30eb9ef.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<img decoding=\"async\" alt=\"Si si po nd\u00ebrtimin e monitorimit me Prometheus, Clickhouse dhe ELK\" src=\"\/wp-content\/uploads\/2019\/04\/9a07ffda75300ec939edff24532fc294.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>Nd\u00ebrtojm\u00eb grafike t\u00eb koh\u00ebs s\u00eb p\u00ebrgjigjes dhe numrit t\u00eb gabimeve. A e mbani mend? Un\u00eb fola p\u00ebr detyrat e biznesit? T\u00eb gjitha shpejt dhe pa gabime? Ne tashm\u00eb i kemi mbyllur k\u00ebto pyetje me dy grafik\u00eb. Dhe mbi ta, tani \u00ebsht\u00eb e mundur t\u00eb telefonosh administrator\u00ebt e sh\u00ebrbimit.<\/p>\n<p><\/p>\n<p>Por ka mbetur nj\u00eb problem tjet\u00ebr \u2014 t\u00eb sigurojm\u00eb eliminimin e shpejt\u00eb t\u00eb shkaqeve t\u00eb incidentit.<\/p>\n<p><\/p>\n<h2 id=\"ustranenie-incidentov\">Eliminimi i incidenteve<\/h2>\n<p><\/p>\n<p>E gjith\u00ebProcedura nga identifikimi deri n\u00eb zgjidhjen e problemit mund t\u00eb ndahet n\u00eb disa hapa:<\/p>\n<p><\/p>\n<ul>\n<li>identifikimi i problemit;<\/li>\n<li>njoftimi i administratorit t\u00eb sh\u00ebrbimit;<\/li>\n<li>reaksioni ndaj incidentit;<\/li>\n<li>eliminimi i shkaqeve.<\/li>\n<\/ul>\n<p><\/p>\n<p>\u00cbsht\u00eb e r\u00ebnd\u00ebsishme q\u00eb ne t\u00eb b\u00ebjm\u00eb k\u00ebt\u00eb sa m\u00eb shpejt t\u00eb jet\u00eb e mundur. Dhe n\u00ebse n\u00eb etapet e identifikimit t\u00eb problemit dhe d\u00ebrgimin e njoftimit nuk mund t\u00eb fitojm\u00eb shum\u00eb koh\u00eb \u2014 dy minuta do t\u00eb shkojn\u00eb n\u00eb \u00e7do rast, at\u00ebher\u00eb etapet e m\u00ebpasshme jan\u00eb thjesht nj\u00eb fush\u00eb e paprekur p\u00ebr p\u00ebrmir\u00ebsime.<\/p>\n<p><\/p>\n<p>Le t\u00eb imagjinom\u00eb se telefoni i roj\u00ebs s\u00eb sh\u00ebrbimit ka r\u00ebn\u00eb. \u00c7far\u00eb do t\u00eb b\u00ebj\u00eb ai? Do t\u00eb k\u00ebrkoj\u00eb p\u00ebrgjigje p\u00ebr pyetje \u2014 \u00e7far\u00eb \u00ebsht\u00eb prishur, ku \u00ebsht\u00eb prishur, si t\u00eb reagoj\u00eb? K\u00ebshtu p\u00ebrgjigjemi n\u00eb k\u00ebto pyetje:<\/p>\n<p>\n<img decoding=\"async\" alt=\"Si si po nd\u00ebrtimin e monitorimit me Prometheus, Clickhouse dhe ELK\" src=\"\/wp-content\/uploads\/2019\/04\/7f33172922e646a24bb83733350b24f5.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>Ne thjesht p\u00ebrfshijm\u00eb t\u00eb gjitha k\u00ebto informacione n\u00eb tekstin e njoftimit dhe i japim nj\u00eb lidhje p\u00ebr faqen n\u00eb wiki, ku p\u00ebrshkruhet se si t\u00eb reagoni p\u00ebr k\u00ebt\u00eb problem, si ta zgjidhni dhe ta eskaloni at\u00eb.<\/p>\n<p><\/p>\n<p>Un\u00eb ende nuk kam th\u00ebn\u00eb asgj\u00eb p\u00ebr nivelin e aplikacionit dhe logjik\u00ebn e biznesit. Fatkeq\u00ebsisht, n\u00eb aplikacionet tona ende nuk \u00ebsht\u00eb implementuar mbledhja e metrikave. Burimi i vet\u00ebm i jak\u00ebson ndonj\u00eb informacion nga k\u00ebto nivele jan\u00eb loget.<\/p>\n<p><\/p>\n<p>Disa pika.<\/p>\n<p><\/p>\n<p>S\u00eb pari, shkruani loge t\u00eb strukturuara. Mos e p\u00ebrfshini kontekstin n\u00eb tekstin e mesazhit. Kjo e v\u00ebshtir\u00ebson grupimin dhe analiz\u00ebn e tyre. Logstash k\u00ebrkon shum\u00eb koh\u00eb p\u00ebr t'i normalizuar t\u00eb gjitha k\u00ebto.<\/p>\n<p><\/p>\n<p>S\u00eb dyti, p\u00ebrdorni sakt\u00ebsisht nivelet e r\u00ebnd\u00ebsis\u00eb. \u00c7do gjuh\u00eb ka standardin e saj. Personalisht, ndaj kat\u00ebr nivele:<\/p>\n<p><\/p>\n<ol>\n<li>nuk ka gabim;<\/li>\n<li>gabim nga ana e klientit;<\/li>\n<li>gabim nga ana jon\u00eb, nuk humbasim para, nuk kemi rreziqe;<\/li>\n<li>gabim nga ana jon\u00eb, humbasim para.<\/li>\n<\/ol>\n<p><\/p>\n<p>N\u00eb p\u00ebrmbledhje. Duhet t\u00eb p\u00ebrpiqemi t\u00eb nd\u00ebrtojm\u00eb monitorimin pik\u00ebrisht nga logjika e biznesit. T\u00eb p\u00ebrpiqemi t\u00eb monitorojm\u00eb vet\u00eb aplikacionin dhe t\u00eb operojm\u00eb me metrika si numri i shitjeve, numri i regjistrimeve t\u00eb reja t\u00eb p\u00ebrdoruesve, numri i p\u00ebrdoruesve aktiv\u00eb n\u00eb k\u00ebt\u00eb moment dhe k\u00ebshtu me radh\u00eb.<\/p>\n<p><\/p>\n<p>N\u00ebse e gjith\u00eb biznesi juaj \u00ebsht\u00eb nj\u00eb buton n\u00eb shfletues, duhet t\u00eb monitoroni n\u00ebse ai klikohet, n\u00ebse funksionon si\u00e7 duhet. Gjith\u00e7ka tjet\u00ebr nuk ka r\u00ebnd\u00ebsi.<\/p>\n<p><\/p>\n<p>N\u00ebse nuk e keni k\u00ebt\u00eb, mund t\u00eb p\u00ebrpiqeni ta rikuperoni k\u00ebt\u00eb n\u00eb loget e aplikacionit, loget Nginx dhe k\u00ebshtu me radh\u00eb, si\u00e7 kemi b\u00ebr\u00eb ne. Duhet t\u00eb jeni sa m\u00eb af\u00ebr aplikacionit.<\/p>\n<p><\/p>\n<p>Metrit e sistemit operativ sigurisht q\u00eb jan\u00eb t\u00eb r\u00ebnd\u00ebsishme, por biznesi nuk \u00ebsht\u00eb i interesuar p\u00ebr to, ne nuk paguhet p\u00ebr to.<\/p>\n<p>Burimi: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/449352\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u041c\u0435\u043d\u044f \u0437\u043e\u0432\u0443\u0442 \u0410\u043d\u0442\u043e\u043d \u0411\u0430\u0434\u0435\u0440\u0438\u043d. \u042f \u0440\u0430\u0431\u043e\u0442\u0430\u044e \u0432 \u0426\u0435\u043d\u0442\u0440\u0435 \u0412\u044b\u0441\u043e\u043a\u0438\u0445 \u0422\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u0438 \u0437\u0430\u043d\u0438\u043c\u0430\u044e\u0441\u044c \u0441\u0438\u0441\u0442\u0435\u043c\u043d\u044b\u043c \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u0435\u043c. \u041c\u0435\u0441\u044f\u0446 \u043d\u0430\u0437\u0430\u0434 \u0437\u0430\u0432\u0435\u0440\u0448\u0438\u043b\u0430\u0441\u044c \u043d\u0430\u0448\u0430 \u043a\u043e\u0440\u043f\u043e\u0440\u0430\u0442\u0438\u0432\u043d\u0430\u044f \u043a\u043e\u043d\u0444\u0435\u0440\u0435\u043d\u0446\u0438\u044f, \u0433\u0434\u0435 \u043c\u044b \u0434\u0435\u043b\u0438\u043b\u0438\u0441\u044c \u043d\u0430\u043a\u043e\u043f\u043b\u0435\u043d\u043d\u044b\u043c \u043e\u043f\u044b\u0442\u043e\u043c \u0441 IT-\u0441\u043e\u043e\u0431\u0449\u0435\u0441\u0442\u0432\u043e\u043c \u043d\u0430\u0448\u0435\u0433\u043e \u0433\u043e\u0440\u043e\u0434\u0430. \u042f \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u044b\u0432\u0430\u043b \u043f\u0440\u043e \u043c\u043e\u043d\u0438\u0442\u043e\u0440\u0438\u043d\u0433 \u0432\u0435\u0431-\u043f\u0440\u0438\u043b\u043e\u0436\u0435\u043d\u0438\u0439. \u041c\u0430\u0442\u0435\u0440\u0438\u0430\u043b \u043f\u0440\u0435\u0434\u043d\u0430\u0437\u043d\u0430\u0447\u0430\u043b\u0441\u044f \u0434\u043b\u044f \u0443\u0440\u043e\u0432\u043d\u044f junior \u0438\u043b\u0438 middle, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u043d\u0435 \u0432\u044b\u0441\u0442\u0440\u0430\u0438\u0432\u0430\u043b\u0438 \u044d\u0442\u043e\u0442 \u043f\u0440\u043e\u0446\u0435\u0441\u0441 \u0441 \u043d\u0443\u043b\u044f. \u041a\u0440\u0430\u0435\u0443\u0433\u043e\u043b\u044c\u043d\u044b\u0439 \u043a\u0430\u043c\u0435\u043d\u044c, \u043b\u0435\u0436\u0430\u0449\u0438\u0439 \u0432 \u043e\u0441\u043d\u043e\u0432\u0435 \u043b\u044e\u0431\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u044b [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":24139,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-32322","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.2 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u041c\u0435\u043d\u044f \u0437\u043e\u0432\u0443\u0442 \u0410\u043d\u0442\u043e\u043d \u0411\u0430\u0434\u0435\u0440\u0438\u043d. \u042f \u0440\u0430\u0431\u043e\u0442\u0430\u044e \u0432 \u0426\u0435\u043d\u0442\u0440\u0435 \u0412\u044b\u0441\u043e\u043a\u0438\u0445 \u0422\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u0438 \u0437\u0430\u043d\u0438\u043c\u0430\u044e\u0441\u044c \u0441\u0438\u0441\u0442\u0435\u043c\u043d\u044b\u043c \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u0435\u043c.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/kak-my-stroili-monitoring-na-prometheus-clickhouse-i-elk\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.2\" \/>\n\t\t<meta property=\"og:locale\" content=\"sq_AL\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u041a\u0430\u043a \u043c\u044b \u0441\u0442\u0440\u043e\u0438\u043b\u0438 \u043c\u043e\u043d\u0438\u0442\u043e\u0440\u0438\u043d\u0433 \u043d\u0430 Prometheus, Clickhouse \u0438 ELK | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u041c\u0435\u043d\u044f \u0437\u043e\u0432\u0443\u0442 \u0410\u043d\u0442\u043e\u043d \u0411\u0430\u0434\u0435\u0440\u0438\u043d. \u042f \u0440\u0430\u0431\u043e\u0442\u0430\u044e \u0432 \u0426\u0435\u043d\u0442\u0440\u0435 \u0412\u044b\u0441\u043e\u043a\u0438\u0445 \u0422\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u0438 \u0437\u0430\u043d\u0438\u043c\u0430\u044e\u0441\u044c \u0441\u0438\u0441\u0442\u0435\u043c\u043d\u044b\u043c \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u0435\u043c.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/kak-my-stroili-monitoring-na-prometheus-clickhouse-i-elk\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2019-10-31T18:46:21+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2019-10-31T18:46:21+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Si e nd\u00ebrtuam monitorimin me Prometheus, Clickhouse dhe ELK | ProHoster","description":"Emri im \u00ebsht\u00eb Anton Baderin. Punoj n\u00eb Qendr\u00ebn e Teknologjive t\u00eb Larta dhe merrem me administrimin e sistemeve.","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/kak-my-stroili-monitoring-na-prometheus-clickhouse-i-elk","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041a\u0430\u043a \u043c\u044b \u0441\u0442\u0440\u043e\u0438\u043b\u0438 \u043c\u043e\u043d\u0438\u0442\u043e\u0440\u0438\u043d\u0433 \u043d\u0430 Prometheus, Clickhouse \u0438 ELK | ProHoster","og:description":"\u041c\u0435\u043d\u044f \u0437\u043e\u0432\u0443\u0442 \u0410\u043d\u0442\u043e\u043d \u0411\u0430\u0434\u0435\u0440\u0438\u043d. \u042f \u0440\u0430\u0431\u043e\u0442\u0430\u044e \u0432 \u0426\u0435\u043d\u0442\u0440\u0435 \u0412\u044b\u0441\u043e\u043a\u0438\u0445 \u0422\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u0438 \u0437\u0430\u043d\u0438\u043c\u0430\u044e\u0441\u044c \u0441\u0438\u0441\u0442\u0435\u043c\u043d\u044b\u043c \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u0435\u043c.","og:url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/kak-my-stroili-monitoring-na-prometheus-clickhouse-i-elk","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T18:46:21+00:00","article:modified_time":"2019-10-31T18:46:21+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"32322","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-02-22 15:34:41","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 03:00:23","updated":"2026-02-22 15:34:41","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/32322","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=32322"}],"version-history":[{"count":2,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/32322\/revisions"}],"predecessor-version":[{"id":162019,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/32322\/revisions\/162019"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media\/24139"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=32322"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=32322"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=32322"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}