{"id":54601,"date":"2019-12-30T00:00:00","date_gmt":"2019-12-29T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics"},"modified":"2020-02-18T14:02:38","modified_gmt":"2020-02-18T11:02:38","slug":"vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sk\/blog\/administrirovanie\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics","title":{"rendered":"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Ahoj v\u0161etk\u00fdm. Ni\u017e\u0161ie je prepis <noindex><a rel=\"nofollow\" href=\"https:\/\/www.youtube.com\/watch?v=HyOXAdQE0Pk\">predn\u00e1\u0161ky z Big Monitoring Meetup 4<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><strong><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/prometheus\">Prometheus<\/a><\/noindex><\/strong> \u2013 syst\u00e9m monitorovania r\u00f4znych syst\u00e9mov a slu\u017eieb, pomocou ktor\u00e9ho syst\u00e9mov\u00ed administr\u00e1tori m\u00f4\u017eu zhroma\u017e\u010fova\u0165 inform\u00e1cie o aktu\u00e1lnych parametroch syst\u00e9mov a nastavova\u0165 upozornenia na z\u00edskavanie notifik\u00e1ci\u00ed o odch\u00fdlkach v ich fungovan\u00ed.<\/p>\n<p><\/p>\n<p>V predn\u00e1\u0161ke bude porovnanie <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\">Thanos<\/a><\/noindex> a <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\">VictoriaMetrics<\/a><\/noindex> \u2013 projektov pre dlhodob\u00e9 uchov\u00e1vanie metriky Prometheus.<\/p>\n<p><noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/b65866353c1f816a8cb2a90af1ceac23.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\n<center><div class=\"youtube-placeholder\" data-id=\"HyOXAdQE0Pk\" onclick=\"loadVideo(this)\">\r\n        <img decoding=\"async\" src=\"https:\/\/img.youtube.com\/vi\/HyOXAdQE0Pk\/hqdefault.jpg\" alt=\"Prehrajte video\" loading=\"lazy\" width=\"480\" height=\"360\" style=\"width:100%;height:auto;\">\r\n        <div class=\"play-button\"><\/div>\r\n    <\/div><\/center><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/dc3c90711a8102d3e70b972ca47ec152.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Na za\u010diatku sa rozpr\u00e1vam o Prometheovi. Je to monitorovac\u00ed syst\u00e9m, ktor\u00fd zhroma\u017e\u010fuje metriky z ur\u010den\u00fdch cie\u013eov a uklad\u00e1 ich do lok\u00e1lneho \u00falo\u017eiska. Prometheus dok\u00e1\u017ee zapisova\u0165 metriky do vzdialen\u00e9ho \u00falo\u017eiska, dok\u00e1\u017ee generova\u0165 upozornenia a pravidl\u00e1 pre zaznamen\u00e1vanie. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/e9852597e74c675d2216d971f19857c2.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<h3 id=\"ogranicheniya-prometheus\">Obmedzenia Prometheus:<\/h3>\n<p><\/p>\n<ul>\n<li>Nem\u00e1 glob\u00e1lny v\u00fdh\u013ead na dopyty. To nast\u00e1va, ke\u010f m\u00e1te nieko\u013eko nez\u00e1visl\u00fdch in\u0161tanci\u00ed Prometheus. Zhroma\u017e\u010fuj\u00fa metriky a vy chcete urobi\u0165 dopyt nad v\u0161etk\u00fdmi t\u00fdmito metrikami zhroma\u017eden\u00fdmi z r\u00f4znych in\u0161tanci\u00ed Prometheus. Prometheus to neumo\u017e\u0148uje.<\/li>\n<li>V\u00fdkon prometheusa je obmedzen\u00fd len na jeden server. Prometheus sa automaticky nem\u00f4\u017ee \u0161k\u00e1lova\u0165 na viacero serverov. M\u00f4\u017eete iba ru\u010dne rozdeli\u0165 va\u0161e ciele medzi nieko\u013eko Prometheov.<\/li>\n<li>Objem metriky v Prometheus je obmedzen\u00fd iba jedn\u00fdm serverom z rovnak\u00e9ho d\u00f4vodu, pre ktor\u00fd sa automaticky nem\u00f4\u017ee roz\u0161irova\u0165 na viacero serverov.<\/li>\n<li>V Prometheus nie je tak\u00e9 jednoduch\u00e9 zorganizova\u0165 ochr\u00e1nenie d\u00e1t.<\/li>\n<\/ul>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/c140d41f1fe39d33e1fc84f5cc111481.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<h3 id=\"resheniya-etih-problemzadach\">Rie\u0161enia t\u00fdchto probl\u00e9mov\/\u00faloh?<\/h3>\n<p><\/p>\n<p>Rie\u0161enia s\u00fa tak\u00e9to:<\/p>\n<p><\/p>\n<ul>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\">Thanos<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\">VictoriaMetrics<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/m3db\">Uber M3<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/cortexproject\/cortex\">Cortex<\/a><\/noindex><\/li>\n<\/ul>\n<p><\/p>\n<p>V\u0161etky tieto rie\u0161enia pre vzdialen\u00e9 uchov\u00e1vanie d\u00e1t, ktor\u00e9 zhroma\u017edil Prometheus. Rie\u0161ia probl\u00e9m vzdialen\u00e9ho \u00falo\u017eiska z predch\u00e1dzaj\u00faceho sn\u00edmku r\u00f4znymi sp\u00f4sobmi. V tejto prezent\u00e1cii budem hovori\u0165 len o prv\u00fdch dvoch rie\u0161eniach: <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\">Thanos<\/a><\/noindex> a <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\">VictoriaMetrics<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p>Prv\u00fdkr\u00e1t sa inform\u00e1cie o <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\">Thanos<\/a><\/noindex> objavili <noindex><a rel=\"nofollow\" href=\"https:\/\/improbable.io\/blog\/thanos-prometheus-at-scale\">tento odkaz<\/a><\/noindex>. Tam je op\u00edsan\u00e1 architekt\u00fara <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\">Thanos<\/a><\/noindex> a ako funguje.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/317db6bb4c3cd69d8742addb2bae16a4.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos berie \u00fadaje, ktor\u00e9 ulo\u017eil Prometheus na lok\u00e1lny disk a pren\u00e1\u0161a ich do S3, do <noindex><a rel=\"nofollow\" href=\"https:\/\/cloud.google.com\/storage\/\">GCS<\/a><\/noindex> alebo do in\u00e9ho objektov\u00e9ho \u00falo\u017eiska.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/7cf5f99dc5ce78f22c5956373812c0aa.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Takto Thanos zabezpe\u010duje glob\u00e1lny v\u00fdh\u013ead na dopyty. M\u00f4\u017eete \u017eiada\u0165 \u00fadaje, ktor\u00e9 s\u00fa ulo\u017een\u00e9 v objektovom \u00falo\u017eisku z nieko\u013ek\u00fdch in\u0161tanci\u00ed Prometheus.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/286cf441fe18fb756c2708086872d8d8.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos podporuje PromQL a <noindex><a rel=\"nofollow\" href=\"https:\/\/prometheus.io\/docs\/prometheus\/latest\/querying\/api\/\">API dopytovania Prometheus.<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6a750070d76414370501a8153cd48007.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos pou\u017e\u00edva k\u00f3d Prometheus na ukladanie \u00fadajov.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/ba0ca17154f9407900efc336f213ba07.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos vyv\u00edjaj\u00fa t\u00ed ist\u00ed v\u00fdvoj\u00e1ri, ktor\u00ed vyvinuli aj Prometheus.<\/p>\n<p><\/p>\n<p>O <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\">VictoriaMetrics<\/a><\/noindex>. Tu je <noindex><a rel=\"nofollow\" href=\"https:\/\/medium.com\/faun\/victoriametrics-creating-the-best-remote-storage-for-prometheus-5d92d66787ac\">odkaz<\/a><\/noindex>, kde sme prv\u00fdkr\u00e1t hovorili o <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\">VictoriaMetrics<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a901d016e6e58c40c6c7c96b1cd5a8c9.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics z\u00edskava d\u00e1ta z viacer\u00fdch prometheus cez <noindex><a rel=\"nofollow\" href=\"https:\/\/prometheus.io\/docs\/practices\/remote_write\/\">remote write API<\/a><\/noindex> protokol, ktor\u00fd podporuje Prometheus.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/24798414102cc63a1a1062c5ae327f4c.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics poskytuje glob\u00e1lny poh\u013ead na dotazy, preto\u017ee nieko\u013eko in\u0161tanci\u00ed Prometheus m\u00f4\u017ee zapisova\u0165 d\u00e1ta do jednej VictoriaMetrics. M\u00f4\u017eete teda vykon\u00e1va\u0165 dotazy nad v\u0161etk\u00fdmi t\u00fdmito \u00fadajmi.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a717855dbdf1df859927a75557ee2573.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics tie\u017e podporuje, rovnako ako Thanos \u2014 PromQL a Prometheus querying API.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/84daf1b7e160e6f9d8a53a83329f2436.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Na rozdiel od Thanos, zdrojov\u00fd k\u00f3d VictoriaMetrics bol nap\u00edsan\u00fd od nuly a optimalizovan\u00fd pre r\u00fdchlos\u0165 a spotrebu zdrojov. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/371dee8d4705438f560245c4e5e7444f.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics sa, na rozdiel od Thanos, \u0161k\u00e1luje vertik\u00e1lne aj horizont\u00e1lne. Existuje <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\/blob\/master\/README.md\">verzia pre jedin\u00e9ho uzla<\/a><\/noindex>, ktor\u00e1 sa \u0161k\u00e1luje vertik\u00e1lne. M\u00f4\u017eete za\u010da\u0165 s jedn\u00fdm procesorom a 1 GB pam\u00e4te a postupne r\u00e1s\u0165 a\u017e po stovky procesorov a 1 TB pam\u00e4te. VictoriaMetrics dok\u00e1\u017ee vyu\u017ei\u0165 v\u0161etky tieto zdroje. Jej v\u00fdkon vzrastie pribli\u017ene 100-kr\u00e1t v porovnan\u00ed s jednojadrov\u00fdm syst\u00e9mom. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/697e77546cda492f8512e7e761c0300f.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Hist\u00f3ria Thanos sa za\u010dala v novembri 2017, ke\u010f sa objavil prv\u00fd verejn\u00fd commit. Predt\u00fdm, Thanos sa vyv\u00edjal vo vn\u00fatri spolo\u010dnosti <noindex><a rel=\"nofollow\" href=\"https:\/\/improbable.io\">improbable.io<\/a><\/noindex>. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/610a81cfb98082bb61b7ae28b00d2c78.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V j\u00fani 2019 do\u0161lo k v\u00fdznamn\u00e9mu vydaniu 0.5.0, v ktorom <noindex><a rel=\"nofollow\" href=\"https:\/\/thanos.io\/proposals\/201809_gossip-removal.md\/\">vymazali<\/a><\/noindex> <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Gossip_protocol\">gossip<\/a><\/noindex> protokol. Bol odstr\u00e1nen\u00fd z Thanos, preto\u017ee sa uk\u00e1zal v nie najlep\u0161om svetle. \u010casto klaster Thanos nespr\u00e1vne fungoval, uzly sa k nemu nespr\u00e1vne prip\u00e1jali kv\u00f4li gossip protokolu. Preto sa rozhodli tento protokol odstr\u00e1ni\u0165. Pova\u017eujem to za spr\u00e1vne rozhodnutie. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/d7ecf0105d46464aadc4c46147edf9dc.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V tom istom j\u00fani 2019 poslali \u017eiados\u0165 \u010d\u00edslo <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/cncf\/toc\/pull\/256\">256<\/a><\/noindex> v <noindex><a rel=\"nofollow\" href=\"https:\/\/www.cncf.io\/\">Cloud Native Computing Foundation<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a8685a616bbdc619009c570e28c9f15b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>A o p\u00e1r mesiacov Thanos prijali do <noindex><a rel=\"nofollow\" href=\"https:\/\/www.cncf.io\/\">Cloud Native Computing Foundation<\/a><\/noindex>, do ktor\u00e9ho patr\u00ed Prometheus, Kubernetes a \u010fal\u0161ie popul\u00e1rne projekty.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/90c64c519aa283b13ce64b96da5ac945.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V janu\u00e1ri 2018 sa za\u010dal v\u00fdvoj VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/c2243e3e0a8d00715644d7c84627c5cb.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V septembri 2018 som prv\u00fdkr\u00e1t verejne spomenul VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/66feecad1783c36651cdf2a19e6d0d70.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V decembri 2018 bola zverejnen\u00e1 verzia pre jedin\u00e9ho uzla.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/aacf5d683c7d639df7a9f05e297f08c4.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V m\u00e1ji 2019 <noindex><a rel=\"nofollow\" href=\"https:\/\/blog.usejournal.com\/open-sourcing-victoriametrics-f31e34485c2b\">boli zverejnen\u00e9<\/a><\/noindex> zdrojov\u00e9 k\u00f3dy pre verziu pre jedin\u00e9ho uzla ako aj pre klastrov\u00fa verziu. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6da160c13c87133b1994ef32f86db077.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V j\u00fani 2019, rovnako ako Thanos, sme podali \u017eiados\u0165 do CNCF foundation pod \u010d\u00edslom <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/cncf\/toc\/pull\/255\">255<\/a><\/noindex>. \u017diados\u0165 sme podali de\u0148 pred t\u00fdm, ako podal \u017eiados\u0165 Thanos. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/12c281eae67b3cec5a66fab41aee1fdb.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Ale, bohu\u017eia\u013e, zatia\u013e n\u00e1s tam neprijali. Potrebujeme pomoc komunity.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/ab7b20661c3cfa01209cd742eb71a898.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pozrime sa na najd\u00f4le\u017eitej\u0161ie sn\u00edmky, ktor\u00e9 ukazuj\u00fa architekt\u00faru Thanos a VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a268b600bcd0cebfd9c5069d2d911a9d.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Za\u010dneme s Thanos. \u017dlt\u00e9 komponenty s\u00fa komponenty Prometheus. V\u0161etko ostatn\u00e9 s\u00fa komponenty Thanos. Za\u010dneme s hlavn\u00fdm komponentom. Thanos Sidecar je komponent, ktor\u00fd je nain\u0161talovan\u00fd ved\u013ea ka\u017ed\u00e9ho Prometheus. Zabezpe\u010duje na\u010d\u00edtanie \u00fadajov Prometheus z lok\u00e1lneho \u00falo\u017eiska do S3 alebo in\u00e9ho objektn\u00e9ho \u00falo\u017eiska. <\/p>\n<p><\/p>\n<p>Existuje aj tak\u00e1 s\u00fa\u010das\u0165 ako Thanos Store Gateway, ktor\u00e1 dok\u00e1\u017ee \u010d\u00edta\u0165 tieto d\u00e1ta z Object Storage pri prich\u00e1dzaj\u00facich po\u017eiadavk\u00e1ch od Thanos Query. Thanos Query implementuje PromQL a Prometheus API. To znamen\u00e1, \u017ee z vonku vyzer\u00e1 ako Prometheus. Prij\u00edma po\u017eiadavky PromQL, posiela ich do Thanos Store Gateway, Thanos Store Gateway z\u00edskava potrebn\u00e9 d\u00e1ta z Object Storage a posiela ich sp\u00e4\u0165.<\/p>\n<p><\/p>\n<p>Ale v na\u0161om Object Storage s\u00fa ulo\u017een\u00e9 d\u00e1ta bez posledn\u00fdch dvoch hod\u00edn kv\u00f4li \u0161pecifik\u00e1m implement\u00e1cie Thanos Sidecar, ktor\u00fd nem\u00f4\u017ee nahra\u0165 posledn\u00e9 dve hodiny do Object Storage S3, preto\u017ee pre tieto dve hodiny e\u0161te Prometheus nevytvoril s\u00fabory v lok\u00e1lnom \u00falo\u017eisku.<\/p>\n<p><\/p>\n<p>Ako sa to podarilo ob\u00eds\u0165? Thanos Query okrem po\u017eiadaviek na Thanos Store Gateway, paralelne posiela po\u017eiadavky aj na ka\u017ed\u00fd Thanos Sidecar, ktor\u00fd sa nach\u00e1dza bl\u00edzko Prometheus. <\/p>\n<p><\/p>\n<p>A Thanos Sidecar, na druhej strane, proxyje po\u017eiadavky \u010falej do Prometheus a z\u00edskava d\u00e1ta za posledn\u00e9 dve hodiny.<\/p>\n<p><\/p>\n<p>Okrem t\u00fdchto komponentov existuje aj volite\u013en\u00fd komponent, bez ktor\u00e9ho sa Thanos nebude dobr\u00e9 c\u00edti\u0165. Je to Thanos Compact, ktor\u00fd sa zaober\u00e1 zl\u00fa\u010den\u00edm mal\u00fdch s\u00faborov na Object Storage do v\u00e4\u010d\u0161\u00edch s\u00faborov, ktor\u00e9 sem nahrali Thanos Sidecary. Thanos Sidecar nahr\u00e1va s\u00fabory s \u00fadajmi za posledn\u00e9 dve hodiny. Tieto s\u00fabory, ak sa nezl\u00fa\u010dia do v\u00e4\u010d\u0161\u00edch s\u00faborov, m\u00f4\u017eu dramaticky nar\u00e1s\u0165. \u010c\u00edm viac tak\u00fdchto s\u00faborov, t\u00fdm viac pam\u00e4te potrebuje Thanos Store Gateway, t\u00fdm viac zdrojov je potrebn\u00fdch na prenos \u00fadajov cez sie\u0165 a metad\u00e1t. Pr\u00e1ca Thanos Store Gateway sa st\u00e1va neefekt\u00edvnou. Preto je potrebn\u00e9 povinne spusti\u0165 Thanos Compact, ktor\u00fd zl\u00fa\u010di mal\u00e9 s\u00fabory do v\u00e4\u010d\u0161\u00edch, aby sme mali menej tak\u00fdchto s\u00faborov a zn\u00ed\u017eili nadmorsk\u00fa z\u00e1\u0165a\u017e na Thanos Store Gateway.<\/p>\n<p><\/p>\n<p>Existuje aj tak\u00e1 komponenta ako Thanos Ruler. Ten vykon\u00e1va pravidl\u00e1 upozornenia Prometheus a m\u00f4\u017ee vypo\u010d\u00edtava\u0165 pravidl\u00e1 nahr\u00e1vania Prometheus, aby op\u00e4\u0165 ulo\u017eil d\u00e1ta do Object Storage. Ale tento komponent sa neodpor\u00fa\u010da pou\u017e\u00edva\u0165, preto\u017ee je <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\/blob\/master\/docs\/components\/rule.md#risk\">n\u00e1chyln\u00fd vraca\u0165 ne\u00fapln\u00e9 d\u00e1ta<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p>Tak\u00e1to jednoduch\u00e1 sch\u00e9ma je u Thanos. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/3f7cd77a1c056bf7ac245c774d05ea34.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Teraz porovnajme so sch\u00e9mou VictoriaMetrics.<\/p>\n<p><\/p>\n<p>VictoriaMetrics m\u00e1 2 verzie: Single-node a klustrov\u00e1 verzia. Single-node funguje na jednom po\u010d\u00edta\u010di. V Single-node nie s\u00fa tieto komponenty, jednoducho len jeden bin\u00e1rny s\u00fabor. Tento bin\u00e1rny s\u00fabor na sn\u00edmke vyzer\u00e1 ako tento \u0161tvorec. V\u0161etko, \u010do sa nach\u00e1dza vo vn\u00fatri \u0161tvorca \u2014 to je obsah bin\u00e1rneho s\u00faboru pre Single-node verziu. Nemus\u00edte o \u0148om vedie\u0165. Jednoducho spust\u00edte bin\u00e1rny s\u00fabor \u2014 a v\u0161etko funguje. <\/p>\n<p><\/p>\n<p>Clusterov\u00e1 verzia je zlo\u017eitej\u0161ia. Vn\u00fatri sa nach\u00e1dzaj\u00fa tri r\u00f4zne komponenty: vmselect, vminsert a vmstorage. Z ich n\u00e1zvov by malo by\u0165 jasn\u00e9, \u010d\u00edm sa ka\u017ed\u00e1 z nich zaober\u00e1. Komponent Insert prij\u00edma \u00fadaje v r\u00f4znych form\u00e1toch: z Prometheus remote write API, Influx line protokolu, Graphite protokolu a z OpenTSDB protokolu. Komponent Insert ich prij\u00edma, parsuje a rozde\u013euje medzi existuj\u00face komponenty storage, kde sa \u00fadaje ukladaj\u00fa. <noindex><a rel=\"nofollow\" href=\"https:\/\/medium.com\/@valyala\/promql-tutorial-for-beginners-9ab455142085\">PromQL<\/a><\/noindex>, ako aj Prometheus querying API, a m\u00f4\u017ee by\u0165 pou\u017eit\u00fd ako n\u00e1hrada Prometheus v Grafana alebo in\u00fdch klientoch Prometheus API. Select prij\u00edma promql dopyty, parsuje ich, \u010d\u00edta potrebn\u00e9 \u00fadaje na vykonanie tohto dopytu zo storage uzlov, spracov\u00e1va tieto \u00fadaje a vracia odpove\u010f.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/5b4f1ec2504c1bea423e58ced26570bd.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Porovnajme zlo\u017eitosti in\u0161tal\u00e1cie Thanos a VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/39b293fc911b2987a191cc5d98b1c9f7.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Za\u010dneme s Thanos. Predt\u00fdm, ako za\u010dnete pracova\u0165 s Thanos, je potrebn\u00e9 vytvori\u0165 bucket v Object Storage, ako S3 alebo GCS, aby Thanos Sidecar mohol zapisova\u0165 \u00fadaje. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/7a59c36c4453f1747067c79d9a9b8e2a.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Potom je potrebn\u00e9 pre ka\u017ed\u00fd Prometheus nain\u0161talova\u0165 Thanos Sidecar. Predt\u00fdm nezabudnite vypn\u00fa\u0165 zhutnenie \u00fadajov (data compaction) v Prometheus. Zhutnenie \u00fadajov pravidelne komprimuje \u00fadaje v miestnom \u00falo\u017eisku Prometheus, aby sa zn\u00ed\u017eila spotreba zdrojov.<\/p>\n<p><\/p>\n<p>Ke\u010f in\u0161talujete Thanos Sidecar na v\u00e1\u0161 Prometheus, mus\u00edte vypn\u00fa\u0165 t\u00fato kompresiu d\u00e1t, preto\u017ee Thanos Sidecar nedok\u00e1\u017ee spr\u00e1vne fungova\u0165 pri zapnutej kompresii d\u00e1t. To znamen\u00e1, \u017ee v\u00e1\u0161 Prometheus za\u010dne uklada\u0165 \u00fadaje blokmi po dve hodiny a prestane zl\u00fa\u010di\u0165 tieto bloky do v\u00e4\u010d\u0161\u00edch. Ak teda rob\u00edte dotazy, ktor\u00e9 presahuj\u00fa dobu posledn\u00fdch dvoch hod\u00edn, nebud\u00fa fungova\u0165 tak efekt\u00edvne v porovnan\u00ed s t\u00fdm, ako by mohli fungova\u0165, ak by bola zapnut\u00e1 kompresia d\u00e1t.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/825b70ede9edd1de6658576e2b824cd1.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Preto Thanos odpor\u00fa\u010da skr\u00e1ti\u0165 \u010das uchov\u00e1vania \u00fadajov (data retention) v miestnom storage na 6-8 hod\u00edn, aby sa zn\u00ed\u017eil tento overhead ve\u013ek\u00e9ho mno\u017estva mal\u00fdch blokov.<\/p>\n<p><\/p>\n<p>Potom, \u010do ste nain\u0161talovali Thanos Sidecar, mus\u00edte pre ka\u017ed\u00fd Object Storage Bucket nain\u0161talova\u0165 dve komponenty. T\u00fdmi s\u00fa Thanos Compactor a Thanos Store Gateway. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/77575d65a75bfd9af8d7dedf0cc5c922.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Potom je potrebn\u00e9 nain\u0161talova\u0165 Thanos Query a nastavi\u0165 ho tak, aby sa mohol prip\u00e1ja\u0165 ku v\u0161etk\u00fdm Thanos Store Gateway, ktor\u00e9 m\u00e1te, a aby sa mohol prip\u00e1ja\u0165 ku v\u0161etk\u00fdm Thanos Sidecar.<\/p>\n<p><\/p>\n<p>Tu m\u00f4\u017ee nasta\u0165 mal\u00fd probl\u00e9m. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6eddee956c58991ccee52891b368f10f.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Mus\u00edte nastavi\u0165 spo\u013eahliv\u00e9 a zabezpe\u010den\u00e9 pripojenie medzi Thanos Query a t\u00fdmito komponentmi. A ak s\u00fa va\u0161e Prometheovsk\u00e9 servery v r\u00f4znych d\u00e1tov\u00fdch centr\u00e1ch alebo v r\u00f4znych VPC, pripojenia zvonka s\u00fa zak\u00e1zan\u00e9. Ale pre fungovanie Thanos Query mus\u00edte nejako nastavi\u0165 pripojenie, a mus\u00edte vymyslie\u0165 sp\u00f4sob.<\/p>\n<p><\/p>\n<p>Ak m\u00e1te ve\u013ea tak\u00fdchto d\u00e1tov\u00fdch centier, zni\u017euje to spo\u013eahlivos\u0165 cel\u00e9ho syst\u00e9mu. Thanos Query mus\u00ed neust\u00e1le udr\u017eiava\u0165 pripojenia ku v\u0161etk\u00fdm Thanos Sidecar, ktor\u00e9 s\u00fa umiestnen\u00e9 v r\u00f4znych d\u00e1tov\u00fdch centr\u00e1ch. Pri ka\u017edom prich\u00e1dzaj\u00facom dopyte bude smerova\u0165 po\u017eiadavky na v\u0161etky Thanos Sidecar. Ak sa pripojenie preru\u0161\u00ed, dostanete bu\u010f ne\u00fapln\u00fd s\u00fabor d\u00e1t, alebo odpove\u010f &#171;klaster nefunguje&#187;. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/13c3765871568ac0db4014964cb5d752.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V VictoriaMetrics je to v\u0161etko trochu jednoduch\u0161ie. Pre verziu s jedn\u00fdm uzlom sta\u010d\u00ed spusti\u0165 jeden bin\u00e1rny s\u00fabor a v\u0161etko funguje. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/1edf992a6404f5dea1ae2bd4f4d2d8fd.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V klastrov\u00e9 verzii sta\u010d\u00ed spusti\u0165 v\u0161etky vy\u0161\u0161ie uveden\u00e9 tri typy komponentov v akomko\u013evek po\u017eadovanom po\u010dte alebo pou\u017ei\u0165 <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/helm-charts\/\">helm chart<\/a><\/noindex> pre automatiz\u00e1ciu sp\u00fa\u0161\u0165ania komponentov v Kubernetes. E\u0161te pl\u00e1nujeme vytvori\u0165 oper\u00e1tor Kubernetes. Helm chart nezah\u0155\u0148a niektor\u00e9 pr\u00edpady a umo\u017e\u0148uje v\u00e1m vystreli\u0165 si do nohy. Napr\u00edklad m\u00f4\u017ee zn\u00ed\u017ei\u0165 po\u010det storage node, \u010do povedie k strate d\u00e1t.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/ad4249222cb5e591d7e7bd0b7f1708c0.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Akon\u00e1hle spust\u00edte jeden bin\u00e1rny s\u00fabor alebo klastrov\u00fa verziu, sta\u010d\u00ed prida\u0165 do konfigur\u00e1cie Prometheus <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\/blob\/master\/README.md#prometheus-setup\">nastavenie pre remote write url<\/a><\/noindex>, aby za\u010dal paralelne zapisova\u0165 d\u00e1ta do lok\u00e1lneho \u00falo\u017eiska a do vzdialen\u00e9ho \u00falo\u017eiska. Ako ste si v\u0161imli, tak\u00e1to konfigur\u00e1cia by mala fungova\u0165 ove\u013ea spo\u013eahlivej\u0161ie v porovnan\u00ed s konfigur\u00e1ciou Thanos. Nemus\u00edme udr\u017eiava\u0165 pripojenie od VictoriaMetrics ku v\u0161etk\u00fdm Prometheusom, preto\u017ee Prometheusy sa samy prip\u00e1jaj\u00fa k VictoriaMetrics a pren\u00e1\u0161aj\u00fa d\u00e1ta. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/465ffc6cd77b2ca022b2541851a7ddbc.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Zv\u00e1\u017eme \u00fadr\u017ebu Thanos a VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6043f0d3d99cb3e49837f03d3e6bbb9b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos mus\u00ed sledova\u0165 Sidecar, aby neprestal na\u010d\u00edtava\u0165 d\u00e1ta do Object Storage. M\u00f4\u017ee sa sta\u0165, \u017ee t\u00e1to synchroniz\u00e1cia sa preru\u0161\u00ed v d\u00f4sledku ch\u00fdb pri nahr\u00e1van\u00ed, napr\u00edklad ak sa v\u00e1m do\u010dasne preru\u0161\u00ed sie\u0165ov\u00e9 pripojenie k Object Storage, alebo ak Object Storage do\u010dasne nie je dostupn\u00fd. Thanos Sidecar si toho v t\u00fa chv\u00ed\u013eu v\u0161imne, nahl\u00e1si chybu, m\u00f4\u017ee zlyha\u0165 a potom prestane fungova\u0165. Ak ho nebudete monitorova\u0165, prestan\u00fa v\u00e1m pren\u00e1\u0161a\u0165 d\u00e1ta do Object Storage. Ak uplynie doba udr\u017eania (odporu\u010den\u00e9 6-8 hod\u00edn), strat\u00edte d\u00e1ta, ktor\u00e9 sa nedostali do Object Storage.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/7c6556fecdee4ca4986931c2eebf9895.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos compactor-y m\u00f4\u017eu presta\u0165 fungova\u0165 z d\u00f4vodu <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\/issues\/1919\">pretekov s Sidecar<\/a><\/noindex>. Compactor-ky preberaj\u00fa d\u00e1ta z objektov\u00e9ho \u00falo\u017eiska a zl\u00fa\u010dia ich do v\u00e4\u010d\u0161\u00edch kusov d\u00e1t. Ke\u010f\u017ee compactor-ky nie s\u00fa synchronizovan\u00e9 so Sidecar-ami, m\u00f4\u017ee sa sta\u0165 toto: Sidecar e\u0161te nestihol dop\u00edsa\u0165 blok, Compactor sa rozhodne, \u017ee tento blok je \u00faplne zap\u00edsan\u00fd. Compactor ho za\u010dne \u010d\u00edta\u0165. \u010c\u00edta blok nie v \u00faplnej podobe a prest\u00e1va pracova\u0165. Pozri podrobnosti <noindex><a rel=\"nofollow\" href=\"https:\/\/thanos.io\/proposals\/201901-read-write-operations-bucket.md\/\">tu<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/7fd00e243009763781b54043dec1e94b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Store Gateway m\u00f4\u017ee vraca\u0165 nekonzistentn\u00e9 d\u00e1ta kv\u00f4li pretekom medzi Compactorom a Sidecar-ami. Tu je to podobn\u00e9, preto\u017ee Store Gateway nie je nijako synchronizovan\u00fd s compactor-ami a sidecar-ami. V d\u00f4sledku toho m\u00f4\u017eu vznikn\u00fa\u0165 stavy pretekov, ke\u010f Store Gateway nevid\u00ed \u010das\u0165 d\u00e1t, alebo vid\u00ed nadbyto\u010dn\u00e9 d\u00e1ta.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/85fcc811173dda1a42ac8d4e3b212f5e.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Komponent Query v Thanos ne\u0161tandardne vracia \u010diasto\u010dn\u00fd v\u00fdsledok, ak niektor\u00e9 Sidecar-y alebo Store Gateway nie s\u00fa v danom momente dostupn\u00e9. Z\u00edskate \u010das\u0165 d\u00e1t, a ani nebudete vedie\u0165, \u017ee ste nez\u00edskali v\u0161etky d\u00e1ta. Takto to funguje \u0161tandardne. V podobnej situ\u00e1cii VictoriaMetrics vr\u00e1ti ozna\u010den\u00e9 d\u00e1ta ako \u010diasto\u010dn\u00e9. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a9e5a70bdcafae9b98545514ca7a7ff3.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Na rozdiel od Thanos, VictoriaMetrics zriedka str\u00e1ca d\u00e1ta. Aj ke\u010f sa preru\u0161\u00ed pripojenie z Prometheus na VictoriaMetrics, nie je probl\u00e9m, preto\u017ee Prometheus pokra\u010duje v zapisovan\u00ed nov\u00fdch prich\u00e1dzaj\u00facich d\u00e1t do Write Ahead Log, ktor\u00e9ho ve\u013ekos\u0165 je 2 hodiny. Ak sa v priebehu dvoch hod\u00edn pripoj\u00edte sp\u00e4\u0165 k VictoriaMetrics, d\u00e1ta sa nestratia. Prometheus <noindex><a rel=\"nofollow\" href=\"https:\/\/grafana.com\/blog\/2019\/03\/25\/whats-new-in-prometheus-2.8-wal-based-remote-write\/\">dok\u00e1\u017ee dop\u00edsa\u0165 d\u00e1ta po obnoven\u00ed pripojenia k VictoriaMetrics<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/fa4be02056f7338416029bfd8f9d0214.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Na rozdiel od Thanos, ktor\u00fd zapisuje d\u00e1ta do object storage a\u017e po dvoch hodin\u00e1ch, Prometheus automaticky replikovuje d\u00e1ta prostredn\u00edctvom remote write protokolu do remote storage, ako je VictoriaMetrics. Nemus\u00edte sa b\u00e1\u0165 straty local storage v Prometheus. Ak n\u00e1hodou strat\u00ed local storage, v najhor\u0161om pr\u00edpade strat\u00edte posledn\u00e9 sekundy d\u00e1t, ktor\u00e9 sa nestihli zap\u00edsa\u0165 do remote storage.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a6e9b2322eb9b3e145603a6b9db1002d.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Kubernetes automaticky spravuje klaster na rozdiel od Thanos. V\u0161etky komponenty Thanos sa \u0165a\u017eko zmestia do jedn\u00e9ho Kubernetes klastra, na rozdiel od klastra komponentov VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/5b3d1586fe461a0c6f34de09fdd12845.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>U VictoriaMetrics je ve\u013emi jednoduch\u00e9 aktualizova\u0165 na nov\u00fa verziu. Sta\u010d\u00ed zastavi\u0165 VictoriaMetrics, aktualizova\u0165 bin\u00e1rne s\u00fabory a znovu spusti\u0165. Pri zastaven\u00ed cez sign\u00e1l SIGINT v\u0161etky bin\u00e1rne s\u00fabory VictoriaMetrics robia graceful shutdown. Spr\u00e1vne ukladaj\u00fa potrebn\u00e9 d\u00e1ta, spr\u00e1vne zatv\u00e1raj\u00fa prich\u00e1dzaj\u00face spojenia, aby sa ni\u010d nestratilo. Preto pri aktualiz\u00e1cii ni\u010d nestrat\u00edte. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/96a52e2f0696172159919536efb68ad3.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>U VictoriaMetrics je ve\u013emi jednoduch\u00e9 roz\u0161\u00edri\u0165 klaster. Sta\u010d\u00ed prida\u0165 potrebn\u00e9 komponenty a pokra\u010dova\u0165 v pr\u00e1ci. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/5f5e6ef78b322bb278e618a526f05e26.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>O skryt\u00fdch probl\u00e9moch v Thanos a VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/17808bc76a16e571b7e4fa1655964201.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos m\u00e1 nasleduj\u00face skryt\u00e9 probl\u00e9my. Prometheus mus\u00ed uchov\u00e1va\u0165 d\u00e1ta za posledn\u00e9 dve hodiny. Ak sa stratia, \u00faplne o ne pr\u00eddete, preto\u017ee sa e\u0161te nestihli zap\u00edsa\u0165 do Object Storage, ako je S3. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/81ca9135d2d97b95e9731dd1f5501859.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Store Gateway komponent a compactor komponent m\u00f4\u017eu vy\u017eadova\u0165 ve\u013ea pam\u00e4te na pr\u00e1cu s ve\u013ek\u00fdm Object Storage, ak tam uchov\u00e1vate ve\u013ea drobn\u00fdch s\u00faborov. \u010c\u00edm v\u00e4\u010d\u0161\u00ed po\u010det a objem s\u00faborov, t\u00fdm viac opera\u010dnej pam\u00e4te Store Gateway a compactor potrebuje na uchov\u00e1vanie meta-inform\u00e1ci\u00ed. Thanos m\u00e1 ve\u013ea probl\u00e9mov s t\u00fdm, \u017ee <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\/issues\/448\">Store Gateway a compactor crashuj\u00fa pri stredn\u00fdch objemoch zap\u00edsan\u00fdch d\u00e1t.<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/cf75315535439843c9bb32cf1175391b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos je reklamovan\u00fd ako schopn\u00fd nekone\u010dne \u0161k\u00e1lova\u0165 po\u010det va\u0161ich Prometheus. V skuto\u010dnosti to nie je pravda. Preto\u017ee v\u0161etky dopyty prech\u00e1dzaj\u00fa cez Query komponent, ktor\u00fd mus\u00ed paralelne op\u00fdta\u0165 v\u0161etky Store Gateway komponenty a v\u0161etky Sidecar komponenty, vy\u0165ahova\u0165 odtia\u013e d\u00e1ta a potom ich pre-processova\u0165. Je zrejm\u00e9, \u017ee r\u00fdchlos\u0165 dopytov je obmedzen\u00e1 najpomal\u0161\u00edm slab\u00fdm \u010dl\u00e1nkom, najpomal\u0161ou Store Gateway alebo najpomal\u0161\u00edm Sidecar. <\/p>\n<p><\/p>\n<p>Tieto komponenty m\u00f4\u017eu by\u0165 pracovne za\u0165a\u017een\u00e9 nerovnomerne. Napr\u00edklad m\u00e1te Prometheus, ktor\u00fd zbiera mili\u00f3ny metrik za sekundu, a je tu aj Prometheus, ktor\u00fd zbiera tis\u00edce metrik za sekundu. Prometheus, ktor\u00fd zbiera mili\u00f3ny metrik, v\u00fdrazne za\u0165a\u017euje server, na ktorom be\u017e\u00ed. Preto tam Sidecar pracuje pomal\u0161ie. A vlastne v\u0161etko tam funguje pomal\u0161ie. Komponent Query bude ve\u013emi pomaly \u0165aha\u0165 d\u00e1ta odtia\u013e. T\u00fdm p\u00e1dom bude v\u00fdkonnos\u0165 cel\u00e9ho v\u00e1\u0161ho klastrov\u00e9ho syst\u00e9mu obmedzen\u00e1 t\u00fdmto pomal\u00fdm Sidecarom.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/68070f629821a54bfd8ed934d67344fd.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pod\u013ea predvolenia Thanos vracia \u010diasto\u010dn\u00e9 d\u00e1ta, ak s\u00fa niektor\u00e9 Sidecar-y alebo Store Gateway nedostupn\u00e9. Napr\u00edklad, ak m\u00e1te Sidecar-y rozosiate po celom svete v r\u00f4znych d\u00e1tov\u00fdch centr\u00e1ch, pravdepodobnos\u0165 preru\u0161enia pripojenia a nedostupnosti komponentov sa v\u00fdrazne zvy\u0161uje. V d\u00f4sledku toho vo v\u00e4\u010d\u0161ine pr\u00edpadov dostanete \u010diasto\u010dn\u00e9 d\u00e1ta, ani o tom neviete.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6a1dea50e739314c23b4370c569b44a4.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics m\u00e1 tie\u017e svoje \u00faskalia. Prv\u00e9 \u00faskalie je mo\u017enos\u0165, ktor\u00e1 obmedzuje objem opera\u010dnej pam\u00e4te vyu\u017e\u00edvanej na cache VictoriaMetrics. Predvolene je nastaven\u00e1 na 60% opera\u010dnej pam\u00e4te na stroji, na ktorom je VictoriaMetrics spusten\u00e1, alebo 60% RAM podu VictoriaMetrics v Kubernetes.<\/p>\n<p><\/p>\n<p>Ak nespr\u00e1vne zmen\u00edte t\u00fato hodnotu, m\u00f4\u017eete ohrozi\u0165 v\u00fdkonnos\u0165 VictoriaMetrics. Napr\u00edklad, ak nastav\u00edte pr\u00edli\u0161 n\u00edzku hodnotu, d\u00e1ta sa nemusia zmesti\u0165 do cache VictoriaMetrics. Kv\u00f4li tomu bude musie\u0165 vykon\u00e1va\u0165 zbyto\u010dn\u00fa pr\u00e1cu a za\u0165a\u017eova\u0165 procesor s diskom. Ak t\u00fato vo\u013ebu nastav\u00edte pr\u00edli\u0161 vysoko, zvy\u0161uje sa, po prv\u00e9, pravdepodobnos\u0165, \u017ee VictoriaMetrics spadne s chybou 'out of memory', a po druh\u00e9, to povedie k tomu, \u017ee v opera\u010dnom syst\u00e9me zostane ve\u013emi m\u00e1lo opera\u010dnej pam\u00e4te na s\u00faborov\u00fd cache. A VictoriaMetrics sa spolieha na s\u00faborov\u00fd cache pre svoju v\u00fdkonnos\u0165. Ak je ho nedostatok, m\u00f4\u017ee sa v\u00fdrazne zv\u00fd\u0161i\u0165 z\u00e1\u0165a\u017e na disk. Preto odpor\u00fa\u010danie: nemeni\u0165 parameter bez naliehavej potreby.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/f145833dcbe42c2b62545358cfb204e5.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Druh\u00e1 mo\u017enos\u0165. Je to retentionPeriod \u2014 obdobie, ktor\u00e9 je predvolene nastaven\u00e9 na 1 mesiac. Je to \u010das, po\u010das ktor\u00e9ho VictoriaMetrics uchov\u00e1va d\u00e1ta. Po uplynut\u00ed tejto doby VictoriaMetrics d\u00e1ta odstr\u00e1ni.<\/p>\n<p><\/p>\n<p>Mnoh\u00ed sp\u00fa\u0161\u0165aj\u00fa VictoriaMetrics bez tohto parametra a zapisuj\u00fa d\u00e1ta po\u010das mesiaca. A potom sa p\u00fdtaj\u00fa: pre\u010do d\u00e1ta zmizli za predch\u00e1dzaj\u00faci mesiac? Preto\u017ee retentionPeriod je predvolene nastaven\u00fd na 1 mesiac. Preto je d\u00f4le\u017eit\u00e9 pozna\u0165 a nastavi\u0165 spr\u00e1vny retentionPeriod. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/377e4e19b7dc5648dd16bff39f4f1651.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Prejdeme si unik\u00e1tne mo\u017enosti.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/bca5529a95e94ada650e67dba063ada6.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos m\u00e1 vlastnos\u0165, ako je downsampling: 5-min\u00fatov\u00e9 a hodinov\u00e9 intervaly, ktor\u00e9 \u010dasto <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\/issues?utf8=%E2%9C%93&amp;q=is%3Aissue+is%3Aopen+downsampling\">nefunguj\u00fa spr\u00e1vne.<\/a><\/noindex>. Ak si to vyh\u013ead\u00e1te a pozriete sa na ich probl\u00e9my na github, n\u00e1jdete tam ve\u013ea probl\u00e9mov s\u00favisiacich s t\u00fdmto downsamplingom, \u017ee niekedy nefunguje spr\u00e1vne alebo funguje inak, ne\u017e o\u010dak\u00e1vaj\u00fa pou\u017e\u00edvatelia.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/84f116767826d1174286b45ccf60dfe7.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos m\u00e1 deduplik\u00e1ciu d\u00e1t pre Prometheus HA p\u00e1ry. Ke\u010f dva Prometheus zbieraj\u00fa rovnak\u00e9 metriky zo rovnak\u00fdch cie\u013eov, Thanos ich uklad\u00e1 do objektov\u00e9ho \u00falo\u017eiska. Thanos dok\u00e1\u017ee tieto d\u00e1ta spr\u00e1vne deduplikova\u0165, na rozdiel od VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/efd797cafcb339a4900f4d2cddd04638.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos m\u00e1 alert komponent, ktor\u00fd bol na sch\u00e9me Thanos. Ale jeho <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\/blob\/master\/docs\/components\/rule.md\">neodpor\u00fa\u010da sa pou\u017e\u00edva\u0165 v produkcii.<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/87d12ff7b3c33dae9a8eda7a2a95bce1.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos m\u00e1 v\u00fdhodu v tom, \u017ee k\u00f3d Thanos a Prometheus je spolo\u010dn\u00fd. Thanos a Prometheus boli vyvinut\u00e9 t\u00fdmi ist\u00fdmi v\u00fdvoj\u00e1rmi. Pri vylep\u0161eniach v Thanos alebo Prometheus vyhr\u00e1va druh\u00e1 strana.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/92435f15d58e83eb4d548a8bf5256c30.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Hlavn\u00e1 vlastnos\u0165 VictoriaMetrics je \u2014 MetricsQL. Toto je roz\u0161\u00edrenie VictoriaMetrics pre PromQL, o ktorom som hovoril na minulom ve\u013ekom monitoring meetupe.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/43a1618a397badc3df9d4eded19be1ec.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics podporuje nahr\u00e1vanie d\u00e1t prostredn\u00edctvom r\u00f4znych protokolov. VictoriaMetrics m\u00f4\u017ee nielen prij\u00edma\u0165 d\u00e1ta od Prometheus, ale aj prostredn\u00edctvom protokolov Influx, OpenTSDB a Graphite.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/b4bca4b255990f1af11a6ceaf42f46ef.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>D\u00e1ta VictoriaMetrics zaberaj\u00fa zvy\u010dajne ove\u013ea menej miesta v porovnan\u00ed s Thanos a Prometheus. <\/p>\n<p><\/p>\n<p>Ak je nahr\u00e1va\u0165 skuto\u010dn\u00e9 d\u00e1ta, pou\u017e\u00edvatelia hovoria o 2-5 n\u00e1sobnom zn\u00ed\u017een\u00ed ve\u013ekosti d\u00e1t na disku v porovnan\u00ed s Prometheus a Thanos.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6aeab3c42b45dbd620d328fc43ce4bec.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>\u010eal\u0161ou v\u00fdhodou VictoriaMetrics je, \u017ee je optimalizovan\u00e1 na r\u00fdchlos\u0165. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/89010a913f0d7b1388b6c62007c7835b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Prejdeme si n\u00e1klady na infra\u0161trukt\u00faru. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/65bd322bb2a64ac4188e29b79e54763a.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Jednou z v\u00fdhod Thanos je, \u017ee uchov\u00e1va d\u00e1ta v object storage, ktor\u00fd je relat\u00edvne lacn\u00fd.<\/p>\n<p><\/p>\n<p>Pri uchov\u00e1van\u00ed d\u00e1t v object storage mus\u00edte plati\u0165 za oper\u00e1cie z\u00e1pisu a \u010d\u00edtania d\u00e1t (10 dol\u00e1rov za mili\u00f3n oper\u00e1ci\u00ed). Ke\u010f zapisujete d\u00e1ta do object storage, plat\u00edte n\u00e1klady za hosting na upload d\u00e1t na internet, ak v\u00e1\u0161 klaster nie je v AWS \u2014 tam je to zadarmo. Pri \u010d\u00edtan\u00ed d\u00e1t plat\u00edte od 10 do 230 dol\u00e1rov za 1 TB. To m\u00f4\u017ee by\u0165 podstatn\u00e9, ak \u010dasto po\u017eadujete historick\u00e9 d\u00e1ta z Thanos klasteru.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/7f1b32c75d49efa082201fa55b43f6bb.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pre Thanos klaster je potrebn\u00e9 financova\u0165 servery pre komponenty Compact, Store Gateway a Query, ktor\u00e9 vy\u017eaduj\u00fa ve\u013ea pam\u00e4te a CPU pre spracovanie ve\u013ek\u00fdch objemov d\u00e1t.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/19c90f30760e77f57a658e67507f4f98.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>N\u00e1klady na VictoriaMetrics s\u00fa tak\u00e9to. Ak uchov\u00e1vate d\u00e1ta na diskoch GCE HDD, vyjde to na 40 dol\u00e1rov za 1TB. Pre VictoriaMetrics sta\u010dia be\u017en\u00e9 HDD disky, nie s\u00fa potrebn\u00e9 \u017eiadne SSD, ktor\u00e9 stoja p\u00e4\u0165kr\u00e1t viac. VictoriaMetrics je optimalizovan\u00e1 pre HDD.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/c7e922b4d97f353218d6edad7cdea584.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pre VictoriaMetrics s\u00fa potrebn\u00e9 servery pre komponenty: bu\u010f single-node alebo pre klustrov\u00e9 komponenty, ktor\u00e9 na rozdiel od Thanos komponentov vy\u017eaduj\u00fa ove\u013ea menej CPU a RAM \u2013 teda bud\u00fa lacnej\u0161ie. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/aaf63cad75238ba19efb825376cf356c.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pr\u00edklady nasadenia. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/53ce0a68724c339d88ad769c18a2e5f9.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pr\u00edklad nasadenia Thanos je Gitlab. Gitlab kompletn\u00e9 funguje na Thanos. Ale nie je to tam v\u0161etko bez probl\u00e9mov. Ak sa pozriete na ich <noindex><a rel=\"nofollow\" href=\"https:\/\/gitlab.com\/gitlab-com\/gl-infra\/infrastructure\/issues\/8647\">issues<\/a><\/noindex>, m\u00f4\u017eete vidie\u0165, \u017ee st\u00e1le sa im vyskytuj\u00fa nejak\u00e9 <noindex><a rel=\"nofollow\" href=\"https:\/\/gitlab.com\/gitlab-com\/gl-infra\/infrastructure\/issues\/8413\">opera\u010dn\u00e9 probl\u00e9my s Thanos<\/a><\/noindex>: ch\u00fdba im pam\u00e4\u0165 pre Store Gateway alebo Query komponenty. Neust\u00e1le musia zvy\u0161ova\u0165 objem pam\u00e4te. <\/p>\n<p><\/p>\n<p>Kv\u00f4li tomu sa zvy\u0161uj\u00fa n\u00e1klady na rie\u0161enie t\u00fdchto probl\u00e9mov. <\/p>\n<p><\/p>\n<p>Druh\u00e9 nasadenie, ktor\u00e9 m\u00f4\u017ee by\u0165 \u00faspe\u0161nej\u0161ie - to je spolo\u010dnos\u0165 Improbable, ktor\u00e1 za\u010dala v\u00fdvoj Thanos. Uverejnili zdrojov\u00fd k\u00f3d Thanos. Improbable je spolo\u010dnos\u0165, ktor\u00e1 sa zaober\u00e1 v\u00fdvojom hern\u00fdch enginov.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/3a1279cae3cfc7e94c2eccfc0972f06e.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Priame pr\u00edklady nasadenia VictoriaMetrics s\u00fa:<\/p>\n<p><\/p>\n<ul>\n<li>wix.com - n\u00e1stroj na tvorbu webov\u00fdch str\u00e1nok<\/li>\n<li>Adidas nasadzuje VictoriaMetrics a dokonca predlo\u017eil spr\u00e1vu na poslednom PromCon 2019<\/li>\n<li>TrafficStars - reklamn\u00e1 sie\u0165<\/li>\n<li>Seznam.cz - popul\u00e1rny \u010desk\u00fd vyh\u013ead\u00e1va\u010d.<\/li>\n<\/ul>\n<p><\/p>\n<p>A potom tu s\u00fa no-name spolo\u010dnosti, ktor\u00e9 moment\u00e1lne nem\u00f4\u017eem pomenova\u0165. Nedali s\u00fahlas. <\/p>\n<p><\/p>\n<ul>\n<li>Jeden ve\u013ek\u00fd v\u00fdvoj\u00e1r hier. V\u00e4\u010d\u0161\u00ed ako Improbable.<\/li>\n<li>Ve\u013ek\u00fd v\u00fdvoj\u00e1r grafick\u00e9ho softv\u00e9ru.<\/li>\n<li>Ve\u013ek\u00e1 rusk\u00e1 banka.<\/li>\n<li>Eur\u00f3psky v\u00fdrobca vetern\u00fdch turb\u00edn, ktor\u00fd \u00faspe\u0161ne otestoval VictoriaMetrics. Tento v\u00fdrobca nasadzuje VictoriaMetrics na monitorovanie d\u00e1t z\u00edskan\u00fdch z vetern\u00fdch turb\u00edn pri r\u00fdchlosti 50 vzoriek za sekundu na ka\u017ed\u00fd senzor. V ka\u017edej vetern\u00e9 turb\u00edne je nieko\u013eko stoviek senzorov. Maj\u00fa nieko\u013eko stoviek vetern\u00fdch turb\u00edn.<\/li>\n<li>Rusk\u00e9 aerol\u00ednie, ktor\u00e9 chc\u00fa nasadi\u0165 VictoriaMetrics, ale st\u00e1le nem\u00f4\u017eu. S nimi sme vo f\u00e1ze zmluvy.<\/li>\n<\/ul>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/040affc4d56712783db61ee3b0ec509e.jpg\" style=\"display:block;margin: 0 auto;\" \/>Z\u00e1ver.<\/p>\n<p><\/p>\n<p>VictoriaMetrics a Thanos rie\u0161ia podobn\u00e9 \u00falohy, ale r\u00f4znymi sp\u00f4sobmi:<\/p>\n<p><\/p>\n<ul>\n<li>Glob\u00e1lny poh\u013ead na dopyt<\/li>\n<li>horizont\u00e1lne \u0161k\u00e1lovanie <\/li>\n<li>\u013eubovo\u013en\u00e9 uchov\u00e1vanie d\u00e1t<\/li>\n<\/ul>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/af6285e8f6f68f373da1ebc552104f51.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>\u010eakujem.<\/p>\n<p><\/p>\n<p>\u010cak\u00e1me na v\u00e1s na na\u0161om <noindex><a rel=\"nofollow\" href=\"https:\/\/t.me\/VictoriaMetrics_ru1\">telegram kan\u00e1li<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyber\u00e1me \u00falo\u017eisko d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/c45b2a3b6e541e7e6cd580629e418c35.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p class=\"for_users_only_msg\">Len registrovan\u00ed pou\u017e\u00edvatelia sa m\u00f4\u017eu z\u00fa\u010dastni\u0165 prieskumu. <noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/auth\/login\/\">Prihl\u00e1ste sa<\/a><\/noindex>, pros\u00edm.<\/p>\n<h2 class=\"default-block__polling-title\">\u010co pou\u017e\u00edvate ako dlhodob\u00e9 \u00falo\u017eisko pre Prometheus?<\/h2>\n<ul class=\"poll-result\">\n<li class=\"poll-result__item\">\n<p>                <strong class=\"poll-result__data-percent\">35,3%<\/strong>Thanos6<\/p>\n<\/li>\n<li class=\"poll-result__item\">\n<p>                <strong class=\"poll-result__data-percent\">0,0%<\/strong>Cortex0<\/p>\n<\/li>\n<li class=\"poll-result__item\">\n<p>                <strong class=\"poll-result__data-percent\">0,0%<\/strong>M3DB0<\/p>\n<\/li>\n<li class=\"poll-result__item\">\n<p>                <strong class=\"poll-result__data-percent  poll-result__data-percent_winner\">41,2%<\/strong>VictoriaMetrics7<\/p>\n<\/li>\n<li class=\"poll-result__item\">\n<p>                <strong class=\"poll-result__data-percent\">23,5%<\/strong>in\u00e14<\/p>\n<\/li>\n<\/ul>\n<p>    Hlasovalo 17 pou\u017e\u00edvate\u013eov. Zdr\u017ealo sa 16 pou\u017e\u00edvate\u013eov.<br \/>\n<br \/>Zdroj: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/482272\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u0412\u0441\u0435\u043c \u043f\u0440\u0438\u0432\u0435\u0442. \u041d\u0438\u0436\u0435 \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u0430 \u0440\u0430\u0441\u0448\u0438\u0444\u0440\u043e\u0432\u043a\u0430 \u0434\u043e\u043a\u043b\u0430\u0434\u0430 \u0441 Big Monitoring Meetup 4. Prometheus \u2013 \u0441\u0438\u0441\u0442\u0435\u043c\u0430 \u043c\u043e\u043d\u0438\u0442\u043e\u0440\u0438\u043d\u0433\u0430 \u0440\u0430\u0437\u043b\u0438\u0447\u043d\u044b\u0445 \u0441\u0438\u0441\u0442\u0435\u043c \u0438 \u0441\u0435\u0440\u0432\u0438\u0441\u043e\u0432, \u0441 \u043f\u043e\u043c\u043e\u0449\u044c\u044e \u043a\u043e\u0442\u043e\u0440\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u043d\u044b\u0435 \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0430\u0442\u043e\u0440\u044b \u043c\u043e\u0433\u0443\u0442 \u0441\u043e\u0431\u0438\u0440\u0430\u0442\u044c \u0438\u043d\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u044e \u043e \u0442\u0435\u043a\u0443\u0449\u0438\u0445 \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u0430\u0445 \u0441\u0438\u0441\u0442\u0435\u043c \u0438 \u043d\u0430\u0441\u0442\u0440\u0430\u0438\u0432\u0430\u0442\u044c \u043e\u043f\u043e\u0432\u0435\u0449\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u043f\u043e\u043b\u0443\u0447\u0435\u043d\u0438\u044f \u0443\u0432\u0435\u0434\u043e\u043c\u043b\u0435\u043d\u0438\u0439 \u043e\u0431 \u043e\u0442\u043a\u043b\u043e\u043d\u0435\u043d\u0438\u044f\u0445 \u0432 \u0440\u0430\u0431\u043e\u0442\u0435 \u0441\u0438\u0441\u0442\u0435\u043c. \u0412 \u0434\u043e\u043a\u043b\u0430\u0434\u0435 \u0431\u0443\u0434\u0435\u0442 \u0441\u0440\u0430\u0432\u043d\u0435\u043d\u0438\u0435 Thanos \u0438 VictoriaMetrics \u2014 \u043f\u0440\u043e\u0435\u043a\u0442\u043e\u0432 \u0434\u043b\u044f \u0434\u043e\u043b\u0433\u043e\u0441\u0440\u043e\u0447\u043d\u043e\u0433\u043e \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u043c\u0435\u0442\u0440\u0438\u043a [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-54601","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.4 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u0412\u0441\u0435\u043c \u043f\u0440\u0438\u0432\u0435\u0442.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/sk\/blog\/administrirovanie\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics\" \/>\n\t\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.4\" \/>\n\t\t<meta property=\"og:locale\" content=\"sk_SK\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0412\u044b\u0431\u0438\u0440\u0430\u0435\u043c \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0434\u043b\u044f Prometheus: Thanos vs VictoriaMetrics | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u0412\u0441\u0435\u043c \u043f\u0440\u0438\u0432\u0435\u0442.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/sk\/blog\/administrirovanie\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2019-12-29T21:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-02-18T11:02:38+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47V\u00fdber \u00falo\u017eiska d\u00e1t pre Prometheus: Thanos vs VictoriaMetrics | ProHoster","description":"Ahojte v\u0161etci.","canonical_url":"https:\/\/prohoster.info\/sk\/blog\/administrirovanie\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sk_SK","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0412\u044b\u0431\u0438\u0440\u0430\u0435\u043c \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0434\u043b\u044f Prometheus: Thanos vs VictoriaMetrics | ProHoster","og:description":"\u0412\u0441\u0435\u043c \u043f\u0440\u0438\u0432\u0435\u0442.","og:url":"https:\/\/prohoster.info\/sk\/blog\/administrirovanie\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-12-29T21:00:00+00:00","article:modified_time":"2020-02-18T11:02:38+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"54601","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-24 12:01:24","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 20:02:45","updated":"2026-01-24 12:01:24","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/posts\/54601","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/comments?post=54601"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/posts\/54601\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/media?parent=54601"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/categories?post=54601"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/tags?post=54601"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}