{"id":54601,"date":"2019-12-30T00:00:00","date_gmt":"2019-12-29T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics"},"modified":"2020-02-18T14:02:38","modified_gmt":"2020-02-18T11:02:38","slug":"vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics","status":"publish","type":"post","link":"https:\/\/prohoster.info\/cs\/blog\/administrirovanie\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics","title":{"rendered":"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Ahoj v\u0161em. N\u00ed\u017ee je uveden p\u0159ehled <noindex><a rel=\"nofollow\" href=\"https:\/\/www.youtube.com\/watch?v=HyOXAdQE0Pk\">prezentace z Big Monitoring Meetup 4<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><strong><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/prometheus\">Prometheus<\/a><\/noindex><\/strong> \u2013 syst\u00e9m monitorov\u00e1n\u00ed r\u016fzn\u00fdch syst\u00e9m\u016f a slu\u017eeb, pomoc\u00ed kter\u00e9ho mohou syst\u00e9mov\u00ed administr\u00e1to\u0159i shroma\u017e\u010fovat informace o aktu\u00e1ln\u00edch parametrech syst\u00e9m\u016f a nastavovat upozorn\u011bn\u00ed na odchylky v jejich fungov\u00e1n\u00ed.<\/p>\n<p><\/p>\n<p>V prezentaci bude srovn\u00e1n\u00ed <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\">Thanos<\/a><\/noindex> a <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\">VictoriaMetrics<\/a><\/noindex> \u2014 projekt\u016f pro dlouhodob\u00e9 ukl\u00e1d\u00e1n\u00ed metrik Prometheus.<\/p>\n<p><noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/b65866353c1f816a8cb2a90af1ceac23.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\n<center><div class=\"youtube-placeholder\" data-id=\"HyOXAdQE0Pk\" onclick=\"loadVideo(this)\">\r\n        <img decoding=\"async\" src=\"https:\/\/img.youtube.com\/vi\/HyOXAdQE0Pk\/hqdefault.jpg\" alt=\"P\u0159ehr\u00e1t video\" loading=\"lazy\" width=\"480\" height=\"360\" style=\"width:100%;height:auto;\">\r\n        <div class=\"play-button\"><\/div>\r\n    <\/div><\/center><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/dc3c90711a8102d3e70b972ca47ec152.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Nejprve v\u00e1m pov\u00edm o Prometheu. Je to syst\u00e9m monitorov\u00e1n\u00ed, kter\u00fd shroma\u017e\u010fuje metriky z ur\u010den\u00fdch c\u00edl\u016f a ukl\u00e1d\u00e1 je do lok\u00e1ln\u00edho \u00falo\u017ei\u0161t\u011b. Prometheus um\u00ed zapisovat metriky do vzd\u00e1len\u00e9ho \u00falo\u017ei\u0161t\u011b, um\u00ed generovat upozorn\u011bn\u00ed a pravidla pro z\u00e1znam. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/e9852597e74c675d2216d971f19857c2.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<h3 id=\"ogranicheniya-prometheus\">Omezen\u00ed Prometheus:<\/h3>\n<p><\/p>\n<ul>\n<li>Nem\u00e1 glob\u00e1ln\u00ed pohled na dotazy. To je situace, kdy m\u00e1te n\u011bkolik nez\u00e1visl\u00fdch instanc\u00ed Prometheus. Ty shroma\u017e\u010fuj\u00ed metriky a vy chcete prov\u00e9st dotaz nad v\u0161emi t\u011bmito metrikami shrom\u00e1\u017ed\u011bn\u00fdmi z r\u016fzn\u00fdch instanc\u00ed. Prometheus to neumo\u017e\u0148uje.<\/li>\n<li>U Promethea je v\u00fdkon omezen pouze jedn\u00edm serverem. Prometheus se automaticky nem\u016f\u017ee \u0161k\u00e1lovat na v\u00edce server\u016f. M\u016f\u017eete pouze ru\u010dn\u011b rozd\u011blit sv\u00e9 c\u00edle mezi v\u00edce instance Promethea.<\/li>\n<li>Objem metrik v Prometheus je omezen pouze jedn\u00edm serverem ze stejn\u00e9ho d\u016fvodu, pro\u010d se automaticky nem\u016f\u017ee \u0161k\u00e1lovat na v\u00edce server\u016f.<\/li>\n<li>V Prometheus nen\u00ed jednodu\u0161e mo\u017en\u00e9 zajistit ochranu dat.<\/li>\n<\/ul>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/c140d41f1fe39d33e1fc84f5cc111481.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<h3 id=\"resheniya-etih-problemzadach\">Jak\u00e9 jsou \u0159e\u0161en\u00ed t\u011bchto probl\u00e9m\u016f\/\u00fakol\u016f?<\/h3>\n<p><\/p>\n<p>\u0158e\u0161en\u00ed jsou n\u00e1sleduj\u00edc\u00ed:<\/p>\n<p><\/p>\n<ul>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\">Thanos<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\">VictoriaMetrics<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/m3db\">Uber M3<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/cortexproject\/cortex\">Cortex<\/a><\/noindex><\/li>\n<\/ul>\n<p><\/p>\n<p>V\u0161echny tyto \u0159e\u0161en\u00ed jsou ur\u010dena pro vzd\u00e1len\u00e9 ukl\u00e1d\u00e1n\u00ed dat shrom\u00e1\u017ed\u011bn\u00fdch Prometheus. \u0158e\u0161\u00ed probl\u00e9m vzd\u00e1len\u00e9ho ukl\u00e1d\u00e1n\u00ed z p\u0159edchoz\u00edho slidu r\u016fzn\u00fdmi zp\u016fsoby. V t\u00e9to prezentaci se zm\u00edn\u00edm pouze o prvn\u00edch dvou \u0159e\u0161en\u00edch: <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\">Thanos<\/a><\/noindex> a <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\">VictoriaMetrics<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p>Poprv\u00e9 se informace o <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\">Thanos<\/a><\/noindex> objevila na <noindex><a rel=\"nofollow\" href=\"https:\/\/improbable.io\/blog\/thanos-prometheus-at-scale\">tento odkaz<\/a><\/noindex>. Tam je pops\u00e1na architektura <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\">Thanos<\/a><\/noindex> a jak funguje.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/317db6bb4c3cd69d8742addb2bae16a4.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos bere data, kter\u00e1 Prometheus ulo\u017eil na m\u00edstn\u00ed disk, a kop\u00edruje je do S3, do <noindex><a rel=\"nofollow\" href=\"https:\/\/cloud.google.com\/storage\/\">GCS<\/a><\/noindex> nebo do jin\u00e9ho objektov\u00e9ho \u00falo\u017ei\u0161t\u011b.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/7cf5f99dc5ce78f22c5956373812c0aa.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>T\u00edmto zp\u016fsobem Thanos zaji\u0161\u0165uje glob\u00e1ln\u00ed pohled na dotazy. M\u016f\u017eete dotazovat data ulo\u017een\u00e1 v objektov\u00e9m \u00falo\u017ei\u0161ti z n\u011bkolika instanc\u00ed Prometheus.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/286cf441fe18fb756c2708086872d8d8.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos podporuje PromQL a <noindex><a rel=\"nofollow\" href=\"https:\/\/prometheus.io\/docs\/prometheus\/latest\/querying\/api\/\">Prometheus querying API<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6a750070d76414370501a8153cd48007.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos pou\u017e\u00edv\u00e1 k\u00f3d Prometheus pro ukl\u00e1d\u00e1n\u00ed dat.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/ba0ca17154f9407900efc336f213ba07.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos vyv\u00edjej\u00ed stejn\u00ed v\u00fdvoj\u00e1\u0159i, kte\u0159\u00ed vyvinuli Prometheus.<\/p>\n<p><\/p>\n<p>O <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\">VictoriaMetrics<\/a><\/noindex>. Tady <noindex><a rel=\"nofollow\" href=\"https:\/\/medium.com\/faun\/victoriametrics-creating-the-best-remote-storage-for-prometheus-5d92d66787ac\">odkaz<\/a><\/noindex>, kde jsme poprv\u00e9 hovo\u0159ili o <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\">VictoriaMetrics<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a901d016e6e58c40c6c7c96b1cd5a8c9.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics p\u0159ij\u00edm\u00e1 data z n\u011bkolika Prometheus pomoc\u00ed <noindex><a rel=\"nofollow\" href=\"https:\/\/prometheus.io\/docs\/practices\/remote_write\/\">remote write API<\/a><\/noindex> protokolu, kter\u00fd podporuje Prometheus.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/24798414102cc63a1a1062c5ae327f4c.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics poskytuje glob\u00e1ln\u00ed p\u0159ehled dotaz\u016f, proto\u017ee v\u00edce instanc\u00ed Promethea m\u016f\u017ee zapisovat data do jedn\u00e9 instance VictoriaMetrics. M\u016f\u017eete tedy prov\u00e1d\u011bt dotazy na v\u0161echna tato data.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a717855dbdf1df859927a75557ee2573.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics tak\u00e9 podporuje PromQL a Prometheus querying API, stejn\u011b jako Thanos.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/84daf1b7e160e6f9d8a53a83329f2436.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Na rozd\u00edl od Thanosu byl zdrojov\u00fd k\u00f3d VictoriaMetrics naps\u00e1n od nuly a optimalizov\u00e1n na rychlost a spot\u0159ebu zdroj\u016f. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/371dee8d4705438f560245c4e5e7444f.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics se na rozd\u00edl od Thanosu \u0161k\u00e1luje jak vertik\u00e1ln\u011b, tak horizont\u00e1ln\u011b. Existuje <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\/blob\/master\/README.md\">verze Single-node,<\/a><\/noindex>kter\u00e1 se \u0161k\u00e1luje vertik\u00e1ln\u011b. M\u016f\u017eete za\u010d\u00edt s jedn\u00edm procesorem a 1 GB pam\u011bti a postupn\u011b r\u016fst a\u017e na stovky procesor\u016f a 1 TB pam\u011bti. VictoriaMetrics um\u00ed vyu\u017e\u00edt v\u0161echny tyto zdroje. Jej\u00ed v\u00fdkon vzroste p\u0159ibli\u017en\u011b 100x ve srovn\u00e1n\u00ed s 1-j\u00e1drov\u00fdm syst\u00e9mem. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/697e77546cda492f8512e7e761c0300f.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>P\u0159\u00edb\u011bh Thanosu za\u010dal v listopadu 2017, kdy byl vyd\u00e1n prvn\u00ed ve\u0159ejn\u00fd commit. P\u0159edt\u00edm byl Thanos vyv\u00edjen uvnit\u0159 spole\u010dnosti <noindex><a rel=\"nofollow\" href=\"https:\/\/improbable.io\">improbable.io.<\/a><\/noindex>. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/610a81cfb98082bb61b7ae28b00d2c78.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V \u010dervnu 2019 do\u0161lo k v\u00fdznamn\u00e9mu vyd\u00e1n\u00ed 0.5.0, ve kter\u00e9m <noindex><a rel=\"nofollow\" href=\"https:\/\/thanos.io\/proposals\/201809_gossip-removal.md\/\">byl odstran\u011bn<\/a><\/noindex> <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Gossip_protocol\">gossip<\/a><\/noindex> protokol. Tento protokol byl odstran\u011bn z Thanosu, proto\u017ee se neosv\u011bd\u010dil. \u010casto klastr Thanos nefungoval spr\u00e1vn\u011b a uzly se k n\u011bmu nespr\u00e1vn\u011b p\u0159ipojovaly kv\u016fli gossip protokolu. Proto bylo rozhodnuto jej odstranit. Pova\u017euji to za spr\u00e1vn\u00e9 rozhodnut\u00ed. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/d7ecf0105d46464aadc4c46147edf9dc.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>T\u00e9ho\u017e \u010dervna 2019 jsme podali \u017e\u00e1dost \u010d\u00edslo <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/cncf\/toc\/pull\/256\">256<\/a><\/noindex> v <noindex><a rel=\"nofollow\" href=\"https:\/\/www.cncf.io\/\">Cloud Native Computing Foundation<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a8685a616bbdc619009c570e28c9f15b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>A o p\u00e1r m\u011bs\u00edc\u016f pozd\u011bji byl Thanos p\u0159ijat do <noindex><a rel=\"nofollow\" href=\"https:\/\/www.cncf.io\/\">Cloud Native Computing Foundation<\/a><\/noindex>, do kter\u00e9 pat\u0159\u00ed Prometheus, Kubernetes a dal\u0161\u00ed popul\u00e1rn\u00ed projekty.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/90c64c519aa283b13ce64b96da5ac945.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V lednu 2018 za\u010dal v\u00fdvoj VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/c2243e3e0a8d00715644d7c84627c5cb.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V z\u00e1\u0159\u00ed 2018 jsem poprv\u00e9 ve\u0159ejn\u011b zm\u00ednil VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/66feecad1783c36651cdf2a19e6d0d70.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V prosinci 2018 byla zve\u0159ejn\u011bna verze Single-node.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/aacf5d683c7d639df7a9f05e297f08c4.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V kv\u011btnu 2019 <noindex><a rel=\"nofollow\" href=\"https:\/\/blog.usejournal.com\/open-sourcing-victoriametrics-f31e34485c2b\">byly zve\u0159ejn\u011bny<\/a><\/noindex> zdrojov\u00e9 k\u00f3dy jak verze Single-node, tak klustrov\u00e9 verze. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6da160c13c87133b1994ef32f86db077.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V \u010dervnu 2019 jsme, stejn\u011b jako Thanos, podali \u017e\u00e1dost do CNCF foundation pod \u010d\u00edslem <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/cncf\/toc\/pull\/255\">255<\/a><\/noindex>. Podali jsme \u017e\u00e1dost o den d\u0159\u00edve ne\u017e Thanos. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/12c281eae67b3cec5a66fab41aee1fdb.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Bohu\u017eel n\u00e1s v\u0161ak dosud nep\u0159ijali. Pot\u0159ebujeme pomoc komunity.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/ab7b20661c3cfa01209cd742eb71a898.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pod\u00edvejme se na nejd\u016fle\u017eit\u011bj\u0161\u00ed slajdy ukazuj\u00edc\u00ed architekturu Thanos a VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a268b600bcd0cebfd9c5069d2d911a9d.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Za\u010dn\u011bme s Thanos. \u017dlut\u00e9 komponenty jsou komponenty Promethea. V\u0161e ostatn\u00ed jsou komponenty Thanos. Za\u010dneme s nejd\u016fle\u017eit\u011bj\u0161\u00ed komponentou. Thanos Sidecar je komponenta, kter\u00e1 je nainstalov\u00e1na vedle ka\u017ed\u00e9ho Promethea. Zaji\u0161\u0165uje, \u017ee p\u0159en\u00e1\u0161\u00ed data Promethea z lok\u00e1ln\u00edho \u00falo\u017ei\u0161t\u011b do S3 nebo do jin\u00e9ho objektov\u00e9ho \u00falo\u017ei\u0161t\u011b. <\/p>\n<p><\/p>\n<p>Existuje tak\u00e9 komponent jako Thanos Store Gateway, kter\u00fd dok\u00e1\u017ee \u010d\u00edst tato data z Object Storage p\u0159i p\u0159\u00edchoz\u00edch po\u017eadavc\u00edch od Thanos Query. Thanos Query implementuje PromQL a Prometheus API. To znamen\u00e1, \u017ee z vn\u011bj\u0161\u00edho pohledu vypad\u00e1 jako Prometheus. P\u0159ij\u00edm\u00e1 po\u017eadavky PromQL, pos\u00edl\u00e1 je do Thanos Store Gateway, kter\u00e1 z\u00edsk\u00e1v\u00e1 pot\u0159ebn\u00e1 data z Object Storage a pos\u00edl\u00e1 je zp\u011bt.<\/p>\n<p><\/p>\n<p>Ale m\u00e1me v Object Storage ulo\u017eena data bez posledn\u00edch dvou hodin vzhledem k povaze implementace Thanos Sidecar, kter\u00fd nem\u016f\u017ee nahr\u00e1t posledn\u00ed dv\u011b hodiny do Object Storage S3, proto\u017ee pro tyto dv\u011b hodiny Prometheus je\u0161t\u011b nevytvo\u0159il soubory v m\u00edstn\u00edm \u00falo\u017ei\u0161ti.<\/p>\n<p><\/p>\n<p>Jak se to tedy poda\u0159ilo obej\u00edt? Thanos Query krom\u011b po\u017eadavk\u016f do Thanos Store Gateway z\u00e1rove\u0148 pos\u00edl\u00e1 po\u017eadavky do ka\u017ed\u00e9ho Thanos Sidecar, kter\u00fd se nach\u00e1z\u00ed pobl\u00ed\u017e Prometheus. <\/p>\n<p><\/p>\n<p>A Thanos Sidecar zase sm\u011bruje po\u017eadavky d\u00e1l do Prometheus a z\u00edsk\u00e1v\u00e1 data za posledn\u00ed dv\u011b hodiny.<\/p>\n<p><\/p>\n<p>Krom\u011b t\u011bchto komponent\u016f existuje je\u0161t\u011b voliteln\u00e1 komponenta, bez kter\u00e9 se Thanos bude c\u00edtit \u0161patn\u011b. Toto je Thanos Compact, kter\u00fd se star\u00e1 o spojov\u00e1n\u00ed mal\u00fdch soubor\u016f na Object Storage do v\u011bt\u0161\u00edch soubor\u016f, kter\u00e9 sem nahr\u00e1ly Thanos Sidecary. Thanos Sidecar tam nahr\u00e1v\u00e1 soubory s daty za posledn\u00ed dv\u011b hodiny. Tyto soubory, pokud se nespojuj\u00ed do v\u011bt\u0161\u00edch soubor\u016f, mohou v\u00fdrazn\u011b nar\u016fst. \u010c\u00edm v\u00edce t\u011bchto soubor\u016f, t\u00edm v\u00edce pam\u011bti pot\u0159ebuje Thanos Store Gateway, t\u00edm v\u00edce prost\u0159edk\u016f na p\u0159enos dat p\u0159es s\u00ed\u0165, metadata. Pr\u00e1ce Thanos Store Gateway se st\u00e1v\u00e1 neefektivn\u00ed. Proto je nutn\u00e9 spustit Thanos Compact, kter\u00fd spojuje mal\u00e9 soubory do v\u011bt\u0161\u00edch, aby bylo t\u011bchto soubor\u016f m\u00e9n\u011b a aby se sn\u00ed\u017eil overhead na Thanos Store Gateway.<\/p>\n<p><\/p>\n<p>Existuje tak\u00e9 komponent jako Thanos Ruler. Prov\u00e1d\u00ed pravidla upozorn\u011bn\u00ed Prometheus a m\u016f\u017ee vypo\u010d\u00edt\u00e1vat pravidla nahr\u00e1v\u00e1n\u00ed Prometheus, aby op\u011bt zapisoval data do Object Storage. Ale tato komponenta se nedoporu\u010duje pou\u017e\u00edvat, proto\u017ee <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\/blob\/master\/docs\/components\/rule.md#risk\">je n\u00e1chyln\u00fd k vracen\u00ed ne\u00fapln\u00fdch dat.<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p>Toto je jednoduch\u00e1 sch\u00e9ma Thanos. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/3f7cd77a1c056bf7ac245c774d05ea34.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Nyn\u00ed porovnejme s diagramem VictoriaMetrics.<\/p>\n<p><\/p>\n<p>VictoriaMetrics m\u00e1 2 verze: Single-node a clusterovou verzi. Single-node b\u011b\u017e\u00ed na jednom po\u010d\u00edta\u010di. V Single-node nejsou tyto komponenty, pouze jeden bin\u00e1rn\u00ed soubor. Tento bin\u00e1rn\u00ed soubor na sn\u00edmku vypad\u00e1 jako tento \u010dtverec. V\u0161e, co je uvnit\u0159 \u010dtverce, je obsah bin\u00e1rn\u00edho souboru pro Single-node verzi. Nen\u00ed nutn\u00e9 o n\u011bm v\u011bd\u011bt. Jednodu\u0161e spust\u00edte bin\u00e1rn\u00ed soubor \u2014 a v\u0161echno funguje. <\/p>\n<p><\/p>\n<p>Klastr verze je slo\u017eit\u011bj\u0161\u00ed. Uvnit\u0159 n\u00ed jsou t\u0159i r\u016fzn\u00e9 komponenty: vmselect, vminsert a vmstorage. Z jejich n\u00e1zv\u016f by m\u011blo b\u00fdt jasn\u00e9, co ka\u017ed\u00e1 z nich d\u011bl\u00e1. Komponenta Insert p\u0159ij\u00edm\u00e1 data v r\u016fzn\u00fdch form\u00e1tech: z Prometheus remote write API, protokolu Influx line, protokolu Graphite a z protokolu OpenTSDB. Komponenta Insert je p\u0159ij\u00edm\u00e1, parsuje a rozd\u011bluje mezi existuj\u00edc\u00ed storage komponenty, kde jsou data ukl\u00e1d\u00e1na. <noindex><a rel=\"nofollow\" href=\"https:\/\/medium.com\/@valyala\/promql-tutorial-for-beginners-9ab455142085\">PromQL<\/a><\/noindex>, a tak\u00e9 Prometheus querying API, a m\u016f\u017ee b\u00fdt pou\u017eita jako n\u00e1hrada Prometheus v Grafana nebo jin\u00fdch klientech Prometheus API. Select p\u0159ij\u00edm\u00e1 promql dotazy, parsuje je, na\u010d\u00edt\u00e1 pot\u0159ebn\u00e1 data pro proveden\u00ed tohoto dotazu z storage uzl\u016f, zpracov\u00e1v\u00e1 tato data a vrac\u00ed odpov\u011b\u010f.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/5b4f1ec2504c1bea423e58ced26570bd.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Porovnejme slo\u017eitost instalace Thanos a VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/39b293fc911b2987a191cc5d98b1c9f7.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Za\u010dneme s Thanos. Ne\u017e za\u010dnete pracovat s Thanos, mus\u00edte vytvo\u0159it bucket v Object Storage, jako je S3 nebo GCS, aby Thanos Sidecar mohl tam zapisovat data. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/7a59c36c4453f1747067c79d9a9b8e2a.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pot\u00e9 je pro ka\u017ed\u00fd Prometheus pot\u0159eba nainstalovat Thanos Sidecar. P\u0159edt\u00edm nezapome\u0148te deaktivovat data compaction v Prometheus. Data compaction pravideln\u011b komprimuje data v lok\u00e1ln\u00edm \u00falo\u017ei\u0161ti Prometheus, aby se sn\u00ed\u017eila spot\u0159eba zdroj\u016f.<\/p>\n<p><\/p>\n<p>Kdy\u017e instalujete Thanos Sidecar ke sv\u00fdm instance Promethea, mus\u00edte vypnout toto zhu\u0161t\u011bn\u00ed dat, proto\u017ee Thanos Sidecar nedok\u00e1\u017ee spr\u00e1vn\u011b pracovat p\u0159i zapnut\u00e9m zhu\u0161t\u011bn\u00ed dat. To znamen\u00e1, \u017ee v\u00e1\u0161 Prometheus za\u010dne ukl\u00e1dat data v bloc\u00edch po dvou hodin\u00e1ch a p\u0159estane tyto bloky spojovat do v\u011bt\u0161\u00edch. Pokud pak prov\u00e1d\u00edte dotazy, kter\u00e9 p\u0159esahuj\u00ed trv\u00e1n\u00ed posledn\u00edch dvou hodin, nebudou fungovat tak efektivn\u011b, jak by mohly, kdyby bylo zhu\u0161t\u011bn\u00ed dat zapnuto.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/825b70ede9edd1de6658576e2b824cd1.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Proto Thanos doporu\u010duje zkr\u00e1tit dobu uchov\u00e1v\u00e1n\u00ed dat (data retention) v m\u00edstn\u00edm \u00falo\u017ei\u0161ti na 6-8 hodin, aby se sn\u00ed\u017eil overhead velk\u00e9ho mno\u017estv\u00ed mal\u00fdch blok\u016f.<\/p>\n<p><\/p>\n<p>Pot\u00e9, co nainstalujete Thanos Sidecar, mus\u00edte pro ka\u017ed\u00fd Object Storage Bucket nainstalovat dva komponenty. To jsou Thanos Compactor a Thanos Store Gateway. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/77575d65a75bfd9af8d7dedf0cc5c922.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Po t\u00e9to instalaci je t\u0159eba nainstalovat Thanos Query a nastavit jej tak, aby mohl p\u0159ipojit ke v\u0161em Thanos Store Gateway, kter\u00e9 m\u00e1te, a tak\u00e9 se mohl p\u0159ipojit ke v\u0161em Thanos Sidecar.<\/p>\n<p><\/p>\n<p>Zde m\u016f\u017ee b\u00fdt mal\u00fd probl\u00e9m. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6eddee956c58991ccee52891b368f10f.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Mus\u00edte nastavit spolehliv\u00e9 a zabezpe\u010den\u00e9 p\u0159ipojen\u00ed z Thanos Query k t\u011bmto komponent\u016fm. A pokud jsou va\u0161e instance Promethea v r\u016fzn\u00fdch datov\u00fdch centrech nebo v r\u016fzn\u00fdch VPC, pak je zak\u00e1z\u00e1no p\u0159ipojen\u00ed zven\u010d\u00ed. Ale pro fungov\u00e1n\u00ed Thanos Query pot\u0159ebujete n\u011bjak\u00fdm zp\u016fsobem nastavit p\u0159ipojen\u00ed tam, a mus\u00edte vymyslet zp\u016fsob.<\/p>\n<p><\/p>\n<p>Pokud m\u00e1te mnoho takov\u00fdch datov\u00fdch center, kles\u00e1 spolehlivost cel\u00e9ho syst\u00e9mu. Thanos Query mus\u00ed neust\u00e1le udr\u017eovat p\u0159ipojen\u00ed ke v\u0161em Thanos Sidecar um\u00edst\u011bn\u00fdm v r\u016fzn\u00fdch datov\u00fdch centrech. P\u0159i ka\u017ed\u00e9m p\u0159\u00edchoz\u00edm po\u017eadavku bude sm\u011b\u0159ovat dotazy na v\u0161echny Thanos Sidecar. Pokud dojde k p\u0159eru\u0161en\u00ed spojen\u00ed, obdr\u017e\u00edte bu\u010f ne\u00faplnou sadu dat, nebo odpov\u011b\u010f \u201eklastr nefunguje\u201c. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/13c3765871568ac0db4014964cb5d752.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Ve VictoriaMetrics je to trochu jednodu\u0161\u0161\u00ed. Pro variantu s jedn\u00edm uzlem sta\u010d\u00ed spustit jeden bin\u00e1rn\u00ed soubor a v\u0161echno funguje. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/1edf992a6404f5dea1ae2bd4f4d2d8fd.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>V klustrov\u00e9 verzi sta\u010d\u00ed spustit v\u0161echny v\u00fd\u0161e zm\u00edn\u011bn\u00e9 t\u0159i typy komponent\u016f v jak\u00e9mkoli pot\u0159ebn\u00e9m mno\u017estv\u00ed, nebo pou\u017e\u00edt <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/helm-charts\/\">helm chart<\/a><\/noindex> pro automatizaci spu\u0161t\u011bn\u00ed komponent\u016f v Kubernetes. Je\u0161t\u011b pl\u00e1nujeme vytvo\u0159en\u00ed oper\u00e1tora pro Kubernetes. Helm chart nepokr\u00fdv\u00e1 n\u011bkter\u00e9 p\u0159\u00edpady a m\u016f\u017ee v\u00e1m zp\u016fsobit probl\u00e9my. Nap\u0159\u00edklad umo\u017e\u0148uje sn\u00ed\u017eit po\u010det storage node, co\u017e povede ke ztr\u00e1t\u011b dat.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/ad4249222cb5e591d7e7bd0b7f1708c0.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pot\u00e9, co spust\u00edte jeden bin\u00e1rn\u00ed soubor nebo klustrovou verzi, sta\u010d\u00ed p\u0159idat do konfigurace Prometheus <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/VictoriaMetrics\/VictoriaMetrics\/blob\/master\/README.md#prometheus-setup\">nastaven\u00ed pro remote write url<\/a><\/noindex>, aby za\u010dal zapisovat data paraleln\u011b do lok\u00e1ln\u00edho \u00falo\u017ei\u0161t\u011b a do vzd\u00e1len\u00e9ho \u00falo\u017ei\u0161t\u011b. Jak jste si v\u0161imli, tato konfigurace by m\u011bla fungovat mnohem spolehliv\u011bji v porovn\u00e1n\u00ed s konfigurac\u00ed Thanos. Nen\u00ed pot\u0159eba udr\u017eovat p\u0159ipojen\u00ed mezi VictoriaMetrics a v\u0161emi Prometheus, proto\u017ee Prometheus se p\u0159ipojuj\u00ed samy k VictoriaMetrics a p\u0159ed\u00e1vaj\u00ed data. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/465ffc6cd77b2ca022b2541851a7ddbc.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Zva\u017eme \u00fadr\u017ebu Thanos a VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6043f0d3d99cb3e49837f03d3e6bbb9b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos mus\u00ed sledovat Sidecar, aby nezastavil nahr\u00e1v\u00e1n\u00ed dat do Object Storage. M\u016f\u017ee se st\u00e1t, \u017ee nahr\u00e1v\u00e1n\u00ed dat se zastav\u00ed kv\u016fli chyb\u00e1m nahr\u00e1v\u00e1n\u00ed, nap\u0159\u00edklad pokud dojde k do\u010dasn\u00e9mu p\u0159eru\u0161en\u00ed s\u00ed\u0165ov\u00e9ho spojen\u00ed s Object Storage, nebo pokud je Object Storage do\u010dasn\u011b nedostupn\u00fd. Thanos Sidecar si toho v tomto okam\u017eiku v\u0161imne, nahl\u00e1s\u00ed chybu, m\u016f\u017ee spadnout a pot\u00e9 p\u0159estat fungovat. Pokud ho nebudete monitorovat, p\u0159estanou se v\u00e1m data p\u0159en\u00e1\u0161et do Object Storage. Pokud uplyne doba retention (doporu\u010den\u00fdch 6-8 hodin), za\u010dnete ztr\u00e1cet data, kter\u00e1 se nedostala do Object Storage.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/7c6556fecdee4ca4986931c2eebf9895.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos compactor-y mohou p\u0159estat fungovat kv\u016fli <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\/issues\/1919\">z\u00e1vod\u016f se Sidecar<\/a><\/noindex>. Compactor-y berou data z Object Storage a slu\u010duj\u00ed je do v\u011bt\u0161\u00edch datov\u00fdch kus\u016f. Proto\u017ee nejsou synchronized s Sidecar, m\u016f\u017ee se st\u00e1t, \u017ee: Sidecar je\u0161t\u011b nedopsal blok, Compactor se rozhodne, \u017ee tento blok je \u00fapln\u011b zaps\u00e1n. Compactor za\u010dne blok \u010d\u00edst. \u010cte blok ne\u00fapln\u011b a p\u0159estane pracovat. Viz podrobnosti <noindex><a rel=\"nofollow\" href=\"https:\/\/thanos.io\/proposals\/201901-read-write-operations-bucket.md\/\">tady<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/7fd00e243009763781b54043dec1e94b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Store Gateway m\u016f\u017ee poskytovat nekonzistentn\u00ed data kv\u016fli z\u00e1vod\u016fm mezi Compactor a Sidecar. Tady je to stejn\u00e9, proto\u017ee Store Gateway nen\u00ed nijak synchronizov\u00e1n s Compactor a Sidecar. M\u016f\u017eou se tedy vyskytnout z\u00e1vodn\u00ed stavy, kdy Store Gateway nevid\u00ed \u010d\u00e1st dat, nebo vid\u00ed nadbyte\u010dn\u00e1 data.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/85fcc811173dda1a42ac8d4e3b212f5e.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Query komponent v Thanos v\u00fdchoz\u00ed nastaven\u00ed vrac\u00ed \u010d\u00e1ste\u010dn\u00fd v\u00fdsledek, pokud n\u011bkter\u00e9 Sidecar-y nebo Store Gateway moment\u00e1ln\u011b nejsou dostupn\u00e9. Z\u00edsk\u00e1te \u010d\u00e1st dat a ani nebudete v\u011bd\u011bt, \u017ee nem\u00e1te v\u0161echna data. Takto funguje ve v\u00fdchoz\u00edm nastaven\u00ed. V podobn\u00e9 situaci VictoriaMetrics vrac\u00ed ozna\u010den\u00e1 data jako \u010d\u00e1ste\u010dn\u00e1. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a9e5a70bdcafae9b98545514ca7a7ff3.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Na rozd\u00edl od Thanos, VictoriaMetrics z\u0159\u00eddka ztr\u00e1c\u00ed data. I kdy\u017e dojde k p\u0159eru\u0161en\u00ed p\u0159ipojen\u00ed z Prometheus k VictoriaMetrics, nen\u00ed to probl\u00e9m, proto\u017ee Prometheus pokra\u010duje v zapisov\u00e1n\u00ed nov\u00fdch p\u0159\u00edchoz\u00edch dat do Write Ahead Logu, jeho\u017e velikost je 2 hodiny. Pokud b\u011bhem dvou hodin obnov\u00edte p\u0159ipojen\u00ed k VictoriaMetrics, data se neztrat\u00ed. Prometheus <noindex><a rel=\"nofollow\" href=\"https:\/\/grafana.com\/blog\/2019\/03\/25\/whats-new-in-prometheus-2.8-wal-based-remote-write\/\">um\u00ed dopsat data po obnoven\u00ed p\u0159ipojen\u00ed k VictoriaMetrics.<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/fa4be02056f7338416029bfd8f9d0214.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Na rozd\u00edl od Thanosu, kter\u00fd zapisuje data do objektov\u00e9ho \u00falo\u017ei\u0161t\u011b a\u017e po dvou hodin\u00e1ch, Prometheus automaticky replikovat data prost\u0159ednictv\u00edm protokolu remote write do vzd\u00e1len\u00e9ho \u00falo\u017ei\u0161t\u011b, jako je VictoriaMetrics. Ztr\u00e1ta lok\u00e1ln\u00edho \u00falo\u017ei\u0161t\u011b v Prometheu v\u00e1s nemus\u00ed d\u011bsit. Pokud by n\u00e1hle ztratil lok\u00e1ln\u00ed \u00falo\u017ei\u0161t\u011b, v nejhor\u0161\u00edm p\u0159\u00edpad\u011b p\u0159ijdete o posledn\u00ed sekundy dat, kter\u00e1 se nestihla zapsat do vzd\u00e1len\u00e9ho \u00falo\u017ei\u0161t\u011b.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/a6e9b2322eb9b3e145603a6b9db1002d.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Kubernetes automaticky spravuje cluster na rozd\u00edl od Thanosu. V\u0161echny komponenty Thanosu je obt\u00ed\u017en\u00e9 um\u00edstit do jednoho Kubernetes clusteru, na rozd\u00edl od clusterov\u00fdch komponent VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/5b3d1586fe461a0c6f34de09fdd12845.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Aktualizace na novou verzi VictoriaMetrics je velmi jednoduch\u00e1. Sta\u010d\u00ed zastavit VictoriaMetrics, aktualizovat bin\u00e1rn\u00ed soubory a znovu spustit. P\u0159i zastaven\u00ed sign\u00e1lem SIGINT v\u0161echny bin\u00e1rn\u00ed soubory VictoriaMetrics prov\u00e1d\u011bj\u00ed graceful shutdown. Spr\u00e1vn\u011b ukl\u00e1daj\u00ed pot\u0159ebn\u00e1 data a spr\u00e1vn\u011b uzav\u00edraj\u00ed p\u0159\u00edchoz\u00ed p\u0159ipojen\u00ed, aby nic neztratili. Proto p\u0159i aktualizaci o nic nep\u0159ijdete. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/96a52e2f0696172159919536efb68ad3.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics usnad\u0148uje roz\u0161i\u0159ov\u00e1n\u00ed clusteru. Sta\u010d\u00ed p\u0159idat pot\u0159ebn\u00e9 komponenty a pokra\u010dovat v pr\u00e1ci. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/5f5e6ef78b322bb278e618a526f05e26.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>O \u00faskal\u00edch v Thanosu a VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/17808bc76a16e571b7e4fa1655964201.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos m\u00e1 n\u00e1sleduj\u00edc\u00ed \u00faskal\u00ed. Prometheus mus\u00ed uchov\u00e1vat data za posledn\u00ed dv\u011b hodiny. Pokud se ztrat\u00ed, p\u0159ijdete o n\u011b, proto\u017ee se je\u0161t\u011b nestihla zapsat do objektov\u00e9ho \u00falo\u017ei\u0161t\u011b, jako je S3. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/81ca9135d2d97b95e9731dd1f5501859.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Komponent Store Gateway a komponent compactor mohou vy\u017eadovat hodn\u011b pam\u011bti pro pr\u00e1ci s velk\u00fdm objektov\u00fdm \u00falo\u017ei\u0161t\u011bm, pokud je tam uchov\u00e1v\u00e1no mnoho mal\u00fdch soubor\u016f. \u010c\u00edm v\u00edce soubor\u016f a jejich objem, t\u00edm v\u00edce opera\u010dn\u00ed pam\u011bti Store Gateway a compactor pot\u0159ebuj\u00ed pro ukl\u00e1d\u00e1n\u00ed metainformac\u00ed. Thanos m\u00e1 mnoho probl\u00e9m\u016f t\u00fdkaj\u00edc\u00edch se toho, \u017ee <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\/issues\/448\">Store Gateway a compactor pad\u00e1 p\u0159i pr\u016fm\u011brn\u00fdch objemech zapsan\u00fdch dat.<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/cf75315535439843c9bb32cf1175391b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos se propaguje, \u017ee m\u016f\u017ee neomezen\u011b \u0161k\u00e1lovat po\u010det va\u0161ich Promethe\u016f. Ve skute\u010dnosti to nen\u00ed pravda. V\u0161echny dotazy proch\u00e1zej\u00ed p\u0159es komponent Query, kter\u00fd mus\u00ed paraleln\u011b dot\u00e1zat v\u0161echny komponenty Store Gateway a v\u0161echny komponenty Sidecar, z\u00edskat odtud data a n\u00e1sledn\u011b je p\u0159edzpracovat. Je z\u0159ejm\u00e9, \u017ee rychlost dotaz\u016f je omezena nejpomalej\u0161\u00edm slab\u00fdm \u010dl\u00e1nkem, nejpomalej\u0161\u00ed komponentou Store Gateway nebo nejpomalej\u0161\u00edm Sidecarem. <\/p>\n<p><\/p>\n<p>Tyto komponenty mohou b\u00fdt zat\u00ed\u017eeny nerovnom\u011brn\u011b. Nap\u0159\u00edklad m\u00e1te Prometheus, kter\u00fd shroma\u017e\u010fuje miliony metrik za sekundu. A pak je zde Prometheus, kter\u00e9mu se shroma\u017e\u010fuj\u00ed tis\u00edce metrik za sekundu. Prometheus, kter\u00fd shroma\u017e\u010fuje miliony metrik za sekundu, v\u00fdrazn\u011b zat\u011b\u017euje server, na kter\u00e9m b\u011b\u017e\u00ed. Proto Sidecar tam pracuje pomaleji. A v\u016fbec v\u0161e tam funguje pomalu. A Query komponent bude velmi pomalu z\u00edsk\u00e1vat data. Proto v\u00fdkonnost cel\u00e9ho va\u0161eho clusteru bude omezena t\u00edmto pomal\u00fdm Sidecarem.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/68070f629821a54bfd8ed934d67344fd.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Ve v\u00fdchoz\u00edm nastaven\u00ed Thanos poskytuje \u010d\u00e1ste\u010dn\u00e1 data, pokud jsou n\u011bkter\u00e9 Sidecar nebo Store Gateway nedostupn\u00e9. Nap\u0159\u00edklad pokud m\u00e1te Sidecar rozpt\u00fdlen\u00e9 po cel\u00e9m sv\u011bt\u011b v r\u016fzn\u00fdch datov\u00fdch centrech, pravd\u011bpodobnost p\u0159eru\u0161en\u00ed spojen\u00ed a nedostupnosti komponent\u016f se v\u00fdrazn\u011b zvy\u0161uje. V\u011bt\u0161inou tedy obdr\u017e\u00edte \u010d\u00e1ste\u010dn\u00e1 data, ani\u017e byste o tom v\u011bd\u011bli.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6a1dea50e739314c23b4370c569b44a4.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics m\u00e1 tak\u00e9 sv\u00e9 \u00faskal\u00ed. Prvn\u00edm \u00faskal\u00edm je mo\u017enost, kter\u00e1 omezuje objem opera\u010dn\u00ed pam\u011bti pou\u017e\u00edvan\u00e9 pro cache u VictoriaMetrics. Ve v\u00fdchoz\u00edm nastaven\u00ed je to 60 % opera\u010dn\u00ed pam\u011bti na stroji, na kter\u00e9m je VictoriaMetrics spu\u0161t\u011bna, nebo 60 % RAM podu VictoriaMetrics v Kubernetes.<\/p>\n<p><\/p>\n<p>Pokud toto nastaven\u00ed nespr\u00e1vn\u011b zm\u011bn\u00edte, m\u016f\u017eete v\u00fdrazn\u011b zhor\u0161it v\u00fdkon VictoriaMetrics. Nap\u0159\u00edklad pokud nastav\u00edte p\u0159\u00edli\u0161 n\u00edzkou hodnotu, data se mohou p\u0159estat vejdou do cache VictoriaMetrics. To znamen\u00e1, \u017ee bude muset vykon\u00e1vat zbyte\u010dn\u00e9 \u00fakoly a zat\u011b\u017eovat procesor s diskem. Pokud tuto mo\u017enost nastav\u00edte p\u0159\u00edli\u0161 vysoko, zvy\u0161uje to jednak pravd\u011bpodobnost, \u017ee VictoriaMetrics zp\u016fsob\u00ed chybu \u201eout of memory\u201c, a jednak to povede k tomu, \u017ee v opera\u010dn\u00edm syst\u00e9mu bude zb\u00fdvat velmi m\u00e1lo opera\u010dn\u00ed pam\u011bti pro souborovou cache. A VictoriaMetrics se spol\u00e9h\u00e1 na souborovou cache pro sv\u016fj v\u00fdkon. Pokud je j\u00ed m\u00e1lo, m\u016f\u017ee v\u00fdrazn\u011b vzr\u016fst z\u00e1t\u011b\u017e na disk. Proto doporu\u010den\u00ed: nem\u011b\u0148te tuto hodnotu bez nal\u00e9hav\u00e9 pot\u0159eby.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/f145833dcbe42c2b62545358cfb204e5.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Druh\u00e1 mo\u017enost. Toto retentionPeriod \u2014 obdob\u00ed, kter\u00e9 je ve v\u00fdchoz\u00edm nastaven\u00ed nastaveno na 1 m\u011bs\u00edc. Toto je doba, po kterou VictoriaMetrics uchov\u00e1v\u00e1 data. Po uplynut\u00ed t\u00e9to doby VictoriaMetrics data ma\u017ee.<\/p>\n<p><\/p>\n<p>Mnoz\u00ed spou\u0161t\u011bj\u00ed VictoriaMetrics bez tohoto parametru, zaznamen\u00e1vaj\u00ed data po dobu jednoho m\u011bs\u00edce. A pak se ptaj\u00ed: pro\u010d data zmizela za p\u0159edchoz\u00ed m\u011bs\u00edc? Proto\u017ee retentionPeriod je ve v\u00fdchoz\u00edm nastaven\u00ed nastaven na 1 m\u011bs\u00edc. Proto je t\u0159eba zn\u00e1t a nastavit spr\u00e1vn\u00fd retentionPeriod. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/377e4e19b7dc5648dd16bff39f4f1651.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Projdeme si unik\u00e1tn\u00ed mo\u017enosti.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/bca5529a95e94ada650e67dba063ada6.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos m\u00e1 funkci zvanou downsampling: 5minutov\u00e9 a hodinov\u00e9 intervaly, kter\u00e9 \u010dasto <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\/issues?utf8=%E2%9C%93&amp;q=is%3Aissue+is%3Aopen+downsampling\">nefunguj\u00ed spr\u00e1vn\u011b<\/a><\/noindex>. Pokud to vyhled\u00e1te a pod\u00edv\u00e1te se na jejich probl\u00e9my na githubu, je tam spousta probl\u00e9m\u016f souvisej\u00edc\u00edch s t\u00edmto downsamplingem, co\u017e n\u011bkdy nefunguje spr\u00e1vn\u011b nebo nefunguje tak, jak u\u017eivatel\u00e9 o\u010dek\u00e1vaj\u00ed.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/84f116767826d1174286b45ccf60dfe7.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos m\u00e1 deduplikaci dat pro p\u00e1ry Prometheus HA. Kdy\u017e dva Prometheus sb\u00edraj\u00ed stejn\u00e9 metriky ze stejn\u00fdch c\u00edl\u016f, Thanos je ukl\u00e1d\u00e1 do Object Storage. Thanos dok\u00e1\u017ee spr\u00e1vn\u011b deduplikovat tato data, na rozd\u00edl od VictoriaMetrics.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/efd797cafcb339a4900f4d2cddd04638.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos m\u00e1 komponentu alert, kter\u00e1 byla na sch\u00e9matu Thanos. Ale <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/thanos-io\/thanos\/blob\/master\/docs\/components\/rule.md\">nedoporu\u010duje se pou\u017e\u00edvat v produkci<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/87d12ff7b3c33dae9a8eda7a2a95bce1.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Thanos m\u00e1 v\u00fdhodu, \u017ee k\u00f3d Thanos a Prometheus je spole\u010dn\u00fd. Thanos a Prometheus jsou vyvinuty t\u011bmi sam\u00fdmi v\u00fdvoj\u00e1\u0159i. P\u0159i vylep\u0161en\u00edch v Thanosu nebo Prometheovi vyhr\u00e1v\u00e1 druh\u00e1 strana.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/92435f15d58e83eb4d548a8bf5256c30.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Hlavn\u00ed funkc\u00ed VictoriaMetrics je MetricsQL. To je roz\u0161\u00ed\u0159en\u00ed VictoriaMetrics pro PromQL, o kter\u00e9m jsem mluvil na p\u0159edchoz\u00edm big monitoring meetupu.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/43a1618a397badc3df9d4eded19be1ec.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>VictoriaMetrics podporuje upload dat podle mnoha r\u016fzn\u00fdch protokol\u016f. VictoriaMetrics m\u016f\u017ee nejen p\u0159ij\u00edmat data od Prometheus, ale tak\u00e9 podle protokol\u016f Influx, OpenTSDB a Graphite.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/b4bca4b255990f1af11a6ceaf42f46ef.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Data ve VictoriaMetrics zab\u00edraj\u00ed obvykle mnohem m\u00e9n\u011b m\u00edsta ve srovn\u00e1n\u00ed s Thanos a Prometheus. <\/p>\n<p><\/p>\n<p>Pokud zapisujete skute\u010dn\u00e1 data, u\u017eivatel\u00e9 hovo\u0159\u00ed o 2-5n\u00e1sobn\u00e9m zmen\u0161en\u00ed velikosti dat na disku ve srovn\u00e1n\u00ed s Prometheus a Thanos.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/6aeab3c42b45dbd620d328fc43ce4bec.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Dal\u0161\u00ed v\u00fdhodou VictoriaMetrics je, \u017ee je optimalizov\u00e1na pro rychlost. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/89010a913f0d7b1388b6c62007c7835b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Projdeme si n\u00e1klady infrastruktury. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/65bd322bb2a64ac4188e29b79e54763a.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Jednou z v\u00fdhod Thanos je, \u017ee ukl\u00e1d\u00e1 data do object storage, kter\u00e9 je relativn\u011b levn\u00e9.<\/p>\n<p><\/p>\n<p>P\u0159i ukl\u00e1d\u00e1n\u00ed dat do object storage mus\u00edte platit za operace z\u00e1pisu a \u010dten\u00ed dat (10 $ za milion operac\u00ed). Kdy\u017e zapisujete data do object storage, plat\u00edte n\u00e1klady sv\u00e9ho hostingu na nahr\u00e1v\u00e1n\u00ed dat do internetu, pokud v\u00e1\u0161 cluster nen\u00ed v AWS \u2014 tam je to zdarma. Kdy\u017e \u010dtete data, plat\u00edte od 10 do 230 $ za 1 TB. To m\u016f\u017ee b\u00fdt v\u00fdznamn\u00e9, pokud \u010dasto vy\u017eadujete historick\u00e1 data z Thanos clusteru.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/7f1b32c75d49efa082201fa55b43f6bb.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pro Thanos klastr je t\u0159eba platit servery pro komponenty Compact, Store Gateway a Query, kter\u00e9 vy\u017eaduj\u00ed hodn\u011b pam\u011bti a CPU pro zpracov\u00e1n\u00ed velk\u00fdch objem\u016f dat.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/19c90f30760e77f57a658e67507f4f98.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>N\u00e1klady pro VictoriaMetrics jsou n\u00e1sleduj\u00edc\u00ed. Pokud uchov\u00e1v\u00e1te data na HDD disc\u00edch GCE, vyjde to na 40 $ za 1TB. Pro VictoriaMetrics sta\u010d\u00ed b\u011b\u017en\u00e9 HDD disky, nepot\u0159ebujete \u017e\u00e1dn\u00e9 SSD, kter\u00e9 jsou alespo\u0148 p\u011btkr\u00e1t dra\u017e\u0161\u00ed. VictoriaMetrics je optimalizov\u00e1na pro HDD.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/c7e922b4d97f353218d6edad7cdea584.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Pro VictoriaMetrics pot\u0159ebujete servery pro komponenty: bu\u010f Single-node nebo pro clusterov\u00e9 komponenty, kter\u00e9 na rozd\u00edl od Thanos komponent\u016f vy\u017eaduj\u00ed mnohem m\u00e9n\u011b CPU a RAM \u2014 co\u017e tedy znamen\u00e1 ni\u017e\u0161\u00ed n\u00e1klady. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/aaf63cad75238ba19efb825376cf356c.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>P\u0159\u00edklady implementac\u00ed. <\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/53ce0a68724c339d88ad769c18a2e5f9.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>P\u0159\u00edkladem implementace pro Thanos je Gitlab. Gitlab pln\u011b b\u011b\u017e\u00ed na Thanos. Ale nen\u00ed to zcela bez probl\u00e9m\u016f. Kdy\u017e se pod\u00edv\u00e1te na jejich <noindex><a rel=\"nofollow\" href=\"https:\/\/gitlab.com\/gitlab-com\/gl-infra\/infrastructure\/issues\/8647\">issues<\/a><\/noindex>, m\u016f\u017eete vid\u011bt, \u017ee maj\u00ed neust\u00e1le n\u011bjak\u00e9 <noindex><a rel=\"nofollow\" href=\"https:\/\/gitlab.com\/gitlab-com\/gl-infra\/infrastructure\/issues\/8413\">probl\u00e9my s Thanosem<\/a><\/noindex>: nedostatek pam\u011bti pro Store Gateway nebo Query komponenty. Neust\u00e1le mus\u00ed zvy\u0161ovat objem pam\u011bti. <\/p>\n<p><\/p>\n<p>T\u00edm se zvy\u0161uj\u00ed n\u00e1klady na \u0159e\u0161en\u00ed t\u011bchto probl\u00e9m\u016f. <\/p>\n<p><\/p>\n<p>Druh\u00e1 implementace, kter\u00e1 by mohla b\u00fdt \u00fasp\u011b\u0161n\u011bj\u0161\u00ed \u2014 je spole\u010dnost Improbable, kter\u00e1 za\u010dala v\u00fdvoj Thanos. Publikovali zdrojov\u00e9 k\u00f3dy Thanosu. Improbable je spole\u010dnost, kter\u00e1 se zab\u00fdv\u00e1 v\u00fdvojem hern\u00edch engin\u016f.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/3a1279cae3cfc7e94c2eccfc0972f06e.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Ve\u0159ejn\u00e9 p\u0159\u00edklady implementace pro VictoriaMetrics jsou:<\/p>\n<p><\/p>\n<ul>\n<li>wix.com, tv\u016frce webov\u00fdch str\u00e1nek<\/li>\n<li>Adidas implementuje VictoriaMetrics a dokonce na posledn\u00edm PromCon 2019 prezentovali.<\/li>\n<li>TrafficStars \u2014 reklamn\u00ed s\u00ed\u0165<\/li>\n<li>Seznam.cz \u2014 popul\u00e1rn\u00ed \u010desk\u00fd vyhled\u00e1va\u010d.<\/li>\n<\/ul>\n<p><\/p>\n<p>A pak jsou tu spole\u010dnosti bez jm\u00e9na, kter\u00e9 nyn\u00ed nemohu nazvat. Nedali souhlas. <\/p>\n<p><\/p>\n<ul>\n<li>Jedno velk\u00e9 hern\u00ed studio. V\u011bt\u0161\u00ed ne\u017e Improbable.<\/li>\n<li>Velk\u00fd v\u00fdvoj\u00e1\u0159 grafick\u00e9ho softwaru.<\/li>\n<li>Velk\u00e1 rusk\u00e1 banka.<\/li>\n<li>Evropsk\u00fd v\u00fdrobce v\u011btrn\u00fdch turb\u00edn, kter\u00fd \u00fasp\u011b\u0161n\u011b otestoval VictoriaMetrics. Tento v\u00fdrobce implementuje VictoriaMetrics pro monitorov\u00e1n\u00ed dat z v\u011btrn\u00fdch turb\u00edn s frekvenc\u00ed 50 vzork\u016f za sekundu na ka\u017ed\u00fd senzor. Ka\u017ed\u00e1 v\u011btrn\u00e1 turb\u00edna m\u00e1 n\u011bkolik set senzor\u016f. Maj\u00ed n\u011bkolik set v\u011btrn\u00fdch turb\u00edn.<\/li>\n<li>Rusk\u00e9 aerolinky, kter\u00e9 cht\u011bj\u00ed implementovat VictoriaMetrics, ale st\u00e1le to nemohou dot\u00e1hnout do konce. Jsme ve f\u00e1zi smlouvy.<\/li>\n<\/ul>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/040affc4d56712783db61ee3b0ec509e.jpg\" style=\"display:block;margin: 0 auto;\" \/>Z\u00e1v\u011bry.<\/p>\n<p><\/p>\n<p>VictoriaMetrics a Thanos \u0159e\u0161\u00ed podobn\u00e9 \u00fakoly, ale r\u016fzn\u00fdmi zp\u016fsoby:<\/p>\n<p><\/p>\n<ul>\n<li>Glob\u00e1ln\u00ed pohled na dotazy<\/li>\n<li>horizont\u00e1ln\u00ed \u0161k\u00e1lov\u00e1n\u00ed <\/li>\n<li>libovoln\u00e1 doba uchov\u00e1v\u00e1n\u00ed<\/li>\n<\/ul>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/af6285e8f6f68f373da1ebc552104f51.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>D\u011bkuji.<\/p>\n<p><\/p>\n<p>T\u011b\u0161\u00edme se na v\u00e1s na na\u0161em <noindex><a rel=\"nofollow\" href=\"https:\/\/t.me\/VictoriaMetrics_ru1\">telegramov\u00e9m kan\u00e1lu<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Vyberme \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics\" src=\"\/wp-content\/uploads\/2019\/12\/c45b2a3b6e541e7e6cd580629e418c35.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p class=\"for_users_only_msg\">Pouze registrovan\u00ed u\u017eivatel\u00e9 se mohou \u00fa\u010dastnit ankety. <noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/auth\/login\/\">P\u0159ihlaste se<\/a><\/noindex>, pros\u00edm.<\/p>\n<h2 class=\"default-block__polling-title\">Co pou\u017e\u00edv\u00e1te jako long term storage pro Prometheus?<\/h2>\n<ul class=\"poll-result\">\n<li class=\"poll-result__item\">\n<p>                <strong class=\"poll-result__data-percent\">35,3%<\/strong>Thanos6<\/p>\n<\/li>\n<li class=\"poll-result__item\">\n<p>                <strong class=\"poll-result__data-percent\">0,0%<\/strong>Cortex0<\/p>\n<\/li>\n<li class=\"poll-result__item\">\n<p>                <strong class=\"poll-result__data-percent\">0,0%<\/strong>M3DB0<\/p>\n<\/li>\n<li class=\"poll-result__item\">\n<p>                <strong class=\"poll-result__data-percent  poll-result__data-percent_winner\">41,2%<\/strong>VictoriaMetrics7<\/p>\n<\/li>\n<li class=\"poll-result__item\">\n<p>                <strong class=\"poll-result__data-percent\">23,5%<\/strong>jin\u00e94<\/p>\n<\/li>\n<\/ul>\n<p>    Hlasovalo 17 u\u017eivatel\u016f. Zdr\u017eelo se 16 u\u017eivatel\u016f.<br \/>\n<br \/>Zdroj: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/482272\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u0412\u0441\u0435\u043c \u043f\u0440\u0438\u0432\u0435\u0442. \u041d\u0438\u0436\u0435 \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u0430 \u0440\u0430\u0441\u0448\u0438\u0444\u0440\u043e\u0432\u043a\u0430 \u0434\u043e\u043a\u043b\u0430\u0434\u0430 \u0441 Big Monitoring Meetup 4. Prometheus \u2013 \u0441\u0438\u0441\u0442\u0435\u043c\u0430 \u043c\u043e\u043d\u0438\u0442\u043e\u0440\u0438\u043d\u0433\u0430 \u0440\u0430\u0437\u043b\u0438\u0447\u043d\u044b\u0445 \u0441\u0438\u0441\u0442\u0435\u043c \u0438 \u0441\u0435\u0440\u0432\u0438\u0441\u043e\u0432, \u0441 \u043f\u043e\u043c\u043e\u0449\u044c\u044e \u043a\u043e\u0442\u043e\u0440\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u043d\u044b\u0435 \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0430\u0442\u043e\u0440\u044b \u043c\u043e\u0433\u0443\u0442 \u0441\u043e\u0431\u0438\u0440\u0430\u0442\u044c \u0438\u043d\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u044e \u043e \u0442\u0435\u043a\u0443\u0449\u0438\u0445 \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u0430\u0445 \u0441\u0438\u0441\u0442\u0435\u043c \u0438 \u043d\u0430\u0441\u0442\u0440\u0430\u0438\u0432\u0430\u0442\u044c \u043e\u043f\u043e\u0432\u0435\u0449\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u043f\u043e\u043b\u0443\u0447\u0435\u043d\u0438\u044f \u0443\u0432\u0435\u0434\u043e\u043c\u043b\u0435\u043d\u0438\u0439 \u043e\u0431 \u043e\u0442\u043a\u043b\u043e\u043d\u0435\u043d\u0438\u044f\u0445 \u0432 \u0440\u0430\u0431\u043e\u0442\u0435 \u0441\u0438\u0441\u0442\u0435\u043c. \u0412 \u0434\u043e\u043a\u043b\u0430\u0434\u0435 \u0431\u0443\u0434\u0435\u0442 \u0441\u0440\u0430\u0432\u043d\u0435\u043d\u0438\u0435 Thanos \u0438 VictoriaMetrics \u2014 \u043f\u0440\u043e\u0435\u043a\u0442\u043e\u0432 \u0434\u043b\u044f \u0434\u043e\u043b\u0433\u043e\u0441\u0440\u043e\u0447\u043d\u043e\u0433\u043e \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u043c\u0435\u0442\u0440\u0438\u043a [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-54601","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.3 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u0412\u0441\u0435\u043c \u043f\u0440\u0438\u0432\u0435\u0442.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/cs\/blog\/administrirovanie\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics\" \/>\n\t\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.3\" \/>\n\t\t<meta property=\"og:locale\" content=\"cs_CZ\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0412\u044b\u0431\u0438\u0440\u0430\u0435\u043c \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0434\u043b\u044f Prometheus: Thanos vs VictoriaMetrics | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u0412\u0441\u0435\u043c \u043f\u0440\u0438\u0432\u0435\u0442.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/cs\/blog\/administrirovanie\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2019-12-29T21:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-02-18T11:02:38+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47V\u00fdb\u011br \u00falo\u017ei\u0161t\u011b dat pro Prometheus: Thanos vs VictoriaMetrics | ProHoster","description":"Ahoj v\u0161ichni.","canonical_url":"https:\/\/prohoster.info\/cs\/blog\/administrirovanie\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"cs_CZ","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0412\u044b\u0431\u0438\u0440\u0430\u0435\u043c \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0434\u043b\u044f Prometheus: Thanos vs VictoriaMetrics | ProHoster","og:description":"\u0412\u0441\u0435\u043c \u043f\u0440\u0438\u0432\u0435\u0442.","og:url":"https:\/\/prohoster.info\/cs\/blog\/administrirovanie\/vybiraem-hranilishhe-dannyh-dlya-prometheus-thanos-vs-victoriametrics","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-12-29T21:00:00+00:00","article:modified_time":"2020-02-18T11:02:38+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"54601","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-24 12:01:24","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 20:02:45","updated":"2026-01-24 12:01:24","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts\/54601","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/comments?post=54601"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts\/54601\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/media?parent=54601"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/categories?post=54601"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/tags?post=54601"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}