Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Aloha kākou. Aia ma lalo ka transcript hōʻike mai Big Monitoring Meetup 4.

IHILA - he ʻōnaehana kiaʻi no nā ʻōnaehana like ʻole a me nā lawelawe, me ke kōkua o nā luna hoʻonohonoho e hiki ke hōʻiliʻili i ka ʻike e pili ana i nā ʻāpana o kēia manawa o nā ʻōnaehana a hoʻonohonoho i nā mākaʻikaʻi e loaʻa i nā leka e pili ana i nā deviations i ka hana o nā ʻōnaehana.

E komo ana ka hōʻike i kahi hoʻohālikelike Thanos и VictoriaMetrics - nā papahana no ka mālama lōʻihi o nā metric Prometheus.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Play wikiō

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻO ka mea mua, e haʻi wau iā ʻoe e pili ana iā Prometheus. He ʻōnaehana nānā kēia e hōʻiliʻili ana i nā metric mai nā pahuhopu i kuhikuhi ʻia a mālama iā lākou i kahi waihona kūloko. Hiki iā Prometheus ke hoʻopaʻa i nā metric i kahi mālama mamao a hiki ke hana i nā mākaʻikaʻi a me nā lula hoʻopaʻa.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Nā palena o Prometheus:

  • ʻAʻohe manaʻo nīnau nīnau honua. ʻO kēia ka manawa i loaʻa iā ʻoe nā manawa kūʻokoʻa he nui o ka prometheus. ʻOhi lākou i nā metric. A makemake ʻoe e nīnau ma luna o kēia mau ana a pau i hōʻiliʻili ʻia mai nā manawa prometheus like ʻole. ʻAʻole ʻae ʻo Prometheus i kēia.
  • Me ka prometheus, ua kaupalena ʻia ka hana i hoʻokahi kikowaena wale nō. ʻAʻole ʻokoʻa ʻo Prometheus i nā kikowaena lehulehu. Hiki iā ʻoe ke hoʻokaʻawale lima i kāu mau pahuhopu ma waena o nā Prometheus he nui.
  • Ua kaupalena ʻia ka laulā o nā metric ma Prometheus i hoʻokahi kikowaena wale nō no ke kumu like ʻole hiki ʻole ke hoʻonui maʻalahi i nā kikowaena lehulehu.
  • ʻAʻole maʻalahi ka hoʻonohonoho ʻana i ka palekana ʻikepili ma Prometheus.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Nā pane i kēia mau pilikia/pilikia?

ʻO nā hāʻina:

ʻO kēia mau hoʻonā āpau no ka mālama mamao o ka ʻikepili i hōʻiliʻili ʻia e Prometheus. Hoʻopau lākou i ka pilikia mālama mālama mamao mai ka paheʻe mua ma nā ʻano like ʻole. Ma kēia hōʻikeʻike e kamaʻilio wale wau e pili ana i nā hopena mua ʻelua: Thanos и VictoriaMetrics.

No ka manawa mua ka ʻike e pili ana Thanos i hoikeia mai e kēia loulou. Hōʻike ʻia ka hale hoʻolālā ma laila Thanos a pehea e hana ai.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Lawe ʻo Thanos i ka ʻikepili i mālama ʻia e Prometheus i ka disk kūloko a kope iā ia i S3, i GCS a i ʻole i kahi waihona mea ʻē aʻe.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

No laila, hāʻawi ʻo Thanos i kahi ʻike nīnau nīnau honua. Hiki iā ʻoe ke nīnau i ka ʻikepili i mālama ʻia i loko o kahi waihona mea mai nā manawa Prometheus he nui.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Kākoʻo ʻo Thanos iā PromQL a Prometheus nīnau API.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Hoʻohana ʻo Thanos i ka code Prometheus e mālama i ka ʻikepili.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Hoʻokumu ʻia ʻo Thanos e nā mea hoʻomohala like me Prometheus.

maluna o VictoriaMetrics. ^ E Ha yM. Eia loulou, kahi a mākou i kamaʻilio mua ai VictoriaMetrics.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Loaʻa iā VictoriaMetrics ka ʻikepili mai kekahi mau prometheus API kākau mamao kākoʻo ʻia e Prometheus.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Hāʻawi ʻo VictoriaMetrics i kahi ʻike hulina honua, no ka mea hiki i nā manawa Prometheus ke kākau i ka ʻikepili i hoʻokahi VictoriaMetrics. No laila, hiki iā ʻoe ke hana i nā nīnau ma kēia ʻikepili āpau.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Kākoʻo pū ʻo VictoriaMetrics, e like me Thanos, PromQL a me Prometheus nīnau API.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻAʻole e like me Thanos, ua kākau ʻia ka code kumu VictoriaMetrics mai ka wā ʻōpala a hoʻopaʻa ʻia no ka wikiwiki a me ka hoʻohana waiwai.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻAʻole like ʻo VictoriaMetrics, ʻaʻole like me Thanos, nā unahi ma ka ʻaoʻao a me ka pae. ʻAi Hoʻokahi-node mana, e kau ana ma ke ala pololei. Hiki iā ʻoe ke hoʻomaka me hoʻokahi kaʻina hana a me 1 GB o ka hoʻomanaʻo a ulu mālie i nā haneli o nā kaʻina hana a me 1 TB o ka hoʻomanaʻo. Hiki iā VictoriaMetrics ke hoʻohana i kēia mau kumuwaiwai āpau. E hoʻonui ʻia kāna hana ma kahi o 100 mau manawa i hoʻohālikelike ʻia me kahi ʻōnaehana 1-core.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Ua hoʻomaka ka mōʻaukala o Thanos i Nowemapa 2017, i ka wā i ʻike ʻia ai ka hana mua o ka lehulehu. Ma mua o kēia, ua kūkulu ʻia ʻo Thanos i loko improbable.io.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

I Iune 2019 ua hoʻokuʻu ʻia kahi hōʻailona 0.5.0, kahi wehe ʻia 'ōleloʻala protocol. Ua hoʻoneʻe ʻia ʻo ia mai Thanos no ka mea ʻaʻole maikaʻi kāna hana. I ka manawa pinepine ʻaʻole i hana pololei ka pūʻulu Thanos, pili ʻole nā ​​nodes iā ia ma muli o ka protocol gossip. No laila, ua hoʻoholo mākou e wehe iā ia mai laila aku. Manaʻo wau ʻo ka hoʻoholo kūpono kēia.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Ma Iune 2019, ua hoʻouna lākou i ka helu noi 256 в Ka Papahana Hoʻonohonoho ʻInikua Kapua.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

A ma hope o kekahi mau mahina ua ʻae ʻia ʻo Thanos Ka Papahana Hoʻonohonoho ʻInikua Kapua, e komo pū ana me Prometheus, Kubernetes a me nā papahana kaulana ʻē aʻe.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

I Ianuali 2018, hoʻomaka ka hoʻomohala ʻana o VictoriaMetrics.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

I Kepakemapa 2018, ua haʻi aku au iā VictoriaMetrics no ka manawa mua.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

I Dekemaba 2018, ua paʻi ʻia kahi mana hoʻokahi node.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

I ka Mei 2019 ua paʻi ʻia nā kumu o nā mana hoʻokahi-node a me nā pūʻulu.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

I Iune 2019, e like me Thanos, ua waiho mākou i kahi noi i ke kumu CNCF ma lalo o ka helu 255. Ua noi mākou i hoʻokahi lā ma mua o ka noi ʻana o Thanos.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Akā naʻe, ʻaʻole naʻe mākou i ʻae ʻia ma laila. Pono ke kōkua kaiaulu.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

E nānā kākou i nā paheʻe koʻikoʻi e hōʻike ana i ka hoʻolālā o Thanos a me VictoriaMetrics.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

E hoʻomaka kākou me Thanos. ʻO nā mea melemele nā ​​mea Prometheus. ʻO nā mea ʻē aʻe he mau mea Thanos. E hoʻomaka kākou me ka mea nui loa. ʻO Thanos Sidecar kahi mea i hoʻokomo ʻia ma hope o kēlā me kēia Prometheus. Hoʻouka ia i ka ʻikepili Prometheus mai kahi waihona kūloko i S3 a i ʻole kahi mea mālama ʻē aʻe.

Aia kekahi ʻāpana i kapa ʻia ʻo Thanos Store Gateway, hiki ke heluhelu i kēia ʻikepili mai ka Object Storage ma nā noi komo mai Thanos Query. Hoʻohana ʻo Thanos Query i ka PromQL a me Prometheus API. ʻO ia hoʻi, mai waho mai ua like ia me Prometheus. Loaʻa i nā nīnau PromQL, hoʻouna iā lākou i Thanos Store Gateway, Thanos Store Gateway e kiʻi i ka ʻikepili pono mai Object Storage, hoʻihoʻi iā ia.

Akā, mālama mākou i ka ʻikepili ma Object Storage me ka ʻole o nā hola ʻelua i hala ma muli o kahi hiʻohiʻona o ka hoʻokō Thanos Sidecar, ʻaʻole hiki ke hoʻouka i nā hola ʻelua i hala i ka Object Storage S3, ʻoiai ʻaʻole i hoʻokumu ʻo Prometheus i nā faila no kēia mau hola ʻelua i ka mālama kūloko.

Pehea ʻoe i hoʻoholo ai e hoʻopuni i kēia? Hoʻouna ʻo Thanos Query, ma kahi o nā noi i ka Thanos Store Gateway, i nā noi like i kēlā me kēia Thanos Sidecar, aia ma ka ʻaoʻao o Prometheus.

A ʻo Thanos Sidecar, ʻo ia hoʻi, noi hou aku nā proxies iā Prometheus, a kiʻi hou i ka ʻikepili no nā hola ʻelua i hala.

Ma kahi o kēia mau ʻāpana, aia kekahi ʻāpana koho me ka ʻole e hana maikaʻi ʻo Thanos. ʻO Thanos Compact kēia, nona ke kuleana no ka hoʻohui ʻana i nā faila liʻiliʻi ma Object Storage i loko o nā faila nui i hoʻouka ʻia e Thanos Sidecars. Hoʻouka ʻo Thanos Sidecar i nā faila ʻikepili ma laila i ʻelua hola. ʻO kēia mau faila, inā ʻaʻole i hoʻohui ʻia i loko o nā faila nui, a laila hiki ke ulu nui ko lākou helu. ʻOi aku ka nui o nā faila, ʻoi aku ka nui o ka hoʻomanaʻo no Thanos Store Gateway, ʻoi aku ka nui o nā kumuwaiwai e pono ai e hoʻoili i ka ʻikepili ma luna o ka pūnaewele a me ka metadata. Ua lilo ʻo Thanos Store Gateway i mea ʻole. No laila, pono e holo iā Thanos Compact, ka mea e hoʻohui i nā faila liʻiliʻi i nā faila nui, i emi iho ai nā faila a e hōʻemi i ke poʻo o ka Thanos Store Gateway.

Aia kekahi ʻāpana e like me Thanos Ruler. Hoʻokō ʻo ia i nā lula makaʻala Prometheus a hiki ke loiloi i nā lula hoʻopaʻa palapala Prometheus i mea e kākau ai i ka ʻikepili i ka Waihona Mea. Akā ʻaʻole ʻōlelo ʻia kēia ʻāpana e hoʻohana, no ka mea ... He e hoʻihoʻi i ka ʻikepili piha ʻole.

ʻO kēia ka papahana maʻalahi o Thanos.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

I kēia manawa e hoʻohālikelike kākou me ka hoʻolālā VictoriaMetrics.

Loaʻa iā VictoriaMetrics he 2 mana: Single-node a me ka cluster version. Holo hoʻokahi node ma hoʻokahi kamepiula. ʻAʻole loaʻa kēia mau ʻāpana node hoʻokahi, hoʻokahi wale nō binary. Ua like ke ʻano o kēia binary ma ka paheʻe me kēia huinahā. ʻO nā mea a pau i loko o ka huinahā nā mea o ka waihona binary no ka mana Single-node. ʻAʻole pono ʻoe e ʻike e pili ana iā ia. Holo wale ʻoe i ka binary a hana nā mea āpau iā mākou.

ʻOi aku ka paʻakikī o ka mana cluster. Aia i loko o ia mea he ʻekolu mau mea like ʻole: vmselect, vminsert a me vmstorage. Mai ko lākou inoa e maopopo ai ka hana a kēlā me kēia o lākou. ʻAe ka ʻāpana Insert i ka ʻikepili ma nā ʻano like ʻole: mai ka Prometheus remote write API, ka Influx line protocol, ka Graphite protocol a me ka OpenTSDB protocol. E ʻae ka ʻāpana Insert iā lākou, e hoʻokaʻawale iā lākou a puʻunaue iā lākou ma waena o nā ʻāpana mālama i kēia manawa, kahi i mālama ʻia ai ka ʻikepili. ʻO ka mea koho, ʻae, ʻae i nā nīnau PromQL. Hoʻokō ʻo ia PromQL, a me ka Prometheus querying API, a hiki ke hoʻohana ʻia ma ke ʻano he pani no Prometheus ma Grafana a i ʻole nā ​​mea kūʻai aku Prometheus API. E ʻae ʻo Select i kahi noi promql, hoʻopau iā ia, heluhelu i ka ʻikepili e pono ai no ka hoʻokō ʻana i kēia noi mai nā nodes mālama, e hoʻoili i kēia ʻikepili a hoʻihoʻi i kahi pane.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

E hoʻohālikelike kākou i ka paʻakikī o ka hoʻokomo ʻana iā Thanos a me VictoriaMetrics.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

E hoʻomaka kākou me Thanos. Ma mua o kou hoʻomaka ʻana e hana pū me Thanos, pono ʻoe e hana i kahi bākeke ma Object Storage, e like me S3 a i ʻole GCS, i hiki iā Thanos Sidecar ke kākau i ka ʻikepili iā ia.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

A laila no kēlā me kēia Prometheus pono ʻoe e hoʻokomo iā Thanos Sidecar. Ma mua o kēia, pono ʻoe e hoʻomanaʻo e hoʻopau i ka compaction data ma Prometheus. Hoʻopili ka ʻikepili i kēlā me kēia manawa i ka ʻikepili i loko o ka waihona Prometheus kūloko i mea e hōʻemi ai i ka hoʻohana waiwai.

Ke hoʻokomo ʻoe iā Thanos Sidecar ma kāu Prometheus, pono ʻoe e hoʻopau i kēia compaction data, no ka mea, ʻaʻole hana pono ʻo Thanos Sidecar me ka hoʻopili ʻana i ka ʻikepili. ʻO ia hoʻi, hoʻomaka kāu Prometheus e mālama i ka ʻikepili i loko o nā poloka ʻelua hola a hoʻōki i ka hoʻohui ʻana i kēlā mau poloka i nā mea nui. No laila, inā e hana ʻoe i nā nīnau i ʻoi aku ma mua o ka lōʻihi o nā hola ʻelua i hala, a laila ʻaʻole e hana maikaʻi lākou e like me ka hana inā hiki ke hoʻopili ʻia ka ʻikepili.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

No laila, paipai ʻo Thanos e hoʻemi i ka manawa paʻa o ka ʻikepili i ka mālama kūloko i 6-8 mau hola i mea e hōʻemi ai i ke poʻo o ka nui o nā poloka liʻiliʻi.

Ke hoʻokomo ʻoe iā Thanos Sidecar, pono ʻoe e hoʻokomo i ʻelua mau ʻāpana no kēlā me kēia Bike Kūʻai. ʻO kēia ʻo Thanos Compactor a me Thanos Store Gateway.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Ma hope o kēlā, pono ʻoe e hoʻokomo iā Thanos Query a hoʻonohonoho iā ia i hiki iā ia ke hoʻopili i nā Gateways Store āpau o Thanos i loaʻa iā ʻoe, a hiki ke hoʻopili pū i nā Thanos Sidecars āpau.

He pilikia iki paha ma ʻaneʻi.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Pono ʻoe e hoʻonohonoho i kahi pilina hilinaʻi a paʻa mai Thanos Query i kēia mau ʻāpana. A inā loaʻa kāu Prometheus ma nā kikowaena ʻikepili like ʻole, a i ʻole ma nā VPC like ʻole, a laila pāpā ʻia nā pilina iā lākou mai waho. Akā no ka hana ʻana o Thanos Query, pono ʻoe e hoʻonohonoho i ka pilina ma laila, a pono ʻoe e noʻonoʻo i kahi ala.

Inā he nui kāu mau kikowaena data, a laila, e emi iho ka hilinaʻi o ka ʻōnaehana holoʻokoʻa. No ka mea, pono e mālama mau ʻo Thanos Query i nā pilina i nā Thanos Sidecars āpau i loaʻa ma nā kikowaena ʻikepili like ʻole. No kēlā me kēia noi e hiki mai ana, e hoʻouna i nā noi i nā Thanos Sidecars āpau. Inā hoʻopau ʻia ka pilina, e loaʻa iā ʻoe kahi ʻikepili piha ʻole, a i ʻole e loaʻa iā ʻoe kahi pane "cluster is down".

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Ma VictoriaMetrics ua maʻalahi nā mea a pau. No ka mana Single-node, pono ʻoe e holo i hoʻokahi binary a hana nā mea āpau.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

I loko o ka mana cluster, ua lawa ia e holo i nā ʻano ʻano ʻekolu o luna i kēlā me kēia nui āu e pono ai, a hoʻohana paha palapala hoʻokele e hoʻokaʻawale i ka hoʻomaka ʻana o nā ʻāpana ma Kubernetes. Hoʻolālā pū mākou e hana i kahi mea hoʻohana Kubernetes. ʻAʻole uhi ka pakuhi Helm i kekahi mau hihia a hiki iā ʻoe ke pana iā ʻoe iho ma ka wāwae. No ka laʻana, hiki iā ʻoe ke hōʻemi i ka helu o nā nodes mālama, e alakaʻi i ka nalowale o ka ʻikepili.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Ma hope o kou hoʻokuʻu ʻana i hoʻokahi binary a i ʻole kahi clustered version, pono ʻoe e hoʻohui iā Prometheus i ka config hoʻonohonoho no ka url kākau mamaono laila e hoʻomaka ai e kākau i ka ʻikepili e like me ka mālama kūloko a me ka waiho mamao. E like me kāu e ʻike ai, pono e hana kēia hoʻonohonoho i ʻoi aku ka hilinaʻi ma mua o ka hoʻonohonoho Thanos. ʻAʻole pono mākou e mālama i kahi pilina mai VictoriaMetrics i nā Prometheus a pau, no ka mea, pili ʻo Prometheus iā VictoriaMetrics a hoʻouna i ka ʻikepili.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

E noʻonoʻo kākou i ke kākoʻo o Thanos a me VictoriaMetrics.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Pono ʻo Thanos e nānā iā Sidecar e hōʻoia ʻaʻole lākou e hoʻōki i ka hoʻouka ʻana i ka ʻikepili i loko o ka Object Storage. Hiki iā lākou ke ho'ōki i kēia hoʻoiho ʻikepili ma muli o ka hoʻoiho ʻana i nā hewa, no ka laʻana, ua hoʻopau ʻia kāu pilina pūnaewele i ka Object Storage, a i ʻole ka loaʻa ʻole o ka Object Storage. E ʻike ʻo Thanos Sidecar i kēia manawa, hōʻike i kahi hewa, hāʻule paha a pau ka hana. Inā ʻaʻole ʻoe e nānā iā ia, a laila e hoʻōki ʻoe i ka hoʻoili ʻana i ka ʻikepili i ka Object Storage. Inā hala ka manawa paʻa (6-8 mau hola i manaʻo ʻia), a laila e nalowale ʻoe i ka ʻikepili i pau ʻole i ka Object Storage.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Hiki i nā mea hoʻopili Thanos ke hoʻōki i ka hana ma muli o heihei me Sidecar. Lawe nā Compactor i ka ʻikepili mai Object Storage a hoʻohui iā ia i loko o nā ʻāpana nui o ka ʻikepili. No ka mea, ʻaʻole i hui pū ʻia nā mea hoʻopaʻa me Sidecars, hiki ke hana ʻia kēia: ʻAʻole i loaʻa i ka Sidecar ka manawa e hoʻopau ai i ka poloka, ua hoʻoholo ʻo Compactor ua kākau piha ʻia kēia poloka. Hoʻomaka ʻo Compactor e heluhelu iā ia. ʻAʻole ia e heluhelu piha i ka poloka a pau ka hana. E ʻike i nā kikoʻī maanei.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Hiki i ka Store Gateway ke hoʻihoʻi i ka ʻikepili like ʻole ma muli o nā heihei ma waena o Compactor a me Sidecars. Hana ʻia ka mea like ma ʻaneʻi, no ka mea, ʻaʻole i hui pū ʻia ka Store Gateway me Compactors a me Sidecars ma kekahi ʻano. No laila, hiki ke kūlana lāhui ke ʻike ʻole ka Store Gateway i kahi ʻāpana o ka ʻikepili a ʻike paha i ka ʻikepili pono ʻole.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻO ka ʻāpana Query ma Thanos ma ka paʻamau e hoʻihoʻi i kahi hopena ʻāpana inā ʻaʻole i loaʻa kekahi mau Sidecars a i ʻole Store Gateways i kēia manawa. E loaʻa iā ʻoe kahi hapa o ka ʻikepili, a ʻaʻole ʻoe e ʻike ʻaʻole i loaʻa iā ʻoe nā ʻikepili āpau. Penei ka hana ma ka paʻamau. Ma kahi kūlana like, hoʻihoʻi ʻo VictoriaMetrics i ka ʻikepili i kaha ʻia ma ke ʻano he hapa.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻAʻole like me Thanos, ʻaʻole i nalowale ʻo VictoriaMetrics i ka ʻikepili. ʻOiai ke hoʻopau ʻia ka pilina mai Prometheus iā VictoriaMetrics, ʻaʻole ia he pilikia, no ka mea, hoʻomau ʻo Prometheus i ka hoʻopaʻa ʻana i nā ʻikepili hou i loko o ka Write Ahead Log, ʻo ia ka nui o 2 mau hola. Inā hoʻihoʻi ʻoe i kāu pilina iā VictoriaMetrics i loko o ʻelua mau hola, ʻaʻole e nalowale kāu ʻikepili. Prometheus hiki ke hoʻohui i ka ʻikepili ma hope o ka hoʻihoʻi ʻana i ka pilina me VictoriaMetrics.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻAʻole like me Thanos, ka mea kākau i ka ʻikepili i ka waiho ʻana i nā mea wale nō ma hope o ʻelua mau hola, e hoʻopiʻi ʻo Prometheus i ka ʻikepili me ka hoʻohana ʻana i ka protocol kākau mamao i kahi mālama mamao, e like me VictoriaMetrics. ʻAʻole ʻoe makaʻu i ka nalowale ʻana o ka mālama kūloko ma Prometheus. Inā nalowale koke ʻo ia i kahi mālama kūloko, a laila ma ka hihia ʻoi loa e nalowale ʻoe i nā kekona hope loa o ka ʻikepili i loaʻa ʻole ka manawa e hoʻopaʻa ʻia i kahi mālama mamao.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Mālama ʻo Kubernetes i ka pūʻulu, ʻaʻole like me Thanos. He mea paʻakikī ke hoʻokomo i nā ʻāpana Thanos a pau i loko o ka pūʻulu Kubernetes hoʻokahi, ʻaʻole like me nā ʻāpana cluster VictoriaMetrics.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

He mea maʻalahi loa ka VictoriaMetrics i ka mana hou. Hoʻopau wale iā VictoriaMetrics, hoʻohou i nā binaries a hoʻomaka. Ke hooki ʻia ma ka hōʻailona SIGINT, hana nā binaries VictoriaMetrics āpau i kahi pani maikaʻi. Mālama pono lākou i ka ʻikepili e pono ai, hoʻopaʻa pololei i nā pilina komo i ʻole e nalowale kekahi mea. No laila ʻaʻole ʻoe e nalowale i kekahi mea ke hoʻonui.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻO VictoriaMetrics he mea maʻalahi loa ka hoʻonui ʻana i kahi pūʻulu. Hoʻohui wale i nā mea pono a hoʻomau i ka hana.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

E pili ana i nā lua ma Thanos a me VictoriaMetrics.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Loaʻa iā Thanos nā pitfalls. Pono ʻo Prometheus e mālama i ka ʻikepili no nā hola ʻelua i hala. Inā nalowale lākou, e nalowale loa ana iā ʻoe no ka mea ʻaʻole lākou i kākau ʻia i ka Object Storage e like me S3.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Hiki i ka ʻāpana Store Gateway a me ka mea compactor ke koi i ka nui o ka hoʻomanaʻo e hana me kahi waihona mea nui inā nui nā faila liʻiliʻi i mālama ʻia ma laila. ʻOi aku ka nui a me ka nui o nā faila, ʻoi aku ka nui o ka Store Gateway a me ka compactor RAM e pono ai e mālama i ka metainformation. He nui nā pilikia o Thanos e pili ana i kēlā Kūʻai ʻo Gateway a me ka mea hoʻopaʻa paʻa me ka nui o nā ʻikepili i hoʻopaʻa ʻia.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Hoʻolaha ʻia ʻo Thanos e hoʻonui mau ʻia me ka nui o Prometheus iā ʻoe. ʻAʻole ʻoiaʻiʻo kēia. No ka hele ʻana o nā noi a pau ma ka ʻāpana Query, pono e koho i nā ʻāpana āpau o Store Gateway a me nā ʻāpana Sidecar a pau, e huki i ka ʻikepili mai laila a laila e hoʻoponopono mua. ʻIke loa, ua kaupalena ʻia ka wikiwiki o ka noi e ka loulou nāwaliwali loa, ʻo ka hale kūʻai lohi a i ʻole ka Sidecar lohi.

Hiki ʻole ke hoʻouka ʻia kēia mau ʻāpana. No ka laʻana, loaʻa iā ʻoe Prometheus, ka mea e hōʻiliʻili i nā miliona o nā metric i kēlā me kēia kekona. A aia ʻo Prometheus, nāna e hōʻiliʻili i nā kaukani metric i kekona. ʻO Prometheus, ka mea e hōʻiliʻili ai i nā miliona o nā metric i kēlā me kēia kekona, kau i ka ukana ʻoi aku ka kiʻekiʻe ma ke kikowaena e holo nei. No laila, ʻoi aku ka lohi o Sidecar ma laila. A ma ka laulā, hana mālie nā mea a pau ma laila. A e huki mālie ka ʻāpana Query i ka ʻikepili mai laila mai. No laila, e kaupalena ʻia ka hana o kāu hui āpau e kēia Sidecar lohi.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Ma ka maʻamau, hāʻawi ʻo Thanos i ka ʻikepili hapa inā ʻaʻole i loaʻa kekahi mau Sidecars a me ka hale kūʻai Gateway. No ka laʻana, inā hoʻopuehu ʻia kāu Sidecar a puni ka honua i nā kikowaena ʻikepili like ʻole, a laila e piʻi nui ana ka hiki ʻole o ka hoʻopili ʻana a me ka loaʻa ʻole o nā mea. No laila, i ka hapanui o nā hihia, e loaʻa iā ʻoe ka ʻikepili hapa me ka ʻike ʻole.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Loaʻa iā VictoriaMetrics nā pitfalls. ʻO ka pitfall mua ke koho e kaupalena ana i ka nui o ka RAM i hoʻohana ʻia no ka cache VictoriaMetrics. Ma ka maʻamau, ua like ia me 60% o ka RAM ma ka mīkini kahi e holo ai ʻo VictoriaMetrics a i ʻole 60% o ka RAM o ka VictoriaMetrics pod ma Kubernetes.

Inā hoʻololi hewa ʻoe i kēia waiwai, hiki iā ʻoe ke hōʻino i ka hana o VictoriaMetrics. No ka laʻana, inā hoʻonoho ʻoe i ka waiwai haʻahaʻa loa, ʻaʻole hiki ke komo hou ka ʻikepili i loko o ka waihona ʻo VictoriaMetrics. Ma muli o kēia, pono ʻo ia e hana i nā hana ʻē aʻe a hoʻouka i ka mea hana a me ka disk. Inā ʻoe e hana i kēia koho nui loa, hoʻonui ia, ʻo ka mea mua, ka likelihood e hāʻule ʻo VictoriaMetrics me kahi hewa o ka hoʻomanaʻo ʻana, a, ʻo ka lua, e alakaʻi ia i ka ʻoiaʻiʻo he liʻiliʻi loa ka RAM i koe i ka hoʻomanaʻo ʻana o ka ʻōnaehana hana. waihona waihona. A hilinaʻi ʻo VictoriaMetrics i kahi waihona waihona no ka hana. Inā ʻaʻole lawa, hiki ke hoʻonui nui ka ukana ma ka disk. No laila, ʻōlelo aʻoaʻo: mai hoʻololi i ka palena ke ʻole pono.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Koho lua. ʻO kēia ka retentionPeriod - kahi manawa i hoʻonohonoho ʻia i 1 mahina ma ke ʻano paʻamau. ʻO kēia ka lōʻihi o ka manawa e mālama ai ʻo VictoriaMetrics i ka ʻikepili. Ma hope o kēia manawa, holoi ʻo VictoriaMetrics i ka ʻikepili.

Nui ka poʻe e holo i VictoriaMetrics me ka ʻole o kēia ʻāpana a hoʻopaʻa i ka ʻikepili no hoʻokahi mahina. A laila nīnau lākou: no ke aha i nalowale ai ka ʻikepili no ka mahina i hala? No ka mea, ʻo 1 mahina ka manawa paʻa paʻa. No laila, pono ʻoe e ʻike a hoʻonohonoho i ka manawa mālama pono.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

E nānā kākou i nā hiʻohiʻona kūikawā.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Loaʻa iā Thanos kahi hiʻohiʻona i kapa ʻia ʻo downsampling: 5 mau minuke a me nā hola hola, ʻo ia ka mea pinepine hana pono ole. Inā ʻoe e google a nānā i kā lākou pilikia ma ka github, nui nā pilikia e pili ana i kēia downsampling, ʻaʻole ia e hana pololei i kekahi manawa, a ʻaʻole hana e like me ka manaʻo o nā mea hoʻohana.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Loaʻa iā Thanos ka unuhi ʻikepili no nā pālua Prometheus HA. Ke hōʻiliʻili ʻelua Prometheus i nā metric like mai nā pahuhopu like a mālama ʻo Thanos iā lākou i ka Object Storage. Hiki iā Thanos ke unuhi pono i kēia ʻikepili, ʻaʻole like me VictoriaMetrics.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Loaʻa iā Thanos kahi mea makaʻala i loko o ka schematic Thanos. Akā ʻo ia ʻaʻole ʻōlelo ʻia no ka hoʻohana ʻana i ka hana.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Loaʻa iā Thanos ka pōmaikaʻi i kaʻana like ʻo Thanos lāua ʻo Prometheus i ka code like. Hoʻokumu ʻia ʻo Thanos a me Prometheus e nā mea hoʻomohala like. Me ka hoʻomaikaʻi ʻana iā Thanos a i ʻole Prometheus, lanakila ka ʻaoʻao ʻē aʻe.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻO ka hiʻohiʻona nui o VictoriaMetrics ʻo MetricsQL. ʻO kēia nā mea hoʻonui VictoriaMetrics no PromQL, aʻu i kamaʻilio ai ma ka meup nānā nui ma mua.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Kākoʻo ʻo VictoriaMetrics i ka hoʻouka ʻana i ka ʻikepili me ka hoʻohana ʻana i nā protocol like ʻole. ʻAʻole hiki i VictoriaMetrics ke ʻae wale i ka ʻikepili mai Prometheus, akā ma o ka Influx, OpenTSDB a me Graphite protocols.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻOi aku ka liʻiliʻi o ka ʻikepili VictoriaMetrics ma mua o Thanos a me Prometheus.

Inā hoʻopaʻa ʻoe i ka ʻikepili maoli, kamaʻilio nā mea hoʻohana e pili ana i ka hōʻemi ʻana o 2-5 mau manawa i ka nui o ka ʻikepili ma ka disk i hoʻohālikelike ʻia me Prometheus a me Thanos.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻO kekahi pono ʻē aʻe o VictoriaMetrics ʻo ia ka mea i hoʻopaʻa ʻia no ka wikiwiki.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

E nānā kākou i ke kumukūʻai o ka ʻoihana.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

ʻO kekahi o nā mea maikaʻi o Thanos ʻo ia ka mālama ʻana i ka ʻikepili i loko o ka waiho ʻana i nā mea, ʻoi aku ka maʻalahi.

I ka wā e mālama ai i ka ʻikepili i loko o ka waihona mea, pono ʻoe e uku no ka ʻikepili kākau a heluhelu i nā hana ($10 no ka miliona mau hana). Ke kākau ʻoe i ka ʻikepili i ka waiho ʻana mea, uku ʻoe i kāu koina hoʻokipa no ka hoʻouka ʻana i ka ʻikepili i ka Pūnaewele; inā ʻaʻole kāu hui i AWS, manuahi ia ma laila. Ke heluhelu ʻoe i ka ʻikepili, uku ʻoe ma waena o $10 a me $230 no 1TB. He mea koʻikoʻi kēia inā e nīnau pinepine ʻoe i ka ʻikepili mōʻaukala mai ka pūʻulu Thanos.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

No kahi pūʻulu Thanos, pono ʻoe e uku no nā kikowaena no Compact, Store Gateway, nā ʻāpana Query e koi nui i ka hoʻomanaʻo, a me ka CPU no ka nui o ka ʻikepili.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Loaʻa iā VictoriaMetrics nā lilo aʻe. Inā mālama ʻoe i ka ʻikepili ma nā drive GCE HDD, a laila e puka mai i $40 no 1TB. No VictoriaMetrics, ua lawa nā drive HDD maʻamau; ʻaʻohe SSD, ʻoi aku ka nui o ʻelima mau manawa. Hoʻolālā ʻia ʻo VictoriaMetrics no HDD.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Pono ʻo VictoriaMetrics i nā kikowaena no nā ʻāpana: ʻo nā ʻāpana hoʻokahi a i ʻole nā ​​ʻāpana clustered, ʻaʻole like me nā ʻāpana Thanos, koi ʻoi aku ka liʻiliʻi o ka CPU a me ka RAM - a e ʻoi aku ka maʻalahi.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Nā laʻana o ka hoʻokō.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Loaʻa iā Thanos kahi hiʻohiʻona hoʻokō ma Gitlab. Holo holoʻokoʻa ʻo Gitlab ma Thanos. Akā ʻaʻole maʻalahi nā mea a pau ma laila. Inā ʻoe e nānā iā lākou helu, a laila hiki iā ʻoe ke ʻike e loaʻa mau iā lākou kekahi nā pilikia hana me Thanos: ʻAʻole lawa ka hoʻomanaʻo no ka Store Gateway a i ʻole nā ​​ʻāpana Query. Pono lākou e hoʻonui i ka nui o ka hoʻomanaʻo.

Ma muli o kēia, hoʻonui nā kumukūʻai no ka hoʻoponopono ʻana i kēia mau pilikia.

ʻO ka lua o ka hoʻokō ʻana, ʻoi aku ka maikaʻi o ka ʻoihana ʻo Improbable, i hoʻomaka e hoʻomohala iā Thanos. Ua hoʻopuka lākou i ka code source Thanos. ʻO Improbable kahi hui e hoʻomohala ana i nā mīkini pāʻani.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Loaʻa iā VictoriaMetrics nā hiʻohiʻona hoʻokō lehulehu:

  • wix.com mea hana pūnaewele
  • Ke hoʻokō nei ʻo Adidas iā VictoriaMetrics a ua hana ʻo ia i kahi hōʻike ma ka PromCon 2019 hope loa
  • TrafficStars - pūnaewele hoʻolaha
  • ʻO Seznam.cz kahi ʻenekini hulina Czech kaulana.

A laila ʻaʻohe ʻoihana inoa ʻaʻole hiki iaʻu ke inoa i kēia manawa. ʻAʻole lākou i ʻae.

  • Hoʻokahi mea hoʻomohala pāʻani nui. Nui aʻe ma mua o im Improbable.
  • Mea haku polokalamu kiʻi nui.
  • Pākē Lūkini nui.
  • Ua ho'āʻo maikaʻi ʻia ʻo VictoriaMetrics ka mea hana ʻenehana makani ʻEulopa. Ke hoʻokō nei kēia mea hana iā VictoriaMetrics e nānā i ka ʻikepili i hōʻiliʻili ʻia mai nā turbines makani ma ka wikiwiki o 50 mau laʻana i kēlā me kēia kekona. Loaʻa i kēlā me kēia mīkini makani makani he mau haneli mau mea ʻike. He mau haneli makani makani ko lākou.
  • ʻO nā mokulele Lūkini makemake e hoʻokō i VictoriaMetrics, akā ʻaʻole hiki. Aia mākou ma ke kahua ʻaelike me lākou.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetricsNā hopena.

Hoʻoponopono ʻo VictoriaMetrics a me Thanos i nā pilikia like, akā ma nā ʻano like ʻole:

  • Nānā hulina honua
  • hoʻopaʻa ʻia ʻana
  • hoʻopaʻa ʻole ʻia

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Спасибо.

Ke kali nei mākou iā ʻoe ma kā mākou kaila telegrama.

Ke koho ʻana i kahi mālama ʻikepili no Prometheus: Thanos vs VictoriaMetrics

Hiki i nā mea hoʻohana i hoʻopaʻa inoa ʻia ke komo i ka noiʻi. Eʻe, e 'oluʻolu.

He aha kāu e hoʻohana ai i kahi mālama lōʻihi no Prometheus?

  • 35,3%ʻO Thanos6

  • 0,0%Kokoko0

  • 0,0%M3DB0

  • 41,2%VictoriaMetrics7

  • 23,5%'ē aʻe4

17 mea hoʻohana i koho. Ua hōʻole nā ​​mea hoʻohana 16.

Source: www.habr.com

E kūʻai i ka hoʻokipa hilinaʻi no nā pūnaewele me ka pale DDoS, nā kikowaena VPS VDS 🔥 E kūʻai i ka hoʻokipa pūnaewele hilinaʻi me ka pale DDoS, nā kikowaena VPS VDS | ProHoster