ããã«ã¡ã¯ãã¿ããªã 以äžã¯è»¢åã§ã
ã¬ããŒãã«ã¯æ¯èŒãå«ãŸããŸã
ãŸãã¯ããã¡ããŠã¹ã«ã€ããŠã話ããŸãã ããã¯ãæå®ãããã¿ãŒã²ããããã¡ããªã¯ã¹ãåéããããŒã«ã« ã¹ãã¬ãŒãžã«ä¿åããç£èŠã·ã¹ãã ã§ãã Prometheus ã¯ãã¡ããªã¯ã¹ããªã¢ãŒã ã¹ãã¬ãŒãžã«èšé²ããã¢ã©ãŒããšèšé²ã«ãŒã«ãçæã§ããŸãã
ããã¡ããŠã¹ã®å¶é:
- ã°ããŒãã« ã¯ãšãª ãã¥ãŒã¯ãããŸããã ããã¯ãprometheus ã®ç¬ç«ããã€ã³ã¹ã¿ã³ã¹ãè€æ°ããå Žåã§ãã 圌ãã¯ã¡ããªã¯ã¹ãåéããŸãã ãããŠãããŸããŸãªããã¡ããŠã¹ ã€ã³ã¹ã¿ã³ã¹ããåéãããããããã¹ãŠã®ã¡ããªã¯ã¹ã«åºã¥ããŠã¯ãšãªãå®è¡ããããšèããŠããŸãã ããã¡ããŠã¹ã¯ãããèš±ããŸããã
- prometheus ã§ã¯ãããã©ãŒãã³ã¹ã¯ XNUMX ã€ã®ãµãŒããŒã®ã¿ã«å¶éãããŸãã Prometheus ã¯ãè€æ°ã®ãµãŒããŒéã§èªåçã«ã¹ã±ãŒã«ããŸããã ã¿ãŒã²ãããè€æ°ã® Prometheus éã§æåã§ã®ã¿åå²ã§ããŸãã
- Prometheus ã®ã¡ããªã¯ã¹ã®ç¯å²ã¯ãè€æ°ã®ãµãŒããŒã«ããã£ãŠèªåçã«æ¡åŒµã§ããªãã®ãšåãçç±ã§ãXNUMX ã€ã®ãµãŒããŒã®ã¿ã«å¶éãããŸãã
- Prometheus ã§ããŒã¿ã®å®å šæ§ãæŽçããã®ã¯ããã»ã©ç°¡åã§ã¯ãããŸããã
ãããã®åé¡/課é¡ã®è§£æ±ºçã¯ãããŸãã?
解決çã¯æ¬¡ã®ãšããã§ãã
ãããã®ãœãªã¥ãŒã·ã§ã³ã¯ãã¹ãŠãPrometheus ã«ãã£ãŠåéãããããŒã¿ã®ãªã¢ãŒã ã¹ãã¬ãŒãžçšã§ãã åã®ã¹ã©ã€ãã§ç€ºãããªã¢ãŒã ã¹ãã¬ãŒãžã®åé¡ãããŸããŸãªæ¹æ³ã§è§£æ±ºããŸãã ãã®ãã¬ãŒã³ããŒã·ã§ã³ã§ã¯ãæåã® XNUMX ã€ã®ãœãªã¥ãŒã·ã§ã³ã«ã€ããŠã®ã¿èª¬æããŸãã
åããŠã®æ
å ±ãšããŠã¯ã
Thanos ã¯ãPrometheus ãããŒã«ã« ãã£ã¹ã¯ã«ä¿åããããŒã¿ãååŸããS3 ã«ã³ããŒããŸãã
ãããã£ãŠãThanos ã¯ã°ããŒãã« ã¯ãšãª ãã¥ãŒãæäŸããŸãã è€æ°ã® Prometheus ã€ã³ã¹ã¿ã³ã¹ãããªããžã§ã¯ã ã¹ãã¬ãŒãžã«ä¿åãããŠããããŒã¿ãã¯ãšãªã§ããŸãã
Thanos 㯠PromQL ããµããŒãããŠããã
Thanos 㯠Prometheus ã³ãŒãã䜿çšããŠããŒã¿ãä¿åããŸãã
Thanos 㯠Prometheus ãšåãéçºè ã«ãã£ãŠéçºãããŠããŸãã
ãªã³
VictoriaMetrics ã¯è€æ°ã®ããã¡ããŠã¹ããããŒã¿ãåä¿¡ããŸã
VictoriaMetrics ã¯ãè€æ°ã® Prometheus ã€ã³ã¹ã¿ã³ã¹ã XNUMX ã€ã® VictoriaMetrics ã«ããŒã¿ãæžã蟌ãããšãã§ãããããã°ããŒãã« ã¯ãšãª ãã¥ãŒãæäŸããŸãã ãããã£ãŠããã®ãã¹ãŠã®ããŒã¿ã«å¯ŸããŠã¯ãšãªãå®è¡ã§ããŸãã
VictoriaMetrics ã¯ãThanos ãšåæ§ãPromQLãPrometheus ã¯ãšãª API ããµããŒãããŠããŸãã
Thanos ãšã¯ç°ãªããVictoriaMetrics ã®ãœãŒã¹ ã³ãŒãã¯æåããæžãããŠãããé床ãšãªãœãŒã¹æ¶è²»ãèæ ®ããŠæé©åãããŠããŸãã
VictoriaMetrics ã¯ãThanos ãšã¯ç°ãªããåçŽæ¹åãšæ°Žå¹³æ¹åã®äž¡æ¹ã«ã¹ã±ãŒãªã³ã°ããŸãã é£ã¹ã
Thanos ã®æŽå²ã¯ãæåã®å
¬éã³ããããç»å Žãã 2017 幎 XNUMX æã«å§ãŸããŸããã ãã以åãThanos ã¯ç€Ÿå
ã§éçºãããŠããŸãã
2019 幎 0.5.0 æã«ç»æçãªãªãªãŒã¹ XNUMX ããªãªãŒã¹ãããŸããã
åã2019幎XNUMXæã«ã圌ãã¯ç³è«çªå·ãéä¿¡ããŸãã
ãããŠæ°ãæåŸããµãã¹ã¯
2018 幎 XNUMX æã« VictoriaMetrics ã®éçºãå§ãŸããŸããã
2018 幎 XNUMX æã«ãç§ã¯ VictoriaMetrics ã«ã€ããŠåããŠå ¬ã®å Žã§èšåããŸããã
2018 幎 XNUMX æã«ãåäžããŒã ããŒãžã§ã³ãå ¬éãããŸããã
5æã«2019
2019幎XNUMXæããµãã¹ãšåæ§ã«ãç§ãã¡ã¯CNCF財å£ã«æ¬¡ã®çªå·ã§ç³è«æžãæåºããŸããã
ããããæ®å¿µãªãããç§ãã¡ã¯ãŸã ããã«åãå ¥ããããŠããŸããã ã³ãã¥ããã£ã®å©ããå¿ èŠã§ãã
Thanos ãš VictoriaMetrics ã®ã¢ãŒããã¯ãã£ã瀺ãæãéèŠãªã¹ã©ã€ããèŠãŠã¿ãŸãããã
ãµãã¹ããå§ããŸãããã é»è²ã®ã³ã³ããŒãã³ã㯠Prometheus ã³ã³ããŒãã³ãã§ãã ãã以å€ã¯ãã¹ãŠThanosã®ã³ã³ããŒãã³ãã§ãã æãéèŠãªã³ã³ããŒãã³ãããå§ããŸãããã Thanos Sidecar ã¯ããã¹ãŠã® Prometheus ã®é£ã«ã€ã³ã¹ããŒã«ãããã³ã³ããŒãã³ãã§ãã Prometheus ããŒã¿ãããŒã«ã« ã¹ãã¬ãŒãžãã S3 ãŸãã¯å¥ã®ãªããžã§ã¯ã ã¹ãã¬ãŒãžã«ããŒãããŸãã
Thanos Store Gateway ãšåŒã°ããã³ã³ããŒãã³ãããããThanos Query ããã®ãªã¯ãšã¹ããåä¿¡ãããšããªããžã§ã¯ã ã¹ãã¬ãŒãžãããã®ããŒã¿ãèªã¿åãããšãã§ããŸãã Thanos Query 㯠PromQL ãš Prometheus API ãå®è£ ããŠããŸãã ã€ãŸããå€ããèŠããšããã¡ããŠã¹ã®ããã«èŠããŸãã PromQL ã¯ãšãªãåä¿¡ããŠââ Thanos Store Gateway ã«éä¿¡ããThanos Store Gateway ããªããžã§ã¯ã ã¹ãã¬ãŒãžããå¿ èŠãªããŒã¿ãååŸããŠéãè¿ããŸãã
ãã ããThanos Sidecar å®è£ ã®æ©èœã«ãããæåŸã® 3 æéãé€ã㊠Object Storage ã«ããŒã¿ãä¿åããŸããããã¯ãPrometheus ãããŒã«ã« ã¹ãã¬ãŒãžã«ãã® XNUMX æéã®ãã¡ã€ã«ããŸã äœæããŠããªããããæåŸã® XNUMX æéã Object Storage SXNUMX ã«ã¢ããããŒãã§ããŸããã
ãããã©ããã£ãŠåé¿ããããšæ±ºããã®ã§ããïŒ Thanos Query ã¯ãThanos Store Gateway ãžã®ãªã¯ãšã¹ãã«å ããŠãPrometheus ã®é£ã«ããå Thanos ãµã€ãã«ãŒã«äžŠè¡ãªã¯ãšã¹ããéä¿¡ããŸãã
ãããŠãThanos Sidecar ã¯ããã«ãªã¯ãšã¹ãã Prometheus ã«ãããã·ããéå» XNUMX æéã®ããŒã¿ãååŸããŸãã
ãããã®ã³ã³ããŒãã³ãã«å ããŠãThanos ãé©åã«åäœããªããªãã·ã§ã³ã®ã³ã³ããŒãã³ãããããŸãã ãã㯠Thanos Compact ã§ããªããžã§ã¯ã ã¹ãã¬ãŒãžäžã®å°ããªãã¡ã€ã«ããThanos Sidecars ã«ãã£ãŠããã«ã¢ããããŒãããã倧ããªãã¡ã€ã«ã«ããŒãžãã圹å²ãæãããŸãã Thanos Sidecar ã¯ããã« XNUMX æéã§ããŒã¿ ãã¡ã€ã«ãã¢ããããŒãããŸãã ãããã®ãã¡ã€ã«ã¯ããã倧ããªãã¡ã€ã«ã«ããŒãžãããªãå Žåããã®æ°ãå€§å¹ ã«å¢å ããå¯èœæ§ããããŸãã ãã®ãããªãã¡ã€ã«ãå¢ãããšãThanos Store Gateway ã«å¿ èŠãªã¡ã¢ãªãå¢ãããããã¯ãŒã¯ãã¡ã¿ããŒã¿ãä»ããŠããŒã¿ã転éããããã«å¿ èŠãªãªãœãŒã¹ãå¢ããŸãã Thanos Store Gateway ãç¡å¹ã«ãªããŸãã ãããã£ãŠãå°ããªãã¡ã€ã«ã倧ããªãã¡ã€ã«ã«ããŒãžãã Thanos Compact ãå®è¡ããŠããã®ãããªãã¡ã€ã«ã®æ°ãæžãããThanos Store Gateway ã®ãªãŒããŒããããåæžããå¿ èŠããããŸãã
Thanos Ruler ãªã©ã®ã³ã³ããŒãã³ãããããŸãã Prometheus ã¢ã©ãŒã ã«ãŒã«ãå®è¡ããããŒã¿ã Object Storage ã«æžãæ»ãããã« Prometheus èšé²ã«ãŒã«ãè©äŸ¡ã§ããŸãã ãã ãããã®ã³ã³ããŒãã³ãã®äœ¿çšã¯ãå§ãã§ããŸãããçç±ã¯æ¬¡ã®ãšããã§ãã 圌
ããããµãã¹ã®åçŽãªèšç»ã§ãã
次ã«ãVictoriaMetrics ã¹ããŒã ãšæ¯èŒããŠã¿ãŸãããã
VictoriaMetrics ã«ã¯ãã·ã³ã°ã«ããŒã ããŒãžã§ã³ãšã¯ã©ã¹ã¿ãŒ ããŒãžã§ã³ã® 2 ã€ã®ããŒãžã§ã³ããããŸãã ã·ã³ã°ã«ããŒã㯠XNUMX å°ã®ã³ã³ãã¥ãŒã¿ãŒäžã§å®è¡ãããŸãã ã·ã³ã°ã«ããŒãã«ã¯ãããã®ã³ã³ããŒãã³ãã¯ãªãããã€ããªã XNUMX ã€ã ããããŸãã ã¹ã©ã€ãäžã®ãã®ãã€ããªã¯ããã®æ£æ¹åœ¢ã®ããã«èŠããŸãã åè§åœ¢ã®äžã«ãããã®ã¯ãã¹ãŠãåäžããŒã ããŒãžã§ã³ã®ãã€ã㪠ãã¡ã€ã«ã®å 容ã§ãã 圌ã®ããšãç¥ãå¿ èŠã¯ãããŸããã ãã€ããªãå®è¡ããã ãã§ãã¹ãŠãæ©èœããŸãã
ã¯ã©ã¹ã¿ãŒ ããŒãžã§ã³ã¯ããã«è€éã§ãã ãã®äžã«ã¯ãvmselectãvminsertãvmstorage ãšãã XNUMX ã€ã®ç°ãªãã³ã³ããŒãã³ãããããŸãã ååããããããããäœããããã¯æããã§ãã Insert ã³ã³ããŒãã³ãã¯ãPrometheus ãªã¢ãŒãæžã蟌㿠APIãInflux ã©ã€ã³ ãããã³ã«ãGraphite ãããã³ã«ãOpenTSDB ãããã³ã«ãªã©ãããŸããŸãªåœ¢åŒã®ããŒã¿ãåãå
¥ããŸãã Insert ã³ã³ããŒãã³ãã¯ããããåãå
¥ãã解æããããŒã¿ããã§ã«ä¿åãããŠããæ¢åã®ã¹ãã¬ãŒãž ã³ã³ããŒãã³ãéã§ããããé
åžããŸãã 次ã«ãSelect ã³ã³ããŒãã³ã㯠PromQL ã¯ãšãªãåãå
¥ããŸãã 圌ã¯å®è£
ããŸã
Thanos ãš VictoriaMetrics ã®ã€ã³ã¹ããŒã«ã®è€éããæ¯èŒããŠã¿ãŸãããã
ãµãã¹ããå§ããŸãããã Thanos ã®äœ¿çšãéå§ããåã«ãThanos Sidecar ãããŒã¿ãæžã蟌ããããã«ãS3 ã GCS ãªã©ã®ãªããžã§ã¯ã ã¹ãã¬ãŒãžã«ãã±ãããäœæããå¿ èŠããããŸãã
次ã«ãPrometheus ããšã« Thanos Sidecar ãã€ã³ã¹ããŒã«ããå¿ èŠããããŸãã ãã®åã«ãPrometheus ã§ããŒã¿å§çž®ãå¿ããã«ç¡å¹ã«ããå¿ èŠããããŸãã ããŒã¿å§çž®ã§ã¯ããªãœãŒã¹ã®æ¶è²»ãåæžããããã«ããŒã«ã« Prometheus ã¹ãã¬ãŒãžå ã®ããŒã¿ãå®æçã«å§çž®ããŸãã
Prometheus ã« Thanos Sidecar ãã€ã³ã¹ããŒã«ããå Žåã¯ãããŒã¿ ã³ã³ãã¯ã·ã§ã³ãæå¹ã«ãªã£ãŠãããš Thanos Sidecar ãæ£ããåäœããªãããããã®ããŒã¿ ã³ã³ãã¯ã·ã§ã³ãç¡å¹ã«ããå¿ èŠããããŸãã ããã¯ãPrometheus ã XNUMX æéã®ãããã¯ã§ããŒã¿ã®ä¿åãéå§ãããããã®ãããã¯ããã倧ããªãããã¯ã«ããŒãžããããšãåæ¢ããããšãæå³ããŸãã ãããã£ãŠãéå» XNUMX æéãè¶ ããã¯ãšãªãäœæãããšãããŒã¿å§çž®ãæå¹ã«ãªã£ãŠããå Žåã»ã©å¹ççã«åäœããªããªããŸãã
ãããã£ãŠãThanos ã¯ãå€æ°ã®å°ããªãããã¯ã®ãªãŒããŒããããåæžããããã«ãããŒã«ã« ã¹ãã¬ãŒãžã§ã®ããŒã¿ä¿ææéã 6 ïœ 8 æéã«ççž®ããããšãæšå¥šããŠããŸãã
Thanos Sidecar ãã€ã³ã¹ããŒã«ãããããªããžã§ã¯ã ã¹ãã¬ãŒãž ãã±ããããšã« XNUMX ã€ã®ã³ã³ããŒãã³ããã€ã³ã¹ããŒã«ããå¿ èŠããããŸãã ããã¯Thanos CompactorãšThanos Store Gatewayã§ãã
ãã®åŸãThanos Query ãã€ã³ã¹ããŒã«ããææããŠãããã¹ãŠã® Thanos ã¹ã㢠ã²ãŒããŠã§ã€ã«æ¥ç¶ã§ããããã«ããŸããã¹ãŠã® Thanos ãµã€ãã«ãŒã«ãæ¥ç¶ã§ããããã«èšå®ããå¿ èŠããããŸãã
ããã§å°ãåé¡ããããããããŸããã
Thanos Query ãããããã®ã³ã³ããŒãã³ããžã®ä¿¡é Œæ§ãé«ãå®å šãªæ¥ç¶ãæ§æããå¿ èŠããããŸãã ãŸããPrometheus ãå¥ã®ããŒã¿ã»ã³ã¿ãŒãŸãã¯å¥ã® VPC ã«ããå Žåãå€éšããã®æ¥ç¶ã¯çŠæ¢ãããŸãã ãã ããThanos Query ãæ©èœããã«ã¯ãäœããã®æ¹æ³ã§æ¥ç¶ãèšå®ããå¿ èŠãããããã®æ¹æ³ãèŠã€ããå¿ èŠããããŸãã
ãã®ãããªããŒã¿ã»ã³ã¿ãŒãå€æ°ååšãããšãããã«å¿ããŠã·ã¹ãã å šäœã®ä¿¡é Œæ§ãäœäžããŸãã Thanos Query ã¯ãç°ãªãããŒã¿ã»ã³ã¿ãŒã«ãããã¹ãŠã® Thanos ãµã€ãã«ãŒãžã®æ¥ç¶ãåžžã«ç¶æããå¿ èŠãããããã ãªã¯ãšã¹ããå±ããã³ã«ããã¹ãŠã® Thanos ãµã€ãã«ãŒã«ãªã¯ãšã¹ããã«ãŒãã£ã³ã°ããŸãã æ¥ç¶ãäžæããããšãäžå®å šãªããŒã¿ã»ãããåä¿¡ãããããã¯ã©ã¹ã¿ãŒãåæ¢ããŠããŸãããšããå¿çãåä¿¡ããããšã«ãªããŸãã
VictoriaMetrics ã§ã¯ããã¹ãŠãå°ãã·ã³ãã«ã«ãªããŸãã åäžããŒã ããŒãžã§ã³ã®å Žåã¯ãXNUMX ã€ã®ãã€ããªãå®è¡ããã ãã§ãã¹ãŠãæ©èœããŸãã
ã¯ã©ã¹ã¿ãŒ ããŒãžã§ã³ã§ã¯ãäžèšã® XNUMX çš®é¡ã®ã³ã³ããŒãã³ãããã¹ãŠå¿
èŠãªã ãå®è¡ãããã次ã®ã³ãã³ãã䜿çšããã ãã§ååã§ãã
XNUMX ã€ã®ãã€ããªãŸãã¯ã¯ã©ã¹ã¿ãŒåãããããŒãžã§ã³ãèµ·åããããPrometheus ãæ§æã«è¿œå ããã ãã§ãã
Thanos ãš VictoriaMetrics ã®ãµããŒããèããŠã¿ãŸãããã
Thanos ã¯ãSidecar ããªããžã§ã¯ã ã¹ãã¬ãŒãžãžã®ããŒã¿ã®èªã¿èŸŒã¿ãåæ¢ããªãããã«ç£èŠããå¿ èŠããããŸãã ãªããžã§ã¯ãã»ã¹ãã¬ãŒãžãžã®ãããã¯ãŒã¯æ¥ç¶ãäžæçã«äžæããããããªããžã§ã¯ãã»ã¹ãã¬ãŒãžãäžæçã«å©çšã§ããªããªã£ãããããªã©ãããŠã³ããŒãã»ãšã©ãŒãåå ã§ãã®ããŒã¿ã®ããŠã³ããŒããåæ¢ãããå ŽåããããŸãã Thanos Sidecar ã¯ãã®æç¹ã§ããã«æ°ã¥ãããšã©ãŒãå ±åããã¯ã©ãã·ã¥ããŠåäœãåæ¢ããå¯èœæ§ããããŸãã ãããç£èŠããªããšããªããžã§ã¯ãã¹ãã¬ãŒãžãžã®ããŒã¿è»¢éãåæ¢ããŸãã ä¿ææé (6 ïœ 8 æéãæšå¥š) ãçµéãããšããªããžã§ã¯ãã¹ãã¬ãŒãžã«ä¿åãããªãã£ãããŒã¿ã倱ãããŸãã
ãµãã¹ã®ã³ã³ãã¯ã¿ãŒã¯æ¬¡ã®çç±ã§åäœãåæ¢ããå¯èœæ§ããããŸã
ã¹ã㢠ã²ãŒããŠã§ã€ã¯ãCompactor ãš Sidecar éã®ç«¶åã«ãããäžè²«æ§ã®ãªãããŒã¿ãè¿ãå ŽåããããŸãã ã¹ã㢠ã²ãŒããŠã§ã€ã¯ã³ã³ãã¯ã¿ãŒããµã€ãã«ãŒãšãŸã£ããåæããŠããªããããããã§ãåãããšãçºçããŸãã ãããã£ãŠãã¹ã㢠ã²ãŒããŠã§ã€ãããŒã¿ã®äžéšãèªèããªããããŸãã¯äžèŠãªããŒã¿ãèªèãããšã競åç¶æ ãçºçããå¯èœæ§ããããŸãã
Thanos ã® Query ã³ã³ããŒãã³ãã¯ãäžéšã®ãµã€ãã«ãŒãŸãã¯ã¹ã㢠ã²ãŒããŠã§ã€ãçŸæç¹ã§å©çšã§ããªãå Žåãããã©ã«ãã§éšåçãªçµæãè¿ããŸãã ããŒã¿ã®äžéšãåä¿¡ããããšã«ãªããŸããããã¹ãŠã®ããŒã¿ãåä¿¡ããŠââããªãããšããããããŸããã ããã¯ããã©ã«ãã§ã©ã®ããã«åäœãããã§ãã åæ§ã®ç¶æ³ã§ã¯ãVictoriaMetrics ã¯ããŒã¯ãããããŒã¿ãéšåãšããŠè¿ããŸãã
Thanos ãšã¯ç°ãªããVictoriaMetrics ã§ã¯ããŒã¿ã倱ãããããšã¯ã»ãšãã©ãããŸããã Prometheus ãã VictoriaMetrics ãžã®æ¥ç¶ãäžæããããšããŠããPrometheus ã¯åä¿¡ããæ°ããããŒã¿ãå
è¡æžã蟌ã¿ãã° (ãµã€ãºã¯ 2 æé) ã«èšé²ãç¶ãããããããã¯åé¡ã«ã¯ãªããŸããã VictoriaMetrics ãžã®æ¥ç¶ã XNUMX æé以å
ã«åŸ©å
ããã°ãããŒã¿ã¯å€±ãããŸããã ããã¡ããŠã¹
XNUMX æéåŸã«ã®ã¿ããŒã¿ããªããžã§ã¯ã ã¹ãã¬ãŒãžã«æžã蟌ã Thanos ãšã¯ç°ãªããPrometheus ã¯ããªã¢ãŒãæžã蟌ã¿ãããã³ã«ã䜿çšããŠãVictoriaMetrics ãªã©ã®ãªã¢ãŒã ã¹ãã¬ãŒãžã«ããŒã¿ãèªåçã«è€è£œããŸãã Prometheus ã®ããŒã«ã« ã¹ãã¬ãŒãžã倱ãããšãæããå¿ èŠã¯ãããŸããã çªç¶ããŒã«ã« ã¹ãã¬ãŒãžã倱ã£ãå Žåãææªã®å Žåããªã¢ãŒã ã¹ãã¬ãŒãžã«èšé²ããæéããªãã£ãæåŸã®æ°ç§ã®ããŒã¿ã倱ãããããšã«ãªããŸãã
Kubernetes 㯠Thanos ãšã¯ç°ãªããã¯ã©ã¹ã¿ãŒãèªåçã«ç®¡çããŸãã VictoriaMetrics ã¯ã©ã¹ã¿ãŒ ã³ã³ããŒãã³ããšã¯ç°ãªãããã¹ãŠã® Thanos ã³ã³ããŒãã³ãã XNUMX ã€ã® Kubernetes ã¯ã©ã¹ã¿ãŒã«é 眮ããã®ã¯å°é£ã§ãã
VictoriaMetrics ã§ã¯ãæ°ããããŒãžã§ã³ãžã®éåžžã«ç°¡åãªã¢ããããŒããè¡ãããŠããŸãã VictoriaMetrics ãåæ¢ãããã€ããªãæŽæ°ããŠèµ·åããã ãã§ãã SIGINT ã·ã°ãã«ã«ãã£ãŠåæ¢ããããšããã¹ãŠã® VictoriaMetrics ãã€ããªã¯æ£åžžãªã·ã£ããããŠã³ãå®è¡ããŸãã å¿ èŠãªããŒã¿ãæ£ããä¿åããäœã倱ãããªãããã«åä¿¡æ¥ç¶ãæ£ããéããŸãã ãããã£ãŠãã¢ããã°ã¬ãŒãæã«äœã倱ãããããšã¯ãããŸããã
VictoriaMetrics ã䜿çšãããšãã¯ã©ã¹ã¿ãŒãéåžžã«ç°¡åã«æ¡åŒµã§ããŸãã å¿ èŠãªã³ã³ããŒãã³ããè¿œå ããã ãã§ãäœæ¥ãç¶è¡ã§ããŸãã
ThanosãšVictoriaMetricsã®èœãšãç©Žã«ã€ããŠã
ãµãã¹ã«ã¯æ¬¡ã®ãããªèœãšãç©ŽããããŸãã Prometheus ã¯éå» 3 æéã®ããŒã¿ãä¿åããå¿ èŠããããŸãã ããã㯠SXNUMX ã®ããã«ãªããžã§ã¯ã ã¹ãã¬ãŒãžã«ãŸã æžã蟌ãŸããŠããªããããçŽå€±ããå Žåã¯å®å šã«å€±ãããŸãã
ã¹ãã¢ã»ã²ãŒããŠã§ã€ã»ã³ã³ããŒãã³ããšã³ã³ãã¯ã¿ãŒã»ã³ã³ããŒãã³ãã¯ã倧ããªãªããžã§ã¯ãã»ã¹ãã¬ãŒãžã«å€æ°ã®å°ããªãã¡ã€ã«ãä¿åãããŠããå Žåããã®ã¹ãã¬ãŒãžãæäœããããã«å€§éã®ã¡ã¢ãªãŒãå¿
èŠãšããå¯èœæ§ããããŸãã ãã¡ã€ã«ã®æ°ãšãµã€ãºã倧ãããªãã»ã©ãã¡ã¿æ
å ±ãä¿åããããã«å¿
èŠãªã¹ã㢠ã²ãŒããŠã§ã€ãšã³ã³ãã¯ã¿ãŒã® RAM ãå¢å ããŸãã ãµãã¹ã¯æ¬¡ã®ç¹ã«é¢ããŠå€ãã®åé¡ãæ±ããŠããŸãã
ãµãã¹ã¯ãææããããã¡ããŠã¹ã®éã«å¿ããŠç¡æéã«æ¡åŒµã§ãããšå®£äŒãããŠããŸãã ããã¯å®éã«ã¯çå®ã§ã¯ãããŸããã ãã¹ãŠã®ãªã¯ãšã¹ãã¯ã¯ãšãª ã³ã³ããŒãã³ããééããããããã¹ãŠã®ã¹ã㢠ã²ãŒããŠã§ã€ ã³ã³ããŒãã³ããšãã¹ãŠã®ãµã€ãã«ãŒ ã³ã³ããŒãã³ããåæã«ããŒãªã³ã°ããå¿ èŠããããããããããŒã¿ãååŸããŠååŠçããŸãã æããã«ããªã¯ãšã¹ãé床ã¯æãé ã匱ããªã³ã¯ãæãé ãã¹ã㢠ã²ãŒããŠã§ã€ããŸãã¯æãé ããµã€ãã«ãŒã«ãã£ãŠå¶éãããŸãã
ãããã®ã³ã³ããŒãã³ãã®è² è·ãäžåäžã«ãªãå¯èœæ§ããããŸãã ããšãã°ãXNUMX ç§ãããæ°çŸäžã®ã¡ããªã¯ã¹ãåéãã Prometheus ããããšããŸãã ãããŠãæ¯ç§æ°åã®ã¡ããªã¯ã¹ãåéãã Prometheus ããããŸãã Prometheus 㯠XNUMX ç§ãããæ°çŸäžã®ã¡ããªã¯ã¹ãåéãããããå®è¡ããããµãŒããŒã«ã¯ããã«é«ãè² è·ãããããŸãã ãããã£ãŠãããã§ã¯ Sidecar ã®åäœãé ããªããŸãã ãããŠäžè¬çã«ãããã§ã¯ãã¹ãŠããã£ãããšåäœããŸãã ãããŠãQuery ã³ã³ããŒãã³ãã¯ããããéåžžã«ãã£ãããšããŒã¿ãååŸããŸãã ãããã£ãŠãã¯ã©ã¹ã¿ãŒå šäœã®ããã©ãŒãã³ã¹ã¯ããã®é ããµã€ãã«ãŒã«ãã£ãŠå¶éãããŸãã
ããã©ã«ãã§ã¯ãäžéšã®ãµã€ãã«ãŒãšã¹ã㢠ã²ãŒããŠã§ã€ã®ãããããå©çšã§ããªãå ŽåãThanos ã¯éšåçãªããŒã¿ãæäŸããŸãã ããšãã°ããµã€ãã«ãŒãäžçäžã®ããŸããŸãªããŒã¿ ã»ã³ã¿ãŒã«åæ£ããŠããå Žåãæ¥ç¶é害ãçºçããã³ã³ããŒãã³ããå©çšã§ããªããªãå¯èœæ§ãå€§å¹ ã«é«ãŸããŸãã ãããã£ãŠãã»ãšãã©ã®å Žåãç¥ããªããã¡ã«éšåçãªããŒã¿ãåãåãããšã«ãªããŸãã
VictoriaMetrics ã«ã¯èœãšãç©ŽããããŸãã æåã®èœãšãç©Žã¯ãVictoriaMetrics ãã£ãã·ã¥ã«äœ¿çšããã RAM ã®éãå¶éãããªãã·ã§ã³ã§ãã ããã©ã«ãã§ã¯ãVictoriaMetrics ãå®è¡ãããŠãããã·ã³ã® RAM ã® 60%ããŸã㯠Kubernetes ã® VictoriaMetrics ãããã® RAM ã® 60% ã«çžåœããŸãã
ãã®å€ã誀ã£ãŠå€æŽãããšãVictoriaMetrics ã®ããã©ãŒãã³ã¹ãæãªãããå¯èœæ§ããããŸãã ããšãã°ãå€ãäœãèšå®ãããããšãããŒã¿ã VictoriaMetrics ãã£ãã·ã¥ã«åãŸããªããªãå¯èœæ§ããããŸãã ãã®ããã圌女ã¯è¿œå ã®äœæ¥ãè¡ã£ãŠããã»ããµãšãã£ã¹ã¯ã«è² è·ããããå¿ èŠããããŸãã ãã®ãªãã·ã§ã³ã倧ãããããããšã第äžã«ãVictoriaMetrics ãã¡ã¢ãªäžè¶³ãšã©ãŒã§ã¯ã©ãã·ã¥ããå¯èœæ§ãé«ãŸãã第äºã«ããªãã¬ãŒãã£ã³ã° ã·ã¹ãã ã®ã¡ã¢ãªã«æ®ããã RAM ãã»ãšãã©ãªããªããŸãããã¡ã€ã«ãã£ãã·ã¥ã ãŸããVictoriaMetrics ã¯ããã©ãŒãã³ã¹ããã¡ã€ã« ãã£ãã·ã¥ã«äŸåããŠããŸãã ãããååã§ãªãå Žåããã£ã¹ã¯ã®è² è·ãå€§å¹ ã«å¢å ããå¯èœæ§ããããŸãã ãããã£ãŠã絶察ã«å¿ èŠãªå Žåãé€ãããã©ã¡ãŒã¿ãå€æŽããªãã§ãã ããã
1 çªç®ã®ãªãã·ã§ã³ã ããã¯ãretentionPeriod ã§ããããã©ã«ã㧠XNUMX ãæã«èšå®ãããŠããæéã§ãã ããã¯ãVictoriaMetrics ãããŒã¿ãä¿åããæéã®é·ãã§ãã ãã®æéãçµéãããšãVictoriaMetrics ã¯ããŒã¿ãåé€ããŸãã
å€ãã®äººã¯ããã®ãã©ã¡ãŒã¿ãŒã䜿çšããã« VictoriaMetrics ãå®è¡ãã1 ãæéããŒã¿ãèšé²ããŸãã ãããŠããªãåæã®ããŒã¿ãæ¶ããŠããŸã£ãã®ããšå°ããŸãã ããã©ã«ãã®ä¿ææé㯠XNUMX ãæã§ããããã§ãã ãããã£ãŠãæ£ããä¿ææéãç¥ã£ãŠèšå®ããå¿ èŠããããŸãã
ãŠããŒã¯ãªæ©èœãèŠãŠã¿ãŸãããã
Thanos ã«ã¯ããŠã³ãµã³ããªã³ã°ãšåŒã°ããæ©èœããããŸãããã㯠5 åééãš XNUMX æéééã§ãã
Thanos ã«ã¯ãPrometheus HA ãã¢ã®ããŒã¿éè€æé€æ©èœããããŸãã XNUMX ã€ã® Prometheus ãåãã¿ãŒã²ããããåãã¡ããªã¯ã¹ãåéããThanos ããããã Object Storage ã«ä¿åããå Žåã VictoriaMetrics ãšã¯ç°ãªããThanos ã¯ãã®ããŒã¿ãé©åã«éè€æé€ã§ããŸãã
Thanos ã«ã¯ãThanos ã®åè·¯å³ã«ãã£ãã¢ã©ãŒã ã³ã³ããŒãã³ãããããŸãã ããã圌ã¯
ãµãã¹ã«ã¯ããµãã¹ãšããã¡ããŠã¹ãåãã³ãŒããå ±æããŠãããšããå©ç¹ããããŸãã ãµãã¹ãšããã¡ããŠã¹ã¯åãéçºè ã«ãã£ãŠéçºãããŠããŸãã ãµãã¹ãããã¡ããŠã¹ãæ¹è¯ããã°ãçžæãåã¡ãŸãã
VictoriaMetrics ã®äž»ãªæ©èœã¯ MetricsQL ã§ãã ããã㯠PromQL çšã® VictoriaMetrics æ¡åŒµæ©èœã§ããã以åã®å€§èŠæš¡ãªç£èŠããŒãã£ã³ã°ã§è©±ããŸããã
VictoriaMetrics ã¯ãããŸããŸãªãããã³ã«ã䜿çšããããŒã¿ã®èªã¿èŸŒã¿ããµããŒãããŠããŸãã VictoriaMetrics ã¯ãPrometheus ããã®ããŒã¿ã ãã§ãªããInfluxãOpenTSDBãGraphite ãããã³ã«çµç±ã§ãããŒã¿ãåãå ¥ããããšãã§ããŸãã
VictoriaMetrics ããŒã¿ã¯ãThanos ã Prometheus ãšæ¯èŒããŠãå æããã¹ããŒã¹ãã¯ããã«å°ãªããªããŸãã
å®éã®ããŒã¿ãèšé²ãããšãPrometheus ã Thanos ãšæ¯èŒããŠãã£ã¹ã¯äžã®ããŒã¿ ãµã€ãºã 2 ïœ 5 ååæžããããšãŠãŒã¶ãŒã¯è©±ããŸãã
VictoriaMetrics ã®ãã XNUMX ã€ã®å©ç¹ã¯ãé床ãæé©åãããŠããããšã§ãã
ã€ã³ãã©ã¹ãã©ã¯ãã£ã®ã³ã¹ããèŠãŠã¿ãŸãããã
Thanos ã®å©ç¹ã® XNUMX ã€ã¯ãããŒã¿ãæ¯èŒçå®äŸ¡ãªãªããžã§ã¯ã ã¹ãã¬ãŒãžã«ä¿åã§ããããšã§ãã
ãªããžã§ã¯ã ã¹ãã¬ãŒãžã«ããŒã¿ãä¿åããå ŽåãããŒã¿ã®æžã蟌ã¿ããã³èªã¿åãæäœã«å¯ŸããŠæéãæ¯æãå¿ èŠããããŸã (10 äžæäœããã 10 ãã«)ã ãªããžã§ã¯ã ã¹ãã¬ãŒãžã«ããŒã¿ãæžã蟌ãå Žåãã€ã³ã¿ãŒãããã«ããŒã¿ãã¢ããããŒãããããã®ãã¹ãã£ã³ã°è²»çšãæ¯æããŸããã¯ã©ã¹ã¿ãŒã AWS ã«ãªãå ŽåãAWS ã§ã¯ç¡æã§ãã ããŒã¿ãèªã¿åãå Žåã¯ã230 TB ããã 1 ïœ XNUMX ãã«ã®æéãæ¯æããŸãã ããã¯ãThanos ã¯ã©ã¹ã¿ãŒã®å±¥æŽããŒã¿ãé »ç¹ã«ã¯ãšãªããå Žåã«éèŠã«ãªãå¯èœæ§ããããŸãã
Thanos ã¯ã©ã¹ã¿ãŒã®å Žåã倧éã®ã¡ã¢ãªãå¿ èŠãšãã CompactãStore GatewayãQuery ã³ã³ããŒãã³ããããã³å€§éã®ããŒã¿çšã® CPU ã®ãµãŒããŒã®æéãæ¯æãå¿ èŠããããŸãã
VictoriaMetrics ã«ã¯æ¬¡ã®è²»çšãããããŸãã GCE HDD ãã©ã€ãã«ããŒã¿ãä¿åãããšã40 TB 㧠1 ãã«ã«ãªããŸãã VictoriaMetrics ã®å Žåãéåžžã® HDD ãã©ã€ãã§ååã§ãããXNUMX åã®ã³ã¹ããããã SSD ã¯å¿ èŠãããŸããã VictoriaMetrics 㯠HDD çšã«æé©åãããŠããŸãã
VictoriaMetrics ã«ã¯ãåäžããŒããŸãã¯ã¯ã©ã¹ã¿ãŒåãããã³ã³ããŒãã³ãã®ã³ã³ããŒãã³ãçšã®ãµãŒããŒãå¿ èŠã§ããThanos ã³ã³ããŒãã³ããšã¯ç°ãªããå¿ èŠãª CPU ãš RAM ãå€§å¹ ã«å°ãªãããããã£ãŠã³ã¹ããå®ããªããŸãã
å®è£ äŸã
Thanos 㯠Gitlab ã«å®è£
äŸãæã£ãŠããŸãã Gitlab ã¯å®å
šã« Thanos äžã§å®è¡ãããŸãã ãããããã¹ãŠãããã»ã©ã¹ã ãŒãºã«é²ãããã§ã¯ãããŸããã ããããèŠãŠã¿ããšã
ãã®ããããããã®åé¡ã解決ããããã®ã³ã¹ããå¢å ããŸãã
XNUMX çªç®ã®å®è£ ã¯ãããæåããå¯èœæ§ããããŸãããThanos ã®éçºãéå§ãã Improbable 瀟ã§ãã 圌ãã¯ãµãã¹ã®ãœãŒã¹ã³ãŒããå ¬éããŸããã Improbable ã¯ã²ãŒã ãšã³ãžã³ãéçºããäŒç€Ÿã§ãã
VictoriaMetrics ã«ã¯å ¬éãããå®è£ äŸããããŸãã
- wix.com ãŠã§ããµã€ããã«ããŒ
- Adidas 㯠VictoriaMetrics ãå°å ¥ããŠãããååã® PromCon 2019 ã§ããã¬ãŒã³ããŒã·ã§ã³ãè¡ããŸããã
- TrafficStars - åºåãããã¯ãŒã¯
- Seznam.cz ã¯ãã§ã³ã®äººæ°ã®ããæ€çŽ¢ãšã³ãžã³ã§ãã
ãããŠãä»ã¯ååãèšããªãç¡åäŒæ¥ããããŸããã 圌ãã¯åæããŸããã§ããã
- æ倧æã²ãŒã éçºäŒç€Ÿã ç§ããã倧ãããããããªãã
- 倧æã°ã©ãã£ãã¯ãœããéçºäŒç€Ÿã
- ãã·ã¢ã®å€§æéè¡ã
- VictoriaMetrics ã®ãã¹ãã«æåãããšãŒãããã®é¢šåã¿ãŒãã³ ã¡ãŒã«ãŒã ãã®ã¡ãŒã«ãŒã¯ãVictoriaMetrics ãå®è£ ããŠã颚åã¿ãŒãã³ããåéãããããŒã¿ãã»ã³ãµãŒããšã« 50 ç§ããã XNUMX ãµã³ãã«ã®é床ã§ç£èŠããŠããŸãã å颚åã¿ãŒãã³ã«ã¯æ°çŸåã®ã»ã³ãµãŒãä»ããŠããŸãã 圌ãã«ã¯æ°çŸã®é¢šåã¿ãŒãã³ããããŸãã
- VictoriaMetrics ãå°å ¥ããããšèããŠãããã®ã®ããŸã å°å ¥ã§ããŠããªããã·ã¢ã®èªç©ºäŒç€Ÿã ç§ãã¡ã¯åœŒããšå¥çŽæ®µéã«ããŸãã
çµè«ã
VictoriaMetrics ãš Thanos ã¯åæ§ã®åé¡ã解決ããŸãããæ¹æ³ã¯ç°ãªããŸãã
- ã°ããŒãã«ã¯ãšãªãã¥ãŒ
- æ°Žå¹³ã¹ã±ãŒãªã³ã°
- ä»»æã®ä¿æ
ããããšãã
ç§ãã¡ã¯ããªãããåŸ
ã¡ããŠããŸã
ç»é²ãŠãŒã¶ãŒã®ã¿ãã¢ã³ã±ãŒãã«åå ã§ããŸãã
Prometheus ã®é·æã¹ãã¬ãŒãžãšããŠäœã䜿çšããŠããŸãã?
-
èŠèŽè ã®ïŒïŒ%ãã¿ãã¹6
-
èŠèŽè ã®ïŒïŒ%ãã³ãŒããã¯ã¹0
-
èŠèŽè ã®ïŒïŒ%ãM3DB0
-
èŠèŽè ã®ïŒïŒ%ããã¯ããªã¢ã¡ããªã¯ã¹7
-
èŠèŽè ã®ïŒïŒ%ããã®ä»4
17 人ã®ãŠãŒã¶ãŒãæ祚ããŸããã 16åã®ãŠãŒã¶ãŒãæ£æš©ããã
åºæïŒ habr.com