Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Mhoroi mose. Pazasi pane chinyorwa Chirevo kubva kuBig Monitoring Meetup 4.

Prometheus - chirongwa chekutarisa cheakasiyana masisitimu uye masevhisi, nerubatsiro rwekuti vatariri vehurongwa vanogona kuunganidza ruzivo nezve yazvino parameter yehurongwa uye kumisikidza chenjedzo kuti vagamuchire zviziviso nezve kutsauka mukushanda kwehurongwa.

Mushumo uchasanganisira kuenzanisa Thanos ΠΈ VictoriaMetrics - mapurojekiti ekuchengetedza kwenguva refu kwePrometheus metrics.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Kutanga, ini ndichakuudza nezve Prometheus. Iyi ndiyo yekutarisa sisitimu inounganidza metrics kubva kune yakatarwa zvinangwa uye inoachengeta kune yekuchengetera kwenzvimbo. Prometheus inogona kurekodha metrics kune kure kuchengetedza uye inogona kugadzira yambiro uye yekurekodha mitemo.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Prometheus Limitations:

  • Haina mubvunzo wepasi rose maonero. Apa ndipo paunenge uine akawanda akazvimirira ega eprometheus. Vanounganidza metrics. Uye iwe unoda kubvunza pamusoro peese metrics akaunganidzwa kubva akasiyana prometheus zviitiko. Prometheus haabvumiri izvi.
  • Ne prometheus, kuita kunogumira kune imwe chete sevha. Prometheus haingoyereki otomatiki pane akawanda maseva. Iwe unogona chete kupatsanura nemaoko zvinangwa zvako pakati pePrometheus yakawanda.
  • Iyo chiyero chema metrics muPrometheus inongogumira kune imwe chete sevha nekuda kwechikonzero chimwe chete iyo haigone kuyera otomatiki pamaseva akawanda.
  • Hazvisi nyore kuronga kuchengetedza data muPrometheus.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Mhinduro kumatambudziko / matambudziko aya?

Mhinduro ndeidzi:

Ese aya mhinduro ndeyekuchengetera kure data yakaunganidzwa naPrometheus. Vanogadzirisa dambudziko rekuchengetedza kure kubva kune yakapfuura slide nenzira dzakasiyana. Mumharidzo iyi ndichataura chete nezve mhinduro mbiri dzekutanga: Thanos ΠΈ VictoriaMetrics.

Kekutanga ruzivo nezve Thanos akaonekwa na iyi link. Mavakirwo anotsanangurwa ipapo Thanos uye kuti inoshanda sei.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos inotora iyo data yakachengetwa naPrometheus kudhisiki yeko uye anoikopa kuS3, ku GCS kana kune chimwe chinhu chekuchengetedza.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Saka Thanos inopa maonero emubvunzo wepasi rose. Iwe unogona kubvunza data rakachengetwa mukuchengetedza chinhu kubva kune akawanda Prometheus zviitiko.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos inotsigira PromQL uye Prometheus querying API.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos inoshandisa Prometheus kodhi kuchengetedza data.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos inogadzirwa nevagadziri vakafanana sePrometheus.

pamusoro VictoriaMetrics. Pano ссылка, kwatakatanga kutaura nezvazvo VictoriaMetrics.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics inogamuchira data kubva kune akati wandei prometheus remote write API protocol inotsigirwa naPrometheus.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics inopa maonero epasirese emubvunzo, sezvo akawanda Prometheus zviitiko anogona kunyora data kune imwe VictoriaMetrics. Nekuda kweizvozvo, iwe unogona kuita mibvunzo pane iyi data yese.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics zvakare inotsigira, senge Thanos, PromQL uye Prometheus querying API.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Kusiyana neThanos, iyo VictoriaMetrics sosi kodhi yakanyorwa kubva kutanga uye yakagadziridzwa kumhanya uye kushandisa zviwanikwa.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics, kusiyana neThanos, zviyero zvese zvakadzika uye zvakachinjika. Eat Single-node version, iyo inoyera yakatwasuka. Iwe unogona kutanga ne processor imwe uye 1 GB yekuyeuka uye zvishoma nezvishoma kukura kusvika kumazana ema processor uye 1 TB yekuyeuka. VictoriaMetrics inogona kushandisa zvese izvi zviwanikwa. Kuita kwayo kuchawedzera nekanosvika zana kana zvichienzaniswa ne100-core system.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Nhoroondo yeThanos yakatanga munaNovember 2017, apo yekutanga ruzhinji kuzvipira kwakaonekwa. Izvi zvisati zvaitika, Thanos yakagadziridzwa mukati zvisingaite.io.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Muna Chikumi 2019 pakave nekuburitswa kwakakosha 0.5.0, umo kubviswa makuhwa protocol. Akabviswa paThanos nekuti haana kuita zvakanaka. Kazhinji iyo Thanos cluster haina kushanda nemazvo, node dzakabatana kwairi zvisizvo nekuda kwemakuhwa protocol. Naizvozvo, takasarudza kumubvisa ipapo. Ndinofunga kuti ichi ndicho chisarudzo chakanaka.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Muna June mumwe chete 2019, vakatumira nhamba yekunyorera 256 Π² Cloud Native Computing Nheyo.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Uye mushure memwedzi mishoma Thanos akagamuchirwa mukati Cloud Native Computing Nheyo, iyo inosanganisira Prometheus, Kubernetes uye mamwe mapurojekiti anozivikanwa.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Muna Ndira 2018, kuvandudzwa kweVictoriaMetrics kwakatanga.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

MunaGunyana 2018, ndakataura pachena VictoriaMetrics kekutanga.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Muna Zvita 2018, imwe-node vhezheni yakaburitswa.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Muna May 2019 akabudiswa masosi ese ari maviri-Single-node uye cluster shanduro.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Muna Chikumi 2019, sezvakaita Thanos, takaendesa chikumbiro kune CNCF hwaro pasi pehuwandu 255. Takanyorera rimwe zuva Thanos asati anyorera.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Asi, zvinosuruvarisa, isu hatisati tagamuchirwa ipapo. Rubatsiro rwenharaunda runodiwa.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Ngatitarisei masiraidhi akanyanya kukosha anoratidza mavakirwo eThanos neVictoriaMetrics.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Ngatitangei naThanos. Iyo yero zvikamu ndeye Prometheus zvikamu. Zvimwe zvese zvinhu zveThanos. Ngatitange nechikamu chakakosha. Thanos Sidecar chikamu chinoiswa padivi pePrometheus yese. Iyo inotakura Prometheus data kubva munzvimbo yekuchengetedza muS3 kana imwe Chinhu Chekuchengetedza.

Kune zvakare chikamu chinonzi Thanos Store Gateway, chinogona kuverenga iyi data kubva kuObject Storage pane zvinouya zvikumbiro kubva kuThanos Query. Thanos Query inoshandisa PromQL uye Prometheus API. Ndiko kuti, kubva kunze inoratidzika sePrometheus. Inogamuchira mibvunzo yePromQL, inoitumira kuThanos Store Gateway, Thanos Store Gateway inotora iyo data inodiwa kubva kuObject Storage, inoidzosera.

Asi isu tinochengeta data muObject Storage pasina maawa maviri ekupedzisira nekuda kwechikamu cheThanos Sidecar kuitiswa, iyo isingakwanise kurodha maawa maviri ekupedzisira kuObject Storage S3, sezvo Prometheus haasati agadzira mafaera emaawa maviri aya munzvimbo yekuchengetedza.

Wakasarudza sei kuzvitenderedza? Thanos Query, kuwedzera kune zvikumbiro kuThanos Store Gateway, inotumira zvikumbiro zvakafanana kune yega yega Thanos Sidecar, iri padyo nePrometheus.

Uye Thanos Sidecar, zvakare, proxies inokumbira mberi kuPrometheus, uye inotora data kwemaawa maviri apfuura.

Pamusoro pezvikamu izvi, pane zvakare chikamu chesarudzo pasina icho Thanos chisingazoite zvakanaka. Iyi iThanos Compact, ine basa rekubatanidza mafaira madiki paObject Storage mumafaira akakura akaiswa pano naThanos Sidecars. Thanos Sidecar inorodha mafaira edata ipapo mumaawa maviri. Aya mafaira, kana asina kubatanidzwa mumafaira makuru, saka nhamba yavo inogona kukura zvakanyanya. Iyo yakawanda mafaera akadaro, iyo yakawanda ndangariro inodiwa kune Thanos Store Gateway, iyo yakawanda zviwanikwa inodiwa kuendesa data pamusoro petiweki uye metadata. Thanos Store Gateway inova isingashande. Naizvozvo, zvinodikanwa kumhanya Thanos Compact, iyo inobatanidza mafaira madiki kuita makuru, kuitira kuti pave nemafaira akadaro mashoma uye kuderedza pamusoro paThanos Store Gateway.

Kune zvakare chikamu chakadai seThanos Mutongi. Inoita Prometheus yekuzivisa mitemo uye inogona kuongorora Prometheus yekurekodha mitemo kuitira kuti inyore data kumashure kuObject Storage. Asi chikamu ichi hachikurudzirwe kushandiswa, nekuti ... Iye inoda kudzorera data isina kukwana.

Ichi ndicho chirongwa chakareruka cheThanos.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Zvino ngatizvienzanise neVictoriaMetrics chirongwa.

VictoriaMetrics ine 2 shanduro: Single-node uye cluster vhezheni. Single-node inomhanya pane imwe komputa. Single-node haina zvinhu izvi, bhinari imwe chete. Iri bhinari pane siraidhi rinotaridzika seskweya iyi. Zvese zviri mukati mesikweya ndizvo zviri mukati mebhinari faira reSingle-node vhezheni. Haufanire kuziva nezvake. Iwe unongomhanya bhinari uye zvese zvinoshanda kwatiri.

Iyo cluster version yakanyanya kuoma. Mukati mayo mune zvinhu zvitatu zvakasiyana: vmselect, vminsert uye vmstorage. Kubva pazita ravo zvinofanirwa kujeka izvo mumwe nemumwe wavo anoita. Iyo Insert chikamu inogamuchira data mumhando dzakasiyana: kubva kuPrometheus kure nyora API, iyo Influx mutsara protocol, iyo Graphite protocol uye OpenTSDB protocol. The Insert component inovagamuchira, inovaparadzanisa uye inogovera pakati pezvinhu zviripo zvekuchengetedza, uko data yakatochengetwa. Iyo Sarudza chikamu, zvakare, inogamuchira PromQL mibvunzo. Anoshandisa PromQL, pamwe nePrometheus querying API, uye inogona kushandiswa sechinotsiva Prometheus muGrafana kana vamwe Prometheus API vatengi. Sarudza inogamuchira chikumbiro chepromql, ichiparura, inoverenga iyo data inodiwa yekuita ichi chikumbiro kubva munzvimbo dzekuchengetedza, inogadzirisa iyi data uye inodzosera mhinduro.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Ngatienzanisei kuoma kwekuisa Thanos neVictoriaMetrics.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Ngatitangei naThanos. Usati watanga kushanda neThanos, iwe unofanirwa kugadzira bhaketi muObject Storage, yakadai seS3 kana GCS, kuitira kuti Thanos Sidecar inyore data kwairi.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Zvadaro kune imwe neimwe Prometheus unoda kuisa Thanos Sidecar. Izvi zvisati zvaitika, unofanirwa kuyeuka kudzima data compaction muPrometheus. Dhata compaction nguva nenguva inomanikidza data mune yemuno Prometheus chengetedzo kuitira kuderedza kushandiswa kwezviwanikwa.

Paunoisa Thanos Sidecar paPrometheus yako, unofanirwa kudzima iyi data compaction, nekuti Thanos Sidecar haishande nemazvo ine data compaction inogoneswa. Izvi zvinoreva kuti Prometheus yako inotanga kuchengetedza data mumaawa maviri-mabhuroki uye inomira kubatanidza iwo mabhururu kuita makuru. Saizvozvo, kana iwe ukaita mibvunzo inodarika nguva yemaawa maviri apfuura, saka ivo havazoshanda nemazvo sezvavaigona kushanda kana data compaction ikagoneswa.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Nokudaro, Thanos inokurudzira kuderedza nguva yekuchengetedza data munzvimbo yekuchengetedza kusvika kumaawa 6-8 kuitira kuderedza kuwanda kwehuwandu hwezvivharo zviduku.

Kana uchinge waisa Thanos Sidecar, unofanira kuisa zvikamu zviviri kune imwe neimwe Object Storage Bucket. Aya ndiwo Thanos Compactor uye Thanos Store Gateway.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Mushure meizvozvo, unofanirwa kuisa Thanos Query uye kuigadzirisa kuitira kuti igone kubatana kune ese Thanos Store Gateways yauinayo, uye zvakare inogona kubatana kune ese Thanos Sidecars.

Panogona kunge paine dambudziko diki pano.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Iwe unofanirwa kugadzirisa yakavimbika uye yakachengeteka yekubatanidza kubva kuThanos Query kune izvi zvikamu. Uye kana Prometheus yako iri munzvimbo dzakasiyana dze data, kana muVPC dzakasiyana, saka kubatana kwavari kubva kunze kunorambidzwa. Asi kuti Thanos Query ishande, iwe unofanirwa kugadzirisa iyo yekubatanidza ipapo, uye iwe unofanirwa kufunga nzira.

Kana uine akawanda akadai data centers, saka, maererano, kuvimbika kwehurongwa hwose kunoderera. Sezvo Thanos Query inofanirwa kugara ichichengetedza hukama kune ese Thanos Sidecars ari munzvimbo dzakasiyana dze data. Pachikumbiro chese chinouya, ichaendesa zvikumbiro kune ese Thanos Sidecars. Kana iyo yekubatanidza ikakanganiswa, iwe unogona kugamuchira isina kukwana seti yedata, kana iwe uchagamuchira "cluster iri pasi" mhinduro.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

MuVictoriaMetrics zvese zviri nyore zvishoma. Kune iyo Imwe-node vhezheni, iwe unongoda kumhanya imwe bhinari uye zvese zvinoshanda.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Mune iyo cluster vhezheni, inokwana kumhanyisa ese ari pamusoro matatu marudzi ezvikamu mune chero huwandu hwaunoda, kana kushandisa. helm chati kuita otomatiki kuvhurwa kwezvikamu muKubernetes. Isu tiri kurongawo kugadzira Kubernetes opareta. Iyo Helm chati haifukidze dzimwe nyaya uye inoita kuti uzvipfure iwe mutsoka. Semuenzaniso, inokubvumira kuderedza nhamba yekuchengetedza node, izvo zvinotungamirira pakurasikirwa kwemashoko.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Mushure mekunge watanga imwe bhinari kana yakabatana vhezheni, iwe unongoda kuwedzera Prometheus kune iyo config. kuseta yeremote kunyora urlkuitira kuti itange kunyora data mukuenderana nekuchengetedza kwenzvimbo uye kuchengetedza kure. Sezvauri kuona, iyi gadziriso inofanirwa kuita zvakanyanya nekuvimbika kana ichienzaniswa neiyo Thanos kumisikidzwa. Hatidi kuchengetedza chinongedzo kubva kuVictoriaMetrics kune ese Prometheus, nekuti Prometheus ivo pachavo vanobatana neVictoriaMetrics uye vanoendesa data.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Ngatitarisei kutsigirwa kweThanos neVictoriaMetrics.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos inofanirwa kutarisa Sidecar kuti ive nechokwadi chekuti havamire kurodha data muObject Storage. Vanogona kumisa iyi kudhawunirodha data nekuda kwekudhawunirodha zvikanganiso, semuenzaniso network yako yekubatanidza kune Object Storage inovhiringwa kwenguva, kana Chinhu Chekuchengeta hachisipo. Thanos Sidecar ichaona izvi panguva ino, taura kukanganisa, inogona kuparara uye yobva yamira kushanda. Kana iwe ukasazvitarisa, ipapo iwe unomira kuendesa data kune Object Storage. Kana nguva yekuchengetedza ikapfuura (6-8 maawa anokurudzirwa), ipapo iwe ucharasikirwa nedata iyo isina kuguma muObject Storage.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos compactors inogona kumira kushanda nekuda kwe mujaho weSidecar. MaCompactor anotora data kubva kuObject Storage uye oisanganisa kuita zvidimbu zvakakura zve data. Sezvo ma compactor asina kuwiriraniswa neSidecars, zvinotevera zvinogona kuitika: Sidecar haisati yave nenguva yekupedzisa block, Compactor inosarudza kuti iyi block yakanyorwa zvachose. Compactor inotanga kuiverenga. Iyo haina kuverenga block yakazara uye inomira kushanda. Ona tsanangudzo pano.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Chengetedza Gateway inogona kudzorera isingaenderane data nekuda kwemijaho pakati peCompactor neSidecars. Chinhu chimwe chete chinoitika pano, nekuti iyo Store Gateway haina kuwiriraniswa neCompactors uye Sidecars chero nzira. Saizvozvo, mamiriro emujaho anogona kuitika kana Store Gateway isingaone chikamu che data kana kuona zvisina basa data.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Iyo Query chikamu muThanos nekusarudzika inodzosa chikamu kana mamwe Sidecars kana Store Gateways asipo panguva ino. Iwe unogashira chikamu che data, uye iwe haungatomboziva kuti hauna kugamuchira data rese. Aya ndiwo mashandiro azvinoita nekusarudzika. Mune mamiriro akafanana, VictoriaMetrics inodzosa yakanyorwa data sechikamu.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Kusiyana neThanos, VictoriaMetrics haiwanzo kurasikirwa nedata. Kunyangwe kana kubatana kubva kuPrometheus kuenda kuVictoriaMetrics kwakakanganiswa, iyi haisi dambudziko, sezvo Prometheus achiramba achinyora data idzva rinouya muKunyora Pamberi Log, ukuru hwayo maawa maviri. Kana iwe ukadzoreredza kubatana kwako kuVictoriaMetrics mukati memaawa maviri, data rako harizorasika. Prometheus inogona kuwedzera data mushure mekudzorera kubatana kuVictoriaMetrics.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Kusiyana neThanos, iyo inonyora dhata yekuchengetera zvinhu chete mushure memaawa maviri, Prometheus inodzokorora data uchishandisa iyo kure kunyora protocol kune kure kuchengetedza, seVictoriaMetrics. Iwe hausi kutya kurasikirwa kwenzvimbo yekuchengetedza muPrometheus. Kana akangoerekana arasikirwa nekuchengetedzwa kwepanzvimbo, ipapo mumatambudziko akaipisisa iwe ucharasikirwa nemasekondi ekupedzisira e data iyo yakanga isina nguva yekunyorwa mukuchengetedza kure.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Kubernetes inongozvigadzirisa iyo cluster, kusiyana neThanos. Zvakaoma kuisa zvese zvikamu zveThanos mune imwe Kubernetes cluster, kusiyana neVictoriaMetrics cluster components.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics ine yakapusa yekuvandudza kune iyo nyowani vhezheni. Ingomira VictoriaMetrics, gadziridza mabhinari uye utange iyo. Kana yamiswa kuburikidza neSIGINT chiratidzo, ese eVictoriaMetrics mabhinari anoita kuvharika kwakanaka. Ivo vanochengeta nemazvo data rinodiwa, vanovhara zvinopinda zvinongedzo nenzira kwayo kuti usarasikirwe chero chinhu. Saka hapana chaunorasikirwa nacho paunenge uchivandudza.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics inoita kuti zvive nyore kwazvo kuwedzera sumbu. Ingo wedzera izvo zvinodiwa uye ramba uchishanda.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Nezve misungo muThanos neVictoriaMetrics.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos ine makomba anotevera. Prometheus inofanirwa kuchengetedza data kwemaawa maviri ekupedzisira. Kana vakarasika, unovarasikirwa zvachose nekuti havasati vanyorwa kuObject Storage seS3.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

The Store Gateway chikamu uye compactor chikamu chinogona kuda yakawanda yekuyeuka kuti ishande nehombe Object Storage kana paine akawanda madiki mafaira akachengetwa ipapo. Iyo yakakura nhamba uye saizi yemafaira, iyo yakawanda Store Gateway uye compactor RAM inodiwa kuchengetedza metainformation. Thanos ane nyaya dzakawanda maererano nenyaya iyoyo Chengetedza Gateway uye compactor kuparara neavhareji mavhoriyamu e data rakarekodhwa.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos inoshambadzirwa kuyera kusinga peri nehuwandu hwePrometheus yaunayo. Ichi hachisi chokwadi. Sezvo zvikumbiro zvese zvichipfuura nechikamu cheQuery, icho chinofanira kuvhota panguva imwe chete ese Store Gateway zvikamu uye ese Sidecar zvikamu, dhonza data kubva ipapo uye wozofanoigadzira. Zviripachena, kumhanya kwekukumbira kunogumira neinononoka isina simba link, inononoka Store Gateway kana inononoka Sidecar.

Zvikamu izvi zvinogona kunge zvakatakurwa zvisina kuenzana. Semuenzaniso, une Prometheus, iyo inounganidza mamirioni emamita pasekondi. Uye kune Prometheus, iyo inounganidza zviuru zvemetrics pasekondi. Prometheus, iyo inounganidza mamiriyoni emametrics pasekondi, inoisa mutoro wepamusoro pane sevha iyo inomhanya nayo. Saizvozvo, Sidecar inoshanda zvishoma ipapo. Uye kazhinji zvinhu zvose zvinoshanda zvishoma nezvishoma ipapo. Uye iyo Query chikamu chinodhonza data kubva ipapo zvishoma nezvishoma. Saizvozvo, kuita kwesumbu rako rese kunoganhurwa neiyi inononoka Sidecar.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Nekumisikidza, Thanos inopa chidimbu data kana mamwe maSidecars uye ingave Store Gateway isipo. Semuenzaniso, kana maSidecars ako akapararira pasirese munzvimbo dzakasiyana dzedata, saka mukana wekutadza kwekubatanidza uye kusawanikwa kwechikamu kunowedzera zvakanyanya. Saizvozvo, kazhinji iwe unogashira chidimbu data usingatombozviziva.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics zvakare ine misungo. Yekutanga gomba isarudzo inodzikamisa huwandu hwe RAM inoshandiswa kuVictoriaMetrics cache. Nekusagadzika, yakaenzana ne60% ye RAM pamushini urikuitwa VictoriaMetrics kana 60% ye RAM ye VictoriaMetrics pod muKubernetes.

Kana ukashandura kukosha uku zvisizvo, unogona kukanganisa kuita kweVictoriaMetrics. Semuenzaniso, kana iwe ukaisa kukosha kwakaderera zvakanyanya, iyo data inogona kunge isingachakwane muVictoriaMetrics cache. Nekuda kweizvi, iye achafanirwa kuita rimwe basa uye kurodha processor uye dhisiki. Kana iwe ukaita iyi sarudzo yakakura kwazvo, inowedzera, chekutanga, mukana wekuti VictoriaMetrics iparare nekunze kwekurangarira kukanganisa, uye, chechipiri, zvinotungamira kune chokwadi chekuti kuchave ne RAM shoma yasara mune yekushandisa system memory ye. file cache. Uye VictoriaMetrics inovimba nefaira cache yekuita. Kana zvisina kukwana, mutoro uri pa diski unogona kuwedzera zvikuru. Naizvozvo, zano: usachinja parameter kunze kwekunge zvakakodzera.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Chechipiri sarudzo. Iyi iretentionPeriod - nguva inotarwa kumwedzi mumwe chete. Uhwu ndihwo hurefu hwenguva VictoriaMetrics inochengeta data. Mushure menguva iyi, VictoriaMetrics inodzima iyo data.

Vanhu vazhinji vanomhanyisa VictoriaMetrics vasina iyi parameter uye vanorekodha data kwemwedzi. Uye vobva vabvunza: nei data remwedzi wapfuura rakanyangarika? Nekuti iyo default retentionPeriod ndeye 1 mwedzi. Naizvozvo, iwe unofanirwa kuziva uye kuseta iyo chaiyo retentionPeriod.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Ngatitarisei kune akasiyana maficha.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos ine chinhu chinodaidzwa kuti downsampling: 5-miniti uye nguva dzeawa, izvo kazhinji kusashanda nemazvo. Kana iwe uchi google uye uchitarisa nyaya yavo pa github, pane zvakawanda zvezvinhu zvine chekuita neiyi downsampling, iyo dzimwe nguva haishande nemazvo, kana isingashande sezvinotarisirwa nevashandisi.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos ine data deduplication yePrometheus HA vaviri vaviri. Apo maviri Prometheus anounganidza ma metrics akafanana kubva kune zvimwe chete zvinangwa uye Thanos anoachengeta muObject Storage. Thanos inogona kunyatso dhinda iyi data, kusiyana neVictoriaMetrics.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos ine chikamu chekuzivisa chaive muThanos schematic. Asi iye hazvikurudzirwe kushandiswa mukugadzira.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos ine mukana wekuti Thanos naPrometheus vanogovana kodhi imwechete. Thanos uye Prometheus inogadzirwa nevagadziri vakafanana. Nekuvandudzwa kuThanos kana Prometheus, rimwe divi rinohwina.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics 'chinhu chikuru ndeyeMetricsQL. Aya ndiwo VictoriaMetrics ekuwedzera ePromQL, yandakataura nezvayo pane yakapfuura hombe yekutarisa metup.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics inotsigira kurodha data uchishandisa akawanda akasiyana maprotocol. VictoriaMetrics haingogamuchire data kubva kuPrometheus, asiwo kuburikidza neInflux, OpenTSDB uye Graphite protocol.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics data inotora nzvimbo shoma kana ichienzaniswa neThanos uye Prometheus.

Kana iwe ukanyora data chaiyo, vashandisi vanotaura nezve 2-5 nguva kuderedzwa kwehukuru hwe data pane disk kana ichienzaniswa nePrometheus uye Thanos.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Imwe mukana weVictoriaMetrics ndeyekuti yakagadziridzwa kumhanya.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Ngatitarisei mutengo wezvivakwa.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Imwe yemabhenefiti eThanos ndeyekuti inochengeta data mukuchengetedza chinhu, izvo zvakachipa.

Paunenge uchichengeta data mukuchengetedza chinhu, unofanirwa kubhadhara yekunyora data uye kuverenga mashandiro ($ 10 pamiriyoni mashandiro). Paunonyora data kune chinhu chekuchengetedza, iwe unobhadhara yako yekutambira mari yekuisa data kuInternet; kana cluster yako isiri muAWS, ndeye mahara ipapo. Paunoverenga data, unobhadhara pakati pemadhora gumi nemadhora mazana maviri nemakumi matatu pa10TB. Izvi zvinogona kuve zvakakosha kana iwe uchiwanzo bvunza nhoroondo data kubva kuThanos cluster.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Kune Thanos cluster, iwe unofanirwa kubhadhara kune maseva eCompact, Store Gateway, Query zvikamu zvinoda ndangariro yakawanda, uye CPU yehuwandu hwedata.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics ine zvinotevera mari. Kana iwe ukachengeta data paGCE HDD madhiraivha, anobva abuda kusvika kumadhora makumi mana e40TB. Kune VictoriaMetrics, akajairwa HDD madhiraivha anokwana; hapana maSSD, anodhura zvakapetwa kashanu, anodiwa. VictoriaMetrics yakagadzirirwa HDD.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics inoda maseva ezvikamu: ingave Imwechete-nod kana zvikamu zvakaunganidzwa, izvo, kusiyana neThanos zvikamu, zvinoda zvishoma CPU uye RAM - uye zvichave zvakachipa.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Mienzaniso yekushandisa.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Thanos ine muenzaniso wekuita muGitlab. Gitlab inomhanya zvachose paThanos. Asi hazvisi zvese zvakatsetseka ipapo. Kana ukavatarisa nyaya, wobva waona kuti vanogara vaine zvimwe matambudziko ekushanda neThanos: Iko hakuna ndangariro yakakwana yeSitoro Gateway kana Query zvikamu. Vanofanira kugara vachiwedzera kuwanda kwekuyeuka.

Nekuda kweizvi, mari dzekugadzirisa matambudziko aya dzinowedzera.

Yechipiri yekuitwa, iyo inogona kubudirira zvakanyanya, iIprobable kambani, iyo yakatanga kugadzira Thanos. Vakaburitsa Thanos source code. Improbable ikambani inogadzira injini dzemitambo.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

VictoriaMetrics ine mienzaniso yeruzhinji yekushandisa:

  • wix.com webhusaiti inovaka
  • Adidas iri kuita VictoriaMetrics uye yakatoita mharidzo panguva yekupedzisira PromCon 2019
  • TrafficStars - ad network
  • Seznam.cz inozivikanwa muCzech injini yekutsvaga.

Uye zvakare pakanga pasina-mazita makambani andisingakwanise kudoma zvino. Havana kubvuma.

  • Mumwe mugadziri mukuru wemutambo. Yakakura kudarika im Improbable.
  • Yakakura graphics software yekuvandudza.
  • Bhangi guru reRussia.
  • European mhepo turbine inogadzira iyo yakabudirira kuyedza VictoriaMetrics. Mugadziri uyu ari kushandisa VictoriaMetrics yekutarisa data rakaunganidzwa kubva kumhepo turbines pamwero wemakumi mashanu emasampuli pasekondi imwe neimwe sensor. Imwe neimwe turbine yemhepo ine mazana akati wandei masensa. Vane mazana emagetsi emhepo.
  • Ndege dzeRussia dzinoda kushandisa VictoriaMetrics, asi hazvigone. Isu tiri padanho rechibvumirano navo.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetricsMhedziso.

VictoriaMetrics uye Thanos vanogadzirisa matambudziko akafanana, asi nenzira dzakasiyana:

  • Global query view
  • horizontal scaling
  • kuchengetwa pasina

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Бпасибо.

Takakumirirai kwedu telegraph channel.

Kusarudza yekuchengetedza data yePrometheus: Thanos vs VictoriaMetrics

Vashandisi vakanyoresa chete ndivo vanogona kutora chikamu muongororo. Nyorera mu, Munogamuchirwa.

Chii chaunoshandisa sekuchengeta kwenguva refu kwePrometheus?

  • 35,3%Thanos6

  • 0,0%Cortex0

  • 0,0%M3DB0

  • 41,2%VictoriaMetrics7

  • 23,5%zvimwe4

17 vashandisi vakavhota. 16 vashandisi vakaramba.

Source: www.habr.com

Voeg