Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Moni nonse. Pansipa pali zolembedwa lipoti kuchokera ku Big Monitoring Meetup 4.

Prometheus - njira yowunikira machitidwe ndi mautumiki osiyanasiyana, mothandizidwa ndi omwe oyang'anira dongosolo amatha kusonkhanitsa zidziwitso za magawo amakono a machitidwe ndikukhazikitsa machenjezo kuti alandire zidziwitso za zopotoka pakugwira ntchito kwa machitidwe.

Lipotilo liphatikizanso kufananitsa Thanos и VictoriaMetrics - mapulojekiti osungira nthawi yayitali Prometheus metrics.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Sewerani kanema

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Choyamba, ndikuuzeni za Prometheus. Iyi ndi njira yowunikira yomwe imasonkhanitsa ma metrics kuchokera pazolinga zomwe zatchulidwa ndikuzisunga kumalo osungira kwanuko. Prometheus imatha kujambula ma metrics kumalo osungirako kutali ndipo imatha kupanga machenjezo ndi malamulo ojambulira.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Zochepa za Prometheus:

  • Ilibe mafunso padziko lonse lapansi. Apa ndi pamene muli ndi maulendo angapo odziimira a prometheus. Amasonkhanitsa ma metric. Ndipo mukufuna kufunsa pamwamba pazitsulo zonsezi zomwe zasonkhanitsidwa kuchokera ku zochitika zosiyanasiyana za prometheus. Prometheus salola izi.
  • Ndi prometheus, magwiridwe antchito amakhala ndi seva imodzi yokha. Prometheus samangodutsa ma seva angapo. Mutha kungogawaniza zolinga zanu pamanja pakati pa Prometheus angapo.
  • Kukula kwa ma metrics ku Prometheus kumangokhala pa seva imodzi yokha pazifukwa zomwezo zomwe sizingangowonjezera ma seva angapo.
  • Sizosavuta kukonza chitetezo cha data ku Prometheus.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Njira zothetsera mavuto/zovutazi?

Mayankho ake ndi:

Mayankho onsewa ndi osungira kutali deta yosonkhanitsidwa ndi Prometheus. Amathetsa vuto la kusungirako kutali kuchokera ku slide yapitayi m'njira zosiyanasiyana. Muchiwonetserochi ndingonena za mayankho awiri oyamba: Thanos и VictoriaMetrics.

Kwa nthawi yoyamba zambiri za Thanos adawonekera pa izi. Zomangamanga zikufotokozedwa pamenepo Thanos ndi momwe zimagwirira ntchito.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos amatenga zomwe Prometheus adasunga ku disk yakomweko ndikuzikopera ku S3, ku Mtengo wa GCS kapena kusungirako chinthu china.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Chifukwa chake Thanos imapereka malingaliro amafunso apadziko lonse lapansi. Mutha kufunsa zomwe zasungidwa muzosungira zinthu kuchokera ku zochitika zingapo za Prometheus.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos imathandizira PromQL ndi Prometheus querying API.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos amagwiritsa ntchito code ya Prometheus kusunga deta.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos imapangidwa ndi opanga omwewo monga Prometheus.

pa VictoriaMetrics. Apa ссылка, pamene tinakambirana koyamba VictoriaMetrics.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics imalandira deta kuchokera ku ma prometheus angapo remote write API protocol yothandizidwa ndi Prometheus.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics imapereka mawonekedwe amafunso apadziko lonse lapansi, popeza ma Prometheus angapo amatha kulemba zambiri ku VictoriaMetrics imodzi. Chifukwa chake, mutha kufunsa pa data yonseyi.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics imathandizanso, monga Thanos, PromQL ndi Prometheus kufunsa API.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mosiyana ndi Thanos, code code ya VictoriaMetrics imalembedwa kuyambira pachiyambi ndipo imakongoletsedwa ndi liwiro komanso kugwiritsa ntchito zinthu.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics, mosiyana ndi Thanos, sikelo yolunjika komanso yopingasa. Idyani Mtundu wa node imodzi, yomwe imakula molunjika. Mutha kuyamba ndi purosesa imodzi ndi 1 GB ya kukumbukira ndikukula pang'onopang'ono mpaka mazana a mapurosesa ndi 1 TB ya kukumbukira. VictoriaMetrics amatha kugwiritsa ntchito zinthu zonsezi. Kuchita kwake kudzawonjezeka pafupifupi nthawi 100 poyerekeza ndi 1-core system.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mbiri ya Thanos idayamba mu Novembala 2017, pomwe kudzipereka koyamba kwagulu kudawonekera. Izi zisanachitike, Thanos idapangidwa mkati zosatheka.io.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mu June 2019 panali kutulutsidwa kodziwika bwino kwa 0.5.0, komwe kuchotsedwa miseche protocol. Anachotsedwa ku Thanos chifukwa sanachite bwino. Nthawi zambiri gulu la Thanos silinagwire ntchito moyenera, mfundo zolumikizidwa nazo molakwika chifukwa cha miseche. Choncho, tinaganiza zomuchotsa kumeneko. Ndikuganiza kuti ichi ndi chisankho choyenera.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mu June 2019 womwewo, adatumiza nambala yofunsira 256 в Cloud Native Computing Foundation.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Ndipo patapita miyezi ingapo Thanos adalandiridwa Cloud Native Computing Foundation, zomwe zikuphatikizapo Prometheus, Kubernetes ndi ntchito zina zodziwika.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mu Januware 2018, chitukuko cha VictoriaMetrics chidayamba.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mu Seputembala 2018, ndidatchulapo za VictoriaMetrics koyamba.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mu Disembala 2018, mtundu wa single-node udasindikizidwa.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mu May 2019 zinasindikizidwa magwero amitundu yonse ya single-node ndi cluster.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mu June 2019, monga Thanos, tidapereka fomu yofunsira ku CNCF maziko pansi pa nambala 255. Tinafunsira tsiku limodzi Thanos asanalembe.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Koma, mwatsoka, sitinavomerezedwebe pamenepo. Thandizo la Community likufunika.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Tiyeni tiwone zithunzi zofunika kwambiri zomwe zikuwonetsa kamangidwe ka Thanos ndi VictoriaMetrics.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Tiyeni tiyambe ndi Thanos. Zigawo zachikasu ndi zigawo za Prometheus. Zina zonse ndi zigawo za Thanos. Tiyeni tiyambe ndi gawo lofunika kwambiri. Thanos Sidecar ndi gawo lomwe limayikidwa pafupi ndi Prometheus iliyonse. Imanyamula deta ya Prometheus kuchokera kusungirako komweko kupita ku S3 kapena Kusungirako Chinthu china.

Palinso gawo lotchedwa Thanos Store Gateway, lomwe limatha kuwerenga izi kuchokera ku Object Storage pazopempha zomwe zikubwera kuchokera ku Thanos Query. Thanos Query imagwiritsa ntchito PromQL ndi Prometheus API. Ndiko kuti, kuchokera kunja kumawoneka ngati Prometheus. Imalandila mafunso a PromQL, kuwatumiza ku Thanos Store Gateway, Thanos Store Gateway imatenganso zofunikira kuchokera ku Object Storage, ndikuzitumizanso.

Koma timasunga deta mu Object Storage popanda maola awiri omaliza chifukwa cha gawo la kukhazikitsidwa kwa Thanos Sidecar, lomwe silingathe kukweza maola awiri omaliza ku Object Storage S3, popeza Prometheus sanapangebe mafayilo kwa maola awiriwa posungirako.

Munaganiza zotani kuti muyendere izi? Thanos Query, kuwonjezera pa zopempha ku Thanos Store Gateway, amatumiza zopempha zofanana kwa Thanos Sidecar iliyonse, yomwe ili pafupi ndi Prometheus.

Ndipo Thanos Sidecar, nawonso, amafunsira ku Prometheus, ndikupeza deta maola awiri apitawa.

Kuphatikiza pazigawozi, palinso chigawo chosankha chomwe Thanos sichingachite bwino. Iyi ndi Thanos Compact, yomwe ili ndi udindo wophatikiza mafayilo ang'onoang'ono pa Object Storage kukhala mafayilo akulu omwe adakwezedwa pano ndi Thanos Sidecars. Thanos Sidecar imakweza mafayilo a data pamenepo m'maola awiri. Mafayilowa, ngati sanaphatikizidwe kukhala mafayilo akulu, ndiye kuti nambala yawo imatha kukula kwambiri. Mafayilo otere akachuluka, m'pamenenso amafunikira kukumbukira kwambiri Thanos Store Gateway, m'pamenenso pakufunika zinthu zambiri kusamutsa deta pamaneti ndi metadata. Thanos Store Gateway imakhala yosagwira ntchito. Chifukwa chake, ndikofunikira kuyendetsa Thanos Compact, yomwe imaphatikiza mafayilo ang'onoang'ono kukhala akuluakulu, kuti pakhale mafayilo ocheperako ndikuchepetsa pamwamba pa Thanos Store Gateway.

Palinso gawo ngati Thanos Wolamulira. Imatsatira malamulo ochenjeza a Prometheus ndipo imatha kuwunika malamulo ojambulira a Prometheus kuti alembe deta kubwerera ku Object Storage. Koma chigawo ichi sichikulimbikitsidwa kuti chigwiritsidwe ntchito, chifukwa ... Iye amakonda kubweza deta yosakwanira.

Ichi ndi njira yosavuta ya Thanos.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Tsopano tiyeni tifanizire ndi chiwembu cha VictoriaMetrics.

VictoriaMetrics ili ndi mitundu iwiri: single-node ndi cluster version. Single-node imagwira ntchito pa kompyuta imodzi. Single-node ilibe zigawo izi, binary imodzi yokha. Binary iyi pa silayidi ikuwoneka ngati lalikulu ili. Chilichonse chomwe chili mkati mwa sikwele ndi zomwe zili mufayilo ya binary ya mtundu wa Single-node. Simufunikanso kudziwa za iye. Mukungoyendetsa binary ndipo zonse zimagwira ntchito kwa ife.

Mtundu wa cluster ndi wovuta kwambiri. Mkati mwake muli zigawo zitatu: vmselect, vminsert ndi vmstorage. Kuchokera ku dzina lawo ziyenera kudziwika zomwe aliyense wa iwo amachita. Chigawo cha Insert chimalandira deta m'njira zosiyanasiyana: kuchokera ku Prometheus remote write API, Influx line protocol, Graphite protocol komanso kuchokera ku OpenTSDB protocol. Chigawo cha Insert chimawalandira, kuwagawa ndi kuwagawa pakati pa zigawo zosungirako zomwe zilipo kale, kumene deta yasungidwa kale. Gawo la Select, nalonso, limavomereza mafunso a PromQL. Iye amakwaniritsa Mtengo wa PromQL, komanso Prometheus querying API, ndipo itha kugwiritsidwa ntchito ngati m'malo mwa Prometheus ku Grafana kapena makasitomala ena a Prometheus API. Sankhani amavomereza pempho la promql, amawerengeka, amawerenga zofunikira kuti achite pempholi kuchokera kumalo osungira, amakonza detayi ndikubwezera yankho.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Tiyeni tifanizire zovuta zoyika Thanos ndi VictoriaMetrics.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Tiyeni tiyambe ndi Thanos. Musanayambe kugwira ntchito ndi Thanos, muyenera kupanga chidebe mu Object Storage, monga S3 kapena GCS, kotero kuti Thanos Sidecar akhoza kulemba deta kwa izo.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Ndiye pa Prometheus iliyonse muyenera kukhazikitsa Thanos Sidecar. Izi zisanachitike, muyenera kukumbukira kuletsa compaction ya data ku Prometheus. Kuphatikizika kwa data nthawi ndi nthawi kumapondereza deta muzosungirako za Prometheus kuti muchepetse kugwiritsa ntchito zinthu.

Mukayika Thanos Sidecar pa Prometheus yanu, muyenera kuletsa kuphatikizika kwa deta iyi, chifukwa Thanos Sidecar sichigwira ntchito bwino ndi kuphatikizika kwa data. Izi zikutanthauza kuti Prometheus yanu imayamba kusunga deta mu midadada ya maola awiri ndikusiya kuphatikiza midadadayo kukhala yayikulu. Chifukwa chake, ngati mupanga mafunso omwe amapitilira nthawi ya maola awiri apitawa, ndiye kuti sangagwire bwino ntchito momwe angagwirire ntchito ngati kulumikizidwa kwa data kudayatsidwa.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Choncho, Thanos amalimbikitsa kuchepetsa nthawi yosungiramo deta kumalo osungiramo zinthu zakale mpaka maola a 6-8 kuti achepetse kuchuluka kwa midadada yaying'ono.

Mukangoyika Thanos Sidecar, muyenera kukhazikitsa zigawo ziwiri pa Chidebe chilichonse Chosungira Zinthu. Awa ndi Thanos Compactor ndi Thanos Store Gateway.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Pambuyo pake, muyenera kukhazikitsa Thanos Query ndikuyikonza kuti igwirizane ndi Zipata zonse za Thanos Store zomwe muli nazo, komanso zimatha kugwirizanitsa ndi Thanos Sidecars zonse.

Pakhoza kukhala vuto laling'ono apa.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Muyenera kukonza kulumikizana kodalirika komanso kotetezeka kuchokera ku Thanos Query kupita ku zigawo izi. Ndipo ngati Prometheus yanu ili m'malo osiyanasiyana a data, kapena ma VPC osiyanasiyana, ndiye kuti kulumikizana nawo kuchokera kunja ndikoletsedwa. Koma kuti Thanos Query agwire ntchito, muyenera kukonza kulumikizana kumeneko, ndipo muyenera kupeza njira.

Ngati muli ndi malo ambiri oterowo, ndiye kuti, kudalirika kwa dongosolo lonse kumachepa. Popeza Thanos Query iyenera kusungitsa kulumikizana ndi ma Thanos Sidecars onse omwe ali m'malo osiyanasiyana. Pazopempha zilizonse zomwe zikubwera, zidzatumiza zopempha ku Thanos Sidecars zonse. Ngati kugwirizana kwasokonezedwa, mudzalandira deta yosakwanira, kapena mudzalandira yankho la "cluster is down".

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mu VictoriaMetrics zonse ndizosavuta. Pa mtundu wa single-node, mumangofunika kuyendetsa binary imodzi ndipo zonse zimagwira ntchito.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mu mtundu wa cluster, ndikokwanira kuyendetsa mitundu yonse itatu yazigawo mu kuchuluka kulikonse komwe mungafune, kapena kugwiritsa ntchito. tchati cha helm kuti musinthe kukhazikitsidwa kwa zigawo ku Kubernetes. Tikukonzekeranso kupanga Kubernetes operator. Tchati cha Helm sichimakhudza milandu ina ndipo imakulolani kudziwombera nokha pamapazi. Mwachitsanzo, zimakupatsani mwayi wochepetsera ma node osungira, zomwe zingayambitse kutayika kwa data.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mutayambitsa mtundu umodzi wa binary kapena gulu limodzi, muyenera kungowonjezera Prometheus ku config. kukhazikitsa kwa ulalo wakutalikotero kuti imayamba kulemba deta mofanana ndi kusungirako kwanuko ndi kusungirako kutali. Monga mukuwonera, kasinthidwe uku kuyenera kuchita modalirika kwambiri poyerekeza ndi kasinthidwe ka Thanos. Sitiyenera kukhala ndi kulumikizana kuchokera ku VictoriaMetrics kupita ku Prometheus yonse, chifukwa Prometheus amalumikizana ndi VictoriaMetrics ndikutumiza deta.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Tiyeni tilingalire thandizo la Thanos ndi VictoriaMetrics.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos akuyenera kuyang'anira Sidecar kuti atsimikizire kuti sasiya kutsitsa deta mu Object Storage. Akhoza kuyimitsa kutsitsa kwa datayi chifukwa cha zolakwika zotsitsa, mwachitsanzo kulumikizana kwanu kwa netiweki ku Object Storage kuyimitsidwa kwakanthawi, kapena Kusunga Zinthu sikukupezeka kwakanthawi. Thanos Sidecar awona izi pakadali pano, afotokoze cholakwika, atha kugwa ndikusiya kugwira ntchito. Ngati simukuwunika, ndiye kuti mudzasiya kusamutsa deta ku Object Storage. Ngati nthawi yosungira idutsa (maola 6-8 akulimbikitsidwa), ndiye kuti mudzataya deta yomwe siinathe mu Kusungirako Zinthu.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos compactors akhoza kusiya kugwira ntchito chifukwa cha mpikisano ndi Sidecar. Ma compactor amatenga deta kuchokera ku Object Storage ndikuiphatikiza kukhala zidutswa zazikulu za data. Popeza ma compactor samalumikizana ndi Sidecars, zotsatirazi zitha kuchitika: Sidecar sanakhale ndi nthawi yomaliza chipikacho, Compactor akuganiza kuti chipikachi chalembedwa kwathunthu. Compactor akuyamba kuwerenga. Simawerenga chipika chonse ndikusiya kugwira ntchito. Onani zambiri apa.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Store Gateway ikhoza kubweza deta yosagwirizana chifukwa cha mipikisano pakati pa Compactor ndi Sidecars. Zomwezo zimachitika pano, chifukwa Chipata Chosungira Sitolo sichimalumikizidwa ndi Compacts ndi Sidecars mwanjira iliyonse. Chifukwa chake, mikhalidwe yamtundu imatha kuchitika pomwe Store Gateway sikuwona gawo lazambiri kapena ikuwona deta yosafunikira.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Chigawo cha Query mu Thanos mwachisawawa chimabweretsa zotsatira zochepa ngati Sidecars kapena Store Gateways sizikupezeka pakadali pano. Mudzalandira gawo la deta, ndipo simudzadziwa kuti simunalandire deta yonse. Umu ndi momwe zimagwirira ntchito mwachisawawa. Munthawi yofananira, VictoriaMetrics imabweza deta yodziwika ngati yochepa.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mosiyana ndi Thanos, VictoriaMetrics nthawi zambiri samataya deta. Ngakhale kulumikizidwa kuchokera ku Prometheus kupita ku VictoriaMetrics kusokonezedwa, izi siziri vuto, popeza Prometheus akupitiliza kulemba zomwe zikubwera mu Logi Lolemba Patsogolo, kukula kwake ndi maola awiri. Mukabwezeretsa kulumikizidwa kwanu ku VictoriaMetrics mkati mwa maola awiri, deta yanu sidzatayika. Prometheus atha kuwonjezera deta pambuyo pobwezeretsa kulumikizidwa kwa VictoriaMetrics.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mosiyana ndi Thanos, yemwe amalemba deta kuti asungidwe pakangotha ​​maola awiri, Prometheus amangobwereza deta pogwiritsa ntchito njira yolembera kutali kuti asunge kutali, monga VictoriaMetrics. Simukuwopa kutaya zosungirako zakomweko ku Prometheus. Ngati mwadzidzidzi anataya kusungirako kwanuko, ndiye kuti muzovuta kwambiri mudzataya masekondi otsiriza a deta omwe analibe nthawi yolembedwa kumalo osungirako akutali.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Kubernetes amayang'anira gululo, mosiyana ndi Thanos. Ndizovuta kuyika zigawo zonse za Thanos mugulu limodzi la Kubernetes, mosiyana ndi zigawo zamagulu a VictoriaMetrics.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics ili ndi zosintha zosavuta za mtundu watsopano. Ingoyimitsani VictoriaMetrics, sinthani ma binaries ndikuyambitsa. Ikayimitsidwa kudzera pa siginecha ya SIGINT, ma binaries onse a VictoriaMetrics amazimitsa bwino. Amasunga molondola deta yofunikira, kutseka zolumikizira zomwe zikubwera molondola kuti asataye chilichonse. Chifukwa chake simudzataya chilichonse mukakulitsa.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics imapangitsa kukhala kosavuta kukulitsa gulu. Ingowonjezerani zigawo zofunika ndikupitiriza kugwira ntchito.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Za zovuta mu Thanos ndi VictoriaMetrics.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos ali ndi zovuta zotsatirazi. Prometheus ayenera kusunga deta kwa maola awiri otsiriza. Ngati atayika, muwataya kwathunthu chifukwa sanalembedwe ku Object Storage ngati S3.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Chigawo cha Store Gateway ndi chigawo cha compactor chingafunike kukumbukira kwambiri kuti chigwire ntchito ndi Chinthu Chosungirako chachikulu ngati pali mafayilo ang'onoang'ono osungidwa pamenepo. Kuchulukirachulukira ndi kukula kwa mafayilo, m'pamenenso Store Gateway ndi RAM yophatikizika imafunikanso kusunga zambiri. Thanos ali ndi zovuta zambiri pankhaniyi Store Gateway ndi kuwonongeka kwa compactor ndi ma volume apakati a data yojambulidwa.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos imalengezedwa kuti ikule mpaka kalekale ndi kuchuluka kwa Prometheus yomwe muli nayo. Izi sizowona. Popeza zopempha zonse zimadutsa mu gawo la Query, lomwe liyenera nthawi imodzi kufufuza zigawo zonse za Store Gateway ndi zigawo zonse za Sidecar, kukoka deta kuchokera pamenepo ndikuyikonza. Mwachiwonekere, liwiro la pempho limakhala lochepa ndi ulalo wofooka kwambiri, Chipata chochepetsetsa cha Store kapena Sidecar yochedwa kwambiri.

Izi zitha kukhala zodzaza mosagwirizana. Mwachitsanzo, muli ndi Prometheus, yomwe imasonkhanitsa ma metrics mamiliyoni pamphindikati. Ndipo pali Prometheus, yomwe imasonkhanitsa masauzande masauzande pamphindikati. Prometheus, yomwe imasonkhanitsa mamiliyoni a ma metric pamphindikati, imayika katundu wapamwamba kwambiri pa seva yomwe imayendetsa. Chifukwa chake, Sidecar imagwira ntchito pang'onopang'ono pamenepo. Ndipo zambiri zonse zimagwira ntchito pang'onopang'ono pamenepo. Ndipo gawo la Query lidzakoka deta kuchokera kumeneko pang'onopang'ono. Chifukwa chake, magwiridwe antchito a gulu lanu lonse achepetsedwa ndi Sidecar yocheperako iyi.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Mwachikhazikitso, Thanos amapereka deta pang'ono ngati Sidecars ena ndi Store Gateway palibe. Mwachitsanzo, ngati ma Sidecars anu amwazikana padziko lonse lapansi m'malo osiyanasiyana a data, ndiye kuti mwayi wa kulephera kwa kulumikizana ndi kusapezeka kwa gawo kumawonjezeka kwambiri. Chifukwa chake, nthawi zambiri mudzalandira data pang'ono popanda kudziwa.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics ilinso ndi misampha. Cholakwika choyamba ndi njira yomwe imachepetsa kuchuluka kwa RAM yomwe imagwiritsidwa ntchito posungira cache ya VictoriaMetrics. Mwachikhazikitso, ndi yofanana ndi 60% ya RAM pamakina omwe VictoriaMetrics ikuyenda kapena 60% ya RAM ya VictoriaMetrics pod ku Kubernetes.

Mukasintha mtengowu molakwika, mutha kuwononga magwiridwe antchito a VictoriaMetrics. Mwachitsanzo, ngati mutsika mtengo kwambiri, datayo singakhalenso ndi cache ya VictoriaMetrics. Pachifukwa ichi, amayenera kugwira ntchito yowonjezera ndikuyika purosesa ndi disk. Ngati mupanga chisankhochi kukhala chachikulu kwambiri, chimawonjezeka, choyamba, mwayi woti VictoriaMetrics idzawonongeka ndi cholakwika chokumbukira, ndipo, chachiwiri, zipangitsa kuti pakhale RAM yocheperako yotsalira pamakumbukiro ogwiritsira ntchito. posungira fayilo. Ndipo VictoriaMetrics imadalira cache yamafayilo kuti igwire ntchito. Ngati sikokwanira, katundu pa disk akhoza kuwonjezeka kwambiri. Choncho, malangizo: musasinthe parameter pokhapokha ngati kuli kofunikira.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Njira yachiwiri. Iyi ndi retentionPeriod - nthawi yokhazikitsidwa kukhala mwezi umodzi mwachisawawa. Uwu ndi utali wa nthawi yomwe VictoriaMetrics imasunga data. Pambuyo pa nthawiyi, VictoriaMetrics imachotsa deta.

Anthu ambiri amayendetsa VictoriaMetrics popanda parameter iyi ndikulemba deta kwa mwezi umodzi. Ndiyeno amafunsa kuti: chifukwa chiyani deta ya mwezi wapitayi inasowa? Chifukwa retentionPeriod ndi mwezi umodzi. Chifukwa chake, muyenera kudziwa ndikukhazikitsa retentionPeriod yoyenera.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Tiyeni tiwone mbali zapadera.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos ili ndi gawo lotchedwa downsampling: mphindi 5 ndi nthawi za ola, zomwe nthawi zambiri osagwira ntchito bwino. Ngati muyang'ana pa google ndikuyang'ana nkhani yawo pa github, pali nkhani zambiri zokhudzana ndi kutsitsa uku, zomwe nthawi zina sizigwira ntchito moyenera, kapena sizigwira ntchito monga momwe ogwiritsa ntchito amayembekezera.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos ili ndi kuchotsera kwa data kwa awiriawiri a Prometheus HA. Pamene awiri a Prometheus atenga ma metric omwewo kuchokera ku zolinga zomwezo ndipo Thanos amazisunga mu Object Storage. Thanos atha kubwereza bwino izi, mosiyana ndi VictoriaMetrics.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos ili ndi gawo lochenjeza lomwe linali mu dongosolo la Thanos. Koma iye osavomerezeka kuti agwiritsidwe ntchito popanga.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos ali ndi mwayi woti Thanos ndi Prometheus amagawana nambala yomweyo. Thanos ndi Prometheus amapangidwa ndi opanga omwewo. Ndikusintha kwa Thanos kapena Prometheus, mbali inayo imapambana.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Chinthu chachikulu cha VictoriaMetrics ndi MetricsQL. Izi ndi zowonjezera za VictoriaMetrics za PromQL, zomwe ndidakambapo pakuwunika kwakukulu kwam'mbuyomu.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics imathandizira kutsitsa kwa data pogwiritsa ntchito ma protocol osiyanasiyana. VictoriaMetrics sangangovomereza zambiri kuchokera ku Prometheus, komanso kudzera pa Influx, OpenTSDB ndi ma protocol a Graphite.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Deta ya VictoriaMetrics imatenga malo ochepa kwambiri poyerekeza ndi Thanos ndi Prometheus.

Ngati mulemba deta yeniyeni, ogwiritsa ntchito amalankhula za kuchepetsa nthawi 2-5 kukula kwa deta pa disk poyerekeza ndi Prometheus ndi Thanos.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Ubwino wina wa VictoriaMetrics ndikuti imakonzedwa mwachangu.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Tiyeni tiwone mtengo wa zomangamanga.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Chimodzi mwazabwino za Thanos ndikuti imasunga deta muzosungirako zinthu, zomwe ndizotsika mtengo.

Mukasunga deta m'malo osungira zinthu, muyenera kulipira ntchito yolemba ndikuwerenga ($ 10 pa ntchito miliyoni). Mukalemba deta kuti musunge zinthu, mumalipira ndalama zanu zosungira kuti mutengere deta pa intaneti; ngati gulu lanu silili mu AWS, ndi laulere pamenepo. Mukawerenga deta, mumalipira pakati pa $10 ndi $230 pa 1TB. Izi zitha kukhala zofunikira ngati nthawi zambiri mumafunsa za mbiri yakale kuchokera ku gulu la Thanos.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Kwa gulu la Thanos, muyenera kulipira ma seva a Compact, Store Gateway, Query zigawo zomwe zimafuna kukumbukira kwambiri, ndi CPU pazambiri zambiri.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics ili ndi ndalama zotsatirazi. Ngati mumasunga zambiri pama drive a GCE HDD, ndiye kuti zimatuluka mpaka $40 pa 1TB. Kwa VictoriaMetrics, ma drive wamba a HDD ndi okwanira; palibe ma SSD, omwe amawononga kasanu, amafunikira. VictoriaMetrics imapangidwira HDD.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics imafuna maseva azigawo: mwina Single-nod kapena zophatikizika, zomwe, mosiyana ndi zigawo za Thanos, zimafuna CPU yocheperako ndi RAM - ndipo zizikhala zotsika mtengo.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Zitsanzo za kukhazikitsa.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Thanos ali ndi chitsanzo chokhazikitsa mu Gitlab. Gitlab imayenda kwathunthu pa Thanos. Koma sikuti zonse zili bwino pamenepo. Ngati muyang'ana pa iwo nkhani, ndiye mutha kuwona kuti nthawi zonse amakhala nazo zovuta zogwirira ntchito ndi Thanos: Palibe kukumbukira kokwanira pazigawo za Store Gateway kapena Query. Nthawi zonse ayenera kuwonjezera kuchuluka kwa kukumbukira.

Chifukwa cha zimenezi, ndalama zothetsa mavutowa zimawonjezeka.

Kukhazikitsa kwachiwiri, komwe kungakhale kopambana, ndi kampani ya Improbable, yomwe idayamba kupanga Thanos. Adasindikiza khodi ya Thanos. Improbable ndi kampani yomwe imapanga injini zamasewera.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics ili ndi zitsanzo zoyendetsera anthu:

  • wix.com womanga webusayiti
  • Adidas ikugwiritsa ntchito VictoriaMetrics ndipo idapanga chiwonetsero pa PromCon 2019 yomaliza
  • TrafficStars - network ad
  • Seznam.cz ndi injini yosakira yotchuka yaku Czech.

Ndiyeno panali makampani opanda mayina omwe sindingathe kuwatchula tsopano. Iwo sanalole.

  • Mmodzi wamkulu wamasewera. Chachikulu kuposa im Probable.
  • Wopanga mapulogalamu akuluakulu ojambula zithunzi.
  • Banki yayikulu yaku Russia.
  • Wopanga ma turbine aku Europe omwe adayesa bwino VictoriaMetrics. Wopanga uyu akugwiritsa ntchito VictoriaMetrics kuyang'anira zomwe zasonkhanitsidwa kuchokera ku makina opangira mphepo pamlingo wa zitsanzo 50 pa sekondi iliyonse. Mphepo iliyonse imakhala ndi masensa mazana angapo. Iwo ali ndi mazana angapo opangira mphepo.
  • Ndege zaku Russia zomwe zikufuna kugwiritsa ntchito VictoriaMetrics, komabe sangathe. Tili nawo pagawo la mgwirizano.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetricsZotsatira.

VictoriaMetrics ndi Thanos amathetsa mavuto ofanana, koma m'njira zosiyanasiyana:

  • Funso lapadziko lonse lapansi
  • yopingasa makulitsidwe
  • kusungirako mosasamala

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Zikomo.

Tikuyembekezerani kwathu telegram channel.

Kusankha kusungirako deta kwa Prometheus: Thanos vs VictoriaMetrics

Ogwiritsa ntchito olembetsedwa okha ndi omwe angatenge nawo gawo pa kafukufukuyu. Lowani muakauntichonde.

Kodi mumagwiritsa ntchito chiyani posungira nthawi yayitali Prometheus?

  • 35,3%Thanos6

  • 0,0%Cortex0

  • 0,0%M3DB0

  • 41,2%VictoriaMetrics 7

  • 23,5%zina4

Ogwiritsa 17 adavota. Ogwiritsa ntchito 16 adakana.

Source: www.habr.com

Gulani kuchititsa kodalirika kwamasamba okhala ndi chitetezo cha DDoS, ma seva a VPS VDS Gulani malo odalirika osungira mawebusayiti okhala ndi chitetezo cha DDoS, ma seva a VPS VDS | ProHoster