Ukukhetha isitoreji sedatha ye-Prometheus: Thanos vs VictoriaMetrics

Sanibonani nonke. Ngezansi umbhalo umbiko ovela ku-Big Monitoring Meetup 4.

Prometheus - uhlelo lokuqapha lwezinhlelo namasevisi ahlukahlukene, ngosizo lwabaphathi besistimu abangaqoqa ulwazi mayelana nemingcele yamanje yezinhlelo futhi bamise izexwayiso zokuthola izaziso mayelana nokuphambuka ekusebenzeni kwezinhlelo.

Umbiko uzobandakanya ukuqhathanisa Thanos и I-VictoriaMetrics - amaphrojekthi okugcina isikhathi eside kwamamethrikhi e-Prometheus.

Okokuqala, ngizokutshela ngo-Prometheus. Lena isistimu yokuqapha eqoqa ama-metrics kusukela kokuqondisiwe futhi iwalondoloze kusitoreji sasendaweni. I-Prometheus ingarekhoda amamethrikhi kwisitoreji esikude futhi ingakhiqiza izexwayiso nemithetho yokurekhoda.

Imikhawulo ye-Prometheus:

• Ayinawo umbuzo womhlaba jikelele. Kulapho unezimo eziningi ezizimele ze-prometheus. Baqoqa amamethrikhi. Futhi ufuna ukubuza phezu kwawo wonke lawa mamethrikhi aqoqwe kusuka kuzimo ezihlukene ze-prometheus. U-Prometheus akakuvumeli lokhu.
• Nge-prometheus, ukusebenza kukhawulelwe kuseva eyodwa kuphela. I-Prometheus ayizikeli ngokuzenzakalelayo kumaseva amaningi. Ungakwazi ukuhlukanisa kuphela okuhlosiwe kwakho phakathi kwe-Prometheus eminingi.
• Ububanzi bamamethrikhi ku-Prometheus bukhawulelwe kuseva eyodwa nje ngesizathu esifanayo sokuthi ayikwazi ukukala ngokuzenzakalelayo kumaseva amaningi.
• Akulula kakhulu ukuhlela ukuphepha kwedatha ku-Prometheus.

Izixazululo zalezi zinkinga/izinselele?

Izisombululo yilezi:

• Thanos
• I-VictoriaMetrics
• Uber M3
• cortex

Zonke lezi zixazululo ezokugcina kude kwedatha eqoqwe ngu-Prometheus. Baxazulula inkinga yesitoreji esikude kusilayidi sangaphambilini ngezindlela ezihlukene. Kulesi sethulo ngizokhuluma kuphela ngezixazululo ezimbili zokuqala: Thanos и I-VictoriaMetrics.

Ngokokuqala ngqa ulwazi mayelana Thanos kuvele ngu lesi sixhumanisi. I-architecture ichazwe lapho Thanos nokuthi isebenza kanjani.

I-Thanos ithatha idatha egcinwe u-Prometheus kudiski yendawo bese ikopisha ku-S3, ukuze I-GCS noma kwenye indawo yokugcina into.

Ngakho-ke i-Thanos inikeza umbono wombuzo womhlaba wonke. Ungabuza ngedatha egcinwe endaweni yokugcina into kusuka kuzimo eziningi ze-Prometheus.

I-Thanos isekela i-PromQL futhi I-Prometheus querying API.

I-Thanos isebenzisa ikhodi ye-Prometheus ukuze igcine idatha.

I-Thanos ithuthukiswe ngabathuthukisi abafanayo ne-Prometheus.

Mayelana I-VictoriaMetrics. Lapha isixhumanisi, lapho siqale ukukhuluma ngakho I-VictoriaMetrics.

I-VictoriaMetrics ithola idatha kuma-prometheus ambalwa i-remote write API Iphrothokholi esekelwa yi-Prometheus.

I-VictoriaMetrics inikeza umbono wemibuzo yomhlaba wonke, njengoba izimo ze-Prometheus eziningi zingabhala idatha ku-VictoriaMetrics eyodwa. Ngokufanelekile, ungenza imibuzo kuyo yonke le datha.

I-VictoriaMetrics iphinde isekele, njenge-Thanos, i-PromQL ne-Prometheus yokubuza i-API.

Ngokungafani ne-Thanos, ikhodi yomthombo ye-VictoriaMetrics ibhalwa kusukela ekuqaleni futhi yenzelwe isivinini nokusetshenziswa kwensiza.

I-VictoriaMetrics, ngokungafani ne-Thanos, ikala kokubili ngokuqondile nangokuvundlile. Yidla Inguqulo yenodi eyodwa, esikala sibheke phezulu. Ungaqala ngephrosesa eyodwa kanye no-1 GB wenkumbulo futhi kancane kancane ukhule ube amakhulu wamaphrosesa kanye no-1 TB wenkumbulo. I-VictoriaMetrics ingasebenzisa zonke lezi zinsiza. Ukusebenza kwayo kuzokwenyuka cishe izikhathi eziyi-100 uma kuqhathaniswa nesistimu engu-1-core.

Umlando we-Thanos waqala ngoNovemba 2017, lapho kuvela isivumelwano sokuqala somphakathi. Ngaphambi kwalokhu, i-Thanos yathuthukiswa ngaphakathi akunakwenzeka.io.

NgoJuni 2019 kube nokukhishwa okuyingqophamlando okungu-0.5.0, lapho isusiwe inhlebo Iphrothokholi. Wasuswa eThanos ngoba engenzanga kahle. Ngokuvamile iqoqo le-Thanos alizange lisebenze kahle, ama-node axhunywe kulo ngokungalungile ngenxa yenqubo yokuhleba. Ngakho-ke, sanquma ukumsusa lapho. Ngicabanga ukuthi lesi yisinqumo esifanele.

NgoJuni 2019 ofanayo, bathumela inombolo yesicelo 256 в Isisekelo se-Cloud Native Computing.

Futhi ngemva kwezinyanga ezimbalwa uThanos wamukelwa Isisekelo se-Cloud Native Computing, okuhlanganisa i-Prometheus, i-Kubernetes namanye amaphrojekthi adumile.

NgoJanuwari 2018, ukuthuthukiswa kwe-VictoriaMetrics kwaqala.

NgoSepthemba 2018, ngakhuluma esidlangalaleni nge-VictoriaMetrics okokuqala ngqa.

NgoDisemba 2018, kwashicilelwa inguqulo ye-Single-node.

Ngo-May 2019 zashicilelwa imithombo yazo zombili izinguqulo ze-Single-node kanye neqoqo.

NgoJuni 2019, njengoThanos, safaka isicelo kusisekelo se-CNCF ngaphansi kwenombolo 255. Safaka isicelo ngosuku olulodwa ngaphambi kokuthi uThanos afake isicelo.

Kodwa, ngeshwa, asikamukelwa lapho. Kudingeka usizo lomphakathi.

Ake sibheke amaslayidi abaluleke kakhulu abonisa ukwakheka kwe-Thanos ne-VictoriaMetrics.

Ake siqale ngoThanos. Izingxenye eziphuzi ziyizingxenye ze-Prometheus. Konke okunye kuyizingxenye ze-Thanos. Ake siqale ngengxenye ebaluleke kakhulu. I-Thanos Sidecar iyingxenye efakwe eduze kwayo yonke i-Prometheus. Ilayisha idatha ye-Prometheus isuka kwisitoreji sendawo iye ku-S3 noma kwenye Isitoreji Sento.

Kukhona nengxenye ebizwa ngokuthi i-Thanos Store Gateway, engafunda le datha ku-Object Storage phezu kwezicelo ezingenayo ezivela ku-Thanos Query. I-Thanos Query isebenzisa i-PromQL ne-Prometheus API. Okusho ukuthi, kusukela ngaphandle kubukeka njengo-Prometheus. Ithola imibuzo ye-PromQL, iyithumele ku-Thanos Store Gateway, i-Thanos Store Gateway ithola idatha edingekayo kokuthi Object Storage, iyibuyisele emuva.

Kodwa sigcina idatha ku-Object Storage ngaphandle kwamahora amabili okugcina ngenxa yesici sokuqaliswa kwe-Thanos Sidecar, esingakwazi ukulayisha amahora amabili okugcina ku-Object Storage S3, njengoba u-Prometheus engakawadali amafayela kulawa mahora amabili kwisitoreji sendawo.

Unqume kanjani ukuhamba kulokhu? I-Thanos Query, ngaphezu kwezicelo ze-Thanos Store Gateway, ithumela izicelo ezifanayo ku-Thanos Sidecar ngayinye, etholakala eduze kwe-Prometheus.

Futhi u-Thanos Sidecar, yena, ummeleli ucela ngokuqhubekayo ku-Prometheus, futhi abuyise idatha emahoreni amabili okugcina.

Ngaphezu kwalezi zingxenye, kukhona futhi ingxenye yokuzikhethela ngaphandle kokuthi i-Thanos ingeke isebenze kahle. Lena i-Thanos Compact, enesibopho sokuhlanganisa amafayela amancane kokuthi Isitoreji Sento abe amafayela amakhulu alayishwe lapha ngabakwa-Thanos Sidecars. I-Thanos Sidecar ilayisha amafayela edatha lapho emahoreni amabili. Lawa mafayela, uma engahlanganiswa abe amafayili amakhulu, inani lawo lingakhula kakhulu. Uma amafayela anjalo engeziwe, kudingeka inkumbulo eyengeziwe ku-Thanos Store Gateway, kudingeka izinsiza ezengeziwe ukuze kudluliselwe idatha ngenethiwekhi nemethadatha. I-Thanos Store Gateway ayisebenzi. Ngakho-ke, kuyadingeka ukusebenzisa i-Thanos Compact, ehlanganisa amafayela amancane abe amakhulu, ukuze kube namafayela anjalo ambalwa futhi kuncishiswe phezulu ku-Thanos Store Gateway.

Kukhona futhi ingxenye efana ne-Thanos Ruler. Isebenzisa imithetho yokuxwayisa ye-Prometheus futhi ingahlola imithetho yokurekhoda ye-Prometheus ukuze ibhale idatha ibuyele kokuthi Isitoreji Sento. Kodwa le ngxenye ayinconywa ukuthi isetshenziswe, ngoba ... Yena ijwayele ukubuyisela idatha engaphelele.

Lolu uhlelo olulula lwe-Thanos.

Manje ake siyiqhathanise nohlelo lweVictoriaMetrics.

I-VictoriaMetrics inezinguqulo ezi-2: I-Single-node nenguqulo yeqoqo. I-Single-node isebenza kukhompuyutha eyodwa. I-Single-node ayinazo lezi zingxenye, kanambambili eyodwa kuphela. Lokhu kanambambili kusilayidi kubukeka njengalesi sikwele. Yonke into engaphakathi kwesikwele iwukuqukethwe kwefayela kanambambili lenguqulo yenodi Eyodwa. Awudingi ukwazi ngaye. Vele ugijime kanambambili futhi yonke into isisebenzele.

Inguqulo ye-cluster iyinkimbinkimbi kakhulu. Ngaphakathi kwayo kunezingxenye ezintathu ezihlukene: vmselect, vminsert kanye vmstorage. Kusukela egameni labo kufanele kucace ukuthi ngamunye wabo wenzani. Ingxenye ethi Faka yamukela idatha ngamafomethi ahlukene: kusukela ku-Prometheus rimote write API, i-Influx line protocol, i-Graphite protocol kanye nephrothokholi ye-OpenTSDB. Ingxenye ethi Faka iyazamukela, izihlukanise futhi izisabalalise phakathi kwezingxenye zokulondoloza ezikhona, lapho idatha isivele igcinwe khona. Ingxenye ethi Khetha, yona, yamukela imibuzo ye-PromQL. Uyasebenzisa I-PromQL, kanye ne-Prometheus querying API, futhi ingasetshenziswa njengokungena esikhundleni se-Prometheus e-Grafana noma amanye amaklayenti e-Prometheus API. Khetha wamukela isicelo se-promql, uyasihlaziya, ufunda idatha edingekayo yokwenza lesi sicelo kumanodi okugcina, ucubungula le datha bese ubuyisela impendulo.

Ake siqhathanise ubunkimbinkimbi bokufaka i-Thanos ne-VictoriaMetrics.

Ake siqale ngoThanos. Ngaphambi kokuthi uqale ukusebenza ne-Thanos, udinga ukudala ibhakede kokuthi Isitoreji Sento, njenge-S3 noma i-GCS, ukuze i-Thanos Sidecar ikwazi ukubhala idatha kuyo.

Khona-ke ku-Prometheus ngayinye udinga ukufaka i-Thanos Sidecar. Ngaphambi kwalokhu, udinga ukukhumbula ukukhubaza ukuhlangana kwedatha ku-Prometheus. Ukuminyanisa idatha ngezikhathi ezithile kucindezela idatha kusitoreji sasendaweni se-Prometheus ukuze kwehliswe ukusetshenziswa kwensiza.

Uma ufaka i-Thanos Sidecar ku-Prometheus yakho, kufanele ukhubaze lokhu kuhlanganiswa kwedatha, ngoba i-Thanos Sidecar ayisebenzi kahle ngokuhlanganisa idatha kunikwe amandla. Lokhu kusho ukuthi i-Prometheus yakho iqala ukulondoloza idatha ngamabhulokhi amahora amabili futhi iyeke ukuhlanganisa lawo mabhulokhi abe amakhulu. Ngokufanelekile, uma ubuza imibuzo edlula ubude besikhathi samahora amabili okugcina, ngeke isebenze kahle ngendlela ebingasebenza ngayo uma ukuhlanganisa idatha bekuvunyelwe.

Ngakho-ke, i-Thanos incoma ukunciphisa isikhathi sokugcinwa kwedatha kusitoreji sasendaweni sibe amahora angu-6-8 ukuze kuncishiswe inani elikhulu lamabhulokhi amancane.

Uma usuyifakile i-Thanos Sidecar, kufanele ufake izingxenye ezimbili zeBhakede Lesitoreji Sento ngayinye. Lezi yiThanos Compactor kanye neThanos Store Gateway.

Ngemva kwalokho, udinga ukufaka i-Thanos Query futhi uyilungiselele ukuze ikwazi ukuxhuma kuwo wonke ama-Thanos Store Gateways onawo, futhi ingaxhuma kuwo wonke ama-Thanos Sidecars.

Kungase kube nenkinga encane lapha.

Udinga ukumisa ukuxhumana okuthembekile nokuvikelekile kusuka ku-Thanos Query kuya kulezi zingxenye. Futhi uma i-Prometheus yakho itholakala ezikhungweni zedatha ezihlukene, noma kuma-VPC ahlukene, khona-ke ukuxhumana nawo kusuka ngaphandle akuvunyelwe. Kepha ukuze Umbuzo we-Thanos usebenze, udinga ukuthi ngandlela thize ulungiselele ukuxhumana lapho, futhi kufanele uthole indlela.

Uma unezikhungo eziningi ezinjalo zedatha, ngakho-ke, ngokufanele, ukwethembeka kwalo lonke uhlelo kunciphisa. Njengoba Umbuzo we-Thanos kumele uhlale ugcina ukuxhumana kuwo wonke ama-Thanos Sidecars atholakala ezikhungweni zedatha ezihlukene. Kuso sonke isicelo esingenayo, izohambisa izicelo kuwo wonke ama-Thanos Sidecars. Uma ukuxhumeka kuphazamiseka, uzothola isethi yedatha engaphelele, noma uzothola impendulo ethi "iqoqo liphansi".

Ku-VictoriaMetrics yonke into ilula kancane. Ngenguqulo ye-Single-node, udinga nje ukusebenzisa kanambambili eyodwa futhi yonke into iyasebenza.

Kunguqulo yeqoqo, kwanele ukusebenzisa zonke izinhlobo ezintathu ezingenhla zezingxenye kunoma yiliphi inani olidingayo, noma olisebenzisayo. ishadi lesigqoko ukwenza ngokuzenzakalelayo ukwethulwa kwezingxenye ku-Kubernetes. Sihlela nokwenza u-opharetha we-Kubernetes. Ishadi le-Helm alibandakanyi ezinye izimo futhi likuvumela ukuthi uzidubule onyaweni. Isibonelo, ikuvumela ukuthi unciphise inani lezindawo zokugcina, okuzoholela ekulahlekeni kwedatha.

Ngemuva kokuthi wethule kanambambili eyodwa noma inguqulo ehlanganisiwe, udinga nje ukwengeza i-Prometheus ku-config. ukulungiselelwa kokubhala kwe-url yesilawuli kudeukuze iqale ukubhala idatha ngokuhambisana nesitoreji sendawo kanye nesitoreji esikude. Njengoba ubona, lokhu kulungiselelwa kufanele kusebenze ngokwethembeka kakhulu uma kuqhathaniswa nokucushwa kwe-Thanos. Asidingi ukugcina uxhumano olusuka ku-VictoriaMetrics kuya kuwo wonke ama-Prometheus, ngoba i-Prometheus ngokwayo ixhuma ku-VictoriaMetrics futhi idlulise idatha.

Ake sicabangele ukwesekwa kwe-Thanos kanye ne-VictoriaMetrics.

I-Thanos idinga ukuqapha i-Sidecar ukuze iqinisekise ukuthi ayiyeki ukulayisha idatha ku-Object Storage. Bangase bamise lokhu kulanda kwedatha ngenxa yamaphutha okulanda, isibonelo, uxhumo lwakho lenethiwekhi ku-Isitoreji Sento luphazamisekile, noma Isitoreji Sento asitholakali okwesikhashana. I-Thanos Sidecar izoqaphela lokhu okwamanje, ibike iphutha, ingase iphahlazeke bese iyeka ukusebenza. Uma ungayiqapheli, uzoyeka ukudlulisa idatha kokuthi Isitoreji Sento. Uma isikhathi sokugcina sidlula (kunconyiwe amahora angu-6-8), uzolahlekelwa yidatha engazange igcine kokuthi Isitoreji Sento.

Ama-Thanos compactors angase ayeke ukusebenza ngenxa umjaho noSidecar. Ama-Compactor athatha idatha Kusitoreji Sento futhi ayihlanganise ibe izingcezu ezinkulu zedatha. Njengoba ama-compactor engavumelaniswa nama-Sidecars, okulandelayo kungenzeka: I-Sidecar ayikabi naso isikhathi sokuqedela ibhulokhi, i-Compactor inquma ukuthi leli bhulokhi libhalwe ngokuphelele. I-Compactor iqala ukuyifunda. Ayifundi ngokugcwele ibhulokhi futhi iyeka ukusebenza. Bona imininingwane lapha.

I-Store Gateway ingase ibuyisele idatha engahambisani ngenxa yemijaho phakathi kwe-Compactor ne-Sidecars. Kwenzeka okufanayo lapha, ngoba i-Store Gateway ayivumelaniswa nama-Compactors nama-Sidecars nganoma iyiphi indlela. Ngokufanelekile, izimo zomjaho zingase zenzeke lapho i-Store Gateway ingayiboni ingxenye yedatha noma ibona idatha engadingekile.

Ingxenye Yombuzo ku-Thanos ngokuzenzakalelayo ibuyisela umphumela oyingxenye uma ezinye i-Sidecars noma I-Store Gateways ingatholakali okwamanje. Uzothola ingxenye yedatha, futhi ngeke wazi nokuthi awuyitholanga yonke idatha. Le yindlela esebenza ngayo ngokuzenzakalelayo. Esimeni esifanayo, i-VictoriaMetrics ibuyisela idatha emakwe njengengxenye.

Ngokungafani ne-Thanos, i-VictoriaMetrics ayivamisile ukulahlekelwa idatha. Ngisho noma uxhumano olusuka ku-Prometheus kuya ku-VictoriaMetrics luphazamisekile, lokhu akuyona inkinga, njengoba u-Prometheus eqhubeka nokurekhoda idatha entsha engenayo Kulogi Yokubhala Phambili, usayizi wayo ongamahora angu-2. Uma ubuyisela ukuxhumeka kwakho ku-VictoriaMetrics phakathi namahora amabili, idatha yakho ngeke ilahleke. I-Prometheus ingangeza idatha ngemva kokubuyisela uxhumano ku-VictoriaMetrics.

Ngokungafani ne-Thanos, ebhala idatha ukuze igcinwe kuphela ngemva kwamahora amabili, i-Prometheus iphindaphinda idatha ngokuzenzakalelayo isebenzisa iphrothokholi yokubhala ukude iyise kwisitoreji esikude, njenge-VictoriaMetrics. Awesabi ukulahlekelwa isitoreji sendawo ku-Prometheus. Uma ngokuzumayo elahlekelwe isitoreji sendawo, lapho-ke esimweni esibi kakhulu uzolahlekelwa imizuzwana yokugcina yedatha eyayingenaso isikhathi sokurekhoda kwisitoreji esikude.

I-Kubernetes iphatha iqoqo ngokuzenzakalelayo, ngokungafani ne-Thanos. Kunzima ukubeka zonke izingxenye ze-Thanos kwiqoqo elilodwa le-Kubernetes, ngokungafani nezingxenye zeqoqo le-VictoriaMetrics.

I-VictoriaMetrics inesibuyekezo esilula kakhulu senguqulo entsha. Vele umise i-VictoriaMetrics, ubuyekeze ama-binaries futhi uyethule. Uma imiswa ngesignali ye-SIGINT, wonke amabhanari we-VictoriaMetrics avala shaqa kahle. Balondoloza kahle idatha edingekayo, bavale ukuxhumana okungenayo ngendlela efanele ukuze bangalahlekelwa lutho. Ngakho-ke ngeke ulahlekelwe lutho lapho uthuthukisa.

I-VictoriaMetrics yenza kube lula kakhulu ukukhulisa iqoqo. Vele ungeze izingxenye ezidingekayo futhi uqhubeke nokusebenza.

Mayelana nezingibe ku-Thanos kanye ne-VictoriaMetrics.

I-Thanos inezihibe ezilandelayo. U-Prometheus kufanele agcine idatha yamahora amabili okugcina. Uma zilahleka, uzolahlekelwa ngazo ngokuphelele ngoba azikabhalelwa ku-Object Storage njenge-S3.

Ingxenye ye-Store Gateway kanye ne-compactor ingadinga inkumbulo eningi ukuze isebenze ne-Object Storage enkulu uma kunamafayela amaningi amancane agcinwe lapho. Uma inani elikhulu nosayizi wamafayela, kudingeka i-Store Gateway ne-RAM ehlangene ukuze kugcinwe ulwazi. I-Thanos inezinkinga eziningi mayelana neqiniso lokuthi Isango lesitolo kanye nokuphahlazeka kwekhompiyutha ngamavolumu amaphakathi wedatha erekhodiwe.

I-Thanos ikhangiswa ukuze ilingane nenani le-Prometheus onayo. Lokhu empeleni akulona iqiniso. Njengoba zonke izicelo zidlulela engxenyeni Yombuzo, okufanele ngesikhathi esisodwa ivote zonke izingxenye ze-Store Gateway nazo zonke izingxenye ze-Sidecar, idonsele idatha lapho bese iyicubungula kusengaphambili. Ngokusobala, isivinini sesicelo sinqunyelwe isixhumanisi esibuthakathaka esinensa kakhulu, i-Store Gateway ehamba kancane noma i-Sidecar ehamba kancane.

Lezi zingxenye zingalayishwa ngokungalingani. Isibonelo, une-Prometheus, eqoqa izigidi zamamethrikhi ngomzuzwana. Futhi kukhona i-Prometheus, eqoqa izinkulungwane zamamethrikhi ngomzuzwana. I-Prometheus, eqoqa izigidi zamamethrikhi ngomzuzwana, ibeka umthwalo ophakeme kakhulu kuseva esebenza kuyo. Ngakho-ke, iSidecar isebenza kancane lapho. Futhi ngokuvamile yonke into isebenza kancane lapho. Futhi ingxenye yombuzo izodonsa idatha ukusuka lapho kancane kakhulu. Ngokufanelekile, ukusebenza kweqoqo lakho lonke kuzokhawulwa yile Sidecar ehamba kancane.

Ngokuzenzakalelayo, i-Thanos inikeza idatha engaphelele uma amanye ama-Sidecars kanye ne-Store Gateway ingatholakali. Isibonelo, uma i-Sidecars yakho ihlakazeke emhlabeni wonke ezikhungweni zedatha ezihlukene, khona-ke amathuba okuhluleka kokuxhumeka nokungatholakali kwengxenye akhula kakhulu. Ngokufanelekile, ezimweni eziningi uzothola idatha engaphelele ngaphandle kokwazi.

I-VictoriaMetrics nayo inezingibe. Umgodi wokuqala inketho ekhawulela inani le-RAM elisetshenziselwa inqolobane ye-VictoriaMetrics. Ngokuzenzakalelayo, ilingana no-60% we-RAM emshinini lapho i-VictoriaMetrics isebenza khona noma u-60% we-RAM ye-VictoriaMetrics pod e-Kubernetes.

Uma ushintsha leli nani ngokungalungile, ungonakalisa ukusebenza kwe-VictoriaMetrics. Isibonelo, uma usetha inani eliphansi kakhulu, idatha ingase ingasakwazi ukungena kunqolobane ye-VictoriaMetrics. Ngenxa yalokhu, kuzodingeka enze umsebenzi owengeziwe futhi alayishe iphrosesa nediski. Uma wenza le nketho ibe yinkulu kakhulu, iyanda, okokuqala, amathuba okuthi i-VictoriaMetrics izophahlazeka ngephutha lokuphuma kwenkumbulo, futhi, okwesibili, kuzoholela eqinisweni lokuthi kuzoba ne-RAM encane kakhulu esele kumemori yesistimu yokusebenza inqolobane yefayela. Futhi i-VictoriaMetrics incike kunqolobane yefayela ukuze isebenze. Uma kungenele, umthwalo kudiski ungakhula kakhulu. Ngakho-ke, iseluleko: ungashintshi ipharamitha ngaphandle uma kunesidingo.

Inketho yesibili. Lena i-retentionPeriod - isikhathi esisethelwe enyangeni engu-1 ngokuzenzakalelayo. Lobu ubude besikhathi i-VictoriaMetrics igcina idatha. Ngemva kwalesi sikhathi, i-VictoriaMetrics isusa idatha.

Abantu abaningi basebenzisa i-VictoriaMetrics ngaphandle kwale pharamitha futhi barekhoda idatha inyanga yonke. Bese bebuza: kungani idatha yenyanga edlule yanyamalala? Ngoba iRetentionPeriod ezenzakalelayo iyinyanga engu-1. Ngakho-ke, udinga ukwazi futhi usethe i-retentionPeriod efanele.

Ake sibheke izici eziyingqayizivele.

I-Thanos inesici esibizwa ngokuthi i-downsampling: imizuzu emi-5 nezikhawu zehora, ngokuvamile ayisebenzi kahle. Uma u-google futhi ubheka inkinga yabo ku-github, kunezinkinga eziningi ezihlobene nalokhu kwehliswa kwesampula, ukuthi ngezinye izikhathi kungasebenzi kahle, noma kungasebenzi njengoba abasebenzisi belindele.

I-Thanos inokukhishwa kwedatha yamapheya e-Prometheus HA. Lapho ama-Prometheus amabili eqoqa amamethrikhi afanayo kokuhlosiwe okufanayo futhi i-Thanos iwagcina kokuthi Isitoreji Sento. I-Thanos ingakwazi ukuphindaphinda le datha ngendlela efanele, ngokungafani ne-VictoriaMetrics.

I-Thanos inengxenye yesixwayiso ebikuhlelo lwe-Thanos. Kodwa yena akunconyelwe ukusetshenziswa ekukhiqizeni.

I-Thanos inenzuzo yokuthi u-Thanos no-Prometheus babelana ngekhodi efanayo. I-Thanos ne-Prometheus athuthukiswa ngabathuthukisi abafanayo. Ngokuthuthuka kwe-Thanos noma i-Prometheus, olunye uhlangothi luyawina.

Isici esiyinhloko se-VictoriaMetrics yi-MetricsQL. Lezi izandiso ze-VictoriaMetrics ze-PromQL, engikhulume ngazo ekuhlanganeni okukhulu kokuqapha kwangaphambilini.

I-VictoriaMetrics isekela ukulayishwa kwedatha kusetshenziswa amaphrothokholi amaningi ahlukene. I-VictoriaMetrics ayikwazi ukwamukela idatha evela ku-Prometheus kuphela, kodwa futhi nge-Influx, OpenTSDB kanye ne-Graphite protocol.

Idatha ye-VictoriaMetrics ithatha isikhala esincane kakhulu uma iqhathaniswa ne-Thanos ne-Prometheus.

Uma urekhoda idatha yangempela, abasebenzisi bakhuluma ngokunciphisa izikhathi ezingu-2-5 kusayizi wedatha kudiski uma kuqhathaniswa ne-Prometheus ne-Thanos.

Enye inzuzo yeVictoriaMetrics ukuthi yenzelwe isivinini.

Ake sibheke izindleko zengqalasizinda.

Enye yezinzuzo ze-Thanos ukuthi igcina idatha endaweni yokugcina into, eshibhile uma kuqhathaniswa.

Lapho ugcina idatha endaweni yokugcina into, kufanele ukhokhele imisebenzi yokubhala nokufunda idatha ($10 ekusebenzeni kwesigidi ngasinye). Uma ubhala idatha endaweni yokugcina into, ukhokha izindleko zakho zokubamba zokulayisha idatha ku-inthanethi; uma iqoqo lakho lingekho ku-AWS, kumahhala lapho. Uma ufunda idatha, ukhokha phakathi kuka-$10 no-$230 nge-1TB ngayinye. Lokhu kungaba okubalulekile uma uvame ukubuza ngedatha yomlando evela kuqoqo le-Thanos.

Ngeqoqo le-Thanos, udinga ukukhokhela amaseva e-Compact, Store Gateway, izingxenye zemibuzo ezidinga inkumbulo eningi, kanye ne-CPU yenani elikhulu ledatha.

I-VictoriaMetrics inezindleko ezilandelayo. Uma ugcina idatha kumadrayivu e-GCE HDD, izophuma ibe ngu-$40 nge-1TB. Ku-VictoriaMetrics, amadrayivu ajwayelekile e-HDD anele; awekho ama-SSD, abiza ngokuphindwe kahlanu, ayadingeka. I-VictoriaMetrics ithuthukiselwe i-HDD.

I-VictoriaMetrics idinga amaseva ezingxenyeni: kungaba i-Single-nod noma izingxenye ezihlangene, okuthi, ngokungafani nezingxenye ze-Thanos, ezidinga i-CPU ne-RAM encane kakhulu - futhi zizobiza ngokufanele.

Izibonelo zokuqaliswa.

I-Thanos inesibonelo sokuqalisa ku-Gitlab. I-Gitlab isebenza ngokuphelele ku-Thanos. Kodwa akuzona zonke izinto ezibushelelezi lapho. Uma ubabheka nezindaba, khona-ke uyabona ukuthi bahlala bephethe izinkinga zokusebenza nge-Thanos: Ayikho inkumbulo eyanele Yesango Lesitolo noma izingxenye Zombuzo. Kufanele njalo bandise inani lenkumbulo.

Ngenxa yalokhu, izindleko zokuxazulula lezi zinkinga ziyanda.

Ukuqaliswa kwesibili, okungase kube yimpumelelo kakhulu, yinkampani ye-Improbable, eyaqala ukuthuthukisa i-Thanos. Bashicilele ikhodi yomthombo ye-Thanos. I-Improbable yinkampani ethuthukisa izinjini zegeyimu.

I-VictoriaMetrics inezibonelo zokusetshenziswa komphakathi:

• wix.com umakhi wewebhusayithi
• I-Adidas isebenzisa i-VictoriaMetrics futhi yenza isethulo ku-PromCon yokugcina ka-2019
• I-TrafficStars - inethiwekhi yesikhangiso
• I-Seznam.cz iyinjini yokusesha edumile yase-Czech.

Futhi-ke bekunezinkampani ezingenamagama engingeke ngizisho manje. Abavumanga.

• Omunye unjiniyela omkhulu wegeyimu. Kukhulu kune-im Improbable.
• Umthuthukisi wesoftware yezithombe ezinkulu.
• Ibhange elikhulu laseRussia.
• Umkhiqizi we-turbine yomoya waseYurophu ohlole ngempumelelo i-VictoriaMetrics. Lo mkhiqizi usebenzisa i-VictoriaMetrics ukuqapha idatha eqoqwe kuma-turbines omoya ngenani lamasampuli angu-50 ngesekhondi ngayinye. Injini yomoya ngayinye inezinzwa ezingamakhulu amaningana. Banezinjini zomoya ezingamakhulu amaningana.
• Izindiza zaseRussia ezifuna ukusebenzisa i-VictoriaMetrics, kodwa namanje azikwazi. Sisesigabeni senkontileka nabo.

Iziphetho.

I-VictoriaMetrics ne-Thanos ixazulula izinkinga ezifanayo, kodwa ngezindlela ezahlukene:

• Ukubuka kombuzo womhlaba wonke
• ukukala okuvundlile
• ukugcinwa ngokungafanele

Спасибо.

Sikulindile endaweni yethu ishaneli yocingo.

Abasebenzisi ababhalisiwe kuphela abangabamba iqhaza kuhlolovo. Ngena ngemvume, wamukelekile.

Yini oyisebenzisayo njengesitoreji sesikhathi eside se-Prometheus?

• 35,3%Thanos6

• 0,0%I-Cortex0

• 0,0%I-M3DB0

• 41,2%I-VictoriaMetrics7

• 23,5%abanye4

Bangu-17 abasebenzisi abavotile. Abasebenzisi abangu-16 bagobile.

Source: www.habr.com