Molweni nonke. Apha ngezantsi kukho umbhalo .
- inkqubo yokubeka iliso kwiinkqubo ezahlukeneyo kunye neenkonzo, ngoncedo apho abalawuli benkqubo banokuqokelela ulwazi malunga neeparitha zangoku zeenkqubo kunye nokuseka izilumkiso zokufumana izaziso malunga nokuphambuka ekusebenzeni kweenkqubo.
Ingxelo iya kubandakanya uthelekiso ΠΈ - iiprojekthi zokugcina ixesha elide leemethrikhi zePrometheus.
Okokuqala, ndiza kukuxelela ngePrometheus. Le yinkqubo yokubeka iliso eqokelela i-metrics kwiithagethi ezichaziweyo kwaye izigcine kwindawo yokugcina indawo. I-Prometheus inokurekhoda iimethrikhi kwindawo yokugcina kude kwaye inokuvelisa izilumkiso kunye nemithetho yokurekhoda.
Unyino lwePrometheus:
- Ayinayo imbono yombuzo wehlabathi. Oku kuxa unemizekelo emininzi ezimeleyo ye-prometheus. Baqokelela iimethrikhi. Kwaye ufuna ukubuza ngaphezulu kwazo zonke ezi metrics ziqokelelwe kwimizekelo eyahlukeneyo yeprometheus. I-Prometheus ayikuvumeli oku.
- Nge-prometheus, ukusebenza kukhawulelwe kumncedisi omnye kuphela. I-Prometheus ayikhuli ngokuzenzekelayo kwiiseva ezininzi. Unokwahlulahlula ngokwakho usukelo lwakho phakathi kwePrometheus ezininzi.
- Umda weemethrikhi kwi-Prometheus ukhawulelwe kwiseva enye ngesizathu esifanayo ukuba ayinakho ukulinganisa ngokuzenzekelayo kwiiseva ezininzi.
- Akulula kangako ukuququzelela ukhuseleko lwedatha kwiPrometheus.
Izisombululo kwezi ngxaki/mingeni?
Izisombululo zezi:
Zonke ezi zisombululo zezokugcinwa kude kwedatha eqokelelwe nguPrometheus. Basombulula ingxaki yokugcina kude ukusuka kwisilayidi sangaphambili ngeendlela ezahlukeneyo. Kule nkcazo ndiza kuthetha kuphela ngezisombululo ezimbini zokuqala: ΠΈ .
Okokuqala ulwazi malunga uvele nge . Uyilo lwezakhiwo luchazwe apho kunye nendlela esebenza ngayo.
I-Thanos ithatha idatha egcinwe nguPrometheus kwidiski yendawo kwaye ikhuphele kwi-S3, ukuya okanye kwenye indawo yokugcina into.
Ke iThanos ibonelela ngembono yombuzo wehlabathi. Ungabuza idatha egcinwe kugcino lwento ukusuka kwiimeko ezininzi zePrometheus.
I-Thanos ixhasa i-PromQL kunye .
I-Thanos isebenzisa ikhowudi ye-Prometheus ukugcina idatha.
I-Thanos iphuhliswa ngabaphuhlisi abafanayo njengePrometheus.
phezu . Apha , apho saqala ukuthetha ngayo .
IVictoriaMetrics ifumana idatha kwiiprometheus ezininzi iprotocol exhaswa nguPrometheus.
IVictoriaMetrics ibonelela ngembono yemibuzo yehlabathi, kuba iimeko ezininzi zePrometheus zinokubhala idatha kwiVictoriaMetrics enye. Ngokufanelekileyo, unokwenza imibuzo kuyo yonke le datha.
I-VictoriaMetrics ikwaxhasa, njenge-Thanos, i-PromQL kunye ne-Prometheus yokubuza i-API.
Ngokungafaniyo ne-Thanos, ikhowudi yomthombo weVictoriaMetrics ibhalwe ukusuka ekuqaleni kwaye ilungiselelwe isantya kunye nokusetyenziswa kobutyebi.
I-VictoriaMetrics, ngokungafaniyo ne-Thanos, izikali zombini ngokuthe nkqo nangokuthe tye. Yitya , esikala ngokuthe nkqo. Unokuqala ngeprosesa enye kunye ne-1 GB yememori kwaye ngokuthe ngcembe ukhule ukuya kumakhulu eeprosesa kunye ne-1 TB yememori. IVictoriaMetrics inokusebenzisa zonke ezi zixhobo. Ukusebenza kwayo kuya kunyuka malunga namaxesha e-100 xa kuthelekiswa nenkqubo ye-1-core.
Imbali yeThanos yaqala ngoNovemba 2017, xa kwavela ukuzinikela koluntu okokuqala. Ngaphambi koku, i-Thanos yaphuhliswa ngaphakathi .
NgoJuni ka-2019 bekukho ukukhutshwa okuphawulekayo kwe-0.5.0, apho iprotocol. Wasuswa eThanos kuba engakhange aqhube kakuhle. Rhoqo iqela le-Thanos alizange lisebenze ngokuchanekileyo, iindawo eziqhagamshelwe kuyo ngokungachanekanga ngenxa yendlela yokuhleba. Ngoko ke, sagqiba kwelokuba simsuse apho. Ndicinga ukuba esi sisigqibo esifanelekileyo.
KwangoJuni 2019, bathumela inombolo yesicelo Π² .
Kwaye emva kweenyanga ezimbalwa uThanos wamkelwa , equka iPrometheus, Kubernetes kunye nezinye iiprojekthi ezidumileyo.
NgoJanuwari 2018, uphuhliso lweVictoriaMetrics lwaqala.
NgoSeptemba ka-2018, ndakhankanya esidlangalaleni iVictoriaMetrics okokuqala.
NgoDisemba 2018, inguqulelo ye-Single-node yapapashwa.
NgoMeyi 2019 imithombo yazo zombini iinguqulelo ze-Single-node kunye neqela.
NgoJuni ka-2019, njengeThanos, singenise isicelo kwisiseko se-CNCF phantsi kwenombolo . Safaka isicelo ngosuku olunye ngaphambi kokuba uThanos afake isicelo.
Kodwa, ngelishwa, asikamkelwa apho. Uncedo loluntu luyafuneka.
Makhe sijonge ezona zilayidi zibalulekileyo ezibonisa uyilo lweThanos kunye neVictoriaMetrics.
Masiqale ngoThanos. Amacandelo atyheli ngamacandelo ePrometheus. Yonke enye into yinxalenye yeThanos. Masiqale ngelona candelo libalulekileyo. I-Thanos Sidecar licandelo elifakwe ecaleni kwayo yonke iPrometheus. Ilayisha idatha yePrometheus kwindawo yokugcina indawo kwi-S3 okanye enye into yokugcina izinto.
Kukho kwakhona icandelo elibizwa ngokuba yiThanos Store Gateway, enokufunda le datha kwi-Object Storage kwizicelo ezingenayo ezivela kwi-Thanos Query. Umbuzo weThanos usebenzisa iPromQL kunye nePrometheus API. Oko kukuthi, ukusuka ngaphandle kubonakala ngathi Prometheus. Ifumana imibuzo ye-PromQL, iyithumele kwi-Thanos Store Gateway, i-Thanos Store Gateway ifumana idatha efunekayo kwi-Object Storage, iyithumele kwakhona.
Kodwa sigcina idatha kwi-Object Storage ngaphandle kweeyure ezimbini zokugqibela ngenxa yento yokuphunyezwa kwe-Thanos Sidecar, engakwazi ukulayisha iiyure ezimbini zokugqibela kwi-Object Storage S3, ekubeni i-Prometheus engakayidali iifayile kwezi yure ezimbini kwindawo yokugcina indawo.
Ugqibe njani ukuba uhambe kule nto? Umbuzo weThanos, ngaphezu kwezicelo kwiThanos Store Gateway, ithumela izicelo ezifanayo kwiThanos Sidecar nganye, esecaleni kwePrometheus.
Kwaye i-Thanos Sidecar, ngokulandelayo, i-proxies icela ngakumbi kwi-Prometheus, kwaye ibuyisela idatha kwiiyure ezimbini zokugqibela.
Ukongeza kula macandelo, kukho kwakhona icandelo elikhethiweyo ngaphandle kokuba i-Thanos ingasebenzi kakuhle. Le yiThanos Compact, enoxanduva lokudibanisa iifayile ezincinci kwi-Object Storage kwiifayile ezinkulu ezifakwe apha nguThanos Sidecars. I-Thanos Sidecar ilayisha iifayile zedatha apho kwiiyure ezimbini. Ezi fayile, ukuba azidityaniswanga kwiifayile ezinkulu, ngoko ke inani labo linokukhula kakhulu. Okukhona iifayile ezinjalo, imemori eninzi iyadingeka kwiThanos Store Gateway, izibonelelo ezininzi zifuneka ukudlulisa idatha kwinethiwekhi kunye nemethadatha. I-Thanos Store Gateway ayisebenzi. Ngoko ke, kuyimfuneko ukuqhuba i-Thanos Compact, edibanisa iifayile ezincinci zibe zinkulu, ukwenzela ukuba zibe mbalwa iifayile ezinjalo kunye nokunciphisa phezulu kwiThanos Store Gateway.
Kukho kwakhona icandelo elinjengoMlawuli weThanos. Iqhuba imithetho yokulumkisa i-Prometheus kwaye inokuvavanya imithetho ye-Prometheus yokurekhoda ukuze ubhale idatha kwi-Object Storage. Kodwa eli candelo alikhuthazwa ukuba lisetyenziswe, kuba ... Yena .
Esi sikimu esilula seThanos.
Ngoku masiyithelekise nesikim seVictoriaMetrics.
IVictoriaMetrics ineenguqulelo ezi-2: I-single-node kunye nenguqulelo yeqela. I-single-node isebenza kwikhompyuter enye. I-single-node ayinala malungu, ibini enye kuphela. Oku kubini kwisilayidi kujongeka njengesikwere. Yonke into engaphakathi kwesikwere yimixholo yefayile yokubini yoguqulelo lwenodi enye. Akuyomfuneko ukuba wazi ngaye. Uqhuba nje okubini kwaye yonke into isebenza kuthi.
Inguqulelo yeqela inzima ngakumbi. Ngaphakathi kuyo kukho izinto ezintathu ezahlukeneyo: vmselect, vminsert kunye vmstorage. Ukususela kwigama labo kufuneka kucace into eyenziwa ngabanye. Icandelo loFaka lamkela idatha kwiifomati ezahlukeneyo: ukusuka kwi-Prometheus ekude bhala i-API, i-Influx line protocol, i-Graphite protocol kunye ne-OpenTSDB protocol. Icandelo laFaka liyawamkela, liwacazulule kwaye liwasasaze phakathi kwezinto ezikhoyo zokugcina, apho idatha sele igcinwe khona. Icandelo Khetha, nalo, lamkela imibuzo yePromQL. Uyaphumeza , kunye ne-Prometheus querying API, kwaye ingasetyenziselwa indawo ye-Prometheus eGrafana okanye abanye abathengi be-Prometheus API. Ukukhetha kwamkela isicelo se-promql, sicazulule, sifunde idatha efunekayo yokwenza esi sicelo kwiindawo zokugcina, inkqubo le datha kwaye ibuyisela impendulo.
Makhe sithelekise ubunzima bokufaka iThanos kunye neVictoriaMetrics.
Masiqale ngoThanos. Ngaphambi kokuba uqale ukusebenza kunye ne-Thanos, kufuneka wenze ibhakethi kwi-Object Storage, njenge-S3 okanye i-GCS, ukuze i-Thanos Sidecar ibhale idatha kuyo.
Ke kwiPrometheus nganye kufuneka ufake iThanos Sidecar. Ngaphambi koku, kufuneka ukhumbule ukukhubaza ukudibanisa kwedatha kwi-Prometheus. Ukunyanzeliswa kwedatha ngamaxesha athile kucinezela idatha kwindawo yokugcina iPrometheus ukuze kuncitshiswe ukusetyenziswa kobutyebi.
Xa ufaka i-Thanos Sidecar kwi-Prometheus yakho, kufuneka ukhubaze le datha yedatha, kuba i-Thanos Sidecar ayisebenzi ngokufanelekileyo kunye nokunyanzeliswa kwedatha. Oku kuthetha ukuba iPrometheus yakho iqala ukugcina idatha kwiibhloko zeyure ezimbini kwaye iyeke ukudibanisa ezobhloko zibe ezinkulu. Ngokufanelekileyo, ukuba ubuza imibuzo engaphezulu kobude beeyure ezimbini zokugqibela, ngoko ke aziyi kusebenza ngokufanelekileyo njengoko zinokusebenza ukuba ukudityaniswa kwedatha kwenziwe kwasebenza.
Ngoko ke, i-Thanos incoma ukunciphisa ixesha lokugcinwa kwedatha kwindawo yokugcina indawo kwiiyure ze-6-8 ukwenzela ukunciphisa inani elikhulu leebhloko ezincinci.
Nje ukuba ufake i-Thanos Sidecar, kufuneka ufake amacandelo amabini kwiBhakethi nganye yokuGcina. Ezi ziiThanos Compactor kunye neThanos Store Gateway.
Emva koko, kufuneka ufake i-Thanos Query kwaye uyilungiselele ukuze ikwazi ukudibanisa kuzo zonke ii-Thanos Store Gateways onazo, kwaye unokuqhagamshela kuzo zonke ii-Thanos Sidecars.
Kungakho ingxaki encinci apha.
Kufuneka uqwalasele uxhulumaniso oluthembekileyo nolukhuselekileyo olusuka kwiThanos Query ukuya kula macandelo. Kwaye ukuba i-Prometheus yakho ifumaneka kumaziko edatha ahlukeneyo, okanye kwii-VPC ezahlukeneyo, ngoko ukudibanisa kubo ngaphandle akuvumelekanga. Kodwa ukuze uMbuzo weThanos usebenze, kufuneka uqwalasele umdibaniso apho, kwaye kufuneka ufumanise indlela.
Ukuba unamaziko amaninzi anjalo edatha, ngoko, ngokufanelekileyo, ukuthembeka kwenkqubo yonke kuncipha. Ekubeni i-Thanos Query kufuneka ihlale igcina uxhulumaniso kuzo zonke ii-Thanos Sidecars ezikumaziko ahlukeneyo edatha. Kuso sonke isicelo esingenayo, iya kuthutha izicelo kuzo zonke iiThanos Sidecars. Ukuba uxhulumaniso luphazamisekile, uya kufumana isethi engaphelelanga yedatha, okanye uya kufumana impendulo "yeqela liphantsi".
KwiVictoriaMetrics yonke into ilula kancinci. Kuguqulelo lwe-node enye, kufuneka usebenzise ibhinari enye kwaye yonke into iyasebenza.
Kuguqulelo lweqela, kwanele ukuqhuba zonke ezi ntlobo zintathu zingentla zamacandelo kuwo nawuphi na ubungakanani obudingayo, okanye usebenzise ukwenza ngokuzenzekelayo ukuqaliswa kwamacandelo kwi-Kubernetes. Sikwaceba ukwenza umqhubi weKubernetes. Itshathi yeHelm ayiquki iimeko ezithile kwaye ikuvumela ukuba uzidubule ezinyaweni. Ngokomzekelo, kukuvumela ukuba unciphise inani leendawo zokugcina, eziya kukhokelela ekulahlekeni kwedatha.
Emva kokuba uqalise ibhinary enye okanye inguqulelo edibeneyo, kufuneka udibanise iPrometheus kuqwalaselo. ukuze iqalise ukubhala idatha ngokuhambelana nokugcinwa kwendawo kunye nokugcinwa kude. Njengoko ubona, olu lungelelwaniso kufuneka lusebenze ngokuthembekileyo ngakumbi xa kuthelekiswa noqwalaselo lwe-Thanos. Asidingi ukugcina uxhulumaniso oluvela kwi-VictoriaMetrics kuyo yonke i-Prometheus, kuba i-Prometheus ngokwayo idibanisa kwi-VictoriaMetrics kwaye idlulisela idatha.
Masithathele ingqalelo inkxaso yeThanos kunye neVictoriaMetrics.
I-Thanos kufuneka ibeke iliso kwi-Sidecar ukuqinisekisa ukuba ayiyeki ukulayisha idatha kwi-Object Storage. Basenokukuyeka ukhuphelo lwedatha ngenxa yeempazamo zokukhuphela, umzekelo uqhagamshelo lwenethiwekhi yakho kuGcino lweNto luphazamiseke okwethutyana, okanye uGcino lweNgcaciso alufumaneki okwexeshana. I-Thanos Sidecar iyakuqaphela oku ngalo mzuzu, xela impazamo, inokuthi ingqubeke kwaye iyeke ukusebenza. Ukuba awuyibek' iliso, ngoko uya kuyeka ukudlulisela idatha kwi-Object Storage. Ukuba ixesha lokugcinwa lidlula (iiyure ezi-6-8 zicetyiswa), ngoko uya kulahlekelwa yidatha engazange iphele kwi-Object Storage.
I-Thanos compactors inokuyeka ukusebenza ngenxa . I-Compactors ithatha idatha kwi-Object Storage kwaye idibanise ibe ngamaqhekeza amakhulu edatha. Ekubeni ii-compactors azihambelani kunye ne-Sidecars, oku kulandelayo kunokwenzeka: I-Sidecar ayizange ibe nexesha lokugqiba ibhloko, i-Compactor inquma ukuba le bloko ibhalwe ngokupheleleyo. ICompactor iqalisa ukuyifunda. Ayifundi ibhloko ngokupheleleyo kwaye iyeke ukusebenza. Bona iinkcukacha .
Gcina iSango linokubuyisela idatha engahambelaniyo ngenxa yeentlanga phakathi kweCompactor kunye neSidecars. Kwenzeka into efanayo apha, kuba iSango leSitolo alihambelani neeCompactors kunye neeSidecars nangayiphi na indlela. Ngokufanelekileyo, iimeko zobuhlanga zinokuthi zenzeke xa iSango leSitolo lingaboni inxalenye yedatha okanye libona idatha engadingekile.
Icandelo loMbuzo kwi-Thanos ngokungagqibekanga libuyisela isiphumo esingaphelelanga ukuba ezinye ii-Sidecars okanye iiSango zoGcino azikho okwangoku. Uya kufumana inxalenye yedatha, kwaye awuyi kwazi nokuba awuyifumani yonke idatha. Le yindlela esebenza ngayo ngokungagqibekanga. Kwimeko efanayo, iVictoriaMetrics ibuyisela idatha ephawulweyo njengenxalenye.
Ngokungafaniyo neThanos, iVictoriaMetrics ayifane iphulukane nedatha. Nangona uxhulumaniso oluvela kwi-Prometheus ukuya kwi-VictoriaMetrics luphazamisekile, oku akuyona ingxaki, ekubeni u-Prometheus uqhubeka nokurekhoda idatha entsha engenayo kwi-Write Ahead Log, ubungakanani bayo buyi-2 iiyure. Ukuba ubuyisela uqhagamshelo lwakho kwiVictoriaMetrics ngaphakathi kweyure ezimbini, idatha yakho ayizukulahleka. Prometheus .
Ngokungafaniyo ne-Thanos, ebhala idatha yokugcina into kuphela emva kweeyure ezimbini, i-Prometheus iphinda iphindaphinda idatha isebenzisa i-protocol yokubhala ekude kwindawo yokugcina kude, njenge-VictoriaMetrics. Awukoyiki ukuphulukana nokugcinwa kwendawo kwiPrometheus. Ukuba ulahlekelwe ngokukhawuleza ukugcinwa kwendawo, ngoko kwimeko embi kakhulu uya kulahlekelwa imizuzwana yokugqibela yedatha engazange ibe nexesha lokurekhoda kwisitoreji esikude.
IKubernetes ilawula ngokuzenzekelayo iqela, ngokungafaniyo neThanos. Kunzima ukubeka onke amacandelo e-Thanos kwiqela elinye le-Kubernetes, ngokungafaniyo namacandelo eqela le-VictoriaMetrics.
IVictoriaMetrics inohlaziyo olulula kakhulu kuguqulelo olutsha. Yeka nje iVictoriaMetrics, hlaziya iibhinari kwaye uyiqalise. Xa umisiwe ngophawu lwe-SIGINT, zonke ii-binaries ze-VictoriaMetrics zenza ukuvalwa kakuhle. Bagcina ngokuchanekileyo idatha efunekayo, bavale uxhulumaniso olungenayo ngokuchanekileyo ukuze bangalahlekelwa nantoni na. Ngoko awuyi kulahlekelwa nantoni na xa uphucula.
IVictoriaMetrics yenza kube lula kakhulu ukwandisa iqela. Yongeza nje amacandelo ayimfuneko kwaye uqhubeke usebenza.
Malunga nemigibe kwiThanos kunye neVictoriaMetrics.
IThanos inemigibe ilandelayo. U-Prometheus kufuneka agcine idatha kwiiyure ezimbini zokugqibela. Ukuba bayalahleka, uya kuphulukana nabo ngokupheleleyo kuba abakabhalelwa kwi-Object Storage efana ne-S3.
Icandelo leSango leSitolo kunye necandelo le-compactor lingafuna imemori eninzi yokusebenza kunye neSitoreji esikhulu seNto ukuba kukho iifayile ezincinci ezigcinwe apho. Okukhona inani elikhulu kunye nobukhulu beefayile, kokukhona iSango lokuGcina iSango kunye ne-RAM edibeneyo ifuneka ukugcina ulwazi. UThanos unemiba emininzi malunga nokuba .
I-Thanos ipapashiwe ukuba ikhule ngokungenasiphelo kunye nesixa sePrometheus onayo. Oku ngokwenene akuyonyani. Kuba zonke izicelo zihamba ngecandelo le-Query, ekufuneka ngaxeshanye livote onke amacandelo e-Store Gateway kunye nawo onke amacandelo e-Sidecar, tsala idatha ukusuka apho kwaye uyiqhube phambili. Ngokucacileyo, isantya sesicelo sikhawulelwe likhonkco elicothayo elibuthathaka, elona licothayo iSango leSitolo okanye eyona Sidecar icothayo.
Ezi zixhobo zinokungalayishwa ngokulinganayo. Umzekelo, unePrometheus, eqokelela izigidi zeemethrikhi ngomzuzwana. Kwaye kukho iPrometheus, eqokelela amawaka eemitha ngomzuzwana. I-Prometheus, eqokelela izigidi zeemethrikhi ngesekhondi, ibeka umthwalo ophezulu kakhulu kwiseva eqhuba kuyo. Ngokufanelekileyo, iSidecar isebenza kancinci apho. Kwaye ngokubanzi yonke into isebenza ngokukhawuleza apho. Kwaye icandelo loMbuzo liya kutsala idatha ukusuka apho ngokucotha kakhulu. Ngokufanelekileyo, ukusebenza kweqela lakho lonke kuya kuthintelwa yile Sidecar icothayo.
Ngokungagqibekanga, iThanos inika idatha engaphelelanga ukuba ezinye iiSidecars kunye nokuba iSango leSitolo alikho. Umzekelo, ukuba iiSidecars zakho zisasazeke kwihlabathi liphela kumaziko edatha ahlukeneyo, ngoko ke ukubakho kokusilela konxibelelwano kunye nokungafumaneki kwecandelo kuyanda kakhulu. Ngokufanelekileyo, kwiimeko ezininzi uya kufumana idatha engaphelelanga ngaphandle kokwazi.
IVictoriaMetrics nayo inemigibe. Umngxunya wokuqala lukhetho olunciphisa ubungakanani be-RAM esetyenziselwa iVictoriaMetrics cache. Ngokungagqibekanga, ilingana ne-60% ye-RAM kumatshini apho i-VictoriaMetrics isebenza okanye i-60% ye-RAM ye-VictoriaMetrics pod e-Kubernetes.
Ukuba utshintsha eli xabiso ngokungalunganga, ungonakalisa ukusebenza kweVictoriaMetrics. Umzekelo, ukuba ubeka ixabiso eliphantsi kakhulu, idatha inokungaphinde ingene kwi-VictoriaMetrics cache. Ngenxa yoku, kuya kufuneka enze umsebenzi owongezelelweyo kwaye alayishe iprosesa kunye nediski. Ukuba wenza olu khetho lube lukhulu kakhulu, luyanda, okokuqala, ukuba nokwenzeka ukuba iVictoriaMetrics iya kuphazamiseka ngempazamo yememori, kwaye, okwesibini, iya kukhokelela kwinto yokuba kuya kubakho i-RAM encinci kakhulu eshiyekileyo kwimemori yenkqubo yokusebenza. indawo yokugcina ifayile. Kwaye iVictoriaMetrics ixhomekeke kwi-cache yefayile yokusebenza. Ukuba akwanelanga, umthwalo kwidiski unokunyuka kakhulu. Ngoko ke, ingcebiso: musa ukutshintsha iparameter ngaphandle kokuba kuyimfuneko.
Inketho yesibini. Le yi-retentionPeriod - ixesha elimiselwe kwinyanga e-1 ngokungagqibekanga. Obu bubude bexesha iVictoriaMetrics igcina idatha. Emva kweli xesha, iVictoriaMetrics icima idatha.
Abantu abaninzi baqhuba iVictoriaMetrics ngaphandle kwale parameter kwaye barekhode idatha yenyanga. Kwaye ke bayabuza: kutheni idatha yenyanga edlulileyo yanyamalala? Kuba iRetentionPeriod yinyanga enye. Ke ngoko, kufuneka wazi kwaye usete iRetentionPeriod echanekileyo.
Makhe sijonge kwiimpawu ezizodwa.
I-Thanos inophawu olubizwa ngokuba yi-downsampling: imizuzu emi-5 kunye nekhefu leyure, elihlala likhona . Ukuba u-google kwaye ujonge umba wabo kwi-github, kukho imiba emininzi ehambelana nale sampuli, ukuba ngamanye amaxesha ayisebenzi ngokuchanekileyo, okanye ayisebenzi njengoko abasebenzisi belindele.
I-Thanos inokutsalwa kwedatha kwi-Prometheus HA ngababini. Xa i-Prometheus ezimbini ziqokelela iimetriki ezifanayo kwiithagethi ezifanayo kwaye i-Thanos igcina kwi-Object Storage. I-Thanos inokuphinda ikhuphe le datha ngokufanelekileyo, ngokungafaniyo neVictoriaMetrics.
I-Thanos inecandelo lesilumkiso elalikwi-Thanos schematic. Kodwa yena .
I-Thanos inenzuzo yokuba i-Thanos kunye ne-Prometheus babelane ngekhowudi efanayo. I-Thanos kunye nePrometheus ziphuhliswa ngabaphuhlisi abafanayo. Ngokuphuculwa kweThanos okanye iPrometheus, elinye icala liyaphumelela.
Inqaku eliphambili leVictoriaMetrics yiMetricsQL. Ezi zizandiso zeVictoriaMetrics zePromQL, endithethe ngazo kwindibano enkulu yokubeka iliso yangaphambili.
IVictoriaMetrics ixhasa ukulayishwa kwedatha kusetyenziswa iiprothokholi ezininzi ezahlukeneyo. I-VictoriaMetrics ayinakuvuma kuphela idatha evela kwi-Prometheus, kodwa kunye ne-Influx, i-OpenTSDB kunye neeprothokholi ze-Graphite.
Idatha yeVictoriaMetrics ithatha indawo encinci kakhulu xa ithelekiswa neThanos kunye nePrometheus.
Ukuba urekhoda idatha yangempela, abasebenzisi bathetha ngamaxesha e-2-5 ukunciphisa ubungakanani bedatha kwidiski xa kuthelekiswa nePrometheus kunye neThanos.
Enye inzuzo yeVictoriaMetrics kukuba ilungiselelwe isantya.
Makhe sijonge iindleko zeziseko zophuhliso.
Enye yeenzuzo zeThanos kukuba igcina idatha kwindawo yokugcina into, enexabiso eliphantsi.
Xa ugcina idatha kwindawo yokugcina into, kufuneka uhlawulele idatha yokubhala kunye nokufunda imisebenzi (i-$ 10 ngezigidi zokusebenza). Xa ubhala idatha yokugcina into, uhlawula iindleko zakho zokubamba ukulayisha idatha kwi-Intanethi; ukuba iqoqo lakho alikho kwi-AWS, ikhululekile apho. Xa ufunda idatha, uhlawula phakathi kwe-$ 10 kunye ne-$ 230 nge-1TB nganye. Oku kunokubaluleka ukuba uhlala ubuza idatha yembali kwiqela le-Thanos.
Kwiqela le-Thanos, kufuneka uhlawule iiseva zeCompact, iSango leSitolo, amacandelo oMbuzo afuna imemori eninzi, kunye ne-CPU yedatha enkulu.
IVictoriaMetrics inezi ndleko zilandelayo. Ukuba ugcina idatha kwi-GCE HDD drives, ngoko iphuma kwi-$ 40 ye-1TB. Kwi-VictoriaMetrics, iidrive ze-HDD eziqhelekileyo zanele; akukho zi-SSD, ezixabisa ngokuphindwe kahlanu ngaphezulu, ziyafuneka. IVictoriaMetrics ilungiselelwe iHDD.
I-VictoriaMetrics ifuna iiseva kumacandelo: nokuba yi-single-nod okanye amacandelo adibeneyo, anokuthi, ngokungafaniyo namacandelo e-Thanos, afune ngaphantsi kwe-CPU kunye ne-RAM-kwaye iya kuba nexabiso eliphantsi.
Imizekelo yokuphunyezwa.
I-Thanos inomzekelo wokuphunyezwa kwi-Gitlab. IGitlab isebenza ngokupheleleyo kwiThanos. Kodwa asiyiyo yonke into egudileyo apho. Ukuba ujonga kubo , ngoko unokubona ukuba bahlala benazo : Akukho nkumbulo yaneleyo yeSango loGcino okanye icandelo loMbuzo. Bahlala kufuneka bandise inani lememori.
Ngenxa yoku, iindleko zokusombulula ezi ngxaki zonyuka.
Ukuphunyezwa kwesibini, okunokuthi kube yimpumelelo ngakumbi, yinkampani ye-Improbable, eyaqala ukuphuhlisa i-Thanos. Bapapashe ikhowudi yomthombo weThanos. I-Improbable yinkampani ephuhlisa iinjini zomdlalo.
IVictoriaMetrics inemizekelo yokuphunyezwa koluntu:
- wix.com umakhi wewebhusayithi
- I-Adidas iphumeza iVictoriaMetrics kwaye yenza nenkcazo kwiPromCon yokugqibela ka-2019
- TrafficStars - inethiwekhi yentengiso
- I-Seznam.cz yinjini yokukhangela edumileyo yaseCzech.
Kwaye ke bekukho iinkampani ezingenamagama endingenakuzichaza ngoku. Abavumanga.
- Omnye umqhubi omkhulu womdlalo. Enkulu kune-im Ingenakwenzeka.
- Umqambi wesoftware yemizobo emikhulu.
- Ibhanki enkulu yaseRashiya.
- Umenzi weinjini yomoya waseYurophu ovavanye ngempumelelo iVictoriaMetrics. Lo mvelisi uphumeza iVictoriaMetrics ukujonga idatha eqokelelwe kwiiinjini zomoya kwireyithi yeesampulu ezingama-50 ngesekondi nganye. Iinjini yomoya nganye inamakhulu aliqela abenzi boluvo. Banee-injini zomoya ezingamakhulu aliqela.
- Iinqwelomoya zaseRussia ezifuna ukuphumeza iVictoriaMetrics, kodwa azikwazi. Sikwinqanaba lekhontrakthi kunye nabo.
Izigqibo.
IVictoriaMetrics kunye neThanos zisombulula iingxaki ezifanayo, kodwa ngeendlela ezahlukeneyo:
- Imbono yombuzo wehlabathi
- ukukala okuthe tye
- ukugcinwa okungenasizathu
Π‘ΠΏΠ°ΡΠΈΠ±ΠΎ.
Sikulindile wethu .
Ngabasebenzisi ababhalisiweyo kuphela abanokuthatha inxaxheba kuphando. , ndiyacela.
Usebenzisa ntoni ukugcinwa kwexesha elide kwiPrometheus?
-
35,3%Thanos6
-
0,0%ICortex0
-
0,0%M3DB0
-
41,2%VictoriaMetrics7
-
23,5%ezinye4
Bali-17 abasebenzisi abavotileyo. Abasebenzisi abasi-16 abakhange.
umthombo: www.habr.com