Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Assalamu alaikum. A ƙasa akwai rubutun rahoto daga Babban Sa Ido Meetup 4.

Prometheus - tsarin kulawa don tsarin da ayyuka daban-daban, tare da taimakon abin da masu gudanar da tsarin zasu iya tattara bayanai game da sigogi na yanzu da kuma saita faɗakarwa don karɓar sanarwa game da sabawa a cikin tsarin aiki.

Rahoton zai hada da kwatance Thanos и VictoriaMetrics - ayyukan don adana dogon lokaci na ma'aunin Prometheus.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Yi bidiyo

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Na farko, zan gaya muku game da Prometheus. Wannan tsarin sa ido ne wanda ke tattara ma'auni daga ƙayyadaddun maƙasudai kuma yana adana su zuwa ma'ajiyar gida. Prometheus na iya yin rikodin ma'auni zuwa ma'ajiya mai nisa kuma yana iya haifar da faɗakarwa da dokokin rikodi.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Iyakokin Prometheus:

  • Ba shi da kallon tambaya ta duniya. Wannan shine lokacin da kuke da lokuta masu zaman kansu da yawa na prometheus. Suna tattara awo. Kuma kuna son yin tambaya akan duk waɗannan ma'auni waɗanda aka tattara daga lokuta daban-daban na prometheus. Prometheus baya ƙyale wannan.
  • Tare da prometheus, aikin yana iyakance ga uwar garken guda ɗaya kawai. Prometheus baya yin ma'auni ta atomatik a tsakanin sabar da yawa. Da hannu kawai za ku iya raba makasudin ku tsakanin Prometheus da yawa.
  • Iyakar ma'auni a cikin Prometheus yana iyakance ga uwar garken guda ɗaya kawai don dalili ɗaya cewa ba zai iya yin ƙima ta atomatik a cikin sabar da yawa.
  • Ba shi da sauƙi don tsara amincin bayanai a cikin Prometheus.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Magani ga waɗannan matsalolin / ƙalubale?

Mafita su ne:

Duk waɗannan mafita don ajiyar nesa ne na bayanan da Prometheus ya tattara. Suna magance matsalar ajiya mai nisa daga faifan da ta gabata ta hanyoyi daban-daban. A cikin wannan gabatarwar zan yi magana ne kawai game da mafita biyu na farko: Thanos и VictoriaMetrics.

A karon farko bayani game da Thanos ya bayyana ta wannan haɗin. An kwatanta gine-ginen a can Thanos da yadda yake aiki.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana ɗaukar bayanan da Prometheus ya adana zuwa faifan gida ya kwafa shi zuwa S3, zuwa GCS ko zuwa wani abu ajiya.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Don haka Thanos yana ba da kallon tambaya ta duniya. Kuna iya tambayar bayanan da aka adana a cikin ma'ajin abu daga lokuta da yawa na Prometheus.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana goyan bayan PromQL da Prometheus querying API.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana amfani da lambar Prometheus don adana bayanai.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana haɓaka ta masu haɓaka iri ɗaya kamar Prometheus.

a kan VictoriaMetrics. Anan mahada, inda muka fara magana akai VictoriaMetrics.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics na karɓar bayanai daga prometheus da yawa API ɗin rubutu mai nisa Prometheus yana goyan bayan yarjejeniya.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics yana ba da kallon tambaya ta duniya, tun da yawancin lokuta na Prometheus na iya rubuta bayanai zuwa ɗaya VictoriaMetrics. Don haka, zaku iya yin tambayoyi akan duk waɗannan bayanan.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics kuma yana goyan bayan, kamar Thanos, PromQL da Prometheus querying API.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Ba kamar Thanos ba, an rubuta lambar tushe ta VictoriaMetrics daga karce kuma an inganta ta don sauri da amfani da albarkatu.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics, sabanin Thanos, ma'auni duka a tsaye da a kwance. Ku ci Sigar kumburi guda ɗaya, wanda ke yin ma'auni a tsaye. Kuna iya farawa da processor ɗaya da 1 GB na ƙwaƙwalwar ajiya kuma a hankali ku girma zuwa ɗaruruwan na'urori masu sarrafawa da 1 TB na ƙwaƙwalwar ajiya. VictoriaMetrics na iya amfani da duk waɗannan albarkatun. Ayyukansa zai ƙaru da kusan sau 100 idan aka kwatanta da tsarin 1-core.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Tarihin Thanos ya fara a watan Nuwamba 2017, lokacin da alƙawarin jama'a na farko ya bayyana. Kafin wannan, an haɓaka Thanos a ciki mai yuwuwa.io.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

A cikin watan Yuni 2019 an sami fitowar tambarin 0.5.0, wanda a ciki cire tsegumi yarjejeniya. An cire shi daga Thanos saboda bai yi kyau ba. Sau da yawa gungu na Thanos bai yi aiki daidai ba, nodes sun haɗa da shi ba daidai ba saboda ƙa'idar tsegumi. Saboda haka, muka yanke shawarar cire shi daga can. Ina ganin wannan shine shawarar da ta dace.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

A cikin watan Yunin 2019, sun aika lambar aikace-aikacen 256 в Gidauniyar putididdigar ativeasar Cloud.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Kuma bayan watanni biyu an karɓi Thanos Gidauniyar putididdigar ativeasar Cloud, wanda ya hada da Prometheus, Kubernetes da sauran shahararrun ayyukan.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

A cikin Janairu 2018, ci gaban VictoriaMetrics ya fara.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

A cikin Satumba 2018, na ambaci VictoriaMetrics a bainar jama'a a karon farko.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

A cikin Disamba 2018, an buga sigar kuɗaɗi ɗaya.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

A watan Mayu 2019 aka buga tushen duka Single-node da cluster iri.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

A watan Yuni 2019, kamar Thanos, mun ƙaddamar da aikace-aikacen zuwa tushe na CNCF a ƙarƙashin lamba 255. Mun nema kwana daya kafin Thanos ya nema.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Amma, abin takaici, har yanzu ba a karɓi mu a can ba. Ana buƙatar taimakon al'umma.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bari mu kalli mafi mahimmanci nunin faifai masu nuna gine-ginen Thanos da VictoriaMetrics.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bari mu fara da Thanos. Abubuwan rawaya sune abubuwan Prometheus. Komai sauran abubuwan Thanos ne. Bari mu fara da mafi mahimmancin sashi. Thanos Sidecar wani sashi ne wanda aka shigar kusa da kowane Prometheus. Yana loda bayanan Prometheus daga ma'ajiyar gida zuwa S3 ko wani Ma'ajiyar Abu.

Hakanan akwai wani sashi mai suna Thanos Store Gateway, wanda zai iya karanta wannan bayanan daga Ma'ajiyar Abu akan buƙatun shigowa daga Thanos Query. Thanos Query yana aiwatar da PromQL da Prometheus API. Wato, daga waje yana kama da Prometheus. Yana karɓar tambayoyin PromQL, aika su zuwa Thanos Store Gateway, Thanos Store Gateway yana maido da mahimman bayanai daga Ma'ajiyar Abu, mayar da shi.

Amma muna adana bayanai a cikin Ma'ajiyar Abubuwan Ba ​​tare da sa'o'i biyu na ƙarshe ba saboda wani fasalin aiwatarwa na Thanos Sidecar, wanda ba zai iya loda sa'o'i biyu na ƙarshe zuwa Object Storage S3 ba, tunda Prometheus bai riga ya ƙirƙiri fayiloli na waɗannan sa'o'i biyu a cikin ajiyar gida ba.

Ta yaya kuka yanke shawarar zagaya wannan? Thanos Query, ban da buƙatun zuwa Ƙofar Store na Thanos, yana aika buƙatun layi ɗaya zuwa kowane Thanos Sidecar, wanda ke kusa da Prometheus.

Kuma Thanos Sidecar, bi da bi, proxies yana buƙatar ƙarin zuwa Prometheus, kuma yana maido da bayanai na sa'o'i biyu na ƙarshe.

Baya ga waɗannan abubuwan haɗin gwiwa, akwai kuma wani ɓangaren zaɓi wanda ba tare da Thanos ba zai yi kyau ba. Wannan Thanos Compact ne, wanda ke da alhakin haɗa ƙananan fayiloli akan Adana Abubuwan zuwa manyan fayiloli waɗanda Thanos Sidecars ya ɗora a nan. Thanos Sidecar yana loda fayilolin bayanai a wurin cikin sa'o'i biyu. Waɗannan fayilolin, idan ba a haɗa su cikin manyan fayiloli ba, to adadin su na iya girma sosai. Yawancin irin waɗannan fayiloli, ana buƙatar ƙarin ƙwaƙwalwar ajiya don Thanos Store Gateway, ana buƙatar ƙarin albarkatun don canja wurin bayanai akan hanyar sadarwa da metadata. Thanos Store Gateway ya zama mara amfani. Sabili da haka, ya zama dole a gudanar da Thanos Compact, wanda ke haɗa ƙananan fayiloli zuwa manyan fayiloli, ta yadda za a sami ƙarancin irin waɗannan fayiloli kuma a rage sama a kan Ƙofar Shagon Thanos.

Hakanan akwai irin wannan bangaren kamar Thanos Ruler. Yana aiwatar da ƙa'idodin faɗakarwa na Prometheus kuma yana iya kimanta ƙa'idodin rikodin Prometheus don rubuta bayanai zuwa Ajiyayyen Abu. Amma wannan bangaren ba a ba da shawarar a yi amfani da shi ba, saboda ... Shi yana son dawo da bayanan da basu cika ba.

Wannan shine tsari mai sauƙi na Thanos.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Yanzu bari mu kwatanta shi da tsarin VictoriaMetrics.

VictoriaMetrics yana da nau'ikan guda biyu: Single-node da sigar tari. Single-node yana gudana akan kwamfuta ɗaya. Kudi ɗaya bashi da waɗannan abubuwan haɗin gwiwa, binary guda ɗaya kawai. Wannan binary akan faifai yayi kama da wannan murabba'in. Duk abin da ke cikin murabba'in shine abinda ke cikin fayil ɗin binary don sigar Single-node. Ba kwa buƙatar saninsa. Kuna kawai gudanar da binary kuma komai yana aiki a gare mu.

Sigar tari ya fi rikitarwa. A ciki akwai abubuwa daban-daban guda uku: vmselect, vminsert da vmstorage. Daga sunayensu ya kamata a bayyana abin da kowannensu yake yi. Bangaren Saka yana karɓar bayanai ta nau'i daban-daban: daga Prometheus m rubuta API, ka'idar layin Influx, ka'idar Graphite da ka'idar OpenTSDB. Bangaren Insert ɗin yana karɓar su, ya ƙididdige su kuma ya rarraba su tsakanin abubuwan da ke akwai, inda aka riga aka adana bayanan. Sashin Zaɓi, bi da bi, yana karɓar tambayoyin PromQL. Yana aiwatarwa PromQL, da kuma Prometheus querying API, kuma ana iya amfani dashi azaman maye gurbin Prometheus a Grafana ko wasu abokan cinikin Prometheus API. Zaɓi yana karɓar buƙatun promql, ya ƙididdige shi, karanta mahimman bayanai don aiwatar da wannan buƙatar daga nodes ɗin ajiya, sarrafa wannan bayanan kuma ya mayar da martani.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bari mu kwatanta hadaddun shigar Thanos da VictoriaMetrics.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bari mu fara da Thanos. Kafin ka fara aiki tare da Thanos, kana buƙatar ƙirƙirar guga a cikin Ma'ajiyar Abu, kamar S3 ko GCS, ta yadda Thanos Sidecar zai iya rubuta bayanai zuwa gare shi.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Sannan ga kowane Prometheus kuna buƙatar shigar da Thanos Sidecar. Kafin wannan, kuna buƙatar tunawa don musaki tattara bayanai a cikin Prometheus. Ƙirƙirar bayanai lokaci-lokaci tana matsa bayanai a cikin ma'ajin Prometheus na gida don rage yawan amfani da albarkatu.

Lokacin da kuka shigar da Thanos Sidecar akan Prometheus ɗinku, dole ne ku kashe wannan haɗin bayanan, saboda Thanos Sidecar baya aiki yadda yakamata tare da kunna bayanan bayanan. Wannan yana nufin cewa Prometheus ɗin ku ya fara adana bayanai a cikin sa'o'i biyu na sa'o'i kuma ya daina haɗa waɗannan tubalan zuwa manyan. Saboda haka, idan kun yi tambayoyin da suka wuce tsawon sa'o'i biyu da suka gabata, to ba za su yi aiki yadda ya kamata ba kamar yadda za su iya aiki idan an kunna tattara bayanan.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Sabili da haka, Thanos ya ba da shawarar rage lokacin riƙe bayanai a cikin ajiyar gida zuwa sa'o'i 6-8 don rage yawan adadin ƙananan tubalan.

Da zarar kun shigar da Thanos Sidecar, dole ne ku shigar da abubuwa biyu don kowane Bucket Storage Abu. Waɗannan su ne Thanos Compactor da Thanos Store Gateway.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bayan haka, kuna buƙatar shigar da Thanos Query kuma saita shi ta yadda zai iya haɗawa da duk Ƙofar Shagon Thanos da kuke da shi, kuma yana iya haɗawa da duk Thanos Sidecars.

Ana iya samun matsala kaɗan a nan.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Kuna buƙatar saita ingantaccen haɗin gwiwa mai aminci daga Thanos Query zuwa waɗannan abubuwan haɗin gwiwa. Kuma idan Prometheus ɗinku yana cikin cibiyoyin bayanai daban-daban, ko a cikin VPC daban-daban, to an haramta haɗin kai zuwa gare su daga waje. Amma don Thanos Query ya yi aiki, kuna buƙatar saita hanyar haɗin gwiwa ta wata hanya, kuma dole ne ku gano hanya.

Idan kuna da yawa irin waɗannan cibiyoyin bayanai, to, daidai da haka, amincin tsarin duka yana raguwa. Tun da Thanos Query dole ne ya ci gaba da kiyaye haɗin kai zuwa duk Thanos Sidecars waɗanda ke cikin cibiyoyin bayanai daban-daban. Ga kowane buƙatun mai shigowa, zai bi da buƙatun zuwa duk Thanos Sidecars. Idan haɗin ya katse, ko dai za ku sami bayanan da bai cika ba, ko kuma za ku sami amsa "cluster is down".

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

A cikin VictoriaMetrics komai yana da ɗan sauƙi. Domin sigar Single-node, kawai kuna buƙatar gudanar da binary guda ɗaya kuma komai yana aiki.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

A cikin cluster version, ya isa ya gudanar da duk nau'ikan abubuwa uku na sama a kowane adadin da kuke buƙata, ko amfani da su. tsarin mulki don sarrafa ƙaddamar da abubuwan haɗin gwiwa a cikin Kubernetes. Muna kuma shirin yin ma'aikacin Kubernetes. Taswirar Helm baya rufe wasu lokuta kuma yana ba ku damar harbi kanku a ƙafa. Misali, yana ba ku damar rage adadin nodes ɗin ajiya, wanda zai haifar da asarar bayanai.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bayan kun ƙaddamar da nau'in binary guda ɗaya ko sigar tari, kawai kuna buƙatar ƙara Prometheus zuwa saitin. saitin url rubutun nesata yadda za a fara rubuta bayanai a layi daya da ma'ajiyar gida da ma'ajiyar nesa. Kamar yadda kuke gani, wannan saitin ya kamata yayi aiki da dogaro sosai idan aka kwatanta da daidaitawar Thanos. Ba ma buƙatar kiyaye haɗin kai daga VictoriaMetrics zuwa duk Prometheus, saboda Prometheus da kansu suna haɗawa zuwa VictoriaMetrics kuma suna watsa bayanai.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bari mu yi la'akari da goyon bayan Thanos da VictoriaMetrics.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana buƙatar saka idanu Sidecar don tabbatar da cewa basu daina loda bayanai a cikin Ma'ajiyar Abu ba. Suna iya dakatar da wannan zazzagewar bayanan saboda kurakuran zazzagewa, misali haɗin yanar gizon ku zuwa Ma'ajiyar Abu ya katse na ɗan lokaci, ko Ma'ajiyar Abu ba ta samuwa na ɗan lokaci. Thanos Sidecar zai lura da wannan a wannan lokacin, ba da rahoton kuskure, na iya faɗuwa sannan ya daina aiki. Idan baku saka idanu ba, to zaku daina tura bayanai zuwa Ma'ajiyar Abu. Idan lokacin riƙewa ya wuce (yawan sa'o'i 6-8 da aka ba da shawarar), to za ku rasa bayanan da ba su ƙare cikin Ma'ajiyar Abu ba.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos compactors na iya daina aiki saboda tsere tare da Sidecar. Compactors suna ɗaukar bayanai daga Ma'ajiyar Abu kuma su haɗa su cikin manyan bayanai. Tun da compactors ba a daidaita su tare da Sidecars, wadannan na iya faruwa: Sidecar bai riga ya sami lokacin da za a kammala block, Compactor yanke shawarar cewa wannan block da aka gaba daya rubuta. Compactor ya fara karanta shi. Ba ya karanta block gaba ɗaya kuma ya daina aiki. Duba cikakkun bayanai a nan.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Ƙofar Store na iya dawo da bayanai marasa daidaituwa saboda tsere tsakanin Compactor da Sidecars. Haka abin yake faruwa a nan, saboda Ba a haɗa Ƙofar Store da Compactors da Sidecars ta kowace hanya. Saboda haka, yanayin tsere na iya faruwa lokacin da Ƙofar Store ba ta ga ɓangaren bayanan ba ko ga bayanan da ba dole ba.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bangaren tambaya a cikin Thanos ta tsohuwa yana dawo da wani sashi na sakamako idan wasu Sidecars ko Ƙofar Store ba su samuwa a yanzu. Za ku karɓi wani ɓangare na bayanan, kuma ba za ku ma san cewa ba ku karɓi duk bayanan ba. Wannan shine yadda yake aiki ta tsohuwa. A cikin irin wannan yanayi, VictoriaMetrics yana dawo da bayanan da aka yiwa alama a matsayin ɓangare.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Ba kamar Thanos ba, VictoriaMetrics ba kasafai ke yin asarar bayanai ba. Ko da an katse haɗin daga Prometheus zuwa VictoriaMetrics, wannan ba matsala ba ne, tun da Prometheus ya ci gaba da yin rikodin sababbin bayanai masu shigowa a cikin Rubutun Gaba, wanda girmansa shine 2 hours. Idan kun dawo da haɗin ku zuwa VictoriaMetrics a cikin sa'o'i biyu, bayananku ba za su rasa ba. Prometheus na iya ƙara bayanai bayan maido da haɗin kai zuwa VictoriaMetrics.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Ba kamar Thanos ba, wanda ke rubuta bayanai zuwa ajiyar abu kawai bayan sa'o'i biyu, Prometheus yana kwafin bayanai ta atomatik ta amfani da ka'idar rubuta ta nesa zuwa ma'aji mai nisa, kamar VictoriaMetrics. Ba kwa tsoron rasa ma'ajiyar gida a cikin Prometheus. Idan ba zato ba tsammani ya rasa ma'ajiyar gida, to, a cikin mafi munin yanayi za ku rasa sakan na ƙarshe na bayanan da ba su da lokacin da za a yi rikodin su a cikin ma'ajiyar nesa.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Kubernetes yana sarrafa gungu ta atomatik, sabanin Thanos. Yana da wahala a sanya duk abubuwan Thanos cikin gungu na Kubernetes guda ɗaya, sabanin abubuwan haɗin gwanon VictoriaMetrics.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics yana da sabuntawa mai sauƙi ga sabon sigar. Kawai dakatar da VictoriaMetrics, sabunta binaries kuma kaddamar da shi. Lokacin da aka tsaya ta siginar SIGINT, duk binaries na VictoriaMetrics suna yin kyakkyawan rufewa. Suna adana bayanan da ake buƙata daidai, rufe haɗin haɗin da ke shigowa daidai don kada a rasa wani abu. Don haka ba za ku rasa komai ba yayin haɓakawa.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics yana ba da sauƙin faɗaɗa tari. Kawai ƙara abubuwan da ake buƙata kuma ci gaba da aiki.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Game da ramuka a cikin Thanos da VictoriaMetrics.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana da ramummuka masu zuwa. Prometheus dole ne ya adana bayanai na sa'o'i biyu na ƙarshe. Idan sun ɓace, za ku rasa su gaba ɗaya saboda har yanzu ba a rubuta su zuwa Ma'ajiyar Abu kamar S3 ba.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bangaren Ƙofar Store da ɓangaren compactor na iya buƙatar ƙwaƙwalwar ajiya mai yawa don aiki tare da babban Ma'ajiyar Abu idan akwai ƙananan fayiloli da yawa da aka adana a wurin. Mafi girman adadin da girman fayiloli, ana buƙatar ƙarin Ƙofar Store da compactor RAM don adana bayanan metain. Thanos yana da batutuwa da yawa game da gaskiyar hakan Ajiye Ƙofar da ƙwanƙwasa ƙwanƙwasa tare da matsakaicin juzu'i na bayanan da aka yi rikodi.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Ana tallata Thanos zuwa sikelin har abada tare da adadin Prometheus da kuke da shi. Wannan ba gaskiya ba ne. Tun da duk buƙatun suna tafiya ta ɓangaren Tambaya, wanda dole ne a yi zabe a lokaci guda duk abubuwan da aka haɗa na Store Gateway da duk abubuwan Sidecar, cire bayanai daga can sannan a aiwatar da shi. A bayyane yake, saurin buƙatun yana iyakance ta hanyar mahaɗin mafi rauni a hankali, Ƙofar Store mafi hankali ko Sidecar mafi hankali.

Ana iya ɗora waɗannan abubuwan ba daidai ba. Misali, kuna da Prometheus, wanda ke tattara miliyoyin ma'auni a sakan daya. Kuma akwai Prometheus, wanda ke tattara dubban ma'auni a sakan daya. Prometheus, wanda ke tattara miliyoyin ma'auni a sakan daya, yana sanya kaya mafi girma akan sabar da yake aiki a kai. Saboda haka, Sidecar yana aiki a hankali a can. Kuma gabaɗaya komai yana aiki sannu a hankali a can. Kuma bangaren tambaya zai ciro bayanai daga can sannu a hankali. Saboda haka, aikin ku duka zai iyakance ta wannan jinkirin Sidecar.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Ta hanyar tsoho, Thanos yana ba da bayanan ɓangarori idan wasu Sidecars da ko dai Ƙofar Store ba su samuwa. Misali, idan Sidecars ɗinku sun warwatse a ko'ina cikin duniya a cibiyoyin bayanai daban-daban, to yuwuwar gazawar haɗin gwiwa da rashin samun kayan aikin yana ƙaruwa sosai. Saboda haka, a mafi yawan lokuta za ku karɓi bayanan ɓangarori ba tare da sanin su ba.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics kuma yana da ramummuka. Ramin farko shine zaɓin da ke iyakance adadin RAM da ake amfani da shi don ma'ajiyar VictoriaMetrics. Ta hanyar tsoho, yana daidai da 60% na RAM akan injin da VictoriaMetrics ke aiki ko 60% na RAM na VictoriaMetrics pod a Kubernetes.

Idan kun canza wannan ƙimar ba daidai ba, zaku iya lalata aikin VictoriaMetrics. Misali, idan kun saita ƙimar tayi ƙasa sosai, bayanan na iya daina shiga cikin ma'ajin VictoriaMetrics. Saboda haka, za ta yi karin aiki kuma ta loda masarrafar da faifai. Idan kun sanya wannan zaɓi ya yi girma sosai, yana ƙaruwa, da farko, da alama cewa VictoriaMetrics za ta faɗo tare da kuskuren ƙwaƙwalwar ajiya, kuma, na biyu, zai haifar da gaskiyar cewa za a sami ƙarancin RAM kaɗan a cikin ƙwaƙwalwar ajiyar tsarin aiki. cache fayil. Kuma VictoriaMetrics ya dogara da cache fayil don aiki. Idan bai isa ba, nauyin da ke kan faifai zai iya karuwa sosai. Saboda haka, shawara: kar a canza siga sai dai idan ya zama dole.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Zabi na biyu. Wannan shine TsawonLokaci - lokacin da aka saita zuwa wata 1 ta tsohuwa. Wannan shine tsawon lokacin da VictoriaMetrics ke adana bayanai. Bayan wannan lokacin, VictoriaMetrics yana share bayanan.

Mutane da yawa suna gudanar da VictoriaMetrics ba tare da wannan sigar ba kuma suna rikodin bayanai na wata ɗaya. Sannan suna tambaya: me yasa bayanan watan da ya gabata suka bace? Saboda tsayayyen Tsayawa Tsawon lokaci wata 1 ne. Don haka, kuna buƙatar sani kuma saita daidai lokacin riƙewa.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bari mu dubi abubuwan musamman.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana da fasalin da ake kira downsampling: 5-minti da tazarar sa'o'i, wanda sau da yawa ba ya aiki daidai. Idan kuna google kuma ku kalli batun su akan github, akwai batutuwa da yawa da suka shafi wannan raguwar, cewa wani lokacin ba ya aiki daidai, ko kuma baya aiki kamar yadda masu amfani ke tsammani.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana da kwafin bayanai don nau'ikan Prometheus HA. Lokacin da Prometheus guda biyu suka tattara ma'auni iri ɗaya daga maƙasudi iri ɗaya kuma Thanos yana adana su a cikin Ma'ajin Abun. Thanos na iya kwafin wannan bayanan da kyau, sabanin VictoriaMetrics.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana da ɓangaren faɗakarwa wanda ke cikin tsarin Thanos. Amma shi ba a ba da shawarar yin amfani da shi wajen samarwa ba.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana da fa'idar cewa Thanos da Prometheus suna raba lambar guda ɗaya. Thanos da Prometheus suna haɓaka ta masu haɓaka iri ɗaya. Tare da haɓakawa zuwa Thanos ko Prometheus, ɗayan gefen yayi nasara.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Babban fasalin VictoriaMetrics shine MetricsQL. Waɗannan su ne haɓakawa na VictoriaMetrics don PromQL, waɗanda na yi magana game da su a babban taron sa ido na baya.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics tana goyan bayan loda bayanai ta amfani da ka'idoji daban-daban. VictoriaMetrics ba zai iya karɓar bayanai kawai daga Prometheus ba, har ma ta hanyar Influx, OpenTSDB da ladabi na Graphite.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bayanan VictoriaMetrics yana ɗaukar sarari da yawa idan aka kwatanta da Thanos da Prometheus.

Idan kun yi rikodin bayanan gaske, masu amfani suna magana game da raguwar sau 2-5 a cikin girman bayanai akan faifai idan aka kwatanta da Prometheus da Thanos.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Wani fa'idar VictoriaMetrics shine cewa an inganta shi don saurin gudu.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Bari mu dubi farashin kayayyakin more rayuwa.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Ɗaya daga cikin fa'idodin Thanos shine cewa yana adana bayanai a cikin ma'adana, wanda yake da arha.

Lokacin adana bayanai a cikin ma'ajiyar abu, dole ne ku biya don rubutawa da karanta bayanan da ake gudanarwa ($ 10 a kowace miliyan ayyukan). Lokacin da kuka rubuta bayanai zuwa ma'ajiyar abu, kuna biyan kuɗin haɗin gwiwar ku don loda bayanai zuwa Intanet; idan tarin ku ba ya cikin AWS, kyauta ne a can. Lokacin karanta bayanai, kuna biyan tsakanin $10 zuwa $230 akan kowane 1TB. Wannan na iya zama mahimmanci idan kuna yawan tambayar bayanan tarihi daga gungu na Thanos.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Don gungu na Thanos, kuna buƙatar biya don sabar don Karamin, Ƙofar Store, Abubuwan Tambayoyi waɗanda ke buƙatar ƙwaƙwalwar ajiya mai yawa, da CPU don adadi mai yawa na bayanai.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics yana da abubuwan kashe kuɗi masu zuwa. Idan kun adana bayanai akan faifan GCE HDD, to yana zuwa $40 akan 1TB. Don VictoriaMetrics, na'urorin HDD na yau da kullun sun wadatar; babu SSDs, waɗanda suka fi tsada sau biyar, ana buƙata. An inganta VictoriaMetrics don HDD.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics na buƙatar sabobin don abubuwan haɗin gwiwa: ko dai Single-nod ko clustered components, waɗanda, sabanin abubuwan Thanos, suna buƙatar ƙarancin CPU da RAM - kuma hakan zai zama mai rahusa.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Misalan aiwatarwa.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Thanos yana da misalin aiwatarwa a Gitlab. Gitlab yana gudana gaba ɗaya akan Thanos. Amma ba duk abin da yake da santsi a can ba. Idan ka kalle su al'amurran da suka shafi, to za ka ga cewa kullum suna da wasu matsalolin aiki tare da Thanos: Babu isassun ƙwaƙwalwar ajiya don Ƙofar Store ko abubuwan da ake buƙata. Dole ne koyaushe su ƙara yawan ƙwaƙwalwar ajiya.

Saboda haka, farashin magance waɗannan matsalolin yana ƙaruwa.

Aiwatar na biyu, wanda zai iya zama mafi nasara, shine kamfanin da ba zai yiwu ba, wanda ya fara bunkasa Thanos. Sun buga lambar tushe na Thanos. Ba zai yuwu ba kamfani ne wanda ke haɓaka injunan wasa.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

VictoriaMetrics yana da misalan aiwatar da jama'a:

  • wix.com mai ginin gidan yanar gizon
  • Adidas yana aiwatar da VictoriaMetrics har ma ya gabatar da gabatarwa a PromCon 2019 na ƙarshe
  • TrafficStars - sadarwar talla
  • Seznam.cz sanannen injin bincike ne na Czech.

Sannan kuma babu wasu kamfanoni masu suna da ba zan iya suna ba a yanzu. Ba su yarda ba.

  • Babban mai haɓaka wasa ɗaya. Ya fi girma fiye da rashin yiwuwa.
  • Manyan masu haɓaka software mai hoto.
  • Babban bankin Rasha.
  • Kamfanin kera injin turbin na Turai wanda ya yi nasarar gwada VictoriaMetrics. Wannan masana'anta yana aiwatar da VictoriaMetrics don saka idanu akan bayanan da aka tattara daga injin turbin iska a ƙimar samfuran 50 a sakan daya a kowace firikwensin. Kowane injin injin iska yana da na'urori masu auna firikwensin ɗari da yawa. Suna da injin turbin ɗari da yawa.
  • Kamfanonin jiragen sama na Rasha waɗanda ke son aiwatar da VictoriaMetrics, amma har yanzu ba za su iya ba. Muna kan matakin kwangila tare da su.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetricsƘarshe.

VictoriaMetrics da Thanos suna magance matsaloli iri ɗaya, amma ta hanyoyi daban-daban:

  • Duban tambaya ta duniya
  • kwance-kwance
  • riƙon sabani

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Спасибо.

Muna jiran ku a wurin mu tashar telegram.

Zaɓin ajiyar bayanai don Prometheus: Thanos vs VictoriaMetrics

Masu amfani da rajista kawai za su iya shiga cikin binciken. Shigadon Allah.

Me kuke amfani da shi azaman ajiyar dogon lokaci don Prometheus?

  • 35,3%Thanso6

  • 0,0%Cortex0

  • 0,0%Saukewa: M3DB0

  • 41,2%VictoriaMetrics7

  • 23,5%sauran 4

Masu amfani 17 sun kada kuri'a. Masu amfani 16 sun kaurace.

source: www.habr.com

Sayi amintaccen masauki don shafuka tare da kariyar DDoS, sabar VPS VDS 🔥 Sayi ingantaccen masaukin yanar gizo tare da kariyar DDoS, sabar VPS VDS | ProHoster