Siv Clickhouse ua qhov hloov pauv rau ELK, Cov Lus Nug Loj thiab TimescaleDB

clickhouse yog qhov qhib-qhov columnar database tswj qhov system rau kev tshawb nrhiav online analytical query processing (OLAP) tsim los ntawm Yandex. Nws yog siv los ntawm Yandex, CloudFlare, VK.com, Badoo thiab lwm yam kev pabcuam thoob ntiaj teb los khaws cov ntaub ntawv ntau heev (ntxig ntau txhiab kab ib ob lossis petabytes ntawm cov ntaub ntawv khaws cia hauv disk).

Hauv ib txwm, "txoj hlua" DBMS, piv txwv uas yog MySQL, Postgres, MS SQL Server, cov ntaub ntawv khaws cia hauv qhov kev txiav txim no:

Siv Clickhouse ua qhov hloov pauv rau ELK, Cov Lus Nug Loj thiab TimescaleDB

Hauv qhov no, cov txiaj ntsig ntsig txog ib kab yog lub cev khaws cia ib sab. Nyob rau hauv columnar DBMS, qhov tseem ceeb ntawm cov kab sib txawv yog khaws cia nyias, thiab cov ntaub ntawv ntawm ib kem yog khaws cia ua ke:

Siv Clickhouse ua qhov hloov pauv rau ELK, Cov Lus Nug Loj thiab TimescaleDB

Piv txwv ntawm columnar DBMSs yog Vertica, Paraccel (Actian Matrix, Amazon Redshift), Sybase IQ, Exasol, Infobright, InfiniDB, MonetDB (VectorWise, Actian Vector), LucidDB, SAP HANA, Google Dremel, Google PowerDrill, Druid, kdb+.

Lub tuam txhab yog tus xa ntawv xa mus Qwintry Kuv pib siv Clickhouse hauv 2018 rau kev tshaj tawm thiab tau zoo siab heev nrog nws txoj kev yooj yim, scalability, SQL txhawb, thiab ceev. Qhov ceev ntawm no DBMS ciam teb ntawm khawv koob.

Qhov Yooj Yim

Clickhouse nruab ntawm Ubuntu nrog ib qho lus txib. Yog tias koj paub SQL, koj tuaj yeem pib siv Clickhouse tam sim ntawd rau koj cov kev xav tau. Txawm li cas los xij, qhov no tsis tau txhais hais tias koj tuaj yeem "tsim cov lus" hauv MySQL thiab luam tawm SQL hauv Clickhouse.

Muab piv rau MySQL, muaj cov ntaub ntawv tseem ceeb sib txawv hauv cov lus schema cov ntsiab lus hauv DBMS no, yog li koj tseem xav tau qee lub sijhawm los hloov cov lus schema cov ntsiab lus thiab kawm cov lus cav kom tau txais kev nplij siab.

Clickhouse ua haujlwm zoo yam tsis muaj software ntxiv, tab sis yog tias koj xav siv cov ntawv luam tawm koj yuav tsum tau nruab ZooKeeper. Kev soj ntsuam kev ua tau zoo qhia tau zoo heev - cov kab lus hauv kab ke muaj tag nrho cov ntaub ntawv, thiab tag nrho cov ntaub ntawv tuaj yeem tau txais los ntawm kev siv SQL qub thiab tho txawv.

Tsim tau

  • Benchmark Clickhouse piv Vertica thiab MySQL kev sib piv ntawm configuration server: ob lub qhov (socket) Intel® Xeon® CPU E5-2650 v2 @ 2.60GHz; 128 GiB RAM; md RAID-5 ntawm 8 6TB SATA HDD, ext4.
  • Benchmark Kev sib piv ntawm Clickhouse nrog Amazon RedShift huab cia.
  • Blog cov ntsiab lus Cloudflare txog Clickhouse kev ua tau zoo:

Siv Clickhouse ua qhov hloov pauv rau ELK, Cov Lus Nug Loj thiab TimescaleDB

Lub ClickHouse database muaj tus qauv tsim yooj yim heev - tag nrho cov nodes hauv pawg muaj qhov ua haujlwm zoo ib yam thiab siv ZooKeeper nkaus xwb rau kev sib koom tes. Peb tau tsim ib pawg me me ntawm ob peb lub nodes thiab ua qhov kev sim, thaum lub sijhawm peb pom tias lub kaw lus muaj kev ua tau zoo heev, uas sib haum rau qhov tau txais txiaj ntsig zoo hauv kev ntsuas DBMS cov qauv ntsuas. Peb txiav txim siab los saib ze dua ntawm lub tswv yim qab ClickHouse. Thawj qhov teeb meem rau kev tshawb fawb yog qhov tsis muaj cov cuab yeej thiab cov zej zog me me ntawm ClickHouse, yog li peb delved rau hauv kev tsim ntawm DBMS no kom nkag siab tias nws ua haujlwm li cas.

ClickHouse tsis txhawb tau txais cov ntaub ntawv ncaj qha los ntawm Kafka, vim nws tsuas yog ib qho chaw khaws ntaub ntawv, yog li peb tau sau peb tus kheej cov kev pabcuam adapter hauv Go. Nws nyeem Cap'n Proto encoded cov lus los ntawm Kafka, hloov lawv mus rau TSV, thiab muab tso rau hauv ClickHouse hauv pawg ntawm HTTP interface. Tom qab ntawd peb rov sau cov kev pabcuam no los siv Go lub tsev qiv ntawv ua ke nrog peb tus kheej ClickHouse interface los txhim kho kev ua haujlwm. Thaum ntsuas qhov kev ua tau zoo ntawm cov pob ntawv tau txais, peb pom ib qho tseem ceeb - nws tau muab tawm tias rau ClickHouse qhov kev ua tau zoo no yog nyob ntawm qhov loj ntawm pob ntawv, uas yog, tus naj npawb ntawm kab tso rau tib lub sijhawm. Kom nkag siab tias yog vim li cas qhov no tshwm sim, peb tau kawm li cas ClickHouse khaws cov ntaub ntawv.

Lub cav tseem ceeb, lossis theej, tsev neeg ntawm lub rooj cav siv los ntawm ClickHouse rau khaws cov ntaub ntawv, yog MergeTree. Lub cav no yog lub tswv yim zoo ib yam li LSM algorithm siv hauv Google BigTable lossis Apache Cassandra, tab sis zam kev tsim lub rooj nruab nrab nco thiab sau cov ntaub ntawv ncaj qha rau disk. Qhov no muab kev sau ntawv zoo heev, vim tias txhua pob ntawv ntxig tsuas yog txheeb los ntawm "tus yuam sij tseem ceeb" thawj tus yuam sij, compressed, thiab sau rau disk los ua ib ntu.

Qhov tsis muaj lub cim xeeb lossis ib lub tswv yim ntawm "freshness" ntawm cov ntaub ntawv kuj txhais tau hais tias lawv tsuas yog ntxiv tau, lub kaw lus tsis txhawb kev hloov lossis tshem tawm. Raws li niaj hnub no, tib txoj hauv kev los rho tawm cov ntaub ntawv yog rho tawm los ntawm lub hli, raws li ntu tsis hla ib lub hli ciam teb. Pab pawg ClickHouse nquag ua haujlwm ntawm kev ua qhov no tuaj yeem hloov kho. Ntawm qhov tod tes, nws ua rau kev sau ntawv thiab kev sib koom ua ke tsis muaj kev sib cav sib ceg, yog li tau txais cov txheej txheem sib luag nrog cov lej sib npaug kom txog thaum I / O lossis cores saturate.
Txawm li cas los xij, qhov xwm txheej no tseem txhais tau hais tias lub kaw lus tsis haum rau cov pob ntawv me me, yog li Kafka cov kev pabcuam thiab cov ntxig ntxig siv rau kev buffering. Tsis tas li ntawd, ClickHouse nyob rau hauv keeb kwm yav dhau tseem txuas ntxiv txuas ntxiv ua ntu ntu, kom ntau cov ntaub ntawv me me yuav raug muab tso ua ke thiab kaw ntau zaus, yog li ua rau kev siv cov ntaub ntawv ntau ntxiv. Txawm li cas los xij, ntau qhov tsis sib xws yuav ua rau muaj kev kub ntxhov ntawm cov ntxig ntxig ntev npaum li qhov kev sib koom ua ke txuas ntxiv mus. Peb tau pom tias qhov kev cuam tshuam zoo tshaj plaws ntawm kev noj cov ntaub ntawv ntawm lub sijhawm tiag tiag thiab kev noj zaub mov zoo yog lees txais qee qhov txwv ntawm cov ntxig ib ob rau hauv lub rooj.

Tus yuam sij rau cov lus nyeem kev ua tau zoo yog qhov indexing thiab qhov chaw ntawm cov ntaub ntawv ntawm disk. Txawm hais tias kev ua haujlwm ceev npaum li cas, thaum lub cav yuav tsum luam theej duab terabytes ntawm cov ntaub ntawv los ntawm disk thiab tsuas yog siv ib feem ntawm nws, nws yuav siv sijhawm. ClickHouse yog ib kem khw, yog li txhua ntu muaj cov ntaub ntawv rau txhua kem (kem) nrog cov nqi sib tw rau txhua kab. Yog li, tag nrho cov kab tsis muaj nyob rau hauv cov lus nug tuaj yeem hla ua ntej, thiab tom qab ntawd ntau lub hlwb tuaj yeem ua tiav nyob rau hauv parallel nrog vectorized execution. Txhawm rau zam kev luam theej duab tag nrho, txhua ntu muaj cov ntaub ntawv qhia me me.

Muab hais tias tag nrho cov kab ntawv raug txheeb xyuas los ntawm "tus yuam sij tseem ceeb", cov ntaub ntawv ntsuas tsuas yog muaj cov ntawv sau (cov kab ntes) ntawm txhua kab Nth, txhawm rau kom muaj peev xwm khaws lawv hauv kev nco txawm tias cov ntxhuav loj heev. Piv txwv li, koj tuaj yeem teeb tsa lub neej ntawd rau "kos txhua 8192th kab", tom qab ntawd "meager" indexing ntawm lub rooj nrog 1 trillion. kab uas haum yooj yim rau hauv lub cim xeeb tsuas yog siv 122 cim.

Kev tsim kho kab ke

Kev txhim kho thiab txhim kho ntawm Clickhouse tuaj yeem taug qab Github repos thiab xyuas kom meej tias cov txheej txheem ntawm "loj hlob" yog tshwm sim ntawm qhov zoo siab.

Siv Clickhouse ua qhov hloov pauv rau ELK, Cov Lus Nug Loj thiab TimescaleDB

Nrov

Nws zoo nkaus li tias Clickhouse qhov muaj koob meej loj hlob zuj zus, tshwj xeeb tshaj yog nyob rau hauv zej zog hais lus Lavxias. Xyoo tas los High load 2018 lub rooj sib tham (Moscow, Kaum Ib Hlis 8-9, 2018) pom tias monsters zoo li vk.com thiab Badoo siv Clickhouse, uas ntxig cov ntaub ntawv (piv txwv li, cav) los ntawm kaum tawm txhiab tus servers ib txhij. Hauv 40 feeb video Yuri Nasretdinov los ntawm pab pawg VKontakte tham txog yuav ua li cas nws ua tiav. Tsis ntev peb yuav tshaj tawm cov ntawv sau tseg ntawm Habr kom yooj yim ntawm kev ua haujlwm nrog cov khoom siv.

Daim ntaub ntawv

Tom qab siv qee lub sij hawm tshawb fawb, kuv xav tias muaj cov cheeb tsam uas ClickHouse tuaj yeem pab tau lossis tuaj yeem hloov pauv lwm cov kev daws teeb meem thiab nrov xws li MySQL, PostgreSQL, ELK, Google Big Query, Amazon RedShift, TimescaleDB, Hadoop, MapReduce, Pinot thiab Druid. Cov hauv qab no yog cov ntsiab lus ntawm kev siv ClickHouse los hloov kho lossis hloov tag nrho cov saum toj no DBMS.

Txuas MySQL thiab PostgreSQL

Tsis ntev los no, peb ib nrab hloov MySQL nrog ClickHouse rau cov ntawv xov xwm platform Mautic tsab ntawv xov xwm. Qhov teeb meem yog tias MySQL vim qhov tsis zoo tsim tsim tau nkag mus rau txhua tus email xa thiab txhua qhov txuas hauv email ntawd nrog lub hauv paus 64 hash, tsim kom muaj lub rooj loj MySQL (email_stats). Tom qab xa tsuas yog 10 lab emails rau cov kev pabcuam cov neeg siv khoom, lub rooj no tau nyob 150 GB ntawm qhov chaw ntaub ntawv, thiab MySQL pib " ruam" ntawm cov lus nug yooj yim. Txhawm rau txhim kho qhov teeb meem ntawm qhov chaw, peb ua tiav siv InnoDB rooj compression, uas txo nws los ntawm qhov zoo ntawm 4. Txawm li cas los xij, nws tseem tsis tau txais txiaj ntsig los khaws ntau dua 20-30 lab emails hauv MySQL tsuas yog rau kev nyeem ntawv keeb kwm, raws li cov lus nug yooj yim uas vim qee qhov yuav tsum tau ua tag nrho cov txiaj ntsig scan hauv kev sib pauv thiab hnyav I / O. nyiaj siv ua haujlwm, uas peb niaj hnub tau txais Zabbix ceeb toom.

Siv Clickhouse ua qhov hloov pauv rau ELK, Cov Lus Nug Loj thiab TimescaleDB

Clickhouse siv ob compression algorithms uas txo tus nqi ntawm cov ntaub ntawv los ntawm txog 3-4 lub sij hawm, tab sis hauv qhov tshwj xeeb no, cov ntaub ntawv tshwj xeeb yog "compressible".

Siv Clickhouse ua qhov hloov pauv rau ELK, Cov Lus Nug Loj thiab TimescaleDB

ELK Hloov

Raws li kuv tus kheej kev paub dhau los, ELK pawg (ElasticSearch, Logstash thiab Kibana, hauv qhov tshwj xeeb no ElasticSearch) xav tau ntau yam kev pabcuam los khiav dua li qhov xav tau los khaws cov cav. ElasticSearch yog lub cav zoo yog tias koj xav tau cov ntawv sau tag nrho zoo tshawb nrhiav (thiab kuv tsis xav tias koj xav tau tiag tiag), tab sis kuv xav tsis thoob vim li cas nws tau dhau los ua tus qauv txiav cav. Nws qhov kev ua tau zoo ntawm kev noj, ua ke nrog Logstash, muab teeb meem rau peb txawm tias lub teeb ua haujlwm zoo thiab xav tau qhov sib ntxiv ntawm ntau thiab ntau RAM thiab qhov chaw disk. Raws li cov ntaub ntawv, Clickhouse zoo dua ElasticSearch rau cov laj thawj hauv qab no:

  • SQL lus txhawb;
  • Qhov zoo tshaj plaws qib ntawm compression ntawm cov ntaub ntawv khaws cia;
  • Kev them nyiaj yug rau Regex search es tsis txhob sau ntawv nyeem;
  • Txhim kho cov lus nug teem caij thiab kev ua tau zoo tag nrho.

Tam sim no, qhov teeb meem loj tshaj plaws uas tshwm sim thaum sib piv ClickHouse nrog ELK yog qhov tsis muaj kev daws teeb meem rau kev rub tawm cov cav, nrog rau qhov tsis muaj ntaub ntawv thiab cov lus qhia ntawm cov ncauj lus no. Nyob rau tib lub sijhawm, txhua tus neeg siv tuaj yeem teeb tsa ELK siv Digital Ocean phau ntawv, uas yog qhov tseem ceeb heev rau kev siv cov thev naus laus zis sai. Muaj lub cav database ntawm no, tab sis tsis muaj Filebeat rau ClickHouse tsis tau. Yog, muaj txawj thiab ib qho kev ua haujlwm nrog cov cav log tsev, muaj cuab yeej nyem tail nkag mus rau cov ntaub ntawv teev cia rau hauv ClickHouse, tab sis tag nrho cov no yuav siv sij hawm ntau dua. Txawm li cas los xij, ClickHouse tseem ua txoj hauv kev vim nws txoj kev yooj yim, yog li txawm tias cov pib tshiab tuaj yeem yooj yim nruab nws thiab pib siv tag nrho hauv 10 feeb xwb.

Nyiam cov kev daws teeb meem me me, kuv tau sim siv FluentBit, lub cim xeeb qis heev rub lub cuab yeej, nrog ClickHouse thaum sim kom tsis txhob siv Kafka. Txawm li cas los xij, me me incompatibilities yuav tsum tau hais, xws li hnub format teeb meemua ntej nws yuav ua tau yam tsis muaj lub npe txheej uas hloov cov ntaub ntawv los ntawm FluentBit rau ClickHouse.

Raws li lwm txoj hauv kev rau Kibana, koj tuaj yeem siv ClickHouse ua tus thaub qab ua grafana. Raws li kuv nkag siab, qhov no tuaj yeem ua rau muaj teeb meem kev ua haujlwm thaum ua cov ntaub ntawv ntau cov ntsiab lus, tshwj xeeb tshaj yog cov laus ntawm Grafana. Hauv Qwintry, peb tseem tsis tau sim qhov no, tab sis kev tsis txaus siab txog qhov no tshwm sim ib ntus ntawm ClickHouse kev txhawb nqa channel hauv Telegram.

Hloov ntawm Google Big Query thiab Amazon RedShift (kev daws teeb meem rau cov tuam txhab loj)

Cov ntaub ntawv siv zoo tshaj plaws rau BigQuery yog txhawm rau thauj 1TB ntawm JSON cov ntaub ntawv thiab khiav cov lus nug txheeb xyuas ntawm nws. Cov Lus Nug Loj yog cov khoom lag luam zoo uas nws qhov scalability nyuaj rau overestimate. Qhov no yog software ntau dua li ClickHouse khiav ntawm ib pawg sab hauv, tab sis los ntawm tus neeg siv lub ntsiab lus, nws muaj ntau yam nrog ClickHouse. BigQuery tuaj yeem "tus nqi nce" sai sai thaum koj pib them rau txhua qhov SELECT, yog li nws yog qhov kev daws teeb meem SaaS tiag tiag nrog txhua qhov zoo thiab qhov tsis zoo.

ClickHouse yog qhov kev xaiv zoo tshaj plaws thaum koj khiav ntau cov lus nug uas kim heev. Qhov ntau SELECT queries koj khiav txhua hnub, qhov taw tes ntau nws ua rau hloov Cov Lus Nug Loj nrog ClickHouse, vim tias qhov kev hloov pauv no yuav txuag koj ntau txhiab nyiaj thaum nws los txog rau ntau terabytes ntawm cov ntaub ntawv ua tiav. Qhov no tsis siv rau cov ntaub ntawv khaws cia, uas pheej yig heev los ua cov lus nug loj.

Nyob rau hauv ib tsab xov xwm los ntawm Alexander Zaitsev, co-founder ntawm Altinity "Txav mus rau ClickHouse" piav qhia txog cov txiaj ntsig ntawm xws li DBMS tsiv teb tsaws.

TimescaleDB Hloov

TimescaleDB yog PostgreSQL txuas ntxiv uas ua kom zoo ua haujlwm nrog cov sijhawm hauv cov ntaub ntawv tsis tu ncua (https://docs.timescale.com/v1.0/introduction, https://habr.com/ru/company/zabbix/blog/458530/).

Txawm hais tias ClickHouse tsis yog ib tus neeg sib tw loj hauv lub sijhawm series niche, tab sis hais txog cov qauv columnar thiab vector query execution, nws yog sai npaum li TimescaleDB nyob rau hauv feem ntau ntawm kev soj ntsuam cov lus nug. Nyob rau tib lub sijhawm, qhov kev ua tau zoo ntawm kev txais ClickHouse pob ntawv cov ntaub ntawv yog kwv yees li 3 zaug siab dua, ntxiv rau, nws siv 20 zaug tsawg dua qhov chaw disk, uas yog qhov tseem ceeb heev rau kev ua cov ntaub ntawv keeb kwm ntau: 
https://www.altinity.com/blog/ClickHouse-for-time-series.

Tsis zoo li ClickHouse, tib txoj hauv kev kom txuag tau qee qhov chaw disk hauv TimescaleDB yog siv ZFS lossis cov ntaub ntawv zoo sib xws.

Kev hloov tshiab tom ntej rau ClickHouse yuav zoo li yuav qhia txog delta compression, uas yuav ua rau nws tsim nyog rau kev ua haujlwm thiab khaws cov ntaub ntawv teev sijhawm. TimescaleDB tej zaum yuav yog qhov kev xaiv zoo dua li liab qab ClickHouse hauv cov xwm txheej hauv qab no:

  • me me installation nrog tsawg heev RAM (<3 GB);
  • ntau cov INSERTs me me uas koj tsis xav kom tsis txhob ua rau tawg loj;
  • zoo sib xws, uniformity thiab ACID cov cai;
  • Kev txhawb nqa PostGIS;
  • merge nrog PostgreSQL cov ntxhuav uas twb muaj lawm, txij li Timescale DB yog qhov tseem ceeb PostgreSQL.

Kev sib tw nrog Hadoop thiab MapReduce systems

Hadoop thiab lwm yam khoom siv MapReduce tuaj yeem ua tau ntau qhov kev suav, tab sis lawv nyiam khiav ntawm latency loj heev. ClickHouse kho qhov teeb meem no los ntawm kev ua cov ntaub ntawv terabytes thiab tsim cov txiaj ntsig yuav luag tam sim. Yog li, ClickHouse muaj txiaj ntsig zoo dua rau kev ua haujlwm nrawm, sib tham sib txheeb xyuas kev tshawb fawb, uas yuav tsum muaj kev txaus siab rau cov ntaub ntawv tshawb fawb.

Kev sib tw nrog Pinot thiab Druid

ClickHouse cov neeg sib tw ze tshaj plaws yog cov columnar, linearly scalable qhib qhov khoom Pinot thiab Druid. Ib txoj haujlwm zoo sib piv cov tshuab no tau luam tawm hauv tsab xov xwm Romana Leventova Lub Ob Hlis 1, 2018

Siv Clickhouse ua qhov hloov pauv rau ELK, Cov Lus Nug Loj thiab TimescaleDB

Cov kab lus no yuav tsum tau hloov kho - nws hais tias ClickHouse tsis txhawb UPDATE thiab DELETE cov haujlwm, uas tsis yog qhov tseeb tag nrho ntawm kev cuam tshuam rau qhov tseeb versions.

Peb tsis muaj kev paub ntau ntxiv nrog cov DBMSs no, tab sis kuv tsis nyiam qhov nyuaj ntawm cov txheej txheem hauv qab uas yuav tsum tau khiav Druid thiab Pinot - nws yog ib pawg ntawm "tsav qhov chaw" puag ncig Java los ntawm txhua sab.

Druid thiab Pinot yog Apache incubator tej yaam num, uas muaj nyob rau hauv kev nthuav dav los ntawm Apache ntawm lawv cov nplooj ntawv GitHub project. Pinot tau tshwm sim nyob rau hauv lub incubator thaum Lub Kaum Hli 2018, thiab Druid yug 8 lub hlis ua ntej - thaum Lub Ob Hlis.

Qhov tsis muaj ntaub ntawv hais txog yuav ua li cas AFS ua haujlwm nce qee qhov, thiab tej zaum ruam, cov lus nug rau kuv. Kuv xav paub yog tias cov kws sau ntawv ntawm Pinot pom tias Apache Foundation muaj kev cuam tshuam ntau dua rau Druid, thiab puas yog tus cwj pwm ntawm tus neeg sib tw ua rau muaj kev khib? Puas yuav txoj kev loj hlob ntawm Druid qeeb thiab kev txhim kho ntawm Pinot nrawm yog tias cov neeg txhawb nqa txhawb nqa yav dhau los dheev txaus siab rau yav tom ntej?

Disadvantages ntawm ClickHouse

Immaturity: Obviously, qhov no tseem yog ib tug tho txawv technology, tab sis nyob rau hauv txhua rooj plaub, tsis muaj dab tsi zoo li no tau pom nyob rau hauv lwm cov columnar DBMS.

Cov ntxig me me tsis ua haujlwm zoo ntawm kev kub ceev: cov ntxig yuav tsum tau muab faib ua cov chunks loj vim tias qhov kev ua tau zoo ntawm cov ntxig me me degrades nyob rau hauv feem ntawm cov kab hauv txhua kab. Qhov no yog li cas ClickHouse khaws cov ntaub ntawv ntawm disk - txhua kab txhais tau tias 1 cov ntaub ntawv lossis ntau dua, yog li txhawm rau ntxig 1 kab uas muaj 100 kab, koj yuav tsum qhib thiab sau tsawg kawg 100 cov ntaub ntawv. Qhov no yog vim li cas ntxig buffering yuav tsum muaj tus neeg nruab nrab (tshwj tsis yog tus neeg siv khoom nws tus kheej muab buffering) - feem ntau Kafka lossis qee yam ntawm cov kab ke. Koj tuaj yeem siv Buffer lub cav tom qab luam cov ntaub ntawv loj rau hauv MergeTree ntxhuav.

Cov rooj koom nrog yog txwv los ntawm server RAM, tab sis tsawg kawg lawv nyob ntawd! Piv txwv li, Druid thiab Pinot tsis muaj kev sib txuas zoo li no, vim lawv nyuaj rau kev siv ncaj qha rau hauv cov kab ke uas tsis txhawb nqa cov ntaub ntawv loj ntawm cov nodes.

tshawb pom

Nyob rau hauv lub xyoo tom ntej, peb npaj yuav ua kom dav siv ClickHouse hauv Qwintry, raws li DBMS no muab kev sib npaug zoo ntawm kev ua tau zoo, tsis tshua muaj nyiaj siv ua haujlwm, scalability, thiab simplicity. Kuv paub tseeb tias nws yuav kis tau sai sai thaum lub zej zog ClickHouse tuaj nrog ntau txoj hauv kev siv nws hauv kev teeb tsa me me thiab nruab nrab.

Ib co ads 🙂

Ua tsaug uas koj tau nyob nrog peb. Koj puas nyiam peb cov ntawv? Xav pom cov ntsiab lus nthuav ntxiv? Txhawb nqa peb los ntawm kev tso ib qho kev txiav txim lossis qhia rau cov phooj ywg, huab VPS rau cov tsim tawm los ntawm $ 4.99, ib qho tshwj xeeb analogue ntawm nkag-theem servers, uas tau tsim los ntawm peb rau koj: Qhov tseeb tag nrho txog VPS (KVM) E5-2697 v3 (6 Cores) 10GB DDR4 480GB SSD 1Gbps los ntawm $ 19 los yog yuav ua li cas faib cov server? (muaj nrog RAID1 thiab RAID10, mus txog 24 cores thiab mus txog 40GB DDR4).

Dell R730xd 2x pheej yig dua hauv Equinix Tier IV data center hauv Amsterdam? Tsuas yog nyob ntawm no 2 x Intel TetraDeca-Core Xeon 2x E5-2697v3 2.6GHz 14C 64GB DDR4 4x960GB SSD 1Gbps 100 TV los ntawm $ 199 hauv Netherlands! Dell R420 - 2x E5-2430 2.2Ghz 6C 128GB DDR3 2x960GB SSD 1Gbps 100TB - los ntawm $ 99! Nyeem txog Yuav ua li cas tsim infrastructure Corp. chav kawm nrog kev siv Dell R730xd E5-2650 v4 servers muaj nqis 9000 euros rau ib lub nyiaj?

Tau qhov twg los: www.hab.com

Ntxiv ib saib