Ndicebisa ukuba ufunde umbhalo wengxelo ka-2017 ngu-Igor Stryhar "ClickHouse - uhlalutyo olubonakalayo olukhawulezayo nolucacileyo lwedatha kwiTabix."
Ujongano lwewebhu lweClickHouse kwiprojekthi yeTabix.
Izinto eziphambili:
- Isebenza kunye neClickHouse ngokuthe ngqo kwisikhangeli, ngaphandle kwesidingo sokufakela isoftware eyongezelelweyo;
- Umhleli wombuzo onesintaksi eqaqambisayo;
- Ukugqibezela imiyalelo;
- Izixhobo zokuhlalutya umzobo wokwenziwa kwemibuzo;
- Izikimu zemibala ukukhetha kuzo.
Ndingumlawuli wezobugcisa we-SMI2. Singumqokeleli weendaba wokutshintshiselana ngeendaba. Sigcina idatha eninzi esiyifumana kumaqabane ethu kwaye siyibhalisa kwiClickHouse - malunga nezicelo ze-30 ngesekhondi.
Le yidatha efana nale:
- Ucofa iindaba.
- Iindaba ziboniswa kwi-aggregator.
- Isibhengezo siboniswa kwinethiwekhi yethu.
- Kwaye sibhalisa iziganeko kwi-counter yethu, efana neYandex.Metrica. Olu lucazululo lwethu oluncinci.
Sasinobomi obuxakekileyo phambi kweClickHouse. Sabandezeleka kakhulu, sizama ukugcina le datha kwindawo ethile kwaye ngandlela-thile siyihlalutye.
Ubomi ngaphambi kweClickHouse - infiniDB
Into yokuqala ebesinayo yi-infiniDB. Wahlala nathi iminyaka emi-4. Sayisungula ngobunzima.
- Ayikuxhasi ukudibanisa okanye ukwahlula. Akukho zinto zilumkileyo ziphume kwibhokisi ngokungagqibekanga.
- Unobunzima bokulayisha idatha. Kuphela yinto ethile yeconsole eluncedo enokulayisha kuphela iifayile ze-CSV kwaye kuphela ngendlela engacacanga.
- Isiseko sedatha sinomsonto omnye. Ungabhala okanye ufunde. Kodwa yenze ukuba kube lula ukucubungula inani elikhulu ledatha.
- Kwaye wayenentonga enika umdla. Rhoqo ebusuku iseva kwafuneka iqalwe ngokutsha, kungenjalo ayizukusebenza.
Usisebenzele de kwasekupheleni kuka-2016, xa satshintshela ngokupheleleyo kwiClickHouse.
Ubomi ngaphambi kweClickHouse - uCassandra
Ekubeni i-infiniDB yayinomsonto omnye, sagqiba ekubeni sifuna uhlobo oluthile lwedatha yedatha eninzi apho sinokubhala imisonto emininzi ngexesha elinye.
Sazama izinto ezininzi ezinomdla. Emva koko sagqiba kwelokuba sizame uCassandra. Yonke into yayimnandi kuCassandra. Izicelo eziyi-10 ngesekhondi nganye. Izicelo ezingama-000 kwenye indawo yokufunda.
Kodwa naye wayenezakhe izilangazelelo. Kanye ngenyanga okanye kanye emva kweenyanga ezimbini uye wafumana i-database desynchronization. Kwaye kwafuneka ndivuke ndibaleke ndiyolungisa uCassandra. Iiseva zaphinda zaqalwa nganye nganye. Kwaye yonke into yahamba kakuhle kwaye intle.
Ubomi ngaphambi kweClickHouse - iDruid
Emva koko siye sabona ukuba kufuneka sibhale idatha engakumbi. Ngo-2016 saqala ukubukela iDruid.
I-Druid yisoftware evulekileyo ebhalwe kwiJava. Ingqale kakhulu. Kwaye yayifanelekile kwi-clickstream, xa sifuna ukugcina uhlobo oluthile lweziganeko kwaye emva koko senze ukuhlanganiswa kubo okanye senze iingxelo zohlalutyo.
UDruid wayenoguqulelo 0.9.X.
I-database ngokwayo inzima kakhulu ukuyihambisa. Oku kuntsonkotha kweziseko zophuhliso. Ukuyithumela, kwakuyimfuneko ukufakela kakhulu, intsimbi eninzi. Kwaye iqhekeza ngalinye le-hardware lalinoxanduva lwendima yalo eyahlukileyo.
Ukulayisha idatha kuyo, kwakuyimfuneko ukusebenzisa uhlobo oluthile lwe-shamanism. Kukho iprojekthi ye-OpenSource - Ukuzola, ebilahlekelwa yidatha evela kuthi kumsinga. Xa silayishe idatha kuyo, yalahleka.
Kodwa ngandlel’ ithile saqalisa ukuyiphumeza. Thina, njengama-hedgehogs asebenzisa iziyobisi kodwa aqhubeka esitya i-cactus, saqala ukukwazisa. Kwasithatha malunga nenyanga ukuyilungiselela zonke iziseko zoncedo. Oko kukuthi, iiseva ze-odolo, qwalasela iindima, kunye nokuthunyelwa ngokupheleleyo. Oko kukuthi, xa kukho ukungaphumeleli kwe-cluster, iqela lesibini liya kuthunyelwa ngokuzenzekelayo.
Kodwa kwenzeka ummangaliso. Bendisekhefini kwaye oogxa bam bandithumelele ikhonkco , ethi Yandex inqume ukuvula iClickHouse. Ndithi masiyizame.
Kwaye ngokwenyani kwiintsuku ezi-2 sahambisa iqela lovavanyo lweClickHouse. Saqala ukulayisha idatha kuyo. Xa kuthelekiswa ne-infiniDB, oku kusisiseko; xa kuthelekiswa ne-Druid, oku kusisiseko. Xa kuthelekiswa neCassandra, ikwayinto yokuqala. Kuba ukuba ulayisha idatha ukusuka kwi-PHP ukuya kwiCassandra, ke oku ayisiyonto isisiseko.
Sifumene ntoni? Ukusebenza ngesantya. Ukusebenza kugcino lwedatha. Oko kukuthi, isithuba esincinci sedisk sisetyenziswa. I-ClickHouse iyakhawuleza, ikhawuleza kakhulu xa kuthelekiswa nezinye iimveliso.
Ngexesha lokuqaliswa, xa i-Yandex ipapasha i-ClickHouse kwi-OpenSource, kwakukho umxhasi we-console kuphela. Thina kwinkampani yethu i-SMI2 sagqiba ekubeni sizame ukwenza umxhasi wendabuko kwiwebhu, ukuze sikwazi ukuvula iphepha kwi-browser, sibhale isicelo kwaye sifumane umphumo, kuba saqala ukubhala izicelo ezininzi. Ukubhala kwi-console kunzima. Kwaye senze inguqulelo yethu yokuqala.
Kwaye kwindawo ethile kufutshane nobusika bonyaka ophelileyo, izixhobo zeqela lesithathu lokusebenza kunye neClickHouse zaqala ukubonakala. Ezi zixhobo ezifana nezi:
- .
- .
- . (Ngoku )
- .
- .
Ndiza kujonga ezinye zezi zixhobo, oko kukuthi, ezo ndisebenze nazo.
Isixhobo esihle, kodwa seDruid. Xa iDruid yayiphunyezwa, ndandivavanya iSuperSet. Bendimthanda. KwiDruid ikhawuleza kakhulu.
Ayifanelanga iClickHouse. Oko kukuthi, iyalingana, iyaqala, kodwa ilungele ukuqhubekekisa kuphela imibuzo esisiseko efana: KHETHA isiganeko, IQELA NGOMnyhadala. Ayixhasi i-syntax entsonkothileyo yeClickHouse.
Isixhobo esilandelayo yiApache Zeppelin. Le yinto enhle kwaye inomdla. Iyasebenza. Ixhasa iincwadana zamanqaku, iideshibhodi, kwaye ixhasa iinguqu. Ndiyazi ukuba umntu othile kuluntu lweClickHouse uyayisebenzisa.
Kodwa akukho nkxaso ye-ClickHouse syntax, okt kuya kufuneka ubhale imibuzo nokuba kwikhonsoli okanye kwenye indawo. Emva koko, khangela ukuba yonke into iyasebenza. Yinto nje ephazamisayo. Kodwa inenkxaso entle yedeshibhodi.
Isixhobo esilandelayo yiRedash.IO. I-Redash ibanjwe kwi-Intanethi. Oko kukuthi, ngokungafaniyo nezixhobo zangaphambili, akufuneki ukuba zifakwe. Kwaye le yideshibhodi ekwaziyo ukudibanisa idatha evela kwiMithombo yeDatha eyahlukeneyo. Oko kukuthi, unokukhuphela kwi-ClickHouse, kwi-MySQL, kwi-PostgreSQL nakwamanye ama-database.
Kwinyanga nje edlulileyo (ngoMatshi 2017), inkxaso yavela eGrafana. Xa usakha iingxelo eGrafana, umzekelo, kwimeko ye-hardware yakho okanye kwi-metrics ethile, ngoku unokwakha igrafu efanayo okanye uhlobo oluthile lwephaneli kwidatha esuka kwi-ClickHouse ngokuthe ngqo. Oku kulula kakhulu, kwaye siyisebenzisa ngokwethu. Oku kukuvumela ukuba ufumane i-anomalies. Okokuthi, ukuba kukho into eyenzekayo kwaye enye i-hardware iyawa okanye iyancipha, ngoko unokujonga isizathu ukuba le datha ikwazile ukungena kwi-ClickHouse.
Ndifumanise ukuba kunzima kakhulu ukubhala kwezi zixhobo okanye kwi-console. Kwaye ndagqiba ekubeni ndiphucule ujongano lwethu lokuqala. Kwaye ndafumana umbono kwi-EventSQL, SeperSet, Zeppelin.
Ubufuna ntoni? Bendifuna ukufumana imizobo, umhleli ophuculweyo, kwaye ndiphumeze inkxaso kwizichazi-magama zoluphawu. Ngenxa yokuba iClickHouse inomsebenzi omkhulu - izichazi-magama. Kodwa kunzima ukusebenzisana nezichazi-magama, kuba kufuneka ukhumbule ifomathi yamaxabiso agciniweyo, oko kukuthi, inani okanye umtya, njalo njalo.
Iinyanga ezi-3 zidlulile ukususela ekukhululweni kwenguqulo yethu yokuqala. Ndenze malunga nama-330 azinikele kwisebe labucala kwaye kwavela ukuba yiTabix.
Ngokungafaniyo nenguqulelo yangaphambili, eyayibizwa ngokuba yiClickHouse-Frontend, ndaye ndagqiba ekubeni ndiyithiye igama elilula. Kwaye kwavela iTabix.
Kwavela ntoni?
Uzoba iigrafu. Ixhasa i-ClickHouse SQL syntax. Unika iingcebiso kwimisebenzi kwaye unokwenza izinto ezininzi ezinomdla.
Le yindlela ekhangeleka ngayo inkqubo yeTabix ngokubanzi. Ngasekhohlo ngumthi. Embindini ngumhleli wombuzo. Kwaye ngezantsi isiphumo sesi sicelo.
Okulandelayo ndiza kukubonisa indlela umhleli wombuzo osebenza ngayo.
Apha ukugqibezela ngokuzenzekelayo kusebenza kwitafile kwaye kuyakhuthaza, ngokufanelekileyo, ukugqibezela ngokuzenzekela kwimihlaba. Kwaye iingcebiso kwimisebenzi. Ukuba ucinezela u-ctrl ngenisa, isicelo siya kuphunyezwa okanye sisilele ngempazamo. Esona sicelo silula sithunyelwa kwiTabix kwaye isiphumo sifunyenwe, okt ungasebenza ngokukhawuleza ngeClickHouse.
Izichazi-magama, njengoko besenditshilo, ziyinto enomdla kakhulu esisebenza ngayo kakhulu. Kwaye oku kusivumela ukuba senze izinto ezininzi. Masithi sigcina zonke izixeko kwizichazi-magama. Sigcina isazisi sesixeko kunye negama lesixeko, ubude baso kunye nobude. Kwaye kwi-database sigcina kuphela isazisi sesixeko. Ngokufanelekileyo, sicinezela idatha kakhulu.
Oku kubonakala kuyinto elula, kodwa inceda kwiClickHouse ngendlela enomdla kakhulu. Ngenxa yokuba iClickHouse ixhasa kuphela ukujoyina okufakwe kwindlwane, umbuzo ukhula phantsi kwaye ubanzi ngokwaneleyo. Kwaye xa isibiyeli sivula kunye nokubonakala okude kungena, into elula njengokugoqa umbuzo yenza kube lula ukusebenza kunye nombuzo ngokwawo. Kuba xa umbuzo unobude bemigca engama-200-300 kwaye inkulu kakhulu ngobubanzi, kuyanceda kakhulu ukuvala umbuzo emva koko ufumane indawo ethile okanye ngandlela ithile uyibeke kwindawo.
Umthi wezinto, ii-multiqueries kunye neethebhu (Ividiyo 13:46 )
Okulandelayo ndiza kukubonisa malunga nomthi kunye neethebhu. Ekhohlo ngumthi, ngaphezulu ungenza iithebhu ezininzi. Iithebhu zinjengendawo yokusebenza. Unokwenza iithebhu ezininzi kwaye unike igama ngalinye ngokwahlukileyo. Kufana nenkqubo encinci yokwakha ingxelo.
Iithebhu zigcinwa ngokuzenzekelayo. Ukuba uqala kwakhona isikhangeli sakho okanye uvale okanye uvule iTabix, konke oku kuya kugcinwa.
I-Hotkey-iluncedo (Ividiyo 14:39 )
Kukho iihotkeys kwaye zininzi kakhulu. Ndikhuphe ezinye zazo apha njengomzekelo. Oku kukutshintsha iithebhu, ukwenza isicelo okanye ukwenza izicelo ezininzi.
Ndiza kukubonisa indlela yokusebenza ngesiphumo. Sithumela isicelo. Apha ndizoba isono, cos kunye netg. Ungagqamisa isiphumo, oko kukuthi, zoba imephu eqhelekileyo yekholamu. Ungagqamisa amaxabiso alungileyo okanye angalunganga. Okanye faka umbala kwinto ethile yetafile. Oku kulungele xa itafile inkulu kwaye kufuneka ufumane i-anomaly ngamehlo akho. Xa ndandikhangela izinto ezingaqhelekanga, ndaphawula imigca ethile, ezinye izinto eziluhlaza okanye ezibomvu.
Kukho izinto ezininzi ezinomdla apho. Umzekelo, indlela yokukhuphela kwiRedmine Markdown. Ukuba ufuna ukukopa umphumo kwenye indawo, oku kulula kakhulu. Unokukhetha nje indawo, uthi "Khuphela kwiRedmine" kwaye iya kukopa kwiRedmine Markdown okanye wenze umbuzo apho.
Okulandelayo kukwandiswa kombuzo. Ndakhe ndalibala ukucacisa indawo "yomhla". Kwaye isicelo sam kwiClickHouse asizange siqhutywe kakhulu, ngokukhawuleza, kodwa ngokukhawuleza, oko kukuthi ngaphantsi kwesibini. Ndathi ndakubona ukuba mingaphi imigca awayebaleka kuyo, ndafikelwa luloyiko. Asibhali imiqolo emininzi kangaka kule theyibhile ngosuku. Ndaqala ndasihlalutya isicelo ndabona ukuba ndiphoswe yidate kwindawo enye. Oko kukuthi, ndilibele ukubonisa ukuba andiyidingi idatha yetafile yonke, kodwa ixesha elithile.
I-Tabix inethebhu ethi "Izibalo", egcina yonke imbali yezicelo ezithunyelweyo, oko kukuthi apho unokubona ukuba zingaphi iilayini ezifundwe kwesi sicelo kunye nokuba kuthatha ixesha elingakanani ukuphumeza. Oku kuvumela ulungiselelo.
Ungakha itafile yepivot ngaphezulu kwesiphumo sombuzo. Uthumele isicelo kwiClickHouse kwaye ufumene idatha. Kwaye ke ungahambisa le datha ngemouse yakho kwaye wakhe uhlobo oluthile lwetafile yepivot.
Into elandelayo enomdla kukucwangcisa. Masithi sinesicelo esilandelayo: ngenxa yesono, cos ukusuka ku-0 ukuya ku-299. Kwaye ukuyidweba, kufuneka ukhethe ithebhu ethi "Zoba" kwaye uya kufumana igrafu ngesono sakho kunye ne-cos.
Ungahlula oku kwizembe ezahlukeneyo, o.k.t. ungazoba iigrafu ezimbini ngapha nangapha kanye. Bhala umyalelo omnye kunye nowesibini.
Ungazoba iihistograms.
Ungayiqhekeza le nto ibe yimatriki yeegrafu.
Ungakha imephu yobushushu.
Unokwakha ikhalenda ye-thermal. Ngendlela, oku kuyinto efanelekileyo kakhulu xa kufuneka uhlalutye i-anomalies ngaphezu konyaka, oko kukuthi, fumana i-spikes okanye i-drops. Oku kubonwa kwedatha kwandinceda kule nto.
Olandelayo yi-Treemap.
I-Sankeys yitshathi enomdla. Yena mhlawumbi Streamgrahps okanye River. Kodwa ndiwubiza ngokuba nguMlambo. Ikwakuvumela ukuba ujonge nayiphi na i-anomalies. Ikhululekile kakhulu. Ndincoma ukuyisebenzisa ukukhangela.
Into elandelayo enomdla kukuzoba imephu eguqukayo. Ukuba ugcina i-latitude, i-longitude kwi-database yakho kwaye, yithi, gcina indawo oya kuyo, ukuba, umzekelo, unelori okanye iinqwelomoya ezibhabhayo, ngoko unokuzoba iindlela zokuya. Kwakhona apho unokuseta isantya kunye nobukhulu bezi zinto apho zibhabha khona.
Kodwa ingxaki ngale mephu kukuba izoba kuphela imephu yehlabathi, akukho zinkcukacha.
Emva kwexesha ndongeze imephu kaGoogle. Ukuba ugcina ubude, ubude, ngoko unokuzoba umphumo kwimephu kaGoogle, kodwa ngaphandle kwenkxaso yenqwelomoya.
Siye saxoxa ngemisebenzi ephambili yokusebenza kunye neziphumo kunye nemibuzo kwiTabix.
Okulandelayo luhlalutyo lomncedisi wakho weClickHouse. Kukho ithebhu "yeMetrics" eyahlukileyo, apho unokubona ubungakanani bedatha egciniweyo kwikholamu nganye. Umfanekiso weskrini ubonisa ukuba le ndawo "ye-referrer" ithatha malunga ne-730 Gb. Ukuba siyayishiya le ntsimi, siya kugcina i-shards ezintathu ze-700 GB nganye, oko kukuthi malunga ne-2 TB esingayidingi.
Sikwanayo nendawo ethi "request_id" esiyigcina kumtya. Kodwa ukuba siqala ukuyigcina kwifomu yamanani, le ndawo iya kuncipha kakhulu.
Ikwabonisa uqwalaselo lomncedisi kunye noluhlu lweenodi kwiqela lakho.
Ithebhu elandelayo ziimetrics. Bangena kwixesha lokwenyani ngeClickHouse kwaye bakuvumela ngokulula ukuba uhlalutye imeko yomncedisi kwaye uqonde ukuba kwenzeka ntoni kuyo. Ayilondawo yeGrafana epheleleyo. Oku kuyimfuneko kuhlalutyo olukhawulezayo.
Ithebhu elandelayo ziinkqubo. Ukusuka kubo unokuqonda okwenzekayo kumncedisi. Qonda ukuba kuqhubeka ntoni apho. Ndinesicelo esasidla i-200 GB yokufunda ixesha ngalinye. Ndibone oku kubulela kule interface. Ndambamba ndamlungisa. Kwaye kwavela malunga ne-30 GB, oko kukuthi ukusebenza ngamanye amaxesha.
Enkosi! Kwaye ikwi-OpenSource
Ndigibile. Kwaye ngendlela, yi-OpenSource, isimahla kwaye awufuni nokuyikhuphela. Yivule kwisikhangeli kwaye yonke into iya kusebenza.
Imibuzo yakho
Igor, yintoni elandelayo? Uza kusiphuhlisa phi esi sixhobo?
Emva koko, iideshibhodi ziya kubonakala, oko kukuthi, mhlawumbi iideshibhodi ziya kubonakala. Ukudityaniswa nabanye oovimba beenkcukacha. Ndikwenzile oku, kodwa andikayipapashi kwi-OpenSource. Le yiMySQL kwaye inokuba yiPostgreSQL. Oko kukuthi, kuya kwenzeka ukuthumela izicelo ezivela kwi-Tabix kungekhona kuphela kwi-ClickHouse, kodwa nakwezinye izixhobo.
Kucacile ukuba mkhulu umsebenzi owenziweyo. Kwaba ngumbono opheleleyo. Oku kwenziwa kwisikhangeli, ngokucacileyo, ukuze kupheliswe iintonga kuzo zonke iintlobo zezembe kwaye ngokukhawuleza ukuphosa yonke into kunye. Ndivile ukuba uvuliwe php sebenza, ke eyona ndlela ilula kukuchwetheza kwibhrawuza kwaye iya kusebenza yonke indawo. Akukho mibuzo malunga noku. Umbuzo ngulo. Kuninzi okwenziwe ngokwenene apho. Bangaphi abantu abasebenza kule nto? Kwaye konke kuthathe ixesha elingakanani? Ngenxa yokuba izixhobo eziqhelekileyo azinamsebenzi ongako.
Umntu omnye kwiqela lethu usebenze ukusuka ehlotyeni ukuya ekwindla. Le yayiyinguqulelo yokuqala. Emva koko ndenze i-330 yokuboleka ndedwa. Into oyibonayo, mna nogxa wam siyenze phakathi. Kwiinyanga ezi-3, ukusuka kwinguqulo yokuqala ukuya kweyokugqibela, ndiyenze ndedwa. Kodwa andiyazi iJavascript kakuhle. Le yayiyeyam kuphela kwaye, ndiyathemba, iprojekthi yam yokugqibela yeJavascript endisebenze nayo. Ndiyifumene, ndajonga-oh, ukothuka. Kodwa ndandifuna ngokwenene ukugqiba imveliso kwaye oku kwenzeka.
Enkosi kakhulu ngengxelo! Esi sisixhobo esikhulu. KUNYE itheyibhile Ngaba uthelekise?
Enkosi. Yiyo loo nto ndayithiya igama elithi Tabix, kuba oonobumba bokuqala bayafana.
Kuba uyakhuphisana?
Kuya kubakho utyalo-mali oluninzi, siya kukhuphisana.
Unokunikela njani ukuthengisa kubahlalutyi bangaphakathi ukuba esi sixhobo siya kuthatha indawo ngokupheleleyo *Itheyibhile*? Ziya kuba yintoni iingxabano?
Isebenza ngokwendalo kunye neClickHouse. Ndizamile Tableau, kodwa awukwazi ukubhala inkxaso izichazi-magama kunye ezifana apho. Ndiyazi ukuba abantu basebenza njani kunye neTabix. Babhala umbuzo, balayishe kwi-CSV kwaye balayishe kwi-BI. Kwaye sele besenza into apho. Kodwa ndinobunzima bokucinga ukuba bayenza njani le nto, kuba sisixhobo segraphical. Iyakwazi ukukhulula imiqolo engama-5, ubuninzi bemigqa ye-000, kodwa akukho ngaphezulu, ngaphandle koko isiphequluli asiyi kuhlangabezana.
Oko kukuthi, kukho imida enzulu kwisixa sedatha, akunjalo?
Ewe. Andikwazi ukucinga ukuba ungafuna ukulayisha imiqolo eyi-10 kwitafile yakho kwiscreen sebrawuza yakho. Yantoni?
Ngaba oku kuthetha ukuba olu lujongano lwedatha yokujonga ngokukhawuleza? Yijije kancinci, uyijije?
Ewe, jonga ngokukhawuleza ukuba isebenza njani kwaye uvele wakhe igrafu yesishwankathelo. Kwaye ke uyinike kwenye indawo. Sinenkqubo yethu yokunika ingxelo, apho ndithatha khona esi sicelo. Ndizoba kwiTabix kwaye ndiyithumele kwingxelo yethu.
Kwaye omnye umbuzo. Uhlalutyo lweqela?
Ukuba kukho naziphi na izicelo, siya kuyongeza.
Uqale nini ukuyisebenzisa? ClickHouse, ukuphunyezwa kuthathe ixesha elingakanani? Cofa indlu kunye nokuzisa kwi imeko yemveliso?
Njengoko benditshilo, siphumeze iqela lovavanyo ngexesha elifutshane kakhulu. Sisasaze ngeentsuku ezimbini. Kwaye sayivavanya iiveki ezimbalwa ezingakumbi. Kwaye sifikelele kwimveliso kwiinyanga ze-3. Kodwa sasine-ETL yethu, oko kukuthi isixhobo sokurekhoda idatha. Kwaye wabhala kuyo yonke into awayenako. Unokubhala kwiMongoDB, Cassandra, MySQL. Kwakulula ukumfundisa indlela yokubhala eClickHouse. Besineziseko ezingundoqo esele zenziwe ukuba ziphunyezwe ngokukhawuleza. Kwiinyanga ezi-3 saqala ukulahla icandelo lokuqala. Kwiinyanga ezi-6 sayishiya ngokupheleleyo yonke enye into. SineClickHouse enye kuphela eshiyekileyo.
U-Igor, enkosi kakhulu ngengxelo. Ndiwuthande kakhulu umsebenzi wokwakha iindlela usebenzisa iimephu. Ngaba kukho naziphi na izicwangciso zokudityaniswa kunye neYandex.Maps kwaye ngokukodwa kunye neYandex.Maps yesiko?
Ndizamile ukudibanisa endaweni yemephu yeGoogle, kodwa andizange ndifumane umxholo omnyama kwiYandex.Maps. Khange ndikuxelele nesiqwengana esinye. Ndiza kubuyisela umva ukongeza.
Isilayidi-imephu kaGoogle. Kukho umyalelo "DRAW_GMAPS", ozoba imaphu. Kukho umyalelo othi "DRAW_YMAPS", oko kukuthi inokuzoba iYandex.Map. Kodwa eneneni, phantsi kwalo myalelo kukho iJavascript, okt idatha oyifumanayo kwiClickHouse inokudluliselwa kwiJavascript, oyibhala apha. Kwaye unendawo yemveliso apho kufuneka izotywe. Ungazoba nayiphi na igrafu, oko kukuthi nayiphi na igrafu, imephu, ungazoba icandelo lakho. Ngaphambi koku, bendinelinye ithala leencwadi lokuzoba iigrafu ngokwazo.
Oko kukuthi, ngaba sikhona isixhobo sokwenza umsebenzi wokubonisa?
Nayiphi na. Ungathatha kwaye uphinde ufake umbala kula machaphaza, uwenze angabibomvu, kodwa aluhlaza okwesibhakabhaka, aluhlaza.
Enkosi ngengxelo! Ubunesilayidi esibonise izixhobo ezizezinye zokubuza Cofa indlu ukwakha iidashbhodi kunye neengxelo zohlalutyo. Ndiyayiqonda loo nto ngalo mzuzu xa uqala ukusebenza kunye ClickHouse, akukho ziadaptha zibhalelwe ezi zixhobo. Kwaye ndiyazibuza ukuba kutheni uthathe isigqibo sokwenza isixhobo sakho, endaweni yokubhala iadaptha yesixhobo esenziwe sele silungile? Ndicinga ukuba ukuguqula umhleli wovavanyo ngokukhawuleza. Kwakutheni ukuze wenze isigqibo sokwenza umsebenzi omninzi kangaka?
Kukho inqaku elinomdla apha - inyaniso kukuba ndingumlawuli wezobugcisa, kungekhona inzululwazi yedatha. Ngethuba sasiqalisa ukusebenzisa iDruid, imephu yendlela yam yayimalunga nama-50% emisebenzi - masibale oku, okanye masibale oku, okanye sihlalutye oku. Kwaye kwavela ukuba siphumeze iClickHouse. Kwaye waqala ngokukhawuleza ukwakha yonke into, ukubala, kwaye ngokukhawuleza wayivala imephu yendlela yakhe. Kwaye ngelo xesha ndaqonda ukuba andinalo ulwazi kwiSayensi yeDatha kunye nokubonwa kwedatha. I-Tabix luhlobo lomsebenzi wam wasekhaya wokufunda ukubonwa kwedatha. Bendijonge indlela yokugcwalisa iZeppelin. Andiyithandi kancinane inkqubo yakhe. Redash ndajonga indlela yokongeza, kodwa umhleli oqhelekileyo wandanele. Kwaye iSuperSet nayo ibhalwe ngolwimi endingaluthandiyo. Kwaye ke ndagqiba ekubeni ndijikeleze, kwaye yile nto eyenzekayo.
Igor, uyazamkela izicelo zoTsalo?
Ewe.
Enkosi kakhulu ngengxelo! Kwaye imibuzo emibini. Okokuqala, awuthethi kakhulu malunga Javascript. Ngaba ubhale kwiJavascript engenanto okanye luhlobo oluthile lwesakhelo?*
Kungcono kwiJavascript engenanto.
Ngoko yintoni isakhelo?
I-Angular.
Icacile. Kwaye umbuzo wesibini. Ngaba uye wacinga R и *Shiny**?*
Ithathelwe ingqalelo. Dlala.
Ungabhala nje iadaptha.
Ngu. Kubonakala ngathi uluntu luyenzile, kodwa, njengoko ndiphendule umbuzo wangaphambili, ndandifuna ukuzama ngokwam.
* Hayi, malunga nokubonwa, ikhona kwakhona.
Uthi kukho into enjalo kwaye iya kukuzoba igrafu. Ndavula incwadi kwi-data visualization. Kwaye ndacinga: "Makhe ndizame ukujonga le datha. Ndiza kumbhalela ukuze akwazi ukwakha kwakhona idatha. " Kwaye ndaqala ukuqonda ngcono iteknoloji feed data. Kwaye ukuba ndithathe inxalenye esele yenziwe, mna ngokwam ngendifunde ngakumbi indlela yokuyisebenzisa, oko kukuthi, ukubonwa. Kodwa ewe, ndiyithandile i-R, kodwa andikayifundi incwadi ethi "R for Dummies" okwangoku.
Ndiyabonga!
Umbuzo olula. Ngaba kukho naziphi na iindlela zokulayisha ngokukhawuleza uphawu okanye ishedyuli?
Ingafakwa kwi-CSV okanye kwi-Excel.
Hayi idatha, kodwa ipleyiti esele ilungile, igrafu esele yenziwe? Umzekelo, ukubonisa umphathi.
Kukho iqhosha elithi "Layisha" kwaye kukho iqhosha "Layisha igrafu kwipng, kwijpg".
Ndiyabonga!
I-PS Mini-imiyalelo yokufaka i-tabix
- Ukukhuphela
- Khupha, khuphela uvimba weefayili
buildkwi nginx root_path - Qwalasela nginx
umthombo: www.habr.com