Ndikupangira kuti muwerenge zolembedwa za lipoti la 2017 la Igor Stryhar "ClickHouse - kusanthula mwachangu komanso momveka bwino ku Tabix."
Mawonekedwe a intaneti a ClickHouse mu polojekiti ya Tabix.
Zofunikira zazikulu:
- Imagwira ntchito ndi ClickHouse mwachindunji kuchokera kwa osatsegula, popanda kufunikira kukhazikitsa mapulogalamu owonjezera;
- Mkonzi wamafunso wokhala ndi kuwunikira kwa mawu;
- Autocomplete ya malamulo;
- Zida zowunikira mafotokozedwe a mafunso;
- Mitundu yamitundu yomwe mungasankhe.
Ndine wotsogolera zaukadaulo wa SMI2. Ndife ophatikizira nkhani zosinthana. Timasunga zambiri zomwe timalandira kuchokera kwa anzathu ndikuzilembetsa ku ClickHouse - pafupifupi zopempha 30 pamphindikati.
Izi ndi data monga:
- Dinani pa nkhani.
- Nkhani zimawonetsedwa mu aggregator.
- Ma banner amawonetsedwa pamanetiweki athu.
- Ndipo timalembetsa zochitika kuchokera pakauntala yathu, yomwe ili yofanana ndi Yandex.Metrica. Izi ndi zathu zazing'ono analytics.
Tidali ndi moyo wotanganidwa kwambiri ClickHouse isanachitike. Tinavutika kwambiri, kuyesa kusunga deta iyi kwinakwake ndikuyisanthula mwanjira ina.
Moyo pamaso pa ClickHouse - infiniDB
Chinthu choyamba chomwe tinali nacho chinali infiniDB. Anakhala nafe zaka 4. Tinaliyambitsa movutikira.
- Sichithandizira kusonkhanitsa kapena kugawa. Palibe zinthu zanzeru zotere zomwe zidatuluka m'bokosi mwachisawawa.
- Amavutika kutsitsa deta. Ndi chida chapadera chokhacho chomwe chimatha kungoyika mafayilo a CSV komanso mwanjira ina yosadziwika bwino.
- Database ili ndi ulusi umodzi. Mutha kulemba kapena kuwerenga. Koma zinapangitsa kuti zitheke kukonza deta yambiri.
- Ndipo analinso ndi ndodo yosangalatsa. Usiku uliwonse seva imayenera kuyambiranso, apo ayi sizigwira ntchito.
Adatigwirira ntchito mpaka kumapeto kwa 2016, pomwe tidasinthiratu ku ClickHouse.
Moyo pamaso pa ClickHouse - Cassandra
Popeza infiniDB inali yopangidwa ndi ulusi umodzi, tinaganiza kuti tikufunikira mtundu wina wa database wamitundu yambiri momwe tingalembe ulusi wambiri nthawi imodzi.
Tinayesa zinthu zambiri zosangalatsa. Kenako tinaganiza zoyesa Cassandra. Zonse zinali zabwino ndi Cassandra. Zopempha 10 pa sekondi iliyonse. Zopempha 000 kwinakwake kuti ziwerengedwe.
Koma analinso ndi zofuna zake. Kamodzi pamwezi kapena kamodzi pa miyezi iwiri iliyonse adakumana ndi kuchotsedwa kwa database. Ndipo ndinayenera kudzuka ndikuthamangira kukakonza Cassandra. Ma seva adayambikanso imodzi ndi imodzi. Ndipo chirichonse chinakhala chosalala ndi chokongola.
Moyo pamaso pa ClickHouse - Druid
Kenako tinazindikira kuti tikufunika kulemba zambiri. Mu 2016 tinayamba kuonera Druid.
Druid ndi pulogalamu yotseguka yolembedwa mu Java. Zolunjika kwambiri. Ndipo zinali zoyenera kwa clickstream, pamene tiyenera kusunga mtundu wina wa zochitika ndiyeno kuchita aggregation pa iwo kapena kupanga malipoti analytical.
Druid anali ndi mtundu wa 0.9.X.
Nawonso database yokha ndiyovuta kuyika. Izi ndizovuta za zomangamanga. Kuti atumize, kunali koyenera kuyika zambiri, zachitsulo zambiri. Ndipo chidutswa chilichonse cha hardware chinali ndi udindo wake wosiyana.
Kuti mulowetse deta mmenemo, kunali koyenera kugwiritsa ntchito mtundu wina wa shamanism. Pali ntchito ya OpenSource - Tranquility, yomwe inali kutaya deta kuchokera kwa ife mumtsinje. Titanyamula deta mu izo, izo zinataya.
Koma mwanjira ina tinayamba kuzigwiritsa ntchito. Ife, monga akalulu omwe amamwa mankhwala osokoneza bongo koma anapitirizabe kudya nkhaka, tinayamba kufotokoza izo. Zinatitengera pafupifupi mwezi umodzi kuti tikonze zida zonse zogwirira ntchitoyo. Ndiko kuti, yitanitsa ma seva, sinthani maudindo, ndikuyika kwathunthu. Ndiko kuti, ngati masango akulephera, gulu lachiwiri lidzangotumizidwa.
Koma kenako chozizwitsa chinachitika. Ndinali patchuthi ndipo anzanga adanditumizira ulalo , yomwe imati Yandex idaganiza zotsegula ClickHouse. Ndimati tiyese.
Ndipo kwenikweni m'masiku a 2 tidatumiza gulu loyesa la ClickHouse. Tinayamba kulowetsamo deta. Poyerekeza ndi infiniDB, izi ndizoyambira; poyerekeza ndi Druid, izi ndizoyambira. Poyerekeza ndi Cassandra, ndizoyambira. Chifukwa ngati mutsitsa deta kuchokera ku PHP kupita ku Cassandra, ndiye kuti izi sizoyambira.
Tinapeza chiyani? Kuchita mwachangu. Zochita pakusunga deta. Ndiye kuti, malo ochepa a disk amagwiritsidwa ntchito. ClickHouse ndi yachangu, imathamanga kwambiri poyerekeza ndi zinthu zina.
Panthawi yoyambitsa, Yandex itasindikiza ClickHouse ku OpenSource, panali kasitomala wotonthoza yekha. Ife ku kampani yathu SMI2 tinaganiza zoyesa kupanga kasitomala wamba pa intaneti, kuti titsegule tsamba kuchokera kwa osatsegula, lembani pempho ndikupeza zotsatira, chifukwa tinayamba kulemba zopempha zambiri. Kulemba mu console ndizovuta. Ndipo tinapanga mtundu wathu woyamba.
Ndipo kwinakwake pafupi ndi nyengo yozizira ya chaka chatha, zida zachitatu zogwirira ntchito ndi ClickHouse zidayamba kuwonekera. Izi ndi zida monga:
- .
- .
- . (Tsopano )
- .
- .
Ndiyang'ana zina mwa zida izi, zomwe ndi zomwe ndagwirapo ntchito.
Chida chabwino, koma cha Druid. Pamene Druid ikugwiritsidwa ntchito, ndinali kuyesa SuperSet. Ndinamukonda. Kwa Druid ndikothamanga kwambiri.
Sikoyenera kwa ClickHouse. Ndiko kuti, ikukwanira, imayamba, koma ili wokonzeka kuyankha mafunso oyambira okha monga: SINANI chochitika, GROUP BY chochitika. Sichimagwirizana ndi mawu ovuta kwambiri a ClickHouse.
Chida chotsatira ndi Apache Zeppelin. Ichi ndi chinthu chabwino komanso chosangalatsa. Ntchito. Imathandizira zolemba, ma dashboards, ndikuthandizira zosintha. Ndikudziwa kuti wina mdera la ClickHouse amagwiritsa ntchito.
Koma palibe chithandizo cha mawu a ClickHouse, mwachitsanzo, muyenera kulemba mafunso mu console kapena kwina kulikonse. Kenako, onetsetsani kuti zonse zikugwira ntchito. Ndizovuta basi. Koma ili ndi chithandizo chabwino cha dashboard.
Chida chotsatira ndi Redash.IO. Redash imapezeka pa intaneti. Ndiye kuti, mosiyana ndi zida zam'mbuyomu, siziyenera kukhazikitsidwa. Ndipo iyi ndi dashboard yokhala ndi kuthekera kophatikiza deta kuchokera ku DataSource zosiyanasiyana. Ndiko kuti, mutha kutsitsa kuchokera ku ClickHouse, kuchokera ku MySQL, kuchokera ku PostgreSQL komanso kuchokera kumasamba ena.
Mwezi umodzi wapitawo (March 2017), thandizo linawonekera ku Grafana. Mukapanga malipoti ku Grafana, mwachitsanzo, pazida zanu kapena pazitsulo zina, tsopano mutha kupanga graph yomweyi kapena gulu linalake kuchokera ku data kuchokera ku ClickHouse mwachindunji. Izi ndizothandiza kwambiri, ndipo timazigwiritsa ntchito tokha. Izi zimakuthandizani kuti mupeze anomalies. Ndiko kuti, ngati chinachake chikuchitika ndipo hardware ina ikugwa kapena imakhala yovuta, ndiye kuti mukhoza kuyang'ana chifukwa ngati deta iyi yatha kulowa mu ClickHouse.
Ndinaona kuti zinali zovuta kwambiri kulemba mu zida izi kapena mu console. Ndipo ndinaganiza zokonza mawonekedwe athu oyamba. Ndipo ndidapeza lingaliro kuchokera ku EventSQL, SeperSet, Zeppelin.
Munkafuna chiyani? Ndinkafuna kupeza zithunzi, mkonzi wabwino, ndikugwiritsa ntchito chithandizo cha mtanthauzira mawu. Chifukwa ClickHouse ili ndi mawonekedwe abwino - otanthauzira mawu. Koma ndizovuta kugwira ntchito ndi otanthauzira mawu, chifukwa muyenera kukumbukira maonekedwe a zikhalidwe zosungidwa, mwachitsanzo, ndi nambala kapena chingwe, ndi zina zotero.
Miyezi ya 3 yadutsa kuchokera pamene Baibulo lathu loyamba linatulutsidwa. Ndinapanga pafupifupi 330 kudzipereka ku nthambi yachinsinsi ndipo idakhala Tabix.
Mosiyana ndi mtundu wakale, womwe umatchedwa ClickHouse-Frontend, ndinaganiza zoutcha dzina losavuta. Ndipo zinapezeka Tabix.
Chinawoneka chiyani?
Amajambula ma graph. Imathandizira mawu a ClickHouse SQL. Amapereka upangiri pazantchito ndipo amatha kuchita zinthu zambiri zosangalatsa.
Izi ndi zomwe dongosolo la Tabix limawonekera. Kumanzere kuli mtengo. Pakatikati pali mkonzi wamafunso. Ndipo pansipa ndi zotsatira za pempholi.
Kenako ndikuwonetsani momwe mkonzi wamafunso amagwirira ntchito.
Apa autocomplete imagwira ntchito patebulo ndipo imalimbikitsa, motero, kumalizitsa kwa magawo. Ndipo malangizo pa ntchito. Mukasindikiza ctrl enter, pempholi lidzachitidwa kapena kulephera ndi cholakwika. Pempho losavuta limatumizidwa ku Tabix ndipo zotsatira zake zapezedwa, mwachitsanzo, mutha kugwira ntchito ndi ClickHouse mwachangu.
Madikishonale, monga ndanenera kale, ndi chinthu chosangalatsa kwambiri chomwe timagwira nawo ntchito kwambiri. Ndipo zimene zinatilola kuchita zinthu zambiri. Tinene kuti timasunga mizinda yonse m'madikishonale. Timasunga chizindikiritso cha mzinda ndi dzina la mzinda, latitude ndi longitude. Ndipo mu nkhokwe timasunga chizindikiritso cha mzinda chokha. Choncho, ife compress deta mwamphamvu kwambiri.
Izi zikuwoneka ngati zosavuta, koma zimathandiza mu ClickHouse m'njira yosangalatsa kwambiri. Chifukwa chakuti ClickHouse imangogwirizira zojowina zisa, funso limakula pansi komanso lalikulu mokwanira. Ndipo bulaketi ikatsegulidwa ndipo mawu ataliatali abwera, ndiye kuti china chake chosavuta ngati kugwetsa funso chimapangitsa kukhala kosavuta kugwira ntchito ndi funso lokha. Chifukwa funso likakhala lalitali la mizere 200-300 komanso lalitali kwambiri m'lifupi, ndizothandiza kwambiri kugwetsa funsolo ndikupeza malo enaake kapena kuyika m'malo mwake.
Mtengo wa chinthu, kuchulukana ndi ma tabo (Video 13:46 )
Kenako ndikuwonetsani za mtengo ndi ma tabu. Kumanzere kuli mtengo; pamwamba mutha kupanga ma tabo angapo. Ma tabu ali ngati malo ogwirira ntchito. Mutha kupanga ma tabo angapo ndikutchula iliyonse mosiyana. Zili ngati mini-system pomanga lipoti.
Ma tabu amasungidwa okha. Mukayambitsanso msakatuli wanu kapena kutseka kapena kutsegula Tabix, zonsezi zidzasungidwa.
Hotkey - yabwino (Video 14:39 )
Pali ma hotkeys ndipo alipo ambiri. Ndatulutsa zina mwazo apa monga chitsanzo. Uku ndikusintha ma tabo, kuchita zopempha kapena kuchita zopempha zingapo.
Ndikuwonetsani momwe mungagwirire ndi zotsatira zake. Timatumiza pempho. Apa ndikujambula sin, cos ndi tg. Mutha kuwunikira zotsatira, mwachitsanzo, kujambula mapu azambiri. Mutha kuwunikira zabwino kapena zoyipa. Kapena ingopaka utoto patebulo. Izi ndi yabwino pamene tebulo ndi lalikulu ndipo muyenera kupeza ena anomaly ndi maso anu. Ndikayang'ana zolakwika, ndidawunikira mizere ina, zinthu zina zobiriwira kapena zofiira.
Pali zinthu zambiri zosangalatsa kumeneko. Mwachitsanzo, momwe mungakoperere Redmine Markdown. Ngati mukufuna kukopera zotsatira kwinakwake, izi ndizothandiza kwambiri. Mutha kusankha malo, nenani "Koperani ku Redmine" ndipo imakopera ku Redmine Markdown kapena pangani funso.
Chotsatira ndi kukhathamiritsa kwa mafunso. Nthawi ina ndinayiwala kutchula gawo la "deti". Ndipo pempho langa ku ClickHouse silinasinthidwe kwambiri, mwachangu kwambiri, koma mwachangu, mwachitsanzo, osakwana sekondi imodzi. Nditaona mizere ingati yomwe anadutsamo, ndinachita mantha. Sitilemba mizere yambiri patebuloli tsiku limodzi. Ndinayamba kusanthula pempholo ndipo ndinawona kuti ndaphonya tsiku limodzi. Ndiko kuti, ndinayiwala kusonyeza kuti sindikusowa deta pa tebulo lonse, koma kwa nthawi yeniyeni.
Tabix ili ndi tabu ya "Stats", yomwe imasunga mbiri yonse ya zopempha zotumizidwa, mwachitsanzo, mukhoza kuona mizere ingati yomwe inawerengedwa ndi pempholi ndi nthawi yayitali bwanji kuti achite. Izi zimathandiza kukhathamiritsa.
Mutha kupanga tebulo la pivot pazotsatira zafunso. Mudatumiza pempho kwa ClickHouse ndipo mwalandira zambiri. Kenako mutha kusuntha izi ndi mbewa yanu ndikupanga mtundu wina wa tebulo la pivot.
Chotsatira chosangalatsa ndikukonza chiwembu. Tinene kuti tili ndi chopempha chotsatirachi: chauchimo, cos kuyambira 0 mpaka 299. Ndipo kuti mujambule, muyenera kusankha tabu ya "Jambulani" ndipo mudzalandira graph ndi tchimo lanu ndi cos.
Mutha kugawa izi kukhala nkhwangwa zosiyanasiyana, mwachitsanzo, mutha kujambula ma graph awiri mbali imodzi nthawi imodzi. Lembani lamulo limodzi ndi lachiwiri.
Mutha kujambula histograms.
Mutha kugawa izi kukhala ma graph angapo.
Mutha kupanga mapu otentha.
Mutha kupanga kalendala yotentha. Mwa njira, ichi ndi chinthu chothandiza kwambiri pamene mukufunikira kusanthula zolakwika kwa chaka chimodzi, mwachitsanzo, pezani spikes kapena madontho. Kuwona kwa data uku kunandithandiza ndi izi.
Chotsatira ndi Treemap.
Sankeys ndi tchati chosangalatsa. Iye mwina Streamgrahps kapena River. Koma ndimautcha Mtsinje. Komanso amakulolani kuyang'ana anomalies iliyonse. Ndizomasuka kwambiri. Ndikupangira kugwiritsa ntchito posaka.
Chotsatira chosangalatsa ndikujambula mapu osinthika. Ngati mumasunga latitude, longitude mu database yanu ndipo, kunena, kusunga kopita, ngati inu, mwachitsanzo, muli ndi trucking kapena ndege zowuluka, ndiye kuti mukhoza kujambula njira kopita. Komanso kumeneko mukhoza kukhazikitsa liwiro ndi kukula kwa zinthu izi zimene zimawulukira.
Koma vuto ndi mapuwa ndikuti amangojambula mapu a dziko lapansi, palibe tsatanetsatane.
Kenako ndinawonjezera Google map. Ngati mumasunga latitude, longitude, ndiye kuti mutha kujambula zotsatira pa mapu a Google, koma popanda thandizo la ndege.
Takambirana ntchito zazikulu zogwira ntchito ndi zotsatira ndi mafunso mu Tabix.
Chotsatira ndikuwunika seva yanu ya ClickHouse. Pali tabu yosiyana ya "Metrics", komwe mutha kuwona kukula kwa data yosungidwa pagawo lililonse. Chithunzi chikuwonetsa kuti gawo la "referrer" ili limatenga pafupifupi 730 Gb. Ngati tisiya gawo ili, tidzapulumutsa atatu 700 GB shards, i.e. za 2 TB, zomwe sitifunikira.
Tilinso ndi gawo la "request_id" lomwe timasunga mu chingwe. Koma ngati tiyamba kuusunga m’mawerengero, gawoli lidzacheperachepera.
Ikuwonetsanso kasinthidwe ka seva ndi mndandanda wa node mumagulu anu.
Tsamba lotsatira ndi ma metrics. Amalowa mu nthawi yeniyeni ndi ClickHouse ndikungokulolani kuti mufufuze momwe seva ikukhalira ndikumvetsetsa zomwe zikuchitika. Uku sikulowa m'malo mwa Grafana wathunthu. Izi ndizofunikira kuti mufufuze mwachangu.
Tsamba lotsatira ndi ndondomeko. Kuchokera kwa iwo mukhoza kumvetsa zomwe zikuchitika pa seva. Mvetserani zomwe zikuchitika kumeneko. Ndinali ndi pempho lomwe linkadya 200 GB yowerengera nthawi iliyonse. Ndinawona izi chifukwa cha mawonekedwe awa. Ndinamugwira ndikumuwongolera. Ndipo zidakhala pafupifupi 30 GB, i.e. magwiridwe antchito nthawi zina.
Zikomo! Ndipo ili mu OpenSource
Ndinamaliza. Ndipo mwa njira, ndi OpenSource, ndi yaulere ndipo simuyenera kuyitsitsa. Tsegulani mu msakatuli ndipo zonse zigwira ntchito.
Mafunso anu
Igor, chotsatira ndi chiyani? Kodi chidachi mudzachipanga kuti?
Kenako, ma dashboards adzawonekera, mwachitsanzo, mwina ma dashboards adzawonekera. Kuphatikiza ndi ma database ena. Ndidachita izi, koma sindinazisindikize mu OpenSource. Izi ndi MySQL ndipo mwina PostgreSQL. Ndiko kuti, zidzatheka kutumiza zopempha kuchokera ku Tabix osati ku ClickHouse, komanso ku zipangizo zina.
N’zoonekeratu kuti ntchito yaikulu yachitika. Linakhala lingaliro lathunthu. Izi zidachitika mu msakatuli, mwachiwonekere, kuti athetse ndodo pamitundu yonse ya nkhwangwa ndikuponya mwachangu chinthu chonsecho. Ndinamva kuti muli pa Php ntchito, kotero njira yosavuta ndikuyiyika mu msakatuli ndipo idzagwira ntchito kulikonse. Palibe mafunso pa izi. Funso ndi ili. Zambiri zachitidwa kumeneko. Ndi anthu angati omwe adagwirapo ntchito imeneyi? Ndipo zonse zidatenga nthawi yayitali bwanji? Chifukwa zida zachikhalidwe nthawi zambiri sizikhala ndi magwiridwe antchito ambiri.
Munthu m'modzi wa gulu lathu amagwira ntchito kuyambira chilimwe mpaka m'dzinja. Ili linali Baibulo loyamba. Kenako ndinapanga ma 330 okha. Zomwe mukuwona, mnzanga ndi ine tidazichita pakati. M'miyezi itatu, kuchokera ku mtundu woyamba mpaka womaliza, nthawi zambiri ndidachita ndekha. Koma sindikudziwa Javascript bwino. Ili linali langa lokha, ndikhulupilira, pulojekiti yanga yomaliza ya Javascript yomwe ndidagwira nayo ntchito. Ndinazipeza, ndinayang'ana - o, mantha. Koma ndinkafuna kwambiri kuti nditsirize mankhwala ndipo izi ndi zomwe zinachitika.
Zikomo kwambiri chifukwa cha lipoti! Ichi ndi chida chachikulu. NDI tebulo Kodi mwafanizira?
Zikomo. Ndicho chifukwa chake ndinachitcha kuti Tabix, chifukwa zilembo zoyambirira ndizofanana.
Chifukwa mukupikisana?
Padzakhala ndalama zambiri, tidzapikisana.
Mungapereke bwanji kugulitsa kwa akatswiri amkati kuti chida ichi chidzasintha kwathunthu *Tableau*? Kodi mikangano idzakhala yotani?
Imagwira ntchito ndi ClickHouse. Ndinayesa Tableau, koma simungalembe zothandizira mtanthauzira mawu ndi zina zotere. Ndikudziwa momwe anthu amagwirira ntchito ndi Tabix. Amalemba funso, kuyika ku CSV ndikuyiyika ku BI. Ndipo iwo akuchita kale chinachake kumeneko. Koma ndimavutika kulingalira momwe amachitira izi, chifukwa ndi chida chojambula. Itha kutsitsa mizere 5, mizere yopitilira 000, koma osatinso, apo ayi osatsegula sangapirire.
Ndiko kuti, pali zoletsa zina zazikulu pa kuchuluka kwa deta, chabwino?
Inde. Sindingayerekeze kuti mungafune kuyika mizere 10 patebulo lanu pa msakatuli wanu. Zachiyani?
Kodi izi zikutanthauza kuti iyi ndi njira yowonera mwachangu deta? Muzipotoza pang'ono, potozani izo?
Inde, onani mwachangu momwe zimagwirira ntchito ndikungopanga chidule cha graph. Ndiyeno perekani kwinakwake. Tili ndi dongosolo lathu loperekera malipoti, pomwe ndimangotengera pempholi. Ndimajambula Tabix ndikutumiza ku lipoti lathu.
Ndipo funso lina. Kusanthula kwamagulu?
Ngati pali zopempha, tidzawonjezera.
Munayamba liti kuzigwiritsa ntchito? ClickHouse, kukhazikitsidwa kudatenga nthawi yayitali bwanji? Dinani Nyumba ndi kubweretsa ku kupanga dziko?
Monga ndanenera, tidakhazikitsa gulu loyesera munthawi yochepa kwambiri. Tinatumiza masiku awiri. Ndipo tinaziyesa kwa milungu ingapo. Ndipo tinafika kupanga m'miyezi 3. Koma tinali ndi ETL yathu, mwachitsanzo, chida chojambulira deta. Ndipo analemba m’zonse zimene akanatha. Atha kulemba ku MongoDB, Cassandra, MySQL. Zinali zosavuta kumuphunzitsa kulemba mu ClickHouse. Tinali ndi maziko okonzeka kuti tigwiritse ntchito mofulumira. Pasanathe miyezi 3 tinayamba kutaya gawo loyamba. M'miyezi 6 tinasiyiratu china chilichonse. Tili ndi ClickHouse imodzi yokha yomwe yatsala.
Igor, zikomo kwambiri chifukwa cha lipotilo. Ndinkakonda kwambiri ntchito yomanga njira pogwiritsa ntchito mamapu. Kodi pali mapulani ophatikizana ndi Yandex.Maps makamaka ndi Yandex.Maps?
Ndinayesa kuphatikiza m'malo mwa mapu a Google, koma sindinapeze mutu wakuda pa Yandex.Maps. Sindinakuuzeni chidutswa chimodzi. Ndibwerera kuti ndiwonjezere.
Slide - Mapu a Google. Pali lamulo "DRAW_GMAPS", lomwe limajambula mapu. Pali lamulo "DRAW_YMAPS", mwachitsanzo, imatha kujambula Yandex.Map. Koma kwenikweni, pansi pa lamulo ili pali Javascript, i.e. deta yomwe mumalandira kuchokera ku ClickHouse ikhoza kusamutsidwa ku Javascript, yomwe mumalemba apa. Ndipo muli ndi gawo lotulutsa pomwe liyenera kukokedwa. Mutha kujambula graph iliyonse, mwachitsanzo, graph iliyonse, mapu, mutha kujambula gawo lanu. Izi zisanachitike, ndinali ndi laibulale ina yojambulira ma graph okha.
Ndiko kuti, kodi pali chida chosinthira magwiridwe antchito awonetsero?
Aliyense. Mutha kutenga ndi kukongoletsanso madonthowa, kuwapanga kukhala ofiira, koma abuluu, obiriwira.
Zikomo chifukwa cha lipoti! Munali ndi slide yomwe ikuwonetsa zida zina zamafunso Dinani Nyumba pomanga ma dashboards ndi malipoti osanthula. Ndikumvetsetsa kuti panthawi yomwe mudayamba kugwira ntchito ndi ClickHouse, palibe ma adapter omwe adalembedwa pazida izi. Ndipo ndikudabwa chifukwa chake mudaganiza zopanga chida chanu, m'malo molemba adaputala ya chida chokonzekera? Ndikuganiza kuti kuwongolera test editor ndikofulumira. N’chifukwa chiyani munaganiza zogwira ntchito yambiri chonchi?
Pali mfundo yosangalatsa apa - chowonadi ndi chakuti ndine wotsogolera luso, osati wasayansi wa data. Pofika nthawi yomwe tidayamba kugwiritsa ntchito Druid, misewu yanga inali ndi pafupifupi 50% ya ntchito - tiyeni tiwerenge izi, kapena tiwerenge izi, kapena tisanthula izi. Ndipo zidapezeka kuti tidakhazikitsa ClickHouse. Ndipo iye anayamba mwamsanga kumanga chirichonse, kuwerengera, ndipo mwamsanga anatseka msewu wake. Ndipo panthawiyo ndinazindikira kuti ndinalibe chidziwitso mu Data Science ndi mawonedwe a deta. Tabix ndi mtundu wa homuweki yanga yophunzirira zowonera. Ndinkayang'ana momwe ndingathandizire Zeppelin. Sindimakonda pang'ono pamapulogalamu ake. Redash ndinayang'ana momwe ndingawonjezere, koma mkonzi wabwinobwino anali wokwanira kwa ine. Ndipo SuperSet imalembedwanso m'chinenero chomwe sindimakonda. Ndipo kotero ine ndinaganiza zozungulira, ndipo izi ndi zomwe zinachitika.
Igor, kodi mumavomereza zopempha za Kokani?
Inde.
Zikomo kwambiri chifukwa cha lipoti! Ndipo mafunso awiri. Choyamba, simumalankhula mokweza kwambiri Javascript. Kodi mudalemba mu Javascript kapena ndi mtundu wina wa chimango?*
Zabwino mu Javascript yopanda kanthu.
Ndiye chimango?
Angular.
Zikumveka. Ndipo funso lachiwiri. Kodi mwalingalirapo R и *Chonyezimira**?*
Ndinaziganizira. Adasewera.
Mukhozanso kulemba adaputala.
Iye ali. Zikuwoneka ngati anthu ammudzi adapanga, koma, monga ndidayankha funso lapitalo, ndidafuna kuyesa ndekha.
* Ayi, ponena za zowonera, ziliponso.
Mukunena kuti pali chinthu choterocho ndipo chidzakujambulani graph. Ndinatsegula buku lowonetsera deta. Ndipo ndinaganiza: “Ndiloleni ndiyese kuwoneratu izi. Ndimulembera kalata kuti amangenso deta. " Ndipo ndinayamba kumvetsetsa bwino luso loperekera deta. Ndipo ndikadatenga gawo lokonzekera, ine ndekha ndikadaphunzira momwe ndingagwiritsire ntchito, ndiko kuti, kuwonetsa. Koma inde, ndimakonda R, koma sindinawerenge buku la "R for Dummies" pano.
Спасибо!
Funso losavuta. Kodi pali njira zilizonse zokwezera chikwangwani kapena ndandanda mwachangu?
Itha kukwezedwa ku CSV kapena Excel.
Osati deta, koma mbale yokonzeka, graph yokonzeka? Mwachitsanzo, kusonyeza bwana.
Pali batani "Kwezani" ndipo pali batani "Kwezani graph mu png, mu jpg".
Спасибо!
PS Mini-malangizo oyika tabix
- Sakanizani
- Chotsani, kukopera chikwatu
buildmu nginx root_path - Konzani nginx
Source: www.habr.com