{"id":90783,"date":"2020-08-06T01:42:19","date_gmt":"2020-08-05T23:42:19","guid":{"rendered":"https:\/\/prohoster.info\/blog\/administrirovanie\/kak-bigquery-ot-google-demokratiziroval-analiz-dannyh-chast-1"},"modified":"2020-08-06T01:42:19","modified_gmt":"2020-08-05T23:42:19","slug":"kak-bigquery-ot-google-demokratiziroval-analiz-dannyh-chast-1","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/kak-bigquery-ot-google-demokratiziroval-analiz-dannyh-chast-1","title":{"rendered":"Kuidas Google'i BigQuery demokraatiseerib andmeanal\u00fc\u00fcsi. Osa 1","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p><b><i>Tere, Habr! Just n\u00fc\u00fcd on OTUS avatud uue kursuse ootenimekirjale <noindex><a rel=\"nofollow\" href=\"https:\/\/otus.pw\/wDZQ\/\">\u201eAndmeinsener\u201c<\/a><\/noindex>Kursi algusele eelnevalt oleme traditsiooniliselt valmistanud teile t\u00f5lke huvitavast materjalist. <\/i><\/b><\/p>\n<p>\nIga p\u00e4ev k\u00fclastab Twitterit \u00fcle saja miljoni inimese, et saada teada, mis maailmas toimub, ja arutada seda. Iga tweet ja iga teine kasutaja tegevus genereerib s\u00fcndmuse, mis on kergesti k\u00e4ttesaadav Twitteri sisemiseks andmeanal\u00fc\u00fcsiks. Sajad t\u00f6\u00f6tajad anal\u00fc\u00fcsivad ja visualiseerivad neid andmeid ning nende kogemuse parandamine on Twitteri andmeplatvormi meeskonna peamine prioriteet. <\/p>\n<p>Usume, et kasutajad, kellel on laiahaardeline tehniline oskus, peaksid saama andmeid leida ja p\u00e4\u00e4seda h\u00e4sti t\u00f6\u00f6tavatele SQL-p\u00f5histele anal\u00fc\u00fcsi- ja visualiseerimist\u00f6\u00f6riistadele. See v\u00f5imaldaks t\u00e4iesti uuel kasutajagrupil, kelle tehnilised oskused on v\u00e4iksemad, sealhulgas andmeanal\u00fc\u00fctikutel ja tootemeeskonna juhtidel, andmetest teavet t\u00f5mmata, v\u00f5imaldades neil paremini m\u00f5ista ja kasutada Twitteri v\u00f5imalusi. Nii demokratiseerime me Twitteris andmeanal\u00fc\u00fcsi. <noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<p>Meie andmeanal\u00fc\u00fcsi t\u00f6\u00f6riistade ja v\u00f5imaluste t\u00e4iustamise k\u00e4igus oleme olnud tunnistajaks Twitteri teenuse paranemisele. Siiski on veel ruumi kasvamiseks. Praegused t\u00f6\u00f6riistad, nagu Scalding, n\u00f5uavad programmeerimiskogemust. SQL-p\u00f5hised anal\u00fc\u00fcsit\u00f6\u00f6riistad, nagu Presto ja Vertica, kannatavad suurel skaalal j\u00f5udlusprobleemide all. Meil on ka probleem andmete levitamisega erinevatesse s\u00fcsteemidesse ilma pideva juurdep\u00e4suta neile.<\/p>\n<p>Eelmisel aastal teatasime <noindex><a rel=\"nofollow\" href=\"https:\/\/blog.twitter.com\/engineering\/en_us\/topics\/infrastructure\/2018\/a-new-collaboration-with-google-cloud.html\">uues koost\u00f6\u00f6st Google'iga<\/a><\/noindex>, mille k\u00e4igus viime osa meie <noindex><a rel=\"nofollow\" href=\"https:\/\/blog.twitter.com\/engineering\/en_us\/topics\/infrastructure\/2019\/the-start-of-a-journey-into-the-cloud.html\">andmeinfrastruktuurist<\/a><\/noindex> Google Cloud Platformile (GCP). Oleme j\u00f5udnud j\u00e4reldusele, et Google Cloudi <noindex><a rel=\"nofollow\" href=\"https:\/\/cloud.google.com\/products\/big-data\/\">Big Data<\/a><\/noindex> t\u00f6\u00f6riistad v\u00f5ivad aidata meid meie algatustes andmeanal\u00fc\u00fcsi, visualiseerimise ja masin\u00f5ppe demokratiseerimisel Twitteris:<\/p>\n<ul>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/cloud.google.com\/bigquery\/\">BigQuery<\/a><\/noindex>: ettev\u00f5tte andmehoidla, mille SQL-mootor p\u00f5hineb <noindex><a rel=\"nofollow\" href=\"https:\/\/ai.google\/research\/pubs\/pub36632\">Dremelil<\/a><\/noindex>, mis on tuntud oma kiirusest, lihtsusest ja suudab toime tulla <noindex><a rel=\"nofollow\" href=\"https:\/\/cloud.google.com\/bigquery-ml\/docs\/bigqueryml-intro\">masin\u00f5ppega.<\/a><\/noindex>.<\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/datastudio.google.com\/overview\">Data Studio:<\/a><\/noindex> t\u00f6\u00f6riist suurte andmete visualiseerimiseks, koos koost\u00f6\u00f6funktsioonidega, nagu Google Docsis.<\/li>\n<\/ul>\n<p>\nSelles artiklis saate teada meie kogemustest nende t\u00f6\u00f6riistadega: mida tegime, mida \u00f5ppisime ja mida teeme edasi. Praegu keskendume t\u00fc\u00fcpkasutusele ja interaktiivsele anal\u00fc\u00fctikale. Reaalajas anal\u00fc\u00fctikat arutame j\u00e4rgmises artiklis.<\/p>\n<h2>Twitteri andmehoidlate ajalugu<\/h2>\n<p>\nEnne s\u00fcveneda BigQuery'sse, tasub l\u00fchidalt \u00fcle vaadata Twitteri andmehoidlate ajalugu. Aastal 2011 t\u00f6\u00f6tas Twitteri andmeanal\u00fc\u00fcs Verticas ja Hadoopis. Hadoopi MapReduce'i t\u00f6\u00f6de loomiseks kasutasime Pig'i. Aastal 2012 asendasime Pigi Scaldinguga, millel oli Scala API, mille eelised olid sellised nagu keerukate torujuhtmete loomise v\u00f5imalus ja lihtsus testimise osas. Siiski, paljudele andmeanal\u00fc\u00fctikutele ja tootejuhtidele, kellele meeldis SQL'iga t\u00f6\u00f6tada, oli see piisavalt j\u00e4rsk \u00f5ppimisk\u00f5ver. Umbes 2016. aastal hakkasime kasutama Presto't SQL liidese jaoks Hadoopi andmetele. Spark pakkus Python'i liidest, mis teeb sellest hea valiku ad hoc andmeuuringute ja masin\u00f5ppe jaoks.<\/p>\n<p>Alates 2018. aastast oleme andmete anal\u00fc\u00fcsimiseks ja visualiseerimiseks kasutanud j\u00e4rgmisi t\u00f6\u00f6riistu:<\/p>\n<ul>\n<li>Scalding tootmisprotsesside jaoks<\/li>\n<li>Scalding ja Spark ad hoc andmeanal\u00fc\u00fcsiks ja masin\u00f5ppe jaoks<\/li>\n<li>Vertica ja Presto ad hoc ja interaktiivseks SQL anal\u00fc\u00fcsiks <\/li>\n<li>Druid v\u00e4ikese interaktiivsuse, uurimise ja madala latentsusega juurdep\u00e4\u00e4suks ajalooliste m\u00f5\u00f5dikute jaoks<\/li>\n<li>Tableau, Zeppelin ja Pivot andmete visualiseerimiseks<\/li>\n<\/ul>\n<p>\nOleme avastanud, et kuigi need t\u00f6\u00f6riistad pakuvad v\u00e4ga v\u00f5imsaid v\u00f5imalusi, olime raskustes nende juurutamisega laiemale publikule Twitteris. Laiendades oma platvormi Google Cloudi abil, keskendume anal\u00fc\u00fcsit\u00f6\u00f6riistade lihtsustamisele kogu Twitteris.<\/p>\n<h2>Google'i BigQuery andmehoidla <\/h2>\n<p>\nM\u00f5ned meeskonnad Twitteris on juba integreerinud BigQuery m\u00f5nedesse oma tootmisprotsessidesse. Kasutades nende kogemusi, hakkasime hindama BigQuery v\u00f5imalusi k\u00f5ikide Twitteri kasutusjuhtude jaoks. Meie eesm\u00e4rk oli pakkuda BigQuery'd kogu ettev\u00f5ttele ning standardiseerida ja toetada seda Data Platformi t\u00f6\u00f6riistade komplekti raames. See osutus mitmetel p\u00f5hjustel keeruliseks. Me pidime v\u00e4lja t\u00f6\u00f6tama infrastruktuuri suurte andmehulkade usaldusv\u00e4\u00e4rseks vastuv\u00f5tmiseks, toetama kogu ettev\u00f5tte andmehalduse juhtimist, tagama n\u00f5uetekohase juurdep\u00e4\u00e4su kontrolli ja kliendiandmete privaatsuse. Samuti pidime looma s\u00fcsteemid ressursside jaotamiseks, monitooringuks ja tasumisteks, et meeskonnad saaksid efektiivselt BigQuery'd kasutada.<\/p>\n<p>Novembris 2018. aastal tutvustasime BigQuery ja Data Studio alpha-versiooni kogu ettev\u00f5ttele. Pakkusime Twitteri t\u00f6\u00f6tajatele m\u00f5ningaid meie enimkasutatud tabelitest puhastatud isikuandmetega. BigQuery'it kasutas \u00fcle 250 kasutaja erinevatest meeskondadest, sealhulgas inseneritehnika, rahanduse ja turunduse alal. Viimasel ajal sooritati umbes 8000 p\u00e4ringut, t\u00f6\u00f6deldes umbes 100 PB kuus, v\u00e4lja arvatud plaanitud p\u00e4ringud. Saades positiivset tagasisidet, otsustasime edasi liikuda ja pakkuda BigQuery't peamise vahendina andmete haldamiseks Twitteris.<\/p>\n<p>Siin on meie Google BigQuery andmeh\u00e4lli k\u00f5rgetasemeline arhitektuuriskeem. <\/p>\n<p><img decoding=\"async\" alt=\"Kuidas Google&#039;i BigQuery demokraatiseerib andmeanal\u00fc\u00fcsi. Osa 1\" src=\"\/wp-content\/uploads\/2020\/08\/6a3e0b43752ebbac641c43519c8c2fba.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\nKopeerime andmed kohalikest Hadoop klastest Google Cloud Storage'i (GCS) kasutades sisemist t\u00f6\u00f6riista Cloud Replicator. Seej\u00e4rel kasutame Apache Airflow'd torujuhtmete loomiseks, mis kasutavad \u201e<noindex><a rel=\"nofollow\" href=\"https:\/\/cloud.google.com\/bigquery\/docs\/reference\/bq-cli-reference#bq_load\">bq_load<\/a><\/noindex>\u201c andmete laadimiseks GCS'ist BigQuery'sse. Kasutame Presto't Parquet v\u00f5i Thrift-LZO andmehulkade p\u00e4rimiseks GCS'is. BQ Blaster on sisemine Scalding t\u00f6\u00f6riist, mis laadib HDFS Vertica ja Thrift-LZO andmehulgad BigQuery'sse.<\/p>\n<p>J\u00e4rk-j\u00e4rgult arutame meie l\u00e4henemist ja teadmisi kasutusmugavuse, j\u00f5udluse, andmete haldamise, s\u00fcsteemi t\u00f6\u00f6kindluse ja kulude osas.<\/p>\n<h4>Kasutusmugavus<\/h4>\n<p>\nOleme avastanud, et kasutajatel oli BigQuery'ga lihtne alustada, kuna see ei n\u00f5udnud tarkvara installimist ja kasutajad p\u00e4\u00e4sesid sellele ligi intuitiivse veebiliidese kaudu. Siiski pidi kasutajad tutvuma m\u00f5ne GCP funktsiooniga ja selle kontseptidega, sealhulgas selliste ressurssidega nagu projektid, andmehulgad ja tabelid. Oleme v\u00e4lja t\u00f6\u00f6tanud \u00f5ppematerjale ja juhendeid, et aidata kasutajatel alustada. P\u00f5hiteadmiste omandamisega on kasutajatel lihtne navigeerida andmehulkade vahel, vaadata tabelite skeeme ja andmeid, teha lihtsaid p\u00e4ringuid ning visualiseerida tulemusi Data Studios.<\/p>\n<p>Meie eesm\u00e4rk andmete sisestamisel BigQuery'sse oli tagada sujuv andmehulkade laadimine HDFS'ist v\u00f5i GCS'ist \u00fche hiirekl\u00f5psuga. Me vaatlesime <noindex><a rel=\"nofollow\" href=\"https:\/\/cloud.google.com\/composer\/\">Cloud Composer<\/a><\/noindex> (hallatav Airflow), kuid ei saanud seda kasutada meie \"Domain Restricted Sharing\" turvamudeli t\u00f5ttu (lisainfot leiate allpool jaotises \"Andmete haldamine\"). Katsetasime Google Data Transfer Service (DTS) kasutamist BigQuery koormuste \u00fclesannete haldamiseks. Kuigi DTS oli kiiresti seadistatav, ei olnud see paindlik s\u00f5ltuvustega torude loomiseks. Meie alfa versioonis l\u00f5ime oma Apache Airflow keskkonna GCE-s ning valmistame seda ette tootmisse viimiseks ja rohkemate andmeallikate, n\u00e4iteks Vertica, toetamiseks.<\/p>\n<p>Andmete konverteerimiseks BigQuery-s loovad kasutajad lihtsaid SQL andmetorusid, kasutades ajastatud p\u00e4ringuid. Komplekssete mitmeastmeliste s\u00f5ltuvustega torude jaoks plaanime kasutada kas meie enda Airflow infrastruktuuri v\u00f5i Cloud Composerit koos <noindex><a rel=\"nofollow\" href=\"https:\/\/cloud.google.com\/dataflow\/\">Cloud Dataflow<\/a><\/noindex>.<\/p>\n<h4>T\u00f5husus<\/h4>\n<p>\nBigQuery on loodud \u00fcldotstarbeliste SQL p\u00e4ringute jaoks, mis t\u00f6\u00f6tlevad suuri andmemahtusid. See ei ole m\u00f5eldud madala latentsuse ja k\u00f5rge l\u00e4bilaskev\u00f5imega p\u00e4ringute jaoks, mis on vajalikud tehingup\u00f5hise andmebaasi jaoks, ega madala latentsusega ajalooliste andmete anal\u00fc\u00fcsiks, mis on rakendatud <noindex><a rel=\"nofollow\" href=\"https:\/\/druid.apache.org\/\">Apache Druid<\/a><\/noindex>. Interaktiivsete anal\u00fc\u00fctiliste p\u00e4ringute jaoks ootavad meie kasutajad vastuseaega alla \u00fche minuti. Oleme pidanud projekteerima BigQuery kasutamise viisil, et see vastaks nende ootustele. Kasutajate jaoks usaldusv\u00e4\u00e4rse j\u00f5udluse tagamiseks oleme kasutanud BigQuery funktsionaalsust, mis on saadaval klientidele fikseeritud hinnaga, v\u00f5imaldades projektide omanikel reserveerida oma p\u00e4ringute jaoks minimaalsed slotid. <noindex><a rel=\"nofollow\" href=\"https:\/\/cloud.google.com\/bigquery\/docs\/slots\">Slot<\/a><\/noindex> BigQuery on arvutusv\u00f5imsuse \u00fcksus, mis on vajalik SQL p\u00e4ringute t\u00e4itmiseks. <\/p>\n<p>Me oleme anal\u00fc\u00fcsinud \u00fcle 800 p\u00e4ringu, mis t\u00f6\u00f6tlevad kokku umbes 1 TB andmeid, ning avastasime, et keskmine t\u00e4itmis aeg oli 30 sekundit. Samuti selgus, et j\u00f5udlus s\u00f5ltub meie sloti kasutamisest erinevates projektides ja \u00fclesannetes. Olime sunnitud selgelt eristama meie tootmis- ja ad hoc slotide reserve, et tagada tootmisstsenaariumide t\u00e4itmise j\u00f5udlus ja interaktiivne anal\u00fc\u00fcs. See m\u00f5jutas v\u00e4ga tugevalt meie slotide broneerimise ja projektide hierarhiat.<\/p>\n<p><i>Andmete haldamise, funktsionaalsuse ja s\u00fcsteemide kulude teemadest r\u00e4\u00e4gime juba l\u00e4hip\u00e4evil t\u00f5lke teises osas, kuid praegu kutsume k\u00f5iki soovijaid <noindex><a rel=\"nofollow\" href=\"https:\/\/otus.pw\/wDZQ\/\">tasuta live veebinarile<\/a><\/noindex>, mille k\u00e4igus saab p\u00f5hjalikult teada kursusest ja esitada k\u00fcsimusi meie eksperdile \u2014 Jevgeni Mate\u0161ukile (vanem andmeinsener, MaximaTelecom). <\/i><\/p>\n<p><\/p>\n<h2>Loe edasi:<\/h2>\n<p><\/p>\n<ul>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/otus\/blog\/501380\/\">Data Build Tool ehk mis seondub Hoiustamisega ja Smuutidega<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/otus\/blog\/502324\/\">Sukeldumine Delta Lake'i: skeemi sundrakendamine ja evolutsioon<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/otus\/blog\/503132\/\">Kiires Apache Parquet Pythonis koos Apache Arrowiga<\/a><\/noindex><\/li>\n<\/ul>\n<p>Allikas: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/otus\/blog\/513780\/\">habr.com<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u041f\u0440\u0438\u0432\u0435\u0442, \u0425\u0430\u0431\u0440! \u041f\u0440\u044f\u043c\u043e \u0441\u0435\u0439\u0447\u0430\u0441 \u0432 OTUS \u043e\u0442\u043a\u0440\u044b\u0442 \u043d\u0430\u0431\u043e\u0440 \u043d\u0430 \u043d\u043e\u0432\u044b\u0439 \u043f\u043e\u0442\u043e\u043a \u043a\u0443\u0440\u0441\u0430 \u00abData Engineer\u00bb. \u0412 \u043f\u0440\u0435\u0434\u0434\u0432\u0435\u0440\u0438\u0438 \u0441\u0442\u0430\u0440\u0442\u0430 \u043a\u0443\u0440\u0441\u0430 \u043c\u044b \u0442\u0440\u0430\u0434\u0438\u0446\u0438\u043e\u043d\u043d\u043e \u043f\u043e\u0434\u0433\u043e\u0442\u043e\u0432\u0438\u043b\u0438 \u0434\u043b\u044f \u0432\u0430\u0441 \u043f\u0435\u0440\u0435\u0432\u043e\u0434 \u0438\u043d\u0442\u0435\u0440\u0435\u0441\u043d\u043e\u0433\u043e \u043c\u0430\u0442\u0435\u0440\u0438\u0430\u043b\u0430. \u041a\u0430\u0436\u0434\u044b\u0439 \u0434\u0435\u043d\u044c \u0431\u043e\u043b\u0435\u0435 \u0441\u0442\u0430 \u043c\u0438\u043b\u043b\u0438\u043e\u043d\u043e\u0432 \u0447\u0435\u043b\u043e\u0432\u0435\u043a \u043f\u043e\u0441\u0435\u0449\u0430\u044e\u0442 Twitter, \u0447\u0442\u043e\u0431\u044b \u0443\u0437\u043d\u0430\u0442\u044c, \u0447\u0442\u043e \u043f\u0440\u043e\u0438\u0441\u0445\u043e\u0434\u0438\u0442 \u0432 \u043c\u0438\u0440\u0435, \u0438 \u043e\u0431\u0441\u0443\u0434\u0438\u0442\u044c \u044d\u0442\u043e. \u041a\u0430\u0436\u0434\u044b\u0439 \u0442\u0432\u0438\u0442 \u0438 \u043b\u044e\u0431\u043e\u0435 \u0434\u0440\u0443\u0433\u043e\u0435 \u0434\u0435\u0439\u0441\u0442\u0432\u0438\u044f \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u044f \u0433\u0435\u043d\u0435\u0440\u0438\u0440\u0443\u044e\u0442 \u0441\u043e\u0431\u044b\u0442\u0438\u0435, \u0434\u043e\u0441\u0442\u0443\u043f\u043d\u043e\u0435 \u0434\u043b\u044f \u0432\u043d\u0443\u0442\u0440\u0435\u043d\u043d\u0435\u0433\u043e [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":90784,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-90783","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.1.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u041f\u0440\u0438\u0432\u0435\u0442, \u0425\u0430\u0431\u0440! \u041f\u0440\u044f\u043c\u043e \u0441\u0435\u0439\u0447\u0430\u0441 \u0432 OTUS \u043e\u0442\u043a\u0440\u044b\u0442 \u043d\u0430\u0431\u043e\u0440 \u043d\u0430 \u043d\u043e\u0432\u044b\u0439 \u043f\u043e\u0442\u043e\u043a \u043a\u0443\u0440\u0441\u0430 \u00abData Engineer\u00bb.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/kak-bigquery-ot-google-demokratiziroval-analiz-dannyh-chast-1\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.1.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"et_EE\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u041a\u0430\u043a BigQuery \u043e\u0442 Google \u0434\u0435\u043c\u043e\u043a\u0440\u0430\u0442\u0438\u0437\u0438\u0440\u043e\u0432\u0430\u043b \u0430\u043d\u0430\u043b\u0438\u0437 \u0434\u0430\u043d\u043d\u044b\u0445. \u0427\u0430\u0441\u0442\u044c 1 | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u041f\u0440\u0438\u0432\u0435\u0442, \u0425\u0430\u0431\u0440! \u041f\u0440\u044f\u043c\u043e \u0441\u0435\u0439\u0447\u0430\u0441 \u0432 OTUS \u043e\u0442\u043a\u0440\u044b\u0442 \u043d\u0430\u0431\u043e\u0440 \u043d\u0430 \u043d\u043e\u0432\u044b\u0439 \u043f\u043e\u0442\u043e\u043a \u043a\u0443\u0440\u0441\u0430 \u00abData Engineer\u00bb.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/kak-bigquery-ot-google-demokratiziroval-analiz-dannyh-chast-1\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-08-05T23:42:19+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-08-05T23:42:19+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Kuidas Google'i BigQuery on demokratiseerinud andmete anal\u00fc\u00fcsi. Osa 1 | ProHoster","description":"Tere, Habrahabr! Praegu toimub OTUSes uue \"Andmeinseneri\" kursuse voolu vastuv\u00f5tt.","canonical_url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/kak-bigquery-ot-google-demokratiziroval-analiz-dannyh-chast-1","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041a\u0430\u043a BigQuery \u043e\u0442 Google \u0434\u0435\u043c\u043e\u043a\u0440\u0430\u0442\u0438\u0437\u0438\u0440\u043e\u0432\u0430\u043b \u0430\u043d\u0430\u043b\u0438\u0437 \u0434\u0430\u043d\u043d\u044b\u0445. \u0427\u0430\u0441\u0442\u044c 1 | ProHoster","og:description":"\u041f\u0440\u0438\u0432\u0435\u0442, \u0425\u0430\u0431\u0440! \u041f\u0440\u044f\u043c\u043e \u0441\u0435\u0439\u0447\u0430\u0441 \u0432 OTUS \u043e\u0442\u043a\u0440\u044b\u0442 \u043d\u0430\u0431\u043e\u0440 \u043d\u0430 \u043d\u043e\u0432\u044b\u0439 \u043f\u043e\u0442\u043e\u043a \u043a\u0443\u0440\u0441\u0430 \u00abData Engineer\u00bb.","og:url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/kak-bigquery-ot-google-demokratiziroval-analiz-dannyh-chast-1","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-08-05T23:42:19+00:00","article:modified_time":"2020-08-05T23:42:19+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"90783","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 12:42:25","updated":"2022-10-03 03:00:18","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/90783","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=90783"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/90783\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media\/90784"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=90783"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=90783"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=90783"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}