{"id":30268,"date":"2019-10-31T21:34:35","date_gmt":"2019-10-31T18:34:35","guid":{"rendered":"https:\/\/prohoster.info\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya\/"},"modified":"2019-10-31T21:34:35","modified_gmt":"2019-10-31T18:34:35","slug":"kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya","title":{"rendered":"Kuidas liikuda, laadida ja integreerida v\u00e4ga suuri andmeid kiiresti ja odavalt? Mis on pushdown-optimeerimine?","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Iga operatsioon suurte andmetega n\u00f5uab suurt arvutusv\u00f5imet. Tavaline andmete liigutamine Hadoopi andmebaasist v\u00f5ib kesta n\u00e4dalaid v\u00f5i maksta t\u00f5eliselt palju. Ei soovi oodata ega raisata? Tasakaalustage koormust erinevate platvormide vahel. \u00dcks v\u00f5imalus on pushdown-optimeerimine.<\/p>\n<p><\/p>\n<p>Palusin Venemaa juhtival Informatica toodete arendamise ja haldamise treeneril Aleksei Ananjevil r\u00e4\u00e4kida pushdown-optimeerimise funktsioonist Informatica Big Data Managementis (BDM). Kui kunagi \u00f5ppisite t\u00f6\u00f6tama Informatica toodetega, siis t\u00f5en\u00e4oliselt r\u00e4\u00e4kis just Aleksei teile PowerCenteri p\u00f5hialustest ja selgitas, kuidas luua kaarte. <\/p>\n<p><\/p>\n<p><strong>Aleksei Ananjev, DIS Group koolituse juht<\/strong><\/p>\n<p><\/p>\n<p><strong>Mis on pushdown?<\/strong><\/p>\n<p><\/p>\n<p>Paljud teist tunnevad juba Informatica Big Data Managementi (BDM). Toode suudab integreerida suurandmeid erinevatest allikatest, liigutada neid erinevate s\u00fcsteemide vahel, tagada nendele lihtne ligip\u00e4\u00e4s, v\u00f5imaldab neid profiilida ja palju muud.<br \/>\nOsav\u00f5tlikus k\u00e4sit\u00f6\u00f6s suudab BDM teha imesid: \u00fclesanded t\u00e4idetakse kiiresti ja minimaalsete arvutusressurssidega. <\/p>\n<p><\/p>\n<p>Kas soovite ka seda? \u00d5ppige kasutama BDM pushdown funktsiooni arvutuskoormuse jaotamiseks erinevate platvormide vahel. Pushdown tehnoloogia v\u00f5imaldab muuta kaardistamise skriptiks ja valida keskkonna, milles see skript k\u00e4ivitub. Sellise valiku v\u00f5imalus v\u00f5imaldab kombineerida erinevate platvormide tugevusi ja saavutada nende maksimaalset tootlikkust.<\/p>\n<p><\/p>\n<p>Skripti t\u00e4itmise keskkonna seadistamiseks tuleb valida pushdown t\u00fc\u00fcp. Skript v\u00f5ib olla t\u00e4ielikult k\u00e4ivitatud Hadoopis v\u00f5i osaliselt jaotatud allika ja sihtkoha vahel. On 4 v\u00f5imalikku pushdown t\u00fc\u00fcpi. Kaardistamist ei pea muutma skriptiks (native). Kaardistamist saab maksimaalselt k\u00e4ivitada allikas (source) v\u00f5i t\u00e4ielikult allikas (full). Samuti saab kaardistamise muuta Hadoopi skriptiks (none).<\/p>\n<p><noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<p><strong>Pushdown-optimeerimine<\/strong><\/p>\n<p><\/p>\n<p>K\u00f5iki nimetatud 4 t\u00fc\u00fcpi saab omavahel erinevalt kombineerida \u2013 optimeerides pushdown'i konkreetsed s\u00fcsteemi vajadused. N\u00e4iteks on sageli m\u00f5istlikum andmeid andmebaasist v\u00e4lja v\u00f5tta, kasutades selle enda v\u00f5imalusi. Andmete t\u00f6\u00f6tlemine v\u00f5iks toimuda Hadoopi abil, et mitte koormata andmebaasi \u00fcle.<\/p>\n<p><\/p>\n<p>Vaatleme olukorda, kus nii allikas kui ka sihtkoht asuvad andmebaasis, ning transformatsioonide t\u00e4itmise platvormi saab valida: s\u00f5ltuvalt seadistustest v\u00f5ib see olla Informatica, andmebaasi server v\u00f5i Hadoop. Selline n\u00e4ide aitab k\u00f5ige paremini m\u00f5ista selle mehhanismi tehnilist k\u00fclge. Loomulikult ei esine selline olukord reaalses elus, kuid funktsionaalsuse demonstreerimiseks sobib see k\u00f5ige paremini. <\/p>\n<p><\/p>\n<p>V\u00f5tame kaardi kahe tabeli lugemiseks, mis asuvad \u00fches Oracle'i andmebaasis. Ja lugemise tulemused salvestatakse sellesse samasse tabelisse. Kaardistuse schema on j\u00e4rgmine:<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Kuidas liikuda, laadida ja integreerida v\u00e4ga suuri andmeid kiiresti ja odavalt? Mis on pushdown-optimeerimine?\" src=\"\/wp-content\/uploads\/2019\/03\/e5bdacf6d7b0c3dbffd56c4876515520.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Informatica BDM 10.2.1 mappina n\u00e4eb see v\u00e4lja j\u00e4rgmine:<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Kuidas liikuda, laadida ja integreerida v\u00e4ga suuri andmeid kiiresti ja odavalt? Mis on pushdown-optimeerimine?\" src=\"\/wp-content\/uploads\/2019\/03\/5e7e1d81f0eac539aaec1c21717341e7.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p><strong>Pushdown'i t\u00fc\u00fcp \u2013 native<\/strong><\/p>\n<p><\/p>\n<p>Kui valime pushdown'i t\u00fc\u00fcbiks native, siis kaardistus teostatakse <a class=\"wpil_keyword_link\" href=\"https:\/\/prohoster.info\/et\/server\/dts-dronten\/\"   title=\"serveril\" data-wpil-keyword-link=\"linked\"  data-wpil-monitor-id=\"2457\">serveril<\/a> Informatica. Andmed loetakse Oracle serverist, edastatakse Informatica serverisse, muudetakse seal ja \u00fcle kantakse Hadoopisse. Teisis\u00f5nu, saame tavalise ETL-protsessi.<\/p>\n<p><\/p>\n<p><strong>Pushdown t\u00fc\u00fcp \u2013 source <\/strong><\/p>\n<p><\/p>\n<p>Source t\u00fc\u00fcbi valimisel saame v\u00f5imaluse jagada meie protsessi <a class=\"wpil_keyword_link\" href=\"https:\/\/prohoster.info\/et\/server\/dts-prohoster\/\"   title=\"serveriga\" data-wpil-keyword-link=\"linked\"  data-wpil-monitor-id=\"2959\">serveriga<\/a> andmebaaside (ABD) ja Hadoopi vahel. Selle seadistusega protsessi k\u00e4ivitamisel saadetakse andmete valimise p\u00e4ringud andmebaasi tabelitest. K\u00f5ik muu toimub Hadoopis sammudena.<br \/>\nT\u00e4itmise skeem n\u00e4eb v\u00e4lja j\u00e4rgmine:<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Kuidas liikuda, laadida ja integreerida v\u00e4ga suuri andmeid kiiresti ja odavalt? Mis on pushdown-optimeerimine?\" src=\"\/wp-content\/uploads\/2019\/03\/8b3b071ea0580394b222da033effceee.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Allpool on n\u00e4ide t\u00e4itmisvahekorra seadistamisest.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Kuidas liikuda, laadida ja integreerida v\u00e4ga suuri andmeid kiiresti ja odavalt? Mis on pushdown-optimeerimine?\" src=\"\/wp-content\/uploads\/2019\/03\/da7434ae71f4b2265f61fd31e182897e.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Sellisel juhul viidatakse kaardistamine kahele sammele. Selle seadetes n\u00e4eme, et see on muutunud skriptiks, mis saadetakse allikale. Lauad ja andmete muutmine toimuvad allikas \u00fcmbersuunatud p\u00e4ringuna.<br \/>\nAlloleval pildil n\u00e4eme optimeeritud kaardistamist BDM-il, ja allikal \u2013 \u00fcmbersuunatud p\u00e4ringut.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Kuidas liikuda, laadida ja integreerida v\u00e4ga suuri andmeid kiiresti ja odavalt? Mis on pushdown-optimeerimine?\" src=\"\/wp-content\/uploads\/2019\/03\/c0e7534b06d2e09785ad8a6c5df15f6f.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Hadoopi roll selles konfiguratsioonis on andmevoo haldamine \u2013 nende dirigeerimine. P\u00e4ringu tulemus saadetakse Hadoopi. P\u00e4rast lugemise l\u00f5ppu salvestatakse fail Hadoopist vastuv\u00f5tjasse.<\/p>\n<p><\/p>\n<p><strong>Pushdown t\u00fc\u00fcp \u2013 full <\/strong><\/p>\n<p><\/p>\n<p>Full t\u00fc\u00fcbi valimisel muudetakse mappimine t\u00e4ielikult andmebaasi p\u00e4ringuks. P\u00e4ringu tulemus saadetakse Hadoopile. Selle protsessi skeem on esitatud allpool.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Kuidas liikuda, laadida ja integreerida v\u00e4ga suuri andmeid kiiresti ja odavalt? Mis on pushdown-optimeerimine?\" src=\"\/wp-content\/uploads\/2019\/03\/bfbb3f593a7053a0157d481d9b3bce83.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Seadistuse n\u00e4ide on esitatud allpool.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Kuidas liikuda, laadida ja integreerida v\u00e4ga suuri andmeid kiiresti ja odavalt? Mis on pushdown-optimeerimine?\" src=\"\/wp-content\/uploads\/2019\/03\/31c70c7fb10996d5a506c6a4618f5f2f.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Tulemusena saame optimeeritud mappimise, mis on sarnane eelmisele. Erinevus seisneb ainult selles, et kogu loogika kantakse vastuv\u00f5tjale \u00fcle tema sisestuse \u00fclekirjutamise kujul. Optimeeritud mappimise n\u00e4ide on esitatud allpool.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Kuidas liikuda, laadida ja integreerida v\u00e4ga suuri andmeid kiiresti ja odavalt? Mis on pushdown-optimeerimine?\" src=\"\/wp-content\/uploads\/2019\/03\/edabf7ab6eba768849d096a4319e5126.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Siin, nagu eelmiseski juhul, t\u00e4idab Hadoop dirigendi rolli. Kuid siin loetakse allikas tervikuna, p\u00e4rast mida teostatakse andmete t\u00f6\u00f6tlemise loogika vastuv\u00f5tja tasandil.<\/p>\n<p><\/p>\n<p><strong>Pushdown t\u00fc\u00fcp \u2013 null<\/strong><\/p>\n<p><\/p>\n<p>Ja viimane variant \u2013 pushdown t\u00fc\u00fcp, mille raames meie mappimine muutub Hadoopi skriptiks.<\/p>\n<p><\/p>\n<p>Optimeeritud mappimine n\u00e4eb n\u00fc\u00fcd v\u00e4lja nii:<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Kuidas liikuda, laadida ja integreerida v\u00e4ga suuri andmeid kiiresti ja odavalt? Mis on pushdown-optimeerimine?\" src=\"\/wp-content\/uploads\/2019\/03\/deb8311403d4e95c2fef06d3b5c94e64.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Siin loetakse andmed esmalt allikafailidest Hadoopis. Seej\u00e4rel kombineeritakse need kaks faili samade vahenditega. P\u00e4rast seda muudetakse andmed ja laaditakse andmebaasi v\u00e4lja.<\/p>\n<p><\/p>\n<p>M\u00f5istes pushdown-optimeerimise p\u00f5him\u00f5tteid, saab suuri andmeid t\u00f6\u00f6tlemise protsesse v\u00e4ga efektiivselt korraldada. Nii, n\u00e4iteks hiljuti suutis \u00fcks suur ettev\u00f5te m\u00f5ne n\u00e4dalaga laadida Hadoopi oma aastal kogutud suure koguse andmeid, mida oli kogutud aastaid.<\/p>\n<p>Allikas: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/445240\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u041b\u044e\u0431\u0430\u044f \u043e\u043f\u0435\u0440\u0430\u0446\u0438\u044f \u0441 \u0431\u043e\u043b\u044c\u0448\u0438\u043c\u0438 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0442\u0440\u0435\u0431\u0443\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u0445 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u0435\u0439. \u041e\u0431\u044b\u0447\u043d\u043e\u0435 \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0435\u043d\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0431\u0430\u0437\u044b \u043d\u0430 Hadoop \u043c\u043e\u0436\u0435\u0442 \u0434\u043b\u0438\u0442\u044c\u0441\u044f \u043d\u0435\u0434\u0435\u043b\u044f\u043c\u0438 \u0438\u043b\u0438 \u0441\u0442\u043e\u0438\u0442\u044c, \u043a\u0430\u043a \u043a\u0440\u044b\u043b\u043e \u0441\u0430\u043c\u043e\u043b\u0451\u0442\u0430. \u041d\u0435 \u0445\u043e\u0442\u0438\u0442\u0435 \u0436\u0434\u0430\u0442\u044c \u0438 \u0442\u0440\u0430\u0442\u0438\u0442\u044c\u0441\u044f? \u0421\u0431\u0430\u043b\u0430\u043d\u0441\u0438\u0440\u0443\u0439\u0442\u0435 \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0443 \u043d\u0430 \u0440\u0430\u0437\u043d\u044b\u0435 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b. \u041e\u0434\u0438\u043d \u0438\u0437 \u0441\u043f\u043e\u0441\u043e\u0431\u043e\u0432 \u2013 pushdown-\u043e\u043f\u0442\u0438\u043c\u0438\u0437\u0430\u0446\u0438\u044f. \u042f \u043f\u043e\u043f\u0440\u043e\u0441\u0438\u043b \u0432\u0435\u0434\u0443\u0449\u0435\u0433\u043e \u0432 \u0420\u043e\u0441\u0441\u0438\u0438 \u0442\u0440\u0435\u043d\u0435\u0440\u0430 \u043f\u043e \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0435 \u0438 \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044e \u043f\u0440\u043e\u0434\u0443\u043a\u0442\u043e\u0432 Informatica \u0410\u043b\u0435\u043a\u0441\u0435\u044f \u0410\u043d\u0430\u043d\u044c\u0435\u0432\u0430 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u0430\u0442\u044c \u043e [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[10],"tags":[],"class_list":["post-30268","post","type-post","status-publish","format-standard","hentry","category-blog"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 4.9.10 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u041b\u044e\u0431\u0430\u044f \u043e\u043f\u0435\u0440\u0430\u0446\u0438\u044f \u0441 \u0431\u043e\u043b\u044c\u0448\u0438\u043c\u0438 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0442\u0440\u0435\u0431\u0443\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u0445 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u0435\u0439. \u041e\u0431\u044b\u0447\u043d\u043e\u0435 \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0435\u043d\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0431\u0430\u0437\u044b \u043d\u0430 Hadoop \u043c\u043e\u0436\u0435\u0442 \u0434\u043b\u0438\u0442\u044c\u0441\u044f \u043d\u0435\u0434\u0435\u043b\u044f\u043c\u0438 \u0438\u043b\u0438 \u0441\u0442\u043e\u0438\u0442\u044c, \u043a\u0430\u043a \u043a\u0440\u044b\u043b\u043e \u0441\u0430\u043c\u043e\u043b\u0451\u0442\u0430. \u041d\u0435 \u0445\u043e\u0442\u0438\u0442\u0435 \u0436\u0434\u0430\u0442\u044c \u0438 \u0442\u0440\u0430\u0442\u0438\u0442\u044c\u0441\u044f? \u0421\u0431\u0430\u043b\u0430\u043d\u0441\u0438\u0440\u0443\u0439\u0442\u0435 \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0443 \u043d\u0430 \u0440\u0430\u0437\u043d\u044b\u0435 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b. \u041e\u0434\u0438\u043d \u0438\u0437 \u0441\u043f\u043e\u0441\u043e\u0431\u043e\u0432 \u2013 pushdown-\u043e\u043f\u0442\u0438\u043c\u0438\u0437\u0430\u0446\u0438\u044f. \u042f \u043f\u043e\u043f\u0440\u043e\u0441\u0438\u043b \u0432\u0435\u0434\u0443\u0449\u0435\u0433\u043e \u0432 \u0420\u043e\u0441\u0441\u0438\u0438 \u0442\u0440\u0435\u043d\u0435\u0440\u0430 \u043f\u043e \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0435 \u0438 \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044e \u043f\u0440\u043e\u0434\u0443\u043a\u0442\u043e\u0432 Informatica \u0410\u043b\u0435\u043a\u0441\u0435\u044f \u0410\u043d\u0430\u043d\u044c\u0435\u0432\u0430 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u0430\u0442\u044c \u043e\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/et\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 4.9.10\" \/>\n\t\t<meta property=\"og:locale\" content=\"et_EE\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u041a\u0430\u043a \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0430\u0442\u044c, \u0432\u044b\u0433\u0440\u0443\u0436\u0430\u0442\u044c \u0438 \u0438\u043d\u0442\u0435\u0433\u0440\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u043e\u0447\u0435\u043d\u044c \u0431\u043e\u043b\u044c\u0448\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0435 \u0434\u0451\u0448\u0435\u0432\u043e \u0438 \u0431\u044b\u0441\u0442\u0440\u043e? \u0427\u0442\u043e \u0442\u0430\u043a\u043e\u0435 pushdown-\u043e\u043f\u0442\u0438\u043c\u0438\u0437\u0430\u0446\u0438\u044f? | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u041b\u044e\u0431\u0430\u044f \u043e\u043f\u0435\u0440\u0430\u0446\u0438\u044f \u0441 \u0431\u043e\u043b\u044c\u0448\u0438\u043c\u0438 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0442\u0440\u0435\u0431\u0443\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u0445 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u0435\u0439. \u041e\u0431\u044b\u0447\u043d\u043e\u0435 \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0435\u043d\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0431\u0430\u0437\u044b \u043d\u0430 Hadoop \u043c\u043e\u0436\u0435\u0442 \u0434\u043b\u0438\u0442\u044c\u0441\u044f \u043d\u0435\u0434\u0435\u043b\u044f\u043c\u0438 \u0438\u043b\u0438 \u0441\u0442\u043e\u0438\u0442\u044c, \u043a\u0430\u043a \u043a\u0440\u044b\u043b\u043e \u0441\u0430\u043c\u043e\u043b\u0451\u0442\u0430. \u041d\u0435 \u0445\u043e\u0442\u0438\u0442\u0435 \u0436\u0434\u0430\u0442\u044c \u0438 \u0442\u0440\u0430\u0442\u0438\u0442\u044c\u0441\u044f? \u0421\u0431\u0430\u043b\u0430\u043d\u0441\u0438\u0440\u0443\u0439\u0442\u0435 \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0443 \u043d\u0430 \u0440\u0430\u0437\u043d\u044b\u0435 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b. \u041e\u0434\u0438\u043d \u0438\u0437 \u0441\u043f\u043e\u0441\u043e\u0431\u043e\u0432 \u2013 pushdown-\u043e\u043f\u0442\u0438\u043c\u0438\u0437\u0430\u0446\u0438\u044f. \u042f \u043f\u043e\u043f\u0440\u043e\u0441\u0438\u043b \u0432\u0435\u0434\u0443\u0449\u0435\u0433\u043e \u0432 \u0420\u043e\u0441\u0441\u0438\u0438 \u0442\u0440\u0435\u043d\u0435\u0440\u0430 \u043f\u043e \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0435 \u0438 \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044e \u043f\u0440\u043e\u0434\u0443\u043a\u0442\u043e\u0432 Informatica \u0410\u043b\u0435\u043a\u0441\u0435\u044f \u0410\u043d\u0430\u043d\u044c\u0435\u0432\u0430 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u0430\u0442\u044c \u043e\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/et\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2019-10-31T18:34:35+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2019-10-31T18:34:35+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Kuidas liigutada, laadida ja integreerida v\u00e4ga suuri andmeid odavalt ja kiiresti? Mis on pushdown-optimeerimine? | ProHoster","description":"Iga suurte andmete t\u00f6\u00f6tlemine vajab suurt arvutusv\u00f5imsust. Tavaandmete liigutamine andmebaasist Hadoopisse v\u00f5ib kesta n\u00e4dalaid v\u00f5i maksta nagu lennuki tiib. Kas te ei soovi oodata ja raha kulutada? Tasakaalustage koormust erinevate platvormide vahel. \u00dcks v\u00f5imalus on pushdown-optimeerimine. Palusin Venemaa juhtival Informatica toodete arenduse ja haldamise koolitajal Alexei Ananijevil r\u00e4\u00e4kida sellest.","canonical_url":"https:\/\/prohoster.info\/et\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041a\u0430\u043a \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0430\u0442\u044c, \u0432\u044b\u0433\u0440\u0443\u0436\u0430\u0442\u044c \u0438 \u0438\u043d\u0442\u0435\u0433\u0440\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u043e\u0447\u0435\u043d\u044c \u0431\u043e\u043b\u044c\u0448\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0435 \u0434\u0451\u0448\u0435\u0432\u043e \u0438 \u0431\u044b\u0441\u0442\u0440\u043e? \u0427\u0442\u043e \u0442\u0430\u043a\u043e\u0435 pushdown-\u043e\u043f\u0442\u0438\u043c\u0438\u0437\u0430\u0446\u0438\u044f? | ProHoster","og:description":"\u041b\u044e\u0431\u0430\u044f \u043e\u043f\u0435\u0440\u0430\u0446\u0438\u044f \u0441 \u0431\u043e\u043b\u044c\u0448\u0438\u043c\u0438 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0442\u0440\u0435\u0431\u0443\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u0445 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u0435\u0439. \u041e\u0431\u044b\u0447\u043d\u043e\u0435 \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0435\u043d\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0431\u0430\u0437\u044b \u043d\u0430 Hadoop \u043c\u043e\u0436\u0435\u0442 \u0434\u043b\u0438\u0442\u044c\u0441\u044f \u043d\u0435\u0434\u0435\u043b\u044f\u043c\u0438 \u0438\u043b\u0438 \u0441\u0442\u043e\u0438\u0442\u044c, \u043a\u0430\u043a \u043a\u0440\u044b\u043b\u043e \u0441\u0430\u043c\u043e\u043b\u0451\u0442\u0430. \u041d\u0435 \u0445\u043e\u0442\u0438\u0442\u0435 \u0436\u0434\u0430\u0442\u044c \u0438 \u0442\u0440\u0430\u0442\u0438\u0442\u044c\u0441\u044f? \u0421\u0431\u0430\u043b\u0430\u043d\u0441\u0438\u0440\u0443\u0439\u0442\u0435 \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0443 \u043d\u0430 \u0440\u0430\u0437\u043d\u044b\u0435 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b. \u041e\u0434\u0438\u043d \u0438\u0437 \u0441\u043f\u043e\u0441\u043e\u0431\u043e\u0432 \u2013 pushdown-\u043e\u043f\u0442\u0438\u043c\u0438\u0437\u0430\u0446\u0438\u044f. \u042f \u043f\u043e\u043f\u0440\u043e\u0441\u0438\u043b \u0432\u0435\u0434\u0443\u0449\u0435\u0433\u043e \u0432 \u0420\u043e\u0441\u0441\u0438\u0438 \u0442\u0440\u0435\u043d\u0435\u0440\u0430 \u043f\u043e \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0435 \u0438 \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044e \u043f\u0440\u043e\u0434\u0443\u043a\u0442\u043e\u0432 Informatica \u0410\u043b\u0435\u043a\u0441\u0435\u044f \u0410\u043d\u0430\u043d\u044c\u0435\u0432\u0430 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u0430\u0442\u044c \u043e","og:url":"https:\/\/prohoster.info\/et\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T18:34:35+00:00","article:modified_time":"2019-10-31T18:34:35+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"30268","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"Article","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-02-09 21:49:15","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 03:38:39","updated":"2026-02-09 21:49:15"},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/30268","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=30268"}],"version-history":[{"count":2,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/30268\/revisions"}],"predecessor-version":[{"id":160240,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/30268\/revisions\/160240"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=30268"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=30268"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=30268"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}