{"id":30268,"date":"2019-10-31T21:34:35","date_gmt":"2019-10-31T18:34:35","guid":{"rendered":"https:\/\/prohoster.info\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya\/"},"modified":"2019-10-31T21:34:35","modified_gmt":"2019-10-31T18:34:35","slug":"kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya","title":{"rendered":"Si q\u00eb t\u00eb transferoni, eksportoni dhe integroni t\u00eb dh\u00ebna shum\u00eb t\u00eb m\u00ebdha n\u00eb m\u00ebnyr\u00eb t\u00eb lir\u00eb dhe t\u00eb shpejt\u00eb? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown?","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>\u00c7do operacion me t\u00eb dh\u00ebna t\u00eb m\u00ebdha k\u00ebrkon kapacitete t\u00eb m\u00ebdha kompjuterike. Transferimi i zakonsh\u00ebm i t\u00eb dh\u00ebnave nga baza n\u00eb Hadoop mund t\u00eb zgjas\u00eb jav\u00eb ose t\u00eb kushtoj\u00eb si nj\u00eb krah avioni. A nuk doni t\u00eb prisni dhe t\u00eb shpenzoni? Balanconi ngarkes\u00ebn mbi platforma t\u00eb ndryshme. Nj\u00eb nga m\u00ebnyrat \u2013 \u00ebsht\u00eb optimizimi pushdown.<\/p>\n<p><\/p>\n<p>I k\u00ebrkova trajnerit kryesor n\u00eb Rusi p\u00ebr zhvillimin dhe administrimin e produkteve Informatica, Aleksej Ananjev, q\u00eb t\u00eb flas\u00eb p\u00ebr funksionin e optimizimit pushdown n\u00eb Informatica Big Data Management (BDM). A ka ndodhur ndonj\u00ebher\u00eb t\u00eb m\u00ebsoni t\u00eb punoni me produktet e Informatica? Me siguri Aleksej ju ka m\u00ebsuar bazat e PowerCenter dhe ka shpjeguar se si t\u00eb krijoni mappings. <\/p>\n<p><\/p>\n<p><strong>Aleksej Ananjev, drejtues i departamentit t\u00eb trajnimit DIS Group<\/strong><\/p>\n<p><\/p>\n<p><strong>\u00c7far\u00eb \u00ebsht\u00eb pushdown?<\/strong><\/p>\n<p><\/p>\n<p>Shumica prej jush jan\u00eb t\u00eb njohur me Informatica Big Data Management (BDM). Produkti mund\u00ebson integrimin e t\u00eb dh\u00ebnave t\u00eb m\u00ebdha nga burime t\u00eb ndryshme, t\u2019i transferoni ato midis sistemeve t\u00eb ndryshme, ofron akses t\u00eb leht\u00eb n\u00eb to, lejon profilizimin e tyre dhe shum\u00eb m\u00eb tep\u00ebr.<br \/>\nN\u00eb duar t\u00eb zot\u00eb, BDM \u00ebsht\u00eb n\u00eb gjendje t\u00eb realizoj\u00eb mrekulli: detyrat do t\u00eb kryhen shpejt dhe me burime minimale kompjuterike. <\/p>\n<p><\/p>\n<p>A d\u00ebshironi edhe ju k\u00ebshtu? M\u00ebsoni sesi t\u00eb p\u00ebrdorni funksionin pushdown n\u00eb BDM p\u00ebr t\u00eb shp\u00ebrndar\u00eb ngarkes\u00ebn kompjuterike midis platformave t\u00eb ndryshme. Teknologjia pushdown lejon kthimin e mapping-ut n\u00eb nj\u00eb skript dhe zgjedhjen e mjedisit ku do t\u00eb ekzekutohet ky skript. Kjo mund\u00ebsi e zgjedhjes b\u00ebn t\u00eb mundur kombinimin e pikave t\u00eb forta t\u00eb platformave t\u00eb ndryshme dhe arritjen e performanc\u00ebs maksimale t\u00eb tyre.<\/p>\n<p><\/p>\n<p>P\u00ebr t\u00eb konfigurimin e mjedisit t\u00eb ekzekutimit t\u00eb skriptit, duhet t\u00eb zgjidhni llojin e pushdown. Skripti mund t\u00eb ekzekutohet plot\u00ebsisht n\u00eb Hadoop ose t\u00eb shp\u00ebrndahet pjes\u00ebrisht midis burimit dhe marr\u00ebsit. Ekzistojn\u00eb 4 lloje t\u00eb mundshme pushdown. Mapping-u mund t\u00eb mos kthehet n\u00eb skript (native). Mapping-u mund t\u00eb ekzekutohet maksimalisht n\u00eb burim (source) ose plot\u00ebsisht n\u00eb burim (full). Po ashtu, mapping-u mund t\u00eb kthehet n\u00eb skript Hadoop (none).<\/p>\n<p><noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<p><strong>Optimizimi pushdown<\/strong><\/p>\n<p><\/p>\n<p>T\u00eb kat\u00ebr llojet e p\u00ebrmendura mund t\u00eb kombinohen n\u00eb m\u00ebnyra t\u00eb ndryshme \u2013 optimizimi i pushdown p\u00ebr nevojat specifike t\u00eb sistemit. P\u00ebr shembull, shpesh \u00ebsht\u00eb m\u00eb e arsyeshme t\u00eb nxirreni t\u00eb dh\u00ebnat nga baza e t\u00eb dh\u00ebnave duke p\u00ebrdorur mund\u00ebsit\u00eb e saj t\u00eb veta. Nd\u00ebrsa transformimi i t\u00eb dh\u00ebnave \u2013 nga fuqit\u00eb e Hadoop-it, p\u00ebr t\u00eb mos e ngarkuar vet\u00eb baz\u00ebn.<\/p>\n<p><\/p>\n<p>Le t\u00eb shqyrtojm\u00eb nj\u00eb rast kur si burimi ashtu edhe marr\u00ebsi ndodhen n\u00eb DB, dhe platforma e ekzekutimit t\u00eb transformimeve mund t\u00eb zgjidhet: n\u00eb var\u00ebsi t\u00eb cil\u00ebsimeve, kjo do t\u00eb jet\u00eb Informatica, serveri i DB ose Hadoop. Ky shembull do t\u00eb lejoj\u00eb t\u00eb kuptojm\u00eb m\u00eb sakt\u00eb an\u00ebn teknike t\u00eb funksionimit t\u00eb k\u00ebtij mekanizmi. Natyrisht, n\u00eb jet\u00ebn reale, nj\u00eb situat\u00eb e till\u00eb nuk ndodh, por p\u00ebr demonstruese t\u00eb funksionalitetit, ajo \u00ebsht\u00eb m\u00eb e p\u00ebrshtatshme. <\/p>\n<p><\/p>\n<p>Le t\u00eb marrim nj\u00eb hartim p\u00ebr leximin e dy tabelave n\u00eb nj\u00eb baz\u00eb t\u00eb vetme t\u00eb dh\u00ebnash Oracle. Dhe rezultatet e leximit le t\u00eb regjistrohen n\u00eb nj\u00eb tabel\u00eb n\u00eb t\u00eb nj\u00ebjt\u00ebn baz\u00eb. Skema e hartimit do t\u00eb duket k\u00ebshtu:<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Si q\u00eb t\u00eb transferoni, eksportoni dhe integroni t\u00eb dh\u00ebna shum\u00eb t\u00eb m\u00ebdha n\u00eb m\u00ebnyr\u00eb t\u00eb lir\u00eb dhe t\u00eb shpejt\u00eb? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown?\" src=\"\/wp-content\/uploads\/2019\/03\/e5bdacf6d7b0c3dbffd56c4876515520.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>N\u00eb form\u00ebn e hartimit n\u00eb Informatica BDM 10.2.1, kjo duket k\u00ebshtu:<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Si q\u00eb t\u00eb transferoni, eksportoni dhe integroni t\u00eb dh\u00ebna shum\u00eb t\u00eb m\u00ebdha n\u00eb m\u00ebnyr\u00eb t\u00eb lir\u00eb dhe t\u00eb shpejt\u00eb? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown?\" src=\"\/wp-content\/uploads\/2019\/03\/5e7e1d81f0eac539aaec1c21717341e7.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p><strong>Tipi pushdown \u2013 native<\/strong><\/p>\n<p><\/p>\n<p>N\u00ebse ne zgjedhim tipin pushdown native, at\u00ebher\u00eb hartimi do t\u00eb ekzekutohet n\u00eb <a class=\"wpil_keyword_link\" href=\"https:\/\/prohoster.info\/sq\/server\/dts-dronten\/\"   title=\"\u0441\u0435\u0440\u0432\u0435\u0440\u0435\" data-wpil-keyword-link=\"linked\"  data-wpil-monitor-id=\"2457\">\u0441\u0435\u0440\u0432\u0435\u0440\u0435<\/a> Informatica. T\u00eb dh\u00ebnat do t\u00eb lexohen nga serveri Oracle, do t\u00eb transferohen n\u00eb serverin Informatica, do t\u00eb transformohen atje dhe do t\u00eb d\u00ebrgohen n\u00eb Hadoop. N\u00eb fjal\u00eb t\u00eb tjera, do t\u00eb marrim nj\u00eb proces t\u00eb zakonsh\u00ebm ETL.<\/p>\n<p><\/p>\n<p><strong>Tipi pushdown \u2013 source <\/strong><\/p>\n<p><\/p>\n<p>Kur zgjidhim tipin source, ne fitojm\u00eb mund\u00ebsin\u00eb p\u00ebr t\u00eb shp\u00ebrndar\u00eb procesin ton\u00eb midis <a class=\"wpil_keyword_link\" href=\"https:\/\/prohoster.info\/sq\/server\/dts-prohoster\/\"   title=\"\u0441\u0435\u0440\u0432\u0435\u0440\u043e\u043c\" data-wpil-keyword-link=\"linked\"  data-wpil-monitor-id=\"2959\">\u0441\u0435\u0440\u0432\u0435\u0440\u043e\u043c<\/a> bazave t\u00eb t\u00eb dh\u00ebnave (DB) dhe Hadoop. N\u00eb ekzekutimin e procesit me k\u00ebt\u00eb cil\u00ebsim, k\u00ebrkesat p\u00ebr marrjen e t\u00eb dh\u00ebnave nga tabelat do t\u00eb fluturojn\u00eb n\u00eb baz\u00eb. Nd\u00ebrsa e gjith\u00eb pjesa tjet\u00ebr do t\u00eb ekzekutohet n\u00eb forma hap pas hapi n\u00eb Hadoop.<br \/>\nSkema e ekzekutimit do t\u00eb duket k\u00ebshtu:<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Si q\u00eb t\u00eb transferoni, eksportoni dhe integroni t\u00eb dh\u00ebna shum\u00eb t\u00eb m\u00ebdha n\u00eb m\u00ebnyr\u00eb t\u00eb lir\u00eb dhe t\u00eb shpejt\u00eb? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown?\" src=\"\/wp-content\/uploads\/2019\/03\/8b3b071ea0580394b222da033effceee.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>M\u00eb posht\u00eb \u2013 nj\u00eb shembull i konfigurimit t\u00eb mjedisit t\u00eb ekzekutimit.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Si q\u00eb t\u00eb transferoni, eksportoni dhe integroni t\u00eb dh\u00ebna shum\u00eb t\u00eb m\u00ebdha n\u00eb m\u00ebnyr\u00eb t\u00eb lir\u00eb dhe t\u00eb shpejt\u00eb? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown?\" src=\"\/wp-content\/uploads\/2019\/03\/da7434ae71f4b2265f61fd31e182897e.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>N\u00eb k\u00ebt\u00eb rast, hartimi do t\u00eb ekzekutohet n\u00eb dy hapa. N\u00eb cil\u00ebsimet e tij do t\u00eb shohim q\u00eb ai e ka shnd\u00ebrruar n\u00eb nj\u00eb skenar, i cili do t\u00eb d\u00ebrgohet n\u00eb burim. Dhe bashkimi i tabelave dhe transformimi i t\u00eb dh\u00ebnave do t\u00eb kryhet n\u00eb form\u00ebn e nj\u00eb k\u00ebrkese t\u00eb rip\u00ebrcaktuar n\u00eb burim.<br \/>\nN\u00eb imazhin m\u00eb posht\u00eb, ne shohim hartimin e optimizuar n\u00eb BDM, nd\u00ebrsa n\u00eb burim \u2013 k\u00ebrkes\u00ebn e rip\u00ebrcaktuar.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Si q\u00eb t\u00eb transferoni, eksportoni dhe integroni t\u00eb dh\u00ebna shum\u00eb t\u00eb m\u00ebdha n\u00eb m\u00ebnyr\u00eb t\u00eb lir\u00eb dhe t\u00eb shpejt\u00eb? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown?\" src=\"\/wp-content\/uploads\/2019\/03\/c0e7534b06d2e09785ad8a6c5df15f6f.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Roli i Hadoop n\u00eb k\u00ebt\u00eb konfigurim do t\u00eb reduktohet n\u00eb menaxhimin e fluxit t\u00eb t\u00eb dh\u00ebnave \u2013 dirigjimin e tyre. Rezultati i k\u00ebrkes\u00ebs do t\u00eb d\u00ebrgohet n\u00eb Hadoop. Pas p\u00ebrfundimit t\u00eb leximit, skedari nga Hadoop do t\u00eb regjistrohet n\u00eb marr\u00ebs.<\/p>\n<p><\/p>\n<p><strong>Tipi pushdown \u2013 full <\/strong><\/p>\n<p><\/p>\n<p>Kur zgjidhet tipi full, hartimi shnd\u00ebrrohet plot\u00ebsisht n\u00eb nj\u00eb k\u00ebrkes\u00eb n\u00eb DB. Dhe rezultati i k\u00ebrkes\u00ebs do t'i d\u00ebrgohet Hadoop. Skema e k\u00ebtij procesi \u00ebsht\u00eb e paraqitur m\u00eb posht\u00eb.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Si q\u00eb t\u00eb transferoni, eksportoni dhe integroni t\u00eb dh\u00ebna shum\u00eb t\u00eb m\u00ebdha n\u00eb m\u00ebnyr\u00eb t\u00eb lir\u00eb dhe t\u00eb shpejt\u00eb? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown?\" src=\"\/wp-content\/uploads\/2019\/03\/bfbb3f593a7053a0157d481d9b3bce83.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Shembulli i konfigurimit paraqitet m\u00eb posht\u00eb.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Si q\u00eb t\u00eb transferoni, eksportoni dhe integroni t\u00eb dh\u00ebna shum\u00eb t\u00eb m\u00ebdha n\u00eb m\u00ebnyr\u00eb t\u00eb lir\u00eb dhe t\u00eb shpejt\u00eb? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown?\" src=\"\/wp-content\/uploads\/2019\/03\/31c70c7fb10996d5a506c6a4618f5f2f.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Si rezultat, ne do t\u00eb kemi nj\u00eb hartim t\u00eb optimizuar t\u00eb ngjash\u00ebm me t\u00eb m\u00ebparshmin. Diferenca \u00ebsht\u00eb se e gjith\u00eb logjika do t\u00eb transferohet n\u00eb marr\u00ebs n\u00eb form\u00ebn e rip\u00ebrcaktimit t\u00eb futjes s\u00eb tij. Shembulli i hartimit t\u00eb optimizuar paraqitet m\u00eb posht\u00eb.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Si q\u00eb t\u00eb transferoni, eksportoni dhe integroni t\u00eb dh\u00ebna shum\u00eb t\u00eb m\u00ebdha n\u00eb m\u00ebnyr\u00eb t\u00eb lir\u00eb dhe t\u00eb shpejt\u00eb? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown?\" src=\"\/wp-content\/uploads\/2019\/03\/edabf7ab6eba768849d096a4319e5126.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>K\u00ebtu, si n\u00eb rastin e m\u00ebparsh\u00ebm, Hadoop luan rolin e dirigjentit. Por k\u00ebtu leximi i burimit b\u00ebhet t\u00ebr\u00ebsisht, dhe m\u00eb pas n\u00eb nivelin e marr\u00ebsit zbatohet logjika e p\u00ebrpunimit t\u00eb t\u00eb dh\u00ebnave.<\/p>\n<p><\/p>\n<p><strong>Lloji pushdown \u2013 null<\/strong><\/p>\n<p><\/p>\n<p>Dhe varianti i fundit \u2013 lloji pushdown, n\u00eb t\u00eb cilin mapimi yn\u00eb do t\u00eb shnd\u00ebrrohet n\u00eb nj\u00eb skenar n\u00eb Hadoop.<\/p>\n<p><\/p>\n<p>Mapimi i optimizuar tani do t\u00eb duket k\u00ebshtu:<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Si q\u00eb t\u00eb transferoni, eksportoni dhe integroni t\u00eb dh\u00ebna shum\u00eb t\u00eb m\u00ebdha n\u00eb m\u00ebnyr\u00eb t\u00eb lir\u00eb dhe t\u00eb shpejt\u00eb? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown?\" src=\"\/wp-content\/uploads\/2019\/03\/deb8311403d4e95c2fef06d3b5c94e64.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>K\u00ebtu t\u00eb dh\u00ebnat nga skedar\u00ebt-burim fillimisht do t\u00eb lexohen n\u00eb Hadoop. Pastaj me mjetet e tij k\u00ebta dy skedar\u00eb do t\u00eb bashkohen. Pas k\u00ebsaj, t\u00eb dh\u00ebnat do t\u00eb transformohen dhe do t\u00eb eksportohen n\u00eb DB.<\/p>\n<p><\/p>\n<p>Duke kuptuar parimet e optimizimit pushdown, mund t\u00eb organizoni shum\u00eb procese t\u00eb pun\u00ebs me t\u00eb dh\u00ebna t\u00eb m\u00ebdha shum\u00eb efikas. K\u00ebshtu, s\u00eb fundmi nj\u00eb kompani e madhe arriti t\u00eb eksportoj\u00eb nga depoja n\u00eb Hadoop t\u00eb dh\u00ebna t\u00eb m\u00ebdha, t\u00eb cilat deri at\u00ebher\u00eb i kishte mbledhur p\u00ebr disa vite.<\/p>\n<p>Burimi: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/445240\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u041b\u044e\u0431\u0430\u044f \u043e\u043f\u0435\u0440\u0430\u0446\u0438\u044f \u0441 \u0431\u043e\u043b\u044c\u0448\u0438\u043c\u0438 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0442\u0440\u0435\u0431\u0443\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u0445 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u0435\u0439. \u041e\u0431\u044b\u0447\u043d\u043e\u0435 \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0435\u043d\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0431\u0430\u0437\u044b \u043d\u0430 Hadoop \u043c\u043e\u0436\u0435\u0442 \u0434\u043b\u0438\u0442\u044c\u0441\u044f \u043d\u0435\u0434\u0435\u043b\u044f\u043c\u0438 \u0438\u043b\u0438 \u0441\u0442\u043e\u0438\u0442\u044c, \u043a\u0430\u043a \u043a\u0440\u044b\u043b\u043e \u0441\u0430\u043c\u043e\u043b\u0451\u0442\u0430. \u041d\u0435 \u0445\u043e\u0442\u0438\u0442\u0435 \u0436\u0434\u0430\u0442\u044c \u0438 \u0442\u0440\u0430\u0442\u0438\u0442\u044c\u0441\u044f? \u0421\u0431\u0430\u043b\u0430\u043d\u0441\u0438\u0440\u0443\u0439\u0442\u0435 \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0443 \u043d\u0430 \u0440\u0430\u0437\u043d\u044b\u0435 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b. \u041e\u0434\u0438\u043d \u0438\u0437 \u0441\u043f\u043e\u0441\u043e\u0431\u043e\u0432 \u2013 pushdown-\u043e\u043f\u0442\u0438\u043c\u0438\u0437\u0430\u0446\u0438\u044f. \u042f \u043f\u043e\u043f\u0440\u043e\u0441\u0438\u043b \u0432\u0435\u0434\u0443\u0449\u0435\u0433\u043e \u0432 \u0420\u043e\u0441\u0441\u0438\u0438 \u0442\u0440\u0435\u043d\u0435\u0440\u0430 \u043f\u043e \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0435 \u0438 \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044e \u043f\u0440\u043e\u0434\u0443\u043a\u0442\u043e\u0432 Informatica \u0410\u043b\u0435\u043a\u0441\u0435\u044f \u0410\u043d\u0430\u043d\u044c\u0435\u0432\u0430 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u0430\u0442\u044c \u043e [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[10],"tags":[],"class_list":["post-30268","post","type-post","status-publish","format-standard","hentry","category-blog"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.1.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u041b\u044e\u0431\u0430\u044f \u043e\u043f\u0435\u0440\u0430\u0446\u0438\u044f \u0441 \u0431\u043e\u043b\u044c\u0448\u0438\u043c\u0438 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0442\u0440\u0435\u0431\u0443\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u0445 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u0435\u0439. \u041e\u0431\u044b\u0447\u043d\u043e\u0435 \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0435\u043d\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0431\u0430\u0437\u044b \u043d\u0430 Hadoop \u043c\u043e\u0436\u0435\u0442 \u0434\u043b\u0438\u0442\u044c\u0441\u044f \u043d\u0435\u0434\u0435\u043b\u044f\u043c\u0438 \u0438\u043b\u0438 \u0441\u0442\u043e\u0438\u0442\u044c, \u043a\u0430\u043a \u043a\u0440\u044b\u043b\u043e \u0441\u0430\u043c\u043e\u043b\u0451\u0442\u0430.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/sq\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.1.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"sq_AL\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u041a\u0430\u043a \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0430\u0442\u044c, \u0432\u044b\u0433\u0440\u0443\u0436\u0430\u0442\u044c \u0438 \u0438\u043d\u0442\u0435\u0433\u0440\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u043e\u0447\u0435\u043d\u044c \u0431\u043e\u043b\u044c\u0448\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0435 \u0434\u0451\u0448\u0435\u0432\u043e \u0438 \u0431\u044b\u0441\u0442\u0440\u043e? \u0427\u0442\u043e \u0442\u0430\u043a\u043e\u0435 pushdown-\u043e\u043f\u0442\u0438\u043c\u0438\u0437\u0430\u0446\u0438\u044f? | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u041b\u044e\u0431\u0430\u044f \u043e\u043f\u0435\u0440\u0430\u0446\u0438\u044f \u0441 \u0431\u043e\u043b\u044c\u0448\u0438\u043c\u0438 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0442\u0440\u0435\u0431\u0443\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u0445 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u0435\u0439. \u041e\u0431\u044b\u0447\u043d\u043e\u0435 \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0435\u043d\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0431\u0430\u0437\u044b \u043d\u0430 Hadoop \u043c\u043e\u0436\u0435\u0442 \u0434\u043b\u0438\u0442\u044c\u0441\u044f \u043d\u0435\u0434\u0435\u043b\u044f\u043c\u0438 \u0438\u043b\u0438 \u0441\u0442\u043e\u0438\u0442\u044c, \u043a\u0430\u043a \u043a\u0440\u044b\u043b\u043e \u0441\u0430\u043c\u043e\u043b\u0451\u0442\u0430.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/sq\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2019-10-31T18:34:35+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2019-10-31T18:34:35+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Si t\u00eb transferoni, eksportoni dhe integroheni t\u00eb dh\u00ebnat shum\u00eb t\u00eb m\u00ebdha me kosto t\u00eb ul\u00ebt dhe shpejt? \u00c7far\u00eb \u00ebsht\u00eb optimizimi pushdown? | ProHoster","description":"\u00c7do operacion me t\u00eb dh\u00ebna t\u00eb m\u00ebdha k\u00ebrkon kapacitete t\u00eb m\u00ebdha llogarit\u00ebse. Shkarkimi normal i t\u00eb dh\u00ebnave nga baza n\u00eb Hadoop mund t\u00eb zgjas\u00eb jav\u00eb ose t\u00eb costohet si krah avioni.","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041a\u0430\u043a \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0430\u0442\u044c, \u0432\u044b\u0433\u0440\u0443\u0436\u0430\u0442\u044c \u0438 \u0438\u043d\u0442\u0435\u0433\u0440\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u043e\u0447\u0435\u043d\u044c \u0431\u043e\u043b\u044c\u0448\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0435 \u0434\u0451\u0448\u0435\u0432\u043e \u0438 \u0431\u044b\u0441\u0442\u0440\u043e? \u0427\u0442\u043e \u0442\u0430\u043a\u043e\u0435 pushdown-\u043e\u043f\u0442\u0438\u043c\u0438\u0437\u0430\u0446\u0438\u044f? | ProHoster","og:description":"\u041b\u044e\u0431\u0430\u044f \u043e\u043f\u0435\u0440\u0430\u0446\u0438\u044f \u0441 \u0431\u043e\u043b\u044c\u0448\u0438\u043c\u0438 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0442\u0440\u0435\u0431\u0443\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u0445 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u0435\u0439. \u041e\u0431\u044b\u0447\u043d\u043e\u0435 \u043f\u0435\u0440\u0435\u043c\u0435\u0449\u0435\u043d\u0438\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0431\u0430\u0437\u044b \u043d\u0430 Hadoop \u043c\u043e\u0436\u0435\u0442 \u0434\u043b\u0438\u0442\u044c\u0441\u044f \u043d\u0435\u0434\u0435\u043b\u044f\u043c\u0438 \u0438\u043b\u0438 \u0441\u0442\u043e\u0438\u0442\u044c, \u043a\u0430\u043a \u043a\u0440\u044b\u043b\u043e \u0441\u0430\u043c\u043e\u043b\u0451\u0442\u0430.","og:url":"https:\/\/prohoster.info\/sq\/blog\/kak-peremeshhat-vygruzhat-i-integrirovat-ochen-bolshie-dannye-dyoshevo-i-bystro-chto-takoe-pushdown-optimizatsiya","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T18:34:35+00:00","article:modified_time":"2019-10-31T18:34:35+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"30268","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"Article","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-02-09 21:49:15","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 03:38:39","updated":"2026-02-09 21:49:15","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/30268","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=30268"}],"version-history":[{"count":2,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/30268\/revisions"}],"predecessor-version":[{"id":160240,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/30268\/revisions\/160240"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=30268"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=30268"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=30268"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}