{"id":90548,"date":"2020-08-02T13:42:53","date_gmt":"2020-08-02T11:42:53","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3"},"modified":"2020-08-02T13:42:53","modified_gmt":"2020-08-02T11:42:53","slug":"reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","title":{"rendered":"L\u00ebshimi i platform\u00ebs p\u00ebr p\u00ebrpunimin e t\u00eb dh\u00ebnave t\u00eb shp\u00ebrndara Apache Hadoop 3.3","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Pas nj\u00eb vit e gjysm\u00eb zhvillimi, organizata Apache Software Foundation <noindex><a rel=\"nofollow\" href=\"https:\/\/blogs.apache.org\/hadoop\/entry\/announce-apache-hadoop-3-3\">publikoi<\/a><\/noindex> l\u00ebshimi <noindex><a rel=\"nofollow\" href=\"http:\/\/hadoop.apache.org\">Apache Hadoop 3.3.0<\/a><\/noindex>, nj\u00eb platform\u00eb e lir\u00eb p\u00ebr organizimin e p\u00ebrpunimit t\u00eb shp\u00ebrndar\u00eb t\u00eb sasis\u00eb s\u00eb madhe t\u00eb t\u00eb dh\u00ebnave duke p\u00ebrdorur paradigmat <noindex><a rel=\"nofollow\" href=\"http:\/\/ru.wikipedia.org\/wiki\/MapReduce\">map\/reduce<\/a><\/noindex>, ku detyra ndahet n\u00eb shum\u00eb fragmente m\u00eb t\u00eb vogla t\u00eb izoluara, secila prej t\u00eb cilave mund t\u00eb ekzekutohet n\u00eb nj\u00eb nyje t\u00eb ve\u00e7ant\u00eb t\u00eb klastri. Shtylla e bazuar n\u00eb Hadoop mund t\u00eb p\u00ebrfshij\u00eb mij\u00ebra nyje dhe t\u00eb p\u00ebrmbaj\u00eb eksabajt t\u00eb dh\u00ebnash.<\/p>\n<p>N\u00eb p\u00ebrb\u00ebrje t\u00eb Hadoop \u00ebsht\u00eb implementimi i sistemit t\u00eb skedar\u00ebve t\u00eb shp\u00ebrndar\u00eb Hadoop Distributed Filesystem (HDFS), i cili automatikisht siguron rezervimin e t\u00eb dh\u00ebnave dhe \u00ebsht\u00eb optimizuar p\u00ebr aplikacionet e MapReduce. P\u00ebr t\u00eb thjeshtuar qasjen n\u00eb t\u00eb dh\u00ebna n\u00eb depo t\u00eb Hadoop, \u00ebsht\u00eb krijuar DB HBase dhe nj\u00eb gjuh\u00eb sipas SQL, t\u00eb cil\u00ebn e quajm\u00eb Pig, e cila \u00ebsht\u00eb nj\u00eb lloj SQL p\u00ebr MapReduce, ku k\u00ebrkesat mund t\u00eb paralelizohen dhe t\u00eb p\u00ebrpunohen nga disa platforma Hadoop. Projekti vler\u00ebsohet si plot\u00ebsisht i stabilizuar dhe i gatsh\u00ebm p\u00ebr p\u00ebrdorim industris\u00eb. Hadoop p\u00ebrdoret aktivisht n\u00eb projekte t\u00eb m\u00ebdha industriale, duke ofruar mund\u00ebsi t\u00eb ngjashme me platform\u00ebn Google Bigtable\/GFS\/MapReduce, nd\u00ebrsa kompania Google zyrtarisht <noindex><a rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=26398\">delegalizoi<\/a><\/noindex> Hadoop dhe projekte t\u00eb tjera Apache t\u00eb drejt\u00ebn p\u00ebr t\u00eb p\u00ebrdorur teknologjit\u00eb, p\u00ebr t\u00eb cilat zbatohen patentet, t\u00eb lidhura me metod\u00ebn MapReduce. <\/p>\n<p>Hadoop renditet i pari n\u00eb mesin e depot Apache p\u00ebr numrin e ndryshimeve t\u00eb paraqitura dhe i pesti p\u00ebr madh\u00ebsin\u00eb e baz\u00ebs s\u00eb kodit (rreth 4 milion\u00eb rreshta kodi). Disa nga p\u00ebrdorimet e m\u00ebdha t\u00eb Hadoop p\u00ebrfshijn\u00eb depozitimet e Netflix (n\u00eb t\u00eb cilat ruhet m\u00eb shum\u00eb se 500 miliard\u00eb ngjarje n\u00eb dit\u00eb), Twitter (nj\u00eb klas\u00ebr prej 10 mij\u00eb nyjesh n\u00eb koh\u00eb reale ruan m\u00eb shum\u00eb se nj\u00eb zetabajt t\u00eb dh\u00ebnash dhe p\u00ebrpunon m\u00eb shum\u00eb se 5 miliard\u00eb seanca n\u00eb dit\u00eb), Facebook (nj\u00eb klas\u00ebr prej 4 mij\u00eb nyjesh ruan m\u00eb shum\u00eb se 300 petabajt dhe rritet \u00e7do dit\u00eb me 4 PB).<\/p>\n<p>Ndryshimet kryesore <noindex><a rel=\"nofollow\" href=\"https:\/\/hadoop.apache.org\/docs\/r3.3.0\/hadoop-project-dist\/hadoop-common\/release\/3.3.0\/CHANGELOG.3.3.0.html\">n\u00eb<\/a><\/noindex> n\u00eb Apache Hadoop 3.3:<\/p>\n<ul>\n<li class=\"l\"> U shtua mb\u00ebshtetje p\u00ebr platformat mbi baz\u00ebn e arkitektur\u00ebs ARM.\n<li class=\"l\"> Implementimi i formatit <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/protocolbuffers\/protobuf\">Protobuf<\/a><\/noindex> (Protocol buffers), e p\u00ebrdorur p\u00ebr serializimin e t\u00eb dh\u00ebnave t\u00eb strukturuara, u p\u00ebrdit\u00ebsua n\u00eb l\u00ebshimin 3.7.1 p\u00ebr shkak t\u00eb mbarimit t\u00eb ciklit t\u00eb jet\u00ebs s\u00eb deg\u00ebs protobuf-2.5.0.\n<li class=\"l\"> Jan\u00eb zgjeruar mund\u00ebsit\u00eb e lidh\u00ebsit S3A: u shtua mb\u00ebshtetje p\u00ebr autentifikimin me an\u00eb t\u00eb token\u00ebve (<noindex><a rel=\"nofollow\" href=\"https:\/\/blog.cloudera.com\/hadoop-delegation-tokens-explained\/\">Delegation Token<\/a><\/noindex>), p\u00ebrmir\u00ebsuar mb\u00ebshtetje p\u00ebr caching t\u00eb p\u00ebrgjigjeve me kod 404, rritur performanc\u00ebn e S3guard dhe p\u00ebrmir\u00ebsuar besueshm\u00ebrin\u00eb e funksionimit.\n<li class=\"l\"> N\u00eb sistemin e skedar\u00ebve ABFS, jan\u00eb zgjidhur problemet me tuningun automatik.\n<li class=\"l\"> U shtua mb\u00ebshtetje e integruar p\u00ebr sistemin e skedar\u00ebve Tencent Cloud COS p\u00ebr qasjen n\u00eb depozitat objektive COS.\n<li class=\"l\"> U shtua mb\u00ebshtetje e plot\u00eb p\u00ebr Java 11.\n<li class=\"l\"> U stabilizua implementimi i HDFS RBF (Router-based Federation). N\u00eb Router-in e HDFS u shtuan mjete p\u00ebr menaxhimin e siguris\u00eb.\n<li class=\"l\"> U shtua sh\u00ebrbimi i DNS Resolution p\u00ebr identifikimin nga klienti t\u00eb server\u00ebve p\u00ebrmes DNS n\u00ebp\u00ebrmjet emrave t\u00eb nyjeve, duke lejuar shmangien e listimit t\u00eb t\u00eb gjitha hosteve n\u00eb konfigurime.\n<li class=\"l\"> U shtua mb\u00ebshtetje p\u00ebr planifikimin e lan\u00e7imit <noindex><a rel=\"nofollow\" href=\"https:\/\/issues.apache.org\/jira\/browse\/YARN-5220\">t\u00eb kontejner\u00ebve opportunist<\/a><\/noindex> n\u00ebp\u00ebrmjet menaxherit t\u00eb centralizuar t\u00eb burimeve (ResourceManager), duke p\u00ebrfshir\u00eb mund\u00ebsin\u00eb e shp\u00ebrndarjes s\u00eb kontejner\u00ebve duke marr\u00eb parasysh ngarkes\u00ebn e secil\u00ebs nyje.\n<li class=\"l\"> U shtua katalogu i aplikacioneve YARN (Yet Another Resource Negotiator) me mund\u00ebsi k\u00ebrkimi.\n<\/ul>\n<p><noindex><a rel=\"nofollow\" name=\"link\"><\/a><\/noindex><\/p>\n<p>Burimi: <a \ncontent=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=53476\">opennet.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437 Apache Hadoop 3.3.0, \u0441\u0432\u043e\u0431\u043e\u0434\u043d\u043e\u0439 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u043e\u0431\u044a\u0451\u043c\u043e\u0432 \u0434\u0430\u043d\u043d\u044b\u0445 \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u043f\u0430\u0440\u0430\u0434\u0438\u0433\u043c\u044b map\/reduce, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u0439 \u0437\u0430\u0434\u0430\u0447\u0430 \u0434\u0435\u043b\u0438\u0442\u0441\u044f \u043d\u0430 \u043c\u043d\u043e\u0436\u0435\u0441\u0442\u0432\u043e \u0431\u043e\u043b\u0435\u0435 \u043c\u0435\u043b\u043a\u0438\u0445 \u043e\u0431\u043e\u0441\u043e\u0431\u043b\u0435\u043d\u043d\u044b\u0445 \u0444\u0440\u0430\u0433\u043c\u0435\u043d\u0442\u043e\u0432, \u043a\u0430\u0436\u0434\u044b\u0439 \u0438\u0437 \u043a\u043e\u0442\u043e\u0440\u044b\u0445 \u043c\u043e\u0436\u0435\u0442 \u0431\u044b\u0442\u044c \u0437\u0430\u043f\u0443\u0449\u0435\u043d \u043d\u0430 \u043e\u0442\u0434\u0435\u043b\u044c\u043d\u043e\u043c \u0443\u0437\u043b\u0435 \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430. \u0425\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u043d\u0430 \u0431\u0430\u0437\u0435 Hadoop \u043c\u043e\u0436\u0435\u0442 \u043e\u0445\u0432\u0430\u0442\u044b\u0432\u0430\u0442\u044c \u0442\u044b\u0441\u044f\u0447\u0438 \u0443\u0437\u043b\u043e\u0432 \u0438 [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-90548","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.0.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/sq\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.0.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"sq_AL\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0420\u0435\u043b\u0438\u0437 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 Apache Hadoop 3.3 | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/sq\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-08-02T11:42:53+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-08-02T11:42:53+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47L\u00ebshimi i platform\u00ebs p\u00ebr p\u00ebrpunimin e t\u00eb dh\u00ebnave t\u00eb shp\u00ebrndara Apache Hadoop 3.3 | ProHoster","description":"Pas pas nj\u00eb viti e gjysm\u00eb zhvillimi, organizata Apache Software Foundation publikoi nj\u00eb version t\u00eb ri","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0420\u0435\u043b\u0438\u0437 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 Apache Hadoop 3.3 | ProHoster","og:description":"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437","og:url":"https:\/\/prohoster.info\/sq\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-08-02T11:42:53+00:00","article:modified_time":"2020-08-02T11:42:53+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"90548","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 12:48:35","updated":"2022-09-28 08:12:14","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/90548","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=90548"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/90548\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=90548"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=90548"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=90548"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}