{"id":90548,"date":"2020-08-02T13:42:53","date_gmt":"2020-08-02T11:42:53","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3"},"modified":"2020-08-02T13:42:53","modified_gmt":"2020-08-02T11:42:53","slug":"reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","title":{"rendered":"\u00c7lirimi i platform\u00ebs p\u00ebr p\u00ebrpunimin e t\u00eb dh\u00ebnave t\u00eb shp\u00ebrndara Apache Hadoop 3.3","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Pas nj\u00eb vit e gjysm\u00eb zhvillimi, organizata Apache Software Foundation <noindex><a rel=\"nofollow\" href=\"https:\/\/blogs.apache.org\/hadoop\/entry\/announce-apache-hadoop-3-3\">publikoi<\/a><\/noindex> l\u00ebshimi <noindex><a rel=\"nofollow\" href=\"http:\/\/hadoop.apache.org\">Apache Hadoop 3.3.0<\/a><\/noindex>, nj\u00eb platform\u00eb e lir\u00eb p\u00ebr organizimin e p\u00ebrpunimit t\u00eb shp\u00ebrndar\u00eb t\u00eb sasis\u00eb t\u00eb m\u00ebdha t\u00eb t\u00eb dh\u00ebnave duke p\u00ebrdorur paradigmat <noindex><a rel=\"nofollow\" href=\"http:\/\/ru.wikipedia.org\/wiki\/MapReduce\">map\/reduce<\/a><\/noindex>, ku detyra ndahet n\u00eb shum\u00eb fragmente m\u00eb t\u00eb vogla, secili prej t\u00eb cilave mund t\u00eb ekzekutohet n\u00eb nj\u00eb nyje t\u00eb ve\u00e7ant\u00eb t\u00eb klasterit. Ruajtja bazuar n\u00eb Hadoop mund t\u00eb p\u00ebrfshij\u00eb mij\u00ebra nyje dhe t\u00eb p\u00ebrmbaj\u00eb eksabajt t\u00eb dh\u00ebnash.<\/p>\n<p>Hadoop p\u00ebrfshin realizimin e sistemit t\u00eb skedar\u00ebve t\u00eb shp\u00ebrndar\u00eb Hadoop Distributed Filesystem (HDFS), i cili automatikisht sigurimin e rezervimit t\u00eb t\u00eb dh\u00ebnave dhe i optimizuar p\u00ebr aplikacionet MapReduce. P\u00ebr t\u00eb thjeshtuar qasjen n\u00eb t\u00eb dh\u00ebna, \u00ebsht\u00eb zhvilluar nj\u00eb Baza e T\u00eb Dh\u00ebnave HBase dhe nj\u00eb gjuh\u00eb e ngjashme me SQL, Pig, e cila \u00ebsht\u00eb nj\u00eb lloj SQL p\u00ebr MapReduce, ku k\u00ebrkesat mund t\u00eb ndahen dhe t\u00eb p\u00ebrpunohen nga disa platforma Hadoop. Projekti vler\u00ebsohet si t\u00ebr\u00ebsisht i q\u00ebndruesh\u00ebm dhe i gatsh\u00ebm p\u00ebr eksploatim industrial. Hadoop p\u00ebrdoret gjer\u00ebsisht n\u00eb projekte t\u00eb m\u00ebdha industriale, duke ofruar mund\u00ebsi t\u00eb ngjashme me platform\u00ebn e Google Bigtable\/GFS\/MapReduce, dhe kompania Google zyrtarisht <noindex><a rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=26398\">ka deleguar<\/a><\/noindex> Hadoop dhe projekteve t\u00eb tjera Apache t\u00eb drejt\u00ebn p\u00ebr t\u00eb p\u00ebrdorur teknologjit\u00eb, t\u00eb cilat mbulohen nga patentat q\u00eb lidhen me metod\u00ebn MapReduce. <\/p>\n<p>Hadoop mban vendin e par\u00eb midis depot t\u00eb Apache p\u00ebr numrin e ndryshimeve t\u00eb b\u00ebra dhe vendin e pest\u00eb p\u00ebr madh\u00ebsin\u00eb e baz\u00ebs s\u00eb kodit (rreth 4 milion rreshta kodi). Nd\u00ebr implementimet e m\u00ebdha t\u00eb Hadoop, p\u00ebrmenden ruajtjet e Netflix (ruhen m\u00eb shum\u00eb se 500 miliard ngjarje n\u00eb dit\u00eb), Twitter (nj\u00eb klaster prej 10 mij\u00eb nyjesh n\u00eb real-time ruan m\u00eb shum\u00eb se nj\u00eb zetabajt t\u00eb dh\u00ebnash dhe p\u00ebrpunon m\u00eb shum\u00eb se 5 miliard seanca n\u00eb dit\u00eb), Facebook (nj\u00eb klaster prej 4 mij\u00eb nyjesh ruan m\u00eb shum\u00eb se 300 petabajt dhe rritet \u00e7do dit\u00eb me 4 PB).<\/p>\n<p>Main <noindex><a rel=\"nofollow\" href=\"https:\/\/hadoop.apache.org\/docs\/r3.3.0\/hadoop-project-dist\/hadoop-common\/release\/3.3.0\/CHANGELOG.3.3.0.html\">ndryshime<\/a><\/noindex> n\u00eb Apache Hadoop 3.3:<\/p>\n<ul>\n<li class=\"l\"> Shtuar mb\u00ebshtetje p\u00ebr platformat t\u00eb bazuara n\u00eb arkitektur\u00ebn ARM.\n<li class=\"l\"> Realizimi i formatit <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/protocolbuffers\/protobuf\">Protobuf<\/a><\/noindex> (Protocol buffers), i p\u00ebrdorur p\u00ebr serializimin e t\u00eb dh\u00ebnave t\u00eb strukturuara, \u00ebsht\u00eb p\u00ebrdit\u00ebsuar deri n\u00eb l\u00ebshimin 3.7.1 p\u00ebr shkak t\u00eb p\u00ebrfundimit t\u00eb ciklit t\u00eb jet\u00ebs s\u00eb deg\u00ebs protobuf-2.5.0.\n<li class=\"l\"> Zgjeruar mund\u00ebsit\u00eb e lidh\u00ebsit S3A: shtuar mb\u00ebshtetje p\u00ebr autentikimin me an\u00eb t\u00eb token\u00ebve (<noindex><a rel=\"nofollow\" href=\"https:\/\/blog.cloudera.com\/hadoop-delegation-tokens-explained\/\">Delegation Token<\/a><\/noindex>), p\u00ebrmir\u00ebsuar mb\u00ebshtetje p\u00ebr keqadhen e p\u00ebrgjigjeve me kod 404, rritur performanc\u00ebn e S3guard, rritur besueshm\u00ebrin\u00eb e pun\u00ebs.\n<li class=\"l\"> N\u00eb sistemin e skedar\u00ebve ABFS jan\u00eb zgjidhur problemet me tunimin automatik.\n<li class=\"l\"> \u00cbsht\u00eb shtuar mb\u00ebshtetje e p\u00ebrfshir\u00eb p\u00ebr sistemin e skedar\u00ebve Tencent Cloud COS p\u00ebr akses n\u00eb magazin\u00ebn objektive COS.\n<li class=\"l\"> \u00cbsht\u00eb shtyer mb\u00ebshtetje e plot\u00eb p\u00ebr Java 11.\n<li class=\"l\"> \u00cbsht\u00eb stabilizuar implementimi HDFS RBF (Federata e Bazuar n\u00eb Router). N\u00eb Router-in HDFS jan\u00eb shtuar mjete p\u00ebr menaxhimin e siguris\u00eb.\n<li class=\"l\"> \u00cbsht\u00eb shtuar sh\u00ebrbimi DNS Resolution p\u00ebr t\u00eb identifikuar server\u00ebt e klientit p\u00ebrmes DNS n\u00ebp\u00ebrmjet emrave t\u00eb hosteve, duke lejuar q\u00eb t\u00eb shmanget renditja e t\u00eb gjith\u00eb hosteve n\u00eb cil\u00ebsimet.\n<li class=\"l\"> \u00cbsht\u00eb shtuar mb\u00ebshtetje p\u00ebr planifikimin e startimit <noindex><a rel=\"nofollow\" href=\"https:\/\/issues.apache.org\/jira\/browse\/YARN-5220\">t\u00eb kontejner\u00ebve oportunist\u00eb<\/a><\/noindex> n\u00ebp\u00ebrmjet menaxherit t\u00eb centralizuar t\u00eb burimeve (ResourceManager), duke p\u00ebrfshir\u00eb mund\u00ebsin\u00eb e shp\u00ebrndarjes s\u00eb kontejner\u00ebve me nj\u00eb llogari t\u00eb ngarkes\u00ebs s\u00eb \u00e7do nodi.\n<li class=\"l\"> \u00cbsht\u00eb shtuar katalogu i aplikacioneve YARN (Yet Another Resource Negotiator) me mund\u00ebsin\u00eb e k\u00ebrkimit.\n<\/ul>\n<p><noindex><a rel=\"nofollow\" name=\"link\"><\/a><\/noindex><\/p>\n<p>Burimi: <a \ncontent=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=53476\">opennet.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437 Apache Hadoop 3.3.0, \u0441\u0432\u043e\u0431\u043e\u0434\u043d\u043e\u0439 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u043e\u0431\u044a\u0451\u043c\u043e\u0432 \u0434\u0430\u043d\u043d\u044b\u0445 \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u043f\u0430\u0440\u0430\u0434\u0438\u0433\u043c\u044b map\/reduce, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u0439 \u0437\u0430\u0434\u0430\u0447\u0430 \u0434\u0435\u043b\u0438\u0442\u0441\u044f \u043d\u0430 \u043c\u043d\u043e\u0436\u0435\u0441\u0442\u0432\u043e \u0431\u043e\u043b\u0435\u0435 \u043c\u0435\u043b\u043a\u0438\u0445 \u043e\u0431\u043e\u0441\u043e\u0431\u043b\u0435\u043d\u043d\u044b\u0445 \u0444\u0440\u0430\u0433\u043c\u0435\u043d\u0442\u043e\u0432, \u043a\u0430\u0436\u0434\u044b\u0439 \u0438\u0437 \u043a\u043e\u0442\u043e\u0440\u044b\u0445 \u043c\u043e\u0436\u0435\u0442 \u0431\u044b\u0442\u044c \u0437\u0430\u043f\u0443\u0449\u0435\u043d \u043d\u0430 \u043e\u0442\u0434\u0435\u043b\u044c\u043d\u043e\u043c \u0443\u0437\u043b\u0435 \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430. \u0425\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u043d\u0430 \u0431\u0430\u0437\u0435 Hadoop \u043c\u043e\u0436\u0435\u0442 \u043e\u0445\u0432\u0430\u0442\u044b\u0432\u0430\u0442\u044c \u0442\u044b\u0441\u044f\u0447\u0438 \u0443\u0437\u043b\u043e\u0432 \u0438 [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-90548","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.1.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/sq\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.1.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"sq_AL\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0420\u0435\u043b\u0438\u0437 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 Apache Hadoop 3.3 | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/sq\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-08-02T11:42:53+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-08-02T11:42:53+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47L\u00ebshimi i platform\u00ebs p\u00ebr p\u00ebrpunimin e shp\u00ebrndar\u00eb t\u00eb t\u00eb dh\u00ebnave Apache Hadoop 3.3 | ProHoster","description":"Pas pasat nj\u00eb vit e gjysm\u00eb zhvillimi, Organizata Apache Software Foundation publikoi versionin e ri.","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0420\u0435\u043b\u0438\u0437 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 Apache Hadoop 3.3 | ProHoster","og:description":"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437","og:url":"https:\/\/prohoster.info\/sq\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-08-02T11:42:53+00:00","article:modified_time":"2020-08-02T11:42:53+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"90548","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 12:48:35","updated":"2022-09-28 08:12:14","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/90548","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=90548"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/90548\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=90548"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=90548"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=90548"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}