{"id":90548,"date":"2020-08-02T13:42:53","date_gmt":"2020-08-02T11:42:53","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3"},"modified":"2020-08-02T13:42:53","modified_gmt":"2020-08-02T11:42:53","slug":"reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","status":"publish","type":"post","link":"https:\/\/prohoster.info\/ro\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","title":{"rendered":"Lansarea platformei pentru procesarea distribuit\u0103 a datelor Apache Hadoop 3.3","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Dup\u0103 un an \u0219i jum\u0103tate de dezvoltare, organiza\u021bia Apache Software Foundation <noindex><a rel=\"nofollow\" href=\"https:\/\/blogs.apache.org\/hadoop\/entry\/announce-apache-hadoop-3-3\">a publicat<\/a><\/noindex> lansare <noindex><a rel=\"nofollow\" href=\"http:\/\/hadoop.apache.org\">Apache Hadoop 3.3.0<\/a><\/noindex>, o platform\u0103 gratuit\u0103 pentru organizarea proces\u0103rii distribuite a unor volume mari de date folosind paradigma <noindex><a rel=\"nofollow\" href=\"http:\/\/ru.wikipedia.org\/wiki\/MapReduce\">map\/reduce<\/a><\/noindex>, \u00een care sarcina este \u00eemp\u0103r\u021bit\u0103 \u00een numeroase fragmente mai mici, fiecare dintre ele put\u00e2nd fi rulat pe un nod separat al clusterei. Stocarea bazat\u0103 pe Hadoop poate acoperi mii de noduri \u0219i con\u021bine exabi\u021bi de date.<\/p>\n<p>Hadoop include implementarea sistemului de fi\u0219iere distribuit Hadoop Distributed Filesystem (HDFS), care asigur\u0103 automat rezervarea datelor \u0219i este optimizat pentru aplica\u021biile MapReduce. Pentru a facilita accesul la datele din stocarea Hadoop, a fost dezvoltat\u0103 baza de date HBase \u0219i un limbaj similar SQL numit Pig, care este un fel de SQL pentru MapReduce, a c\u0103rui interog\u0103ri pot fi paralelizate \u0219i procesate de mai multe platforme Hadoop. Proiectul este evaluat ca fiind complet stabil \u0219i gata pentru utilizare industrial\u0103. Hadoop este utilizat activ \u00een proiecte industriale mari, oferind func\u021bionalit\u0103\u021bi echivalente cu cele ale platformei Google Bigtable\/GFS\/MapReduce, iar compania Google a delegat oficial <noindex><a rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=26398\">dreptul de utilizare<\/a><\/noindex> Hadoop \u0219i altor proiecte Apache pentru a utiliza tehnologii acoperite de brevete legate de metoda MapReduce. <\/p>\n<p>Hadoop ocup\u0103 prima pozi\u021bie \u00een r\u00e2ndul repository-urilor Apache dup\u0103 num\u0103rul de modific\u0103ri aduse \u0219i locul cinci dup\u0103 dimensiunea bazei de cod (aproximativ 4 milioane de linii de cod). Printre implement\u0103rile majore ale Hadoop se num\u0103r\u0103 stoc\u0103rile Netflix (care p\u0103streaz\u0103 peste 500 de miliarde de evenimente pe zi), Twitter (un cluster de 10.000 de noduri \u00een timp real, care stocheaz\u0103 peste un zettabyte de date \u0219i proceseaz\u0103 peste 5 miliarde de sesiuni pe zi), Facebook (un cluster de 4.000 de noduri stocheaz\u0103 peste 300 de petabytes \u0219i cre\u0219te zilnic cu 4 PB pe zi).<\/p>\n<p>Principalele <noindex><a rel=\"nofollow\" href=\"https:\/\/hadoop.apache.org\/docs\/r3.3.0\/hadoop-project-dist\/hadoop-common\/release\/3.3.0\/CHANGELOG.3.3.0.html\">modific\u0103ri<\/a><\/noindex> \u00een Apache Hadoop 3.3:<\/p>\n<ul>\n<li class=\"l\"> A fost ad\u0103ugat\u0103 suportul pentru platformele bazate pe arhitectura ARM.\n<li class=\"l\"> Implementarea formatului <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/protocolbuffers\/protobuf\">Protobuf<\/a><\/noindex> (Protocol buffers), utilizat pentru serializarea datelor structurate, a fost actualizat\u0103 la versiunea 3.7.1 \u00een urma \u00eencheierii ciclului de via\u021b\u0103 al ramurii protobuf-2.5.0.\n<li class=\"l\"> Func\u021bionalit\u0103\u021bile conectorului S3A au fost extinse: a fost ad\u0103ugat suport pentru autentificarea prin token-uri (<noindex><a rel=\"nofollow\" href=\"https:\/\/blog.cloudera.com\/hadoop-delegation-tokens-explained\/\">Delegation Token<\/a><\/noindex>), a fost \u00eembun\u0103t\u0103\u021bit suportul pentru cache-ul r\u0103spunsurilor cu codul 404, a fost crescut\u0103 performan\u021ba S3guard \u0219i a fost \u00eembun\u0103t\u0103\u021bit\u0103 fiabilitatea acestuia.\n<li class=\"l\"> \u00cen sistemul de fi\u0219iere ABFS au fost rezolvate problemele legate de tune-ul automat.\n<li class=\"l\"> A fost ad\u0103ugat suport \u00eencorporat pentru sistemul de fi\u0219iere Tencent Cloud COS pentru accesarea stoc\u0103rii obiectelor COS.\n<li class=\"l\"> A fost ad\u0103ugat suport complet pentru Java 11.\n<li class=\"l\"> A fost stabilizat\u0103 implementarea HDFS RBF (Federatia bazat\u0103 pe Router). Au fost ad\u0103ugate instrumente de gestionare a securit\u0103\u021bii \u00een Router-ul HDFS.\n<li class=\"l\"> A fost ad\u0103ugat serviciul DNS Resolution pentru identificarea serverelor de c\u0103tre client prin DNS folosind numele gazdelor, reduc\u00e2nd astfel nevoia de a lista toate gazdele \u00een configura\u021bii.\n<li class=\"l\"> A fost ad\u0103ugat suport pentru planificarea lans\u0103rii <noindex><a rel=\"nofollow\" href=\"https:\/\/issues.apache.org\/jira\/browse\/YARN-5220\">containerelor oportuniste<\/a><\/noindex> prin intermediul managerului de resurse centralizat (ResourceManager), inclusiv posibilitatea de a distribui containere \u00een func\u021bie de sarcina fiec\u0103rui nod.\n<li class=\"l\"> A fost ad\u0103ugat catalogul de aplica\u021bii YARN (Yet Another Resource Negotiator) cu op\u021biuni de c\u0103utare.\n<\/ul>\n<p><noindex><a rel=\"nofollow\" name=\"link\"><\/a><\/noindex><\/p>\n<p>Sursa: <a \ncontent=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=53476\">opennet.ro<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437 Apache Hadoop 3.3.0, \u0441\u0432\u043e\u0431\u043e\u0434\u043d\u043e\u0439 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u043e\u0431\u044a\u0451\u043c\u043e\u0432 \u0434\u0430\u043d\u043d\u044b\u0445 \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u043f\u0430\u0440\u0430\u0434\u0438\u0433\u043c\u044b map\/reduce, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u0439 \u0437\u0430\u0434\u0430\u0447\u0430 \u0434\u0435\u043b\u0438\u0442\u0441\u044f \u043d\u0430 \u043c\u043d\u043e\u0436\u0435\u0441\u0442\u0432\u043e \u0431\u043e\u043b\u0435\u0435 \u043c\u0435\u043b\u043a\u0438\u0445 \u043e\u0431\u043e\u0441\u043e\u0431\u043b\u0435\u043d\u043d\u044b\u0445 \u0444\u0440\u0430\u0433\u043c\u0435\u043d\u0442\u043e\u0432, \u043a\u0430\u0436\u0434\u044b\u0439 \u0438\u0437 \u043a\u043e\u0442\u043e\u0440\u044b\u0445 \u043c\u043e\u0436\u0435\u0442 \u0431\u044b\u0442\u044c \u0437\u0430\u043f\u0443\u0449\u0435\u043d \u043d\u0430 \u043e\u0442\u0434\u0435\u043b\u044c\u043d\u043e\u043c \u0443\u0437\u043b\u0435 \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430. \u0425\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u043d\u0430 \u0431\u0430\u0437\u0435 Hadoop \u043c\u043e\u0436\u0435\u0442 \u043e\u0445\u0432\u0430\u0442\u044b\u0432\u0430\u0442\u044c \u0442\u044b\u0441\u044f\u0447\u0438 \u0443\u0437\u043b\u043e\u0432 \u0438 [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-90548","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.2.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/ro\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.2.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"ro_RO\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0420\u0435\u043b\u0438\u0437 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 Apache Hadoop 3.3 | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/ro\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-08-02T11:42:53+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-08-02T11:42:53+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Release-ul platformei pentru procesarea distribuit\u0103 a datelor Apache Hadoop 3.3 | ProHoster","description":"Dup\u0103 un an \u0219i jum\u0103tate de dezvoltare, organiza\u021bia Apache Software Foundation a publicat release-ul","canonical_url":"https:\/\/prohoster.info\/ro\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"ro_RO","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0420\u0435\u043b\u0438\u0437 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 Apache Hadoop 3.3 | ProHoster","og:description":"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437","og:url":"https:\/\/prohoster.info\/ro\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-08-02T11:42:53+00:00","article:modified_time":"2020-08-02T11:42:53+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"90548","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 12:48:35","updated":"2022-09-28 08:12:14","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/posts\/90548","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/comments?post=90548"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/posts\/90548\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/media?parent=90548"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/categories?post=90548"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/tags?post=90548"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}