{"id":90548,"date":"2020-08-02T13:42:53","date_gmt":"2020-08-02T11:42:53","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3"},"modified":"2020-08-02T13:42:53","modified_gmt":"2020-08-02T11:42:53","slug":"reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","title":{"rendered":"Apache Hadoop 3.3 andmete jaotamise platvormi v\u00e4ljaanne","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>P\u00e4rast poolteist aastat arendust\u00f6\u00f6de tegemist organisatsiooni Apache Software Foundation <noindex><a rel=\"nofollow\" href=\"https:\/\/blogs.apache.org\/hadoop\/entry\/announce-apache-hadoop-3-3\">avalikustas<\/a><\/noindex> vabastus <noindex><a rel=\"nofollow\" href=\"http:\/\/hadoop.apache.org\">Apache Hadoop 3.3.0<\/a><\/noindex>, avatud platvorm andmete jaotatud t\u00f6\u00f6tlemise korraldamiseks suurte andmehulkade kasutamise kaudu <noindex><a rel=\"nofollow\" href=\"http:\/\/ru.wikipedia.org\/wiki\/MapReduce\">map\/reduce<\/a><\/noindex>, mille k\u00e4igus jagatakse \u00fclesanne arvukateks v\u00e4iksemateks eraldiseisvateks fragmentideks, millest iga\u00fcht saab k\u00e4itada klastris eraldi s\u00f5lmel. Hadoopi talletamine v\u00f5ib h\u00f5lmata tuhandeid s\u00f5lmi ja sisaldada eksabaitide andmeid.<\/p>\n<p>Hadoopi koosseisu kuulub jaotatud failis\u00fcsteemi Hadoop Distributed Filesystem (HDFS) teostus, mis tagab automaatse andmete varundamise ning on optimeeritud MapReduce rakenduste jaoks. Andmete h\u00f5lbustatud juurdep\u00e4\u00e4su nimel Hadoopi salvestusse on v\u00e4lja t\u00f6\u00f6tatud andmebaas HBase ja SQL-sarnane keel Pig, mis on midagi nagu SQL MapReduce jaoks, mille p\u00e4ringud saab paralleelselt t\u00f6\u00f6tleda mitme Hadoopi platvormiga. Projekt on hinnatud t\u00e4iesti stabiilseks ja t\u00f6\u00f6stuslikuks kasutamiseks valmis. Hadoopit kasutatakse aktiivselt suurtes t\u00f6\u00f6stusprojektides, pakkudes v\u00f5imalusi, mis sarnanevad Google'i Bigtable\/GFS\/MapReduce platvormile, samas kui Google on ametlikult <noindex><a rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=26398\">delegeerinud<\/a><\/noindex> Hadoopile ja teistele Apache projektidele \u00f5iguse kasutada tehnoloogiaid, millele kehtivad patendid, mis on seotud MapReduce meetodiga. <\/p>\n<p>Hadoop on Apache'i hoidlate seas muudatuste arvu poolest esikohal ja koodibaasi suuruse poolest viiendal kohal (umbes 4 miljonit koodirida). Suurtest Hadoopi rakendustest on m\u00e4rgitud Netflixi salvestus (kus s\u00e4ilitab \u00fcle 500 miljardi s\u00fcndmuse p\u00e4evas), Twitter (10 000 s\u00f5lme reaalajas klastri, mis s\u00e4ilitab \u00fcle zettabaiti andmeid ja t\u00f6\u00f6tleb \u00fcle 5 miljardi seansi p\u00e4evas), Facebook (4 000 s\u00f5lme klastri, kus hoiustatakse \u00fcle 300 petabaiti ja mis suureneb iga p\u00e4ev 4 TB v\u00f5rra).<\/p>\n<p>Peamised <noindex><a rel=\"nofollow\" href=\"https:\/\/hadoop.apache.org\/docs\/r3.3.0\/hadoop-project-dist\/hadoop-common\/release\/3.3.0\/CHANGELOG.3.3.0.html\">muudatused<\/a><\/noindex> Apache Hadoop 3.3 sees:<\/p>\n<ul>\n<li class=\"l\"> Lisatud toetus ARM-arkitektuuril p\u00f5hinevatele platvormidele.\n<li class=\"l\"> Protocolli <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/protocolbuffers\/protobuf\">Protobuf<\/a><\/noindex> (Protokollipufferid), mida kasutatakse struktureeritud andmete serialiseerimiseks, on uuendatud versioonile 3.7.1 seoses protobuf-2.5.0 versiooni eluts\u00fckli l\u00f5ppemisega.\n<li class=\"l\"> S3A konnektori v\u00f5imalusi on laiendatud: lisatud toe autentimine tokenite abil (<noindex><a rel=\"nofollow\" href=\"https:\/\/blog.cloudera.com\/hadoop-delegation-tokens-explained\/\">Delegation Token<\/a><\/noindex>), t\u00e4iustatud vastuste vahem\u00e4lu tugi 404 koodiga, S3guard'i j\u00f5udlust on suurendatud, t\u00f6\u00f6 usaldusv\u00e4\u00e4rsust on parendatud.\n<li class=\"l\"> ABFS-failis\u00fcsteemis on lahendatud automaatse h\u00e4\u00e4lestuse probleemid.\n<li class=\"l\"> Lisatud sisseehitatud tugi Tencent Cloud COS failis\u00fcsteemile, et p\u00e4\u00e4seda COS objektide salvestusruumile.\n<li class=\"l\"> Lisatud t\u00e4ielik toetus Java 11-le.\n<li class=\"l\"> Stabiliseeritud HDFS RBF (Router-p\u00f5hine f\u00f6deratsioon) teostus. HDFS Routerisse on lisatud turvahalduse t\u00f6\u00f6riistad.\n<li class=\"l\"> Lisatud DNS-i lahendamise teenus, mis v\u00f5imaldab kliendil serverite m\u00e4\u00e4ratlemist nimepidi, v\u00e4ltides k\u00f5igi hostide loetlemist seadistustes.\n<li class=\"l\"> Lisatud \u00fclesande k\u00e4ivitamise ajakava tugi. <noindex><a rel=\"nofollow\" href=\"https:\/\/issues.apache.org\/jira\/browse\/YARN-5220\">opportunistlike konteinerite jaoks.<\/a><\/noindex> keskse ressursside halduri (ResourceManager) kaudu, sealhulgas v\u00f5imalus jaotada konteinerite koormuse alusel igas s\u00f5lmes.\n<li class=\"l\"> Lisatud YARN (Yet Another Resource Negotiator) rakenduste kataloog otsinguv\u00f5imalusega.\n<\/ul>\n<p><noindex><a rel=\"nofollow\" name=\"link\"><\/a><\/noindex><\/p>\n<p>Allikas: <a \ncontent=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=53476\">opennet.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437 Apache Hadoop 3.3.0, \u0441\u0432\u043e\u0431\u043e\u0434\u043d\u043e\u0439 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u043e\u0431\u044a\u0451\u043c\u043e\u0432 \u0434\u0430\u043d\u043d\u044b\u0445 \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u043f\u0430\u0440\u0430\u0434\u0438\u0433\u043c\u044b map\/reduce, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u0439 \u0437\u0430\u0434\u0430\u0447\u0430 \u0434\u0435\u043b\u0438\u0442\u0441\u044f \u043d\u0430 \u043c\u043d\u043e\u0436\u0435\u0441\u0442\u0432\u043e \u0431\u043e\u043b\u0435\u0435 \u043c\u0435\u043b\u043a\u0438\u0445 \u043e\u0431\u043e\u0441\u043e\u0431\u043b\u0435\u043d\u043d\u044b\u0445 \u0444\u0440\u0430\u0433\u043c\u0435\u043d\u0442\u043e\u0432, \u043a\u0430\u0436\u0434\u044b\u0439 \u0438\u0437 \u043a\u043e\u0442\u043e\u0440\u044b\u0445 \u043c\u043e\u0436\u0435\u0442 \u0431\u044b\u0442\u044c \u0437\u0430\u043f\u0443\u0449\u0435\u043d \u043d\u0430 \u043e\u0442\u0434\u0435\u043b\u044c\u043d\u043e\u043c \u0443\u0437\u043b\u0435 \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430. \u0425\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u043d\u0430 \u0431\u0430\u0437\u0435 Hadoop \u043c\u043e\u0436\u0435\u0442 \u043e\u0445\u0432\u0430\u0442\u044b\u0432\u0430\u0442\u044c \u0442\u044b\u0441\u044f\u0447\u0438 \u0443\u0437\u043b\u043e\u0432 \u0438 [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-90548","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.1.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/et\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.1.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"et_EE\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0420\u0435\u043b\u0438\u0437 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 Apache Hadoop 3.3 | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/et\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-08-02T11:42:53+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-08-02T11:42:53+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Apache Hadoop 3.3 andmete jaotamise platvormi v\u00e4ljaanne | ProHoster","description":"P p\u00e4rast poolteist aastat arendust on Apache Software Foundation v\u00e4lja andnud versiooni.","canonical_url":"https:\/\/prohoster.info\/et\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0420\u0435\u043b\u0438\u0437 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 Apache Hadoop 3.3 | ProHoster","og:description":"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437","og:url":"https:\/\/prohoster.info\/et\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-08-02T11:42:53+00:00","article:modified_time":"2020-08-02T11:42:53+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"90548","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 12:48:35","updated":"2022-09-28 08:12:14","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/90548","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=90548"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/90548\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=90548"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=90548"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=90548"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}