{"id":90548,"date":"2020-08-02T13:42:53","date_gmt":"2020-08-02T11:42:53","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3"},"modified":"2020-08-02T13:42:53","modified_gmt":"2020-08-02T11:42:53","slug":"reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","title":{"rendered":"Andmete jaotatud t\u00f6\u00f6tlemise platvormi Apache Hadoop 3.3 v\u00e4ljaanne","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>P\u00e4rast poolteist aastat arendust\u00f6\u00f6d Apache Software Foundation <noindex><a rel=\"nofollow\" href=\"https:\/\/blogs.apache.org\/hadoop\/entry\/announce-apache-hadoop-3-3\">avalikustasin<\/a><\/noindex> v\u00e4ljalase <noindex><a rel=\"nofollow\" href=\"http:\/\/hadoop.apache.org\">Apache Hadoop 3.3.0<\/a><\/noindex>, avatud platvorm suurte andmemahtude jaotatud t\u00f6\u00f6tlemise korraldamiseks, kasutades paradigmat <noindex><a rel=\"nofollow\" href=\"http:\/\/ru.wikipedia.org\/wiki\/MapReduce\">map\/reduce<\/a><\/noindex>, kus \u00fclesanne jaguneb paljude v\u00e4ikeste eraldiseisvate fragmentideks, millest iga\u00fcht saab k\u00e4itada klastris eraldi s\u00f5lmel. Hadoopi p\u00f5hjal loodud salvestusmaht v\u00f5ib katab tuhandeid s\u00f5lmi ja sisaldada eksabaitide kaupa andmeid.<\/p>\n<p>Hadoopi koosseisu kuulub jaotatud failis\u00fcsteemi Hadoop Distributed Filesystem (HDFS) teostus, mis tagab automaatse andmete varundamise ja on optimeeritud MapReduce rakenduste jaoks. Andmetele juurdep\u00e4\u00e4su lihtsustamiseks on Hadoobi salvestuses v\u00e4lja t\u00f6\u00f6tatud andmebaas HBase ja SQL-sarnane keel Pig, mis on omamoodi SQL MapReduce jaoks, mille p\u00e4ringud saavad olla paralleelselt t\u00f6\u00f6deldud mitmete Hadoopi platvormide poolt. Projekt on hinnatud t\u00e4ielikult stabiilseks ja valmis t\u00f6\u00f6stuslikuks kasutamiseks. Hadoopi kasutatakse aktiivselt suurtes t\u00f6\u00f6stuslikes projektides, pakkudes v\u00f5imalusi, mis sarnanevad Google'i Bigtable\/GFS\/MapReduce platvormile, samal ajal kui Google on ametlikult <noindex><a rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=26398\">delegeerinud<\/a><\/noindex> Hadoop ja teiste Apache projektide puhul on tehnoloogiate kasutamise \u00f5igused, mis on seotud MapReduce meetodiga, litsentseeritud. <\/p>\n<p>Hadoop on Apache hoidlatest k\u00f5ige rohkem muudatusi teinud ja suuruselt viies koodibaasi (umbes 4 miljonit rida koodi). Suurte Hadoopi rakenduste seas on Netflixi andmehoidlad (salvestatakse \u00fcle 500 miljardi s\u00fcndmuse p\u00e4evas), Twitter (10 000 s\u00f5lme reaalajas klaster salvestab \u00fcle zettabaidi andmeid ja t\u00f6\u00f6tleb enam kui 5 miljardit seanssi p\u00e4evas), Facebook (4 000 s\u00f5lmega klaster salvestab \u00fcle 300 petabaiti ja suureneb igap\u00e4evaselt 4 PB v\u00f5rra).<\/p>\n<p>Peamised <noindex><a rel=\"nofollow\" href=\"https:\/\/hadoop.apache.org\/docs\/r3.3.0\/hadoop-project-dist\/hadoop-common\/release\/3.3.0\/CHANGELOG.3.3.0.html\">muudatused<\/a><\/noindex> Apache Hadoop 3.3-s:<\/p>\n<ul>\n<li class=\"l\"> Lisatud tugi ARM arhitektuuril p\u00f5hinevatele platvormidele.\n<li class=\"l\"> Protokolli <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/protocolbuffers\/protobuf\">Protobuf<\/a><\/noindex> Protokolli (Protocol buffers) formaat, mida kasutatakse struktureeritud andmete serialiseerimiseks, on v\u00e4rskendatud versioonile 3.7.1 seoses protobuf-2.5.0 haru eluts\u00fckli l\u00f5ppemisega.\n<li class=\"l\"> S3A \u00fchenduse v\u00f5imalusi on laiendatud: lisatud tugiv\u00f5imalus autentimiseks tokenite abil (<noindex><a rel=\"nofollow\" href=\"https:\/\/blog.cloudera.com\/hadoop-delegation-tokens-explained\/\">Delegation Token<\/a><\/noindex>), t\u00e4iustatud 404 staatusega vastuste vahehoidlate tugi, suurendatud S3guard'i j\u00f5udlust ja parendatud t\u00f6\u00f6kindlust.\n<li class=\"l\"> ABFS failnuts\u00fcsteemis on lahendatud automaatse h\u00e4\u00e4lestamise probleemid.\n<li class=\"l\"> Lisatud sisseehitatud tugi Tencent Cloud COS failis\u00fcsteemile COS objektihaldusena ligip\u00e4\u00e4suks.\n<li class=\"l\"> Java 11 t\u00e4iendav tugi on lisatud.\n<li class=\"l\"> HDFS RBF (\u00fclemise f\u00f6deratsiooni) rakendus on stabiliseeritud. HDFS Routerile on lisatud turvalisuse juhtimise vahendid.\n<li class=\"l\"> Lisatud DNS-i resolutsiooni teenus, mis v\u00f5imaldab klientidel serverite leidmist DNS-i kaudu hostinimede j\u00e4rgi, v\u00e4ltides k\u00f5igi hostide loetlemist seadistustes.\n<li class=\"l\"> Lanceraamisplaani tugi on lisatud <noindex><a rel=\"nofollow\" href=\"https:\/\/issues.apache.org\/jira\/browse\/YARN-5220\">opportunistlike konteinerite<\/a><\/noindex> haldamiseks keskse ressursside haldur (ResourceManager) kaudu, sealhulgas iga s\u00f5lme koormuse arvestamisega konteinerite jaotamine.\n<li class=\"l\"> YARN (Veel \u00dcks Ressursside L\u00e4bir\u00e4\u00e4kimine) rakenduste kataloog on lisatud otsinguv\u00f5imalustega.\n<\/ul>\n<p><noindex><a rel=\"nofollow\" name=\"link\"><\/a><\/noindex><\/p>\n<p>Allikas: <a \ncontent=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=53476\">opennet.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437 Apache Hadoop 3.3.0, \u0441\u0432\u043e\u0431\u043e\u0434\u043d\u043e\u0439 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u043e\u0431\u044a\u0451\u043c\u043e\u0432 \u0434\u0430\u043d\u043d\u044b\u0445 \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u043f\u0430\u0440\u0430\u0434\u0438\u0433\u043c\u044b map\/reduce, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u0439 \u0437\u0430\u0434\u0430\u0447\u0430 \u0434\u0435\u043b\u0438\u0442\u0441\u044f \u043d\u0430 \u043c\u043d\u043e\u0436\u0435\u0441\u0442\u0432\u043e \u0431\u043e\u043b\u0435\u0435 \u043c\u0435\u043b\u043a\u0438\u0445 \u043e\u0431\u043e\u0441\u043e\u0431\u043b\u0435\u043d\u043d\u044b\u0445 \u0444\u0440\u0430\u0433\u043c\u0435\u043d\u0442\u043e\u0432, \u043a\u0430\u0436\u0434\u044b\u0439 \u0438\u0437 \u043a\u043e\u0442\u043e\u0440\u044b\u0445 \u043c\u043e\u0436\u0435\u0442 \u0431\u044b\u0442\u044c \u0437\u0430\u043f\u0443\u0449\u0435\u043d \u043d\u0430 \u043e\u0442\u0434\u0435\u043b\u044c\u043d\u043e\u043c \u0443\u0437\u043b\u0435 \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430. \u0425\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u043d\u0430 \u0431\u0430\u0437\u0435 Hadoop \u043c\u043e\u0436\u0435\u0442 \u043e\u0445\u0432\u0430\u0442\u044b\u0432\u0430\u0442\u044c \u0442\u044b\u0441\u044f\u0447\u0438 \u0443\u0437\u043b\u043e\u0432 \u0438 [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-90548","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.0.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/et\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.0.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"et_EE\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0420\u0435\u043b\u0438\u0437 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 Apache Hadoop 3.3 | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/et\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-08-02T11:42:53+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-08-02T11:42:53+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Apache Hadoop 3.3 andmete hajutatud t\u00f6\u00f6tlemise platvormi v\u00e4ljaanne | ProHoster","description":"P\u00e4rast poolteist aastat arendust avaldas Apache Software Foundation versiooni","canonical_url":"https:\/\/prohoster.info\/et\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0420\u0435\u043b\u0438\u0437 \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u0434\u043b\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 Apache Hadoop 3.3 | ProHoster","og:description":"\u041f\u043e\u0441\u043b\u0435 \u043f\u043e\u043b\u0443\u0442\u043e\u0440\u0430 \u043b\u0435\u0442 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u044f Apache Software Foundation \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0440\u0435\u043b\u0438\u0437","og:url":"https:\/\/prohoster.info\/et\/blog\/news\/reliz-platformy-dlya-raspredelyonnoj-obrabotki-dannyh-apache-hadoop-3-3","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-08-02T11:42:53+00:00","article:modified_time":"2020-08-02T11:42:53+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"90548","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 12:48:35","updated":"2022-09-28 08:12:14","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/90548","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=90548"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/90548\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=90548"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=90548"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=90548"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}