{"id":38448,"date":"2019-10-31T22:23:47","date_gmt":"2019-10-31T19:23:47","guid":{"rendered":"https:\/\/prohoster.info\/blog\/github-otkryl-narabotki-po-primeneniyu-mashinnogo-obucheniya-dlya-poiska-i-analiza-koda\/"},"modified":"2019-10-31T22:23:47","modified_gmt":"2019-10-31T19:23:47","slug":"github-otkryl-narabotki-po-primeneniyu-mashinnogo-obucheniya-dlya-poiska-i-analiza-koda","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/news\/github-otkryl-narabotki-po-primeneniyu-mashinnogo-obucheniya-dlya-poiska-i-analiza-koda","title":{"rendered":"GitHub on avanud arendused masin\u00f5ppe rakendamiseks koodi otsimiseks ja anal\u00fc\u00fcsimiseks.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>GitHub <noindex><a rel=\"nofollow\" href=\"https:\/\/github.blog\/2019-09-26-introducing-the-codesearchnet-challenge\/\">esitles<\/a><\/noindex> projekt <noindex><a rel=\"nofollow\" href=\"https:\/\/arxiv.org\/abs\/1909.09436\">CodeSearchNet<\/a><\/noindex>, mille on v\u00e4lja t\u00f6\u00f6tatud masin\u00f5ppe mudelid ja andmestikud, mis on vajalikud koodi anal\u00fc\u00fcsimiseks, klassifitseerimiseks ja anal\u00fc\u00fcsimiseks erinevates programmeerimiskeeltes. CodeSearchNet, sarnaselt <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/ImageNet\">ImageNet<\/a><\/noindex>, sisaldab suurt kogumit koodil\u00f5ike, mis on varustatud annotatsioonidega, mis formaliseerivad koodiga sooritatud toimingud. Mudelite koolitamiseks vajalikud komponendid ja CodeSearchNeti kasutusn\u00e4ited on kirjutatud Pythonis, kasutades Tensorflow raamistikku ja <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/github\/CodeSearchNet\">levitatakse<\/a><\/noindex> MIT litsentsi alusel.<\/p>\n<p>CodeSearchNeti loomisel on kasutatud loomuliku keele seadistustehnoloogiaid, mis v\u00f5imaldavad masin\u00f5ppe s\u00fcsteemidel arvestada mitte ainult s\u00fcntaktiliste omadustega, vaid ka koodi sooritatud toimingute t\u00e4hendusega. GitHubi s\u00fcsteem <noindex><a rel=\"nofollow\" href=\"https:\/\/github.blog\/2018-09-18-towards-natural-language-semantic-code-search\/\">rakendatakse<\/a><\/noindex> eksperimentides semantilise koodi otsingu korraldamiseks loomuliku keele p\u00e4ringute abil <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/github\/CodeSearchNet\/blob\/master\/resources\/queries.csv\">loomuliku keele<\/a><\/noindex> (n\u00e4iteks, kui esitada p\u00e4ring \"stringide loendi sortimine\", n\u00e4idatakse vastava algoritmi rakenduskoodi).<\/p>\n<p>Pakkumine andmekogum sisaldab \u00fcle 2 miljoni \"kood-kommentaar\" paari, mis on koostatud olemasolevate avatud raamatukogude allikate p\u00f5hjal. Kood katab \u00fcksikute funktsioonide v\u00f5i meetodite t\u00e4ieliku algteksti ning kommentaar kirjeldab funktsiooni tegevusi (toodud on detailne dokumentatsioon). Praegu on andmekogud ette valmistatud Python, JavaScript, Ruby, Go, Java ja PHP keelte jaoks. Pakutakse n\u00e4iteid ettevalmistatud andmekogude kasutamiseks erinevat t\u00fc\u00fcpi n\u00e4rviv\u00f5rkude koolitamiseks, sealhulgas <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Bag-of-words_model\">Ettepanekut andmekogumit h\u00f5lmab \u00fcle 2 miljoni \u201ekoodi-kommentaar\u201c paari, mis on koostatud olemasolevate avatud teegide l\u00e4htekoodidest. Kood h\u00f5lmab \u00fcksikute funktsioonide v\u00f5i meetodite t\u00e4isteksti ning kommentaar kirjeldab funktsiooni sooritatud toiminguid (toodud on detailsed dokumentatsioonid). Hetkel on andmekogumid ette valmistatud Python, JavaScript, Ruby, Go, Java ja PHP keelte jaoks. Pakutud andmekogumite kasutusn\u00e4idete jaoks erinevate n\u00e4rviv\u00f5rkude koolitamiseks on h\u00f5lmatud<\/a><\/noindex>, <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Recurrent_neural_network\">Neural-Bag-Of-Words<\/a><\/noindex>, <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Transformer_(machine_learning_model)\">RNN<\/a><\/noindex> Self-Attention <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Convolutional_neural_network\">(BERT) ja<\/a><\/noindex>.<\/p>\n<p>1D-CNN+Self-Attention Hybrid<br \/>\n<noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/github\/CodeSearchNet\/blob\/master\/resources\/queries.csv\">Loomuliku keele otsimise mehhanismide arendamiseks on lisaks ette valmistatud CodeSearchNet Challenge andmekogum, mis sisaldab<\/a><\/noindex> 99 t\u00fc\u00fcpilist<noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/github\/CodeSearchNet#downloading-data-from-s3\">p\u00e4ringut koos umbes 4 tuhande ekspertide annotatsiooniga, mis kirjeldavad k\u00f5ige t\u00f5en\u00e4olisemaid sidemeid koodiga andmekogus CodeSearchNet Corpus, mis katab umbes 6 miljonit meetodit ja funktsiooni (<\/a><\/noindex> kogu kogumi <noindex><a rel=\"nofollow\" href=\"https:\/\/www.kubeflow.org\/\">umbes 20 GB). CodeSearchNet Challenge v\u00f5ib toimida standardina koodi otsingu erinevate meetodite t\u00f5hususe hindamiseks loomuliku keele abil. Kasutades<\/a><\/noindex> on ette valmistatud<br \/>\n<noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/kubeflow\/examples\/tree\/master\/code_search\">n\u00e4ide<\/a><\/noindex> Kubeflow<\/p>\n<p><noindex><a rel=\"nofollow\" name=\"link\"><\/a><\/noindex><\/p>\n<p>Allikas: <a \ncontent=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=51570\">opennet.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>GitHub \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b \u043f\u0440\u043e\u0435\u043a\u0442 CodeSearchNet, \u0432 \u0440\u0430\u043c\u043a\u0430\u0445 \u043a\u043e\u0442\u043e\u0440\u043e\u0433\u043e \u043f\u043e\u0434\u0433\u043e\u0442\u043e\u0432\u043b\u0435\u043d\u044b \u043c\u043e\u0434\u0435\u043b\u0438 \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u0438 \u043d\u0430\u0431\u043e\u0440\u044b \u0434\u0430\u043d\u043d\u044b\u0445, \u043d\u0435\u043e\u0431\u0445\u043e\u0434\u0438\u043c\u044b\u0435 \u0434\u043b\u044f \u0440\u0430\u0437\u0431\u043e\u0440\u0430, \u043a\u043b\u0430\u0441\u0441\u0438\u0444\u0438\u043a\u0430\u0446\u0438\u0438 \u0438 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u043a\u043e\u0434\u0430 \u043d\u0430 \u0440\u0430\u0437\u043b\u0438\u0447\u043d\u044b\u0445 \u044f\u0437\u044b\u043a\u0430\u0445 \u043f\u0440\u043e\u0433\u0440\u0430\u043c\u043c\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f. CodeSearchNet, \u043f\u043e \u0430\u043d\u0430\u043b\u043e\u0433\u0438\u0438 \u0441 ImageNet, \u0432\u043a\u043b\u044e\u0447\u0430\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0443\u044e \u043a\u043e\u043b\u043b\u0435\u043a\u0446\u0438\u044e \u043e\u0442\u0440\u044b\u0432\u043a\u043e\u0432 \u043a\u043e\u0434\u0430, \u0441\u043d\u0430\u0431\u0436\u0451\u043d\u043d\u044b\u0445 \u0430\u043d\u043d\u043e\u0442\u0430\u0446\u0438\u044f\u043c\u0438, \u0444\u043e\u0440\u043c\u0430\u043b\u0438\u0437\u0443\u044e\u0449\u0438\u043c\u0438 \u0432\u044b\u043f\u043e\u043b\u043d\u044f\u0435\u043c\u044b\u0435 \u043a\u043e\u0434\u043e\u043c \u0434\u0435\u0439\u0441\u0442\u0432\u0438\u044f. \u041a\u043e\u043c\u043f\u043e\u043d\u0435\u043d\u0442\u044b \u0434\u043b\u044f \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u043c\u043e\u0434\u0435\u043b\u0435\u0439 \u0438 \u043f\u0440\u0438\u043c\u0435\u0440\u044b \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u044f CodeSearchNet \u043d\u0430\u043f\u0438\u0441\u0430\u043d\u044b \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 Python \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-38448","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.1.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"GitHub \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b \u043f\u0440\u043e\u0435\u043a\u0442\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/et\/blog\/news\/github-otkryl-narabotki-po-primeneniyu-mashinnogo-obucheniya-dlya-poiska-i-analiza-koda\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.1.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"et_EE\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47GitHub \u043e\u0442\u043a\u0440\u044b\u043b \u043d\u0430\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043f\u043e \u043f\u0440\u0438\u043c\u0435\u043d\u0435\u043d\u0438\u044e \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u043f\u043e\u0438\u0441\u043a\u0430 \u0438 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u043a\u043e\u0434\u0430 | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"GitHub \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b \u043f\u0440\u043e\u0435\u043a\u0442\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/et\/blog\/news\/github-otkryl-narabotki-po-primeneniyu-mashinnogo-obucheniya-dlya-poiska-i-analiza-koda\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2019-10-31T19:23:47+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2019-10-31T19:23:47+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47GitHub tutvustas masin\u00f5ppe rakendamise projekti koodi otsimiseks ja anal\u00fc\u00fcsimiseks | ProHoster","description":"koodi otsingu mootorit.","canonical_url":"https:\/\/prohoster.info\/et\/blog\/news\/github-otkryl-narabotki-po-primeneniyu-mashinnogo-obucheniya-dlya-poiska-i-analiza-koda","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47GitHub \u043e\u0442\u043a\u0440\u044b\u043b \u043d\u0430\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043f\u043e \u043f\u0440\u0438\u043c\u0435\u043d\u0435\u043d\u0438\u044e \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u043f\u043e\u0438\u0441\u043a\u0430 \u0438 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u043a\u043e\u0434\u0430 | ProHoster","og:description":"GitHub \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b \u043f\u0440\u043e\u0435\u043a\u0442","og:url":"https:\/\/prohoster.info\/et\/blog\/news\/github-otkryl-narabotki-po-primeneniyu-mashinnogo-obucheniya-dlya-poiska-i-analiza-koda","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T19:23:47+00:00","article:modified_time":"2019-10-31T19:23:47+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"38448","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-23 22:05:20","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 01:09:22","updated":"2026-01-23 22:05:20","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/38448","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=38448"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/38448\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=38448"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=38448"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=38448"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}