{"id":33865,"date":"2019-10-31T21:55:06","date_gmt":"2019-10-31T18:55:06","guid":{"rendered":"https:\/\/prohoster.info\/blog\/microsoft-otkryl-kod-biblioteki-vektornogo-poiska-ispolzuemoj-v-bing\/"},"modified":"2019-10-31T21:55:06","modified_gmt":"2019-10-31T18:55:06","slug":"microsoft-otkryl-kod-biblioteki-vektornogo-poiska-ispolzuemoj-v-bing","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/microsoft-otkryl-kod-biblioteki-vektornogo-poiska-ispolzuemoj-v-bing","title":{"rendered":"Microsoft on avanud vektorotsingu raamatukogu koodi, mida kasutatakse Bingis","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Ettev\u00f5te Microsoft avalikustasin<\/a><\/noindex> masin\u00f5ppe raamatukogu l\u00e4htekood SPTAG<\/a><\/noindex> (Space Partition Tree And Graph) koos ligikaudse otsingu algoritmi rakendusega l\u00e4hedaloleva naabri otsing<\/a><\/noindex>. Raamatukogu on v\u00e4lja t\u00f6\u00f6tatud<\/a><\/noindex> Microsoft Research'i teadusosakonnas ja Microsoft Search Technology Center'i otsingutehnoloogia arenduskeskuses. Praktikas kasutatakse SPTAG-i otsingumootoris Bing, et m\u00e4\u00e4rata k\u00f5ige asjakohasemad tulemused, arvestades otsingup\u00e4ringute konteksti. Kood on kirjutatud C++ keeles ja GNU \u00dcldine Avaliku litsentsi alusel.<\/a><\/noindex> on MIT litsentsi all. Toetatud on koostamine Linuxile ja Windowsile. On olemas Python keelele m\u00f5eldud m\u00e4his.<\/p>\n

Kuigi ideed vektorhoidlate kasutamisest otsingus\u00fcsteemides on juba pikka aega ringelnud, takistab nende rakendamist praktikas operatsioonide suur ressursimahukus ja skaleeritavuse piirangud. S\u00fcva\u00f5ppe meetodite ja l\u00e4hima naabri ligikaudse otsingu algoritmide \u00fchendamine on v\u00f5imaldanud viia vektors\u00fcsteemide j\u00f5udluse ja skaleeritavuse tasemele, mis on suures osas vastuv\u00f5etav suurtele otsingus\u00fcsteemidele. N\u00e4iteks Bingis j\u00f5uab vektoriindeksi, mille suurus \u00fcletab 150 miljardit vektorit, k\u00f5ige asjakohasemate tulemuste valimise aeg 8 ms.<\/p>\n

Raamatukogusse on kaasatud vahendid indeksi loomiseks ja vektorite otsimise korraldamiseks ning t\u00f6\u00f6riistade komplekt jaotatud online-otsingus\u00fcsteemi toetamiseks, mis katab v\u00e4ga suurte vektorikogude otsimise. Pakutakse<\/a><\/noindex> j\u00e4rgnevad moodulid: indeksi loojamoodul indekseerimiseks, otsija indeksi p\u00f5hjal otsimiseks, mida haldab klaster mitmest s\u00f5lmest, server t\u00f6\u00f6tlusprotsessorite k\u00e4ivitamiseks s\u00f5lmedel, Agregaator mitme serveri \u00fchendamiseks \u00fcheks ning klient p\u00e4ringute edastamiseks. Toetatakse uute vektorite lisamist indeksisse ja vektorite eemaldamist reaalajas.<\/p>\n

Raamatukogu eeldab, et kogutud ja esitatud andmed on vormindatud seotud vektoritena, mida saab v\u00f5rrelda p\u00f5hjal euclidean<\/a><\/noindex> (L2) v\u00f5i kosinuse<\/a><\/noindex> vahedega. Otsingup\u00e4ringu korral tagastatakse vektorid, mille vahe allika vektoriga on minimaalne. SPTAG pakub kahte meetodit vektoriruumi korraldamiseks: SPTAG-KDT (K-m\u00f5\u00f5tmelise puu (kd-tree<\/a><\/noindex>) ja relatiivsete naabruste graaf)<\/a><\/noindex>ja SPTAG-BKT (k-esimese puu (k-means tree<\/a><\/noindex> ja relatiivsete naabruste graaf). Esimene meetod n\u00f5uab indeksi t\u00f6\u00f6tlemisel v\u00e4hem ressursse, samas kui teine n\u00e4itab v\u00e4ga suurte vektorikogude puhul k\u00f5rgemat otsingut\u00e4psust.<\/p>\n

Vektors\u00fcstem ei piirdumurda vaid tekstiga, vaid seda saab rakendada ka multimeedia teabele ja piltidele, samuti automaatsete soovituste s\u00fcsteemides. N\u00e4iteks oli PyTorchi raamistikul p\u00f5hinevas protot\u00fc\u00fcbis rakendatud vektors\u00fcsteem, mis v\u00f5imaldab otsida objektide sarnasust piltidel, luues vektorkogumeid mitmest standardkogumist, kus olid loomapildid, kassid ja koerad. Kui otsinguks esitatakse sisendpilt, muudetakse see masin\u00f5ppemudeli abil vektoriks, mille alusel valitakse SPTAG-algoritmi abil indeksist k\u00f5ige sarnasemad vektorid ning tulemuseks tagastatakse nendega seotud pildid.<\/p>\n

<\/a><\/noindex><\/p>\n

Allikas: opennet.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Microsoft \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0438\u0441\u0445\u043e\u0434\u043d\u044b\u0435 \u0442\u0435\u043a\u0441\u0442\u044b \u0431\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u0438 \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f SPTAG (Space Partition Tree And Graph) \u0441 \u0440\u0435\u0430\u043b\u0438\u0437\u0430\u0446\u0438\u0435\u0439 \u0430\u043b\u0433\u043e\u0440\u0438\u0442\u043c\u0430 \u043f\u0440\u0438\u0431\u043b\u0438\u0437\u0438\u0442\u0435\u043b\u044c\u043d\u043e\u0433\u043e \u043f\u043e\u0438\u0441\u043a\u0430 \u0431\u043b\u0438\u0436\u0430\u0439\u0448\u0435\u0433\u043e \u0441\u043e\u0441\u0435\u0434\u0430. \u0411\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u0430 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u0430\u043d\u0430 \u0432 \u0438\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u044c\u0441\u043a\u043e\u043c \u043f\u043e\u0434\u0440\u0430\u0437\u0434\u0435\u043b\u0435\u043d\u0438\u0438 Microsoft Research \u0438 \u0446\u0435\u043d\u0442\u0440\u0435 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043f\u043e\u0438\u0441\u043a\u043e\u0432\u044b\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 (Microsoft Search Technology Center). \u041d\u0430 \u043f\u0440\u0430\u043a\u0442\u0438\u043a\u0435 SPTAG \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0435\u0442\u0441\u044f \u0432 \u043f\u043e\u0438\u0441\u043a\u043e\u0432\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u0435 Bing \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u043d\u0430\u0438\u0431\u043e\u043b\u0435\u0435 \u0440\u0435\u043b\u0435\u0432\u0430\u043d\u0442\u043d\u044b\u0445 \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u043e\u0432 \u0441 \u0443\u0447\u0451\u0442\u043e\u043c \u043a\u043e\u043d\u0442\u0435\u043a\u0441\u0442\u0430 \u043f\u043e\u0438\u0441\u043a\u043e\u0432\u044b\u0445 \u0437\u0430\u043f\u0440\u043e\u0441\u043e\u0432. […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-33865","post","type-post","status-publish","format-standard","hentry","category-novosti-interneta"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Microsoft avas Bingis kasutatava vektoriotsingu raamatukogu koodi | ProHoster","description":"Microsoft avaldas avatud l\u00e4htekoodiga masin\u00f5ppe raamatukogu SPTAG (Space Partition Tree And Graph), mis sisaldab ligikaudse l\u00e4hima naabri otsingu algoritmi rakendust. Raamatukogu on v\u00e4lja t\u00f6\u00f6tatud Microsofti teadus- ja arendusosakonnas ning otsingutehnoloogia keskuses (Microsoft Search Technology Center). Praktikas kasutatakse SPTAG-i Bing otsingumootoris, et m\u00e4\u00e4rata konteksti arvesse v\u00f5ttes k\u00f5ige asjakohasemad otsingutulemused.","canonical_url":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/microsoft-otkryl-kod-biblioteki-vektornogo-poiska-ispolzuemoj-v-bing","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47Microsoft \u043e\u0442\u043a\u0440\u044b\u043b \u043a\u043e\u0434 \u0431\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u0438 \u0432\u0435\u043a\u0442\u043e\u0440\u043d\u043e\u0433\u043e \u043f\u043e\u0438\u0441\u043a\u0430, \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u043c\u043e\u0439 \u0432 Bing | ProHoster","og:description":"\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Microsoft \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0430 \u0438\u0441\u0445\u043e\u0434\u043d\u044b\u0435 \u0442\u0435\u043a\u0441\u0442\u044b \u0431\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u0438 \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f SPTAG (Space Partition Tree And Graph) \u0441 \u0440\u0435\u0430\u043b\u0438\u0437\u0430\u0446\u0438\u0435\u0439 \u0430\u043b\u0433\u043e\u0440\u0438\u0442\u043c\u0430 \u043f\u0440\u0438\u0431\u043b\u0438\u0437\u0438\u0442\u0435\u043b\u044c\u043d\u043e\u0433\u043e \u043f\u043e\u0438\u0441\u043a\u0430 \u0431\u043b\u0438\u0436\u0430\u0439\u0448\u0435\u0433\u043e \u0441\u043e\u0441\u0435\u0434\u0430. \u0411\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u0430 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u0430\u043d\u0430 \u0432 \u0438\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u044c\u0441\u043a\u043e\u043c \u043f\u043e\u0434\u0440\u0430\u0437\u0434\u0435\u043b\u0435\u043d\u0438\u0438 Microsoft Research \u0438 \u0446\u0435\u043d\u0442\u0440\u0435 \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u043f\u043e\u0438\u0441\u043a\u043e\u0432\u044b\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 (Microsoft Search Technology Center). \u041d\u0430 \u043f\u0440\u0430\u043a\u0442\u0438\u043a\u0435 SPTAG \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0435\u0442\u0441\u044f \u0432 \u043f\u043e\u0438\u0441\u043a\u043e\u0432\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u0435 Bing \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u043d\u0430\u0438\u0431\u043e\u043b\u0435\u0435 \u0440\u0435\u043b\u0435\u0432\u0430\u043d\u0442\u043d\u044b\u0445 \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u043e\u0432 \u0441 \u0443\u0447\u0451\u0442\u043e\u043c \u043a\u043e\u043d\u0442\u0435\u043a\u0441\u0442\u0430 \u043f\u043e\u0438\u0441\u043a\u043e\u0432\u044b\u0445 \u0437\u0430\u043f\u0440\u043e\u0441\u043e\u0432.","og:url":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/microsoft-otkryl-kod-biblioteki-vektornogo-poiska-ispolzuemoj-v-bing","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T18:55:06+00:00","article:modified_time":"2019-10-31T18:55:06+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"33865","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-21 17:01:19","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 02:32:26","updated":"2026-01-21 17:01:19"},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/33865","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=33865"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/33865\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=33865"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=33865"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=33865"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}