{"id":111103,"date":"2023-10-26T15:10:31","date_gmt":"2023-10-26T13:10:31","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/otkryt-kod-jina-embedding-modeli-dlya-vektornogo-predstavleniya-smysla-teksta"},"modified":"2023-10-26T15:10:31","modified_gmt":"2023-10-26T13:10:31","slug":"otkryt-kod-jina-embedding-modeli-dlya-vektornogo-predstavleniya-smysla-teksta","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sv\/blog\/news\/otkryt-kod-jina-embedding-modeli-dlya-vektornogo-predstavleniya-smysla-teksta","title":{"rendered":"Koden f\u00f6r Jina Embedding har \u00f6ppnats, en modell f\u00f6r vektorrepr\u00e4sentation av textens betydelse.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

F\u00f6retaget Jina har lanserat en maskininl\u00e4rningsmodell f\u00f6r vektorrepresentation av text under licensen Apache 2.0 \u2014 jina-embeddings-v2. Modellen g\u00f6r det m\u00f6jligt att omvandla godtycklig text, inklusive upp till 8192 tecken, till en liten sekvens av reella tal som bildar en vektor kopplad till den ursprungliga texten och \u00e5terspeglar dess semantik. Jina Embedding har blivit den f\u00f6rsta \u00f6ppna maskininl\u00e4rningsmodellen med egenskaper som st\u00e5r sig mot den propriet\u00e4ra textvektoriseringsmodellen fr\u00e5n OpenAI-projektet (text-embedding-ada-002), och klarar dessutom av att bearbeta texter med upp till 8192 tokens. <\/p>\n

Avst\u00e5ndet mellan tv\u00e5 skapade vektorer kan anv\u00e4ndas f\u00f6r att best\u00e4mma den semantiska relationen mellan de ursprungliga texterna. I praktiken kan de skapade vektorerna anv\u00e4ndas f\u00f6r att analysera textlikhet, organisera s\u00f6kningar av \u00e4mnesn\u00e4ra material (rankning av resultat baserat p\u00e5 semantisk n\u00e4rhet), gruppera texter efter mening, generera rekommendationer (f\u00f6resl\u00e5 en lista med liknande textstr\u00e4ngar), uppt\u00e4ckta anomalier, plagiatdetektion och klassificering av tester. Exempel p\u00e5 anv\u00e4ndningsomr\u00e5den inkluderas analys av juridiska dokument, aff\u00e4rsanalys, medicinska studier f\u00f6r bearbetning av vetenskapliga artiklar, litteraturkritik, analys av finansiella rapporter och f\u00f6r att f\u00f6rb\u00e4ttra kvaliteten i chatbottars hantering av komplexa fr\u00e5gor. <\/p>\n

Tv\u00e5 varianter av modellen jina-embeddings finns tillg\u00e4ngliga f\u00f6r nedladdning (grundversion \u2014 0,27 GB och nedskalen version \u2014 0,07 GB), tr\u00e4nade p\u00e5 400 miljoner par av textsekvenser p\u00e5 engelska som t\u00e4cker olika kunskapsomr\u00e5den. Vid tr\u00e4ningen anv\u00e4ndes sekvenser med en storlek p\u00e5 512 tokens, som extrapolerades till en storlek p\u00e5 8192 med hj\u00e4lp av metoden ALiBi (Attention with Linear Biases). <\/p>\n

Basmodellen inkluderar 137 miljoner parametrar och \u00e4r avsedd f\u00f6r anv\u00e4ndning p\u00e5 station\u00e4ra system med GPU. Den f\u00f6rkortade modellen inneh\u00e5ller 33 miljoner parametrar, erbjuder l\u00e4gre noggrannhet och \u00e4r inriktad p\u00e5 anv\u00e4ndning p\u00e5 mobila enheter och system med begr\u00e4nsad minneskapacitet. Inom en snar framtid planeras ocks\u00e5 lanseringen av en stor modell som kommer att omfatta 435 miljoner parametrar. En flerspr\u00e5kig variant av modellen \u00e4r ocks\u00e5 under utveckling, som f\u00f6r n\u00e4rvarande fokuserar p\u00e5 st\u00f6d f\u00f6r tyska och spanska. En plugin f\u00f6r att anv\u00e4nda modellen jina-embeddings via LLM-verktyget har ocks\u00e5 tagits fram.
\n
K\u00e4lla: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Jina \u043e\u0442\u043a\u0440\u044b\u043b\u0430 \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 Apache 2.0 \u043c\u043e\u0434\u0435\u043b\u044c \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u0432\u0435\u043a\u0442\u043e\u0440\u043d\u043e\u0433\u043e \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u0438\u044f \u0442\u0435\u043a\u0441\u0442\u0430 — jina-embeddings-v2. \u041c\u043e\u0434\u0435\u043b\u044c \u043f\u043e\u0437\u0432\u043e\u043b\u044f\u0435\u0442 \u043f\u0440\u0435\u043e\u0431\u0440\u0430\u0437\u043e\u0432\u0430\u0442\u044c \u043f\u0440\u043e\u0438\u0437\u0432\u043e\u043b\u044c\u043d\u044b\u0439 \u0442\u0435\u043a\u0441\u0442, \u0432\u043a\u043b\u044e\u0447\u0430\u044e\u0449\u0438\u0439 \u0434\u043e 8192 \u0437\u043d\u0430\u043a\u043e\u0432, \u0432 \u043d\u0435\u0431\u043e\u043b\u044c\u0448\u0443\u044e \u043f\u043e\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u044c\u043d\u043e\u0441\u0442\u044c \u0432\u0435\u0449\u0435\u0441\u0442\u0432\u0435\u043d\u043d\u044b\u0445 \u0447\u0438\u0441\u0435\u043b, \u043e\u0431\u0440\u0430\u0437\u0443\u044e\u0449\u0438\u0445 \u0432\u0435\u043a\u0442\u043e\u0440, \u0441\u043e\u043f\u043e\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u043d\u044b\u0439 \u0441 \u0438\u0441\u0445\u043e\u0434\u043d\u044b\u043c \u0442\u0435\u043a\u0441\u0442\u043e\u043c \u0438 \u0432\u043e\u0441\u043f\u0440\u043e\u0438\u0437\u0432\u043e\u0434\u044f\u0449\u0438\u0439 \u0435\u0433\u043e \u0441\u0435\u043c\u0430\u043d\u0442\u0438\u043a\u0443 (\u0441\u043c\u044b\u0441\u043b). Jina Embedding \u0441\u0442\u0430\u043b\u0430 \u043f\u0435\u0440\u0432\u043e\u0439 \u043e\u0442\u043a\u0440\u044b\u0442\u043e\u0439 \u043c\u043e\u0434\u0435\u043b\u044c\u044e \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f, \u043e\u0431\u043b\u0430\u0434\u0430\u044e\u0449\u0435\u0439 \u0445\u0430\u0440\u0430\u043a\u0442\u0435\u0440\u0438\u0441\u0442\u0438\u043a\u0430\u043c\u0438, \u043d\u0435 \u0443\u0441\u0442\u0443\u043f\u0430\u044e\u0449\u0438\u043c\u0438 \u043f\u0440\u043e\u043f\u0440\u0438\u0435\u0442\u0430\u0440\u043d\u043e\u0439 \u043c\u043e\u0434\u0435\u043b\u0438 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-111103","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Koden f\u00f6r Jina Embedding har \u00f6ppnats, en modell f\u00f6r vektorrepr\u00e4sentation av textens betydelse | ProHoster","description":"F\u00f6retaget Jina har sl\u00e4ppt en maskininl\u00e4rningsmodell f\u00f6r vektorrepr\u00e4sentation av text under licens Apache 2.0 - jina-embeddings-v2.","canonical_url":"https:\/\/prohoster.info\/sv\/blog\/news\/otkryt-kod-jina-embedding-modeli-dlya-vektornogo-predstavleniya-smysla-teksta","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sv_SE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u0442\u043a\u0440\u044b\u0442 \u043a\u043e\u0434 Jina Embedding, \u043c\u043e\u0434\u0435\u043b\u0438 \u0434\u043b\u044f \u0432\u0435\u043a\u0442\u043e\u0440\u043d\u043e\u0433\u043e \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u0438\u044f \u0441\u043c\u044b\u0441\u043b\u0430 \u0442\u0435\u043a\u0441\u0442\u0430 | ProHoster","og:description":"\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Jina \u043e\u0442\u043a\u0440\u044b\u043b\u0430 \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 Apache 2.0 \u043c\u043e\u0434\u0435\u043b\u044c \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u0432\u0435\u043a\u0442\u043e\u0440\u043d\u043e\u0433\u043e \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u0438\u044f \u0442\u0435\u043a\u0441\u0442\u0430 - jina-embeddings-v2.","og:url":"https:\/\/prohoster.info\/sv\/blog\/news\/otkryt-kod-jina-embedding-modeli-dlya-vektornogo-predstavleniya-smysla-teksta","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2023-10-26T13:10:31+00:00","article:modified_time":"2023-10-26T13:10:31+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sv\/wp-json\/wp\/v2\/posts\/111103","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sv\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sv\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sv\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sv\/wp-json\/wp\/v2\/comments?post=111103"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sv\/wp-json\/wp\/v2\/posts\/111103\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sv\/wp-json\/wp\/v2\/media?parent=111103"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sv\/wp-json\/wp\/v2\/categories?post=111103"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sv\/wp-json\/wp\/v2\/tags?post=111103"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}