{"id":111103,"date":"2023-10-26T15:10:31","date_gmt":"2023-10-26T13:10:31","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/otkryt-kod-jina-embedding-modeli-dlya-vektornogo-predstavleniya-smysla-teksta"},"modified":"2023-10-26T15:10:31","modified_gmt":"2023-10-26T13:10:31","slug":"otkryt-kod-jina-embedding-modeli-dlya-vektornogo-predstavleniya-smysla-teksta","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/news\/otkryt-kod-jina-embedding-modeli-dlya-vektornogo-predstavleniya-smysla-teksta","title":{"rendered":"\u00cbsht\u00eb hapur kodi Jina Embedding, modelit p\u00ebr p\u00ebrfaq\u00ebsimin vektorial t\u00eb kuptimit t\u00eb tekstit.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Kompania Jina hapi modelin e m\u00ebsimit t\u00eb makinerive p\u00ebr paraqitjen vektoriale t\u00eb tekstit n\u00ebn licenc\u00ebn Apache 2.0 \u2014 jina-embeddings-v2. Ky model lejon q\u00eb nj\u00eb tekst i zakonsh\u00ebm, i cili p\u00ebrfshin deri n\u00eb 8192 karaktere, t\u00eb transformohet n\u00eb nj\u00eb sekuenc\u00eb t\u00eb vog\u00ebl numrash real\u00eb, t\u00eb cilat formojn\u00eb nj\u00eb vektor t\u00eb lidhur me tekstin origjinal dhe q\u00eb pasqyron semantik\u00ebn e tij (kuptimin). Jina Embedding u b\u00eb modeli i par\u00eb i hapur i m\u00ebsimit t\u00eb makinerive, q\u00eb ka karakteristika q\u00eb p\u00ebrputhen me ato t\u00eb nj\u00eb modeli proprietary p\u00ebr paraqitjen vektoriale t\u00eb tekstit nga projekti OpenAI (text-embedding-ada-002), gjithashtu i aft\u00eb p\u00ebr t\u00eb p\u00ebrpunuar tekste q\u00eb num\u00ebrojn\u00eb deri n\u00eb 8192 tokene. <\/p>\n

Distanca midis dy vektor\u00ebve t\u00eb formuar mund t\u00eb p\u00ebrdoret p\u00ebr t\u00eb p\u00ebrcaktuar lidhjen semantike mes teksteve origjinale. N\u00eb praktik\u00eb, vektor\u00ebt e formuar mund t\u00eb aplikohen p\u00ebr t\u00eb analizuar ngjashm\u00ebrin\u00eb e teksteve, p\u00ebr t\u00eb organizuar k\u00ebrkimin e materialeve t\u00eb af\u00ebrta tematikisht (renditja e rezultateve sipas af\u00ebrsis\u00eb semantike), p\u00ebr t\u00eb grupuar tekstet sipas kuptimit, p\u00ebr t\u00eb krijuar rekomandime (propozimi i nj\u00eb liste t\u00eb rreshtave t\u00eb ngjash\u00ebm t\u00eb teksteve), p\u00ebr t\u00eb identifikuar anomali, p\u00ebr t\u00eb p\u00ebrcaktuar plagjiatur\u00ebn dhe p\u00ebr klasifikimin e testeve. Si shembuj t\u00eb fushave t\u00eb p\u00ebrdorimit, p\u00ebrmendet angazhimi i modelit p\u00ebr analiz\u00ebn e dokumenteve ligjore, p\u00ebr analitik\u00ebn e biznesit, n\u00eb k\u00ebrkimin mjek\u00ebsor p\u00ebr p\u00ebrpunimin e artikujve shkencor\u00eb, n\u00eb kritik\u00ebn letrare, p\u00ebr analizimin e raportet financiare dhe p\u00ebr p\u00ebrmir\u00ebsimin e cil\u00ebsis\u00eb s\u00eb p\u00ebrpunimit t\u00eb pyetjeve komplekse nga chatbot\u00ebt. <\/p>\n

P\u00ebr shkarkim jan\u00eb t\u00eb disponueshme dy variante t\u00eb modelit jina-embeddings (baza \u2014 0.27 GB dhe e shkurtuar \u2014 0.07 GB), t\u00eb trajnuara mbi 400 milion pal\u00eb sekuencash tekstuale n\u00eb anglisht, q\u00eb p\u00ebrfshijn\u00eb fusha t\u00eb ndryshme t\u00eb njohurive. Gjat\u00eb trajnimit jan\u00eb p\u00ebrdorur sekuenca me gjat\u00ebsi 512 tokene, t\u00eb cilat jan\u00eb ekstrapoluar n\u00eb p\u00ebrmasa 8192 me an\u00eb t\u00eb metod\u00ebs ALiBi (V\u00ebmendje me Ekip Linar). <\/p>\n

Modeli Bazik p\u00ebrmban 137 milion parametra dhe \u00ebsht\u00eb projektuar p\u00ebr t'u p\u00ebrdorur n\u00eb sisteme stacionare me GPU. Modeli i shkurtuar p\u00ebrmban 33 milion parametra, ofron sakt\u00ebsi m\u00eb t\u00eb ul\u00ebt dhe \u00ebsht\u00eb fokusuar n\u00eb p\u00ebrdorimin n\u00eb pajisje mobile dhe n\u00eb sisteme me memorie t\u00eb vog\u00ebl. N\u00eb t\u00eb ardhmen e af\u00ebrt, planifikohet gjithashtu publikimi i nj\u00eb modeli t\u00eb madh q\u00eb do t\u00eb p\u00ebrfshij\u00eb 435 milion parametra. Po ashtu, \u00ebsht\u00eb n\u00eb zhvillim nj\u00eb variant shum\u00ebgjuh\u00ebsh i modelit, i cili aktualisht p\u00ebrq\u00ebndrohet n\u00eb mb\u00ebshtetje t\u00eb gjermanishtes dhe spanjishtes. Nj\u00eb plugin i ve\u00e7ant\u00eb \u00ebsht\u00eb p\u00ebrgatitur p\u00ebr p\u00ebrdorimin e modelit jina-embeddings p\u00ebrmes mjetit LLM.
\n
Burimi: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Jina \u043e\u0442\u043a\u0440\u044b\u043b\u0430 \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 Apache 2.0 \u043c\u043e\u0434\u0435\u043b\u044c \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u0432\u0435\u043a\u0442\u043e\u0440\u043d\u043e\u0433\u043e \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u0438\u044f \u0442\u0435\u043a\u0441\u0442\u0430 — jina-embeddings-v2. \u041c\u043e\u0434\u0435\u043b\u044c \u043f\u043e\u0437\u0432\u043e\u043b\u044f\u0435\u0442 \u043f\u0440\u0435\u043e\u0431\u0440\u0430\u0437\u043e\u0432\u0430\u0442\u044c \u043f\u0440\u043e\u0438\u0437\u0432\u043e\u043b\u044c\u043d\u044b\u0439 \u0442\u0435\u043a\u0441\u0442, \u0432\u043a\u043b\u044e\u0447\u0430\u044e\u0449\u0438\u0439 \u0434\u043e 8192 \u0437\u043d\u0430\u043a\u043e\u0432, \u0432 \u043d\u0435\u0431\u043e\u043b\u044c\u0448\u0443\u044e \u043f\u043e\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u044c\u043d\u043e\u0441\u0442\u044c \u0432\u0435\u0449\u0435\u0441\u0442\u0432\u0435\u043d\u043d\u044b\u0445 \u0447\u0438\u0441\u0435\u043b, \u043e\u0431\u0440\u0430\u0437\u0443\u044e\u0449\u0438\u0445 \u0432\u0435\u043a\u0442\u043e\u0440, \u0441\u043e\u043f\u043e\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u043d\u044b\u0439 \u0441 \u0438\u0441\u0445\u043e\u0434\u043d\u044b\u043c \u0442\u0435\u043a\u0441\u0442\u043e\u043c \u0438 \u0432\u043e\u0441\u043f\u0440\u043e\u0438\u0437\u0432\u043e\u0434\u044f\u0449\u0438\u0439 \u0435\u0433\u043e \u0441\u0435\u043c\u0430\u043d\u0442\u0438\u043a\u0443 (\u0441\u043c\u044b\u0441\u043b). Jina Embedding \u0441\u0442\u0430\u043b\u0430 \u043f\u0435\u0440\u0432\u043e\u0439 \u043e\u0442\u043a\u0440\u044b\u0442\u043e\u0439 \u043c\u043e\u0434\u0435\u043b\u044c\u044e \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f, \u043e\u0431\u043b\u0430\u0434\u0430\u044e\u0449\u0435\u0439 \u0445\u0430\u0440\u0430\u043a\u0442\u0435\u0440\u0438\u0441\u0442\u0438\u043a\u0430\u043c\u0438, \u043d\u0435 \u0443\u0441\u0442\u0443\u043f\u0430\u044e\u0449\u0438\u043c\u0438 \u043f\u0440\u043e\u043f\u0440\u0438\u0435\u0442\u0430\u0440\u043d\u043e\u0439 \u043c\u043e\u0434\u0435\u043b\u0438 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-111103","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Kodi i Jina Embedding \u00ebsht\u00eb hapur, nj\u00eb model p\u00ebr p\u00ebrfaq\u00ebsimin vektor t\u00eb kuptimit t\u00eb tekstit | ProHoster","description":"kompania Jina hapi n\u00ebn licenc\u00ebn Apache 2.0 nj\u00eb model t\u00eb m\u00ebsimit t\u00eb makineris\u00eb p\u00ebr p\u00ebrfaq\u00ebsimin vektor t\u00eb tekstit - jina-embeddings-v2.","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/news\/otkryt-kod-jina-embedding-modeli-dlya-vektornogo-predstavleniya-smysla-teksta","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u0442\u043a\u0440\u044b\u0442 \u043a\u043e\u0434 Jina Embedding, \u043c\u043e\u0434\u0435\u043b\u0438 \u0434\u043b\u044f \u0432\u0435\u043a\u0442\u043e\u0440\u043d\u043e\u0433\u043e \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u0438\u044f \u0441\u043c\u044b\u0441\u043b\u0430 \u0442\u0435\u043a\u0441\u0442\u0430 | ProHoster","og:description":"\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Jina \u043e\u0442\u043a\u0440\u044b\u043b\u0430 \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 Apache 2.0 \u043c\u043e\u0434\u0435\u043b\u044c \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u0432\u0435\u043a\u0442\u043e\u0440\u043d\u043e\u0433\u043e \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u0438\u044f \u0442\u0435\u043a\u0441\u0442\u0430 - jina-embeddings-v2.","og:url":"https:\/\/prohoster.info\/sq\/blog\/news\/otkryt-kod-jina-embedding-modeli-dlya-vektornogo-predstavleniya-smysla-teksta","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2023-10-26T13:10:31+00:00","article:modified_time":"2023-10-26T13:10:31+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/111103","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=111103"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/111103\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=111103"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=111103"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=111103"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}