{"id":182824,"date":"2026-08-11T04:54:15","date_gmt":"2026-08-11T02:54:15","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3"},"modified":"2026-08-11T04:54:15","modified_gmt":"2026-08-11T02:54:15","slug":"yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","title":{"rendered":"28,9 miljoni parameetriga keelemudel t\u00f6\u00f6tab ESP32-S3-l","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

<\/i><\/a>
1 <\/p>\n

Arendaja Vyacheslav Serbov, kes esindab end pseudon\u00fc\u00fcmi slvDev all, haavatavust, mis v\u00f5imaldas r\u00fcndajal k\u00e4ivitada oma koodi serveripoolel api.wordpress.org.<\/a> on t\u00e4ielikult kohaliku teksti genereerimine mikrokontrolleril ESP32-S3. Tema loodud keelemudel sisaldab 28,9 miljonit parameetrit ja genereerib umbes 9,9 tokenit sekundis, ilma serverite v\u00f5i teiste v\u00e4liste arvutusressurssideta. Generatsioonitud l\u00fchilood kuvatakse \u00fchendatud OLED-ekraanil.<\/p>\n

<\/noindex> <\/p>\n

Projekt esp32-ai<\/a> katsetatud ESP32-S3 N16R8 moodulil, millel on 512 KB sisseehitatud SRAM, 8 MB PSRAM ja 16 MB v\u00e4lk m\u00e4lu. Neli bitti kvantitud mudel v\u00f5tab 14,9 MB. Repositooriumis on avaldatud C keele t\u00e4itevkeskkonna allikas, mudeli koolitamise ja kvantimise vahendid, p\u00fcsivara, testid ja stsenaariumid selle plaadile laadimiseks.<\/p>\n

<\/noindex> <\/p>\n

Kavandatud 28,9 miljonit parameetrit ei tohiks otseselt v\u00f5rrelda tavaliste arvutite LLM-de parameetrite arvuga. Vastavalt arendaja \u00fcksikasjalikule raportile<\/a>, mudel koosneb tihedast arvutuslikust tuumast, kus on umbes 559 tuhat parameetrit, v\u00e4ljundkihist, kus on 3,1 miljonit parameetrit, ja tasanditevaheliste vektorite esituste tabelist, kus on umbes 25 miljonit parameetrit. Just viimane tagab mudeli ametliku suuruse peamise osa, kuid ei t\u00f6\u00f6delda t\u00e4ielikult iga tokeni genereerimisel.<\/p>\n

<\/noindex> <\/p>\n

Mudeli paigutamiseks kasutatakse kolme taseme m\u00e4lu. K\u00f5ige sagedamini kasutatavad andmed asuvad sisemises SRAM-is, v\u00e4ljundkiht, KV-cache ja ajutised puBufferid \u2013 PSRAM-is, samas kui 25-miljoniline tabel j\u00e4\u00e4b v\u00e4lk m\u00e4llu ja on saadaval aadressiruumi kaudu. Iga tokeni jaoks loetakse sellest ainult umbes kuus rida, mille kogumaht on umbes 450 baiti.<\/p>\n

<\/p>\n

Selline seade p\u00f5hineb tehnoloogial Per-Layer Embeddings, mida Google rakendas Gemma 3n-is. Vastavalt Google'i dokumentatsioonile<\/a>, PLE-parameetreid saab salvestada mudeli t\u00f6\u00f6m\u00e4lu v\u00e4lja ja lisada v\u00e4ljundprotsessi k\u00e4igus, kui t\u00f6\u00f6tatakse l\u00e4bi individuaalsete kihtide. esp32-ai on see l\u00e4henemine viidud mikrokontrolleri m\u00e4luhierarhiasse, kus kiire SRAM on eriti piiratud.<\/p>\n

<\/noindex> <\/p>\n

Esimene \u00f5ige versioon C-interpreterist andis vaid 0,57 tokenit sekundis. P\u00e4rast v\u00e4ljundkihi paigutamist PSRAM-i, \u00fcleminekut kaheksabitiseks aktiveerimiseks, arvutiste jagamist kahe Xtensa LX7 tuuma vahel ning muid optimeerimisi v\u00e4henes viivitus mudeli sammu kohta 94,9 ms-ni. L\u00f5plik m\u00f5\u00f5detud kiirus saavutas 9,88 tokenit sekundis, arvestades kogu genereerimisprotsessi. Peamine piirang on n\u00fc\u00fcd PSRAM-i ribalaius v\u00e4ljundkihi lugemisel.<\/p>\n

<\/p>\n

Mudelit on koolitatud s\u00fcnteetilise andmekogumi peal TinyStories<\/a>, mis koosneb lihtsatest ingliskeelsetest lugudest piiratud s\u00f5navaraga. Seet\u00f5ttu suudab see j\u00e4tkata lauseid ja luua v\u00e4ikeseid sidusaid lugusid, kuid ei ole m\u00f5eldud k\u00fcsimustele vastamiseks, juhiste t\u00e4itmiseks, programmeerimiseks v\u00f5i faktiteadmiste edastamiseks. Arendaja peab t\u00f6\u00f6d eelk\u00f5ige efektiivse mudeli paigutamise demonstreerimiseks mikroprotsessori m\u00e4llu, mitte valmis iseseisva juturoboti loomiseks.<\/p>\n

<\/noindex> <\/p>\n

Ajakohases dokumentatsioonis r\u00f5hutab autor eraldi, et esp32-ai on iseseisev arendus. Projektid llama2.c<\/a> Andrei Karpaty ja varasema 260 000 parameetriga mudeli k\u00e4itamine ESP32-S3-l on toodud vaid suuniste ja eelnevate t\u00f6\u00f6de n\u00e4idetena: kood, kontrollpunktid ja meetodid ei ole otse neist laenatud. esp32-ai allikas levitatakse MIT litsentsi alusel<\/a>.<\/p>\n

<\/noindex><\/p>\n

Allikas: linux.org.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

1 \u0420\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u0447\u0438\u043a \u0412\u044f\u0447\u0435\u0441\u043b\u0430\u0432 \u0421\u0435\u0440\u0431\u043e\u0432, \u0432\u044b\u0441\u0442\u0443\u043f\u0430\u044e\u0449\u0438\u0439 \u043f\u043e\u0434 \u043f\u0441\u0435\u0432\u0434\u043e\u043d\u0438\u043c\u043e\u043c slvDev, \u043f\u0440\u043e\u0434\u0435\u043c\u043e\u043d\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043b \u043f\u043e\u043b\u043d\u043e\u0441\u0442\u044c\u044e \u043b\u043e\u043a\u0430\u043b\u044c\u043d\u0443\u044e \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u044e \u0442\u0435\u043a\u0441\u0442\u0430 \u043d\u0430 \u043c\u0438\u043a\u0440\u043e\u043a\u043e\u043d\u0442\u0440\u043e\u043b\u043b\u0435\u0440\u0435 ESP32-S3. \u0421\u043e\u0437\u0434\u0430\u043d\u043d\u0430\u044f \u0438\u043c \u044f\u0437\u044b\u043a\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u0442 28,9 \u043c\u043b\u043d \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u043e\u0432 \u0438 \u0432\u044b\u0434\u0430\u0451\u0442 \u043e\u043a\u043e\u043b\u043e 9,9 \u0442\u043e\u043a\u0435\u043d\u0430 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443, \u043d\u0435 \u043e\u0431\u0440\u0430\u0449\u0430\u044f\u0441\u044c \u043a \u0441\u0435\u0440\u0432\u0435\u0440\u0443 \u0438\u043b\u0438 \u0434\u0440\u0443\u0433\u0438\u043c \u0432\u043d\u0435\u0448\u043d\u0438\u043c \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u043c \u0440\u0435\u0441\u0443\u0440\u0441\u0430\u043c. \u0421\u0433\u0435\u043d\u0435\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043a\u043e\u0440\u043e\u0442\u043a\u0438\u0435 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u044b \u0432\u044b\u0432\u043e\u0434\u044f\u0442\u0441\u044f \u043d\u0430 \u043f\u043e\u0434\u043a\u043b\u044e\u0447\u0451\u043d\u043d\u044b\u0439 OLED-\u0434\u0438\u0441\u043f\u043b\u0435\u0439. \u041f\u0440\u043e\u0435\u043a\u0442 esp32-ai \u0438\u0441\u043f\u044b\u0442\u0430\u043d \u043d\u0430 \u043c\u043e\u0434\u0443\u043b\u0435 ESP32-S3 N16R8, \u0440\u0430\u0441\u043f\u043e\u043b\u0430\u0433\u0430\u044e\u0449\u0435\u043c […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":9,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-182824","post","type-post","status-publish","format-standard","hentry","category-novosti-interneta"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Keeltemudel, millel on 28,9 miljonit parameetrit, t\u00f6\u00f6tab ESP32-S3 peal | ProHoster","description":"","canonical_url":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u042f\u0437\u044b\u043a\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u0441 28,9 \u043c\u043b\u043d \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u043e\u0432 \u0437\u0430\u0440\u0430\u0431\u043e\u0442\u0430\u043b\u0430 \u043d\u0430 ESP32-S3 | ProHoster","og:url":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2026-08-11T02:54:15+00:00","article:modified_time":"2026-08-11T02:54:15+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/182824","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=182824"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/182824\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=182824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=182824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=182824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}