{"id":182824,"date":"2026-08-11T04:54:15","date_gmt":"2026-08-11T02:54:15","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3"},"modified":"2026-08-12T18:21:41","modified_gmt":"2026-08-12T16:21:41","slug":"yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","title":{"rendered":"Keelemudel, millel on 28,9 miljonit parameetrit, t\u00f6\u00f6tas ESP32-S3-l.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

<\/i><\/a>
\nArendaja Viacheslav Serbov, kes esineb h\u00fc\u00fcdnimega slvDev, demonstreeris<\/a> t\u00e4iesti lokaalset tekstigeneratsiooni mikrokontrolleril ESP32-S3. Tema loodud keele mudel sisaldab 28,9 miljonit parameetrit ja genereerib umbes 9,9 tokenit sekundis, ilma serverite v\u00f5i teiste v\u00e4listest arvutusressurssidest s\u00f5ltumata. Genereeritud l\u00fchijutud kuvatakse \u00fchendatud OLED-ekraanil.<\/p>\n

 <\/p>\n

Projekt esp32-ai<\/a> katsetati ESP32-S3 N16R8 moodulil, millel on 512 KB sisseehitatud SRAM, 8 MB PSRAM ja 16 MB flash-m\u00e4lu. Nelja bitti kvantitud mudel v\u00f5tab 14,9 MB. Repos on avaldatud C keeles kirjaliku keskkonna l\u00e4htekood, koolitus- ja kvantimisvahendid, p\u00fcsivara, testid ja laadimisstsenaariumid plaadile.<\/p>\n

 <\/p>\n

Deklaritud 28,9 miljonit parameetrit ei tohiks vahetult v\u00f5rrelda tavaliste lauaarvutite LLM-i parameetrite arvuga. Vastavalt arendaja \u00fcksikasjalikule aruandele<\/a>, koosneb mudel tihedast arvutuskeerust, millel on umbes 559 tuhat parameetrit, v\u00e4ljundkihist, millel on 3,1 miljoni parameetrit ja kihtidevahelistest vektorite esindustest, millel on umbes 25 miljonit parameetrit. Just viimane tagab mudeli ametliku suuruse suure osa, kuid ei t\u00f6\u00f6deldud t\u00e4ielikult iga tokeni genereerimise ajal.<\/p>\n

 <\/p>\n

Mudeli paigutamiseks kasutatakse kolme m\u00e4lu taset. K\u00f5ige sagedamini kasutatavad andmed asuvad sisseehitatud SRAM-is, v\u00e4ljundkiht, KV-cache ja ajutised bufferid \u2013 PSRAM-is, ja 25-miljoniline tabel j\u00e4\u00e4b flash-m\u00e4llu ja on juurdep\u00e4\u00e4setav l\u00e4bi aadressiruumi kaardistamise. Iga tokeni jaoks loetakse sellest vaid umbes kuus rida kogumahus umbes 450 baiti.<\/p>\n

 <\/p>\n

See seade p\u00f5hineb Per-Layer Embeddings tehnoloogial, mille Google rakendas Gemma 3n. Vastavalt Google'i dokumentatsioonile<\/a>, v\u00f5ivad PLE parameetrid olla salvestatud mudeli t\u00f6\u00f6m\u00e4lu v\u00e4liselt ja lisatud v\u00e4ljundprotsessi k\u00e4igus, kui t\u00f6\u00f6deldakse eraldi kihte. esp32-ai-s on see l\u00e4henemine kantud mikrokontrolleri m\u00e4luhierarhiasse, kus kiire SRAM on eriti piiratud.<\/p>\n

 <\/p>\n

Esimene \u00f5igesti kirjutatud C t\u00e4itekeskkond andis ainult 0,57 tokenit sekundis. P\u00e4rast v\u00e4ljundkihti PSRAM-i paigutamist, \u00fcleminekut kaheksabitiseks aktiveerimiseks, arvutuste jaotamist kahe Xtensa LX7 tuuma vahel ning muid optimeerimisi v\u00e4henes viivitus mudeli sammu kohta 94,9 ms-ni. L\u00f5plik m\u00f5\u00f5detud kiirus saavutas 9,88 tokenit sekundis, arvestades kogu genereerimisprotsessi. Peamiseks piiranguks on n\u00fc\u00fcd PSRAM-i l\u00e4bilaskev\u00f5ime v\u00e4ljundkihti lugedes.<\/p>\n

 <\/p>\n

Mudelit \u00f5petati s\u00fcnteetilisel andmekogul TinyStories<\/a>, mis koosneb lihtsatest ingliskeelsetest lugudest piiratud s\u00f5navaraga. Seet\u00f5ttu on ta suuteline lauseid j\u00e4tkama ja v\u00e4ikeseid sidusaid lugusid looma, kuid ei ole m\u00f5eldud k\u00fcsimustele vastamiseks, juhiste t\u00e4itmiseks, programmeerimiseks v\u00f5i faktiteadlikkuse esitamiseks. Arendaja k\u00e4sitleb seda t\u00f6\u00f6d peamiselt mudeli t\u00f5husaks paigutamiseks mikrokontrolleri m\u00e4llu, mitte valmis autonoomse vestlusroboti loomisena.<\/p>\n

 <\/p>\n

Aktiivses dokumentatsioonis r\u00f5hutab autor eraldi, et esp32-ai on iseseisev arendus. Projektid llama2.c<\/a> Andrei Karpaty ja varasem 260 000 parameetri mudeli k\u00e4itamine ESP32-S3-l on toodud vaid suuniste ja eelnevate t\u00f6\u00f6de n\u00e4idistena: kood, kontrollpunktid ja meetod ei ole otseselt neist laenatud. Esp32-ai l\u00e4htekood levitatakse MIT litsentsi alusel.<\/a>.<\/p>\n

 <\/p>\n

Allikas: linux.org.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0420\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u0447\u0438\u043a \u0412\u044f\u0447\u0435\u0441\u043b\u0430\u0432 \u0421\u0435\u0440\u0431\u043e\u0432, \u0432\u044b\u0441\u0442\u0443\u043f\u0430\u044e\u0449\u0438\u0439 \u043f\u043e\u0434 \u043f\u0441\u0435\u0432\u0434\u043e\u043d\u0438\u043c\u043e\u043c slvDev, \u043f\u0440\u043e\u0434\u0435\u043c\u043e\u043d\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043b \u043f\u043e\u043b\u043d\u043e\u0441\u0442\u044c\u044e \u043b\u043e\u043a\u0430\u043b\u044c\u043d\u0443\u044e \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u044e \u0442\u0435\u043a\u0441\u0442\u0430 \u043d\u0430 \u043c\u0438\u043a\u0440\u043e\u043a\u043e\u043d\u0442\u0440\u043e\u043b\u043b\u0435\u0440\u0435 ESP32-S3. \u0421\u043e\u0437\u0434\u0430\u043d\u043d\u0430\u044f \u0438\u043c \u044f\u0437\u044b\u043a\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u0442 28,9 \u043c\u043b\u043d \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u043e\u0432 \u0438 \u0432\u044b\u0434\u0430\u0451\u0442 \u043e\u043a\u043e\u043b\u043e 9,9 \u0442\u043e\u043a\u0435\u043d\u0430 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443, \u043d\u0435 \u043e\u0431\u0440\u0430\u0449\u0430\u044f\u0441\u044c \u043a \u0441\u0435\u0440\u0432\u0435\u0440\u0443 \u0438\u043b\u0438 \u0434\u0440\u0443\u0433\u0438\u043c \u0432\u043d\u0435\u0448\u043d\u0438\u043c \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u043c \u0440\u0435\u0441\u0443\u0440\u0441\u0430\u043c. \u0421\u0433\u0435\u043d\u0435\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043a\u043e\u0440\u043e\u0442\u043a\u0438\u0435 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u044b \u0432\u044b\u0432\u043e\u0434\u044f\u0442\u0441\u044f \u043d\u0430 \u043f\u043e\u0434\u043a\u043b\u044e\u0447\u0451\u043d\u043d\u044b\u0439 OLED-\u0434\u0438\u0441\u043f\u043b\u0435\u0439.   \u041f\u0440\u043e\u0435\u043a\u0442 esp32-ai \u0438\u0441\u043f\u044b\u0442\u0430\u043d \u043d\u0430 \u043c\u043e\u0434\u0443\u043b\u0435 ESP32-S3 N16R8, \u0440\u0430\u0441\u043f\u043e\u043b\u0430\u0433\u0430\u044e\u0449\u0435\u043c […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":9,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-182824","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Keelemudel 28,9 miljoni parameetriga t\u00f6\u00f6tas ESP32-S3-l | ProHoster","description":".","canonical_url":"https:\/\/prohoster.info\/et\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u042f\u0437\u044b\u043a\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u0441 28,9 \u043c\u043b\u043d \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u043e\u0432 \u0437\u0430\u0440\u0430\u0431\u043e\u0442\u0430\u043b\u0430 \u043d\u0430 ESP32-S3 | ProHoster","og:description":".","og:url":"https:\/\/prohoster.info\/et\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2026-08-11T02:54:15+00:00","article:modified_time":"2026-08-12T16:21:41+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"182824","title":null,"description":null,"keywords":null,"keyphrases":{"focus":[],"additional":[]},"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-08-11 06:43:49","updated":"2026-08-11 06:43:49","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/182824","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=182824"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/182824\/revisions"}],"predecessor-version":[{"id":182897,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/182824\/revisions\/182897"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=182824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=182824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=182824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}