{"id":182824,"date":"2026-08-11T04:54:15","date_gmt":"2026-08-11T02:54:15","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3"},"modified":"2026-08-12T18:21:41","modified_gmt":"2026-08-12T16:21:41","slug":"yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sk\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","title":{"rendered":"Jazykov\u00fd model s 28,9 mili\u00f3na parametrov pracoval na ESP32-S3","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

<\/i><\/a>
\nV\u00fdvoj\u00e1r Viacheslav Serbov, vystupuj\u00faci pod pseudonymom slvDev, predviedol<\/a> \u00faplne lok\u00e1lnu gener\u00e1ciu textu na mikrokontrol\u00e9ri ESP32-S3. Vytvoren\u00fd jazykov\u00fd model obsahuje 28,9 mili\u00f3na parametrov a generuje pribli\u017ene 9,9 tokenov za sekundu, bez pr\u00edstupu na server alebo in\u00e9 extern\u00e9 v\u00fdpo\u010dtov\u00e9 zdroje. Vygenerovan\u00e9 kr\u00e1tke pr\u00edbehy sa zobrazuj\u00fa na pripojenom OLED displeji.<\/p>\n

 <\/p>\n

Projekt esp32-ai<\/a> bol testovan\u00fd na module ESP32-S3 N16R8 s 512 kB zabudovanej SRAM, 8 MB PSRAM a 16 MB flash pam\u00e4te. Kvantizovan\u00fd do \u0161tyroch bitov model zaber\u00e1 14,9 MB. V repozit\u00e1ri s\u00fa publikovan\u00e9 zdrojov\u00e9 k\u00f3dy vykon\u00e1vacej prostredia v C, n\u00e1stroje na u\u010denie a kvantiz\u00e1ciu modelu, firmv\u00e9r, testy a sc\u00e9nare jeho nahr\u00e1vania na dosku.<\/p>\n

 <\/p>\n

Zverejnen\u00fdch 28,9 mili\u00f3na parametrov by sa nemalo priamo porovn\u00e1va\u0165 s po\u010dtom parametrov be\u017en\u00fdch desktopov\u00fdch LLM. Pod\u013ea podrobnej spr\u00e1vy v\u00fdvoj\u00e1ra<\/a>, model pozost\u00e1va z hust\u00e9ho v\u00fdpo\u010dtov\u00e9ho jadra s pribli\u017ene 559 tis\u00edc parametrami, v\u00fdstupnej vrstvy s 3,1 mili\u00f3nmi parametrov a tabu\u013eky po vrstven\u00fdch vektorov\u00fdch predstaveniam s pribli\u017ene 25 mili\u00f3nmi parametrov. Pr\u00e1ve t\u00e1to posledn\u00e1 zais\u0165uje v\u00e4\u010d\u0161inu form\u00e1lnej ve\u013ekosti modelu, ale nie je spracovan\u00e1 cel\u00e1 pri generovan\u00ed ka\u017ed\u00e9ho tokenu.<\/p>\n

 <\/p>\n

Na umiestnenie modelu sa vyu\u017e\u00edvaj\u00fa tri \u00farovne pam\u00e4te. Naj\u010dastej\u0161ie pou\u017e\u00edvan\u00e9 d\u00e1ta sa nach\u00e1dzaj\u00fa v internej SRAM, v\u00fdstupn\u00e1 vrstva, KV-cache a do\u010dasn\u00e9 buffery \u2014 v PSRAM, zatia\u013e \u010do 25-mili\u00f3nov\u00e1 tabu\u013eka zost\u00e1va vo flash pam\u00e4ti a je dostupn\u00e1 cez zobrazenie v adresnom priestore. Pre ka\u017ed\u00fd token sa z nej \u010d\u00edta len pribli\u017ene \u0161es\u0165 riadkov s celkov\u00fdm objemom pribli\u017ene 450 bajtov.<\/p>\n

 <\/p>\n

Toto zariadenie je zalo\u017een\u00e9 na technol\u00f3gii Per-Layer Embeddings, aplikovanej Googlom v Gemma 3n. Pod\u013ea dokument\u00e1cie Googlu<\/a>, PLE-parametre m\u00f4\u017eu by\u0165 ulo\u017een\u00e9 mimo pracovnej pam\u00e4te modelu a prid\u00e1van\u00e9 do procesu v\u00fdstupu po\u010das spracovania jednotliv\u00fdch vrstiev. V esp32-ai je tento pr\u00edstup prenesen\u00fd na hierarchiu pam\u00e4te mikrokontrol\u00e9ra, kde je r\u00fdchla SRAM obzvl\u00e1\u0161\u0165 obmedzen\u00e1.<\/p>\n

 <\/p>\n

Prv\u00e1 spr\u00e1vna verzia prostredia C pre vykon\u00e1vanie k\u00f3du poskytovala len 0,57 tokena za sekundu. Po presunut\u00ed v\u00fdstupnej vrstvy do PSRAM, prechode na osembitov\u00e9 aktiv\u00e1cie, rozdelen\u00ed v\u00fdpo\u010dtov medzi dva jadr\u00e1 Xtensa LX7 a \u010fal\u0161\u00edch optimaliz\u00e1ci\u00e1ch sa oneskorenie zn\u00ed\u017eilo na 94,9 ms na krok modelu. Kone\u010dn\u00e1 meran\u00e1 r\u00fdchlos\u0165 dosiahla 9,88 tokena za sekundu pri zoh\u013eadnen\u00ed cel\u00e9ho procesu generovania. Hlavn\u00fdm obmedzen\u00edm sa teraz stala \u0161\u00edrka p\u00e1sma PSRAM pri \u010d\u00edtan\u00ed v\u00fdstupnej vrstvy.<\/p>\n

 <\/p>\n

Model bol vy\u0161kolen\u00fd na syntetickom d\u00e1tovom s\u00fabore TinyStories<\/a>, skladaj\u00facom sa z jednoduch\u00fdch anglicky p\u00edsan\u00fdch pr\u00edbehov s obmedzen\u00fdm slovn\u00edkom. Preto dok\u00e1\u017ee pokra\u010dova\u0165 vo fr\u00e1zach a vytv\u00e1ra\u0165 mal\u00e9 s\u00favisl\u00e9 pr\u00edbehy, ale nie je ur\u010den\u00fd na odpovedanie na ot\u00e1zky, vykon\u00e1vanie pokynov, programovanie alebo reprodukovanie skuto\u010dn\u00fdch znalost\u00ed. V\u00fdvoj\u00e1r pova\u017euje pr\u00e1cu predov\u0161etk\u00fdm za demon\u0161tr\u00e1ciu efekt\u00edvneho umiestnenia modelu do pam\u00e4te mikrokontrol\u00e9ra, a nie ako pripraven\u00e9ho samostatn\u00e9ho chatbotu.<\/p>\n

 <\/p>\n

V aktu\u00e1lnej dokument\u00e1cii autor osobitne zd\u00f4raz\u0148uje, \u017ee esp32-ai je samostatn\u00fd projekt. Projekty llama2.c<\/a> Andreyho Karpaty a sk\u00f4r spusten\u00fd model s 260 000 parametrami na ESP32-S3 s\u00fa uveden\u00e9 iba ako orienta\u010dn\u00e9 body a pr\u00edklady predch\u00e1dzaj\u00facich pr\u00e1c: k\u00f3d, kontroln\u00e9 body a metodika nie s\u00fa priamo prevzat\u00e9 z nich. Zdrojov\u00fd k\u00f3d esp32-ai je \u0161\u00edren\u00fd pod licenciou MIT<\/a>.<\/p>\n

 <\/p>\n

Zdroj: linux.org.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0420\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u0447\u0438\u043a \u0412\u044f\u0447\u0435\u0441\u043b\u0430\u0432 \u0421\u0435\u0440\u0431\u043e\u0432, \u0432\u044b\u0441\u0442\u0443\u043f\u0430\u044e\u0449\u0438\u0439 \u043f\u043e\u0434 \u043f\u0441\u0435\u0432\u0434\u043e\u043d\u0438\u043c\u043e\u043c slvDev, \u043f\u0440\u043e\u0434\u0435\u043c\u043e\u043d\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043b \u043f\u043e\u043b\u043d\u043e\u0441\u0442\u044c\u044e \u043b\u043e\u043a\u0430\u043b\u044c\u043d\u0443\u044e \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u044e \u0442\u0435\u043a\u0441\u0442\u0430 \u043d\u0430 \u043c\u0438\u043a\u0440\u043e\u043a\u043e\u043d\u0442\u0440\u043e\u043b\u043b\u0435\u0440\u0435 ESP32-S3. \u0421\u043e\u0437\u0434\u0430\u043d\u043d\u0430\u044f \u0438\u043c \u044f\u0437\u044b\u043a\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u0442 28,9 \u043c\u043b\u043d \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u043e\u0432 \u0438 \u0432\u044b\u0434\u0430\u0451\u0442 \u043e\u043a\u043e\u043b\u043e 9,9 \u0442\u043e\u043a\u0435\u043d\u0430 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443, \u043d\u0435 \u043e\u0431\u0440\u0430\u0449\u0430\u044f\u0441\u044c \u043a \u0441\u0435\u0440\u0432\u0435\u0440\u0443 \u0438\u043b\u0438 \u0434\u0440\u0443\u0433\u0438\u043c \u0432\u043d\u0435\u0448\u043d\u0438\u043c \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u043c \u0440\u0435\u0441\u0443\u0440\u0441\u0430\u043c. \u0421\u0433\u0435\u043d\u0435\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043a\u043e\u0440\u043e\u0442\u043a\u0438\u0435 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u044b \u0432\u044b\u0432\u043e\u0434\u044f\u0442\u0441\u044f \u043d\u0430 \u043f\u043e\u0434\u043a\u043b\u044e\u0447\u0451\u043d\u043d\u044b\u0439 OLED-\u0434\u0438\u0441\u043f\u043b\u0435\u0439.   \u041f\u0440\u043e\u0435\u043a\u0442 esp32-ai \u0438\u0441\u043f\u044b\u0442\u0430\u043d \u043d\u0430 \u043c\u043e\u0434\u0443\u043b\u0435 ESP32-S3 N16R8, \u0440\u0430\u0441\u043f\u043e\u043b\u0430\u0433\u0430\u044e\u0449\u0435\u043c […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":9,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-182824","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Jazykov\u00fd model s 28,9 mili\u00f3na parametrami fungoval na ESP32-S3 | ProHoster","description":".","canonical_url":"https:\/\/prohoster.info\/sk\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sk_SK","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u042f\u0437\u044b\u043a\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u0441 28,9 \u043c\u043b\u043d \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u043e\u0432 \u0437\u0430\u0440\u0430\u0431\u043e\u0442\u0430\u043b\u0430 \u043d\u0430 ESP32-S3 | ProHoster","og:description":".","og:url":"https:\/\/prohoster.info\/sk\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2026-08-11T02:54:15+00:00","article:modified_time":"2026-08-12T16:21:41+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"182824","title":null,"description":null,"keywords":null,"keyphrases":{"focus":[],"additional":[]},"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-08-11 06:43:49","updated":"2026-08-11 06:43:49","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/posts\/182824","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/comments?post=182824"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/posts\/182824\/revisions"}],"predecessor-version":[{"id":182897,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/posts\/182824\/revisions\/182897"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/media?parent=182824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/categories?post=182824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sk\/wp-json\/wp\/v2\/tags?post=182824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}