{"id":182824,"date":"2026-08-11T04:54:15","date_gmt":"2026-08-11T02:54:15","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3"},"modified":"2026-08-12T18:21:41","modified_gmt":"2026-08-12T16:21:41","slug":"yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","status":"publish","type":"post","link":"https:\/\/prohoster.info\/az\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","title":{"rendered":"28,9 milyon parametrli dil modeli ESP32-S3-d\u0259 i\u015f\u0259 sal\u0131nd\u0131","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

<\/i><\/a>
\nT\u0259rtibat\u00e7\u0131 Vya\u00e7eslav Serbov, slvDev t\u0259x\u0259ll\u00fcs\u00fc il\u0259 tan\u0131n\u0131r, n\u00fcmun\u0259sini g\u00f6st\u0259rdi<\/a> ESP32-S3 mikrocontroller-d\u0259 tamamil\u0259 lokal m\u0259tn n\u0259sli. Onun yaratd\u0131\u011f\u0131 dil modeli 28,9 milyon parametr\u0259 malikdir v\u0259 server\u0259 v\u0259 ya dig\u0259r xarici hesablama resurslar\u0131na m\u00fcraci\u0259t etm\u0259d\u0259n, saniy\u0259d\u0259 t\u0259xmin\u0259n 9,9 token t\u0259qdim edir. Yarad\u0131lm\u0131\u015f q\u0131sa hekay\u0259l\u0259r qo\u015fulmu\u015f OLED ekran\u0131nda g\u00f6st\u0259rilir.<\/p>\n

 <\/p>\n

Layih\u0259 esp32-ai<\/a> ESP32-S3 N16R8 modulu \u00fcz\u0259rind\u0259 s\u0131naqdan ke\u00e7irilib, 512 KB daxili SRAM, 8 MB PSRAM v\u0259 16 MB flash yadda\u015f\u0131na malikdir. D\u00f6rd bit\u0259 kvantla\u015fd\u0131r\u0131lm\u0131\u015f model 14,9 MB yer tutur. Depozitd\u0259 C dilind\u0259 h\u0259yata ke\u00e7irilm\u0259si \u00fc\u00e7\u00fcn m\u0259nb\u0259 kodu, modelin \u00f6yr\u0259dilm\u0259si v\u0259 kvantla\u015fd\u0131r\u0131lmas\u0131 \u00fc\u00e7\u00fcn vasit\u0259l\u0259r, proqram t\u0259minat\u0131, testl\u0259r v\u0259 onun l\u00f6vh\u0259y\u0259 y\u00fckl\u0259nm\u0259si \u00fc\u00e7\u00fcn ssenaril\u0259r d\u0259rc olunub.<\/p>\n

 <\/p>\n

28,9 milyon parametrin say\u0131 adi masa\u00fcst\u00fc LLM-l\u0259rl\u0259 birba\u015fa m\u00fcqayis\u0259 edilm\u0259m\u0259lidir. Buna g\u00f6r\u0259 d\u0259 t\u0259rtibat\u00e7\u0131n\u0131n \u0259trafl\u0131 hesabat\u0131na g\u00f6r\u0259,<\/a>model, t\u0259xmin\u0259n 559 min parametrli s\u0131x hesablaman\u0131n n\u00fcv\u0259sind\u0259n, 3,1 milyon parametrli \u00e7\u0131x\u0131\u015f qat\u0131ndan v\u0259 t\u0259xmin\u0259n 25 milyon parametrli lay-lay vektor t\u0259msilinin c\u0259dv\u0259lin\u0259 ibar\u0259tdir. M\u0259hz sonuncu modelin r\u0259smi \u00f6l\u00e7\u00fcs\u00fcn\u00fcn \u0259sas hiss\u0259sini t\u0259min edir, amma h\u0259r bir tokenin n\u0259sli zaman\u0131 tamamil\u0259 i\u015fl\u0259nilmir.<\/p>\n

 <\/p>\n

Modelin saxlan\u0131lmas\u0131 \u00fc\u00e7\u00fcn \u00fc\u00e7 s\u0259viyy\u0259li yadda\u015f istifad\u0259 olunur. \u018fn \u00e7ox istifad\u0259 olunan m\u0259lumatlar daxili SRAM-da, \u00e7\u0131x\u0131\u015f qat\u0131n\u0131, KV-cache v\u0259 m\u00fcv\u0259qq\u0259ti yast\u0131qlar\u0131 PSRAM-da, 25 milyonluq c\u0259dv\u0259l is\u0259 flash yadda\u015fda qal\u0131r v\u0259 \u00fcnvan sah\u0259sin\u0259 x\u0259rit\u0259l\u0259m\u0259 vasit\u0259sil\u0259 \u0259ld\u0259 edilir. H\u0259r bir token \u00fc\u00e7\u00fcn oradan yaln\u0131z t\u0259xmin\u0259n alt\u0131 s\u0259tir oxunur, \u00fcmumi h\u0259cmi is\u0259 t\u0259xmin\u0259n 450 baytd\u0131r.<\/p>\n

 <\/p>\n

Bel\u0259 bir cihaz Google-un Gemma 3m-d\u0259 t\u0259tbiq etdiyi Per-Layer Embeddings texnologiyas\u0131na \u0259saslan\u0131r. Buna g\u00f6r\u0259 d\u0259 Google-un s\u0259n\u0259din\u0259 g\u00f6r\u0259,<\/a>PLE parametrl\u0259ri modelin i\u015f\u00e7i yadda\u015f\u0131ndan k\u0259narda saxlan\u0131la bil\u0259r v\u0259 m\u00fcxt\u0259lif qatlar\u0131n i\u015fl\u0259nm\u0259si zaman\u0131 \u00e7\u0131xar\u0131\u015f prosesin\u0259 \u0259lav\u0259 edil\u0259 bil\u0259r. esp32-ai bu yana\u015fman\u0131 mikrocontroller-in yadda\u015f hiyerarxiyas\u0131na t\u0259tbiq edir, burada s\u00fcr\u0259tli SRAM x\u00fcsusil\u0259 m\u0259hduddur.<\/p>\n

 <\/p>\n

C dilind\u0259 yaz\u0131lan ilk d\u00fczg\u00fcn icra versiyas\u0131 yaln\u0131z 0,57 tokeni saniy\u0259d\u0259 verirdi. \u00c7\u0131x\u0131\u015f qat\u0131n\u0131 PSRAM-a qoyduqdan, s\u0259kkizbitli aktivasiyalara ke\u00e7id etdikd\u0259n, iki Xtensa LX7 n\u00fcv\u0259si aras\u0131nda hesablama f\u0259aliyy\u0259tl\u0259rini paylayaraq v\u0259 dig\u0259r optimalla\u015fd\u0131rmalar il\u0259 gecikm\u0259 modelin bir add\u0131m\u0131nda 94,9 ms-y\u0259 endirildi. N\u0259tic\u0259d\u0259 \u00f6l\u00e7\u00fcl\u0259n s\u00fcr\u0259t tam n\u0259sil prosesini n\u0259z\u0259r\u0259 alaraq 9,88 token\u0259 \u00e7atd\u0131. \u0130ndi \u0259sas m\u0259hdudiyy\u0259t PSRAM-\u0131n \u00e7\u0131x\u0131\u015f qat\u0131n\u0131 oxumaq \u00fc\u00e7\u00fcn olan bant geni\u015fliyidir.<\/p>\n

 <\/p>\n

Model sintetik veril\u0259nl\u0259r bazas\u0131nda t\u0259lim ke\u00e7irilib TinyStories<\/a>, ibar\u0131ndan ibar\u0259t sad\u0259 ingilisc\u0259 hekay\u0259l\u0259rd\u0259n ibar\u0259tdir, m\u0259hdud l\u00fc\u011f\u0259t il\u0259. Buna g\u00f6r\u0259 d\u0259 c\u00fcml\u0259l\u0259ri davam etdir\u0259 v\u0259 ki\u00e7ik ba\u011fl\u0131 hekay\u0259l\u0259r yarada bilir, amma suallara cavab verm\u0259k, t\u0259limatlar\u0131 icra etm\u0259k, proqramla\u015fd\u0131rmaq v\u0259 ya faktiki bilikl\u0259ri b\u0259rpa etm\u0259k \u00fc\u00e7\u00fcn n\u0259z\u0259rd\u0259 tutulmam\u0131\u015fd\u0131r. \u0130nki\u015faf etdirici i\u015fi \u0259vv\u0259lc\u0259 mikroqontrollerin yadda\u015f modelini s\u0259m\u0259r\u0259li yerl\u0259\u015fdirm\u0259nin n\u00fcmayi\u015fi kimi g\u00f6r\u00fcr, tamamil\u0259 m\u00fcst\u0259qil bir \u00e7at-bot kimi deyil.<\/p>\n

 <\/p>\n

M\u00f6vcud s\u0259n\u0259dl\u0259rd\u0259 m\u00fc\u0259llif ayr\u0131ca vur\u011fulay\u0131r ki, esp32-ai m\u00fcst\u0259qil bir inki\u015fafd\u0131r. Layih\u0259l\u0259r llama2.c<\/a> Andrey Karpatinin 260 min parametrlik modelinin ESP32-S3-d\u0259 daha \u0259vv\u0259lki i\u015fl\u0259r kimi t\u0259qdim edilm\u0259si yaln\u0131z g\u00f6st\u0259ricil\u0259r v\u0259 \u00f6nc\u0259d\u0259n ir\u0259lil\u0259yi\u015fl\u0259rdir: kod, yoxlama n\u00f6qt\u0259l\u0259ri v\u0259 metodologiya birba\u015fa onlardan al\u0131nmay\u0131b. esp32-ai-nin ba\u015flan\u011f\u0131c kodu MIT lisenziyas\u0131 alt\u0131nda yay\u0131mlan\u0131r.<\/a>.<\/p>\n

 <\/p>\n

M\u0259nb\u0259: linux.org.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0420\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u0447\u0438\u043a \u0412\u044f\u0447\u0435\u0441\u043b\u0430\u0432 \u0421\u0435\u0440\u0431\u043e\u0432, \u0432\u044b\u0441\u0442\u0443\u043f\u0430\u044e\u0449\u0438\u0439 \u043f\u043e\u0434 \u043f\u0441\u0435\u0432\u0434\u043e\u043d\u0438\u043c\u043e\u043c slvDev, \u043f\u0440\u043e\u0434\u0435\u043c\u043e\u043d\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043b \u043f\u043e\u043b\u043d\u043e\u0441\u0442\u044c\u044e \u043b\u043e\u043a\u0430\u043b\u044c\u043d\u0443\u044e \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u044e \u0442\u0435\u043a\u0441\u0442\u0430 \u043d\u0430 \u043c\u0438\u043a\u0440\u043e\u043a\u043e\u043d\u0442\u0440\u043e\u043b\u043b\u0435\u0440\u0435 ESP32-S3. \u0421\u043e\u0437\u0434\u0430\u043d\u043d\u0430\u044f \u0438\u043c \u044f\u0437\u044b\u043a\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u0442 28,9 \u043c\u043b\u043d \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u043e\u0432 \u0438 \u0432\u044b\u0434\u0430\u0451\u0442 \u043e\u043a\u043e\u043b\u043e 9,9 \u0442\u043e\u043a\u0435\u043d\u0430 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443, \u043d\u0435 \u043e\u0431\u0440\u0430\u0449\u0430\u044f\u0441\u044c \u043a \u0441\u0435\u0440\u0432\u0435\u0440\u0443 \u0438\u043b\u0438 \u0434\u0440\u0443\u0433\u0438\u043c \u0432\u043d\u0435\u0448\u043d\u0438\u043c \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u043c \u0440\u0435\u0441\u0443\u0440\u0441\u0430\u043c. \u0421\u0433\u0435\u043d\u0435\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043a\u043e\u0440\u043e\u0442\u043a\u0438\u0435 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u044b \u0432\u044b\u0432\u043e\u0434\u044f\u0442\u0441\u044f \u043d\u0430 \u043f\u043e\u0434\u043a\u043b\u044e\u0447\u0451\u043d\u043d\u044b\u0439 OLED-\u0434\u0438\u0441\u043f\u043b\u0435\u0439.   \u041f\u0440\u043e\u0435\u043a\u0442 esp32-ai \u0438\u0441\u043f\u044b\u0442\u0430\u043d \u043d\u0430 \u043c\u043e\u0434\u0443\u043b\u0435 ESP32-S3 N16R8, \u0440\u0430\u0441\u043f\u043e\u043b\u0430\u0433\u0430\u044e\u0449\u0435\u043c […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":9,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-182824","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd4728,9 milyon parametr\u0259 malik dil modeli ESP32-S3-d\u0259 i\u015f\u0259 d\u00fc\u015fd\u00fc | ProHoster","description":".","canonical_url":"https:\/\/prohoster.info\/az\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"az_AZ","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u042f\u0437\u044b\u043a\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u0441 28,9 \u043c\u043b\u043d \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u043e\u0432 \u0437\u0430\u0440\u0430\u0431\u043e\u0442\u0430\u043b\u0430 \u043d\u0430 ESP32-S3 | ProHoster","og:description":".","og:url":"https:\/\/prohoster.info\/az\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2026-08-11T02:54:15+00:00","article:modified_time":"2026-08-12T16:21:41+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"182824","title":null,"description":null,"keywords":null,"keyphrases":{"focus":[],"additional":[]},"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-08-11 06:43:49","updated":"2026-08-11 06:43:49","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/az\/wp-json\/wp\/v2\/posts\/182824","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/az\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/az\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/az\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/az\/wp-json\/wp\/v2\/comments?post=182824"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/az\/wp-json\/wp\/v2\/posts\/182824\/revisions"}],"predecessor-version":[{"id":182897,"href":"https:\/\/prohoster.info\/az\/wp-json\/wp\/v2\/posts\/182824\/revisions\/182897"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/az\/wp-json\/wp\/v2\/media?parent=182824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/az\/wp-json\/wp\/v2\/categories?post=182824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/az\/wp-json\/wp\/v2\/tags?post=182824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}