{"id":182824,"date":"2026-08-11T04:54:15","date_gmt":"2026-08-11T02:54:15","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3"},"modified":"2026-08-12T18:21:41","modified_gmt":"2026-08-12T16:21:41","slug":"yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","title":{"rendered":"Modeli gjuh\u00ebsor me 28,9 milion parametra funksionoi n\u00eb ESP32-S3","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

<\/i><\/a>
\nZhvilluesi Via\u00e7eslav Serbov, i njohur me emrin e tij t\u00eb p\u00ebrzgjedhur slvDev, demonstronte<\/a> ka krijuar nj\u00eb gjenerim plot\u00ebsisht lokal t\u00eb tekstit n\u00eb mikroprocesorin ESP32-S3. Modeli i gjuh\u00ebs i krijuar prej tij p\u00ebrmban 28.9 milion parametra dhe jep rreth 9.9 token n\u00eb sekond\u00eb, pa ndihm\u00ebn e server\u00ebve apo burimeve t\u00eb tjera jashtme t\u00eb llogaritjes. Histori t\u00eb shkurtra t\u00eb gjeneruara shfaqen n\u00eb ekranin OLED t\u00eb lidhur.<\/p>\n

 <\/p>\n

Projekti esp32-ai<\/a> \u00ebsht\u00eb testuar n\u00eb modulin ESP32-S3 N16R8, q\u00eb ka 512 KB SRAM t\u00eb integruar, 8 MB PSRAM dhe 16 MB memorie flash. Modeli i kvantizuar deri n\u00eb kat\u00ebr bit z\u00eb 14.9 MB. N\u00eb depo jan\u00eb publikuar kodet burimore t\u00eb ambientit t\u00eb ekzekutimit n\u00eb C, mjetet p\u00ebr trajnim dhe kvantizimin e modelit, firmware, teste dhe skenare p\u00ebr ngarkimin e tij n\u00eb bord.<\/p>\n

 <\/p>\n

Numri i deklaruar prej 28.9 milion parametra nuk duhet t\u00eb krahasohet drejtp\u00ebrdrejt me numrin e parametrave t\u00eb LLM-ve t\u00eb zakonshme desktop. Sipas raportit t\u00eb Detajuar t\u00eb Zhvilluesit<\/a>, modeli p\u00ebrb\u00ebhet nga nj\u00eb b\u00ebrtham\u00eb t\u00eb dendur llogarit\u00ebse me rreth 559 mij\u00eb parametra, nj\u00eb kat i daljes me 3.1 milion parametra dhe nj\u00eb tabel\u00eb p\u00ebrfaq\u00ebsuese vektoriale sipas kat\u00ebrit me rreth 25 milion parametra. Kjo e fundit siguron pjes\u00ebn kryesore t\u00eb madh\u00ebsis\u00eb formale t\u00eb modelit, por nuk p\u00ebrpunohen t\u00ebr\u00ebsisht gjat\u00eb gjenerimit t\u00eb \u00e7do tokeni.<\/p>\n

 <\/p>\n

P\u00ebr vendosjen e modelit jan\u00eb angazhuar tri nivele memorie. T\u00eb dh\u00ebnat m\u00eb shpesh t\u00eb p\u00ebrdorura ndodhen n\u00eb SRAM-in e brendsh\u00ebm, kat i daljes, KV-cache dhe buffer-et e p\u00ebrkohsh\u00ebm banojn\u00eb n\u00eb PSRAM, nd\u00ebrsa tabela prej 25 milion\u00ebsh mbetet n\u00eb memorie flash dhe \u00ebsht\u00eb e aksesueshme p\u00ebrmes mapimit n\u00eb hap\u00ebsir\u00ebn e adres\u00ebs. P\u00ebr secilin token, nga ajo lexohen vet\u00ebm rreth gjasht\u00eb rreshta me nj\u00eb v\u00ebllim total prej rreth 450 byte.<\/p>\n

 <\/p>\n

Nj\u00eb pajisje e till\u00eb bazohet n\u00eb teknologjin\u00eb Per-Layer Embeddings, e cila \u00ebsht\u00eb aplikuar nga Google n\u00eb Gemma 3n. Sipas dokumentacionit t\u00eb Google<\/a>, parametrat PLE mund t\u00eb ruhen jasht\u00eb memorie s\u00eb pun\u00ebs s\u00eb modelit dhe t\u00eb shtohet n\u00eb procesin e daljes nd\u00ebrsa p\u00ebrpunohen katet e ve\u00e7anta. N\u00eb esp32-ai ky qasje \u00ebsht\u00eb transferuar n\u00eb hierarkin\u00eb e memories s\u00eb mikroprocesorit, ku SRAM-i i shpejt\u00eb \u00ebsht\u00eb ve\u00e7an\u00ebrisht i kufizuar.<\/p>\n

 <\/p>\n

Versioni e par\u00eb korrekte e shkruar n\u00eb C t\u00eb mjedisit t\u00eb ekzekutimit jepte vet\u00ebm 0.57 tokena n\u00eb sekond\u00eb. Pas vendosjes s\u00eb shtres\u00ebs dal\u00ebse n\u00eb PSRAM, kalimit n\u00eb aktivizime 8-bit\u00ebshe, shp\u00ebrndarjes s\u00eb llogaritjeve midis dy b\u00ebrthamave Xtensa LX7 dhe optimizimeve t\u00eb tjera, vonesa u ul n\u00eb 94.9 ms p\u00ebr hapin e modelit. Shpejt\u00ebsia p\u00ebrfundimtare e matur arriti n\u00eb 9.88 tokena n\u00eb sekond\u00eb duke marr\u00eb parasysh procesin e plot\u00eb t\u00eb gjenerimit. Kufizimi kryesor tani ishte kapaciteti i leximit t\u00eb PSRAM-it n\u00eb lidhje me shtres\u00ebn dal\u00ebse.<\/p>\n

 <\/p>\n

Modeli \u00ebsht\u00eb st\u00ebrvitur mbi nj\u00eb set t\u00eb dh\u00ebnash sintetik TinyStories<\/a>, q\u00eb p\u00ebrmban tregime t\u00eb thjeshta n\u00eb anglisht me nj\u00eb fjalor t\u00eb kufizuar. Prandaj, ajo \u00ebsht\u00eb n\u00eb gjendje t\u00eb vazhdoj\u00eb fraza dhe t\u00eb p\u00ebrb\u00ebj\u00eb histori t\u00eb vogla t\u00eb lidhura, por nuk \u00ebsht\u00eb e destinuar p\u00ebr t\u00eb p\u00ebrgjigjur pyetjeve, p\u00ebr t\u00eb p\u00ebrmbushur udh\u00ebzime, p\u00ebr programim ose p\u00ebr t\u00eb riprodhuar njohuri faktike. Zhvilluesi e shikon pun\u00ebn kryesisht si nj\u00eb demonstrim t\u00eb vendosjes efikase t\u00eb modelit n\u00eb memorien e mikro-kontrollerit dhe jo si nj\u00eb chatbot autonom t\u00eb gatsh\u00ebm.<\/p>\n

 <\/p>\n

N\u00eb dokumentacionin aktual, autori ve\u00e7on qart\u00eb se esp32-ai \u00ebsht\u00eb nj\u00eb zhvillim i pavarur. Projektet llama2.c<\/a> t\u00eb Andrei Karpathy dhe nisja m\u00eb e hershme e modelit 260,000-parameter n\u00eb ESP32-S3 p\u00ebrmenden vet\u00ebm si pik\u00eb referimi dhe shembuj t\u00eb pun\u00ebve paraprake: kodi, pikat e kontrollit dhe metodologjia p\u00ebrkat\u00ebse nuk jan\u00eb marr\u00eb drejtp\u00ebrdrejt prej tyre. Kodi burimor i esp32-ai distribuohet n\u00ebn licenc\u00ebn MIT<\/a>.<\/p>\n

 <\/p>\n

Burimi: linux.org.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0420\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u0447\u0438\u043a \u0412\u044f\u0447\u0435\u0441\u043b\u0430\u0432 \u0421\u0435\u0440\u0431\u043e\u0432, \u0432\u044b\u0441\u0442\u0443\u043f\u0430\u044e\u0449\u0438\u0439 \u043f\u043e\u0434 \u043f\u0441\u0435\u0432\u0434\u043e\u043d\u0438\u043c\u043e\u043c slvDev, \u043f\u0440\u043e\u0434\u0435\u043c\u043e\u043d\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043b \u043f\u043e\u043b\u043d\u043e\u0441\u0442\u044c\u044e \u043b\u043e\u043a\u0430\u043b\u044c\u043d\u0443\u044e \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u044e \u0442\u0435\u043a\u0441\u0442\u0430 \u043d\u0430 \u043c\u0438\u043a\u0440\u043e\u043a\u043e\u043d\u0442\u0440\u043e\u043b\u043b\u0435\u0440\u0435 ESP32-S3. \u0421\u043e\u0437\u0434\u0430\u043d\u043d\u0430\u044f \u0438\u043c \u044f\u0437\u044b\u043a\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u0442 28,9 \u043c\u043b\u043d \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u043e\u0432 \u0438 \u0432\u044b\u0434\u0430\u0451\u0442 \u043e\u043a\u043e\u043b\u043e 9,9 \u0442\u043e\u043a\u0435\u043d\u0430 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443, \u043d\u0435 \u043e\u0431\u0440\u0430\u0449\u0430\u044f\u0441\u044c \u043a \u0441\u0435\u0440\u0432\u0435\u0440\u0443 \u0438\u043b\u0438 \u0434\u0440\u0443\u0433\u0438\u043c \u0432\u043d\u0435\u0448\u043d\u0438\u043c \u0432\u044b\u0447\u0438\u0441\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u043c \u0440\u0435\u0441\u0443\u0440\u0441\u0430\u043c. \u0421\u0433\u0435\u043d\u0435\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043a\u043e\u0440\u043e\u0442\u043a\u0438\u0435 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u044b \u0432\u044b\u0432\u043e\u0434\u044f\u0442\u0441\u044f \u043d\u0430 \u043f\u043e\u0434\u043a\u043b\u044e\u0447\u0451\u043d\u043d\u044b\u0439 OLED-\u0434\u0438\u0441\u043f\u043b\u0435\u0439.   \u041f\u0440\u043e\u0435\u043a\u0442 esp32-ai \u0438\u0441\u043f\u044b\u0442\u0430\u043d \u043d\u0430 \u043c\u043e\u0434\u0443\u043b\u0435 ESP32-S3 N16R8, \u0440\u0430\u0441\u043f\u043e\u043b\u0430\u0433\u0430\u044e\u0449\u0435\u043c […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":9,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-182824","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Modeli gjuh\u00ebsor me 28.9 milion parametra funksionon n\u00eb ESP32-S3 | ProHoster","description":".","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u042f\u0437\u044b\u043a\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u0441 28,9 \u043c\u043b\u043d \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u043e\u0432 \u0437\u0430\u0440\u0430\u0431\u043e\u0442\u0430\u043b\u0430 \u043d\u0430 ESP32-S3 | ProHoster","og:description":".","og:url":"https:\/\/prohoster.info\/sq\/blog\/news\/yazykovaya-model-s-289-mln-parametrov-zarabotala-na-esp32-s3","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2026-08-11T02:54:15+00:00","article:modified_time":"2026-08-12T16:21:41+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"182824","title":null,"description":null,"keywords":null,"keyphrases":{"focus":[],"additional":[]},"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-08-11 06:43:49","updated":"2026-08-11 06:43:49","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/182824","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=182824"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/182824\/revisions"}],"predecessor-version":[{"id":182897,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/182824\/revisions\/182897"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=182824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=182824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=182824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}