{"id":106128,"date":"2022-12-16T15:36:45","date_gmt":"2022-12-16T13:36:47","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki"},"modified":"2022-12-16T15:36:45","modified_gmt":"2022-12-16T13:36:47","slug":"sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/news\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","title":{"rendered":"The Stable Diffusion machine learning system has been adapted for music synthesis.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Projekti Riffusion po zhvillon nj\u00eb version t\u00eb sistemit t\u00eb m\u00ebsimit t\u00eb makinerive Stable Diffusion, t\u00eb p\u00ebrshtatur p\u00ebr t\u00eb gjeneruar muzik\u00eb n\u00eb vend t\u00eb imazheve. Muzika mund t\u00eb sintetizohet nga nj\u00eb p\u00ebrshkrim tekstual n\u00eb gjuh\u00ebn natyrore ose nga nj\u00eb model i propozuar. Komponent\u00ebt p\u00ebr sintez\u00ebn e muzik\u00ebs jan\u00eb shkruar n\u00eb gjuh\u00ebn Python duke p\u00ebrdorur korniz\u00ebn PyTorch dhe jan\u00eb n\u00eb dispozicion n\u00ebn licenc\u00ebn MIT. Nd\u00ebrfaqja \u00ebsht\u00eb implementuar n\u00eb gjuh\u00ebn TypeScript dhe gjithashtu shp\u00ebrndahet n\u00ebn licenc\u00ebn MIT. Modelet e trajnuara jan\u00eb t\u00eb hapura sipas nj\u00eb licenc\u00eb permissive Creative ML OpenRAIL-M, e cila lejon p\u00ebrdorimin p\u00ebr q\u00ebllime komerciale. <\/p>\n

Projekti \u00ebsht\u00eb interesant sepse vazhdon t\u00eb p\u00ebrdor\u00eb modele p\u00ebr gjenerimin e muzik\u00ebs \"nga teksti n\u00eb imazh\" dhe \"nga imazhi n\u00eb imazh\", por manipulon spektrogramet si imazhe. N\u00eb fjal\u00eb t\u00eb tjera, Stable Diffusion klasik \u00ebsht\u00eb st\u00ebrvitur jo n\u00eb fotografi dhe pamje, por n\u00eb imazhe spektrogramesh q\u00eb reflektojn\u00eb ndryshimin e frekuenc\u00ebs dhe amplitud\u00ebs s\u00eb val\u00ebs s\u00eb z\u00ebrit me kalimin e koh\u00ebs. Si rrjedhoj\u00eb, edhe rezultati formohet si spektrogram, i cili m\u00eb pas kthehet n\u00eb nj\u00eb p\u00ebrfaq\u00ebsim t\u00eb z\u00ebrit.

\"The<\/center> <\/p>\n

Metoda gjithashtu mund t\u00eb p\u00ebrdoret p\u00ebr t\u00eb ndryshuar kompozitat ekzistuese t\u00eb z\u00ebrave dhe p\u00ebr t\u00eb sintetizuar muzik\u00eb sipas nj\u00eb modeli, me analogji me modifikimin e imazheve n\u00eb Stable Diffusion. P\u00ebr shembull, gjat\u00eb gjenerimit, mund t\u00eb jepen mostra spektrogramesh me nj\u00eb stil referenc\u00eb, t\u00eb kombinohen stil t\u00eb ndrysh\u00ebm, t\u00eb realizohet nj\u00eb kalim i but\u00eb nga nj\u00eb stil n\u00eb tjetrin ose t\u00eb b\u00ebhen ndryshime n\u00eb nj\u00eb z\u00eb ekzistues p\u00ebr t\u00eb zgjidhur detyra si rritja e volumit t\u00eb instrumenteve t\u00eb ve\u00e7anta, ndryshimi i ritmit dhe z\u00ebvend\u00ebsimi i instrumenteve. Mostrat gjithashtu p\u00ebrdoren p\u00ebr t\u00eb gjeneruar kompozita q\u00eb luajn\u00eb gjat\u00eb, t\u00eb p\u00ebrb\u00ebr\u00eb nga nj\u00eb seri fragmentesh q\u00eb jan\u00eb af\u00ebr nj\u00ebri-tjetrit, duke u ndryshuar pak me kalimin e koh\u00ebs. Fragmentet q\u00eb gjenerohen ve\u00e7mas bashkohen n\u00eb nj\u00eb rrjedh\u00eb t\u00eb vazhdueshme p\u00ebrmes interpolimit t\u00eb parametrave t\u00eb brendsh\u00ebm t\u00eb modelit.

\"The<\/center> <\/p>\n

P\u00ebr krijimin e nj\u00eb spektrogrami nga z\u00ebri p\u00ebrdoret transformimi i Furierit me dritare. Kur rikrijohet z\u00ebri nga spektrogrami, lind problemi i p\u00ebrcaktimit t\u00eb faz\u00ebs (n\u00eb spektrogram \u00ebsht\u00eb vet\u00ebm frekuenca dhe amplituda), p\u00ebr rikonstruktimin e s\u00eb cil\u00ebs angazhohet algoritmi i aproksimimit t\u00eb Griffin-Lim.

<\/center>
<\/center>
\n
Burimi: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041f\u0440\u043e\u0435\u043a\u0442\u043e\u043c Riffusion \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u0435\u0442\u0441\u044f \u0432\u0430\u0440\u0438\u0430\u043d\u0442 \u0441\u0438\u0441\u0442\u0435\u043c\u044b \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f Stable Diffusion, \u0430\u0434\u0430\u043f\u0442\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0439 \u0434\u043b\u044f \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u0438 \u043c\u0443\u0437\u044b\u043a\u0438 \u0432\u043c\u0435\u0441\u0442\u043e \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439. \u041c\u0443\u0437\u044b\u043a\u0430 \u043c\u043e\u0436\u0435\u0442 \u0441\u0438\u043d\u0442\u0435\u0437\u0438\u0440\u043e\u0432\u0430\u0442\u044c\u0441\u044f \u0442\u0435\u043a\u0441\u0442\u043e\u0432\u043e\u0433\u043e \u043e\u043f\u0438\u0441\u0430\u043d\u0438\u044f \u043d\u0430 \u0435\u0441\u0442\u0435\u0441\u0442\u0432\u0435\u043d\u043d\u043e\u043c \u044f\u0437\u044b\u043a\u0435 \u0438\u043b\u0438 \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u043f\u0440\u0435\u0434\u043b\u043e\u0436\u0435\u043d\u043d\u043e\u0433\u043e \u0448\u0430\u0431\u043b\u043e\u043d\u0430. \u041a\u043e\u043c\u043f\u043e\u043d\u0435\u043d\u0442\u044b \u0434\u043b\u044f \u0441\u0438\u043d\u0442\u0435\u0437\u0430 \u043c\u0443\u0437\u044b\u043a\u0438 \u043d\u0430\u043f\u0438\u0441\u0430\u043d\u044b \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 Python \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u0444\u0440\u0435\u0439\u043c\u0432\u043e\u0440\u043a\u0430 PyTorch \u0438 \u0434\u043e\u0441\u0442\u0443\u043f\u043d\u044b \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 MIT. \u041e\u0431\u0432\u044f\u0437\u043a\u0430 \u0441 \u0438\u043d\u0442\u0435\u0440\u0444\u0435\u0439\u0441\u043e\u043c \u0440\u0435\u0430\u043b\u0438\u0437\u043e\u0432\u0430\u043d\u0430 \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 TypeScript \u0438 \u0442\u0430\u043a\u0436\u0435 \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u044f\u0435\u0442\u0441\u044f […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":106129,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-106128","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Sistemi i m\u00ebsimit t\u00eb automatizuar Stable Diffusion \u00ebsht\u00eb p\u00ebrshtatur p\u00ebr sintez\u00ebn e muzik\u00ebs | ProHoster","description":"Projekti Riffusion zhvillon nj\u00eb variant t\u00eb sistemit t\u00eb m\u00ebsimit t\u00eb automatizuar Stable Diffusion, t\u00eb p\u00ebrshtatur p\u00ebr t\u00eb gjeneruar muzik\u00eb n\u00eb vend t\u00eb imazheve.","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/news\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0421\u0438\u0441\u0442\u0435\u043c\u0430 \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f Stable Diffusion \u0430\u0434\u0430\u043f\u0442\u0438\u0440\u043e\u0432\u0430\u043d\u0430 \u0434\u043b\u044f \u0441\u0438\u043d\u0442\u0435\u0437\u0430 \u043c\u0443\u0437\u044b\u043a\u0438 | ProHoster","og:description":"\u041f\u0440\u043e\u0435\u043a\u0442\u043e\u043c Riffusion \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u0435\u0442\u0441\u044f \u0432\u0430\u0440\u0438\u0430\u043d\u0442 \u0441\u0438\u0441\u0442\u0435\u043c\u044b \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f Stable Diffusion, \u0430\u0434\u0430\u043f\u0442\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0439 \u0434\u043b\u044f \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u0438 \u043c\u0443\u0437\u044b\u043a\u0438 \u0432\u043c\u0435\u0441\u0442\u043e \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439.","og:url":"https:\/\/prohoster.info\/sq\/blog\/news\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2022-12-16T13:36:47+00:00","article:modified_time":"2022-12-16T13:36:47+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/106128","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=106128"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/106128\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media\/106129"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=106128"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=106128"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=106128"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}