{"id":106128,"date":"2022-12-16T15:36:45","date_gmt":"2022-12-16T13:36:47","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki"},"modified":"2022-12-16T15:36:45","modified_gmt":"2022-12-16T13:36:47","slug":"sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","status":"publish","type":"post","link":"https:\/\/prohoster.info\/ro\/blog\/news\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","title":{"rendered":"Sistemul de \u00eenv\u0103\u021bare automat\u0103 Stable Diffusion a fost adaptat pentru sintez\u0103 muzical\u0103","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Proiectul Riffusion dezvolt\u0103 o variant\u0103 a sistemului de \u00eenv\u0103\u021bare automatizat\u0103 Stable Diffusion, adaptat\u0103 pentru generarea muzicii \u00een loc de imagini. Muzica poate fi sintetizat\u0103 din descrierea textului \u00een limbaj natural sau pe baza unui \u0219ablon propus. Componentele pentru sinteza muzicii sunt scrise \u00een limbajul Python folosind cadrul PyTorch \u0219i sunt disponibile sub licen\u021ba MIT. Interfa\u021ba este implementat\u0103 \u00een TypeScript \u0219i se distribuie, de asemenea, sub licen\u021ba MIT. Modelele antrenate sunt deschise sub licen\u021ba permisiv\u0103 Creative ML OpenRAIL-M, care permite utilizarea \u00een scopuri comerciale. <\/p>\n

Proiectul este interesant deoarece continu\u0103 s\u0103 utilizeze pentru generarea muzicii modele \u201edin text \u00een imagine\u201d \u0219i \u201edin imagine \u00een imagine\u201d, dar manipuleaz\u0103 spectrogramele ca imagini. Cu alte cuvinte, versiunea clasic\u0103 Stable Diffusion nu a fost antrenat\u0103 pe fotografii \u0219i imagini obi\u0219nuite, ci pe imagini ale spectrogramelor, care reflect\u0103 schimb\u0103rile de frecven\u021b\u0103 \u0219i amplitudine ale undei sonore \u00een timp. Astfel, la ie\u0219ire se formeaz\u0103 o spectrogram\u0103, care este apoi transformat\u0103 \u00een reprezentarea sonor\u0103.

\"Sistemul<\/center> <\/p>\n

Metoda poate fi, de asemenea, utilizat\u0103 pentru a modifica compozi\u021biile sonore existente \u0219i pentru sintetizarea muzicii pe baza unui exemplu, analog cu modificarea imaginilor \u00een Stable Diffusion. De exemplu, la generare pot fi specificate modele de spectrogram\u0103 cu un stil de referin\u021b\u0103, pot fi combinate diferite stiluri, efectuate tranzi\u021bii graduale de la un stil la altul sau pot fi realizate modific\u0103ri \u00een sunetul existent pentru a rezolva probleme precum cre\u0219terea volumului instrumentelor individuale, schimbarea ritmului \u0219i \u00eenlocuirea instrumentelor. Modelele sunt, de asemenea, utilizate pentru generarea de compozi\u021bii de lung\u0103 durat\u0103, compuse dintr-o serie de fragmente apropiate \u00eentre ele, care se schimb\u0103 pu\u021bin \u00een timp. Fragmentele generate separat sunt combinate \u00eentr-un flux continuu prin interpolarea parametrilor interni ai modelului.

\"Sistemul<\/center> <\/p>\n

Pentru a crea o spectrogram\u0103 din sunet, se folose\u0219te o transformare Fourier pe feron\u0103. La recrearea sunetului din spectrogram\u0103 apare problema determin\u0103rii fazei (pe spectrogram\u0103 exist\u0103 doar frecven\u021ba \u0219i amplitudinea), pentru refacerea c\u0103reia se folose\u0219te un algoritm de aproximare Griffin-Lim.

<\/center>
<\/center>
\n
Sursa: opennet.ro<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041f\u0440\u043e\u0435\u043a\u0442\u043e\u043c Riffusion \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u0435\u0442\u0441\u044f \u0432\u0430\u0440\u0438\u0430\u043d\u0442 \u0441\u0438\u0441\u0442\u0435\u043c\u044b \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f Stable Diffusion, \u0430\u0434\u0430\u043f\u0442\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0439 \u0434\u043b\u044f \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u0438 \u043c\u0443\u0437\u044b\u043a\u0438 \u0432\u043c\u0435\u0441\u0442\u043e \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439. \u041c\u0443\u0437\u044b\u043a\u0430 \u043c\u043e\u0436\u0435\u0442 \u0441\u0438\u043d\u0442\u0435\u0437\u0438\u0440\u043e\u0432\u0430\u0442\u044c\u0441\u044f \u0442\u0435\u043a\u0441\u0442\u043e\u0432\u043e\u0433\u043e \u043e\u043f\u0438\u0441\u0430\u043d\u0438\u044f \u043d\u0430 \u0435\u0441\u0442\u0435\u0441\u0442\u0432\u0435\u043d\u043d\u043e\u043c \u044f\u0437\u044b\u043a\u0435 \u0438\u043b\u0438 \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u043f\u0440\u0435\u0434\u043b\u043e\u0436\u0435\u043d\u043d\u043e\u0433\u043e \u0448\u0430\u0431\u043b\u043e\u043d\u0430. \u041a\u043e\u043c\u043f\u043e\u043d\u0435\u043d\u0442\u044b \u0434\u043b\u044f \u0441\u0438\u043d\u0442\u0435\u0437\u0430 \u043c\u0443\u0437\u044b\u043a\u0438 \u043d\u0430\u043f\u0438\u0441\u0430\u043d\u044b \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 Python \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u0444\u0440\u0435\u0439\u043c\u0432\u043e\u0440\u043a\u0430 PyTorch \u0438 \u0434\u043e\u0441\u0442\u0443\u043f\u043d\u044b \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 MIT. \u041e\u0431\u0432\u044f\u0437\u043a\u0430 \u0441 \u0438\u043d\u0442\u0435\u0440\u0444\u0435\u0439\u0441\u043e\u043c \u0440\u0435\u0430\u043b\u0438\u0437\u043e\u0432\u0430\u043d\u0430 \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 TypeScript \u0438 \u0442\u0430\u043a\u0436\u0435 \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u044f\u0435\u0442\u0441\u044f […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":106129,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-106128","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Sistemul de \u00eenv\u0103\u021bare automat\u0103 Stable Diffusion este adaptat pentru sintez\u0103 muzical\u0103 | ProHoster","description":"Proiectul Riffusion dezvolt\u0103 o variant\u0103 a sistemului de \u00eenv\u0103\u021bare automat\u0103 Stable Diffusion, adaptat\u0103 pentru generarea de muzic\u0103 \u00een loc de imagini.","canonical_url":"https:\/\/prohoster.info\/ro\/blog\/news\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"ro_RO","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0421\u0438\u0441\u0442\u0435\u043c\u0430 \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f Stable Diffusion \u0430\u0434\u0430\u043f\u0442\u0438\u0440\u043e\u0432\u0430\u043d\u0430 \u0434\u043b\u044f \u0441\u0438\u043d\u0442\u0435\u0437\u0430 \u043c\u0443\u0437\u044b\u043a\u0438 | ProHoster","og:description":"\u041f\u0440\u043e\u0435\u043a\u0442\u043e\u043c Riffusion \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u0435\u0442\u0441\u044f \u0432\u0430\u0440\u0438\u0430\u043d\u0442 \u0441\u0438\u0441\u0442\u0435\u043c\u044b \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f Stable Diffusion, \u0430\u0434\u0430\u043f\u0442\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0439 \u0434\u043b\u044f \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u0438 \u043c\u0443\u0437\u044b\u043a\u0438 \u0432\u043c\u0435\u0441\u0442\u043e \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439.","og:url":"https:\/\/prohoster.info\/ro\/blog\/news\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2022-12-16T13:36:47+00:00","article:modified_time":"2022-12-16T13:36:47+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/posts\/106128","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/comments?post=106128"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/posts\/106128\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/media\/106129"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/media?parent=106128"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/categories?post=106128"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/tags?post=106128"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}