{"id":106128,"date":"2022-12-16T15:36:45","date_gmt":"2022-12-16T13:36:47","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki"},"modified":"2022-12-16T15:36:45","modified_gmt":"2022-12-16T13:36:47","slug":"sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","status":"publish","type":"post","link":"https:\/\/prohoster.info\/hu\/blog\/news\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","title":{"rendered":"A Stable Diffusion g\u00e9pi tanul\u00e1si rendszer zene szint\u00e9zis\u00e9re lett adapt\u00e1lva.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

A Riffusion projekt a Stable Diffusion g\u00e9pi tanul\u00e1si rendszer zenegener\u00e1l\u00e1sra adapt\u00e1lt v\u00e1ltozat\u00e1t fejleszti, amely a k\u00e9pek helyett zen\u00e9t gener\u00e1l. A zene szintetiz\u00e1lhat\u00f3 term\u00e9szetes nyelven \u00edrt sz\u00f6veges le\u00edr\u00e1s vagy javasolt minta alapj\u00e1n. A zene szintetiz\u00e1l\u00e1s\u00e1hoz sz\u00fcks\u00e9ges komponensek Python nyelven \u00edr\u00f3dtak a PyTorch keretrendszer haszn\u00e1lat\u00e1val, \u00e9s MIT licenc alatt \u00e9rhet\u0151k el. A felhaszn\u00e1l\u00f3i fel\u00fclet interf\u00e9sze TypeScript nyelven van megval\u00f3s\u00edtva, szint\u00e9n MIT licenc alatt el\u00e9rhet\u0151. A betan\u00edtott modellek a Creative ML OpenRAIL-M permissz\u00edv licenc alapj\u00e1n nyitottak, amely kereskedelmi c\u00e9l\u00fa felhaszn\u00e1l\u00e1st is megenged. <\/p>\n

A projekt \u00e9rdekes abban az \u00e9rtelemben, hogy a zene gener\u00e1l\u00e1s\u00e1hoz a \"sz\u00f6vegb\u0151l k\u00e9pre\" \u00e9s a \"k\u00e9pb\u0151l k\u00e9pre\" modelleket haszn\u00e1lja, de a k\u00e9pek helyett spektrogramokkal manipul\u00e1l. M\u00e1s sz\u00f3val, a klasszikus Stable Diffusion nem f\u00e9nyk\u00e9peken \u00e9s rajzokon, hanem spektrogramok k\u00e9pein lett betan\u00edtva, amelyek a hanghull\u00e1m frekvenci\u00e1j\u00e1nak \u00e9s amplit\u00fad\u00f3j\u00e1nak id\u0151beli v\u00e1ltoz\u00e1s\u00e1t t\u00fckr\u00f6zik. Ennek megfelel\u0151en a kimeneten is egy spektrogram keletkezik, amelyet azt\u00e1n hangz\u00f3 reprezent\u00e1ci\u00f3v\u00e1 alak\u00edtanak.

\"A<\/center> <\/p>\n

A m\u00f3dszer a megl\u00e9v\u0151 zenei kompoz\u00edci\u00f3k m\u00f3dos\u00edt\u00e1s\u00e1ra \u00e9s a zene szintetiz\u00e1l\u00e1s\u00e1ra is alkalmazhat\u00f3 mint\u00e1k alapj\u00e1n, hasonl\u00f3an az Stable Diffusion-ban v\u00e9gzett k\u00e9pm\u00f3dos\u00edt\u00e1shoz. P\u00e9ld\u00e1ul a gener\u00e1l\u00e1s sor\u00e1n spektr\u00e1lis mint\u00e1k adhat\u00f3k meg referencia st\u00edlusokkal, k\u00fcl\u00f6nb\u00f6z\u0151 st\u00edlusok kombin\u00e1lhat\u00f3k, sima \u00e1tmenetek v\u00e9gezhet\u0151k egyik st\u00edlusb\u00f3l a m\u00e1sikba, vagy a megl\u00e9v\u0151 hangok megv\u00e1ltoztat\u00e1s\u00e1ra is lehet\u0151s\u00e9gek vannak, mint p\u00e9ld\u00e1ul egyes hangszerek hanger\u0151j\u00e9nek n\u00f6vel\u00e9se, ritmusm\u00f3dos\u00edt\u00e1s \u00e9s hangszerek cser\u00e9je. A mint\u00e1k hossz\u00fa ideig tart\u00f3 kompoz\u00edci\u00f3k gener\u00e1l\u00e1s\u00e1ra is haszn\u00e1latosak, amelyek k\u00f6zel egy id\u0151ben l\u00e9v\u0151 r\u00e9szletekb\u0151l \u00e1llnak, amelyek id\u0151ben enyh\u00e9n v\u00e1ltoznak. A k\u00fcl\u00f6n gener\u00e1lt r\u00e9szletek a modell bels\u0151 param\u00e9terei k\u00f6z\u00f6tti interpol\u00e1l\u00e1ssal egy folyamatos \u00e1raml\u00e1ss\u00e1 egyes\u00fclnek.

\"A<\/center> <\/p>\n

A hang spektrum\u00e1nak l\u00e9trehoz\u00e1s\u00e1hoz Fourier ablakos transzform\u00e1ci\u00f3t alkalmaznak. Amikor a hangot a spektrumr\u00f3l \u00fajraalkotj\u00e1k, felmer\u00fcl a f\u00e1zis meghat\u00e1roz\u00e1s\u00e1nak probl\u00e9m\u00e1ja (a spektrumon csak a frekvencia \u00e9s az amplit\u00fad\u00f3 van), amelynek rekonstrukci\u00f3j\u00e1hoz a Griffin-Lim k\u00f6zel\u00edt\u00e9si algoritmust haszn\u00e1lj\u00e1k.

<\/center>
<\/center>
\n
Forr\u00e1s: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041f\u0440\u043e\u0435\u043a\u0442\u043e\u043c Riffusion \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u0435\u0442\u0441\u044f \u0432\u0430\u0440\u0438\u0430\u043d\u0442 \u0441\u0438\u0441\u0442\u0435\u043c\u044b \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f Stable Diffusion, \u0430\u0434\u0430\u043f\u0442\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0439 \u0434\u043b\u044f \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u0438 \u043c\u0443\u0437\u044b\u043a\u0438 \u0432\u043c\u0435\u0441\u0442\u043e \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439. \u041c\u0443\u0437\u044b\u043a\u0430 \u043c\u043e\u0436\u0435\u0442 \u0441\u0438\u043d\u0442\u0435\u0437\u0438\u0440\u043e\u0432\u0430\u0442\u044c\u0441\u044f \u0442\u0435\u043a\u0441\u0442\u043e\u0432\u043e\u0433\u043e \u043e\u043f\u0438\u0441\u0430\u043d\u0438\u044f \u043d\u0430 \u0435\u0441\u0442\u0435\u0441\u0442\u0432\u0435\u043d\u043d\u043e\u043c \u044f\u0437\u044b\u043a\u0435 \u0438\u043b\u0438 \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u043f\u0440\u0435\u0434\u043b\u043e\u0436\u0435\u043d\u043d\u043e\u0433\u043e \u0448\u0430\u0431\u043b\u043e\u043d\u0430. \u041a\u043e\u043c\u043f\u043e\u043d\u0435\u043d\u0442\u044b \u0434\u043b\u044f \u0441\u0438\u043d\u0442\u0435\u0437\u0430 \u043c\u0443\u0437\u044b\u043a\u0438 \u043d\u0430\u043f\u0438\u0441\u0430\u043d\u044b \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 Python \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u0444\u0440\u0435\u0439\u043c\u0432\u043e\u0440\u043a\u0430 PyTorch \u0438 \u0434\u043e\u0441\u0442\u0443\u043f\u043d\u044b \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 MIT. \u041e\u0431\u0432\u044f\u0437\u043a\u0430 \u0441 \u0438\u043d\u0442\u0435\u0440\u0444\u0435\u0439\u0441\u043e\u043c \u0440\u0435\u0430\u043b\u0438\u0437\u043e\u0432\u0430\u043d\u0430 \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 TypeScript \u0438 \u0442\u0430\u043a\u0436\u0435 \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u044f\u0435\u0442\u0441\u044f […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":106129,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-106128","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47A Stable Diffusion g\u00e9pi tanul\u00e1si rendszer zenei szint\u00e9zisre van adapt\u00e1lva | ProHoster","description":"A Riffusion projekt a Stable Diffusion g\u00e9pi tanul\u00e1si rendszer egy zenegener\u00e1l\u00e1sra, k\u00e9pek helyett val\u00f3 adapt\u00e1ci\u00f3j\u00e1t fejleszti.","canonical_url":"https:\/\/prohoster.info\/hu\/blog\/news\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"hu_HU","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0421\u0438\u0441\u0442\u0435\u043c\u0430 \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f Stable Diffusion \u0430\u0434\u0430\u043f\u0442\u0438\u0440\u043e\u0432\u0430\u043d\u0430 \u0434\u043b\u044f \u0441\u0438\u043d\u0442\u0435\u0437\u0430 \u043c\u0443\u0437\u044b\u043a\u0438 | ProHoster","og:description":"\u041f\u0440\u043e\u0435\u043a\u0442\u043e\u043c Riffusion \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u0435\u0442\u0441\u044f \u0432\u0430\u0440\u0438\u0430\u043d\u0442 \u0441\u0438\u0441\u0442\u0435\u043c\u044b \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f Stable Diffusion, \u0430\u0434\u0430\u043f\u0442\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u044b\u0439 \u0434\u043b\u044f \u0433\u0435\u043d\u0435\u0440\u0430\u0446\u0438\u0438 \u043c\u0443\u0437\u044b\u043a\u0438 \u0432\u043c\u0435\u0441\u0442\u043e \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439.","og:url":"https:\/\/prohoster.info\/hu\/blog\/news\/sistema-mashinnogo-obucheniya-stable-diffusion-adaptirovana-dlya-sinteza-muzyki","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2022-12-16T13:36:47+00:00","article:modified_time":"2022-12-16T13:36:47+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts\/106128","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/comments?post=106128"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts\/106128\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/media\/106129"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/media?parent=106128"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/categories?post=106128"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/tags?post=106128"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}