Umthombo ovulekile we-Spleeter, uhlelo lokuhlukanisa umculo nezwi

Umhlinzeki wokusakaza u-Deezer kuvulwe Imibhalo engumthombo yephrojekthi yokuhlola i-Spleeter, ethuthukisa isistimu yokufunda yomshini yokuhlukanisa imithombo yomsindo ekuqanjweni komsindo okuyinkimbinkimbi. Uhlelo lukuvumela ukuthi ukhiphe amazwi ekwakhiweni futhi ushiye kuphela okuhambisana nomculo, ulawule umsindo wezinsimbi ngazinye, noma ulahle umculo futhi ushiye izwi ukuze limbozwe ngolunye uchungechunge lomsindo, udale amamiksi, i-karaoke noma okulotshiweyo. Ikhodi yephrojekthi ibhalwe ngePython kusetshenziswa injini ye-Tensorflow futhi isatshalaliswa ngu ngaphansi kwelayisensi ye-MIT.

Okokulayisha inikelwe amamodeli asevele aqeqeshelwe ukuhlukanisa amazwi (izwi elilodwa) ahambisanayo, kanye nokuhlukaniswa abe imifudlana engu-4 no-5, okuhlanganisa amazwi, izigubhu, ibhesi, upiyano kanye nawo wonke omunye umsindo. I-Spleeter ingasetshenziswa kokubili njengomtapo wezincwadi wePython nanjengensiza yomugqa womyalo ozimele. Esimweni esilula, ngokusekelwe kufayela lomthombo kudaliwe amafayela amabili, amane noma amahlanu anezwi nezingxenye ezihambisanayo (vocals.wav, drums.wav, bass.wav, piano.wav, other.wav).

Lapho ihlukaniswa ibe imicu engu-2 no-4, i-Spleeter inikeza ukusebenza okuphezulu kakhulu, isibonelo, uma usebenzisa i-GPU, ukuhlukanisa ifayela lomsindo libe imicu emi-4 kuthatha isikhathi esingaphansi kwezikhathi eziyi-100 kunobude bokuqanjwa kwangempela. Kusistimu ene-NVIDIA GeForce GTX 1080 GPU kanye ne-32-core Intel Xeon Gold 6134 CPU, iqoqo lokuhlola le-musDB, elithathe amahora amathathu nemizuzu engama-27, licutshungulwe ngemizuzwana engama-90.

Umthombo ovulekile we-Spleeter, uhlelo lokuhlukanisa umculo nezwi



Phakathi kwezinzuzo ze-Spleeter, uma kuqhathaniswa nezinye intuthuko emkhakheni wokuhlukaniswa komsindo, njengephrojekthi yomthombo ovulekile. Vula-Unmix, ikhuluma ngokusetshenziswa kwamamodeli ekhwalithi ephezulu akhiwe kusukela eqoqweni elibanzi lamafayela omsindo. Ngenxa yemikhawulo ye-copyright, abacwaningi bokufunda ngomshini banqunyelwe ukufinyelela emaqoqweni ambalwa omphakathi amafayela omculo, kuyilapho amamodeli e-Spleeter akhiwa kusetshenziswa idatha evela kukhathalogi enkulu yomculo ka-Deezer.

Ngu ukuqhathanisa nge-Open-Unmix, ithuluzi lokuhlukanisa le-Spleeter cishe lishesha ngo-35% uma lihlolwa ku-CPU, lisekela amafayela e-MP3, futhi likhiqiza imiphumela engcono kakhulu (izwi elilodwa ku-Open-Unmix lishiya iminonjana yamanye amathuluzi, okungenzeka kungenxa yokuthi amamodeli we-Open-Unmix aqeqeshwe eqoqweni lezingoma eziyi-150 kuphela).

Source: opennet.ru

Engeza amazwana