Open source for Spleeter, dongosolo lolekanitsa nyimbo ndi mawu

Wothandizira akukhamukira Deezer anatsegula Zolemba zochokera ku polojekiti yoyeserera ya Spleeter, yomwe imapanga makina ophunzirira makina olekanitsa magwero amawu ndi nyimbo zovuta. Pulogalamuyi imakupatsani mwayi wochotsa mawu pakupanga ndikusiya nyimbo zokha, kuwongolera phokoso la zida zapadera, kapena kutaya nyimbo ndikusiya mawuwo kuti aphimbe ndi nyimbo zina, kupanga zosakaniza, karaoke kapena zolembedwa. Khodi ya polojekitiyi idalembedwa ku Python pogwiritsa ntchito injini ya Tensorflow ndi wogawidwa ndi pansi pa layisensi ya MIT.

Potsitsa zoperekedwa zitsanzo zophunzitsidwa kale zolekanitsa mawu (mawu amodzi) kuchokera kumayendedwe, komanso kugawa mu 4 ndi 5 mitsinje, kuphatikizapo mawu, ng'oma, bass, piyano ndi zina zonse. Spleeter itha kugwiritsidwa ntchito ngati laibulale ya Python komanso ngati chida choyimira mzere wamalamulo. Mwachidule, kutengera fayilo yoyambira adalengedwa mafayilo awiri, anayi kapena asanu okhala ndi mawu ndi zigawo zotsagana (vocals.wav, drums.wav, bass.wav, piano.wav, other.wav).

Pogawanika mu ulusi wa 2 ndi 4, Spleeter imapereka ntchito yapamwamba kwambiri, mwachitsanzo, pogwiritsa ntchito GPU, kugawa fayilo ya audio mu ulusi wa 4 kumatenga nthawi yocheperapo 100 kusiyana ndi nthawi ya zolemba zoyambirira. Pa makina okhala ndi NVIDIA GeForce GTX 1080 GPU ndi 32-core Intel Xeon Gold 6134 CPU, kusonkhanitsa kwa mayeso a musDB, komwe kunatenga maola atatu ndi mphindi 27, kudakonzedwa mumasekondi 90.

Zina mwazabwino za Spleeter, poyerekeza ndi zomwe zikuchitika pagawo la kulekana kwa audio, monga polojekiti yotseguka. Open-Unmix, imatchula za kugwiritsa ntchito zitsanzo zamtundu wapamwamba zomwe zimamangidwa kuchokera kumagulu ochuluka a mafayilo amawu. Chifukwa cha ziletso za kukopera, ofufuza ophunzirira pamakina amangokhala ndi mwayi wopeza mafayilo anyimbo ochepa, pomwe mitundu ya Spleeter idapangidwa pogwiritsa ntchito zidziwitso zochokera kugulu lalikulu la nyimbo la Deezer.

Ndi kuyerekezera ndi Open-Unmix, chida cholekanitsa cha Spleeter chimakhala cha 35% mwachangu poyesedwa pa CPU, imathandizira mafayilo a MP3, ndipo imapanga zotsatira zabwinoko (mawu amodzi mu Open-Unmix amasiya zida zina, zomwe mwina ndi chifukwa chakuti Mitundu ya Open-Unmix imaphunzitsidwa pagulu la nyimbo 150 zokha).

Source: opennet.ru