I-Zyphra ikhuphe ukukhutshwa kwe-beta yokuqala ye-Zonos intetho ye-AI imodeli ye-AI phantsi kwelayisensi ye-Apache 2.0. I-toolkit enikezelwa kunye nomzekelo isekela umsebenzi we-cloning yezwi, ovumela imodeli ukuba idibanise intetho kwilizwi elifunwayo, apho kwanele ukubonelela ngokurekhoda kwereferensi ye-30 yentetho yesithethi. Ukuhlanganiswa kwesiNgesi, isiJapan, isiTshayina, isiFrentshi kunye nesiJamani kuyaxhaswa.
Imodeli igubungela i-1.6 yeebhiliyoni zeeparamitha kwaye yaqeqeshwa kwiiyure ezingamawaka angama-200 zokurekhodwa komsindo. I-synthesis ye-monotonous (njengakwii-audiobooks) kunye nentetho yeemvakalelo (njengencoko ephilayo) iyaxhaswa, kunye ne-synthesis esekelwe kwisimaphambili esinikiweyo (ukurekhodwa komsindo kunye nesiqalo sentetho kunikezelwa, ngesiseko apho imodeli idibanisa ukuqhubeka kwesicatshulwa esichaziweyo, ukuvelisa kwakhona iimpawu zokuqala zentetho, umzekelo, ukuqhubeka nokuthetha ngokuhlebeza).
Isiphumo sivelisa isandi kunye nesampulu yesampulu ye-44kHz. Inkxaso ibonelelwa ngokufakela ukufakwa okuhlanganisiweyo ukulinganisa iintetho zesithethi ezininzi okanye ukwakha iingxoxo ezisebenzisanayo, kunye nokongeza iileyibhile ukulawula izinga lentetho, isandi, kunye nokubonakaliswa kweemvakalelo ezifana novuyo, uloyiko, usizi kunye nomsindo.
Ngokwabaphuhlisi, umgangatho wentetho eveliswayo ulingana okanye uphezulu kuzo zonke iinkqubo ezifumaneka esidlangalaleni ezivulekileyo kunye nezorhwebo (uvavanyo lubonelela ngokuthelekisa ne-ElevenLabs, Cartesia kunye neFishSpeech). Phakathi kwezinto ezingalunganga, ukugxininiswa okuphezulu kwezixhobo zomsindo, ezifana nokukhwehlela, ukuphefumla izandi okanye i-creaking, kuphawulwe ekuqaleni okanye ekupheleni kwesixhobo somsindo owenziweyo.
- Zonos:
- ElevenLabs:
- ICartesia:
- Intetho yentlanzi v1.5:
Ukusebenzisa imodeli kwisistim yakho, umfanekiso osele ulungele ukusetyenziswa wenkqubo ye-Docker ulungisiwe, obandakanya ujongano lwewebhu lokulawula i-synthesis, esekelwe kwiqonga leGradio. Ukuqalisa, faka ngokulula umfanekiso usebenzisa umyalelo “git clone https://github.com/Zyphra/Zonos.git; cd Zonos; docker qamba phezulu" kwaye uvule iphepha elithi "http://localhost:7860" kwisikhangeli. Ukusebenza, kuyacetyiswa ukuba ubuncinane ube ne-NVIDIA GPU ye-3000 series kunye ne-6 GB yememori yevidiyo. I-RTX 4090 GPU inikezela kabini ukusebenza okufunekayo kwi-synthesis yexesha langempela.
umthombo: opennet.ru
