Iyo sosi kodhi yePIXIE muchina kudzidza sisitimu yakavhurwa, ichikubvumidza iwe kugadzira 3D modhi uye animated avatars emuviri wemunhu kubva pamufananidzo mumwe. Mamiriro chaiwo ekumeso uye ezvipfeko akasiyana neanoratidzwa mumufananidzo wekutanga anogona kusungirirwa kune yakabuda modhi. Iyo sisitimu inogona kushandiswa, semuenzaniso, kupa kubva kune yakasiyana nzvimbo, kugadzira animation, kuvakazve muviri zvichienderana nechimiro chechiso, uye kugadzira 3D modhi yeminwe. Iyo kodhi yakanyorwa muPython uchishandisa iyo Pytorch chimiro uye inogoverwa pasi peiyo isiri-yekutengesa kushandisa rezinesi chete.
Zvinonzi, kana zvichienzaniswa nemapurojekiti akafanana, PIXIE inokutendera kuti unyatso kudzoreredza makondisheni emuviri, pakutanga akavanzwa nezvipfeko mumufananidzo, chimiro chechiso uye nzvimbo yemajoini emaoko. Iyo nzira yakavakirwa pakushandiswa kweneural network, iyo inobvisa maparamita echiso, muviri uye maoko kubva pamufananidzo wepixel. Basa reneural network rinobatanidzwa neakakosha controller, iyo, zvichienderana nekuongorora kwekuvhenekera, inowedzera ruzivo pamusoro pehuremu hwehuremu hwezvikamu zvakasiyana-siyana zvemuviri kusabvisa kuonekwa kwezvisizvo. Paunenge uchigadzira modhi, misiyano yeanatomical pakati pemurume nemukadzi muviri, mamiriro ekugadzirisa, kuvheneka, kutaridzika kwepamusoro uye kutenderera kwechiso mundege ine mativi matatu anotariswa.
Zvinoumba PIXIE:
- Iyo yakagadziridzwa 3D body modhi, pamwe neruzivo nezve pose, ruoko chinzvimbo uye chimiro chechiso, inochengetwa seti yeSMPL-X paramita, iyo inogona kuzoshandiswa gare gare muBlender modelling system kuburikidza neplugin.
- Kubva pamufananidzo, ruzivo rwakadzama rwakatemerwa nezve chimiro uye chimiro chechiso, pamwe nehunhu hwayo, sekuvapo kwemakwinya (iyo DECA muchina kudzidza sisitimu, yakagadziridzwa nevanyori vakafanana, inoshandiswa kugadzira musoro muenzaniso) .
- Paunenge uchigadzira chimiro chechiso, iyo albedo yechinhu inofungidzirwa.
- Iyo yakagadzirwa yemuviri modhi inogona gare gare kuve nehupenyu kana kuratidzwa mune yakasiyana pose.
- Tsigiro yekuvaka modhi kubva kune akajairwa mafoto emunhu ari mumamiriro echisikigo. PIXIE inoita basa rakanaka rekuona zvakasiyana-siyana, mamiriro ekuvhenekesa, uye kudzivirira kuonekwa kwezvikamu zvechinhu.
- Kuita kwepamusoro, kwakakodzera kushandiswa kwesimba kwemifananidzo yekamera.
Source: opennet.ru