Khodi yochokera pamakina ophunzirira makina a PIXIE yatsegulidwa, kukulolani kuti mupange mitundu ya 3D ndi ma avatar ojambula a thupi la munthu kuchokera pa chithunzi chimodzi. Maonekedwe enieni a nkhope ndi zovala zomwe zimasiyana ndi zomwe zikuwonetsedwa pachithunzi choyambirira zitha kulumikizidwa ku mtundu womwe watsatira. Dongosololi lingagwiritsidwe ntchito, mwachitsanzo, kupereka kuchokera kumalo osiyanasiyana, kupanga makanema ojambula, kumanganso thupi potengera mawonekedwe a nkhope, ndikupanga mtundu wa 3D wa zala. Khodiyo imalembedwa mu Python pogwiritsa ntchito dongosolo la Pytorch ndipo imagawidwa pansi pa chilolezo chosagwiritsa ntchito malonda.
Zimanenedwa kuti, poyerekeza ndi mapulojekiti ofanana, PIXIE imakulolani kuti muthe kukonzanso zozungulira za thupi, zomwe poyamba zimabisika ndi zovala pa chithunzi, mawonekedwe a nkhope ndi malo a ziwalo za manja. Njirayi imachokera pakugwiritsa ntchito neural network, yomwe imatulutsa magawo a nkhope, thupi ndi manja kuchokera pa chithunzi cha pixel. Ntchito ya neural network imayendetsedwa ndi woyang'anira wapadera, yemwe, potengera kuwunika kwa kuunikira, amawonjezera chidziwitso chokhudza ma coefficients olemetsa a magawo osiyanasiyana a thupi kuti asazindikire mawonekedwe osakhala achilengedwe. Popanga chitsanzo, kusiyana kwa anatomical pakati pa thupi lachimuna ndi lachikazi, magawo a kaimidwe, kuunikira, kuwonetsetsa pamwamba ndi kuzungulira kwa nkhope mu ndege yamagulu atatu amaganiziridwa.
Zochitika za PIXIE:
- Chitsanzo cha thupi la 3D chomangidwanso, komanso chidziwitso chokhudza maonekedwe, malo a manja ndi maonekedwe a nkhope, zimasungidwa ngati magawo a SMPL-X, omwe pambuyo pake angagwiritsidwe ntchito mu dongosolo lachitsanzo la Blender kudzera pa plugin.
- Kuchokera pachithunzichi, chidziwitso chatsatanetsatane chimatsimikiziridwa za mawonekedwe ndi maonekedwe a nkhope, komanso mawonekedwe ake, monga kukhalapo kwa makwinya (makina ophunzirira makina a DECA, opangidwa ndi olemba omwewo, amagwiritsidwa ntchito popanga chitsanzo chamutu) .
- Popanga mawonekedwe a nkhope, albedo ya chinthucho imayesedwa.
- Thupi lopangidwa limatha kusinthidwa kapena kuperekedwa mwanjira ina.
- Thandizo lomanga chitsanzo kuchokera ku zithunzi wamba za munthu wachilengedwe. PIXIE imagwira ntchito yabwino yozindikira mawonekedwe osiyanasiyana, kuyatsa, ndi kulepheretsa mawonekedwe a chinthu.
- Kuchita bwino kwambiri, koyenera kusinthidwa kwazithunzi za kamera.
Source: opennet.ru