Ikhodi yomthombo yesistimu yokufunda yomshini we-PIXIE ivuliwe, okukuvumela ukuthi udale amamodeli e-3D nama-avatar agqwayizayo womzimba womuntu esithombeni esisodwa. Ukwakheka kwangempela kobuso nezingubo ezihlukile kulezo ezivezwe esithombeni sokuqala zinganamathiselwa kumodeli ewumphumela. Isistimu ingasetshenziswa, ngokwesibonelo, ukuze inikeze kusuka endaweni ehlukile, ukudala ukugqwayiza, ukwakha kabusha umzimba ngokusekelwe ekumeni kobuso, nokwenza imodeli ye-3D yeminwe. Ikhodi ibhalwe nge-Python kusetshenziswa uhlaka lwe-Pytorch futhi isakazwa ngaphansi kwelayisensi yokusetshenziswa okungezona ezohwebo kuphela.
Kuthiwa, uma kuqhathaniswa namaphrojekthi afanayo, i-PIXIE ikuvumela ukuthi udale kabusha ngokunembe kakhudlwana ama-contours omzimba, ekuqaleni afihlwe izingubo ezisesithombeni, ukuma kobuso kanye nokuma kwamalunga ezandla. Indlela isekelwe ekusetshenzisweni kwenethiwekhi ye-neural, ekhipha imingcele yobuso, umzimba nezandla esithombeni sephikseli. Umsebenzi wenethiwekhi ye-neural uhlanganiswa yisilawuli esikhethekile, esisekelwe ekuhlaziyeni ukukhanya, sengeza ulwazi mayelana nama-coefficients anesisindo ezingxenyeni ezihlukahlukene zomzimba ukuze kukhishwe ukutholwa kokuma okungezona ezemvelo. Lapho udala imodeli, umehluko we-anatomical phakathi komzimba wesilisa nowesifazane, imingcele yokuma, ukukhanya, ukukhanya okungaphezulu nokujikeleza kobuso endizeni enezinhlangothi ezintathu kuyacatshangelwa.
Izici ze-PIXIE:
- Imodeli yomzimba we-3D eyakhiwe kabusha, kanye nolwazi mayelana nokuma, ukuma kwesandla nesimo sobuso, ilondolozwe njengesethi yamapharamitha e-SMPL-X, angasetshenziswa kamuva ohlelweni lokumodela lwe-Blender nge-plugin.
- Kusukela esithombeni, ulwazi oluningiliziwe lunqunywa mayelana nokuma nokubonakaliswa kobuso, kanye nezici zayo, ezifana nokuba khona kwemibimbi (uhlelo lokufunda lomshini we-DECA, olwakhiwe ngababhali abafanayo, lusetshenziselwa ukwakha imodeli yekhanda) .
- Uma udala ukuthungwa kobuso, i-albedo yento iyalinganiselwa.
- Imodeli yomzimba eyakhiwe kamuva ingagqwayiza noma yethulwe ngendlela ehlukile.
- Ukusekela ukwakha imodeli kusuka ezithombeni ezijwayelekile zomuntu osesimweni semvelo. I-PIXIE yenza umsebenzi omuhle wokuthola ukuma okuhlukile, izimo zokukhanyisa, nokuvimbela ukubonakala kwezingxenye zento.
- Ukusebenza okuphezulu, kulungele ukucubungula okuguquguqukayo kwezithombe zekhamera.
Source: opennet.ru
