An buɗe lambar tushe na tsarin koyon injin PIXIE, yana ba ku damar ƙirƙirar ƙirar 3D da avatars masu rai na jikin ɗan adam daga hoto ɗaya. Haƙiƙanin fuskar fuska da suturar sutura waɗanda suka bambanta da waɗanda aka kwatanta a cikin hoton na asali ana iya haɗa su zuwa samfurin da aka samu. Ana iya amfani da tsarin, alal misali, don nunawa daga wani wuri daban, ƙirƙirar motsin rai, sake gina jiki bisa siffar fuska, da kuma samar da samfurin 3D na yatsunsu. An rubuta lambar a cikin Python ta amfani da tsarin Pytorch kuma ana rarraba a ƙarƙashin lasisin amfani da ba na kasuwanci kawai ba.
An bayyana cewa, idan aka kwatanta da irin wannan ayyukan, PIXIE yana ba ku damar yin daidaitattun sassa na jiki, wanda aka fara ɓoye ta tufafi a cikin hoton, siffar fuska da matsayi na haɗin gwiwar hannu. Hanyar ta dogara ne akan amfani da hanyar sadarwa na jijiyoyi, wanda ke fitar da sigogi na fuska, jiki da hannaye daga hoton pixel. Ayyukan cibiyar sadarwar jijiyoyi suna daidaitawa ta hanyar mai sarrafawa na musamman, wanda, bisa ga nazarin haske, yana ƙara bayani game da ma'auni na ma'auni na sassa daban-daban na jiki don ware gano abubuwan da ba su da kyau. Lokacin ƙirƙirar samfuri, ana la'akari da bambance-bambancen anatomical tsakanin jikin namiji da mace, sigogin matsayi, haske, haskakawa da jujjuya fuska a cikin jirgin sama mai girman uku.
Siffofin PIXIE:
- Samfurin jiki na 3D da aka sake ginawa, da kuma bayanai game da matsayi, matsayi na hannu da yanayin fuska, an ajiye su azaman saitin sigogi na SMPL-X, wanda daga baya za'a iya amfani dashi a cikin tsarin ƙirar Blender ta hanyar plugin.
- Daga cikin hoton, an ƙayyade cikakken bayani game da siffar fuska da bayyanar fuska, da kuma siffofinsa, irin su kasancewar wrinkles (tsarin ilmantarwa na na'ura na DECA, wanda masu marubuta iri ɗaya suka haɓaka, ana amfani da su don gina samfurin kai). .
- Lokacin samar da nau'in fuska, ana ƙididdige albedo na abu.
- Samfurin jikin da aka gina daga baya za a iya raye-raye ko a gabatar da shi a wani matsayi na daban.
- Taimako don gina samfuri daga hotuna na yau da kullun na mutum a cikin yanayin yanayi. PIXIE yana aiki mai kyau na gano matsayi daban-daban, yanayin haske, da kuma toshe ganuwa na sassan abu.
- Babban aiki, wanda ya dace da aiki mai ƙarfi na hotunan kamara.
source: budenet.ru