PIFu yog lub tshuab kev kawm rau kev tsim 3D qauv ntawm tus neeg raws li 2D duab

Ib pawg ntawm cov kws tshawb fawb los ntawm ntau lub tebchaws Asmeskas tau tshaj tawm ib txoj haujlwm PIB (Pixel-Aligned Implicit Function), uas tso cai rau koj siv txoj kev kawm tshuab los tsim 3D qauv ntawm tus neeg los ntawm ib lossis ntau dua ob sab duab. Lub kaw lus tso cai rau koj los tsim cov kev xaiv khaub ncaws nyuaj, xws li cov tiab pleated thiab pob taws, thiab ntau yam hairstyles, nws tus kheej rov ua kom zoo nkauj thiab cov duab hauv thaj chaw pom tsis pom hauv qhov projection los ntawm 3D qauv tsim. Txhawm rau nce qhov zoo thiab nthuav dav ntawm tus qauv 3D kawg, siv ntau cov duab los ntawm cov ces kaum sib txawv. Txoj haujlwm code yog sau hauv Python siv PyTorch lub moj khaum thiab faib los ntawm nyob rau hauv MIT daim ntawv tso cai.

PIFu - lub tshuab kev kawm rau kev tsim cov qauv 3D ntawm tus neeg raws li 2D duab

Lub neural network yog siv los ua qhov chaw rau kev tsim kho peb-dimensional layout, uas tso cai rau koj xaiv qhov zoo tshaj plaws thiab tsim cov ntsiab lus zais, pib los ntawm tus qauv uas tau kawm ntau yam ntawm cov khoom uas twb muaj lawm. Nyob rau hauv parallel, peb tes num muab ib tug algorithm rau txuam qhov tshwm sim volumetric layout nrog textures nyob rau hauv lub muab 2D dluab, uas aligns lub pixels ntawm 3D duab raws li lawv txoj hauj lwm ntawm cov khoom XNUMXD thiab generates feem ntau yuav ploj textures. Txhua daim duab tuaj yeem raug encoded convolutional neural networkrau
nto reconstruction thov architecture "Stacked hourglass", ib
architecture-based neural network yog siv rau kev ntxhib los mos sib piv CycleGAN.

PIFu - lub tshuab kev kawm rau kev tsim cov qauv 3D ntawm tus neeg raws li 2D duab

Cov qauv npaj ua tiav siv los ntawm cov kws tshawb fawb muaj muaj pub dawb rub tawm, tab sis cov ntaub ntawv nyoos siv rau kev cob qhia tseem yog tus kheej raws li kev lag luam 3D scans. Yuav siv tau los ua qhov chaw rau kev cob qhia tus kheej ntawm tus qauv 3D qauv database cov neeg los ntawm Renderpeople project.

Tau qhov twg los: opennet.ru

Ntxiv ib saib