PIFu ndi makina ophunzirira makina opangira mtundu wa 3D wa munthu potengera zithunzi za 2D

Gulu la ofufuza ochokera ku mayunivesite angapo aku America adafalitsa ntchito PIFu (Pixel-Aligned Implicit Function), yomwe imakupatsani mwayi wogwiritsa ntchito njira zophunzirira zamakina kuti mupange mtundu wa 3D wamunthu kuchokera pa chithunzi chimodzi kapena zingapo zamitundu iwiri. Dongosololi limakupatsani mwayi wopangiranso zosankha zovuta za zovala, monga masiketi okhala ndi zidendene, ndi masiketi osiyanasiyana, ndikubwezeretsanso mawonekedwe ndi mawonekedwe m'malo osawoneka bwino momwe mtundu wa 3D umapangidwira. Kuti muwonjezere mtundu ndi tsatanetsatane wa mtundu womaliza wa 3D, zithunzi zingapo zochokera kumakona osiyanasiyana zitha kugwiritsidwa ntchito. Khodi ya polojekitiyi imalembedwa ku Python pogwiritsa ntchito dongosolo la PyTorch ndi wogawidwa ndi pansi pa layisensi ya MIT.

Neural network imagwiritsidwa ntchito ngati gwero lopangiranso mawonekedwe amitundu itatu, omwe amakulolani kuti musankhe mawonekedwe omwe angatheke ndikupanga zinthu zobisika, kuyambira pachitsanzo chophunzitsidwa pamitundu yosiyanasiyana yazinthu zomwe zilipo. Mofananamo, pulojekitiyi imapereka ndondomeko yofananitsa masanjidwe a volumetric omwe amabwera ndi mapangidwe azithunzi za 2D zomwe zimaperekedwa, zomwe zimagwirizanitsa mapikseli a chithunzi cha 3D molingana ndi malo awo pa chinthu cha XNUMXD ndikupanga mawonekedwe omwe akusowa. Chithunzi chilichonse chikhoza kusungidwa convolutional neural networkza
kukonzanso pamwamba kumagwiritsa ntchito zomangamanga "Zosanjikiza ma hourglass", a
Neural network yokhazikitsidwa ndi zomangamanga imagwiritsidwa ntchito pofananiza mawonekedwe NdondomekoGAN.

Chitsanzo chokonzekera chokonzekera chogwiritsidwa ntchito ndi ochita kafukufuku zilipo imapezeka kuti mutsitse kwaulere, koma deta yomwe imagwiritsidwa ntchito pophunzitsa imakhalabe yachinsinsi chifukwa imachokera pazithunzi zamalonda za 3D. Itha kugwiritsidwa ntchito ngati gwero lodziphunzitsira nokha lachitsanzo 3D model database anthu ochokera ku polojekiti ya Renderpeople.

Source: opennet.ru