Vhura kodhi yeanimation synthesis uchishandisa neural network

Boka revaongorori kubva kuShanghai Technical University yakabudiswa zvishandiso Kutevedzera, iyo inobvumira kushandisa nzira dzekudzidza muchina kutevedzera mafambiro evanhu vachishandisa mifananidzo isingachinji, pamwe nekutsiva mbatya, kudziendesa kune imwe nharaunda uye kuchinja kona iyo chinhu chinoonekwa. Iyo kodhi yakanyorwa muPython
kushandisa framework PyTorch. Gungano rinodawo torchvision uye CUDA Toolkit.

Iyo kiti yezvishandiso inogashira mufananidzo wemativi maviri sekuisa uye inogadzirisa mhedzisiro yakagadziridzwa zvichibva pane yakasarudzwa modhi. Sarudzo nhatu dzekushandura dzinotsigirwa:
Kugadzira chinhu chinofamba chinotevera mafambiro ayo muenzaniso wakadzidziswa. Kutamisa zvinhu zvekuonekwa kubva kumuenzaniso kuenda kune chinhu (somuenzaniso, kuchinja kwembatya). Chizvarwa chekona nyowani (semuenzaniso, synthesis yemufananidzo wakavakirwa pamufananidzo wakazara-chiso). Idzi nzira nhatu dzinogona kusanganiswa, semuenzaniso, iwe unogona kugadzira vhidhiyo kubva pamufananidzo unoteedzera kuita kweakaomarara acrobatic trick mune dzakasiyana zvipfeko.

Munguva yemaitiro ekubatanidza, mashandiro ekusarudza chinhu mupikicha uye kugadzira zvisipo zvekumashure zvinhu kana uchifamba unoitwa panguva imwe chete. Iyo neural network modhi inogona kudzidziswa kamwe uye kushandiswa kune akasiyana shanduko. Zvekurodha inowanikwa akagadzirira-akagadzirwa modhi iyo inokutendera iwe kuti ushandise nekukurumidza maturusi pasina kudzidziswa kwekutanga. GPU ine saizi yekurangarira ingangoita 8GB inodiwa kuti ishande.

Kusiyana nenzira dzekushandura dzinobva pakushandurwa nemapoinzi akakosha anotsanangura nzvimbo yemuviri munzvimbo ine mativi maviri, Mutevedzeri anoedza kubatanidza mesh ine mativi matatu netsananguro yemuviri uchishandisa nzira dzekudzidza muchina.
Iyo yakarongwa nzira inobvumira manipulations achifunga nezvemunhu chimiro chemuviri uye chimiro chazvino, kutevedzera echisikigo mafambiro emakumbo.

Kuchengetedza ruzivo rwekutanga senge maumbirwo, chimiro, mavara uye kuzivikanwa kwechiso panguva yekuchinja maitiro, generative adversarial neural network (Liquid Warping GAN) Ruzivo rwechibviro chechinhu uye ma parameter ekuzivikanwa kwayo anotorwa nekushandisa convolutional neural network.

Source: opennet.ru