Stability AI yatulutsa makina ophunzirira makina otchedwa Stable Video Diffusion omwe amatha kupanga makanema achidule kuchokera pazithunzi. Chitsanzochi chimakulitsa luso la pulojekiti ya Stable Diffusion, yomwe poyamba inali yochepa pakupanga zithunzi zosasunthika. Khodi ya maphunziro a neural network ndi zida zopangira zithunzi zalembedwa mu Python pogwiritsa ntchito dongosolo la PyTorch ndikusindikizidwa pansi pa layisensi ya MIT. Mitundu yophunzitsidwa kale ndi yotsegulidwa pansi pa chilolezo cha Creative ML OpenRAIL-M chololeza, chololeza kugwiritsidwa ntchito pamalonda.
Pali njira ziwiri zachitsanzo zomwe zilipo kuti mutsitse: SVD (Stable Video Diffusion) yopanga mafelemu 14 okhala ndi 576x1024 kutengera chithunzi chokhazikika ndi SVD-XT popanga mafelemu 25. Ndikotheka kupanga kanema popanda kusuntha kapena kuzungulira pang'onopang'ono kwa kamera, kosapitilira masekondi 4. Kuwongolera kwachitsanzo chachindunji motengera kumasulira kwachiyankhulo chachilengedwe sikunathandizidwebe, koma mutha kukonzekera chithunzi choyambirira pogwiritsa ntchito mtundu wakale wa Stable Diffusion 2.1 ndikuchisintha kukhala kanema pogwiritsa ntchito mtundu wa SVD.
Khalidwe lakanema silimapereka chithunzithunzi choyenera komanso kuperekedwa kolondola kwa nkhope ndi anthu. Pankhani ya magwiridwe antchito, mawonekedwe otseguka omwe akufunsidwa ali patsogolo pa ma analogue amtundu wa Runway ndi Pika Labs. Chitsanzochi chikhoza kusinthidwa mosavuta kuti chithetse mavuto osiyanasiyana, mwachitsanzo, chikhoza kugwiritsidwa ntchito kupanga ziwerengero zitatu-dimensional.
Kuphatikiza apo, titha kuzindikira kusindikizidwa kwa chida chophunzirira makina cha Video-LLaVA, chomwe chimakulolani kuti mupange chiwonetsero chogwirizana cha chinthu, chopangidwa potengera kugwiritsa ntchito nthawi imodzi zithunzi ndi mavidiyo azinthu pamaphunziro. Dongosolo lingagwiritsidwe ntchito, mwachitsanzo, kuzindikira kukhalapo kwa zinthu zomwezo muzithunzi ndi makanema. Khodiyo idalembedwa mu Python ndikugawidwa pansi pa layisensi ya Apache 2.0.
Source: opennet.ru
