Podcast "ITMO Tsvagiridzo_": nzira yekusvika nayo kuwiriranisa kwezvirimo zveAR nechiratidziro pachiyero chenhandare yese

Ichi ndicho chikamu chekutanga chezvinyorwa zvinyorwa zvebvunzurudzo yechipiri yechirongwa chedu (Apple podcasts, Yandex.Music) Nyaya Muenzi - Andrey Karsakov (kapc3d), Ph.D., muongorori mukuru paNational Center for Cognitive Research, akabatana napurofesa paFaculty of Digital Transformations.

Kubva 2012, Andrey anga achishanda muboka rekutsvagisa Visualization uye Computer Graphics. Kuita mapurojekiti makuru akashandiswa padanho renyika nepasirese. Muchikamu chino chehurukuro, tinotaura nezve ruzivo rwake mukutsigirwa kweAR kune zviitiko zveveruzhinji.

Podcast "ITMO Tsvagiridzo_": nzira yekusvika nayo kuwiriranisa kwezvirimo zveAR nechiratidziro pachiyero chenhandare yese
mufananidzo IyiInjiniya RAEng (Unsplash.com)

Mamiriro eprojekiti uye zvinangwa

Timecode (by audio versions) β€” 00:41

dmitrykabanov: Ndinoda kutanga nechirongwa cheEuropean Games. Izvo zvine-multi-component, zvikwata zvakawanda zvakatora chikamu mugadziriro, uye kupa chokwadi chakawedzerwa kune vateereri vezviuru panguva yechiitiko munhandare ibasa rakakura. Panyaya yekubatanidzwa kwako, yaive software yekutanga here?

kapc3d: Ehe, isu takaita chikamu chechirongwa uye takapa rutsigiro panguva yeshow. Zvakanga zvakafanira kutevera, kutarisa uye kutanga zvinhu zvose munguva chaiyo, uyewo kushanda neboka reterevhizheni. Kana tikafunga purojekiti iyi seyakazara, saka tinogona kutaura nezvemitambo yekuvhura nekuvhara Mitambo yeEurope muMinsk, pamwe chete nezvemhemberero yekuvhurwa kwemakwikwi WorldSkills muKazan. Yaiva chirongwa chebasa chimwe chete, asi zviitiko zvakasiyana. Pakave nemukaha wemwedzi miviri pakati pavo. Takagadzirira chirongwa ichi pamwe chete nevakomana vekambani Sechenov.com.

Takasangana navo nemukana Science Fest, iyo yakaitika mukupera kwe2018. Vadzidzi vatenzi vedu vakaratidzira chirongwa chavo chekosi pane musoro weVR. Vakomana vakauya kwatiri ndokubvunza kuti taiitei murabhoritari yedu. Zvaiita seizvi:

- Iwe unoshanda neVR, asi unogona kushanda neicho chakawedzerwa?

- Zvakanaka, hongu, hongu.

- Pane basa rakadaro, rine zvinyorwa zvekutanga zvakadaro. Unogona kuzviita here?

Vakakwenya maturnips avo zvishoma, panoratidzika kunge pasina chinhu chisingagoneke:

- Ngatiedzei kudzidza zvese kutanga, uye tozowana mhinduro.

Dmitriy: Vanongopa rutsigiro rwenhau chete here?

Andrew: Vanoita murwi wakazara. Kubva pakuona kwemanejimendi uye kurongeka, ivo vanobatanidzwa zvizere mukutungamira, kuita, kusarudzwa kwenzvimbo, logistics uye kumwe kutsigirwa kwehunyanzvi. Asi vaida kuita chimwe chinhu chakakosha paMitambo yeEurope. Aya akakosha mhedzisiro, senge chokwadi chakasanganiswa, akagadzirirwa terevhizheni kwenguva yakareba, asi haasi iwo akanyanya bhajeti-ane hushamwari maererano nehunyanzvi hwekuita. Naizvozvo, vakomana vakatsvaga dzimwe sarudzo.

Dmitriy: Ngatikurukurei dambudziko racho zvakadzama. Zvaisanganisira chii?

Andrew: Pane chiitiko. Inotora awa nehafu. Isu tinofanirwa kuve nechokwadi chekuti vateereri vanoiona vachirarama uye avo vakagara munhandare vanogona kuona iyo yakawedzerwa chaiyo mhedzisiro mukuenderana kwakazara neiyo live show maererano nenguva nenzvimbo panzvimbo.

Pakanga pane zviverengero zvakawanda zvounyanzvi. Zvakanga zvisingagoneki kuita nguva yekuwiriranisa kuburikidza neInternet, nekuti pakanga paine kutya pamusoro pemutoro wakawandisa panetiweki ine mastand akazara uye tarisiro yevakuru vehurumende vachipinda chiitiko, izvo zvaigona kukanganisa nharembozha.

Andrey Karsakov, mufananidzo kubva zvinhu kubva ITMO University
Podcast "ITMO Tsvagiridzo_": nzira yekusvika nayo kuwiriranisa kwezvirimo zveAR nechiratidziro pachiyero chenhandare yeseTaive nezvikamu zviviri zvakakosha zvepurojekiti iyi - ruzivo rwemunhu rwunogona kuwanikwa nevanhu kuburikidza nenharembozha, uye izvo zvinopinda munhepfenyuro yeterevhizheni uye zviratidziro zveruzivo munhandare pachayo.

Kana kamwe-kamwe munhu ari kuona zvikamu zveaugmented reality kuburikidza nenharembozha uye panguva imwe chete achipinda pachiratidziri, anofanira kuona mufananidzo wakafanana.

Taida masisitimu maviri akasiyana kuti anyatso wiriraniswa nenguva. Asi iyo peculiarity yezviratidziro zvakadaro ndezvekuti izvi zviitiko zvakaoma uko nhamba yakakura yehunyanzvi masevhisi inobatanidzwa uye mabasa ese anoitwa zvinoenderana nenguva macode. Kodhi yenguva inguva yakatarwa panguva iyo chimwe chinhu chinotanga: mwenje, ruzha, vanhu vanosiya, nhanho petals kuvhurwa, zvichingodaro. Taifanira kuchinjira kugadziriro ino kuitira kuti zvinhu zvose zvitange panguva yakakodzera. Chimwe chinhu chaive chekuti zviratidziro uye zvikamu zvine chokwadi chakawedzerwa zvaive zvine chekuita nescript.

Dmitriy: Asi wakafunga here kurega kushandiswa kwemakodhi enguva nekuda kwenjodzi huru dzeforce majeure, kana kuti wakamboverenga mamwe masimba emagetsi uye ukaona kuti mutoro pahurongwa hwese waizonyanya kukwira?

Andrew: Kana iwe ukaita sevhisi yekubatanidza kune vateereri vakadaro, saka hazvina kuoma zvakanyanya. Chero zvazvingava, zvikumbiro hazvikundiki kamwe chete. Hongu, mutoro wacho wakakwirira, asi haisi dambudziko. Mubvunzo ndewokuti zvakakosha here kushandisa zviwanikwa uye nguva pane izvi kana network ikangoerekana yabuda. Takanga tisina chokwadi kuti izvi hazvaizoitika. Pakupedzisira, zvese zvakashanda, nekukanganisa nekuda kwekuremerwa, asi zvakashanda, uye isu takawiriranisa zvinoenderana nekodhi yenguva zvichienderana nechirongwa chakasiyana. Iri raive rimwe rematambudziko epasi rose.

Matambudziko ekuita kubva paUX poindi yekuona

Timecode (by audio versions) β€” 10:42

Andrew: Isu taifanirawo kufunga kuti nhandare haisi nzvimbo yemakonsati ekare, uye kuwiriranisa masisitimu munzvimbo yese yemidziyo nhare. Saka, imwe nguva yapfuura ndakaenda kuhutachiona augmented reality story paEminem concerts, pakabva paita nyaya neLoboda.

mufananidzo Robert Bye (Unsplash.com)
Podcast "ITMO Tsvagiridzo_": nzira yekusvika nayo kuwiriranisa kwezvirimo zveAR nechiratidziro pachiyero chenhandare yeseAsi ichi chinogara chiri chiitiko pamberi pako - boka rese rinomira pamberi pechikuva, kuwiriranisa kuri nyore. Kana iri nhandare, iwe unofanirwa kunzwisisa kuti nderipi divi redenderedzwa rauri, nzvimbo inoenderana, kuitira kuti nhandare ikwane munzvimbo iripo munzvimbo yekuona. Yakanga iri dambudziko rakaoma. Vakaedza kuigadzirisa nenzira dzakasiyana-siyana, uye mugumisiro waiva nyaya iri pedyo neiyo yakaitwa neLoboda, asi kwete mune zvose.

Isu tinorega mushandisi kusarudza kwaari. Takaisa zviratidzo zvenhandare, umo vanhu vakasarudza chikamu, mutsara, nzvimbo. Zvese izvi muma β€œtinya” mana. Tevere taifanira kusarudza nzira yekuenda kuchikuva. Kuti tiite izvi, isu takaratidza silhouette yezvinofanira kutaridzika sechiitiko kubva pachimiro chetsika. Akaisanganisa, akarova uye ndizvozvo - danho rakagara pasi. Takaedza kurerutsa nzira iyi nepatinogona napo. Zvakadaro, 90% yevataridzi vaida kuona kuratidzwa havasi ivo vanhu vane ruzivo rwekutaurirana nechakawedzerwa chokwadi.

Dmitriy: Panga paine chikumbiro chakasiyana chechirongwa ichi here?

Andrew: Ehe, application yeIOS uye Android, yatakasundira kuchitoro. Paive nemushandirapamwe wakasiyana wekusimudzira nayo. Yakambotsanangurwa zvakadzama nzira yekurodha uye zvichingodaro.

Dmitriy: Iwe unofanirwa kunzwisisa kuti hapana nzvimbo yekuti munhu aedze muviri uye kudzidza mashandisiro akadaro. Nokudaro, basa re "kudzidzisa" vateereri rakava rakaoma zvikuru.

Andrew: Hongu Hongu. NeUX, takabata mabhampa akawanda, nekuti mushandisi anoda kuwana ruzivo mukudzvanya katatu: kudhawunirodha, kuiswa, kutangwa - kwakashanda. Vanhu vazhinji vane usimbe hwekutevera zvidzidzo zvakaoma, kuverenga zvidzidzo, nezvimwe zvakadaro. Uye isu hatina kuedza kutsanangura zvese kumushandisi zvakanyanya sezvinobvira mudzidziso: hwindo rinovhurika pano, kuwana kamera pano, zvikasadaro hazvishande, zvichingodaro. Hazvina mhosva kuti ingani tsananguro dzaunonyora, zvisinei kuti unotsenga zvakadii, zvisinei kuti unoisa zvipi, vanhu havazviverenge.

MuMinsk takaunganidza dziva guru remhinduro pane ichi chikamu, uye takatochinja zvakawanda zvekushandisa muKazan. Isu tinoisa imomo kwete chete iyo magiramufomu uye iyo nguva makodhi anoenderana nechaicho chiitiko chechokwadi chakawedzerwa, asi isu takatora ese maphonogiramu uye macode enguva mune yavo yese. Saka chikumbiro chakanzwa zvaiitika panguva yekutangwa, uye - kana munhu akapinda panguva isiriyo - yakapa ruzivo: "Comrade, ndine hurombo, chikamu chako cheAR chichava mumaminetsi gumi nemashanu."

Zvishoma nezve dhizaini uye nzira yekuyananisa

Timecode (by audio versions) β€” 16:37

Dmitriy: Wafunga here kuwiriranisa neruzha?

Andrew: Hongu, zvakaitika netsaona. Isu takanga tichitarisa kuburikidza nesarudzo uye takasangana nekambani Cifrasoft kubva kuIzhevsk. Ivo vanogadzira isina kunyanya kuomarara, asi iron-inoshanda SDK, iyo inokutendera iwe kuwiriranisa ruzha nenguva. Iyo sisitimu yakamisikidzwa kuti ishande neTV, kana iwe uchigona kuratidza chimwe chinhu muchirongwa chinoenderana neruzha rwechiziviso chine mamiriro kana kupa chiitiko chinodyidzana chakavakirwa pane bhaisikopo track.

Dmitriy: Asi chinhu chimwe - iwe wakagara muimba yako yekutandarira, uye chimwe chinhu - nhandare ine zviuru zvevanhu. Zvinhu zvakafamba sei kwauri nemhando yekurekodha ruzha uye kuzivikanwa kwayo kwakazotevera?

Andrew: Paiva nekutya kukuru uye kusava nechokwadi, asi kazhinji zvinhu zvose zvaizivikanwa zvakanaka. Ivo vanovaka masiginecha pane odhiyo track neayo ehunyanzvi algorithms - mhedzisiro inorema zvishoma pane yekutanga odhiyo faira. Kana maikorofoni ichiteerera kune yakatenderedza ruzha, inoedza kutsvaga zvinhu izvi uye kuziva track yakavakirwa pazviri. Mumamiriro ezvinhu akanaka, kurongeka kwekuenzanisa ndeye 0,1-0,2 masekondi. Izvi zvaipfuura zvakakwana. Mumamiriro ezvinhu akaipa mutsauko waisvika kumasekonzi 0,5.

Zvakawanda zvinoenderana nechishandiso. Takashanda neboka guru remidziyo. Kune maPhones kune mamodheru gumi chete. Vakashanda zvakanaka maererano nemhando uye zvimwe zvinhu. Asi neandroids zoo yakafanana naamai vangu. Kwete kwese kwakaitika kuti kuwiriranisa kwenzwi kwakashanda. Paive nezviitiko pazvaive zvisingaite kunzwa nziyo dzakasiyana pamidziyo yakasiyana nekuda kwezvimwe zvinhu. Pane imwe nzvimbo iyo yakaderera frequency inonyangarika, kumwe kwakakwirira mafambiro anotanga kuhwihwidza. Asi kana mudziyo waive neyakajairwa pamaikorofoni, kuwiriranisa kwaigara kuchishanda.

Dmitriy: Ndokumbira utiudze nezve mavakirwo - chii chakashandiswa muprojekiti?

Andrew: Isu takaita iyo application muKubatana - iyo yakapusa sarudzo maererano neakawanda-chikuva uye kushanda nemifananidzo. Inoshandiswa AR Foundation. Isu takabva tangotaura kuti isu hatidi kuomesa sisitimu, saka takazvimisira kune boka remidziyo inotsigira ARKit neARCore kuitira kuti tive nenguva yekuyedza zvese. Isu takagadzira plugin yeDigitalSoft SDK, iyo iri paGitHub yedu. Isu takagadzira yemukati manejimendi system kuitira kuti zvinyorwa zvifambe zvinoenderana nenguva.

Isu takatarisa zvishoma neiyo particle system, nekuti mushandisi anogona kupinda chero nguva mune chimwe chikamu, uye isu tinoda kuti aone zvese kubva panguva yaakawiriranisa. Isu takafunga nezve system inobvumira kuti zviratidziro zvitambwe zvakajeka nenguva, kuitira kuti iyo XNUMXD chiitiko chigone kupepetwa nekudzoka, semufirimu. Nepo ichishanda kunze kwebhokisi neakare animations, isu taifanira kuita tinker ne particle masisitimu. Pane imwe nguva, vanotanga kubereka, uye kana iwe ukazviwana iwe pane imwe nzvimbo isati yasvika, ivo havasati vaberekwa, kunyange zvazvo zvichiita sekuti vanofanira kuva. Asi dambudziko iri riri nyore kugadzirisa.

Kune iyo mobile chikamu, iyo dhizaini iri nyore. Kutepfenyura paterevhizheni zvinhu zvese zvakaoma. Takanga tine zvirambidzo zvehardware. Mutengi anoisa mamiriro: "Pano tine paki yakadai uye yakadai, tichitaura, zvese zvinoda kushanda pairi." Takabva tangotarisana nenyaya yekuti taizoshanda nekadhi rebhajeti rekutora mavhidhiyo. Asi bhajeti hazvirevi kuti ivo vakaipa.

Paive nezvirambidzo pahardware, pamakadhi ekutora vhidhiyo uye pamamiriro ekushanda - maitiro atinofanira kugamuchira mufananidzo. Capture makadhi - Blackmagic Dhizaini, yakashanda zvinoenderana neInternal keying scheme - apa ndipo panouya vhidhiyo furemu kwauri kubva kamera. Iyo kadhi ine yayo yekugadziridza chip, iyo iyo furemu inoiswawo, iyo inofanirwa kuve yakasimudzwa pamusoro peinouya. Kadhi rinovasanganisa - isu hatibate chero chimwe chinhu ipapo uye hachikanganisa furemu kubva kuvhidhiyo kamera. Anosvipa mhedzisiro kukamuri yekudzora kuburikidza nevhidhiyo inobuda. Iyi inzira yakanaka yekufukidza mazita uye zvimwe zvinhu zvakafanana, asi haina kunyatsokodzera musanganiswa chaiwo mhedzisiro nekuti pane zvakawanda zvinorambidzwa papiipi yekupa.

Dmitriy: Panyaya ye-chaiyo-nguva komputa, chinhu chinosunga, kana chimwe chinhu?

Andrew: Panyaya yehutano uye kubudirira kunoda migumisiro. Nekuti isu hatizive zvatiri kuisa mufananidzo pamusoro. Isu tinongotumira ruzivo rwemavara uye pachena pamusoro perukova rwekutanga. Mimwe mhedzisiro senge refractions, kujeka kwakaringana, uye mimwe mimvuri haigone kuwanikwa nechirongwa ichi. Kuti aite izvi, unofanira kusanganisa zvose pamwe chete. Semuenzaniso, hapana nzira yekugadzira mhedzisiro yekukanganiswa kwemhepo kubva pamoto kana inopisa asphalt. Izvo zvakafanana zvinoenda kune kuendeswa kweiyo transparency athari uchifunga iyo refractive index. Isu takatanga kugadzira zvirimo zvichibva pane izvi zvirambidzo uye takaedza kushandisa zvakakodzera maitiro.

Ona izvi zvinyorwa pa Instagram

Kuvharwa kwe II European Games muMinsk.

Nzvimbo yakagoverwa Alena Lanskaya (@alyonalanskaya) musi waChikumi 30, 2019 na3:19pm PDT

Dmitriy: Wanga uchitova nezvako zvemukati mupurojekiti yekutanga yeMitambo yeEurope?

Andrew: Kwete, nhanho huru yekuvandudzwa kwemukati yakaitwa nevakomana veSechenov.com. Vakadhirowa vavo vakadhirowa izvo zvakakosha zvemukati nemifananidzo uye zvimwe zvinhu. Uye isu takabatanidza zvese mujini, tikawedzera zvimwe mhedzisiro, takaigadzirisa kuti zvese zvishande nemazvo.

Kana tikataura nezvepombi, saka pakutepfenyura kweterevhizheni takaunganidza zvese paUnreal Engine 4. Sezvineiwo, ivo panguva iyoyo vakatanga kuwedzera maturusi avo echokwadi chakasanganiswa. Zvakazoitika kuti zvese hazvisi nyore. Kunyange iye zvino maturusi ese akabikwa, taifanira kupedza zvakawanda nemaoko. MuMinsk takashanda pane imwe tsika yekuvaka injini, ndiko kuti, takanyora zvakare zvimwe zvinhu mukati mejini kuitira kuti, semuenzaniso, tikwanise kukwevera mimvuri pamusoro pezvinhu chaizvo. Iyo vhezheni yeinjini yaive iripo panguva iyoyo yakanga isina zvinhu zvaizoita kuti izvi zviitwe pachishandiswa maturusi akajairwa. Nechikonzero ichi, vakomana vedu vakagadzira yavo yetsika musangano kuti vape zvese zvaive zvakakosha.

Mamwe nuances uye kuchinjika kune WorldSkills muKazan

Timecode (by audio versions) β€” 31:37

Dmitriy: Asi zvese izvi munguva pfupi pfupi?

Andrew: Mazuva ekupedzisira aive akaoma Kazan project, maererano neMinsk - zvakajairika. Inenge mwedzi mitanhatu yebudiriro, asi tichifunga nezvekuti vanhu vatanhatu vaibatanidzwa. Panguva imwecheteyo, takanga tichigadzira chikamu chenhare nekugadzira maturusi ekugadzira terevhizheni. Pakanga pasina kungobuda kwemifananidzo. Semuenzaniso, chirongwa chekutevera chine optics, nekuda kweizvi waifanira kugadzira zvishandiso zvako.

Dmitriy: Paive nekugadzirisa kubva kune imwe chirongwa kuenda kune imwe? Mumwedzi nehafu, zvaive zvakafanira kutora mukana wezvinoitika uye kuendesa purojekiti nezvinhu zvitsva kune saiti itsva?

Andrew: Hongu, yakanga iri yemwedzi nechidimbu. Takanga taronga zororo remavhiki maviri reboka rose mushure mechirongwa cheMinsk. Asi mushure mekuvhara, vakomana veSechenov.com vanouya ndokuti: "Zvakanaka, ngatiite Kazan ipapo." Isu takakwanisa kuzorora zvishoma, asi takachinjira kuchirongwa ichi nekukurumidza. Takapedza basa rehunyanzvi. Yakawanda yenguva yakashandiswa pane zviri mukati, nekuti kuWorldSkills takazviita zvachose, takangozvibatanidza nechikwata chekugadzira. Paingova nerunyoro chete padivi pavo. Asi zvaive nyore - pakanga pasina chikonzero chekuwedzera kudzokorora. Paunenge uchigadzira zvirimo iwe pachako, unobva waona kuti zvinoshanda sei muinjini, uye unogona kukurumidza kugadzirisa uye kuronga.


Nezve chikamu chinofamba, takafunga nezvese zvinyengeri zvataive nazvo muMinsk. Isu takagadzira dhizaini nyowani, takagadziridza zvivakwa zvishoma, takawedzera zvidzidzo, asi takaedza kuita kuti ive pfupi uye yakajeka sezvinobvira. Isu takadzikisa huwandu hwematanho emushandisi kubva pakutanga application kusvika pakuona zvirimo. Mwedzi nehafu wakakwana kupedza basa raikwana. Muvhiki nehafu takasvika panzvimbo yacho. Kwakanga kuri nyore kushanda ikoko nokuti kutonga kwose pamusoro pechirongwa chacho kwakanga kuri mumaoko evarongi, pakanga pasina chikonzero chokutsinhiranisa nemamwe makomiti. Zvakanga zviri nyore uye zviri nyore kushanda muKazan uye zvaive zvakajairika kuti pakanga paine nguva shoma.

Dmitriy: Asi wafunga kusiya nzira yekuyananisa sezvazvaive, zvichibva pakurira?

Andrew: Hongu, takaisiya nenzwi. Yakashanda zvakanaka. Sezvavanotaura, kana ikashanda, usaibate. Isu takangofunga nezve nuances yemhando yeodhiyo track. Pavakaita intro, pakaitwa chirongwa chekudzidzisa vanhu kuti vaedze mutambo usati watanga. Zvaishamisa kuti kana panguva yekutamba njanji munhandare paine kuombera kwemhepo, "rarama", sisitimu inobvumidza iwe kuwiriranisa zvakanaka neiyi track, asi kana panguva ino yakarekodhwa kuombera kwakasanganiswa ne track, ipapo iyo track haichabatiki. Manuances akadaro akaverengerwa, uye zvese zvakawiriraniswa chaizvo maererano nezwi.

PS Muchikamu chechipiri chenyaya tinotaura nezve sainzi data kuona, maitiro ekuenzanisira mune mamwe mapurojekiti, kusimudzira mutambo uye chirongwa chatenzi "Computer game yekuvandudza tekinoroji" Tichabudisa kuenderera mberi munyaya inotevera. Unogona kuteerera nekutitsigira pano:

PPS Zvichakadaro, pashanduro yeChirungu yeHabr: kunyatsotarisisa ITMO University.

Source: www.habr.com

Voeg