Podcast "ITMO Research_": momwe mungayandikire kulumikizana kwa zomwe zili mu AR ndi chiwonetsero chamasewera onse

Ili ndi gawo loyamba lazolemba za kuyankhulana kwachiwiri kwa pulogalamu yathu (Ma Podcasts a Apple, Yandex.Music). Nkhani Mlendo - Andrey Karsakov (kapc3d), Ph.D., wofufuza wamkulu ku National Center for Cognitive Research, pulofesa wothandizira pa Faculty of Digital Transformations.

Kuyambira 2012, Andrey wakhala akugwira ntchito mu gulu lofufuza la Visualization and Computer Graphics. Amagwira ntchito zazikulu zogwiritsidwa ntchito kumayiko ndi mayiko. Mu gawo ili la zokambirana, tikukamba za zomwe adakumana nazo mu chithandizo cha AR pazochitika zapagulu.

Podcast "ITMO Research_": momwe mungayandikire kulumikizana kwa zomwe zili mu AR ndi chiwonetsero chamasewera onse
chithunzi Izi ndiEngineering RAEng (Unsplash.com)

Zolinga za polojekiti ndi zolinga zake

Timecode (by zomveraβ€” 00:41

dmitrykabanov: Ndikufuna kuyamba ndi projekiti ya Masewera aku Europe. Ndizinthu zambiri, magulu angapo adatenga nawo gawo pokonzekera, ndipo kupereka zenizeni zenizeni kwa anthu masauzande ambiri panthawi yomwe zimachitika pabwalo lamasewera ndi ntchito yayikulu. Pankhani yanu, kodi inali pulogalamu yoyamba?

kapc3d: Inde, tinachita gawo la pulogalamuyo ndikupereka chithandizo panthawi yawonetsero. Zinali zofunikira kutsatira, kuyang'anira ndikuyambitsa zonse mu nthawi yeniyeni, komanso kugwira ntchito ndi gulu la TV. Ngati tilingalira ntchitoyi yonse, ndiye kuti tikhoza kulankhula za miyambo yotsegulira ndi kutseka Masewera a ku Ulaya ku Minsk, komanso za mwambo wotsegulira mpikisano WorldSkills ku Kazan. Zinali zofanana ntchito ndondomeko, koma zochitika zosiyanasiyana. Panali kusiyana kwa miyezi iwiri pakati pawo. Tinakonzekera ntchitoyi pamodzi ndi anyamata a kampaniyo Sechenov.com.

Tinakumana nawo mwamwayi Chikondwerero cha Sayansi, zomwe zidachitika kumapeto kwa 2018. Ophunzira a masters adawonetsa pulojekiti yawo pamutu wa VR. Anyamatawo anabwera kwa ife natifunsa zomwe tinali kuchita mu labotale yathu. Zinkawoneka motere:

- Mumagwira ntchito ndi VR, koma mutha kugwira ntchito ndi zenizeni zenizeni?

- Chabwino, ngati, inde.

- Pali ntchito yotereyi, yokhala ndi zolemba zoyambira. Kodi mungathe?

Adakanda ma turnips awo pang'ono, zikuwoneka kuti palibe cholakwika:

- Tiyeni tiyese kuphunzira zonse kaye, ndiyeno tipeze yankho.

Dmitriy: Kodi amangopereka chithandizo cha media?

Andrew: Amapanga zodzaza. Pakuwona kwa oyang'anira ndi bungwe, amatenga nawo mbali pakuwongolera, kupanga, kusankha malo, mayendedwe ndi chithandizo china chaukadaulo. Koma iwo ankafuna kuchita chinachake chapadera pa Masewera a ku Ulaya. Zotsatira zapaderazi, monga zenizeni zosakanikirana, zakhala zikupangidwira pawailesi yakanema kwa nthawi yayitali, koma sizogwirizana kwambiri ndi bajeti pakugwiritsa ntchito luso. Chifukwa chake, anyamatawo anali kufunafuna njira zina.

Dmitriy: Tiyeni tikambirane vutoli mwatsatanetsatane. Kodi chinali chiyani?

Andrew: Pali chochitika. Zimatenga ola limodzi ndi theka. Tiyenera kuwonetsetsa kuti omvera akuwonera akukhala ndi omwe akukhala mubwaloli atha kuwona zovuta zenizeni zenizeni zogwirizana ndi chiwonetsero chamoyo malinga ndi nthawi ndi malo omwe ali patsamba.

Panali zolephera zingapo zaukadaulo. Zinali zosatheka kugwirizanitsa nthawi kudzera pa intaneti, chifukwa panali mantha okhudza katundu wochuluka pa intaneti ndi maimidwe athunthu komanso chiyembekezo cha atsogoleri a mayiko omwe akupita ku mwambowu, zomwe zingathe kusokoneza ma intaneti.

Andrey Karsakov, chithunzi kuchokera zinthu zochokera ku yunivesite ya ITMO
Podcast "ITMO Research_": momwe mungayandikire kulumikizana kwa zomwe zili mu AR ndi chiwonetsero chamasewera onseTinali ndi zigawo ziwiri zofunika kwambiri za polojekitiyi - zomwe anthu angapeze kudzera pa mafoni a m'manja, ndi zomwe zimalowa pawailesi yakanema komanso zowonetsera zambiri m'bwaloli.

Ngati mwadzidzidzi munthu akuyang'ana zochitika zenizeni zowonjezereka kudzera pa foni yam'manja ndipo nthawi yomweyo akufika pawindo, ayenera kuwona chithunzi chomwecho.

Tinkafunikira machitidwe awiri osiyana kuti agwirizane kwathunthu munthawi yake. Koma chodabwitsa cha ziwonetsero zoterezi ndikuti izi ndizochitika zovuta zomwe ntchito zambiri zaumisiri zimakhudzidwa ndipo ntchito zonse zimachitika molingana ndi ma code a nthawi. Nambala ya nthawi ndi nthawi yeniyeni mu nthawi yomwe chinachake chimayamba: kuwala, phokoso, anthu akuchoka, kutsegulidwa kwa siteji, ndi zina zotero. Tinkafunika kuzolowera dongosolo limeneli kuti zonse ziyambe pa nthawi yake. Chinanso chinali chakuti zochitika ndi magawo okhala ndi zowona zenizeni zinali zokhudzana ndi zolemba.

Dmitriy: Koma kodi munaganiza zosiya kugwiritsa ntchito zizindikiro za nthawi chifukwa cha kuopsa kwakukulu kwa mphamvu majeure, kapena kodi poyamba munawerengera mphamvu zina za mphamvu ndikuzindikira kuti katundu pa dongosolo lonse adzakhala okwera kwambiri?

Andrew: Ngati mupanga ntchito yolumikizira omvera otere, ndiye kuti sizovuta kwambiri. Mulimonse momwe zingakhalire, zopempha sizingalephereke. Inde, katunduyo ndi wochuluka, koma si zadzidzidzi. Funso ndiloti kuli koyenera kugwiritsa ntchito chuma ndi nthawi pa izi ngati maukonde atuluka mwadzidzidzi. Sitinatsimikize kuti izi sizingachitike. Pamapeto pake, zonse zinagwira ntchito, ndi zosokoneza chifukwa cha katundu, koma zinagwira ntchito, ndipo tinagwirizanitsa molingana ndi ndondomeko ya nthawi molingana ndi ndondomeko yosiyana. Ichi chinali chimodzi mwazovuta zapadziko lonse lapansi.

Zovuta pakukhazikitsa kuchokera pakuwona kwa UX

Timecode (by zomveraβ€” 10:42

Andrew: Tidayeneranso kuganizira kuti bwaloli simalo ochitirako konsati akale, ndikugwirizanitsa machitidwe pazida zam'manja. Kotero, nthawi ina yapitayo ndinapita ndi tizilombo augmented reality story ku ma concerts a Eminem, ndiye panali nkhani ndi Loboda.

chithunzi Robert Bye (Unsplash.com)
Podcast "ITMO Research_": momwe mungayandikire kulumikizana kwa zomwe zili mu AR ndi chiwonetsero chamasewera onseKoma izi nthawi zonse zimakhala zokumana nazo pamaso panu - khamu lonse limayima kutsogolo kwa siteji, kulumikizana ndikosavuta. Pankhani ya bwalo lamasewera, muyenera kumvetsetsa mbali ya bwalo lomwe mulipo, malo oyandikana nawo, kuti bwaloli ligwirizane ndi malo omwe alipo. Zinali zovuta kwambiri. Anayesa kuthetsa izo m'njira zosiyanasiyana, ndipo zotsatira zake zinali pafupi ndi zomwe Loboda anakhazikitsa, koma osati m'mbali zonse.

Timalola wogwiritsa ntchito kusankha komwe ali. Tinalemba zilembo zabwaloli, pomwe anthu amasankha gawo, mzere, malo. Zonsezi mu "madina" anayi. Kenako tinayenera kudziwa njira yopita ku siteji. Kuti tichite izi, tidawonetsa silhouette ya momwe chiwonetserocho chikuyenera kuwoneka molingana ndi chikhalidwe. Anaziphatikiza, kumenya ndipo ndizo - siteji idakhala pansi. Tinayesetsa kufewetsa njirayi momwe tingathere. Komabe, 90% ya owonera omwe amafuna kuwonera chiwonetserochi si anthu omwe ali ndi chidziwitso cholankhulana ndi zenizeni zenizeni.

Dmitriy: Kodi panali pulogalamu ina ya polojekitiyi?

Andrew: Inde, pulogalamu ya iOS ndi Android, yomwe tidakankhira ku sitolo. Panali kampeni yapadera yotsatsira izo. Izi zidafotokozedwa kale mwatsatanetsatane momwe mungatsitsire ndi zina zotero.

Dmitriy: Muyenera kumvetsetsa kuti palibe malo oti munthu ayesedwe mwakuthupi ndikuphunzira momwe angagwiritsire ntchito pulogalamuyi. Choncho, ntchito ya "kuphunzitsa" omvera inakhala yovuta kwambiri.

Andrew: Inde Inde. Ndi UX, tidagwira mabampu ambiri, chifukwa wogwiritsa ntchitoyo akufuna kuti apeze chidziwitso pakudina katatu: kutsitsa, kuyika, kukhazikitsidwa - zidagwira ntchito. Anthu ambiri ndi aulesi kwambiri kuti atsatire maphunziro ovuta, kuwerenga maphunziro, ndi zina zotero. Ndipo sitinayese kufotokozera zonse kwa wogwiritsa ntchito momwe tingathere mu phunziroli: zenera lidzatsegulidwa apa, kupeza kamera apa, mwinamwake sizingagwire ntchito, ndi zina zotero. Ziribe kanthu kuti mumalemba mafotokozedwe angati, mosasamala kanthu kuti mumatafuna mwatsatanetsatane bwanji, mosasamala kanthu kuti mumayika ma gif, anthu samawerenga.

Ku Minsk tidasonkhanitsa mayankho ambiri pagawoli, ndipo tasintha kale zambiri pakugwiritsa ntchito ku Kazan. Sitinaikemo osati ma phonogram okhawo ndi zizindikiro za nthawi zomwe zimagwirizana ndi gawo linalake la zochitika zowonjezereka, koma tinatenga ma phonogram ndi zizindikiro za nthawi zonse. Chifukwa chake pulogalamuyo idamva zomwe zikuchitika panthawi yotsegulira, ndipo - ngati munthu adalowa nthawi yolakwika - idapereka chidziwitso: "Comrade, pepani, gawo lanu la AR likhala mumphindi 15."

A pang'ono za zomangamanga ndi njira kalunzanitsidwe

Timecode (by zomveraβ€” 16:37

Dmitriy: Kodi mwaganiza zogwirizanitsa ndi mawu?

Andrew: Inde, zinachitika mwangozi. Tinayang'ana njira zomwe tingasankhe ndipo tinapeza kampani Cifrasoft kuchokera ku Izhevsk. Amapanga SDK yosakhala yaukadaulo, koma yogwira ntchito yachitsulo, yomwe imakupatsani mwayi wolumikiza mawuwo ndi nthawi yake. Dongosololi lidayikidwa kuti lizigwira ntchito ndi TV, pomwe mutha kuwonetsa china chake mu pulogalamuyo potengera kutsatsa kovomerezeka kapena kupereka chidziwitso chokhudzana ndi kanema wa kanema.

Dmitriy: Koma ndi chinthu chimodzi - mwakhala m'chipinda chanu chochezera, ndipo chinthu china - bwalo lamasewera lomwe lili ndi anthu masauzande ambiri. Kodi zinthu zinakuyendereni bwanji ndi mtundu wa mawu ojambulidwa ndi kuzindikirika kwake?

Andrew: Panali mantha ambiri ndi kukayikira, koma nthawi zambiri zonse zinkadziwika bwino. Amamanga siginecha pamawu omvera ndi ma aligorivimu ochenjera - zotsatira zake zimalemera mochepera kuposa fayilo yomvera yoyambirira. Maikolofoni ikamvetsera phokoso lozungulira, imayesa kupeza zinthuzi ndikuzindikira njanji yochokera pa iwo. M'mikhalidwe yabwino, kulondola kwamalumikizidwe ndi masekondi 0,1-0,2. Izi zinali zokwanira. M'mikhalidwe yoyipa, kusagwirizana kunali mpaka masekondi 0,5.

Zambiri zimadalira chipangizocho. Tinagwira ntchito ndi zida zambiri. Kwa iPhones pali mitundu 10 yokha. Iwo ankagwira ntchito bwino pankhani ya khalidwe ndi zina. Koma ndi androids zoo ali ngati mayi anga. Osati kulikonse kunapezeka kuti kulumikiza mawu kunagwira ntchito. Panali zochitika pamene kunali kosatheka kumva nyimbo zosiyanasiyana pazida zosiyanasiyana chifukwa cha zina. Penapake ma frequency otsika amatha, penapake ma frequency okwera amayamba kuwomba. Koma ngati chipangizocho chinali ndi normalizer pa maikolofoni, kugwirizanitsa nthawi zonse kumagwira ntchito.

Dmitriy: Chonde tiuzeni za zomangamanga - zomwe zidagwiritsidwa ntchito pantchitoyi?

Andrew: Tidapanga pulogalamuyi mu Unity - njira yosavuta kwambiri pankhani ya nsanja zambiri ndikugwira ntchito ndi zithunzi. Ntchito AR Foundation. Nthawi yomweyo tidati sitikufuna kusokoneza dongosololi, chifukwa chake tidangodzipereka ku zida zingapo zomwe zimathandizira ARKit ndi ARCore kuti tikhale ndi nthawi yoyesa chilichonse. Tinapanga pulogalamu yowonjezera ya DigitalSoft SDK, izo ili pa GitHub yathu. Tinapanga dongosolo loyendetsera zinthu kuti zolemba ziziyenda molingana ndi nthawi.

Tidayang'ana pang'ono ndi tinthu tating'ono, chifukwa wogwiritsa ntchito amatha kulowa nthawi iliyonse mugawo linalake, ndipo timafunikira kuti awone chilichonse kuyambira pomwe adalumikizana. Tidalumikizana ndi makina omwe amalola kuti ziwonetsero ziziwonetsedwa bwino munthawi yake, kuti zochitika za XNUMXD ziziyenda uku ndi uku, monga mu kanema. Ngakhale zimagwira ntchito m'bokosi lokhala ndi makanema ojambula pamanja, tidayenera kuyang'ana ndi kachitidwe kakang'ono. Panthawi ina, amayamba kubereka, ndipo ngati mutadzipeza nokha penapake musanayambe kubadwa, iwo sanabadwe, ngakhale akuwoneka ngati ayenera kukhala. Koma vutoli kwenikweni n'losavuta kuthetsa.

Kwa gawo la mafoni, zomangamanga ndizosavuta. Kwa kuwulutsa pawailesi yakanema zonse ndizovuta kwambiri. Tinali ndi zoletsa za hardware. Wogulayo adakhazikitsa lamulo: "Pano tili ndi malo osungiramo zinthu ngati awa, kunena pang'ono, zonse ziyenera kukonzedwa." Nthawi yomweyo tinayang'ana pa mfundo yakuti tidzagwira ntchito ndi makadi ojambulira mavidiyo a bajeti. Koma bajeti sizikutanthauza kuti ndi zoipa.

Panali zoletsa pa hardware, pa makadi ojambula mavidiyo ndi zochitika zogwirira ntchito - momwe tiyenera kulandira chithunzicho. Makhadi ojambulidwa - Blackmagic Design, adagwira ntchito molingana ndi Internal keying scheme - apa ndipamene chimango cha kanema chimabwera kwa inu kuchokera ku kamera. Khadi ili ndi chip yakeyake yopangira, pomwe chimango chimayikidwanso, chomwe chiyenera kukhala pamwamba pa chomwe chikubwera. Khadi imawasakaniza - sitikhudza china chilichonse pamenepo ndipo sizikhudza chimango cha kamera ya kanema. Amalavulira zotsatira zake kuchipinda chowongolera kudzera pavidiyo. Iyi ndi njira yabwino yokutira mitu ndi zinthu zina zofananira, koma sizoyenera kuphatikizira zenizeni zenizeni chifukwa pali zoletsa zambiri pamapaipi operekera.

Dmitriy: Pankhani ya computing yeniyeni, kumanga zinthu, kapena china chake?

Andrew: Kumbali ya khalidwe ndi kukwaniritsa anakhumba zotsatira. Chifukwa sitidziwa zomwe tikuyika chithunzicho pamwamba. Timangotumiza zambiri zamtundu ndi zowonekera pamwamba pa mtsinje woyambirira. Zotsatira zina monga ma refractions, kuwonekera koyenera, ndi mithunzi yowonjezera sizingachitike ndi chiwembu ichi. Kuti muchite izi, muyenera kuchita zonse pamodzi. Mwachitsanzo, palibe njira yopangira zotsatira za kusokonezeka kwa mpweya kuchokera pamoto kapena phula lotentha. Zomwezo zimapitanso kusamutsidwa kwa kuwonekera poganizira index ya refractive. Poyamba tidapanga zomwe zili paziletsozi ndikuyesera kugwiritsa ntchito zoyenera.

Onani chithunzi ichi pa Instagram

Kutsekedwa kwa Masewera a II aku Europe ku Minsk.

Chojambulidwa chogawidwa Alena Lanskaya (@alyonalanskaya) pa Jun 30, 2019 pa 3:19pm PDT

Dmitriy: Kodi mudali nazo kale zomwe zili mu projekiti yoyamba ya Masewera aku Europe?

Andrew: Ayi, gawo lalikulu lachitukuko chazinthu zidapangidwa ndi anyamata ochokera ku Sechenov.com. Ojambula awo ojambula zithunzi adajambula zoyambira ndi makanema ojambula ndi zinthu zina. Ndipo tidaphatikizira zonse mu injini, kuwonjezera zina zowonjezera, kuzisintha kuti zonse ziziyenda bwino.

Ngati tilankhula za payipi, ndiye kuti pawailesi yakanema tidasonkhanitsa chilichonse pa Unreal Engine 4. Mwachidziwitso, iwo nthawi yomweyo adayamba kulimbikitsa zida zawo pazowona zosakanikirana. Zinapezeka kuti chirichonse si chophweka. Ngakhale tsopano zida zonse ndi zosaphika, tinayenera kumaliza zambiri ndi manja. Ku Minsk tinagwira ntchito yomanga injini, ndiko kuti, tinalembanso zinthu zina mkati mwa injini kuti, mwachitsanzo, tikhoza kujambula mithunzi pamwamba pa zinthu zenizeni. Mtundu wa injini yomwe inalipo panthawiyo inalibe zinthu zomwe zingalole kuti izi zichitike pogwiritsa ntchito zida zokhazikika. Pachifukwa ichi, anyamata athu adapanga msonkhano wawo wokhazikika kuti apereke zonse zomwe zinali zofunika kwambiri.

Ma nuances ena ndikusintha ku WorldSkills ku Kazan

Timecode (by zomveraβ€” 31:37

Dmitriy: Koma zonsezi mu nthawi yochepa?

Andrew: Nthawi zomalizira zinali zolimba Kazan project, malinga ndi Minsk - zachilendo. Pafupifupi miyezi isanu ndi umodzi ya chitukuko, koma poganizira kuti anthu asanu ndi mmodzi adakhudzidwa. Nthawi yomweyo, tinali kupanga gawo la mafoni ndikupanga zida zopangira kanema wawayilesi. Panalibe chithunzi chotulutsa chokha. Mwachitsanzo, njira yotsatirira yokhala ndi optics, chifukwa cha izi munayenera kupanga zida zanu.

Dmitriy: Kodi panali kusintha kulikonse kuchokera ku polojekiti ina kupita ku ina? Pakatha mwezi ndi theka, kunali koyenera kupezerapo mwayi pazomwe zikuchitika ndikusamutsa pulojekitiyi ndi zatsopano patsamba latsopano?

Andrew: Inde, zinali kwa mwezi ndi theka. Tinakonzekera tchuthi cha milungu iwiri kwa gulu lonse pambuyo pa ntchito ya Minsk. Koma atangotseka, anyamata ochokera ku Sechenov.com amabwera nati: "Chabwino, tiyeni tichite ku Kazan." Tidakwanitsabe kupuma pang'ono, koma tidasinthiratu ntchitoyi mwachangu. Tinamaliza ntchito ina yaukadaulo. Nthawi yambiri idagwiritsidwa ntchito pazinthu, chifukwa kwa WorldSkills tidazichita kwathunthu, tidangogwirizanitsa ndi gulu lopanga. Panali script chabe kumbali yawo. Koma zinali zosavuta - panalibe chifukwa chowonjezera. Mukapanga zokhutira nokha, mumawona nthawi yomweyo momwe zimagwirira ntchito mu injini, ndipo mutha kusintha ndikugwirizanitsa.


Ponena za gawo la mafoni, tidaganizira zobisika zonse zomwe tinali nazo ku Minsk. Tinapanga mapangidwe atsopano ogwiritsira ntchito, kukonzanso zomangamanga pang'ono, kuwonjezera maphunziro, koma kuyesera kuti zikhale zazifupi komanso zomveka bwino momwe tingathere. Tinachepetsa kuchuluka kwa masitepe a ogwiritsa ntchito kuyambira poyambitsa pulogalamuyo mpaka kuwona zomwe zili. Mwezi umodzi ndi theka unali wokwanira kumaliza ntchito yokwanira. Mu sabata ndi theka tinafika pamalowo. Kugwira ntchito kumeneko kunali kosavuta chifukwa mphamvu zonse zoyendetsera ntchitoyi zinali m’manja mwa okonza mapulaniwo, ndipo panalibe chifukwa chogwirizana ndi makomiti ena. Zinali zosavuta komanso zosavuta kugwira ntchito ku Kazan ndipo zinali zachilendo kuti nthawi inali yochepa.

Dmitriy: Koma kodi mudaganiza zosiya njira yolumikizirana momwe idalili, kutengera mawu?

Andrew: Inde, tinazisiya mwaphokoso. Zinayenda bwino. Monga akunena, ngati zikugwira ntchito, musakhudze. Tinkangoganizira zamtundu wa nyimbo. Pamene adapanga mawu oyamba, panali gawo lophunzitsira anthu kuti ayesere chiwonetserochi chisanayambe. Zinali zodabwitsa kuti panthawi yomwe mukusewera njanjiyi mubwalo lamasewera pali kuwomba kwamphepo, "Live", dongosololi limakupatsani mwayi wolumikizana bwino ndi njanjiyi, koma ngati pakali pano kuwomba m'manja kojambulidwa kumasakanikirana ndi njanjiyo, ndiye track sinagwidwenso. Ma nuances oterowo adaganiziridwa, ndipo zonse zidalumikizidwa bwino pamawu.

PS Mu gawo lachiwiri la nkhaniyi tikukamba za kuwonetseratu deta ya sayansi, ndondomeko ya ndondomeko muzinthu zina, chitukuko cha masewera ndi pulogalamu ya mbuye "Ukadaulo wokulitsa masewera apakompyuta" Tidzafalitsa kupitiriza m'nkhani yotsatira. Mutha kumvetsera ndi kutithandizira pano:

PPS Pakadali pano, pa mtundu wa Chingerezi wa Habr: Kuyang'ana kwambiri ku yunivesite ya ITMO.

Source: www.habr.com

Kuwonjezera ndemanga