Isihloko esisha: I-Computational Photography

Isihloko sokuqala sifakwe kuwebhusayithi Vastrik.ru futhi yashicilelwa ku-3DNews ngemvume yombhali. Sinikeza umbhalo ogcwele we-athikili, ngaphandle kwenani elikhulu lezixhumanisi - ziyoba usizo kulabo abanesithakazelo esijulile esihlokweni futhi bangathanda ukufunda izici zethiyori zokuthwebula izithombe ngokujulile, kodwa izethameli ezivamile sibheke lokhu okubalulekile njengokungabalulekile.  

Namuhla, akukho nesisodwa isethulo se-smartphone esiphelele ngaphandle kokukhotha ikhamera yayo. Nyanga zonke sizwa ngempumelelo elandelayo yamakhamera eselula: I-Google ifundisa i-Pixel ukuthwebula ebumnyameni, i-Huawei ukusondeza njengezibonakude, i-Samsung ifaka i-lidar, futhi i-Apple yenza amakhona ayindilinga emhlabeni wonke. Zimbalwa izindawo lapho ukuqanjwa kugeleza ngokushesha okungaka kulezi zinsuku.

Ngesikhathi esifanayo, izibuko zibonakala ziphawula isikhathi. U-Sony minyaka yonke ushawa yiwo wonke umuntu ngomatikuletsheni amasha, futhi abakhiqizi ngokuvilapha babuyekeza idijithi yenguqulo yakamuva futhi baqhubeke nokukhululeka nokubhema eceleni. Ngine-$3000 DSLR etafuleni lami, kodwa uma ngihamba, ngithatha i-iPhone yami. Kungani?

Njengoba kwakudala kusho, ngingene ku-inthanethi ngalo mbuzo. Lapho baxoxa “ngama-algorithms” kanye “namanethiwekhi we-neural”, ngaphandle kokuba nombono wokuthi athinta kanjani ukuthwebula izithombe. Izintatheli zifunda ngokuzwakalayo inani lama-megapixel, ama-blogger abona ama-unboxing akhokhelwayo ngazwi linye, futhi ama-aesthetes azigcoba “ngombono ovusa inkanuko wephalethi yombala we-matrix.” Konke kunjengokujwayelekile.

Kwadingeka ngihlale phansi, ngichithe ingxenye yempilo yami futhi ngizitholele konke ngokwami. Kulesi sihloko ngizokutshela engikufundile.

#Kuyini ukuthwebula izithombe ngekhompyutha?

Yonke indawo, kuhlanganise ne-Wikipedia, banikeza into efana nale ncazelo: ukuthwebula izithombe ngekhompyutha yinoma iyiphi indlela yokuthwebula izithombe nezindlela zokucubungula esebenzisa ikhompuyutha yedijithali esikhundleni soguquko lwama-optical. Konke mayelana nakho kuhle, ngaphandle kokuthi akuchazi lutho. Ngisho ne-autofocus ifaneleka kuyo, kodwa i-plenoptics, esivele isisilethele izinto eziningi eziwusizo, ayihambisani. Ukungacaci kwezincazelo ezisemthethweni kubonakala kukhomba ukuthi asazi ukuthi sikhuluma ngani.

Umsunguli wokuthwebula izithombe ngekhompyutha, uprofesa waseStanford uMarc Levoy (manje osephethe ikhamera ku-Google Pixel) unikeza enye incazelo - isethi yezindlela zokubuka ngekhompyutha ezithuthukisa noma ezinweba amandla okuthwebula izithombe zedijithali, kusetshenziswa okutholakala isithombe esivamile lokho. ayikwazanga ukuthathwa ngale khamera.ikhamera ngendlela evamile. Esihlokweni nginamathela kulokhu.

Ngakho-ke, ama-smartphones ayenecala kukho konke.

Omakhalekhukhwini babengenayo enye indlela ngaphandle kokuzala uhlobo olusha lwezithombe: ukuthwebula izithombe ngekhompyutha.

Omatikuletsheni babo abancane abanomsindo namalensi amancanyana avuleka kancane, ngokwayo yonke imithetho yefiziksi, bekufanele alethe ubuhlungu nokuhlupheka kuphela. Lokhu bakwenze kwaze kwaba yilapho abathuthukisi babo bethola ukuthi bangasebenzisa kanjani amandla abo ngobuhlakani ukuze banqobe ubuthakathaka babo - izivalo zikagesi ezisheshayo, amaphrosesa anamandla nesoftware.

Isihloko esisha: I-Computational Photography

Iningi locwaningo olusezingeni eliphezulu emkhakheni wokuthwebula izithombe ngekhompyutha lwenzeka phakathi kuka-2005 no-2015, okubhekwa kwezesayensi ngokoqobo izolo. Njengamanje, phambi kwamehlo ethu nasemaphaketheni ethu, insimu entsha yolwazi nobuchwepheshe iyathuthuka engakaze ibe khona ngaphambili.

Ukuthwebula izithombe ngekhompyutha akukhona nje ukuzithwebula nge-neuro-bokeh. Isithombe sakamuva sembobo emnyama besingeke senzeke ngaphandle kwamasu okuthwebula izithombe. Ukuthatha isithombe esinjalo ngesibonakude esivamile, kwakuzodingeka sisenze silingane noMhlaba. Nokho, ngokuhlanganisa idatha evela kumabonakude ayisishiyagalombili erediyo ezindaweni ezihlukene ebholeni lethu nokubhala imibhalo embalwa ngePython, sithole isithombe sokuqala emhlabeni somkhathizwe womcimbi. Kulungele futhi izithombe ozishuthe zona.

Isihloko esisha: I-Computational Photography

#Qala: ukucubungula kwedijithali

Ake sicabange ukuthi sibuyile ngo-2007. Umama wethu unesiyaluyalu, futhi izithombe zethu zingamajephu anomsindo angu-0,6-megapixel athathwe ebhodini lokutyibilika. Ngaleso sikhathi sinesifiso sokuqala esingenakuvinjelwa sokufafaza okusethiwe kubo ukuze sifihle usizi lwamatrices eselula. Masingaziphiki.

Isihloko esisha: I-Computational Photography

#I-Matan ne-Instagram

Ngokukhishwa kwe-Instagram, wonke umuntu waba matasa ngezihlungi. Njengomuntu owahlehlisa unjiniyela i-X-Pro II, i-Lo-Fi ne-Valencia, ngokwezinjongo zocwaningo, ngisakhumbula ukuthi zazihlanganisa izingxenye ezintathu:

  • Izilungiselelo zombala (I-Hue, Saturation, Lightness, Contrast, Levels, njll.) - ama-coefficients alula edijithali, afana ncamashí nanoma yikuphi ukusetha ngaphambilini abathwebuli bezithombe abaye bakusebenzisa kusukela ezikhathini zasendulo.
  • I-Tone Mappings ama-vectors wamanani, ngayinye yawo eyasitshela: “Umbala obomvu onombala ongu-128 kufanele uguqulwe ube i-tint engu-240.”
  • Imbondela yisithombe esikhanyayo esinothuli, okusanhlamvu, i-vignette, nakho konke okunye okungabekwa phezulu ukuze kutholwe umphumela ongenqatshelwe nhlobo wefilimu endala. Wayengekho njalo.   

Izihlungi zesimanje azikude nalaba abathathu, sezivele zaba yinkimbinkimbi kakhulu kwizibalo. Ngokufika kwama-hardware shader kanye ne-OpenCL kuma-smartphones, abhalwa kabusha ngokushesha ku-GPU, futhi lokhu kwathathwa njengokupholile. Ngo-2012, kunjalo. Namuhla, noma yimuphi umfundi angenza okufanayo ku-CSS, futhi ngeke alithole ithuba lokuthweswa iziqu.

Nokho, ukuqhubeka kwezihlungi akumile namuhla. Abafana abavela ku-Dehanser, ngokwesibonelo, bahle kakhulu ekusebenziseni izihlungi ezingezona umugqa - esikhundleni semephu yethoni ye-proletarian, basebenzisa ukuguqulwa okuyinkimbinkimbi okungaqondile, okuthi, ngokusho kwabo, kuvule amathuba amaningi kakhulu.

Ungenza izinto eziningi ngezinguquko ezingaqondile, kodwa ziyinkimbinkimbi ngendlela emangalisayo, futhi thina bantu siyiziphukuphuku ezimangalisayo. Uma nje kukhulunywa ngoguquko olungaqondile kusayensi, sincamela ukuya ezindleleni zezinombolo kanye namanethiwekhi e-cram neural yonke indawo ukuze basibhalele ubuciko bobuciko. Kwaba okufanayo lapha.

#Ukuzenzakalela namaphupho enkinobho "yobuciko obuhle".

Lapho wonke umuntu esejwayele ukuhlunga, saqala ukuzakhela ngokuqondile kumakhamera. Umlando ufihla ukuthi yimuphi umkhiqizi owayengowokuqala, kodwa ukuze uqonde nje ukuthi kwakukudala kangakanani - ku-iOS 5.0, eyakhishwa emuva ngo-2011, kwase kune-API yomphakathi Yezithombe Ezithuthukisa Ngokuzenzakalelayo. Imisebenzi kuphela owaziyo ukuthi yasetshenziswa isikhathi esingakanani ngaphambi kokuvulelwa umphakathi.

I-automation yenza into efanayo eyenziwa ngamunye wethu lapho evula isithombe kumhleli - yakhipha izikhala ekukhanyeni nasethunzini, yanezela ukugcwala, yasusa amehlo abomvu kanye nebala elimile. Abasebenzisi abazange babone nokuthi "ikhamera ethuthuke ngokumangazayo" ku-smartphone entsha yayiwukufaneleka kwamashadi amasha ambalwa. Kwakusele iminyaka emihlanu ngaphambi kokukhishwa kwe-Google Pixel kanye nokuqala kwe-computational photography hype.

Isihloko esisha: I-Computational Photography

Namuhla, impi yenkinobho "yobuciko obuhle" isithuthele emkhakheni wokufunda ngomshini. Ngemva kokudlala ngokwanele ngemephu yethoni, wonke umuntu waphuthuma ukuqeqesha ama-CNN nama-GAN ukuhambisa izilayidi esikhundleni somsebenzisi. Ngamanye amazwi, kusukela kusithombe esifakiwe, nquma isethi yamapharamitha alungile angasondeza lesi sithombe ekuqondeni okuthile "kwezithombe ezinhle." Kusetshenziswe ku-Pixelmator Pro efanayo nakwabanye abahleli. Isebenza, njengoba ungase ucabange, hhayi kahle kakhulu futhi hhayi njalo. 

#Ukupakisha kungu-90% wempumelelo yamakhamera eselula

Ukuthatha izithombe ngekhompyutha kwangempela kwaqala ngokupakisha—ukwendlalela izithombe eziningi phezu kwesinye. Akuyona inkinga nge-smartphone ukuchofoza amafreyimu ayishumi nambili ngesigamu somzuzwana. Amakhamera abo awanazo izingxenye zemishini ehamba kancane: imbobo ilungisiwe, futhi esikhundleni sekhethini elinyakazayo kune-shutter kagesi. Iphrosesa imane iyale i-matrix ukuthi mangaki ama-microsecond okufanele ibambe ama-photon asendle, futhi ifunda umphumela.

Ngobuchwepheshe, ifoni ingathatha izithombe ngesivinini sevidiyo, kanye nevidiyo ngokulungiswa kwesithombe, kodwa konke kuncike kujubane lebhasi kanye nephrosesa. Yingakho bahlale bebeka imikhawulo yohlelo.

I-Staking ngokwayo isibe nathi isikhathi eside. Ngisho nomkhulu bafake ama-plugin ku-Photoshop 7.0 ukuze bahlanganise izithombe ezimbalwa zibe i-HDR edonsa amehlo noma bahlanganise i-panorama yamaphikseli angu-18000 × 600 futhi... empeleni, akekho owake wacabanga ukuthi enzeni ngazo ngokulandelayo. Kwakudabukisa ukuthi izikhathi zazicebile futhi zasendle.

Manje sesingabantu abadala futhi sikubiza ngokuthi "i-epsilon photography" - lapho, ngokushintsha ipharamitha eyodwa yekhamera (ukuchayeka, ukugxila, indawo) nokuhlanganisa ndawonye amafreyimu atholakele, sithola okuthile okungathathwanga kuhlaka olulodwa. Kodwa leli yigama lama-theorists; empeleni, elinye igama selithathe izimpande - staking. Namuhla, empeleni, i-90% yazo zonke izinto ezintsha kumakhamera eselula zisekelwe kuwo.

Isihloko esisha: I-Computational Photography

Okuthile abantu abaningi abangacabangi ngakho, kodwa kubalulekile ukuqonda zonke izithombe zeselula nezekhompyutha: ikhamera ku-smartphone yesimanje iqala ukuthatha izithombe ngokushesha nje lapho uvula uhlelo lwayo lokusebenza. Okunengqondo, ngoba udinga ngandlela-thile ukudlulisa isithombe esikrinini. Kodwa-ke, ngaphezu kwesikrini, ilondoloza amafreyimu anokulungiswa okuphezulu ku-loop buffer yayo, lapho iwagcina khona imizuzwana embalwa.

Uma ucindezela inkinobho “thatha isithombe”, sesivele sithathiwe, ikhamera ivele ithathe isithombe sokugcina kusigcinalwazi.

Lena yindlela noma iyiphi ikhamera yeselula esebenza ngayo namuhla. Okungenani kuwo wonke ama-flagship angaveli kuzinqwaba zikadoti. I-buffering ikuvumela ukuthi ungaboni nje ukuthi i-zero shutter lag, abathwebuli bezithombe kudala beyiphupha, kodwa ngisho nebi - uma ucindezela inkinobho, i-smartphone ibheka okwedlule, ilayishe izithombe zokugcina ezingu-5-10 ku-buffer futhi iqala ukuhlaziya ngokukhululekile. futhi uwanamathisele. Akusekho ukulinda ukuthi ifoni ichofoze amafreyimu e-HDR noma imodi yasebusuku - vele uwasuse ku-buffer, umsebenzisi ngeke aze azi.

Isihloko esisha: I-Computational Photography

Ngendlela, kungosizo lwe-shutter lag engalungile lapho i-Live Photo isetshenziswa kuma-iPhones, futhi i-HTC yayinokuthile okufanayo ngo-2013 ngaphansi kwegama elingajwayelekile elithi Zoe.

#Ukunqwabelanisa kokuchayeka - HDR kanye nezinguquko zokukhanya

Isihloko esisha: I-Computational Photography

Ukuthi izinzwa zekhamera ziyakwazi yini ukuthwebula lonke uhla lokukhanya olufinyeleleka emehlweni ethu kuyisihloko esidala esishisayo senkulumompikiswano. Abanye bathi cha, ngoba iso liyakwazi ukubona kufika ku-25 f-stops, kuyilapho ngisho nokusuka phezulu kwe-matrix egcwele uhlaka ungathola ubuningi obungu-14. Abanye babiza ukuqhathanisa okungalungile, ngoba ubuchopho busiza iso ngokulungisa ngokuzenzakalelayo. umfundi kanye nokuqedela isithombe ngamanethiwekhi aso ezinzwa, kanye nokuphazima kweso Ububanzi obuguquguqukayo beso empeleni abukho ngaphezu kuka-10-14 f-stops. Masiyiyeke le nkulumo-mpikiswano kubacabangi abahamba phambili bezihlalo ze-armchar ku-inthanethi.

Iqiniso liwukuthi: uma udubula abangani esibhakabhakeni esikhanyayo ngaphandle kwe-HDR kunoma iyiphi ikhamera yeselula, uthola isibhakabhaka esivamile nobuso obumnyama babangane, noma abangani abakhangwe kahle, kodwa isibhakabhaka esishile saze safa.

Isixazululo sekuyisikhathi eside sasungulwa - ukwandisa ububanzi bokukhanya kusetshenziswa i-HDR (ububanzi obunamandla obuphezulu). Udinga ukuthatha amafreyimu amaningana ngesivinini esihlukile sokuvala bese uwahlanganisa. Ngakho lowo "ojwayelekile", owesibili ulula, owesithathu umnyama. Sithatha izindawo ezimnyama kusuka kuhlaka olukhanyayo, sigcwalise ukuchayeka ngokweqile kusuka kokumnyama - inzuzo. Okusele nje ukuxazulula inkinga yokubakaki okuzenzakalelayo - ukuthi kungakanani ukushintsha ukuvezwa kohlaka ngalunye ukuze ungadluli, kodwa manje umfundi owenza unyaka wesibili enyuvesi yobuchwepheshe angakwazi ukusingatha ukunquma ukukhanya okumaphakathi kwesithombe.

Isihloko esisha: I-Computational Photography

Ku-iPhone, i-Pixel ne-Galaxy yakamuva, imodi ye-HDR ngokuvamile ivulwa ngokuzenzakalelayo uma i-algorithm elula ngaphakathi kwekhamera inquma ukuthi uthwebula okuthile ngokugqamayo ngosuku olunelanga. Ungaqaphela nokuthi ifoni ishintsha kanjani imodi yokurekhoda iye kusigcinalwazi ukuze ulondoloze amafreyimu aguquliwe ekuvezweni - i-fps kukhamera iyehla, futhi isithombe ngokwaso siba juicier. Isikhathi sokushintsha sibonakala ngokucacile ku-iPhone X yami lapho ngiqopha ngaphandle. Bheka futhi i-smartphone yakho ngokuzayo.

Okubi kwe-HDR enobakaki wokuchayeka wukungangeneki kwayo ekukhanyeni okubi. Ngisho nokukhanya kwesibani segumbi, amafreyimu ajika abe mnyama kangangokuthi ikhompuyutha ayikwazi ukuqondanisa nokuwahlanganisa ndawonye. Ukuxazulula inkinga ngokukhanya, ngo-2013 i-Google yabonisa indlela ehlukile ku-HDR ku-smartphone ye-Nexus ekhishwe ngaleso sikhathi. Wasebenzisa ukupakisha isikhathi.

#Ukupakisha isikhathi - ukulingiswa kokuchayeka isikhathi eside kanye nokweqiwa kwesikhathi

Isihloko esisha: I-Computational Photography

Ukupakisha isikhathi kukuvumela ukuthi udale ukuchayeka okude usebenzisa uchungechunge lwamafushane. Amaphayona ayengabalandeli bokuthwebula imizila yezinkanyezi esibhakabhakeni ebusuku, abakuthola kunzima ukuvula i-shutter amahora amabili ngesikhathi esisodwa. Kwakunzima kakhulu ukubala zonke izilungiselelo kusengaphambili, futhi ukuzamazama okuncane kwakuzolimaza lonke uhlaka. Banquma ukuvula i-shutter kuphela imizuzu embalwa, kodwa izikhathi eziningi, base beya ekhaya futhi banamathisele amafreyimu avela ku-Photoshop.

Isihloko esisha: I-Computational Photography

Kuvele ukuthi ikhamera ayikaze idubule ngesivinini esikhulu sokuvala, kodwa sithole umphumela wokulingisa ngokungeza amafreyimu ambalwa athathwe ngokulandelana. Kube nenqwaba yezinhlelo zokusebenza ezibhalelwe ama-smartphones asebenzisa leli qhinga isikhathi eside, kodwa zonke azidingeki njengoba isici sengezwe cishe kuwo wonke amakhamera ajwayelekile. Namuhla, ngisho ne-iPhone ingakwazi ukuhlanganisa kalula ukuchayeka okude kusuka ku-Live Photo.

Isihloko esisha: I-Computational Photography

Masibuyele ku-Google nge-HDR yayo yasebusuku. Kuvele ukuthi usebenzisa ubakaki besikhathi ungasebenzisa i-HDR enhle ebumnyameni. Ubuchwepheshe baqala ukuvela ku-Nexus 5 futhi babubizwa nge-HDR+. Amanye amafoni e-Android ayithola sengathi iyisipho. Lobu buchwepheshe busaduma kangangoba buyanconywa ngisho nasekwethulweni kwamaPixels akamuva.

I-HDR+ isebenza kalula: ngemva kokunquma ukuthi uthwebula ebumnyameni, ikhamera ikhipha izithombe zokugcina ezingu-8-15 RAW kusukela kusigcinalwazi ukuze izimboze phezu kwezinye. Ngakho, i-algorithm iqoqa ulwazi olwengeziwe mayelana nezindawo ezimnyama zohlaka ukuze kuncishiswe umsindo - amaphikseli lapho, ngesizathu esithile, ikhamera ayikwazanga ukuqoqa lonke ulwazi futhi ayihambanga kahle.

Kufana nokuthi ubungazi ukuthi i-capybara ibukeka kanjani futhi ucele abantu abahlanu ukuthi bayichaze, izindaba zabo zizocishe zifane, kodwa ngamunye uzosho imininingwane ethile eyingqayizivele. Ngale ndlela ubungaqoqa ulwazi olwengeziwe kunokubuza olulodwa nje. Kuyafana ngamaphikseli.

Ukwengeza ozimele abathathwe endaweni eyodwa kunikeza umphumela ofanayo womgunyathi wokuchayeka njengezinkanyezi ezingenhla. Ukuvezwa kwenqwaba yozimele kuyafingqwa, amaphutha kokukodwa ancishiswa kokunye. Cabanga ukuthi kufanele uchofoze kangaki ishutha ye-DSLR njalo ukuze ufeze lokhu.

Isihloko esisha: I-Computational Photography

Okwakusele kwakuwukuxazulula inkinga yokulungiswa kombala okuzenzakalelayo - amafreyimu athathwe ebumnyameni ngokuvamile aphenduka aphuzi noma aluhlaza, futhi sifuna ukunotha kokukhanya kwasemini. Ezinguqulweni zakuqala ze-HDR+, lokhu kwaxazululwa ngokumane ulungise izilungiselelo, njengezihlungi ze-Instagram. Babe sebecela amanethiwekhi e-neural ukuba asize.

Yavela kanjena indlela I-Night Sight - ubuchwepheshe "bokuthwebula izithombe zasebusuku" ku-Pixel 2 no-3. Encazelweni bathi: "Amasu okufunda ngomshini akhelwe phezu kwe-HDR+, enza i-Night Sight isebenze." Empeleni, lokhu ukuzenzakalelayo kwesiteji sokulungiswa kombala. Umshini waqeqeshwa kudathasethi yezithombe "zangaphambili" kanye "nangemva" ukuze wenze esisodwa esihle kunoma iyiphi isethi yezithombe ezimnyama ezigobile.

Isihloko esisha: I-Computational Photography

Nokho, idathasethi yenziwe yatholakala esidlangalaleni. Mhlawumbe abafana bakwa-Apple bazoyithatha futhi ekugcineni bafundise amafosholo abo engilazi ukuthatha izithombe kahle ebumnyameni.

Ngaphezu kwalokho, Ukubona Ebusuku kusebenzisa ukubala ivekhtha yezinto ezikufreyimu ukwenza kube ngokwejwayelekile ukufiphala okuqinisekile ukuthi kuzokwenzeka ngesivinini se-shutter eside. Ngakho-ke, i-smartphone ingathatha izingxenye ezicacile kwamanye amafreyimu futhi iwanamathisele.

#Ukupakishwa kokunyakaza - i-panorama, i-superzoom kanye nokunciphisa umsindo

Isihloko esisha: I-Computational Photography

I-Panorama iyinhlangano yokuzijabulisa edumile ehlala ezindaweni zasemakhaya. Umlando awukazi noma yiziphi izimo lapho isithombe sesoseji singaba nesithakazelo kunoma ubani ngaphandle kombhali waso, kodwa asikwazi ukushaywa indiva - kwabaningi, yilapho ukunqwabelana kwaqala khona kwasekuqaleni.

Isihloko esisha: I-Computational Photography

Indlela yokuqala ewusizo yokusebenzisa i-panorama ukuthola isithombe sokucaca okuphezulu kunesivumela i-matrix yekhamera ngokuhlanganisa amafreyimu amaningana. Sekuyisikhathi eside abathwebuli bezithombe besebenzisa isoftware ehlukile kulokho okubizwa ngezithombe ezinesinqumo esihle kakhulu - lapho izithombe ezinyakaziswa kancane zibonakala zihambisana phakathi kwamaphikseli. Ngale ndlela ungathola isithombe okungenani samakhulukhulu amagigaphikiseli, esiwusizo kakhulu uma udinga ukusiphrinta kuphosta yokukhangisa engusayizi wendlu.

Isihloko esisha: I-Computational Photography

Enye, indlela ethakazelisa kakhulu i-Pixel Shifting. Amanye amakhamera angenazibuko afana ne-Sony ne-Olympus aqala ukuyisekela ngo-2014, kodwa kwakusadingeka anamathisele umphumela ngesandla. Ukuqamba okusha kwekhamera enkulu.

Ama-Smartphones aphumelele lapha ngesizathu esihlekisayo - uma uthatha isithombe, izandla zakho ziyaqhaqhazela. Le nkinga ebonakala iyinkinga yakha isisekelo sokusetshenziswa kwesinqumo esihle kakhulu somdabu kuma-smartphones.

Ukuze uqonde ukuthi lokhu kusebenza kanjani, udinga ukukhumbula ukuthi i-matrix yanoma iyiphi ikhamera yakhiwe kanjani. Iphikseli ngalinye (photodiode) likwazi ukuqopha kuphela ubukhulu bokukhanya - okungukuthi, inani lama-photons angenayo. Nokho, i-pixel ayikwazi ukukala umbala wayo (ubude beza). Ukuze sithole isithombe se-RGB, bekumele sengeze nezinduku lapha - simboze yonke i-matrix ngegridi yezingcezu zengilazi ezinemibala eminingi. Ukuqaliswa kwayo okudume kakhulu kubizwa ngokuthi isihlungi se-Bayer futhi sisetshenziswa kumatrices amaningi namuhla. Kubukeka njengesithombe esingezansi.

Isihloko esisha: I-Computational Photography

Kuvele ukuthi iphikseli ngayinye ye-matrix ibamba kuphela ingxenye engu-R-, G- noma B, ngoba ama-photon asele aboniswa ngokungenaluzwela isihlungi se-Bayer. Ibona izingxenye ezingekho ngokulinganisa ngokusobala amanani amaphikseli angomakhelwane.

Kunamaseli aluhlaza engeziwe kusihlungi se-Bayer - lokhu kwenziwe ngokufanisa neso lomuntu. Kuvele ukuthi kumaphikseli ayizigidi ezingu-50 ku-matrix, okuluhlaza kuzothwebula izigidi ezingu-25, okubomvu nokuluhlaza okwesibhakabhaka - izigidi ezingu-12,5 ngalinye. lapho konke kuphumule.

Isihloko esisha: I-Computational Photography

Eqinisweni, i-matrix ngayinye ine-algorithm yayo yobuqili yedemosaicing enelungelo lobunikazi, kodwa ngezinjongo zale ndaba sizokushaya indiva lokhu.

Ezinye izinhlobo zikamatikuletsheni (ezifana neFoveon) azikakabanjwa. Yize abanye abakhiqizi bezama ukusebenzisa izinzwa ngaphandle kwesihlungi se-Bayer ukuthuthukisa ukucijile nobubanzi obuguqukayo.

Uma kunokukhanya okuncane noma imininingwane yento imincane kakhulu, silahlekelwa ulwazi oluningi ngoba isihlungi se-Bayer sinqamula ama-photon ngokusobala ngobude obungafunwa. Yingakho beqhamuke ne-Pixel Shifting - beshintsha i-matrix ngephikseli elingu-1 phezulu-phansi-kwesokudla-kwesokunxele ukuze bababambe bonke. Kulokhu, isithombe asiveli sibe sikhulu izikhathi ezi-4, njengoba kungase kubonakale, iphrosesa imane isebenzise le datha ukurekhoda ngokunembile inani lephikseli ngayinye. Ayilingani ngaphezu komakhelwane bayo, ngomqondo ongokomfanekiso, kodwa ngaphezu kwamanani amane ayo.

Isihloko esisha: I-Computational Photography

Ukuxhawula izandla zethu lapho sithatha izithombe ocingweni kwenza le nqubo ibe umphumela wemvelo. Ezinguqulweni zakamuva ze-Google Pixel, le nto iyasetshenziswa futhi ivulwa noma nini uma usebenzisa ukusondeza ocingweni - ibizwa nge-Super Res Zoom (yebo, ngiyathanda nokuqamba kwabo okungenaluzwela). AmaShayina nawo ayikopishela kuma- laophone awo, yize kwaba kubi kakhulu.

Ukumbondela izithombe ezigudluke kancane phezu kwesinye kukuvumela ukuthi uqoqe ulwazi olwengeziwe mayelana nombala wephikseli ngayinye, okusho ukunciphisa umsindo, ukukhulisa ukucijile nokukhulisa ukucaca ngaphandle kokwandisa inombolo ebonakalayo yama-megapixels we-matrix. Amafulegi esimanje e-Android akwenza lokhu ngokuzenzakalelayo, ngaphandle kokuthi abasebenzisi bawo bacabange ngakho.

#Ukupakisha okugxilile - noma yikuphi ukujula kwenkambu nokugxila kabusha ekukhiqizeni kwangemuva

Isihloko esisha: I-Computational Photography

Indlela ivela ezithombeni eziningi, lapho ukujula kwensimu bekulokhu kuyinkinga. Ukuze yonke into igxile, bekufanele uthathe amafreyimu amaningana ngokugxila ashintshele emuva naphambili, bese uwahlanganisa abe ocijile olulodwa. Indlela efanayo yayivame ukusetshenziswa abathwebuli bendawo, okwenza ingaphambili nengemuva libukhali njengohudo.

Isihloko esisha: I-Computational Photography

Konke lokhu kuphinde kuthuthele kuma-smartphones, yize kungekho hype enkulu. Ngo-2013, iNokia Lumia 1020 ene-“Refocus App” yakhululwa, kwathi ngo-2014, i-Samsung Galaxy S5 enemodi ethi “Selective Focus”. Basebenze ngohlelo olufanayo: ngokucindezela inkinobho, ngokushesha bathatha izithombe ezi-3 - esisodwa esigxile "esivamile", esesibili esigxilile sashintshela phambili kanti esesithathu sabuyisela emuva ukugxila. Uhlelo luqondaniswe nozimele futhi lwakuvumela ukuthi ukhethe olulodwa lwazo, olwathathwa njengokulawula kokugxila “kwangempela” ekukhiqizeni ngemuva.

Kwakungekho ukucutshungulwa okwengeziwe, ngoba ngisho nalokhu kugenca okulula kwakwanele ukushayelela esinye isipikili esivalweni sikaLytro nontanga bayo ngokugxila kwabo okuthembekile. By the way, ake sikhulume ngazo (inguquko master 80 lvl).

#Ama-matrices wekhompyutha - izinkambu ezikhanyayo nama-plenoptics

Njengoba sizwile ngenhla, omatikuletsheni bethu bayethusa ngezinduku. Sisanda kujwayela futhi siyazama ukuphila nakho. Isakhiwo sabo asishintshile kancane kusukela ekuqaleni kwesikhathi. Sithuthukise inqubo yobuchwepheshe kuphela - sehlise ibanga eliphakathi kwamaphikseli, salwa nomsindo wokuphazamiseka, futhi sengeza amaphikseli akhethekile okuthola isigaba se-autofocus. Kodwa uma uthatha ngisho ne-DSLR ebiza kakhulu bese uzama ukuthwebula ikati eligijima nayo ekamelweni lokukhanyisa - ikati, ukulibeka kancane, lizowina.

Isihloko esisha: I-Computational Photography

Kade sizama ukusungula okuthile okungcono. Imizamo eminingi kanye nocwaningo kule ndawo kusetshenziswa i-google "sensor computational" noma "non-bayer sensor", futhi ngisho nesibonelo se-Pixel Shifting esingenhla singabalulwa emizamweni yokuthuthukisa u-matric usebenzisa izibalo. Kodwa-ke, izindaba ezithembisa kakhulu kule minyaka engamashumi amabili edlule zize kithi ngokuqondile zivela emhlabeni walokho okubizwa ngokuthi amakhamera we-plenoptic.

Ukuze ungalali ngenxa yokulindela kwamagama ayinkimbinkimbi ezayo, ngizofaka ngaphakathi ukuthi ikhamera ye-Google Pixel yakamuva imane nje iyi-plenoptic “kancane”. Amaphikseli amabili nje, kodwa ngisho nalokhu kuyivumela ukubala ukujula okulungile kokubona kohlaka ngisho nangaphandle kwekhamera yesibili, njengawo wonke umuntu.

I-Plenoptics isikhali esinamandla esingakadumi. Nasi isixhumanisi esiya kwenye yezintandokazi zami zakamuva. izihloko mayelana namakhono amakhamera we-plenoptic kanye nekusasa lethu nawo, lapho ngiboleke khona izibonelo.

#

Ikhamera ye-Plenoptic - iyeza maduze

Yasungulwa ngo-1994, yaqoqwa eStanford ngo-2004. Ikhamera yokuqala yabathengi, i-Lytro, yakhululwa ngo-2012. Imboni ye-VR manje izama ngenkuthalo ubuchwepheshe obufanayo.

Ikhamera ye-plenoptic ihluke kwikhamera evamile ekuguqulweni okukodwa kuphela - i-matrix yayo imbozwe ngegridi yamalensi, ngayinye ehlanganisa amaphikseli amaningana wangempela. Okufana nalokhu:

Isihloko esisha: I-Computational Photography

Uma ubala kahle ibanga ukusuka kugridi ukuya ku-matrix kanye nosayizi wembobo, isithombe sokugcina sizoba namaqoqo acacile wamaphikseli - uhlobo lwezinguqulo ezincane zesithombe sokuqala.

Kuvele ukuthi uma uthatha, uthi, iphikseli eyodwa emaphakathi kuqoqo ngalinye bese unamathisela isithombe ndawonye usebenzisa zona kuphela, ngeke kuhluke kulokho okuthathwe ngekhamera evamile. Yebo, silahlekelwe kancane ekulungisweni, kodwa sizovele sicele u-Sony ukuthi engeze amanye ama-megapixel kumatric amasha.

Isihloko esisha: I-Computational Photography

Ubumnandi buyaqala. uma uthatha elinye iphikseli eqoqweni ngalinye bese uhlanganisa isithombe futhi, uzothola isithombe esijwayelekile futhi, kube sengathi sithathwe ngokushintshwa kwephikseli eyodwa. Ngakho, ngokuba namaqoqo amaphikseli angu-10 × 10, sizothola izithombe eziyi-100 zento kusuka kumaphuzu “kancane” ahlukene.

Isihloko esisha: I-Computational Photography

Usayizi weqoqo elikhulu usho izithombe eziningi, kodwa ukulungiswa okuphansi. Emhlabeni wama-smartphone anamatrices angu-41-megapixel, nakuba singase singakunaki isinqumo kancane, kunomkhawulo kukho konke. Kufanele ugcine ibhalansi.

Kulungile, sihlanganise ikhamera ye-plenoptic, ngakho lokho kusinikani?

Ukugxila kabusha okuthembekile

Isici zonke izintatheli ebezibhuza ngaso ezihlokweni ezimayelana ne-Lytro bekuyikhono lokulungisa ngokwethembeka ukugxila ekukhiqizweni kwangemuva. Ngobulungisa sisho ukuthi asisebenzisi noma yimaphi ama-algorithms wokufiphalisa, kodwa sisebenzisa ngokukhethekile amaphikseli aseduze, siwakhetha noma siwalinganise kumaqoqo ngendlela edingekayo.

Ukuthwebula izithombe OKUHLAZA okuvela kukhamera ye-plenoptic kubukeka kuxakile. Ukuze ukhiphe i-jeep ebukhali evamile kuyo, kufanele uqale uyihlanganise. Ukuze wenze lokhu, udinga ukukhetha iphikseli ngayinye ye-jeep kwelinye lamaqoqo e-RAW. Kuya ngokuthi sizikhetha kanjani, umphumela uzoshintsha.

Isibonelo, uma iqoqo liqhubeka lisuka endaweni yesigameko se-beam yasekuqaleni, yilapho le nsimbi ingagxili kakhulu. Ngoba optics. Ukuze sithole isithombe esishintshiwe, sidinga nje ukukhetha amaphikseli ebangeni olifunayo ukusuka kwesangempela - eduze noma ngaphezulu.

Isihloko esisha: I-Computational Photography

 

Bekunzima kakhulu ukushintsha ukugxila kuwena - ngokwasemzimbeni kuphela, abemaphikseli anjalo ambalwa kumaqoqo. Ekuqaleni, abathuthukisi abafuni ngisho nokunikeza umsebenzisi amandla okugxila ngezandla zabo-ikhamera ngokwayo inqume lokhu kusofthiwe. Abasebenzisi abazange balithande leli kusasa, ngakho-ke bangeze isici ku-firmware yakamuva ebizwa ngokuthi “imodi yokudala,” kodwa baphinde bagxila kukho kukhawulelwe ngenxa yalesi sizathu.

Imephu yokujula kanye ne-3D kusuka kukhamera eyodwa   

Omunye wemisebenzi elula ku-plenoptics ukuthola imephu ejulile. Ukuze wenze lokhu, udinga nje ukuqoqa amafreyimu amabili ahlukene futhi ubale ukuthi izinto ezikuzo zigudluke kangakanani. Ukushintsha okuningi kusho ukuba kude nekhamera.

I-Google isanda kuthenga futhi yabulala i-Lytro, kodwa yasebenzisa ubuchwepheshe bayo nge-VR yayo kanye... ngekhamera ye-Pixel. Iqala nge-Pixel 2, ikhamera yaba i-plenoptic "kancane" okokuqala, nakuba yaba namaqoqo amaphikseli amabili kuphela. Lokhu kunikeze i-Google ithuba lokungafaki ikhamera yesibili, njengabo bonke abanye abafana, kodwa ukubala imephu ejulile kuphela esithombeni esisodwa.

Isihloko esisha: I-Computational Photography

Isihloko esisha: I-Computational Photography

Imephu yokujula yakhiwe kusetshenziswa ozimele ababili abahanjiswe ngephikseli eyodwa eyodwa. Lokhu kwanele ukubala imephu yokujula kanambambili futhi uhlukanise ingaphambili nengemuva bese ufiphalisa okwakamuva nge-bokeh esemfashinini manje. Umphumela wokwendlaleka okunjalo ubuye uhlelwe kahle futhi “uthuthukiswe” amanethiwekhi e-neural aqeqeshelwe ukuthuthukisa amamephu ajulile (hhayi ukufiphala, njengoba abantu abaningi becabanga).

Isihloko esisha: I-Computational Photography

Iqhinga ukuthi sithole ama-plenoptics kuma-smartphone cishe mahhala. Sesivele sifake amalensi kulawa matrices amancane ukuze ngandlela thize sandise ukugeleza okukhanyayo. Ku-Pixel elandelayo, i-Google ihlela ukuya phambili futhi imboze ama-photodiode amane ngelensi.

Source: 3dnews.ru

Engeza amazwana