Chinyorwa chitsva: Computational Photography

Chinyorwa chekutanga chakaiswa pawebhusaiti Vastrik.ru uye yakaburitswa pa3DNews nemvumo yemunyori. Isu tinopa iyo yakazara zvinyorwa zvechinyorwa, kunze kwehuwandu hukuru hwezvibatanidza - zvichave zvinobatsira kune avo vanofarira zvakanyanya musoro wenyaya uye vanoda kudzidza iwo theoretical maficha ekunyora mafoto mune zvakadzama, asi kune a vanhuwo zvavo takaona izvi sezvisina basa.  

Nhasi, hapana kana imwe mharidzo ye smartphone inokwana isina kunanzva kamera yayo. Mwedzi wega wega tinonzwa nezve kubudirira kunotevera kwemakamera enhare: Google inodzidzisa Pixel kupfura murima, Huawei kuswededza semabhainokura, Samsung inoisa lidar, uye Apple inoita makona akatenderedza pasirese. Kune nzvimbo shoma uko hutsva hunoyerera nekukurumidza mazuva ano.

Panguva imwecheteyo, magirazi anoita seanotara nguva. Sony gore negore inogeza munhu wese nematrice matsva, uye vagadziri vanovandudza husimbe hweshanduro yazvino dhijiti uye vanoramba vachizorora nekuputa padivi. Ndine $3000 DSLR padhesiki rangu, asi pandinofamba, ndinotora iPhone yangu. Sei?

Sezvakataurwa nekirasi, ndakaenda online nemubvunzo uyu. Ikoko ivo vanokurukura mamwe "algorithms" uye "neural network", vasina kana zano rekuti zvinokanganisa sei kutora mafoto. Vatori venhau vari kuverenga nenzwi guru huwandu hwema megapixels, mablogiki ari kuona akabhadharwa unboxing pamwe chete, uye aesthetes vari kuzvizora ne "maonero enyama epalette yeruvara rwematrix." Zvese zviri semazuva ese.

Ndaifanira kugara pasi, kupedza hafu yeupenyu hwangu uye ndizvionese pachangu. Munyaya ino ndichakuudza zvandakadzidza.

⇑#Chii chinonzi computational photography?

Kwese kwese, kusanganisira Wikipedia, vanopa chimwe chinhu senge dudziro iyi: computational kutora mafoto chero mufananidzo wekutora uye kugadzirisa maitiro anoshandisa digital komputa pachinzvimbo chekuchinja kwemaziso. Zvose pamusoro pazvo zvakanaka, kunze kwekuti hapana chinotsanangura. Kunyange autofocus yakakodzera iyo, asi plenoptics, iyo yakatotiunzira zvinhu zvakawanda zvinobatsira, haikodzeri. Kusajeka kwetsananguro dzepamutemo kunoratidzika kunge kunoratidza kuti isu hatizive zvatiri kutaura nezvazvo.

Iye piyona wekufananidza kutora mifananidzo, Stanford purofesa Marc Levoy (uyo ave kuita kamera kuGoogle Pixel) anopa imwe tsananguro - seti yenzira dzekuona komputa dzinovandudza kana kuwedzera kugona kwemifananidzo yedhijitari, uchishandisa iyo foto yenguva dzose inowanikwa iyo. haina kukwanisa kutorwa neyakapuwa kamera nenzira yechinyakare. Muchinyorwa ini ndinoomerera kune izvi.

Saka, ma smartphones aikonzeresa zvese.

MaSmartphones aive asina sarudzo kunze kwekuzvara rudzi rutsva rwekutora mifananidzo: computational photography.

Matinji avo madiki ane ruzha nemalenzi madiki anopinza, maererano nemitemo yese yefizikisi, aifanira kunge akaunza marwadzo nekutambura chete. Vakaita izvi kusvikira vavakudziri vaona mashandisiro avangaita masimba avo zvine hungwaru kuti vakunde kusasimba kwavo - kukurumidza zvivharo zvemagetsi, mapurosesa ane simba uye software.

Chinyorwa chitsva: Computational Photography

Mazhinji ekutsvagisa kwepamusoro-soro mumunda wekutorwa kwemifananidzo kwakaitika pakati pa2005 na2015, iyo mune sainzi inoonekwa sezvazviri nezuro. Parizvino, pamberi pemeso edu uye muhomwe dzedu, ndima itsva yeruzivo uye tekinoroji iri kukura iyo isati yambovapo.

Computational kutora mafoto hakungori nezve selfies ine neuro-bokeh. Mufananidzo uchangoburwa wegomba dema waisazogoneka pasina hunyanzvi hwekutora mifananidzo. Kuti titore mufananidzo wakadaro neteresikopu yenguva dzose, taizofanira kuugadzira hukuru hwePasi. Nekudaro, nekubatanidza data kubva kumateresikopu masere eredhiyo panzvimbo dzakasiyana pabhora redu uye kunyora zvinyorwa zvishoma muPython, takawana mufananidzo wekutanga wepasi rose wechiitiko ichi. Zvakanaka kune selfies zvakare.

Chinyorwa chitsva: Computational Photography

⇑#Kutanga: digital processing

Ngatimbofungidzira kuti takadzoka 2007. Amai vedu vane mhirizhonga, uye mapikicha edu ane ruzha 0,6-megapixel jeep akatorwa pa skateboard. Nenguva iyo isu tine yekutanga isingadzivisiki chishuwo chekumwaya presets pavari kuitira kuvanza hurombo hwe mobile matrices. Ngatirege kuzviramba.

Chinyorwa chitsva: Computational Photography

⇑#Matan uye Instagram

Nekuburitswa kwe Instagram, munhu wese akabatikana nemafirita. Semunhu akadzosera kumashure-injiniya X-Pro II, Lo-Fi neValencia kuitira, hongu, zvinangwa zvekutsvagisa, ndichiri kurangarira kuti zvaisanganisira zvinhu zvitatu:

  • Zvirongwa zvemavara (Hue, Saturation, Lightness, Contrast, Levels, etc.) - akareruka edhijitari coefficients, sezvakangoita chero presets mapikicha akashandisa kubvira kare.
  • Tone Mappings mavekita ezvinokosha, rimwe nerimwe raitiudza kuti: β€œRuvara dzvuku rine tint ye128 rinofanira kuchinjwa kuva tint ye240.”
  • Kufukidzira mufananidzo unopenya une huruva, zviyo, vignette, uye zvimwe zvese zvinogona kuiswa pamusoro kuti uwane iyo isingaite zvachose banal mhedzisiro yefirimu rekare. Akanga asiripo nguva dzose.   

Mafirita emazuva ano haasi kure neatatu aya, angove akanyanya kuomarara mumasvomhu. Nekuuya kwehardware shaders uye OpenCL pamafoni efoni, dzakakurumidza kunyorwazve kuGPU, uye izvi zvainzi zvinotonhorera. Kwa2012, hongu. Nhasi, chero mudzidzi anogona kuita zvakafanana muCSS, uye haasati awana mukana wekupedza kudzidza.

Zvisinei, kufambira mberi kwemasefa hakuna kumira nhasi. Vakomana vanobva kuDehanser, semuenzaniso, vakanaka pakushandisa mafirita asina mutsara - pachinzvimbo che proletarian toni mepu, vanoshandisa zvakanyanya kuomarara shanduko dzisiri dzemitsetse, izvo, maererano navo, zvinovhura mikana yakawanda.

Iwe unogona kuita zvinhu zvakawanda neasina mutsara shanduko, asi iwo akaomarara zvakanyanya, uye isu vanhu takapusa zvisingaite. Kana zvangosvika kune dzisiri mutsara shanduko musainzi, isu tinosarudza kuenda kunhamba nzira uye cram neural network kwese kwese kuti vanyore hunyanzvi kwatiri. Zvakanga zvakafanana pano.

⇑#Automation uye zviroto zve "masterpiece" bhatani

Pakangosvika munhu wese kujaira kusefa, takatanga kuvavaka zvakananga mumakamera. Nhoroondo inovanza kuti ndeupi mugadziri aive wekutanga, asi kungonzwisisa kuti yaive nguva yakareba sei - muIOS 5.0, yakaburitswa muna 2011, pakanga patove neruzhinji API yeAuto Enhancing Images. Mabasa chete ndiye anoziva kuti yakatora nguva yakareba sei isati yavhurwa kune veruzhinji.

Iyo otomatiki yakaita chinhu chimwe chete icho mumwe nemumwe wedu anoita pakuvhura foto mupepeti - yakaburitsa maburi muchiedza nemumvuri, yakawedzera saturation, yakabvisa maziso matsvuku uye yakatsiga ganda. Vashandisi havana kana kumboziva kuti "kamera yakagadziridzwa" muiyo nyowani smartphone yaingova mafaniro emamwe mashadhi matsva. Kwakanga kuchine makore mashanu asara pamberi pekuburitswa kweGoogle Pixel uye kutanga kweiyo computational mafoto hype.

Chinyorwa chitsva: Computational Photography

Nhasi, hondo yebhatani re "masterpiece" yaenda kumunda wekudzidza muchina. Mushure mekutamba zvakakwana nemepu yematoni, munhu wese akamhanya kudzidzisa maCNN nemaGAN kufambisa masiraidhi pachinzvimbo chemushandisi. Mune mamwe mazwi, kubva pamufananidzo wekuisa, sarudza seti yeakakwana ma paramita angaunza mufananidzo uyu padyo nekumwe kunzwisiswa kwe "zvakanaka kutora mafoto." Inoitwa mune imwecheteyo Pixelmator Pro uye vamwe vapepeti. Inoshanda, sezvaungafungidzira, kwete zvakanyanya uye kwete nguva dzose. 

⇑#Stacking ndiyo 90% yekubudirira kwemakamera efoni

Kutora mifananidzo kwechokwadi kwakatanga nekurongedza-kuisa mafoto akawanda pamusoro peumwe neumwe. Haisi dambudziko kune smartphone kudzvanya gumi nemaviri mafuremu muhafu yechipiri. Makamera avo haana zvikamu zvinononoka zvemagetsi: aperture yakagadziriswa, uye panzvimbo yeketeni rinofamba kune chivharo chemagetsi. Iyo processor inongoraira matrix kuti mangani mamicroseconds aanofanira kubata emusango mafotoni, uye anoverenga mhedzisiro.

Nehunyanzvi, foni inogona kutora mafoto nekumhanyisa vhidhiyo, uye vhidhiyo pakugadziriswa kwemafoto, asi zvese zvinoenderana nekumhanya kwebhazi uye processor. Ndicho chikonzero vanogara vachiisa miganhu yepurogiramu.

Staking pachayo yave nesu kwenguva yakareba. Kunyange sekuru vakaisa plugins paPhotoshop 7.0 kuti vaunganidze mafoto akati wandei muHDR inobata maziso kana kusona pamwe panorama ye18000 Γ— 600 pixels uye... kutaura zvazviri, hapana akambofunga zvekuita navo anotevera. Zvainzwisa tsitsi kuti nguva dzaive dzakapfuma uye dzesango.

Iye zvino tave vanhu vakuru uye tinozvidaidza kuti "epsilon photography" - apo, nekushandura imwe yekamera parameters (kuratidzwa, kutarisa, nzvimbo) uye kubatanidza pamwe chete mafuremu anoguma, tinowana chimwe chinhu chaisakwanisa kutorwa mune imwe furemu. Asi iri ishoko re theorists; mukuita, rimwe zita ratora midzi - staking. Nhasi, chokwadi, 90% yezvese zvitsva mumakamera emafoni anobva pairi.

Chinyorwa chitsva: Computational Photography

Chimwe chinhu chisingafungirwe nevanhu vazhinji, asi zvakakosha kuti unzwisise zvese zvefoni uye komputa kutora mafoto: kamera pane yemazuva ano smartphone inotanga kutora mafoto paunongovhura app yayo. Izvo zvine musoro, nekuti anofanirwa kuendesa mufananidzo kuchiratidziro. Nekudaro, mukuwedzera kune iyo skrini, inochengetedza yakakwirira-resolution mafuremu mune yayo loop buffer, kwainoachengeta kwemasekonzi akati wandei.

Paunodzvanya bhatani rekuti "tora mufananidzo", rinenge ratotorwa, kamera inongotora mufananidzo wekupedzisira kubva kubhafa.

Aya ndiwo mashandiro anoita chero nharembozha inoshanda nhasi. Kanenge mune zvese mureza kwete kubva mumarara. Buffering inobvumidza iwe kuti uone kwete kungoita zero shutter lag, iyo vatori vemifananidzo vagara vachirota nezvayo, asi kunyange zvisina kunaka - kana iwe ukadzvanya bhatani, iyo smartphone inotarisa mune yakapfuura, inoburitsa ekupedzisira 5-10 mafoto kubva mubuffer uye inotanga kupenengura kuongorora. wozvinamira. Hapasisina kumirira kuti foni idzvanye mafuremu eHDR kana husiku modhi - ingoatora kubva mubuffer, mushandisi haatomboziva.

Chinyorwa chitsva: Computational Photography

Nenzira, iri nerubatsiro rweakaipa shutter lag iyo Live Photo inoshandiswa muPhones, uye HTC yaive nechimwe chinhu chakafanana kumashure muna 2013 pasi pezita risinganzwisisike Zoe.

⇑#Exposure stacking - HDR uye kurwisa kupenya shanduko

Chinyorwa chitsva: Computational Photography

Kunyangwe ma sensors ekhamera achikwanisa kutora huwandu hwese hwekupenya huripo kumaziso edu inyaya yekare inopisa yekukakavadzana. Vamwe vanoti kwete, nokuti ziso rinokwanisa kuona kusvika ku25 f-stops, nepo kunyange kubva kumusoro yakazara-frame matrix iwe unogona kuwana huwandu hwe 14. Vamwe vanodana kuenzanisa kusina kururama, nokuti uropi hunobatsira ziso nekuzvigadzirisa mudzidzi uye kupedzisa chifananidzo nemanetiweki ayo, uye pakarepo The dynamic range of the eye is actually no more than just 10-14 f-stops. Ngatisiyirei gakava iri kune vakanyanya armchair vanofunga paInternet.

Chokwadi chinoramba chiripo: kana ukapfura shamwari mudenga rakajeka risina HDR pane chero nharembozha, unowana denga rakajairwa uye zviso zvitema zveshamwari, kana shamwari dzakakwevedzwa zvakanaka, asi denga rakatsva kusvika rafa.

Mhinduro yakagara yakagadzirwa - kuwedzera kupenya kwemhando uchishandisa HDR (High dynamic range). Iwe unofanirwa kutora mafuremu akati wandei pane akasiyana shutter kumhanya woasona pamwechete. Saka iyo iyo "yakajairika", yechipiri inoreruka, yechitatu yakasviba. Isu tinotora nzvimbo dzakasviba kubva kune mwenje furemu, zadza zvakawandisa kubva kune yakasviba - purofiti. Chinosara ndechekugadzirisa dambudziko reotomatiki bracketing - ingani yekuchinjisa kuratidzwa kwega yega furemu kuti urege kuipfuura, asi iye zvino mudzidzi wegore rechipiri payunivhesiti yehunyanzvi anogona kubata kuona avhareji kupenya kwemufananidzo.

Chinyorwa chitsva: Computational Photography

Pane ichangoburwa iPhone, Pixel neGalaxy, HDR modhi inowanzobatidzwa otomatiki kana iri nyore algorithm mukati mekamera yaona kuti uri kupfura chimwe chinhu chakasiyana pazuva rakajeka. Iwe unogona kutoona kuti foni inoshandura sei iyo yekurekodha modhi kune buffer kuitira kuchengetedza mafuremu akachinjika mukuratidzwa - iyo fps mumera inodonha, uye pikicha pachayo inova juicier. Iyo nguva yekuchinja inooneka zvakajeka pane yangu iPhone X kana uchitora mafirimu kunze. Tarisa zvakanyanya pane yako smartphone nguva inotevera zvakare.

Iyo yakashata yeHDR ine exposure bracketing ndiko kusapinda kwayo kusapinda mukuvhenekerwa kwakashata. Kunyangwe nechiedza cherambi remukamuri, mafuremu anobuda akasviba zvekuti komputa haigone kurongeka nekuabatanidza pamwechete. Kugadzirisa dambudziko nechiedza, muna 2013 Google yakaratidza imwe nzira yeHDR mune yakazoburitswa Nexus smartphone. Akashandisa nguva stacking.

⇑#Nguva stacking - kureba kuratidzwa simulation uye kupera nguva

Chinyorwa chitsva: Computational Photography

Nguva yakaturikidzana inokubvumira kuti ugadzire kuratidzwa kwenguva refu uchishandisa akatevedzana mapfupi. Mapiyona acho aive mafani ekutora mifananidzo nzira dzenyeredzi mudenga rehusiku, avo vakawana zvisingaite kuvhura chivharo kwemaawa maviri kamwechete. Zvakanga zvakaoma kuverenga zvigadziriso zvese pachine nguva, uye kuzununguka kudiki kwaizoparadza furemu yese. Vakasarudza kuzarura chivharo chete kwemaminitsi mashomanana, asi kakawanda, ndokubva vaenda kumba ndokunamatidza mapuranga akabuda mu Photoshop.

Chinyorwa chitsva: Computational Photography

Zvinoitika kuti kamera haina kumbobvira yapfura nekumhanya kwevhavha refu, asi isu takawana mhedzisiro yekuitevedzera nekuwedzera akati wandei mafuremu akatorwa mumutsara. Pave paine boka remaapplication akanyorerwa mafoni anoshandisa hunyengeri uhwu kwenguva yakareba, asi ese haadiwe sezvo chimiro chakawedzerwa kune angangoita ese akajairwa makamera. Nhasi, kunyange iPhone inogona kusona nyore pamwechete kuratidzwa kwenguva refu kubva kuLive Photo.

Chinyorwa chitsva: Computational Photography

Ngatidzokerei kuGoogle nehusiku hwayo HDR. Zvakazoitika kuti uchishandisa nguva bracketing unogona kuita yakanaka HDR murima. Iyo tekinoroji yakatanga kuoneka muNexus 5 uye yakanzi HDR+. Mamwe ese emafoni eAndroid akazvigamuchira sekunge sechipo. Tekinoroji ichiri kufarirwa zvekuti inotorumbidzwa mukuratidzwa kweazvino maPixels.

HDR + inoshanda zvakapusa: waona kuti uri kupfura murima, kamera inoburitsa ekupedzisira 8-15 RAW mafoto kubva mubuffer kuitira kuti aafukidze pamusoro peumwe neumwe. Nekudaro, iyo algorithm inounganidza rumwe ruzivo nezve nzvimbo dzakasviba dzefuremu kuderedza ruzha - pixels uko, pane chimwe chikonzero, kamera haina kukwanisa kuunganidza ruzivo rwese uye yakashata.

Zvakafanana kana iwe usingazive kuti capybara yakaita sei uye ukabvunza vanhu vashanu kuti vatsanangure, nyaya dzavo dzingangofanana, asi imwe neimwe yaizotaura imwe yakasarudzika. Nenzira iyi waizounganidza ruzivo rwakawanda pane kungobvunza rimwe chete. Zvakafanana nemapikiseli.

Kuwedzera mafuremu akatorwa kubva pane imwe nzvimbo kunopa yakafanana fake yekuratidzwa kwenguva refu senge nyeredzi dziri pamusoro. Kuratidzwa kwemafuremu akawanda kunopfupikiswa, kukanganisa mune imwe kunoderedzwa mune mamwe. Fungidzira kuti kangani kawaizofanira kudzvanya iyo DSLR shutter nguva dzese kuti uite izvi.

Chinyorwa chitsva: Computational Photography

Chakanga chasara ndechekugadzirisa dambudziko rekugadziriswa kwemavara otomatiki - mafuremu anotorwa murima anowanzo kubuda yero kana girinhi, uye isu tinoda kupfuma kwemasikati. Mushanduro dzekutanga dzeHDR +, izvi zvakagadziriswa nekungogadzirisa zvigadziriso, semasefa a Instagram. Vakabva vafonera neural network kuti ibatsire.

Aya ndiwo mabudiro akaita Night Sight - tekinoroji ye "night photography" muPixel 2 ne3. Mutsanangudzo vanoti: "Makine ekudzidza emuchina akavakirwa pamusoro peHDR+, anoita kuti Night Sight ishande." Muchidimbu, iyi ndiyo automation yedanho rekugadzirisa mavara. Muchina uyu wakadzidziswa pane dataset ye "pamberi" uye "mushure" mapikicha kuitira kugadzira imwe yakanaka kubva kune chero seti yerima yakatsveyama mafoto.

Chinyorwa chitsva: Computational Photography

Nenzira, iyo dataset yakaitwa pachena. Zvichida vakomana vanobva kuApple vachaitora uye pakupedzisira vanodzidzisa mafoshoro avo egirazi kutora mifananidzo zvakanaka murima.

Uye zvakare, Night Sight inoshandisa kuverenga kweiyo inofamba vheti yezvinhu zviri mufuremu kuti igadzirise blur iyo ine chokwadi chekuitika nekumhanya kwevhavha refu. Saka, iyo smartphone inogona kutora zvikamu zvakajeka kubva kune mamwe mafuremu nekuanamatira.

⇑#Motion stacking - panorama, superzoom uye kuderedza ruzha

Chinyorwa chitsva: Computational Photography

Panorama ivaraidzo yakakurumbira kune vagari vekumaruwa. Nhoroondo haisati yaziva nezve chero nyaya umo foto yesoseji ingave inofarira kune chero munhu kunze kwemunyori wayo, asi haigone kufuratirwa - kune vazhinji, apa ndipo pakatanga kurongedza.

Chinyorwa chitsva: Computational Photography

Nzira yekutanga inobatsira yekushandisa panorama ndeyekutora mufananidzo wepamusoro resolution pane iyo kamera matrix inobvumira nekubatanidza pamwechete akati wandei mafuremu. Vatori vemifananidzo vagara vachishandisa software yakasiyana yeanonzi super-resolution mafoto - kana mafoto akachinjika zvishoma anoita seanopindirana pakati pemapikisi. Nenzira iyi unogona kuwana mufananidzo weanenge mazana egigapixels, iyo inobatsira zvikuru kana iwe uchida kuidhinda pane poster yekushambadzira saizi yeimba.

Chinyorwa chitsva: Computational Photography

Imwe, nzira inonakidza ndeyePixel Shifting. Mamwe makamera asina girazi seSony neOlympus akatanga kutsigira kumashure muna 2014, asi vaifanira kunama mhedzisiro nemaoko. Magadzirirwo emakamera makuru.

Mafonifoni akabudirira pano nechikonzero chinosetsa - paunotora mufananidzo, maoko ako anodedera. Iri raiita kunge dambudziko rakagadzira hwaro hwekuitwa kweiyo native super resolution pane smartphones.

Kuti unzwisise kuti izvi zvinoshanda sei, unofanirwa kuyeuka kuti matrix yechero kamera yakagadziridzwa sei. Imwe neimwe yemapikisi ayo (photodiode) inokwanisa kurekodha chete kusimba kwechiedza - ndiko kuti, nhamba yemafotoni anouya. Nekudaro, pixel haigone kuyera ruvara rwayo (wavelength). Kuti tiwane mufananidzo weRGB, taifanira kuwedzera madondoro pano zvakare - kuvhara matrix yese negridi yezvimedu zvegirazi zvine mavara mazhinji. Kuitwa kwayo kunonyanya kufarirwa kunonzi Bayer sefa uye inoshandiswa mumatrices mazhinji nhasi. Inoratidzika semufananidzo uri pasi apa.

Chinyorwa chitsva: Computational Photography

Zvinoitika kuti pixel yega yega yematrix inobata chete R-, G- kana B-chikamu, nekuti mafotoni asara anoratidzwa zvisina tsitsi neBayer sefa. Iyo inoziva izvo zvisipo nekunyatso kuyera kukosha kwevavakidzani pixels.

Kune mamwe masero egirinhi muBayer sefa - izvi zvakaitwa nekuenzanisa neziso remunhu. Zvinoitika kuti kubva pamamiriyoni makumi mashanu pixels pamatrix, yegirini ichatora 50 miriyoni, tsvuku nebhuruu - 25 miriyoni imwe neimwe.Amwe ese anozoverengerwa - maitiro aya anonzi debayerization kana demosaicing, uye iyi iine mafuta anonakidza crutch on. izvo zvose zvinozorora.

Chinyorwa chitsva: Computational Photography

Muchokwadi, imwe neimwe matrix ine yayo yakangwara patented demosaicing algorithm, asi nezvinangwa zveiyi nyaya isu ticharegeredza izvi.

Mamwe marudzi ematrices (akadai seFoveon) neimwe nzira haisati yabatwa. Kunyangwe vamwe vagadziri vari kuyedza kushandisa masensa pasina Bayer sefa kuvandudza kupinza uye simba renji.

Kana paine mwenje mudiki kana ruzivo rwechinhu chidiki kwazvo, tinorasikirwa neruzivo rwakawanda nekuti iyo Bayer sefa inodimbura zviri pachena mafotoni neasingadiwe wavelength. Ndosaka vauya nePixel Shifting - kushandura matrix ne1 pixel kumusoro-pasi-kurudyi-kuruboshwe kuti vabate vese. Muchiitiko ichi, mufananidzo wacho hauiti kuva 4 nguva yakakura, sezvazvingaita sekuti, processor inongoshandisa iyi data kuti inyatsonyora kukosha kwepixel imwe neimwe. Iyo mavhareji kwete pamusoro pevavakidzani vayo, sekutaura, asi pamusoro pemakoshero mana ega.

Chinyorwa chitsva: Computational Photography

Kudzungudza maoko edu kana tichitora mapikicha parunhare kunoita kuti kuita uku kuve mugumisiro wechisikigo. Mushanduro dzichangoburwa dzeGoogle Pixel, chinhu ichi chinoitwa uye chinobatidzwa pese paunoshandisa zoom pafoni - inonzi Super Res Zoom (hongu, ini ndinodawo mazita avo asina tsitsi). MaChinese akazvikopawo mumalaophones avo, kunyangwe zvakazonyanya kuipa.

Kuvhara mapikicha akachinjika zvishoma pamusoro peumwe neumwe kunobvumidza iwe kuunganidza rumwe ruzivo nezve ruvara rwepixel yega yega, zvinoreva kuderedza ruzha, kuwedzera kupinza uye kusimudza kugadzirisa pasina kuwedzera huwandu hwemuviri wema megapixels ematrix. Mazuva ano Android mureza anoita izvi otomatiki, pasina vashandisi vawo kana kufunga nezvazvo.

⇑#Focus stacking - chero kudzika kwemunda uye refocus mune post-kugadzirwa

Chinyorwa chitsva: Computational Photography

Iyo nzira inobva ku macro mafoto, uko kudzika kwemunda kwagara kuri dambudziko. Kuti chinhu chose chive mukutarisa, waifanira kutora mafuremu akati wandei nekutarisa achichinjika kumashure nekudzoka, wozoabatanidza pamwechete kuita imwe yakapinza. Mutoo mumwe chetewo waiwanzoshandiswa nevatorwa vemifananidzo yenzvimbo, zvichiita kuti kumberi uye kumashure kuve kwakapinza semanyoka.

Chinyorwa chitsva: Computational Photography

Zvese izvi zvakatamira kune mafoni, kunyangwe pasina hype yakawanda. Muna 2013, Nokia Lumia 1020 ine "Refocus App" yakaburitswa, uye muna 2014, Samsung Galaxy S5 ine "Selective Focus" maitiro. Vakashanda zvinoenderana nechirongwa chimwechete: nekudzvanya bhatani, vakakurumidza kutora mafoto matatu - imwe ine "yakajairika" kutarisa, yechipiri ine tarisiro yakachinjika kumberi uye yechitatu nekutarisa kumashure. Iyo purogiramu yakarongedza mafuremu uye yakakubvumidza iwe kuti usarudze imwe yadzo, iyo yainzi "chaiyo" yekutarisa kudzora mune post-kugadzirwa.

Pakanga pasisinazve kugadzirisa, nekuti kunyangwe iyi hack iri nyore yaive yakakwana kurovera imwe mbambo muchivharo cheLytro nevezera rayo nekutendeseka kwavo refocus. Nenzira, ngatitaure pamusoro pavo (shanduko tenzi 80 lvl).

⇑#Computational matrices - chiedza minda uye plenoptics

Sezvatakanzwisisa pamusoro, matrices edu anotyisa pamadondoro. Takangozvijaira uye tiri kuedza kurarama nazvo. Chimiro chavo chachinja zvishoma kubva pakutanga kwenguva. Isu takangovandudza tekinoroji maitiro - takadzikisa chinhambwe pakati pemapikseli, kurwisa ruzha rwekukanganisa, uye nekuwedzera akakosha mapikseli echikamu chekuona autofocus. Asi kana iwe ukatora kunyange iyo inodhura zvikuru DSLR uye edza kupfura katsi inomhanya nayo muimba yekuvhenekera - katsi, kuisa zvinyoro, ichakunda.

Chinyorwa chitsva: Computational Photography

Tave tichiedza kugadzira chimwe chinhu chiri nani kwenguva yakareba. Kuedza kwakawanda uye kutsvagisa munzvimbo ino kwakaiswa google ye "computational sensor" kana "non-bayer sensor", uye kunyange iyo Pixel Shifting muenzaniso uri pamusoro inogona kuverengerwa kuedza kuvandudza matrices uchishandisa macalculation. Nekudaro, nyaya dzinonyanya kuvimbisa mumakore makumi maviri apfuura dzakauya kwatiri chaizvo kubva munyika yeanonzi plenoptic kamera.

Kuti urege kurara kubva pakutarisira mazwi akaoma ari kuuya, ini ndichakanda mukati kuti kamera yeGoogle Pixel ichangoburwa inongova "zvishoma" plenoptic. Ingori mapixels maviri, asi kunyangwe izvi zvinozvibvumidza kuverenga kudzika kwakaringana kwefiremu kunyangwe isina yechipiri kamera, sevamwe vese.

Plenoptics chombo chine simba chisati chapfura. Heino link kune imwe yandinofarira ichangoburwa. zvinyorwa nezve kugona kwemakamera eplenoptic uye ramangwana redu navo, kwandakakwereta mienzaniso kubva.

⇑#

Plenoptic kamera - iri kuuya munguva pfupi

Yakagadzirwa muna 1994, yakaunganidzwa kuStanford muna 2004. Yekutanga mutengi kamera, Lytro, yakaburitswa mu2012. Indasitiri yeVR ikozvino yave kuyedza nehunyanzvi matekinoroji akafanana.

Iyo plenoptic kamera inosiyana neyakajairwa kamera mune imwe chete shanduko - matrix ayo akafukidzwa negidhi remalenzi, imwe neimwe inovhara akati wandei mapixels chaiwo. Chinhu chakadai:

Chinyorwa chitsva: Computational Photography

Kana iwe ukaverenga nemazvo chinhambwe kubva kune grid kusvika kune matrix uye saizi yeaperture, chifananidzo chekupedzisira chichava nemasumbu akajeka emapikseli - mhando ye mini-shanduro yemufananidzo wekutanga.

Zvinoitika kuti kana iwe ukatora, toti, imwe yepakati pixel kubva musumbu rega rega uye uchinamira chifananidzo pamwe chete uchishandisa ivo, hazvizove zvakasiyana nezvinotorwa nekamera yenguva dzose. Ehe, isu tarasikirwa zvishoma mukugadziriswa, asi isu tichangokumbira Sony kuti iwedzere mamwe megapixels mumatrice matsva.

Chinyorwa chitsva: Computational Photography

Kunakidzwa kuchangotanga. kana iwe ukatora imwe pixel kubva musumbu rega rega uye kusona mufananidzo wacho pamwe chete, iwe unowana wakajairika mufananidzo zvakare, sekunge wakatorwa nekuchinja kwepixel imwe. Saka, ne 10 Γ— 10 pixel clusters, tinowana 100 mifananidzo yechinhu kubva "zvishoma" zvakasiyana.

Chinyorwa chitsva: Computational Photography

Saizi yakakura yemasumbu inoreva mimwe mifananidzo, asi yakaderera resolution. Munyika yemafoni ane 41-megapixel matrices, kunyange isu tichigona kuregeredza kugadzirisa zvishoma, pane muganhu kune zvese. Iwe unofanirwa kuchengetedza kuenzanisa.

Zvakanaka, isu takaunganidza kamera yeplenoptic, saka izvo zvinotipa chii?

Honest refocus

Chinhu icho vatori venhau vese vaizeya pamusoro pazvo muzvinyorwa nezveLytro kwaive kugona kugadzirisa nekuvimbika kutarisa mumashure-kugadzirwa. Nezvakanaka tinoreva kuti isu hatishandise chero deblurring algorithms, asi shandisa chete mapixels aripo, kusarudza kana kuavhareji kubva kumasumbu muhurongwa hunodiwa.

RAW kutora mafoto kubva kuplenoptic kamera inotaridzika zvinoshamisa. Kuti uwane jeep yakajairika inopinza kubva mairi, unofanira kutanga waiunganidza. Kuti uite izvi, unofanirwa kusarudza pixel yega yega yejipi kubva kune imwe yemasumbu eRAW. Zvichienderana nekuti tinovasarudza sei, mhedzisiro inoshanduka.

Semuenzaniso, iyo inoenderera mberi sumbu kubva panzvimbo yechiitiko chepakutanga danda, zvakanyanya kunze kwekutarisa danda iri. Nokuti optics. Kuti tiwane tarisiro-yakashandurwa mufananidzo, isu tinongoda kusarudza mapikseli pachinhambwe chaunoda kubva kune yekutanga - ingave padyo kana mberi.

Chinyorwa chitsva: Computational Photography

 

Zvaive zvakanyanya kuoma kushandura tarisiro yakananga kwauri - chaiko panyama, pakanga paine mashoma pixels akadaro mumasumbu. Pakutanga, vagadziri vaisatomboda kupa mushandisi kugona kutarisa nemaoko avo-kamera pachayo yakasarudza izvi musoftware. Vashandisi vaisada ramangwana iri, saka vakawedzera chinhu mune yakazotevera firmware inonzi "creative mode," asi vakaita kudzokororwa mairi zvishoma nekuda kweichi chikonzero.

Mepu yakadzama uye 3D kubva kune imwe kamera   

Imwe yeakareruka mashandiro muplenoptics kuwana mepu yakadzama. Kuti uite izvi, iwe unongoda kuunganidza maviri akasiyana mafuremu uye kuverenga kuti yakawanda sei zvinhu zviri mazviri zvakashandurwa. Kuwedzera kuchinja kunoreva kure kure nekamera.

Google ichangobva kutenga nekuuraya Lytro, asi yakashandisa tekinoroji yavo yeVR uye ... yePixel kamera. Kutanga nePixel 2, kamera yakava "zvishoma" plenoptic kekutanga, kunyangwe nemasumbu emapikisi maviri chete. Izvi zvakapa Google mukana wekusaisa yechipiri kamera, sevamwe vakomana vese, asi kuverenga mepu yakadzama kubva pamufananidzo mumwe chete.

Chinyorwa chitsva: Computational Photography

Chinyorwa chitsva: Computational Photography

Mepu yakadzika inovakwa pachishandiswa mafuremu maviri akachinjirwa nepixel imwe. Izvi zvakakwana kuti uverenge mepu yakadzika yebhinari uye kupatsanura kumberi kubva kumashure uye kudzima iyo yekupedzisira mune yazvino fashoni bokeh. Mhedzisiro yekumisikidza kwakadaro inokwenenzverwa uye "inovandudzwa" neneural network inodzidziswa kuvandudza kudzika mepu (uye kwete kudzima, sekufunga kwevanhu vazhinji).

Chinyorwa chitsva: Computational Photography

Icho chinonyengera ndechekuti isu tine plenoptics muma smartphones anenge emahara. Isu takatoisa lenzi pane aya matrices madiki kuitira kuti neimwe nzira tiwedzere kupenya kunopenya. MuPixel inotevera, Google inoronga kuenda mberi uye kuvhara mafotodiode mana nelenzi.

Source: 3dnews.ru

Voeg