Thawj tsab ntawv yog muab tso rau hauv lub vev xaib thiab luam tawm ntawm 3DNews nrog kev tso cai los ntawm tus sau. Peb muab tag nrho cov ntawv nyeem ntawm tsab xov xwm, nrog rau kev zam ntawm ib tug lossis loj tus naj npawb ntawm cov kev sib txuas - lawv yuav pab tau rau cov neeg uas txaus siab rau lub ntsiab lus thiab xav mus kawm theoretical yam ntawm xam cov duab nyob rau hauv ntau qhov tob, tab sis rau ib tug. cov neeg tuaj saib peb suav hais tias cov ntaub ntawv no redundant.
Niaj hnub no, tsis yog ib qho kev nthuav qhia smartphone ua tiav yam tsis tau licking nws lub koob yees duab. Txhua lub hlis peb hnov ββββtxog qhov kev vam meej tom ntej ntawm lub koob yees duab ntawm lub xov tooj: Google qhia Pixel tua hauv qhov tsaus ntuj, Huawei kom zoom zoom li lub koob yees duab, Samsung ntxig lidar, thiab Apple ua rau lub ntiaj teb puag ncig. Muaj ob peb qhov chaw uas innovation ntws sai heev hnub no.
Nyob rau tib lub sijhawm, cov iav zoo li ua cim lub sijhawm. Sony txhua xyoo da dej txhua tus nrog cov matrices tshiab, thiab cov tuam txhab lag luam lazily hloov kho tus lej tshiab thiab txuas ntxiv mus so thiab haus luam yeeb ntawm sab nraud. Kuv muaj $3000 DSLR ntawm kuv lub rooj, tab sis thaum kuv mus ncig, kuv nqa kuv iPhone. Vim li cas?
Raws li cov classic hais, kuv tau mus online nrog cov lus nug no. Nyob ntawd lawv tham txog qee qhov "algorithms" thiab "neural networks", yam tsis muaj lub tswv yim tias lawv cuam tshuam li cas rau kev yees duab. Cov neeg sau xov xwm nrov nrov nyeem tawm tus naj npawb ntawm megapixels, bloggers tau pom cov nyiaj them tsis tau them nqi hauv kev sib koom ua ke, thiab kev zoo nkauj yog smearing lawv tus kheej nrog "kev nkag siab zoo ntawm cov xim palette ntawm matrix." Txhua yam zoo li qub.
Kuv yuav tsum zaum, siv ib nrab kuv lub neej thiab xam tag nrho kuv tus kheej. Hauv tsab xov xwm no kuv yuav qhia koj qhov kuv tau kawm.
Computational photography yog dab tsi?
Txhua qhov chaw, suav nrog Wikipedia, lawv muab qee yam zoo li no txhais tau tias: kev yees duab suav yog ib qho duab ntes thiab ua cov txheej txheem uas siv kev suav digital es tsis txhob hloov kho qhov muag. Txhua yam hais txog nws yog qhov zoo, tshwj tsis yog tias nws tsis piav dab tsi. Txawm tias autofocus haum rau nws, tab sis plenoptics, uas twb tau coj peb ntau yam tseem ceeb, tsis haum. Lub vagueness ntawm official lub ntsiab txhais zoo li hint tias peb tsis muaj lub tswv yim dab tsi peb tab tom tham txog.
Tus pioneer ntawm kev suav yees duab, Stanford tus xibfwb Marc Levoy (uas yog tam sim no lub luag haujlwm rau lub koob yees duab ntawm Google Pixel) muab lwm lub ntsiab lus - cov txheej txheem ntawm kev pom hauv computer uas txhim kho lossis nthuav dav lub peev xwm ntawm kev yees duab digital, siv cov duab tsis tu ncua tau txais. yuav tsis technically coj nrog lub koob yees duab no. Hauv tsab xov xwm kuv ua raws li qhov no.
Yog li, smartphones tau liam rau txhua yam.
Smartphones tsis muaj kev xaiv tab sis yug tau ib hom kev yees duab tshiab: kev yees duab suav.
Lawv cov suab nrov me me thiab cov lo ntsiab muag qeeb qeeb me me, raws li tag nrho cov kev cai ntawm lub cev, yuav tsum tau coj tsuas yog mob thiab kev txom nyem. Lawv tau ua li ntawd kom txog rau thaum lawv cov neeg tsim khoom paub txog yuav ua li cas siv lawv lub zog los kov yeej lawv qhov tsis muaj zog - ceev hluav taws xob kaw, cov txheej txheem muaj zog thiab software.
Feem ntau ntawm cov kev tshawb fawb siab tshaj plaws nyob rau hauv kev lag luam ntawm kev suav yees duab tshwm sim ntawm 2005 thiab 2015, uas hauv kev tshawb fawb tau suav hais tias yog nag hmo. Tam sim no, ua ntej peb ob lub qhov muag thiab hauv peb lub hnab ris, thaj chaw tshiab ntawm kev paub thiab thev naus laus zis tab tom txhim kho uas tsis tau muaj ua ntej.
Kev yees duab suav tsis yog hais txog selfies nrog neuro-bokeh. Daim duab tsis ntev los no ntawm lub qhov dub yuav tsis tuaj yeem ua tsis tau yog tias tsis muaj kev suav nrog kev yees duab. Yuav kom thaij duab zoo li no nrog lub koob yees duab tsis tu ncua, peb yuav tsum ua kom nws loj ntawm lub ntiaj teb. Txawm li cas los xij, los ntawm kev sib txuas cov ntaub ntawv los ntawm yim lub xov tooj cua telescopes ntawm cov ntsiab lus sib txawv ntawm peb lub pob thiab sau ob peb tsab ntawv hauv Python, peb tau txais lub ntiaj teb thawj daim duab ntawm qhov kev tshwm sim qab ntug. Zoo rau selfies ib yam nkaus.
Pib: digital processing
Cia peb xav txog tias peb rov qab xyoo 2007. Peb niam yog anarchy, thiab peb cov duab yog nrov 0,6-megapixel jeeps coj mus rau ib tug skateboard. Nyob ib ncig ntawm ces peb muaj thawj irresistible siab xav mus sprinkle presets rau lawv nyob rau hauv thiaj li yuav nkaum lub wretchedness ntawm mobile matrices. Wb tsis kam lees peb tus kheej.
Matan thiab Instagram
Nrog rau kev tso tawm ntawm Instagram, txhua tus tau los ua obsessed nrog cov ntxaij lim dej. Raws li ib tug neeg uas thim rov qab-engineered X-Pro II, Lo-Fi thiab Valencia rau, tau kawg, kev tshawb fawb lub hom phiaj, kuv tseem nco ntsoov tias lawv muaj peb yam:
- Kev teeb tsa xim (Hue, Saturation, Lightness, Contrast, Levels, thiab lwm yam) - cov coefficients digital yooj yim, zoo ib yam li cov presets uas cov kws yees duab tau siv txij thaum ub.
- Tone Mappings yog vectors ntawm qhov tseem ceeb, txhua tus tau hais rau peb: "Cov xim liab nrog lub tint ntawm 128 yuav tsum tau hloov mus rau hauv tint ntawm 240."
- Ib qho overlay yog ib daim duab translucent nrog plua plav, nplej, vignette, thiab txhua yam uas tuaj yeem muab tso rau saum toj kom tau txais qhov tsis muaj txiaj ntsig ntawm cov yeeb yaj kiab qub. Tsis yog ib txwm muaj.
Cov ntxaij lim dej niaj hnub tsis nyob deb ntawm qhov trio no, lawv tsuas yog ua me ntsis nyuaj hauv kev ua lej. Nrog rau qhov tshwm sim ntawm hardware shaders thiab OpenCL ntawm smartphones, lawv tau sau sai sai rau GPU, thiab qhov no tau suav tias yog txias heev. Rau 2012, tau kawg. Niaj hnub no, txhua tus tub ntxhais kawm tuaj yeem ua ib yam hauv CSS, thiab nws tseem yuav tsis muaj sijhawm los kawm tiav.
Txawm li cas los xij, kev nce qib ntawm cov lim dej tsis tau nres hnub no. Cov txiv neej los ntawm Dehanser, piv txwv li, yog qhov zoo ntawm kev siv cov lim tsis-linear - es tsis txhob siv cov suab nrov proletarian, lawv siv ntau qhov kev hloov pauv tsis zoo, uas, raws li lawv, qhib ntau qhov muaj peev xwm.
Koj tuaj yeem ua ntau yam nrog cov kev hloov pauv uas tsis yog-linear, tab sis lawv yog qhov nyuaj kawg, thiab peb tib neeg yog neeg ruam kawg. Thaum nws los txog rau cov kev hloov pauv tsis yog hauv kev tshawb fawb, peb nyiam mus rau cov txheej txheem lej thiab kev sib koom tes ntawm neural nyob txhua qhov chaw kom lawv sau cov txuj ci rau peb. Nws yog ib yam ntawm no.
Automation thiab npau suav ntawm ib tug "masterpiece" khawm
Thaum txhua tus tau siv los lim, peb pib tsim lawv ncaj qha rau hauv cov koob yees duab. Keeb kwm zais qhov chaw tsim khoom yog thawj zaug, tab sis tsuas yog kom nkag siab ntev npaum li cas nws tau nyob - hauv iOS 5.0, uas tau tso tawm rov qab rau xyoo 2011, twb muaj ib qho pej xeem API rau Auto Enhancing Images. Tsuas yog Cov Haujlwm paub tias nws siv sijhawm ntev npaum li cas ua ntej qhib rau pej xeem.
Lub automation tau ua tib yam uas peb txhua tus ua thaum qhib daim duab hauv tus editor - nws rub tawm qhov khoob hauv lub teeb thiab duab ntxoov ntxoo, ntxiv saturation, tshem tawm qhov muag liab thiab taag complexion. Cov neeg siv tsis tau txawm paub tias "lub koob yees duab zoo heev" hauv lub xov tooj smartphone tshiab tsuas yog qhov txiaj ntsig ntawm ob peb qhov ntxoov ntxoo tshiab. Tseem tshuav tsib xyoos ua ntej tso tawm Google Pixel thiab pib ntawm kev suav duab hype.
Niaj hnub no, kev sib ntaus sib tua rau lub pob "masterpiece" tau tsiv mus rau kev kawm tshuab. Tau ua si txaus nrog cov suab lus piav qhia, txhua tus tau maj nrawm los qhia CNNs thiab GANs kom txav cov sliders es tsis txhob siv cov neeg siv. Hauv lwm lo lus, los ntawm cov duab nkag mus, txiav txim siab cov txheej txheem zoo tshaj plaws uas yuav coj cov duab no los ze zog rau qee qhov kev nkag siab ntawm "kev yees duab zoo." Ua tiav hauv tib lub Pixelmator Pro thiab lwm tus neeg kho. Nws ua haujlwm, raws li koj yuav twv, tsis zoo heev thiab tsis tas li.
Stacking yog 90% ntawm kev ua tiav ntawm lub koob yees duab mobile
Kev suav duab tiag tiag pib nrog kev sib tw-txhim ntau daim duab rau saum ib leeg. Nws tsis yog ib qho teeb meem rau lub xov tooj smartphone los nias lub kaum os thav ntawv hauv ib nrab thib ob. Lawv lub koob yees duab tsis muaj qhov ua haujlwm qeeb: lub aperture yog tsau, thiab hloov cov ntaub ntawv hloov mus muaj hluav taws xob kaw. Tus processor tsuas hais kom matrix pes tsawg microseconds nws yuav tsum ntes cov photons qus, thiab nws nyeem qhov tshwm sim.
Technically, lub xov tooj tuaj yeem thaij duab ntawm video ceev, thiab yees duab ntawm cov duab daws teeb meem, tab sis txhua yam nyob ntawm qhov ceev ntawm lub tsheb npav thiab lub processor. Yog vim li ntawd lawv ib txwm teeb qhov kev txwv.
Staking nws tus kheej tau nrog peb mus ntev. Txawm tias yawm txiv tau teeb tsa plugins ntawm Photoshop 7.0 los sib sau ua ke ntau cov duab rau hauv qhov muag pom HDR los yog xaws ua ke panorama ntawm 18000 Γ 600 pixels thiab ... qhov tseeb, tsis muaj leej twg paub tias yuav ua li cas nrog lawv tom ntej. Nws yog ib tug tu siab tias lub sij hawm muaj nplua nuj thiab qus.
Tam sim no peb tau dhau los ua neeg laus thiab hu nws "epsilon photography" - thaum, los ntawm kev hloov ib qho ntawm lub koob yees duab tsis muaj (exposure, tsom, txoj hauj lwm) thiab stitching ua ke lub resulting thav duab, peb tau txais ib yam dab tsi uas yuav tsis raug ntes nyob rau hauv ib tug ncej. Tab sis qhov no yog ib lo lus rau theorists; hauv kev xyaum, lwm lub npe tau pib hauv paus - staking. Niaj hnub no, qhov tseeb, 90% ntawm tag nrho cov kev tsim kho tshiab hauv lub koob yees duab mobile yog raws li nws.
Ib yam dab tsi uas ntau tus neeg tsis xav txog, tab sis nws yog ib qho tseem ceeb kom nkag siab tag nrho cov xov tooj ntawm tes thiab suav kev yees duab: lub koob yees duab ntawm lub smartphone niaj hnub pib thaij duab sai li sai tau thaum koj qhib nws app. Uas yog vim li cas, vim hais tias nws yuav tsum tau hloov cov duab mus rau qhov screen. Txawm li cas los xij, ntxiv rau qhov screen, nws txuag cov kev daws teeb meem siab rau hauv nws tus kheej lub voj tsis muaj, qhov twg nws khaws cia rau ob peb feeb ntxiv.
Thaum koj nias lub pob "muab yees duab", nws twb tau ua tiav lawm, lub koob yees duab tsuas yog siv cov duab kawg ntawm qhov tsis.
Qhov no yog li cas lub koob yees duab mobile ua haujlwm niaj hnub no. Yam tsawg kawg hauv txhua qhov flagships tsis yog los ntawm cov thoob khib nyiab. Buffering tso cai rau koj kom paub tsis yog tsuas yog xoom shutter lag, uas cov kws yees duab tau ua npau suav ntev, tab sis txawm tias tsis zoo - thaum koj nias lub pob, lub xov tooj smartphone zoo li yav dhau los, tshem tawm cov duab 5-10 kawg ntawm qhov tsis thiab pib soj ntsuam frantically. thiab muab tshuaj txhuam lawv. Tsis tas tos rau lub xov tooj los nyem thav duab rau HDR lossis hmo ntuj hom - tsuas yog coj lawv los ntawm qhov tsis, tus neeg siv yuav tsis paub.
Los ntawm txoj kev, nws yog nrog kev pab los ntawm qhov tsis zoo shutter lag uas Live Photo yog siv nyob rau hauv iPhones, thiab HTC muaj ib yam dab tsi zoo sib xws nyob rau hauv 2013 nyob rau hauv lub coj txawv txawv lub npe Zoe.
Txhaj tshuaj tiv thaiv - HDR thiab sib ntaus sib tua kev hloov pauv
Seb lub koob yees duab sensors muaj peev xwm ntes tau tag nrho cov kev ci ntsa iab nkag tau rau peb lub qhov muag yog lub ntsiab lus qub ntawm kev sib cav. Qee tus hais tias tsis yog, vim tias lub qhov muag muaj peev xwm pom txog 25 f-stops, txawm tias los ntawm ib qho kev sib tw tag nrho ntawm cov matrix koj tuaj yeem tau txais qhov siab tshaj plaws ntawm 14. Lwm tus hu qhov kev sib piv tsis raug, vim lub hlwb pab lub qhov muag los ntawm kev hloov kho. tus menyuam kawm ntawv thiab ua tiav cov duab nrog nws cov neural tes hauj lwm, thiab qhov instant Qhov dynamic ntau ntawm lub qhov muag yog tsis ntau tshaj li 10-14 f-stops. Cia peb tawm ntawm qhov kev sib cav no mus rau qhov zoo tshaj plaws armchair thinkers hauv Internet.
Qhov tseeb tseem: thaum koj tua cov phooj ywg tawm tsam lub ntuj kaj uas tsis muaj HDR ntawm lub koob yees duab ntawm lub xov tooj ntawm tes, koj tau txais lub ntuj qub thiab cov phooj ywg lub ntsej muag dub, lossis cov phooj ywg zoo, tab sis lub ntuj scorched kom tuag.
Cov kev daws teeb meem tau tsim los ntev - txhawm rau nthuav dav qhov ci ci siv HDR (High dynamic range). Koj yuav tsum coj ob peb thav duab ntawm qhov sib txawv shutter speeds thiab khi lawv ua ke. Yog li ntawd ib qho yog "ib txwm", qhov thib ob yog sib dua, qhov thib peb yog tsaus dua. Peb coj qhov chaw tsaus ntuj los ntawm lub teeb ncej, sau rau hauv overexposures los ntawm qhov tsaus ntuj - cov txiaj ntsig. Txhua yam uas tseem tshuav yog los daws qhov teeb meem ntawm kev siv bracketing tsis siv neeg - ntau npaum li cas los hloov qhov cuam tshuam ntawm txhua tus ncej kom tsis txhob overdo nws, tab sis tam sim no cov tub ntxhais kawm xyoo ob ntawm lub tsev kawm txuj ci tuaj yeem txiav txim siab qhov nruab nrab qhov ci ntawm daim duab.
Ntawm qhov tseeb iPhone, Pixel thiab Galaxy, HDR hom feem ntau yog qhib tau thaum lub algorithm yooj yim hauv lub koob yees duab txiav txim siab tias koj tab tom tua ib yam dab tsi nrog qhov sib txawv ntawm hnub ci. Koj tuaj yeem pom tias lub xov tooj hloov pauv hom kaw lus li cas rau qhov tsis nyob rau hauv thiaj li yuav txuag cov thav duab hloov pauv hauv qhov raug - fps hauv lub koob yees duab poob, thiab daim duab nws tus kheej ua juicier. Lub sijhawm hloov pauv tau pom meej meej ntawm kuv iPhone X thaum ua yeeb yaj kiab sab nraum zoov. Ua tib zoo saib koj lub smartphone lwm zaus thiab.
Qhov tsis zoo ntawm HDR nrog kev sib kis bracketing yog nws txoj kev tsis muaj peev xwm pab tsis tau hauv cov teeb pom kev tsis zoo. Txawm tias nrog lub teeb ntawm chav tsev teeb, cov thav ntawv tig tawm kom tsaus uas lub khoos phis tawj tsis tuaj yeem sib dhos thiab khi lawv ua ke. Txhawm rau daws qhov teeb meem nrog lub teeb, hauv 2013 Google tau qhia txog kev sib txawv rau HDR hauv Nexus smartphone tom qab ntawd tso tawm. Nws siv sij hawm stacking.
Lub sij hawm stacking - ntev exposure simulation thiab lub sij hawm lapse
Lub sij hawm stacking tso cai rau koj los tsim ib tug ntev raug siv ib tug series ntawm luv luv sawv daws yuav. Cov pioneers yog cov kiv cua ntawm kev yees duab hnub qub taug kev nyob rau hmo ntuj, uas pom tias nws tsis yooj yim qhib lub qhov rooj rau ob teev ib zaug. Nws yog qhov nyuaj heev los xam tag nrho cov kev teeb tsa ua ntej, thiab qhov qis qis tshaj yuav ua rau tag nrho cov ncej. Lawv tau txiav txim siab qhib lub qhov rooj rau ob peb feeb xwb, tab sis ntau zaus, thiab tom qab ntawd mus tsev thiab muab cov duab tshwm sim hauv Photoshop.
Nws hloov tawm tias lub koob yees duab yeej tsis tau tua ntawm qhov ntev shutter ceev, tab sis peb tau txais cov txiaj ntsig ntawm simulating nws los ntawm kev ntxiv ob peb thav ntawv coj mus ua kab. Muaj ib pawg ntawm cov ntawv sau rau cov xov tooj smartphones uas siv qhov ua kom yuam kev no tau ntev, tab sis txhua tus ntawm lawv tsis xav tau txij li qhov tshwj xeeb tau ntxiv rau yuav luag txhua lub koob yees duab txheem. Niaj hnub no, txawm tias ib qho iPhone tuaj yeem yooj yim xaws ua ke ntev ntev los ntawm Live Photo.
Cia peb rov qab mus rau Google nrog nws hmo ntuj HDR. Nws tau pom tias siv sijhawm sib khi koj tuaj yeem siv HDR zoo hauv qhov tsaus ntuj. Cov thev naus laus zis tau tshwm sim thawj zaug hauv Nexus 5 thiab hu ua HDR +. Tus so ntawm Android xov tooj tau txais nws zoo li yog khoom plig. Cov thev naus laus zis tseem nrov heev uas nws tseem tau qhuas hauv kev nthuav qhia ntawm Pixels tshiab.
HDR + ua haujlwm yooj yim heev: tau txiav txim siab tias koj tab tom tua hauv qhov tsaus ntuj, lub koob yees duab unloads 8-15 RAW cov duab kawg los ntawm qhov tsis nyob rau hauv thiaj li yuav overlay lawv nyob rau sab saum toj ntawm ib leeg. Yog li, lub algorithm sau cov ntaub ntawv ntau ntxiv txog qhov tsaus ntuj ntawm tus ncej kom txo qis suab nrov - pixels qhov twg, rau qee qhov laj thawj, lub koob yees duab tsis tuaj yeem sau tag nrho cov ntaub ntawv thiab ua yuam kev.
Nws zoo li yog tias koj tsis paub tias lub capybara zoo li cas thiab koj nug tsib tus neeg los piav qhia nws, lawv cov dab neeg yuav zoo ib yam, tab sis txhua tus yuav hais txog qee qhov tshwj xeeb. Txoj kev no koj yuav sau cov ntaub ntawv ntau dua li tsuas yog nug ib qho xwb. Nws zoo ib yam nrog pixels.
Ntxiv cov thav ntawv coj los ntawm ib qho taw qhia muab tib lub sijhawm ntev cuam tshuam nrog cov hnub qub saum toj no. Kev nthuav tawm ntawm kaum ob ntawm cov thav ntawv yog summed, yuam kev nyob rau hauv ib tug yog minimized nyob rau hauv lwm tus neeg. Xav txog seb koj yuav tau nyem lub DSLR shutter ntau npaum li cas txhua zaus kom ua tiav qhov no.
Txhua yam uas tseem tshuav yog los daws qhov teeb meem ntawm kev kho xim tsis siv neeg - thav duab coj hauv qhov tsaus ntuj feem ntau tig tawm daj lossis ntsuab, thiab peb xav tau kev nplua nuj ntawm nruab hnub nrig. Hauv kev ua ntej ntawm HDR +, qhov no tau daws los ntawm tsuas yog tweaking cov chaw, xws li hauv cov ntxaij lim dej ntawm Instagram. Tom qab ntawd lawv hu xov tooj rau neural network los pab.
Qhov no yog li cas Night Sight tshwm sim - thev naus laus zis ntawm "kev yees duab hmo ntuj" hauv Pixel 2 thiab 3. Hauv cov lus piav qhia lawv hais tias: "Kev kawm tshuab ua rau saum HDR+, uas ua rau Hmo Pom Kev Ua Haujlwm." Nyob rau hauv qhov tseeb, qhov no yog lub automation ntawm cov xim kho theem. Lub tshuab tau raug cob qhia ntawm cov ntaub ntawv ntawm "ua ntej" thiab "tom qab" cov duab txhawm rau ua kom ib qho zoo nkauj los ntawm cov duab tsaus nti.
Los ntawm txoj kev, cov ntaub ntawv tau muab rau pej xeem. Tej zaum cov txiv neej los ntawm Apple yuav coj nws thiab thaum kawg qhia lawv cov iav shovels kom thaij duab kom zoo hauv qhov tsaus ntuj.
Tsis tas li ntawd, Night Sight siv kev suav ntawm cov lus tsa suab vector ntawm cov khoom hauv tus ncej kom normalize qhov plooj uas paub tseeb tias yuav tshwm sim nrog lub sijhawm kaw ntev. Yog li, lub xov tooj smartphone tuaj yeem nqa qhov tseeb ntawm lwm cov thav duab thiab ua rau lawv.
Motion stacking - panorama, superzoom thiab txo suab nrov
Panorama yog qhov kev lom zem nrov rau cov neeg nyob hauv thaj chaw deb nroog. Keeb kwm tseem tsis tau paub txog qee qhov xwm txheej uas cov duab sausage yuav muaj kev txaus siab rau lwm tus uas tsis yog nws tus sau, tab sis nws tsis tuaj yeem tsis quav ntsej - rau ntau tus, qhov no yog qhov chaw stacking pib thawj qhov chaw.
Thawj qhov tseem ceeb ntawm kev siv lub panorama yog kom tau txais daim duab ntawm qhov kev daws teeb meem siab dua li lub koob yees duab matrix tso cai los ntawm stitching ua ke ob peb thav ntawv. Cov kws yees duab tau ntev tau siv cov software sib txawv rau qhov hu ua super-resolution duab - thaum cov duab hloov me ntsis zoo li ua kom sib ntxiv ntawm pixels. Txoj kev no koj tuaj yeem tau txais cov duab tsawg kawg ntau pua ntawm gigapixels, uas yog qhov tseem ceeb heev yog tias koj xav tau luam tawm ntawm daim ntawv tshaj tawm qhov loj ntawm lub tsev.
Lwm qhov, nthuav ntau txoj hauv kev yog Pixel Shifting. Qee lub koob yees duab tsis muaj iav zoo li Sony thiab Olympus tau pib txhawb nqa nws rov qab rau xyoo 2014, tab sis lawv tseem yuav tsum tau nplaum qhov tshwm sim ntawm tes. Cov koob yees duab loj loj nrhav tshiab.
Smartphones tau ua tiav ntawm no rau qhov laj thawj funny - thaum koj thaij duab, koj txhais tes co. Qhov teeb meem zoo li no tau tsim lub hauv paus rau kev siv ntawm haiv neeg super daws teeb meem ntawm smartphones.
Yuav kom nkag siab tias qhov no ua haujlwm li cas, koj yuav tsum nco ntsoov tias lub matrix ntawm ib lub koob yees duab yog li cas. Txhua qhov ntawm nws cov pixels (photodiode) muaj peev xwm sau tau tsuas yog qhov kev siv ntawm lub teeb - uas yog, tus naj npawb ntawm photons tuaj. Txawm li cas los xij, pixel tsis tuaj yeem ntsuas nws cov xim (wavelength). Yuav kom tau txais ib daim duab RGB, peb yuav tsum tau ntxiv cov ntoo khaub lig ntawm no ib yam nkaus - npog tag nrho cov matrix nrog ib daim phiaj ntawm ntau cov xim ntawm iav. Nws qhov kev siv nrov tshaj plaws yog hu ua Bayer lim thiab siv nyob rau hauv feem ntau matrices hnub no. Zoo li daim duab hauv qab no.
Nws hloov tawm hais tias txhua pixel ntawm lub matrix catches R-, G- los yog B-component, vim hais tias cov seem ntawm photons yog mercilessly reflected los ntawm Bayer lim. Nws paub txog cov khoom uas ploj lawm los ntawm bluntly nruab nrab qhov tseem ceeb ntawm cov pixels nyob sib ze.
Muaj ntau lub hlwb ntsuab hauv Bayer lim - qhov no tau ua los ntawm kev sib piv nrog tib neeg lub qhov muag. Nws hloov tawm hais tias tawm ntawm 50 lab pixels ntawm lub matrix, ntsuab yuav ntes 25 lab, liab thiab xiav - 12,5 lab txhua tus so yuav nruab nrab - cov txheej txheem no hu ua debayerization los yog demosaicing, thiab qhov no yog xws li ib tug rog funny crutch rau. uas txhua yam so.
Qhov tseeb, txhua lub matrix muaj nws tus kheej cunning patented demosaicing algorithm, tab sis rau lub hom phiaj ntawm zaj dab neeg no peb yuav tsis quav ntsej qhov no.
Lwm hom matrices (xws li Foveon) muaj qee yam tsis tau ntes tau. Txawm hais tias qee lub tuam txhab tau sim siv cov sensors tsis muaj Bayer lim los txhim kho qhov ntse thiab muaj zog ntau yam.
Thaum muaj lub teeb me me lossis cov ntsiab lus ntawm ib qho khoom me me, peb poob ntau cov ntaub ntawv vim tias Bayer lim blatantly txiav tawm photons nrog lub pliaj wavelength. Tias yog vim li cas lawv tuaj nrog Pixel Shifting - hloov cov matrix los ntawm 1 pixel nce-down-sab xis-sab laug kom ntes lawv tag nrho. Nyob rau hauv cov ntaub ntawv no, daim duab tsis tig mus rau 4 lub sij hawm loj dua, raws li nws tej zaum yuav zoo li, lub processor tsuas yog siv cov ntaub ntawv no kom meej meej sau tus nqi ntawm txhua pixel. Nws nruab nrab tsis tshaj nws cov neeg nyob ze, yog li hais, tab sis tshaj plaub qhov tseem ceeb ntawm nws tus kheej.
Kev tuav ntawm peb txhais tes thaum thaij duab hauv xov tooj ua rau cov txheej txheem no yog qhov tshwm sim. Hauv qhov tseeb versions ntawm Google Pixel, qhov no yog siv thiab tig rau thaum twg koj siv zoom ntawm lub xov tooj - nws hu ua Super Res Zoom (yog, kuv kuj nyiam lawv lub npe tsis muaj kev hlub tshua). Cov Suav kuj tau theej nws rau hauv lawv lub laophones, txawm hais tias nws ua phem me ntsis.
Overlaying me ntsis hloov cov duab nyob rau sab saum toj ntawm ib leeg tso cai rau koj sau cov ntaub ntawv ntau ntxiv txog cov xim ntawm txhua pixel, uas txhais tau hais tias txo cov suab nrov, ua kom pom tseeb thiab nce kev daws teeb meem yam tsis tas yuav nce lub cev ntawm megapixels ntawm matrix. Niaj hnub nimno Android flagships ua qhov no cia li, tsis muaj lawv cov neeg siv txawm xav txog nws.
Ua kom pom tseeb stacking - txhua qhov tob ntawm thaj teb thiab rov tsom mus rau tom qab tsim khoom
Txoj kev los ntawm kev yees duab macro, qhov twg qhov tob tob ntawm thaj teb ib txwm muaj teeb meem. Txhawm rau kom tag nrho cov khoom ua kom pom tseeb, koj yuav tsum coj ob peb lub thav duab nrog lub ntsej muag tig rov qab, thiab tom qab ntawd khi lawv ua ke rau hauv ib qho ntse. Tib txoj kev no feem ntau siv los ntawm cov kws yees duab toj roob hauv pes, ua rau lub hauv ntej thiab keeb kwm yav dhau los ua kom pom tseeb raws li kev mob raws plab.
Tag nrho cov no kuj tau tsiv mus rau smartphones, txawm tias tsis muaj hype ntau. Nyob rau hauv 2013, Nokia Lumia 1020 nrog "Refocus App" raug tso tawm, thiab nyob rau hauv 2014, Samsung Galaxy S5 nrog "Selective Focus" hom. Lawv ua hauj lwm raws li tib lub tswv yim: los ntawm nias ib lub pob, lawv sai sai muab 3 daim duab - ib qho nrog "ib txwm" tsom, qhov thib ob nrog kev tsom mus rau pem hauv ntej thiab qhov thib peb nrog lub hom phiaj rov qab. Qhov kev zov me nyuam ua raws cov thav ntawv thiab tso cai rau koj xaiv ib qho ntawm lawv, uas yog touted li "tiag tiag" kev tswj hwm hauv kev tsim khoom tom qab.
Tsis muaj kev ua tiav ntxiv, vim tias txawm tias qhov yooj yim hack no tau txaus los tsav lwm tus ntsia hlau rau hauv lub hau ntawm Lytro thiab nws cov phooj ywg nrog lawv cov kev ncaj ncees refocus. Los ntawm txoj kev, cia peb tham txog lawv (kev hloov pauv tswv 80 lvl).
Computational matrices - lub teeb teb thiab plenoptics
Raws li peb to taub saum toj no, peb cov matrices yog ntshai heev ntawm crutches. Peb nyuam qhuav tau siv nws thiab sim ua neej nrog nws. Lawv cov qauv tau hloov me ntsis txij li thaum pib ntawm lub sijhawm. Peb tsuas yog txhim kho cov txheej txheem thev naus laus zis - peb txo qhov kev ncua deb ntawm pixels, tiv thaiv kev cuam tshuam lub suab nrov, thiab ntxiv cov pixels tshwj xeeb rau theem nrhiav kom pom autofocus. Tab sis yog tias koj nqa txawm tias kim tshaj plaws DSLR thiab sim thaij cov miv uas khiav nrog nws hauv chav teeb pom kev zoo - miv, muab nws me me, yuav yeej.
Peb tau sim tsim ib yam dab tsi zoo dua rau lub sijhawm ntev. Ntau qhov kev sim thiab kev tshawb fawb hauv cheeb tsam no yog googled rau "computational sensor" lossis "non-bayer sensor", thiab txawm tias Pixel Shifting piv txwv saum toj no tuaj yeem raug ntaus nqi rau kev sim txhim kho matrices siv kev suav. Txawm li cas los xij, cov dab neeg zoo tshaj plaws hauv nees nkaum xyoo dhau los tau los rau peb los ntawm lub ntiaj teb ntawm lub koob yees duab plenoptic.
Yog li ntawd koj tsis tsaug zog los ntawm qhov kev cia siab ntawm cov lus nyuaj uas yuav tshwm sim, Kuv yuav muab pov rau hauv ib tus neeg sab hauv tias lub koob yees duab ntawm Google Pixel qhov tseeb tsuas yog "me ntsis" plenoptic. Tsuas yog ob lub pixels, tab sis txawm tias qhov no tso cai rau nws los xam qhov tseeb qhov tob ntawm tus ncej txawm tias tsis muaj lub koob yees duab thib ob, zoo li txhua tus.
Plenoptics yog riam phom muaj zog uas tseem tsis tau raug rho tawm haujlwm. Ntawm no yog qhov txuas mus rau ib qho ntawm kuv nyiam tsis ntev los no. , qhov twg kuv qiv cov piv txwv los ntawm.
Plenoptic koob yees duab - los sai sai no
Tsim nyob rau hauv 1994, sau ntawm Stanford hauv 2004. Thawj tus neeg siv lub koob yees duab, Lytro, tau tso tawm xyoo 2012. VR kev lag luam tam sim no nquag sim nrog cov thev naus laus zis zoo sib xws.
Lub koob yees duab plenoptic txawv ntawm lub koob yees duab ib txwm nyob rau hauv ib qho kev hloov kho - nws cov matrix yog them nrog ib daim phiaj ntawm lo ntsiab muag, txhua qhov uas npog ntau pixels tiag tiag. Ib yam li no:
Yog tias koj raug xam qhov kev ncua deb ntawm daim phiaj mus rau lub matrix thiab qhov loj ntawm aperture, cov duab kawg yuav muaj cov pawg meej ntawm pixels - xaiv cov mini-versions ntawm thawj daim duab.
Nws hloov tawm tias yog tias koj coj, hais tias, ib lub hauv paus pixel ntawm txhua pawg thiab muab cov duab ua ke tsuas yog siv lawv, nws yuav tsis txawv ntawm qhov uas coj nrog lub koob yees duab li niaj zaus. Yog lawm, peb tau poob me ntsis hauv kev daws teeb meem, tab sis peb tsuas yog hais kom Sony ntxiv ntau megapixels hauv matrices tshiab.
Kev lom zem tsuas yog pib xwb. Yog tias koj coj lwm pixel los ntawm txhua pawg thiab khi daim duab ua ke dua, koj yuav tau txais daim duab qub dua, tsuas yog nws tau coj nrog kev hloov ntawm ib pixel. Yog li, muaj pawg ntawm 10 Γ 10 pixels, peb yuav tau txais 100 cov duab ntawm cov khoom los ntawm "me ntsis" cov ntsiab lus sib txawv.
Cov pawg loj dua txhais tau tias ntau cov duab, tab sis kev daws teeb meem qis dua. Hauv ntiaj teb ntawm cov xov tooj smartphones nrog 41-megapixel matrices, txawm hais tias peb tuaj yeem tsis quav ntsej qhov kev daws teeb meem me ntsis, muaj qhov txwv rau txhua yam. Koj yuav tsum muaj kev sib npaug.
Okay, peb tau sib sau ua ke lub koob yees duab plenoptic, yog li nws muab dab tsi rau peb?
Kev ncaj ncees rov tsom
Qhov tshwj xeeb uas txhua tus neeg sau xov xwm tau buzzing nyob rau hauv cov lus hais txog Lytro yog lub peev xwm los kho siab ncaj ncees hauv kev tsim khoom tom qab. Los ntawm kev ncaj ncees peb txhais tau tias peb tsis siv ib qho kev deblurring algorithms, tab sis tsuas yog siv cov pixels ntawm tes, xaiv los yog nruab nrab ntawm cov pawg hauv qhov kev txiav txim yuav tsum tau ua.
RAW yees duab los ntawm lub koob yees duab plenoptic zoo li coj txawv txawv. Yuav kom tau txais lub jeep ntse ib txwm tawm ntawm nws, koj yuav tsum xub sib sau ua ke. Txhawm rau ua qhov no, koj yuav tsum xaiv txhua pixel ntawm jeep los ntawm ib qho ntawm RAW pawg. Nyob ntawm seb peb xaiv lawv li cas, qhov tshwm sim yuav hloov.
Piv txwv li, qhov txuas ntxiv ntawm pawg yog los ntawm qhov tshwm sim ntawm qhov teeb meem ntawm cov kab qub qub, qhov ntau tawm ntawm kev tsom xam qhov nqaj yog. Vim yog optics. Txhawm rau kom tau txais cov duab ua kom pom tseeb, peb tsuas yog yuav tsum xaiv pixels ntawm qhov xav tau nyob deb ntawm qhov qub - los ze dua lossis ntxiv.
Nws yog qhov nyuaj dua los hloov qhov tsom mus rau koj tus kheej - lub cev nkaus xwb, muaj tsawg dua li pixels hauv pawg. Thaum xub thawj, cov neeg tsim khoom tsis txawm xav muab cov neeg siv lub peev xwm los tsom nrog lawv txhais tes - lub koob yees duab nws tus kheej txiav txim siab qhov no hauv software. Cov neeg siv tsis nyiam lub neej yav tom ntej no, yog li lawv tau ntxiv qhov tshwj xeeb hauv cov firmware tom qab hu ua "creative mode," tab sis tau ua kom pom tseeb hauv nws txwv rau qhov laj thawj no.
Daim ntawv qhia tob thiab 3D los ntawm ib lub koob yees duab
Ib qho ntawm cov haujlwm yooj yim tshaj plaws hauv plenoptics yog tau txais daim ntawv qhia tob. Txhawm rau ua qhov no, koj tsuas yog yuav tsum tau sau ob lub thav duab sib txawv thiab suav tias cov khoom hauv lawv tau hloov pauv ntau npaum li cas. Kev hloov ntau dua txhais tau tias nyob deb ntawm lub koob yees duab.
Google nyuam qhuav yuav thiab tua Lytro, tab sis siv lawv cov thev naus laus zis rau nws VR thiab ... rau lub koob yees duab Pixel. Pib nrog Pixel 2, lub koob yees duab tau dhau los ua "me ntsis" plenoptic thawj zaug, txawm hais tias nrog pawg ntawm ob pixels xwb. Qhov no tau muab sijhawm rau Google kom tsis txhob teeb tsa lub koob yees duab thib ob, zoo li txhua tus txiv neej, tab sis suav nrog daim duab qhia qhov tob ntawm ib daim duab.
Daim ntawv qhia qhov tob yog tsim siv ob lub thav duab hloov los ntawm ib qho subpixel. Qhov no yog qhov txaus los xam daim duab qhia qhov tob binary thiab cais lub foreground los ntawm keeb kwm yav dhau thiab plooj qhov kawg hauv qhov tam sim no fashionable bokeh. Qhov tshwm sim ntawm cov txheej txheej zoo li no kuj tau ua kom zoo thiab "txhim kho" los ntawm neural tes hauj lwm uas tau kawm los txhim kho daim duab qhia qhov tob (thiab tsis plam, raws li ntau tus neeg xav).
Qhov ua kom yuam kev yog tias peb tau txais plenoptics hauv smartphones yuav luag dawb xwb. Peb twb muab lo ntsiab muag rau ntawm cov matrices me me no txhawm rau ua kom cov luminous flux. Hauv Pixel tom ntej, Google npaj yuav mus ntxiv thiab npog plaub lub photodiodes nrog lub lens.
Tau qhov twg los: 3d xov.ru