ʻatikala hou: Computational Photography

Hoʻopuka ʻia ka ʻatikala kumu ma ka pūnaewele Vastrik.ru a paʻi ʻia ma 3DNews me ka ʻae o ka mea kākau. Hāʻawi mākou i ka kikokikona piha o ka ʻatikala, koe naʻe ka nui o nā loulou - e pono lākou i ka poʻe i makemake nui i ke kumuhana a makemake lākou e aʻo i nā ʻaoʻao theoretical o ke kiʻi computational i ka hohonu, akā no kahi lehulehu a mākou i manaʻo ai he mea ʻole kēia mea.  

I kēia lā, ʻaʻole i hoʻopau ʻia kahi hōʻike kelepona hoʻokahi me ka ʻole o kāna kāmela. I kēlā me kēia mahina, lohe mākou e pili ana i ka holomua o nā kāmeʻa kelepona: aʻo ʻo Google iā Pixel e pana i ka pōʻeleʻele, Huawei e hoʻonui e like me ka binoculars, hoʻokomo ʻo Samsung i ka lidar, a hana ʻo Apple i nā kihi pōʻai loa o ka honua. He liʻiliʻi nā wahi e holo wikiwiki nei nā mea hou i kēia mau lā.

I ka manawa like, ʻike ʻia nā aniani i ka manawa. Hoʻohāinu ʻo Sony i kēlā me kēia makahiki me nā matrices hou, a me ka palaualelo o nā mea hana i ka huahelu mana hou a hoʻomau i ka hoʻomaha a me ka puhi ʻana ma nā ʻaoʻao. He $3000 kaʻu DSLR ma kaʻu pākaukau, akā ke hele au, lawe wau i kaʻu iPhone. No ke aha mai?

E like me ka ʻōlelo maʻamau, hele au ma ka pūnaewele me kēia nīnau. Ma laila lākou e kūkākūkā ai i kekahi mau "algorithms" a me "neural networks", me ka ʻole o ka manaʻo i ke ʻano o ka hopena o ke kiʻi. Ke heluhelu leo ​​nui nei ka poʻe nūpepa i ka helu o nā megapixels, ke ʻike nei nā mea kākau moʻolelo i nā unboxings i uku ʻole ʻia, a ke hoʻoheheʻe nei nā aesthetes iā lākou iho me ka "manaʻo naʻau o ka palette kala o ka matrix." ʻO nā mea a pau e like me ka mea maʻamau.

Pono wau e noho i lalo, e hoʻolilo i ka hapalua o koʻu ola a e noʻonoʻo pono iaʻu iho. Ma kēia ʻatikala e haʻi wau iā ʻoe i kaʻu i aʻo ai.

#He aha ke kiʻi helu helu?

Ma nā wahi a pau, me Wikipedia, hāʻawi lākou i kekahi mea e like me kēia wehewehe ʻana: ʻo ke kiʻi computational kekahi kiʻi kiʻi kiʻi a me nā ʻenehana hana e hoʻohana ana i ka helu helu kikohoʻe ma mua o ka hoʻololi ʻana. Maikaʻi nā mea a pau e pili ana iā ia, koe naʻe ʻaʻole ia e wehewehe i kekahi mea. ʻOiai kūpono ka autofocus no ia, akā ʻo plenoptics, ka mea i lawe mai iā mākou i nā mea pono he nui, ʻaʻole kūpono. Me he mea lā ʻaʻole maopopo iā mākou ka mea a mākou e kamaʻilio nei.

ʻO ka paionia o ke kiʻi ʻikepili, ʻo Stanford professor Marc Levoy (ʻo ia ke kuleana o ke kāmela ma Google Pixel) hāʻawi i kahi wehewehe ʻē aʻe - kahi hoʻonohonoho o nā ʻano hiʻohiʻona kamepiula e hoʻomaikaʻi a hoʻonui paha i nā hiki o ke kiʻi kiʻi kiʻi, me ka hoʻohana ʻana i kahi kiʻi maʻamau e loaʻa ai. ʻaʻole hiki ke lawe ʻia me kēia pahupaʻikiʻi. Ma ka ʻatikala e pili ana au i kēia.

No laila, ua hewa nā smartphones no nā mea a pau.

ʻAʻohe koho o nā kelepona ma mua o ka hānau ʻana i kahi kiʻi kiʻi hou: kiʻi computational.

ʻO kā lākou mau matrices walaʻau liʻiliʻi a me nā lens lohi-aperture liʻiliʻi, e like me nā kānāwai āpau o ka physics, pono e lawe wale mai i ka ʻeha a me ka ʻeha. Hana lākou a hiki i kā lākou mea hoʻomohala e noʻonoʻo ai pehea e hoʻohana akamai ai i ko lākou ikaika e lanakila ai i ko lākou nāwaliwali - nā pani uila wikiwiki, nā mea hana ikaika a me nā lako polokalamu.

ʻatikala hou: Computational Photography

ʻO ka hapa nui o ka noiʻi kiʻekiʻe ma ke kahua o ke kiʻi ʻikepili i hana ʻia ma waena o 2005 a me 2015, i manaʻo ʻia ma ka ʻepekema i nehinei. I kēia manawa, i mua o ko mākou mau maka a i loko o kā mākou ʻeke, ke ulu nei kahi ʻano ʻike a me ka ʻenehana hou i loaʻa ʻole ma mua.

ʻAʻole pili wale ka paʻi kiʻi ʻikepili me ka neuro-bokeh. ʻAʻole hiki ke kiʻi hou ʻia o kahi lua ʻeleʻele me ka ʻole o nā ʻenehana kiʻi helu helu. No ke kiʻi ʻana i ia kiʻi me kahi telescope maʻamau, pono mākou e hana i ka nui o ka Honua. Eia nō naʻe, ma ka hoʻohui ʻana i nā ʻikepili mai nā telescope radio ʻewalu ma nā wahi like ʻole o kā mākou kinipōpō a kākau i kekahi mau palapala ma Python, ua loaʻa iā mākou ke kiʻi mua o ka honua o ka pae hanana. Maikaʻi no ka selfies kekahi.

ʻatikala hou: Computational Photography

#Hoʻomaka: ka hana kikohoʻe

E noʻonoʻo kākou ua hoʻi mākou i ka makahiki 2007. ʻO ko mākou makuahine, he huhū, a ʻo kā mākou mau kiʻi he 0,6-megapixel jeeps i lawe ʻia ma luna o ka skateboard. A puni, loaʻa iā mākou ka makemake mua ʻole e kāpīpī i nā presets ma luna o lākou i mea e hūnā ai i ka pōʻino o nā matrices mobile. Mai hoole kakou ia kakou iho.

ʻatikala hou: Computational Photography

#Matan a me Instagram

Me ka hoʻokuʻu ʻana o Instagram, lilo nā mea āpau i nā kānana. Ma ke ʻano he mea hoʻohuli hou i ka X-Pro II, Lo-Fi a me Valencia no, ʻoiaʻiʻo, no ka noiʻi noiʻi, ke hoʻomanaʻo mau nei au he ʻekolu mau ʻāpana:

  • Nā hoʻonohonoho kala (Hue, Saturation, Lightness, Contrast, Levels, etc.) - nā coefficient kikohoʻe maʻalahi, e like me nā preset a nā mea paʻi kiʻi i hoʻohana ai mai ka wā kahiko.
  • ʻO Tone Mappings nā vectors o nā waiwai, ua haʻi mai kēlā me kēia iā mākou: "ʻO ke kala ʻulaʻula me kahi kala o 128 pono e hoʻololi ʻia i kahi kala o 240."
  • ʻO kahi overlay he kiʻi translucent me ka lepo, ka palaoa, ka vignette, a me nā mea ʻē aʻe e hiki ke kau ʻia ma luna e loaʻa ai ka hopena banal ʻole o kahi kiʻiʻoniʻoni kahiko. ʻAʻole i loaʻa i nā manawa a pau.   

ʻAʻole mamao loa nā kānana hou mai kēia ʻekolu, ua lilo lākou i mea paʻakikī iki i ka makemakika. Me ka hiki ʻana mai o nā shaders hardware a me OpenCL ma nā smartphones, ua kākau hou ʻia lākou no ka GPU, a ua manaʻo ʻia kēia he mea ʻoluʻolu loa. No 2012, ʻoiaʻiʻo. I kēia lā, hiki i kēlā me kēia haumāna ke hana like ma CSS, a ʻaʻole loaʻa iā ia ka manawa e puka ai.

Eia naʻe, ʻaʻole i pau ka holomua o nā kānana i kēia lā. ʻO ka poʻe mai Dehanser, no ka laʻana, maikaʻi loa i ka hoʻohana ʻana i nā kānana nonlinear - ma kahi o ka proletarian leo mapping, hoʻohana lākou i nā hoʻololi nonlinear paʻakikī, e like me lākou, e wehe i nā mea hiki.

Hiki iā ʻoe ke hana i nā mea he nui me nā hoʻololi nonlinear, akā paʻakikī lākou, a he naʻaupō mākou nā kānaka. I ka hiki ʻana mai i nā hoʻololi nonlinear i ka ʻepekema, makemake mākou e hele i nā ʻano helu a me ka cram neural networks ma nā wahi āpau i kākau ai lākou i nā haku hana no mākou. Ua like nō ma ʻaneʻi.

#Automation a me nā moeʻuhane o kahi pihi "masterpiece".

I ka manawa i maʻa ai ka poʻe a pau i nā kānana, hoʻomaka mākou e kūkulu pololei iā lākou i loko o nā pahupaʻikiʻi. Hūnā ka mōʻaukala ʻo wai ka mea hana mua, akā no ka hoʻomaopopo ʻana i ka lōʻihi o ka wā ma mua - ma IOS 5.0, i hoʻokuʻu ʻia i ka makahiki 2011, aia kekahi API ākea no ka hoʻonui ʻana i nā kiʻi. ʻO Jobs wale nō ka ʻike i ka lōʻihi o ka hoʻohana ʻana ma mua o ka wehe ʻana i ka lehulehu.

Ua hana like ka automation e like me kā mākou e wehe ai i kahi kiʻi i ka mea hoʻoponopono - ua huki i nā āpau i ka mālamalama a me nā aka, hoʻohui i ka saturation, wehe i nā maka ʻulaʻula a me ka ʻili paʻa. ʻAʻole i ʻike nā mea hoʻohana ʻo ka "kamele hoʻomaikaʻi maikaʻi loa" i ke kelepona hou ʻo ia wale nō ka pono o nā shaders hou. He ʻelima mau makahiki i koe ma mua o ka hoʻokuʻu ʻia ʻana o Google Pixel a me ka hoʻomaka ʻana o ka hype kiʻi computational.

ʻatikala hou: Computational Photography

I kēia lā, ua neʻe ke kaua no ka pihi "masterpiece" i ke kula o ka mīkini aʻo. Ma hope o ka pāʻani ʻana me ka palapala palapala leo, holo wikiwiki nā mea a pau e hoʻomaʻamaʻa iā CNNs a me GANs e neʻe i nā sliders ma mua o ka mea hoʻohana. Ma nā huaʻōlelo ʻē aʻe, mai ke kiʻi hoʻokomo, e hoʻoholo i kahi hoʻonohonoho o nā ʻāpana maikaʻi loa e hoʻokokoke ai i kēia kiʻi i kahi ʻike kikoʻī o ka "kiʻi maikaʻi." Hoʻokomo ʻia ma ka Pixelmator Pro like a me nā mea hoʻoponopono ʻē aʻe. He hana ia, e like me kāu e manaʻo ai, ʻaʻole maikaʻi loa a ʻaʻole i nā manawa a pau. 

#ʻO ka hoʻopaʻa ʻana ʻo 90% o ka kūleʻa o nā kāmeʻa kelepona

Ua hoʻomaka ʻia ke kiʻi ʻike helu ʻoiaʻiʻo me ka hoʻopaʻa ʻana i nā kiʻi he nui ma luna o kekahi. ʻAʻole ia he pilikia no ke kelepona ʻana e kaomi i hoʻokahi haneli mau papa i ka hapalua kekona. ʻAʻohe ʻāpana mechanical lohi o kā lākou mau kāmera: paʻa ka puka, a ma kahi o kahi pale e neʻe ai aia kahi pani uila. Kauoha wale ke kaʻina hana i ka matrix i ka nui o nā microseconds e hopu ai i nā kiʻi hihiu, a heluhelu ia i ka hopena.

Ma keʻano loea, hiki i ke kelepona ke kiʻi i nā kiʻi ma ka wikiwiki wikiō, a me ka wikiō i ka hoʻonā kiʻi, akā pili ia i ka wikiwiki o ke kaʻa a me ka mea hana. ʻO ia ke kumu i hoʻonohonoho mau ai lākou i nā palena papahana.

Ua noho pū ʻo Staking me mākou no ka manawa lōʻihi. Ua hoʻokomo nā kupuna kāne i nā plugins ma Photoshop 7.0 e hōʻuluʻulu i nā kiʻi he nui i HDR a i ʻole e hui pū i kahi panorama o 18000 × 600 pixels a ... ʻoiaʻiʻo, ʻaʻohe mea i ʻike i ka mea e hana ai me lākou aʻe. He mea minamina ka waiwai a me ka hihiu o ka manawa.

I kēia manawa ua lilo mākou i poʻe mākua a kapa ʻia ʻo ia he "epsilon kiʻi" - i ka hoʻololi ʻana i kekahi o nā ʻāpana kamera (hōʻike, nānā, kūlana) a hui pū i nā kiʻi hopena, loaʻa iā mākou kahi mea hiki ʻole ke hopu ʻia i hoʻokahi kiʻi. Akā he huaʻōlelo kēia no ka poʻe theorists; ma ka hoʻomaʻamaʻa, ua paʻa ka inoa ʻē aʻe - staking. I kēia lā, ʻoiaʻiʻo, ʻo 90% o nā mea hou a pau i nā kāmeʻa kelepona e pili ana iā ia.

ʻatikala hou: Computational Photography

He mea i noʻonoʻo ʻole ai ka poʻe he nui, akā he mea nui ka hoʻomaopopo ʻana i nā kiʻi paʻi kiʻi a me nā kiʻi kamepiula: hoʻomaka ka pahupaʻikiʻi ma ke kelepona hou i kēia manawa ke wehe ʻoe i kāna polokalamu. He mea kūpono, no ka mea, pono ʻo ia e hoʻololi i ke kiʻi i ka pale. Eia nō naʻe, ma waho aʻe o ka pale, mālama ʻo ia i nā kiʻi kiʻekiʻe i loko o kāna pale loop loop, kahi e mālama ai iā lākou no nā kekona ʻelua.

Ke paʻi ʻoe i ke pihi "kiʻi kiʻi", ua lawe ʻia, lawe wale ke kāmela i ke kiʻi hope loa mai ka buffer.

ʻO kēia ke ʻano o ka hana ʻana o kekahi pahupaʻikiʻi kelepona i kēia lā. Ma ka liʻiliʻi loa ma nā hae hae a pau ʻaʻole mai nā puʻu ʻōpala. Hiki iā ʻoe ke hoʻomaopopo ʻaʻole wale ka zero shutter lag, nā mea paʻi kiʻi i moeʻuhane lōʻihi, akā maikaʻi ʻole - ke kaomi ʻoe i kahi pihi, nānā ke kelepona i ka wā i hala, wehe i nā kiʻi 5-10 hope loa mai ka buffer a hoʻomaka i ka hoʻopaʻa ʻana. a kāpili iā lākou. ʻAʻole e kali hou i ke kelepona e kaomi i nā kiʻi no HDR a i ʻole ke ʻano pō - lawe wale iā lākou mai ka buffer, ʻaʻole ʻike ka mea hoʻohana.

ʻatikala hou: Computational Photography

Ma ke ala, ʻo ia me ke kōkua o ka lag shutter maikaʻi ʻole i hoʻokō ʻia ʻo Live Photo ma iPhones, a ua like ka HTC i ka makahiki 2013 ma lalo o ka inoa ʻē ʻo Zoe.

#Hoʻopaʻa ʻike - HDR a me ka hakakā ʻana i nā loli o ka mālamalama

ʻatikala hou: Computational Photography

Inā hiki i nā mea ʻike kamepiula ke hopu i ka laulā holoʻokoʻa i hiki i ko mākou mau maka, he kumuhana wela kahiko ia o ka hoʻopaʻapaʻa. ʻAʻole ʻōlelo kekahi, no ka mea hiki i ka maka ke ʻike i ka 25 f-stops, ʻoiai mai kahi matrix piha piha kiʻekiʻe hiki iā ʻoe ke loaʻa i ka nui o 14. Ke kapa nei kekahi i ka hoʻohālikelike ʻana, no ka mea, kōkua ka lolo i ka maka ma ka hoʻoponopono ʻana. ka haumāna a hoʻopiha i ke kiʻi me kona neural networks, a me ka manawa ʻAʻole i ʻoi aku ka nui o ka dynamic range o ka maka ma mua o 10-14 f-stops wale nō. E waiho kākou i kēia hoʻopaʻapaʻa i ka poʻe noʻonoʻo noho lima maikaʻi loa ma ka Pūnaewele.

ʻO ka mea ʻoiaʻiʻo: ke pana ʻoe i nā hoaaloha i kahi lani ʻālohilohi me ka HDR ʻole ma kekahi pahupaʻikiʻi kelepona, loaʻa iā ʻoe kahi lani maʻamau a me nā maka ʻeleʻele o nā hoaaloha, a i ʻole nā ​​​​hoaaloha maikaʻi, akā ua wela ka lani a make.

Ua hoʻolālā lōʻihi ka hopena - e hoʻonui i ka laulā me ka hoʻohana ʻana i HDR (High dynamic range). Pono ʻoe e lawe i kekahi mau kiʻi i nā wikiwiki pani ʻokoʻa a humuhumu pū. No laila he "maʻamau" kēlā, ʻoi aku ka māmā o ka lua, ʻoi aku ka pōʻeleʻele o ke kolu. Lawe mākou i nā wahi ʻeleʻele mai kahi kukui kukui, hoʻopiha i nā overexposures mai kahi pōʻeleʻele - loaʻa kālā. ʻO nā mea a pau e hoʻoponopono ai i ka pilikia o ka bracketing maʻalahi - pehea ka nui o ka hoʻololi ʻana i ka ʻike o kēlā me kēia kiʻi i ʻole e hoʻonui ʻia, akā i kēia manawa hiki i kahi haumāna makahiki ʻelua ma ke kulanui ʻenehana ke hoʻoholo i ka awelika o ka mālamalama o ke kiʻi.

ʻatikala hou: Computational Photography

Ma ka iPhone hou loa, Pixel a me Galaxy, huli ʻia ke ʻano HDR i ka wā e hoʻoholo ai kahi algorithm maʻalahi i loko o ke kāmela e pana ana ʻoe i kekahi mea me ka ʻokoʻa i ka lā lā. Hiki iā ʻoe ke ʻike pehea e hoʻololi ai ke kelepona i ke ʻano hoʻopaʻa leo i ka buffer i mea e mālama ai i nā kiʻi i hoʻololi ʻia i ka ʻike - hāʻule ka fps i ke kāmela, a lilo ke kiʻi ponoʻī. ʻIke maopopo ʻia ka manawa hoʻololi ma kaʻu iPhone X i ke kiʻi ʻana i waho. E nānā pono i kāu kelepona i ka wā aʻe.

ʻO ka hemahema o HDR me ka hoʻolaha bracketing ʻo kona hiki ʻole ke kōkua ʻole i nā kukui maikaʻi ʻole. ʻOiai me ka mālamalama o ke kukui lumi, ua pōʻeleʻele nā ​​papa i hiki ʻole i ke kamepiula ke hoʻolike a humuhumu. No ka hoʻoponopono ʻana i ka pilikia me ka māmā, i ka makahiki 2013 ua hōʻike ʻo Google i kahi ala ʻē aʻe i HDR i ka polokalamu kelepona Nexus i hoʻokuʻu ʻia. Ua hoʻohana ʻo ia i ka hoʻopaʻa manawa.

#Hoʻopaʻa manawa - hoʻohālikelike lōʻihi a me ka hala o ka manawa

ʻatikala hou: Computational Photography

Hiki iā ʻoe ke hana i kahi hōʻike lōʻihi me ka hoʻohana ʻana i nā ʻano pōkole. ʻO ka poʻe paionia ka poʻe pā i ke kiʻi ʻana i nā ala hōkū ma ka lani o ka pō, a ʻike lākou he mea paʻakikī ke wehe i ka pani no ʻelua hola i ka manawa hoʻokahi. He paʻakikī loa ka helu ʻana i nā hoʻonohonoho āpau ma mua, a ʻo ka haʻalulu liʻiliʻi e hōʻino i ke kiʻi holoʻokoʻa. Ua hoʻoholo lākou e wehe i ka pani no ʻelua mau minuke wale nō, akā i nā manawa he nui, a laila hoʻi i ka home a hoʻopili i nā kiʻi hopena i Photoshop.

ʻatikala hou: Computational Photography

ʻIke ʻia ʻaʻole i pana maoli ke kāmela i ka wikiwiki pani lōʻihi, akā loaʻa iā mākou ka hopena o ka hoʻohālikelike ʻana iā ia ma ka hoʻohui ʻana i kekahi mau kiʻi i lawe ʻia i ka lālani. Aia kekahi pūʻulu o nā polokalamu i kākau ʻia no nā smartphones e hoʻohana nei i kēia hoʻopunipuni no ka manawa lōʻihi, akā ʻaʻole pono lākou a pau mai ka hoʻohui ʻia ʻana o ka hiʻohiʻona i nā kāmela maʻamau āpau. I kēia lā, hiki i kahi iPhone ke hoʻopaʻa maʻalahi i kahi hōʻike lōʻihi mai kahi Live Photo.

ʻatikala hou: Computational Photography

E hoʻi kāua i Google me kāna HDR pō. Ua ʻike ʻia ʻo ka hoʻohana ʻana i ka bracketing manawa hiki iā ʻoe ke hoʻokō i ka HDR maikaʻi i ka pōʻeleʻele. Ua ʻike mua ʻia ka ʻenehana i ka Nexus 5 a ua kapa ʻia ʻo HDR +. ʻO ke koena o nā kelepona Android i loaʻa iā ia me he makana lā. Ke kaulana nei ka ʻenehana a mahalo ʻia i ka hōʻike ʻana o nā Pixels hou loa.

Hana maʻalahi ka HDR +: i ka hoʻoholo ʻana e pana ana ʻoe i ka pōʻeleʻele, wehe ke kāmela i nā kiʻi 8-15 RAW hope loa mai ka buffer i mea e uhi ai iā lākou ma luna o kekahi. No laila, ʻohi ka algorithm i nā ʻike hou aʻe e pili ana i nā wahi ʻeleʻele o ke kiʻi e hōʻemi i ka walaʻau - nā pika kahi, no kekahi kumu, ʻaʻole hiki i ke kāmela ke hōʻiliʻili i nā ʻike āpau a hele hewa.

Me he mea lā inā ʻaʻole ʻoe i ʻike i ke ʻano o ka capybara a ua noi ʻoe i ʻelima mau kānaka e wehewehe iā ia, ʻano like kā lākou mau moʻolelo, akā e haʻi kēlā me kēia i kekahi kikoʻī kūʻokoʻa. Ma kēia ala e ʻohi ai ʻoe i nā ʻike hou aʻe ma mua o ka nīnau ʻana i hoʻokahi. Ua like ia me nā pika.

ʻO ka hoʻohui ʻana i nā kiʻi i lawe ʻia mai kahi wahi e hāʻawi i ka hopena hoʻopunipuni lōʻihi e like me nā hōkū ma luna. Ua hōʻuluʻulu ʻia ka hōʻike ʻana o nā papa he nui, ua hōʻemi ʻia nā hewa i kekahi. E noʻonoʻo i ka nui o nā manawa āu e kaomi ai i ka pani pani DSLR i kēlā me kēia manawa e hoʻokō i kēia.

ʻatikala hou: Computational Photography

ʻO nā mea a pau i koe, ʻo ia ka hoʻoponopono ʻana i ka pilikia o ka hoʻoponopono ʻana i ka waihoʻoluʻu - ʻo nā kiʻi i lawe ʻia i ka pōʻeleʻele e lilo i melemele a ʻōmaʻomaʻo paha, a makemake mākou i ka momona o ke ao. I nā mana mua o HDR +, ua hoʻoholo ʻia kēia ma ka hoʻoponopono ʻana i nā hoʻonohonoho, e like me nā kānana a la Instagram. A laila kāhea lākou i nā neural network e kōkua.

ʻO kēia ke ʻano i ʻike ʻia ai ka Night Sight - ʻo ka ʻenehana o ka "pō kiʻi" ma Pixel 2 a me 3. Ma ka wehewehe ʻōlelo lākou: "ʻO nā ʻenehana aʻo mīkini i kūkulu ʻia ma luna o HDR +, e hana ai ka Night Sight." ʻO ka mea nui, ʻo kēia ka automation o ka pae hoʻoponopono kala. Ua hoʻomaʻamaʻa ʻia ka mīkini ma kahi ʻikepili o nā kiʻi "ma mua" a me "ma hope" i mea e hana ai i hoʻokahi kiʻi nani mai nā pūʻulu o nā kiʻi kekee ʻeleʻele.

ʻatikala hou: Computational Photography

Ma ke ala, ua hoʻolaha ʻia ka ʻikepili i ka lehulehu. E lawe paha nā poʻe o Apple iā ia a aʻo hope i kā lākou mau kīʻaha aniani e kiʻi pono i nā kiʻi i ka pōʻeleʻele.

Eia kekahi, hoʻohana ʻo Night Sight i ka helu ʻana o ka vector neʻe o nā mea i loko o ke kiʻi e hoʻomaʻamaʻa i ka blur i ʻike ʻia me ka wikiwiki pani lōʻihi. No laila, hiki i ke kelepona ke lawe i nā ʻāpana ʻokoʻa mai nā kiʻi ʻē aʻe a hoʻopili iā lākou.

#Hoʻopaʻa hoʻoneʻe - panorama, superzoom a me ka hoʻohaʻahaʻa leo

ʻatikala hou: Computational Photography

He leʻaleʻa kaulana ʻo Panorama no nā kamaʻāina o nā kuaʻāina. ʻAʻole ʻike ka mōʻaukala i nā hihia i makemake ʻia kahi kiʻi sausage i nā mea ʻē aʻe ma mua o kāna mea kākau, akā ʻaʻole hiki ke mālama ʻia - no nā mea he nui, ʻo ia kahi i hoʻomaka ai ka hoʻopaʻa ʻana.

ʻatikala hou: Computational Photography

ʻO ke ala pono mua e hoʻohana ai i kahi panorama, ʻo ia ke kiʻi ʻana i ke kiʻi o kahi hoʻonā ʻoi aku ka kiʻekiʻe ma mua o ka pahu kiʻi paʻi kiʻi i ʻae ʻia ma ka humuhumu ʻana i kekahi mau papa. Ua lōʻihi ka hoʻohana ʻana o nā mea paʻi kiʻi i nā polokalamu like ʻole no nā kiʻi i kapa ʻia ʻo super-resolution kiʻi - ke ʻike ʻia nā kiʻi hoʻololi liʻiliʻi e hoʻokō kekahi i kekahi ma waena o nā pika. Ma kēia ala hiki iā ʻoe ke kiʻi i kahi kiʻi o ka liʻiliʻi o nā haneli gigapixels, he mea maikaʻi loa inā pono ʻoe e paʻi ma ka pepa hoʻolaha e like me ka nui o ka hale.

ʻatikala hou: Computational Photography

ʻO kahi ala ʻē aʻe, ʻoi aku ka hoihoi ʻo Pixel Shifting. Ua hoʻomaka kekahi mau kāmela aniani ʻole e like me Sony a me Olympus e kākoʻo iā ia i ka makahiki 2014, akā pono lākou e hoʻopili i ka hopena ma ka lima. ʻO nā hana hou kamera nui maʻamau.

Ua lanakila nā kelepona ma ʻaneʻi no kahi kumu ʻakaʻaka - ke kiʻi ʻoe i ke kiʻi, haʻalulu kou mau lima. ʻO kēia pilikia ka mea i hoʻokumu i ke kumu no ka hoʻokō ʻana i ka hoʻonā super maoli ma nā smartphones.

No ka hoʻomaopopo ʻana i ka hana ʻana o kēia, pono ʻoe e hoʻomanaʻo pehea i hoʻonohonoho ʻia ai ka matrix o kēlā me kēia kamera. Hiki i kēlā me kēia pika (photodiode) ke hoʻopaʻa i ka ikaika o ka mālamalama - ʻo ia hoʻi, ka helu o nā photons e hiki mai ana. Eia naʻe, ʻaʻole hiki i kahi pika ke ana i kona kala (lōʻihi nalu). No ke kiʻi ʻana i kahi kiʻi RGB, pono mākou e hoʻohui i nā koʻokoʻo ma aneʻi - uhi i ka matrix holoʻokoʻa me kahi pahu aniani o nā ʻāpana aniani. ʻO kāna hoʻokō kaulana loa i kapa ʻia ʻo ka kānana Bayer a hoʻohana ʻia i ka hapa nui o nā matrices i kēia lā. E like me ke kiʻi ma lalo nei.

ʻatikala hou: Computational Photography

ʻIke ʻia ʻo kēlā me kēia pika o ka matrix e hopu wale i ka R-, G- a i ʻole B-component, no ka mea, ʻike ʻia nā kiʻi i koe me ke aloha ʻole e ka kānana Bayer. Hoʻomaopopo ʻo ia i nā ʻāpana e nalowale ana ma ka hoʻohālikelike ʻana i nā waiwai o nā pika kokoke.

Nui aʻe nā ʻōmaʻomaʻo i loko o ka kānana Bayer - ua hana ʻia kēia ma ke ʻano hoʻohālikelike me ka maka kanaka. Ka mea, mai loko mai o 50 miliona pika ma ka matrix, omaomao e hopu 25 miliona, ulaula a me ka uliuli - 12,5 miliona i kela a me keia.. Ke koena e awelika - keia kaʻina i kapaia debayerization a demosaicing, a me keia mea he momona funny crutch ma luna. kahi e hoomaha ai na mea a pau.

ʻatikala hou: Computational Photography

ʻO ka ʻoiaʻiʻo, aia kēlā me kēia matrix i kāna algorithm demosaicing patented maalea, akā no ke kumu o kēia moʻolelo e haʻalele mākou i kēia.

ʻAʻole i paʻa nā ʻano matrices ʻē aʻe (e like me Foveon). ʻOiai ke hoʻāʻo nei kekahi mau mea hana e hoʻohana i nā sensor me ka ʻole o kahi kānana Bayer e hoʻomaikaʻi ai i ka ʻoi a me ka laulā.

Ke liʻiliʻi ka mālamalama a i ʻole ka liʻiliʻi loa o nā kikoʻī o kahi mea, nalowale mākou i ka nui o ka ʻike no ka mea ʻoki loa ka kānana Bayer i nā kiʻi kiʻi me kahi lōʻihi makemake ʻole. ʻO ia ke kumu i hele mai ai lākou me Pixel Shifting - hoʻololi i ka matrix e 1 pika i luna-lalo-hema-hema e hopu iā lākou āpau. I kēia hihia, ʻaʻole i lilo ke kiʻi i 4 mau manawa nui, e like me ka mea i ʻike ʻia, hoʻohana wale ka mea hana i kēia ʻikepili e hoʻopaʻa pololei i ka waiwai o kēlā me kēia pika. ʻAʻole ia ma luna o kona mau hoalauna, pēlā e ʻōlelo ai, akā ma luna o ʻehā mau waiwai nona iho.

ʻatikala hou: Computational Photography

ʻO ka lulu ʻana o ko mākou mau lima i ke kiʻi ʻana i nā kiʻi ma ke kelepona ʻo ia ka hopena kūlohelohe. I nā mana hou loa o Google Pixel, hoʻokō ʻia kēia mea a huli i ka wā e hoʻohana ai ʻoe i ka zoom ma ke kelepona - ua kapa ʻia ʻo Super Res Zoom (ʻae, makemake wau i kā lākou inoa aloha ʻole). Ua kope no hoi na Pake i ka lakou mau laophone, oiai ua oi aku ka ino.

ʻO ka uhi ʻana i nā kiʻi i hoʻololi iki ʻia ma luna o kekahi e hiki ai iā ʻoe ke hōʻiliʻili i ka ʻike hou aku e pili ana i ke kala o kēlā me kēia pika, ʻo ia hoʻi ka hōʻemi ʻana i ka walaʻau, ka hoʻonui ʻana i ka ʻoi a me ka hoʻonui ʻana i ka hoʻonā me ka hoʻonui ʻole i ka helu kino o nā megapixels o ka matrix. Hana ʻokoʻa nā poʻokela Android hou i kēia, me ka noʻonoʻo ʻole o kā lākou mea hoʻohana.

#Hoʻopaʻa kikoʻī - kekahi hohonu o ke kahua a nānā hou i ka hana ma hope o ka hana

ʻatikala hou: Computational Photography

No ke kiʻi macro ke ʻano, kahi i pilikia mau ai ka hohonu pāpaʻu. I mea e nānā pono ai ka mea holoʻokoʻa, pono ʻoe e lawe i kekahi mau papa me ka neʻe ʻana o ka nānā ʻana i hope a i waho, a laila humuhumu i hoʻokahi ʻoi. Hoʻohana pinepine ʻia ke ʻano hana e nā mea paʻi kiʻi ʻāina, e hana ana i ka ʻaoʻao mua a me ke kua i ʻoi e like me ka maʻi maʻi.

ʻatikala hou: Computational Photography

Ua neʻe kēia mau mea i nā smartphones, ʻoiai ʻaʻole nui ka hype. Ma 2013, ua hoʻokuʻu ʻia ʻo Nokia Lumia 1020 me "Refocus App", a ma 2014, Samsung Galaxy S5 me ke ʻano "Selective Focus". Hana lākou e like me ka hoʻolālā like: ma ke kaomi ʻana i kahi pihi, lawe koke lākou i 3 mau kiʻi - hoʻokahi me ka "maʻamau", ʻo ka lua me ka nānā ʻana i neʻe i mua a ʻo ke kolu me ka nānā ʻana i hope. Hoʻopili ka papahana i nā kiʻi a ʻae iā ʻoe e koho i kekahi o lākou, i manaʻo ʻia ʻo ia ka mana "maoli" ma hope o ka hana ʻana.

ʻAʻohe hana hou aʻe, no ka mea, ʻo kēia hack maʻalahi ua lawa ia e hoʻokau i kahi kui hou i loko o ka poʻi o Lytro a me kāna mau hoa me kā lākou hoʻohuli hou ʻana. Ma ke ala, e kamaʻilio e pili ana iā lākou (transition master 80 lvl).

#Matrices computational - nā māla māmā a me nā plenoptics

E like me kā mākou i hoʻomaopopo ai ma luna, he mea weliweli kā mākou matrices ma nā koʻokoʻo. Ua maʻa wale mākou a ke hoʻāʻo nei mākou e noho me ia. Ua loli iki ko lākou ʻano mai ka wā kahiko. Ua hoʻomaikaʻi wale mākou i ke kaʻina hana ʻenehana - ua hoʻemi mākou i ka mamao ma waena o nā pika, hakakā me ka walaʻau hoʻopiʻi, a hoʻohui i nā pika kūikawā no ka pae ʻike autofocus. Akā inā e lawe ʻoe i ka DSLR nui loa a hoʻāʻo e kiʻi i kahi pōpoki holo me ia i loko o ke kukui lumi - ʻo ka pōpoki, e kau mālie, e lanakila.

ʻatikala hou: Computational Photography

Ua hoʻāʻo mākou e hana i kahi mea maikaʻi aʻe no ka manawa lōʻihi. He nui nā ho'āʻo a me ka noiʻi ʻana ma kēia wahi i googled no "computational sensor" a i ʻole "non-bayer sensor", a ʻo ka Pixel Shifting hiʻohiʻona ma luna nei hiki ke hoʻopili ʻia i nā hoʻāʻo e hoʻomaikaʻi i nā matrices me ka hoʻohana ʻana i nā helu. Eia nō naʻe, ʻo nā moʻolelo hoʻohiki maikaʻi loa i nā makahiki he iwakālua i hala ua hiki mai iā mākou mai ka honua o nā mea i kapa ʻia ʻo nā kāmela plenoptic.

I ʻole ʻoe e hiamoe mai ka manaʻo ʻana i nā huaʻōlelo paʻakikī e hiki mai ana, e hoʻolei wau i loko o kahi mea hoʻopukapuka ʻo ke kāmela o ka Google Pixel hou loa he "liʻiliʻi" plenoptic. ʻElua mau pika wale nō, akā hiki i kēia ke helu i ka hohonu optical kūpono o ke kiʻi me ka ʻole o kahi kāmela lua, e like me nā mea ʻē aʻe.

ʻO Plenoptics kahi mea kaua ikaika i kī ʻole ʻia. Eia kahi loulou i kekahi o kaʻu mau punahele hou. ʻatikala e pili ana i ka hiki o nā kāmela plenoptic a me kā mākou wā e hiki mai ana me lākou, kahi aʻu i ʻaiʻē ai i nā laʻana mai.

#

Kāmeʻa Plenoptic - hiki koke mai

Hana ʻia ma 1994, hōʻiliʻili ʻia ma Stanford ma 2004. Ua hoʻokuʻu ʻia ka pahu paʻi kiʻi mua, ʻo Lytro, ma 2012. Ke ho'āʻo ikaika nei ka ʻoihana VR me nā ʻenehana like.

ʻOkoʻa kahi kāmela plenoptic mai kahi kāmela maʻamau i hoʻokahi hoʻololi - ua uhi ʻia kāna matrix me kahi pahu o nā lens, e uhi ana kēlā me kēia mea i kekahi mau pika maoli. ʻO kekahi mea e like me kēia:

ʻatikala hou: Computational Photography

Inā helu pololei ʻoe i ka mamao mai ka mākia a hiki i ka matrix a me ka nui o ka aperture, e loaʻa i ke kiʻi hope nā puʻupuʻu o nā pika - ʻano o nā ʻano liʻiliʻi o ke kiʻi kumu.

ʻIke ʻia inā ʻoe e lawe, e ʻōlelo, i hoʻokahi kiko waena mai kēlā me kēia puʻupuʻu a hoʻopili i ke kiʻi me ka hoʻohana wale ʻana iā lākou, ʻaʻole ia e ʻokoʻa mai ka mea i lawe ʻia me kahi kāmela maʻamau. ʻAe, ua nalowale mākou i ka hoʻonā, akā e noi wale mākou iā Sony e hoʻohui i nā megapixels hou i nā matrices hou.

ʻatikala hou: Computational Photography

Ke hoʻomaka wale nei ka leʻaleʻa. inā lawe ʻoe i kahi pika hou mai kēlā me kēia puʻupuʻu a humuhumu hou i ke kiʻi, e loaʻa hou iā ʻoe ke kiʻi maʻamau, me he mea lā ua lawe ʻia me ka hoʻololi ʻana o hoʻokahi pika. No laila, loaʻa nā pūʻulu o 10 × 10 pixels, e loaʻa iā mākou nā kiʻi 100 o ka mea mai nā wahi ʻokoʻa "liʻiliʻi".

ʻatikala hou: Computational Photography

ʻOi aku ka nui o nā kiʻi, akā haʻahaʻa ka hoʻonā. I ka honua o nā smartphones me nā matrices 41-megapixel, ʻoiai hiki iā mākou ke haʻalele iki i ka hoʻonā ʻana, aia ka palena o nā mea āpau. Pono ʻoe e mālama i ke kaulike.

ʻAe, ua hōʻuluʻulu mākou i kahi kāmele plenoptic, no laila he aha ka mea e hāʻawi mai iā mākou?

Hoʻopono hou

ʻO ka hiʻohiʻona a ka poʻe nūpepa a pau e haʻalulu nei ma nā ʻatikala e pili ana iā Lytro ʻo ia ka hiki ke hoʻoponopono pololei i ka manaʻo ma hope o ka hana. ʻO ke kūpono, ʻaʻole mākou e hoʻohana i nā algorithm deblurring, akā hoʻohana wale i nā pika ma ka lima, ke koho ʻana a i ʻole ka hoʻohana ʻana iā lākou mai nā puʻupuʻu i ke kauoha i makemake ʻia.

He ʻano ʻē ke kiʻi RAW mai kahi kāmela plenoptic. No ka loaʻa ʻana o ka jeep ʻoi maʻamau, pono ʻoe e hōʻuluʻulu mua iā ia. No ka hana ʻana i kēia, pono ʻoe e koho i kēlā me kēia pika o ka jeep mai kekahi o nā pūʻulu RAW. Ma muli o ke ʻano o kā mākou koho ʻana iā lākou, e loli ka hopena.

No ka laʻana, ʻoi aku ka mamao o ka puʻupuʻu mai kahi o ka ulu ʻana o ka kukuna kumu, ʻoi aku ka mamao o kēia kukuna. No ka mea optics. No ka loaʻa ʻana o kahi kiʻi i hoʻohuli ʻia, pono mākou e koho i nā pika ma kahi mamao i makemake ʻia mai ke kiʻi kumu - kokoke a i ʻole.

ʻatikala hou: Computational Photography

 

Ua ʻoi aku ka paʻakikī o ka hoʻololi ʻana i ka manaʻo iā ʻoe iho - ma ke kino maoli, ʻoi aku ka liʻiliʻi o ia mau pika i loko o nā pūʻulu. I ka wā mua, ʻaʻole makemake nā mea hoʻomohala e hāʻawi i ka mea hoʻohana i ka hiki ke nānā aku me ko lākou mau lima-ʻo ke kāmela ponoʻī i hoʻoholo i kēia i ka polokalamu. ʻAʻole makemake nā mea hoʻohana i kēia wā e hiki mai ana, no laila ua hoʻohui lākou i kahi hiʻohiʻona i ka firmware hope i kapa ʻia ʻo "creative mode," akā ua hana hou i loko o ia mea i kaupalena ʻia no kēia kumu.

Palapala hohonu a me 3D mai hoʻokahi pahupaʻikiʻi   

ʻO kekahi o nā hana maʻalahi i ka plenoptics ka loaʻa ʻana o kahi palapala hohonu. No ka hana ʻana i kēia, pono ʻoe e hōʻiliʻili i ʻelua mau papa like ʻole a helu i ka nui o nā mea i loko o ia mau mea e hoʻololi ʻia. ʻO ka hoʻololi hou ʻana, ʻo ia hoʻi, ʻoi aku ka mamao mai ke kamera.

Ua kūʻai aku ʻo Google a pepehi iā Lytro, akā ua hoʻohana i kā lākou ʻenehana no kāna VR a ... no ke kāmela Pixel. E hoʻomaka ana me Pixel 2, ua lilo ke kāmela "plenoptic" no ka manawa mua, ʻoiai me nā pūʻulu o ʻelua mau pika. Hāʻawi kēia iā Google i ka manawa ʻaʻole e hoʻokomo i kahi kāmela lua, e like me nā kāne ʻē aʻe, akā e helu i ka palapala ʻāina hohonu mai kahi kiʻi wale nō.

ʻatikala hou: Computational Photography

ʻatikala hou: Computational Photography

Kūkulu ʻia ka palapala ʻāina hohonu me ka hoʻohana ʻana i ʻelua mau papa i hoʻololi ʻia e hoʻokahi subpixel. Ua lawa kēia no ka helu ʻana i kahi palapala ʻāina hohonu a hoʻokaʻawale i ke kahua mua mai ke kua a hoʻoheheʻe i ka hope i ka bokeh i kēia manawa. Hoʻomaʻamaʻa ʻia ka hopena o ia papa ʻaina a "hoʻomaikaʻi" e nā neural network i aʻo ʻia e hoʻomaikaʻi i nā palapala ʻāina hohonu (a ʻaʻole blur, e like me ka manaʻo o ka poʻe he nui).

ʻatikala hou: Computational Photography

ʻO ka hoʻopunipuni ua loaʻa iā mākou nā plenoptics i nā smartphones kokoke i ka uku ʻole. Ua kau mua mākou i nā lens ma kēia mau matrices liʻiliʻi i mea e hoʻonui ai i ka flux luminous. I ka Pixel aʻe, hoʻolālā ʻo Google e hele hou a uhi i ʻehā photodiodes me kahi lens.

Source: 3dnews.ru

Pākuʻi i ka manaʻo hoʻopuka