NeuroIPS () ndi msonkhano waukulu kwambiri padziko lonse wokhudza kuphunzira makina ndi luntha lochita kupanga komanso chochitika chachikulu padziko lonse lapansi cha kuphunzira mozama.
Kodi ife, mainjiniya a DS, tidzadziwanso biology, linguistics, ndi psychology m'zaka khumi zatsopanozi? Tikuwuzani mu ndemanga yathu.
Chaka chino msonkhanowu unasonkhanitsa anthu oposa 13500 ochokera m’mayiko 80 mumzinda wa Vancouver, ku Canada. Ichi si chaka choyamba kuti Sberbank akuyimira Russia pamsonkhanowo - gulu la DS linalankhula za kukhazikitsidwa kwa ML mu njira za banki, za mpikisano wa ML komanso za luso la nsanja ya Sberbank DS. Kodi zomwe zidachitika mu 2019 mgulu la ML zinali zotani? Otenga nawo mbali pa msonkhanowu akuti: и .
Chaka chino, NeurIPS inavomereza mapepala oposa 1400-maalgorithms, zitsanzo zatsopano, ndi mapulogalamu atsopano ku deta yatsopano.
Zamkatimu:
- Miyambo
-
- Kutanthauzira kwachitsanzo
- Multidisciplinarity
- Kukambitsirana
- RL
- GAN
- Nkhani Zoyitanira
-
- "Social Intelligence", Blaise Aguera ndi Arcas (Google)
- "Veridical Data Science", Bin Yu (Berkeley)
- "Kutengera Makhalidwe Aumunthu ndi Kuphunzira Kwamakina: Mwayi ndi Zovuta", Nuria M Oliver, Albert Ali Salah
- "Kuchokera ku System 1 mpaka System 2 Kuphunzira Mwakuya", Yoshua Bengio
Zochitika za 2019 za Chaka
1. Kutanthauzira kwachitsanzo ndi njira yatsopano ya ML
Mutu waukulu wa msonkhanowu ndi kutanthauzira ndi umboni wa chifukwa chake timapeza zotsatira zina. Munthu akhoza kuyankhula kwa nthawi yaitali za kufunika kwa filosofi ya kutanthauzira kwa "bokosi lakuda", koma panali njira zenizeni ndi chitukuko chaukadaulo m'derali.
Njira yotengera zitsanzo ndikuchotsa chidziwitso kuchokera muzo ndi chida chatsopano cha sayansi. Zitsanzo zitha kukhala ngati chida chopezera chidziwitso chatsopano ndikuchiyesa, ndipo gawo lililonse la preprocessing, kuphunzitsa ndi kugwiritsa ntchito chitsanzocho liyenera kupangidwanso.
Gawo lalikulu la zofalitsa silinaperekedwe pomanga zitsanzo ndi zida, koma pamavuto owonetsetsa chitetezo, kuwonekera komanso kutsimikizika kwa zotsatira. Makamaka, mtsinje wosiyana wawonekera wokhudza kuukira kwachitsanzo (kuukira kwa adani), ndipo zosankha zonse ziwiri pakuwukira maphunziro ndi kuukira kwa ntchito zimaganiziridwa.
Zolemba:
- - nkhani yamapulogalamu panjira yotsimikizira zachitsanzo. Mulinso chiwongolero cha zida zamakono zomasulira zitsanzo, makamaka kugwiritsa ntchito chidwi ndikupeza kufunikira kwa "kusokoneza" neural network yokhala ndi mizere mizere.
- Chaofan Chen, Oscar Li, Daniel Tao, Alina Barnett, Cynthia Rudin, Jonathan K. Su
- Sara Hooker, Dumitru Erhan, Pieter-Jan Kindermans, Been Kim
- Alexander Mott, Daniel Zoran, Mike Chrzanowski, Daan Wierstra, Danilo Jimenez Rezende
- Xiao Li, Yu Wang, Sumanta Basu, Karl Kumbier, Bin Yu
- Jaemin Yoo, Minyong Cho, Taebum Kim, U Kang
- Edward Raff
ExBert.net ikuwonetsa kutanthauzira kwachitsanzo kwa ntchito zokonza zolemba
2. Kusiyanasiyana
Kuti titsimikizire zotsimikizirika zodalirika ndikupanga njira zotsimikizira ndi kukulitsa chidziwitso, tikufunika akatswiri azinthu zofananira omwe ali ndi luso pa ML ndi gawo la phunziroli (mankhwala, linguistics, neurobiology, maphunziro, ndi zina). Ndikoyenera kudziwa makamaka kupezeka kwa ntchito ndi zolankhula mu sayansi ya ubongo ndi sayansi yachidziwitso - pali kuyanjana kwa akatswiri ndi kubwereketsa malingaliro.
Kuphatikiza pa kuyanjana uku, ma multidisciplinarity akuwonekera pakuphatikizana kwa chidziwitso kuchokera kuzinthu zosiyanasiyana: zolemba ndi zithunzi, zolemba ndi masewera, zolemba zazithunzi + zolemba ndi zithunzi.
Zolemba:
- Neuroscience + ML -
- VisualQA -
- RL + NLP -
Mitundu iwiri - strategist ndi executive - yotengera RL ndi NLP play online strategy
3. Kukambitsirana
Kulimbitsa luntha lochita kupanga ndikusunthira ku machitidwe odzipangira okha, "chidziwitso", kulingalira ndi kulingalira. Makamaka, kulingalira kwapang'onopang'ono ndi kulingalira kwanzeru kukukula. Ena mwa malipoti amaperekedwa ku meta-learning (za momwe mungaphunzirire kuphunzira) komanso kuphatikiza kwa matekinoloje a DL okhala ndi 1st ndi 2nd order logic - mawu akuti Artificial General Intelligence (AGI) akukhala mawu wamba pamalankhulidwe a okamba.
Zolemba:
- Weijiang Yu, Jingwen Zhou, Weihao Yu, Xiaodan Liang, Nong Xiao
- Wang-Zhou Dai, Qiuling Xu, Yang Yu, Zhi-Hua Zhou
- Vaishak Belle, Brendan Juba
- Anton Bakhtin, Laurens van der Maaten, Justin Johnson, Laura Gustafson, Ross Girshick
- Dinesh Garg, Shajith Ikbal, Santosh K. Srivastava, Harit Vishwakarma, Hima Karanam, L Venkata Subramaniam
4.Kulimbikitsa Kuphunzira
Ntchito zambiri zikupitilizabe kupanga madera azikhalidwe za RL - DOTA2, Starcraft, kuphatikiza zomanga ndi masomphenya apakompyuta, NLP, ma graph database.
Tsiku losiyana la msonkhano linaperekedwa ku msonkhano wa RL, pomwe mapangidwe a Optimistic Actor Critic Model adaperekedwa, apamwamba kuposa onse am'mbuyomu, makamaka Soft Actor Critic.
Zolemba:
- ; Kamil Ciosek, Quan Vuong, Robert Loftin, Katja Hofmann
- ; Yasuhiro Fujita (Preferred Networks, Inc.)*; Toshiki Kataoka (Preferred Networks, Inc.); Prabhat Nagarajan (Maukonde Okondedwa); Takahiro Ishikawa (University of Tokyo) [external pdf link].
- ; Danijar Hafner (Google)*; Timothy Lillicrap (DeepMind); Jimmy Ba (University of Toronto); Mohammad Norouzi (Google Brain)
Osewera a StarCraft akulimbana ndi mtundu wa Alphastar (DeepMind)
5.GAN
Maukonde opanga akadali owonekera: ntchito zambiri zimagwiritsa ntchito ma GAN a vanila paumboni wa masamu, komanso amawagwiritsa ntchito m'njira zatsopano, zachilendo (zojambula zopanga ma graph, zogwira ntchito ndi mndandanda, kugwiritsa ntchito kuyambitsa-ndi-zokhudza maubwenzi mu data, ndi zina).
Zolemba:
- Sangwoo Mo, Chiheon Kim, Sungwoong Kim, Minsu Cho, Jinwoo Shin
- Dan Zhang, Anna Khoreva
- Lei Xu, Maria Skoularidou, Alfredo Cuesta-Infante, Kalyan Veeramachaneni
Popeza kuti ntchito yowonjezereka inavomerezedwa Pansipa tikambirana zokamba zofunika kwambiri.
Nkhani Zoitanidwa
"Social Intelligence", Blaise Aguera ndi Arcas (Google)
Nkhaniyi ikuyang'ana kwambiri njira yophunzirira makina komanso zomwe zikuyembekezeka kusintha makampani pakali pano - ndi njira ziti zomwe tikukumana nazo? Kodi ubongo ndi chisinthiko zimagwira ntchito bwanji, ndipo n’chifukwa chiyani sitigwiritsa ntchito kwambiri zimene timadziwa zokhudza mmene chilengedwe chimapangidwira?
Kukula kwa mafakitale a ML makamaka kumagwirizana ndi zochitika zazikuluzikulu za chitukuko cha Google, chomwe chimasindikiza kafukufuku wake pa NeurIPS chaka ndi chaka:
- 1997 - kukhazikitsidwa kwa malo osakira, ma seva oyamba, mphamvu yaying'ono yamakompyuta
- 2010 - Jeff Dean akuyambitsa pulojekiti ya Google Brain, kuwonjezereka kwa ma neural network pachiyambi pomwe
- 2015 - kukhazikitsidwa kwa mafakitale kwa ma neural network, kuzindikira nkhope mwachangu mwachindunji pazida zakomweko, mapurosesa otsika opangidwa ndi tensor computing - TPU. Google ikuyambitsa Coral ai - analogue ya raspberry pi, mini-kompyuta yoyambitsa ma neural network pakuyika koyesera
- 2017 - Google ikuyamba kupanga maphunziro apamwamba ndikuphatikiza zotsatira za maphunziro a neural network kuchokera ku zida zosiyanasiyana kukhala mtundu umodzi - pa Android.
Masiku ano, makampani onse amaperekedwa kuchitetezo cha data, kuphatikiza, ndi kubwereza zotsatira zamaphunziro pazida zam'deralo.
- mayendedwe a ML momwe anthu amaphunzirira pawokha paokha ndipo amaphatikizidwa kukhala chitsanzo chimodzi (popanda kuyika deta pakati pa gwero), kusinthidwa pazosowa, zolakwika, makonda, ndi zina zambiri. Zida zonse za Android ndizofunikira kwambiri pakompyuta imodzi ya Google.
Zitsanzo zopanga zotengera maphunziro achitachita ndi njira yodalirika yamtsogolo molingana ndi Google, yomwe ili "pamayambiriro a kukula kwakukulu." Ma GAN, malinga ndi mphunzitsi, amatha kuphunzira kubwereza kuchuluka kwa zamoyo zamoyo ndi ma algorithms oganiza.
Pogwiritsa ntchito chitsanzo cha zomangamanga ziwiri zosavuta za GAN, zikuwonetsedwa kuti kusaka njira yokwaniritsira kumayendayenda mozungulira, zomwe zikutanthauza kuti kukhathamiritsa koteroko sikuchitika. Panthawi imodzimodziyo, zitsanzozi zimakhala zopambana kwambiri poyesa kuyesa zomwe akatswiri a sayansi ya zamoyo amachita pamagulu a mabakiteriya, kuwakakamiza kuphunzira njira zatsopano zamakhalidwe pofunafuna chakudya. Titha kunena kuti moyo umagwira ntchito mosiyana ndi ntchito yokhathamiritsa.
Kuyenda GAN Kukhathamiritsa
Zonse zomwe timachita pamakina ophunzirira pamakina tsopano ndi ntchito zopapatiza komanso zokhazikika, pomwe machitidwewa samakhala bwino ndipo samafanana ndi zomwe timaphunzira m'magawo monga neurophysiology ndi biology.
Chomwe chili choyenera kubwereka ku gawo la neurophysiology posachedwa ndi zomangamanga zatsopano za neuron ndikuwunikanso pang'ono njira zobwezerera zolakwika.
Ubongo wamunthu sumaphunzira ngati neural network:
- Alibe zolowera mwachisawawa, kuphatikiza zomwe zidakhazikitsidwa ndi mphamvu komanso ubwana
- Ali ndi mayendedwe achibadwa a kakulidwe kachibadwa (chilakolako chophunzira chinenero kuchokera kwa khanda, kuyenda mowongoka)
Kuphunzitsa ubongo wa munthu payekha ndi ntchito yocheperako; mwina tiyenera kuganizira "makoloni" a anthu omwe akusintha mwachangu omwe amapereka chidziwitso kwa wina ndi mnzake kuti apangitsenso njira za chisinthiko chamagulu.
Zomwe titha kutengera ma aligorivimu a ML tsopano:
- Ikani zitsanzo zama cell zomwe zimatsimikizira kuphunzira kwa anthu, koma moyo waufupi wa munthu ("ubongo wamunthu")
- Kuphunzira pang'ono pogwiritsa ntchito zitsanzo zochepa
- Ma neuron ovuta kwambiri, magwiridwe antchito osiyana pang'ono
- Kusamutsa "genome" ku mibadwo yotsatira - backpropagation algorithm
- Tikangolumikiza neurophysiology ndi neural network, tiphunzira kupanga ubongo wogwiritsa ntchito zinthu zambiri kuchokera kuzinthu zambiri.
Kuchokera pamalingaliro awa, machitidwe a mayankho a SOTA ndi owononga ndipo akuyenera kukonzedwanso kuti apange ntchito zofananira (benchmarks).
"Veridical Data Science", Bin Yu (Berkeley)
Lipotilo laperekedwa ku vuto la kutanthauzira makina ophunzirira makina ndi njira yoyesera mwachindunji ndi kutsimikizira. Mtundu uliwonse wa ML wophunzitsidwa ukhoza kuwonedwa ngati gwero la chidziwitso chomwe chiyenera kuchotsedwamo.
M'madera ambiri, makamaka mankhwala, kugwiritsa ntchito chitsanzo sikungatheke popanda kuchotsa chidziwitso chobisika ichi ndikutanthauzira zotsatira za chitsanzo - mwinamwake sitidzakhala otsimikiza kuti zotsatira zake zidzakhala zokhazikika, zosawerengeka, zodalirika, ndipo sizidzapha wodwala. Njira yonse ya njira zogwirira ntchito ikukula mkati mwaphunziro lakuya ndipo imadutsa malire ake - sayansi ya data yeniyeni. Ndi chiyani?
Tikufuna kuti tikwaniritse zofalitsa zasayansi komanso kupangidwanso kwamitundu yomwe ili:
- zodziwikiratu
- makompyuta
- khola
Mfundo zitatu izi zimapanga maziko a njira yatsopano. Kodi mitundu ya ML ingawunikidwe bwanji motsutsana ndi izi? Njira yosavuta ndiyo kupanga zitsanzo zomasulira nthawi yomweyo (zobwerera, mitengo yachisankho). Komabe, tikufunanso kupeza mapindu a nthawi yomweyo a kuphunzira mozama.
Pali njira zingapo zothetsera vutoli:
- kutanthauzira chitsanzo;
- gwiritsani ntchito njira zozikidwa pa chidwi;
- gwiritsani ntchito ma algorithms ophatikizika pophunzitsa, ndikuwonetsetsa kuti mitundu yotanthauzira mizere iphunzira kulosera mayankho omwewo monga neural network, kutanthauzira mawonekedwe kuchokera pamzere wamzere;
- kusintha ndi kuwonjezera deta yophunzitsa. Izi zikuphatikizapo kuwonjezera phokoso, kusokoneza, ndi kuwonjezera deta;
- njira zilizonse zomwe zimathandiza kuonetsetsa kuti zotsatira za chitsanzozo sizikhala mwachisawawa ndipo sizidalira kusokoneza kochepa kosafunika (kuukira kwa adani);
- kutanthauzira chitsanzo pambuyo powona, pambuyo pa maphunziro;
- kuphunzira kumapanga zolemera m'njira zosiyanasiyana;
- phunzirani kuthekera kwa malingaliro onse, kugawa kwamagulu.
Kuukira kwa adani
Zolakwa zachitsanzo ndizokwera mtengo kwa aliyense: chitsanzo chabwino ndi ntchito ya Reinhart ndi Rogov. "" idakhudza mfundo zachuma m'maiko ambiri aku Europe ndikuwakakamiza kutsatira njira zochepetsera ndalama, koma kuwunikanso mosamala zomwe zidachitika komanso kukonzanso kwawo zaka pambuyo pake zidawonetsa zotsatira zosiyana!
Ukadaulo uliwonse wa ML umakhala ndi moyo wake kuyambira pakukhazikitsidwa mpaka kukhazikitsidwa. Cholinga cha njira yatsopanoyi ndikuwunika mfundo zitatu pagawo lililonse la moyo wachitsanzo.
Zotsatira:
- Ntchito zingapo zikupangidwa zomwe zingathandize kuti mtundu wa ML ukhale wodalirika. Izi, mwachitsanzo, deeptune (ulalo ku: );
- Kuti mupitilize kupititsa patsogolo njira, ndikofunikira kuwongolera bwino zofalitsa m'munda wa ML;
- Kuphunzira pamakina kumafunikira atsogoleri omwe ali ndi maphunziro osiyanasiyana komanso ukadaulo m'magawo aukadaulo ndi anthu.
"Kutengera Makhalidwe Aumunthu ndi Kuphunzira Kwamakina: Mwayi ndi Zovuta" Nuria M Oliver, Albert Ali Salah
Maphunziro operekedwa pakutengera machitidwe aumunthu, maziko ake aukadaulo ndi chiyembekezo chogwiritsa ntchito.
Makhalidwe a anthu akhoza kugawidwa m'magulu awiri:
- khalidwe la munthu payekha
- khalidwe la kagulu kakang'ono ka anthu
- khalidwe la anthu ambiri
Iliyonse mwa mitundu iyi imatha kutsatiridwa pogwiritsa ntchito ML, koma ndi chidziwitso ndi mawonekedwe osiyanasiyana. Mtundu uliwonse ulinso ndi zovuta zake zomwe polojekiti iliyonse imadutsamo:
- khalidwe la munthu - kuba zidziwitso, zabodza;
- khalidwe la magulu a anthu - de-anonymization, kupeza zambiri za kayendedwe, mafoni, etc.;
khalidwe la munthu payekha
Zogwirizana kwambiri ndi mutu wa Computer Vision - kuzindikira momwe anthu amamvera komanso momwe amachitira. Mwina pokhapokha, m'kupita kwanthawi, kapena ndi kuchuluka kwa kusinthasintha kwamalingaliro ake. Chithunzichi chikuwonetsa kuzindikira momwe Mona Lisa akumvera pogwiritsa ntchito mawu okhudza momwe amamvera azimayi aku Mediterranean. Zotsatira: kumwetulira kwachisangalalo, koma ndi kunyoza ndi kunyansidwa. Chifukwa chake ndi chotheka kwambiri mu njira yaukadaulo yofotokozera malingaliro "osakondera".
Khalidwe la kagulu kakang’ono ka anthu
Pakalipano chitsanzo choipa kwambiri ndi chifukwa cha chidziwitso chosakwanira. Mwachitsanzo, ntchito za 2018 - 2019 zidawonetsedwa. pa anthu ambiri X mavidiyo ambiri (cf. 100k++ zithunzi za dataset). Kuti muwonetsetse bwino ntchitoyi, zidziwitso zama multimodal zimafunikira, makamaka kuchokera ku masensa a thupi-altimeter, thermometer, kujambula maikolofoni, ndi zina.
Khalidwe lalikulu
Malo otukuka kwambiri, popeza kasitomala ndi UN ndi mayiko ambiri. Makamera oyang'anira panja, deta kuchokera ku nsanja za foni - kulipira, ma SMS, mafoni, deta pakuyenda pakati pa malire a boma - zonsezi zimapereka chithunzi chodalirika cha kayendetsedwe ka anthu ndi kusakhazikika kwa anthu. Zomwe zitha kugwiritsidwa ntchito paukadaulo: kukhathamiritsa kwa ntchito zopulumutsira, thandizo komanso kuthamangitsidwa kwa anthu munthawi yake pakagwa mwadzidzidzi. Mitundu yomwe imagwiritsidwa ntchito nthawi zambiri imatanthauziridwa molakwika - awa ndi ma LSTM osiyanasiyana ndi ma convolutional network. Panali ndemanga yachidule yoti bungwe la UN likulimbikitsa kuti pakhale lamulo latsopano lomwe lingakakamize mabizinesi aku Europe kuti agawane zomwe zili zofunika pakufufuza kulikonse.
"Kuchokera ku System 1 mpaka System 2 Kuphunzira Mwakuya", Yoshua Bengio
Munkhani ya Joshua Bengio, kuphunzira mozama kumakumana ndi neuroscience pamlingo wokhazikitsa zolinga.
Bengio amatchula mitundu iwiri ikuluikulu yamavuto malinga ndi njira ya Daniel Kahneman, yemwe adalandira mphotho ya Nobel (buku ".")
mtundu 1 - System 1, zochita zosadziwa zomwe timachita "zokha" (ubongo wakale): kuyendetsa galimoto m'malo odziwika, kuyenda, kuzindikira nkhope.
mtundu 2 - System 2, zochita zachidziwitso (cerebral cortex), kukhazikitsa zolinga, kusanthula, kulingalira, ntchito zophatikizika.
AI mpaka pano yafika pamtunda wokwanira pokhapokha muzochita zamtundu woyamba, pamene ntchito yathu ndikuyibweretsa ku yachiwiri, kuiphunzitsa kuti igwire ntchito zosiyanasiyana ndikugwira ntchito ndi malingaliro ndi luso lapamwamba la chidziwitso.
Kuti akwaniritse cholinga ichi akuperekedwa:
- muzochita za NLP, gwiritsani ntchito chidwi ngati njira yayikulu yowonetsera kuganiza
- gwiritsani ntchito kuphunzira kwa meta ndi kuyimilira kuti mukhale ndi mawonekedwe abwino omwe amakhudza chidziwitso ndi kutanthauzira kwawo - ndipo pamaziko awo amapitilira kugwira ntchito ndi malingaliro apamwamba.
M'malo momaliza, nayi nkhani yoyitanidwa: Bengio ndi m'modzi mwa asayansi ambiri omwe akuyesera kukulitsa gawo la ML kupitilira zovuta zokhathamiritsa, SOTA ndi zomangamanga zatsopano.
Funso limakhala lotseguka kuti kuphatikizika kwa zovuta za chidziwitso, chikoka cha chilankhulo pamaganizidwe, neurobiology ndi ma aligorivimu ndi zomwe zikutiyembekezera m'tsogolomu ndipo zidzatilola kusamukira ku makina omwe "amaganiza" ngati anthu.
Спасибо!
Source: www.habr.com