Inzwi renzvimbo: maziviro anoita huropi manzwi

Inzwi renzvimbo: maziviro anoita huropi manzwi

Nyika yakatitenderedza yakazara nemarudzi ese eruzivo ayo uropi hwedu hunoramba huchishanda. Anogamuchira ruzivo urwu kuburikidza nemitezo yepfungwa, imwe neimwe inotarisira chikamu chayo chezviratidzo: maziso (kuona), rurimi (kuravira), mhino (kunhuwa), ganda (kubata), vestibular apparatus (chiyero, chinzvimbo munzvimbo uye pfungwa uremu) uye nzeve (inzwi). Nokubatanidza zviratidzo zvinobva munhengo dzose idzi, uropi hwedu hunogona kugadzira mufananidzo wakarurama wemhoteredzo yedu. Asi hazvisi zvese zvekugadzirisa zviratidzo zvekunze zvinozivikanwa kwatiri. Chimwe chezvakavanzika izvi magadzirirwo ekugadzirisa kunobva manzwi.

Masayendisiti kubva kuLabhoritari yeNeuroengineering yeKutaura uye Kunzwa (New Jersey Institute of Technology) vakaronga muenzaniso mutsva weiyo neural process yekunzwika kwenzvimbo. Ndeapi maitiro chaiwo anoitika muuropi panguva yekuona kwenzwi, kuti uropi hwedu hunonzwisisa sei nzvimbo yeruzha, uye kuti tsvakiridzo iyi inogona kubatsira sei mukurwisa kusanzwa zvakanaka. Tinodzidza pamusoro peizvi kubva mushumo yeboka retsvakurudzo. Enda.

Hwaro hwechidzidzo

Ruzivo rwunogamuchira uropi hwedu kubva kumanzwiro edu akasiyana kubva kune mumwe nemumwe, maererano nekwahunobva uye maererano nemagadzirirwo awo. Mamwe masaini anobva angooneka kuhuropi hwedu seruzivo rwechokwadi, nepo mamwe achida mamwe macomputer maitiro. Kutaura zvazviri, tinonzwa tabatwa pakarepo, asi patinonzwa inzwi, tinofanira kuwana kwarinobva.

Hwaro hwekuisa manzwi mundege yakachinjika ndeye interaural* musiyano wenguva (ITD kubva interaural nguva musiyano) manzwi anosvika kunzeve dzemuteereri.

Interaural base* - kureba pakati penzeve.

Pane imwe nzvimbo muuropi (iyo yepakati yepamusoro yemuorivhi kana MSO) inokonzeresa kuita uku. Parizvino chiratidzo chezwi chinogamuchirwa muMVO, misiyano yenguva yepakati inoshandurwa kuita chiyero chekuita kwe neuroni. Chimiro cheMBO inobuda velocity curves sechishandiso cheITD inofanana nechimiro chemuchinjiko-wekubatanidzwa basa remasaini ekuisa panzeve yega yega.

Magadzirirwo nekududzirwa ruzivo muMBO haasati anyatsojeka, ndosaka paine akati wandei anopokana dzidziso. Iyo inonyanya kuzivikanwa uye yechokwadi yekirasi dzidziso yekunzwika kwenzvimbo ndeye Jeffress modhi (Lloyd A. Jeffress) Inobva pa mutsara wamaka* detector neurons inonzwa kune binaural synchrony ye neural inputs kubva munzeve imwe neimwe, neuron yega yega ichinyanya kunzwa kune imwe huwandu hweITD (1A).

Mutsara wakanyorwa musimboti* ifungidziro inotsanangura kuti tsinga dzakasiyana sei, dzose dzinoshandisa misimboti yakafanana yefiziyoloji mukufambisa manzwiro pamwe nemaaxon adzo, dzinokwanisa kuburitsa manzwiro akasiyana. Tsinga dzakafanana dzakafanana dzinogona kuburitsa manzwisisiro akasiyana kana dzakabatana neakasarudzika neuroni mukati mepakati tsinga system inokwanisa kudhidha masaini etsinga dzakafanana nenzira dzakasiyana.

Inzwi renzvimbo: maziviro anoita huropi manzwi
Mufananidzo #1

Iyi modhi yakangofanana neneural coding, zvichibva pane zvisina kuganhurirwa muchinjika-kuwirirana kwemanzwi anosvika kunzeve dzose.

Panewo muenzaniso unoratidza kuti ruzha rwenzvimbo inogona kuenzanisirwa zvichienderana nekusiyana kwekukurumidza kwekupindura kwemamwe marudzi eeuroni kubva kune dzakasiyana-siyana dzehemispheres yeuropi, i.e. muenzaniso we interhemispheric asymmetry (1B).

Kusvika ikozvino, zvaive zvakaoma kutaura zvisina kujeka kuti ndeipi yedzidziso mbiri (mienzaniso) ndeyechokwadi, zvichipihwa kuti imwe neimwe yadzo inofanotaura zvinotsamira zvakasiyana zveinzwi renzvimbo pane kurira kwekurira.

Muchidzidzo chatiri kutarisa nhasi, vatsvakurudzi vakasarudza kubatanidza mamodheru maviri kuti vanzwisise kana maonero emanzwi akavakirwa pane neural coding kana mutsauko wemhinduro yemunhu mumwe nemumwe. Kuedza kwakawanda kwakaitwa umo vanhu vane makore 18 kusvika kumakore 27 (vakadzi 5 nevarume 7) vakatora chikamu. Audiometry yeVatori vechikamu (chiyero chekunzwa acuity) yaive 25 dB kana kupfuura pakati pe250 ne8000 Hz. Mutori wechikamu muzviedzo akaiswa muimba yakavharwa inzwi, umo midziyo inokosha yakaiswa, yakarongedzerwa nehupamhi hwepamusoro. Vatori vechikamu vaifanira, pakunzwa chiratidzo chenzwi, kuratidza kwachakabva.

Mhedzisiro yekutsvaga

Kuongorora kutsamira lateralization* basa rehuropi kubva pakusimba kweruzha mukupindura kune yakanyorwa neurons, dhata rekumhanya kwemaneuroni mulaminar nucleus yebran owl brain yakashandiswa.

Laterality* - asymmetry yehafu yekuruboshwe uye yakarurama yemuviri.

Kuongorora kutsamira kweiyo lateralization yehuropi hwekuita pakukurumidza kwekuita kwemamwe marudzi eeuroni, data kubva kune yakaderera colliculus ye rhesus monkey brain yakashandiswa, mushure meizvozvo misiyano yekumhanya kwema neurons kubva kune akasiyana hemispheres yakawedzerwa kuverengerwa. .

Iyo yakamisikidzwa mutsara modhi ye detector neurons inofanotaura kuti sezvo kusimba kwekurira kunoderera, kurongeka kweinofungidzirwa sosi kunoshanduka kureva hunhu hwakafanana nereshiyo yekupfava kusvika kune ruzha.1Π‘).

Iyo hemispheric asymmetry modhi, zvakare, inoratidza kuti sezvo kusimba kwenzwi kunoderera kusvika padyo pechikumbaridzo mazinga, inofungidzirwa kuti laterality ichachinja yakananga pakati.1D).

Pakukwirira kwese kusimba kwekurira, lateralization inotarisirwa kuve nekusimba invariant (inset in 1Π‘ ΠΈ 1D).

Naizvozvo, kuongorora kuti kusimba kweruzha kunokanganisa sei kutungamira kunoonekwa kweruzha kunotibvumira kunyatsoona chimiro chemaitiro ari kuitika panguva iyoyo - neurons kubva munzvimbo imwechete yakakura kana neurons kubva kune akasiyana hemispheres.

Zviripachena, kugona kwemunhu kusarura ITD kunogona kusiyana zvichienderana nekusimba kwekurira. Nekudaro, masayendisiti anoti zvakaoma kududzira zvakambowanikwa zvinobatanidza kunzwisiswa neITD uye kutonga kwevateereri kwegwara rinonzwika senge basa rekusimba kwekurira. Dzimwe ongororo dzinoti kana kusimba kwenzwi kunosvika pamuganhu, zvinofungidzirwa kuti kureba kwekwakabva kunodzikira. Zvimwe zvidzidzo zvinoratidza kuti hapana mhedzisiro yekusimba pakuona zvachose.

Mune mamwe mazwi, masayendisiti ari "zvinyoro" achinongedza kuti pane ruzivo rudiki mumabhuku maererano nehukama pakati peITD, kusimba kwekurira uye kuona kwainotangira. Pane dzidziso dziripo semhando yeaxioms, inogamuchirwa kazhinji nenharaunda yesainzi. Naizvozvo, zvakasarudzwa kuti zviedze zvakadzama dzidziso dzese, mamodheru uye nzira dzinogoneka dzekunzwa kuona mukuita.

Kuedza kwekutanga kwaive kwakavakirwa pane psychophysical paradigm yakabvumira kudzidza kweITD-based lateralization sebasa rekusimba kwekurira muboka revanhu gumi vakajairwa vanonzwa.

Inzwi renzvimbo: maziviro anoita huropi manzwi
Mufananidzo #2

Iwo manzwi masosi akanyatso kurongedzerwa kuvhara yakawanda ye frequency renji mukati umo vanhu vanokwanisa kuziva ITD, i.e. kubva 300 kusvika 1200 Hz (2A).

Pachiyedzo chega chega, mutereri aifanirwa kuratidza kunoonekwa kumberi, kuyerwa senge basa rekunzwa, pamusoro pehuwandu hweITD tsika kubva pa375 kusvika 375 ms. Kuti uone mhedzisiro yekusimba kwenzwi, iyo isina mutsara yakasanganiswa mhedzisiro modhi (NMLE) yakashandiswa iyo yaisanganisira zvese zvakagadziriswa uye zvisina tsarukano ruzha kusimba.

Girafu 2B inoratidza inofungidzirwa lateralization ine spectrally flat ruzha pambiri mbiri intensity kumumiririri anoteerera. Uye purogiramu 2Π‘ inoratidza data raw (madenderedzwa) uye yakamisikidzwa NMLE modhi (mitsetse) yevateereri vese.

Inzwi renzvimbo: maziviro anoita huropi manzwi
Tafura # 1

Tafura iri pamusoro inoratidza ese NLME paramita. Zvinogona kuoneka kuti kurongeka kwakawedzera nekuwedzera ITD, sezvaitarisirwa nemasayendisiti. Sezvo kurira kwekurira kwakaderera, maonero akawedzera uye achiwedzera kuenda kune yepakati (inoiswa mugirafu. 2C).

Aya maitiro akatsigirwa neNLME modhi, iyo yakaratidza mhedzisiro yakakosha yeITD uye kusimba kwenzwi pahupamhi hwepamusoro hwemashure, ichitsigira muenzaniso wekusiyana kwemukati mehemispheric.

Pamusoro pezvo, zvinoreva audiometric zvikumbaridzo zvematoni akachena aive nemhedzisiro shoma pane zvinoonekwa gare gare. Asi kusimba kwenzwi hakuna kukanganisa zvakanyanya zviratidzo zve psychometric mabasa.

Chinangwa chikuru chekuedza kwechipiri chaiva chekuona kuti migumisiro yakawanikwa mukuedza kwekare yaizochinja sei kana ichifunga nezvezvinhu zvinotaridzika zvezvinosimudzira (zvinonzwika). Iko kudikanwa kwekuyedza kutaridzika kwakatsetseka ruzha pakudzika kweinzwi kwakadzika ndeyekuti zvikamu zveiyo spectrum zvinogona kusanzwika uye izvi zvinogona kukanganisa kutsunga kwegwara rekurira. Nekuda kweizvozvo, mhedzisiro yekuyedza kwekutanga inogona kukanganisa zvisirizvo nekuda kwekuti hupamhi hwechikamu chinonzwika cheiyo spectrum hunogona kudzikira nekudzikira kwekusimba kwekurira.

Naizvozvo, zvakasarudzwa kuita imwe kuyedza, asi uchishandisa reverse A-kurema* noise

A-kuyera* rinoshandiswa kumazinga eruzha kuti titarise kukwirira kuri kunzwisiswa nenzeve yemunhu, sezvo nzeve isinganzwe zvakanyanya kune yakaderera ruzha. A-kurema kunoitwa nearithmetically kuwedzera tafura yemakoshero akanyorwa mumabhendi eoctave kune akayerwa enzwi rekumanikidza mazinga mudB.

Pachati 2D inoratidza data raw (madenderedzwa) uye NMLE modhi-yakakodzera data (mitsara) yevose vatori vechikamu muchiyedzo.

Ongororo yedata yakaratidza kuti kana zvikamu zvese zveruzha zvinenge zvakaenzana kunzwika (zvese mukutanga uye muyedzo yechipiri), inonzwisiswa kurerekera uye kutsetseka kuri mugirafu kunotsanangura shanduko yelateral neITD kuderera nekuderera kwekusimba kwenzwi.

Nokudaro, migumisiro yekuedza kwechipiri yakasimbisa migumisiro yekutanga. Ndiko kuti, mukuita zvakaratidzwa kuti modhi yakatsanangurwa kumashure muna 1948 naJeffress haina kururama.

Zvinoitika kuti kunzwisiswa kwenzvimbo kunowedzera sezvo kusimba kunoderera, uye Jeffress aitenda kuti manzwi anonzwisiswa uye anogadziriswa nevanhu nenzira imwechete, zvisinei nekusimba kwavo.

Kuti uwane rumwe ruzivo rwakadzama rwema nuances echidzidzo, ini ndinokurudzira kutarisa mushumo wemasayendisiti.

Epilogue

Mafungiro efungidziro uye zviedzo zvinoshanda zvinovatsigira zvakaratidza kuti tsinga dzehuropi mumhuka dzinoyamwisa dzinoitwa pamitengo yakasiyana zvichienderana nekwainongedza chiratidzo chezwi. Uropi hunobva hwaenzanisa kumhanya uku pakati pema neuron ese anobatanidzwa mukuita kuti ivake mepu yenzvimbo inonzwika.

Muenzaniso waJeffresson hausi 100% wakashata, sezvo uchigona kushandiswa kutsanangura zvakakwana kugariswa kweizwi sosi mumazizi. Hongu, kune mazizi kusimba kwekurira hakuna basa, chero zvazvingava, ivo vachaziva kwainobva. Nekudaro, iyi modhi haishande ne rhesus tsoko, sezvakamboita ongororo dzakapfuura. Naizvozvo, iyi modhi yeJeffresson haigone kutsanangura kuiswa kwemanzwi kune zvese zvipenyu.

Kuedza nevatori vechikamu kwevanhu kwakasimbisa zvakare kuti ruzha rwenzvimbo inoitika zvakasiyana muzvisikwa zvakasiyana. Vazhinji vevatori vechikamu havana kukwanisa kunyatsoona nzvimbo yekwakabva zviratidzo zvezwi nekuda kwekuderera kwemazwi.

Vesainzi vanodavira kuti basa ravo rinoratidza zvimwe zvakafanana pakati pemaonero atinoita nemanzwire atinoita. Maitiro ese ari maviri ane chekuita nekumhanya kwemaneuron munzvimbo dzakasiyana dzehuropi, pamwe nekuongororwa kwemutsauko uyu kuona zvese zviri zviviri nzvimbo yezvinhu zvatinoona muchadenga uye panobva ruzha rwatinonzwa.

Mune ramangwana, vaongorori vachaita ongororo dzakatevedzana kuti vaongorore zvakadzama kubatana pakati pekunzwa kwevanhu uye kuona, izvo zvinotitendera kuti tinzwisise zviri nani kuti uropi hwedu hunovaka sei mepu yenyika yakatitenderedza.

Ndatenda nekuverenga, garai muchida kuziva uye muve nevhiki yakanaka vakomana! πŸ™‚

Ndinokutendai nekugara nesu. Unoda zvinyorwa zvedu here? Unoda kuona zvimwe zvinonakidza zvemukati? Titsigire nekuisa odha kana kukurudzira kushamwari, Cloud VPS yevagadziri kubva kumadhora 4.99, 30% kuderedzwa kwevashandisi veHabr pane yakasarudzika analogue yekupinda-level maseva, iyo yakagadzirwa nesu kuti iwe: Chokwadi chese nezveVPS (KVM) E5-2650 v4 (6 Cores) 10GB DDR4 240GB SSD 1Gbps kubva pamadhora makumi maviri kana kugovera sevha? (inowanikwa neRAID1 uye RAID10, kusvika ku24 cores uye kusvika ku40GB DDR4).

Dell R730xd kaviri zvakachipa? Chete pano 2 x Intel TetraDeca-Core Xeon 2x E5-2697v3 2.6GHz 14C 64GB DDR4 4x960GB SSD 1Gbps 100 TV kubva $199 muNetherlands! Dell R420 - 2x E5-2430 2.2Ghz 6C 128GB DDR3 2x960GB SSD 1Gbps 100TB - kubva pamadhora makumi mapfumbamwe nemapfumbamwe! Verenga nezve Nzira yekuvaka Infrastructure Corp. kirasi nekushandiswa kweDell R730xd E5-2650 v4 maseva anokosha 9000 euros penny?

Source: www.habr.com

Voeg