OpenAI imaphunzitsa gulu la AI pamasewera obisala ndi kufufuza

Masewera abwino akale akale obisala amatha kukhala mayeso abwino anzeru zamaluso (AI) bots kuti awonetse momwe amapangira zisankho ndikuyanjana wina ndi mnzake komanso zinthu zosiyanasiyana zowazungulira.

Mu zake nkhani yatsopano, lofalitsidwa ndi ofufuza ochokera ku OpenAI, bungwe lopanda phindu la intelligence intelligence yomwe yakhala yotchuka kupambana kwa akatswiri padziko lonse lapansi mu masewera apakompyuta a Dota 2, asayansi amafotokoza momwe othandizira olamulidwa ndi luntha lochita kupanga adaphunzitsidwa kuti akhale otsogola pakufufuza ndi kubisala wina ndi mnzake m'malo enieni. Zotsatira za kafukufukuyu zidawonetsa kuti gulu la ma bots awiri limaphunzira bwino komanso mwachangu kuposa wothandizira m'modzi wopanda ogwirizana.

OpenAI imaphunzitsa gulu la AI pamasewera obisala ndi kufufuza

Asayansi agwiritsa ntchito njira yomwe yatchuka kwa nthawi yaitali kuphunzira makina ndi kulimbikitsa, momwe luntha lochita kupanga limayikidwa mu malo osadziwika kwa iwo, pokhala ndi njira zina zoyankhulirana nawo, komanso dongosolo la mphotho ndi chindapusa chifukwa cha chimodzi kapena zotsatira za zochita zake. Njirayi ndiyothandiza kwambiri chifukwa cha kuthekera kwa AI kuchita zinthu zosiyanasiyana pamalo omwe ali pa liwiro lalikulu, mamiliyoni ambiri mwachangu kuposa momwe munthu angaganizire. Izi zimathandiza kuyesa ndi zolakwika kupeza njira zothandiza kwambiri zothetsera vuto lomwe laperekedwa. Koma njira iyi imakhalanso ndi zofooka zina, mwachitsanzo, kupanga malo ndi kuyendetsa maulendo ambiri ophunzitsira kumafuna zipangizo zamakono zamakompyuta, ndipo ndondomekoyi imafuna dongosolo lolondola lofananitsa zotsatira za zochita za AI ndi cholinga chake. Kuphatikiza apo, luso lopezedwa ndi wothandizira mwanjira iyi limangokhala pantchito yomwe yafotokozedwa ndipo, AI ikaphunzira kuthana nayo, sipadzakhalanso zosintha zina.

Kuti aphunzitse AI kusewera mobisa ndi kufufuza, asayansi adagwiritsa ntchito njira yotchedwa "Undirected exploration," komwe othandizira amakhala ndi ufulu wonse wokulitsa kumvetsetsa kwawo kwamasewera ndikupanga njira zopambana. Izi ndizofanana ndi njira yophunzirira yogwiritsa ntchito ma agent ambiri yomwe ofufuza a DeepMind adagwiritsa ntchito popanga machitidwe angapo anzeru. adaphunzitsidwa kusewera kujambula mbendera mu Quake III Arena. Monga momwe zilili, othandizira a AI sanaphunzitsidwe kale malamulo a masewerawo, koma patapita nthawi adaphunzira njira zoyambira ndipo amatha kudabwitsa ofufuza ndi mayankho osakhala ang'onoang'ono.

M'masewera obisalamo, nthumwi zingapo zomwe ntchito yawo inali kubisala anafunika kupeΕ΅a mzere wa adani awo atangoyamba kumene pang'ono pamene gulu la anthu omwe ankafufuza likugwira ntchito. Kuphatikiza apo, "mzere wamawonekedwe" m'nkhaniyi ndi 135 degree cone kutsogolo kwa bot payekha. Othandizira sakanakhoza kupita patali kwambiri kunja kwa malo osewerera ndipo amakakamizika kuyenda m'zipinda zopangidwa mwachisawawa ndi kuthekera kogwiritsa ntchito zinthu zakunja (mabokosi, makoma osunthika, zingwe zapadera) zomwazikana mozungulira zomwe zingagwiritsidwe ntchito popanga chivundikiro ndikulowetsamo. .

OpenAI imaphunzitsa gulu la AI pamasewera obisala ndi kufufuza

Kupyolera mukuphunzira kwanthawi yayitali, othandizira a AI adaphunzira njira zisanu ndi imodzi zapadera, zomwe zidawathandiza kupita ku gawo lotsatira lamasewera. Poyamba, magulu ofunafuna ndi obisala amangothawa ndi kuthamangitsana, koma pambuyo pa maseΕ΅era pafupifupi 25 miliyoni, gulu lobisala linaphunzira kutsekereza tinjira ndi mabokosi ndi kumangamo malo obisalamo. Pambuyo pa machesi ena 75 miliyoni, gululi linapeza njira zogwiritsira ntchito ma ramps kuti lilowe m'malo obisalamo. Pambuyo pa maulendo ena okwana 10 miliyoni, obisala anaphunzira kukokera zingwe m'mphepete mwa malo osewerera ndikuzitsekera kuti adani asagwiritse ntchito.

OpenAI imaphunzitsa gulu la AI pamasewera obisala ndi kufufuza

Pambuyo pa machesi 388 miliyoni, ofuna kufufuza aphunzira kugwiritsa ntchito zitunda zotchingidwa kukwera pamabokosi omwe amabweretsedwa, ndiyeno, kusuntha molunjika, kulowa m'malo obisala a adani opangidwa kuchokera kumakoma onyamula. Ndipo pamapeto pake, pambuyo pa maseΕ΅era okwana 458 miliyoni, gulu lobisalalo linaganiza kuti liyenera kutsekereza zinthu zonse ndi kumanga pobisalira, zomwe mwachiwonekere zinawatsogolera ku chipambano chawo chomaliza.

Chochititsa chidwi kwambiri ndi chakuti pambuyo pa machesi 22 miliyoni, othandizira adaphunzira kugwirizanitsa zochita zawo ndipo mphamvu ya mgwirizano wawo inangowonjezereka m'tsogolomu, mwachitsanzo, aliyense anabweretsa bokosi kapena khoma lake kuti apange pogona ndikusankha gawo lake la zinthu. block, kusokoneza masewera ovuta kwa otsutsa.

OpenAI imaphunzitsa gulu la AI pamasewera obisala ndi kufufuza

Asayansi adawonanso mfundo yofunikira yokhudzana ndi chikoka cha kuchuluka kwa zinthu zophunzitsira (kuchuluka kwa data kudzera mu neural network - "Batch Size") pa liwiro la kuphunzira. Mtundu wosasinthika umafunikira machesi 132,3 miliyoni pamaphunziro a maola a 34 kuti afikire pomwe gulu lobisala lidaphunzira kutsekereza mayendedwe, pomwe zambiri zidapangitsa kuti nthawi yophunzitsira ichepe. Mwachitsanzo, kuonjezera chiwerengero cha magawo (gawo la deta yomwe inapezedwa panthawi yonse ya maphunziro) kuchokera ku 0,5 miliyoni kufika pa 5,8 miliyoni kunakulitsa luso lachitsanzo ndi nthawi 2,2, ndikuwonjezera kukula kwa deta kuchokera ku 64 KB kufika ku 128 KB kuchepetsa maphunziro. nthawi pafupifupi nthawi imodzi ndi theka.

OpenAI imaphunzitsa gulu la AI pamasewera obisala ndi kufufuza

Kumapeto kwa ntchito yawo, ofufuzawo adaganiza zoyesa kuchuluka kwa maphunziro amasewera omwe angathandize othandizira kuthana ndi ntchito zofananira kunja kwa masewerawo. Panali mayesero asanu onse: kuzindikira kuchuluka kwa zinthu (kumvetsetsa kuti chinthu chikupitirizabe kukhalapo ngakhale sichikuwoneka ndipo sichikugwiritsidwa ntchito); "Loko ndi kubwerera" - luso kukumbukira malo oyambirira ndi kubwerera kwa iwo akamaliza ntchito zina; "kutsekereza motsatizana" - mabokosi 4 adayikidwa mwachisawawa m'zipinda zitatu zopanda zitseko, koma zokhala ndi zingwe zolowera mkati, othandizira amafunikira kuwapeza ndikutchinga onse; kuyika mabokosi pamasamba omwe adakonzedweratu; kupanga pobisalira mozungulira chinthu ngati silinda.

Chotsatira chake, mu ntchito zitatu mwa zisanu, ma bots omwe adaphunzitsidwa koyambirira mu masewerawa adaphunzira mofulumira ndikuwonetsa zotsatira zabwino kuposa AI yomwe inaphunzitsidwa kuthetsa mavuto kuyambira pachiyambi. Iwo anachita bwino pang'ono pomaliza ntchito ndi kubwerera ku malo poyambira, sequentially kutsekereza mabokosi m'zipinda zotsekedwa, ndi kuika mabokosi m'madera anapatsidwa, koma anachita pang'ono ofooka pozindikira chiwerengero cha zinthu ndi kupanga chivundikiro kuzungulira chinthu china.

Ofufuza amati zotsatira zosakanikirana ndi momwe AI imaphunzirira ndikukumbukira maluso ena. "Tikuganiza kuti ntchito zomwe maphunziro asanachitike pamasewera adachita bwino kwambiri ndikugwiritsanso ntchito maluso omwe tinaphunzira kale m'njira yodziwika bwino, pomwe amagwira ntchito zotsalazo bwino kuposa zomwe AI adaphunzitsidwa kuyambira pachiyambi zimafuna kuzigwiritsa ntchito mwanjira ina. chovuta kwambiri,” analemba motero olemba nawo ntchitoyo. "Zotsatirazi zikuwonetsa kufunikira kopanga njira zogwiritsira ntchito bwino luso lomwe mwaphunzira powasamutsa kuchokera kumalo ena kupita ku ena."

Ntchito imene yachitika n’njochititsa chidwi kwambiri chifukwa chakuti anthu sangakwanitse kugwiritsa ntchito njira yophunzitsira imeneyi. Ofufuzawa akuti ntchito yawo ndi sitepe yofunika kwambiri popanga AI yokhala ndi "physics-based" ndi "makhalidwe ngati aumunthu" omwe amatha kuzindikira matenda, kulosera zamtundu wa mamolekyu ovuta a mapuloteni ndikusanthula ma CT scans.

Mu kanema pansipa mutha kuwona bwino momwe njira yonse yophunzirira idachitikira, momwe AI idaphunzirira kugwirira ntchito limodzi, ndipo njira zake zidakhala zachinyengo komanso zovuta.



Source: 3dnews.ru

Kuwonjezera ndemanga