Boka revatsvagiri kubva kuStanford University, University of California kuBerkeley, ETH Zurich, Graduate Chikoro cheEconomics, Carnegie Mellon University, pamwe neYandex neMeta, vakaburitsa kodhi yeinjini yekushandisa mamodheru makuru emitauro pane zviwanikwa. -kumanikidza masisitimu. Semuenzaniso, injini inopa kukwanisa kugadzira kushanda kunoyeuchidza ChatGPT uye Copilot kuburikidza nekushandisa pre-yakadzidziswa OPT-175B modhi, inovhara 175 bhiriyoni parameters, pane yenguva dzose komputa ine NVIDIA RTX3090 yekutamba yemifananidzo kadhi ine 24GB yemavhidhiyo memory. Iyo kodhi yakanyorwa muPython, inoshandisa iyo PyTorch chimiro uye inogoverwa pasi peiyo Apache 2.0 rezinesi.
Inosanganisira muenzaniso script yekugadzira bots iyo inokutendera iwe kudhawunirodha imwe yemhando yemitauro inowanikwa pachena uye nekukurumidza wotanga kutaurirana (semuenzaniso, nekumhanyisa murairo "python apps/chatbot.py -model facebook/opt-30b - -percent 0 100 100 0 100 0β). Sehwaro, zvinokurudzirwa kushandisa mhando yemutauro yakakura yakaburitswa neFacebook, yakadzidziswa kuunganidzwa kweBookCorpus (10 zviuru zvemabhuku), CC-Nhau, Murwi (OpenSubtitles, Wikipedia, DM Mathematics, HackerNews, nezvimwewo), Pushshift. io (yakavakirwa paReddit data) uye CCNewsV2 (news archive). Iyo modhi inovhara angangoita 180 bhiriyoni tokens (800 GB yedata). Mazuva makumi matatu nematatu ekushanda kweboka ne33 NVIDIA A992 100GB GPUs akashandiswa pakudzidzisa modhi.
Paunenge uchimhanyisa OPT-175B modhi pane system ine imwechete NVIDIA T4 GPU (16GB), injini yeFlexGen yakaratidza kuita kwakapetwa ka100 nekukurumidza kupfuura mhinduro dzakambopihwa, zvichiita kuti kushandiswa kwemhando dzemitauro mikuru kudhure uye kuchivabvumira kuti vamhanye. masisitimu asina accelerator akazvipira. Panguva imwecheteyo, FlexGen inogona kuyera kufananidza kuverenga nemaGPU akawanda. Kuti uderedze saizi yemodhi, a proprietary parameter compression scheme uye modhi caching mechanism inowedzerwa zvakare.
Parizvino, FlexGen inongotsigira maOPT emitauro chete, asi mune ramangwana vagadziri vanovimbisawo kuwedzera rutsigiro rweBLOOM (176 bhiriyoni paramita, inotsigira mitauro makumi mana nematanhatu nemitauro gumi nematanhatu), CodeGen (inogona kugadzira kodhi mumitauro makumi maviri nemaviri ehurongwa) uye Mhando dzeGLM. Muenzaniso wenhaurirano ine bot yakavakirwa paFlexGen uye iyo OPT-46B modhi:
Munhu: Nderipi zita regomo refu kupfuura mamwe pasi rose?
Mubatsiri: Everest.
Munhu: Ndiri kuronga rwendo rwemhemberero yedu. Zvinhu zvipi zvatingaita?
Mubatsiri: Zvakanaka, pane zvinhu zvakati wandei zvaunogona kuita kune yako yegore. Kutanga, unogona kutamba makadhi. Chechipiri, unogona kuenda kunofamba. Chechitatu, unogona kuenda kumuseum.
Source: opennet.ru