Qhov xwm txheej: GPUs virtual tsis ua haujlwm qis dua rau kev daws teeb meem kho vajtse

Thaum Lub Ob Hlis, Stanford tau tuav lub rooj sib tham ntawm kev ua haujlwm siab (HPC). VMware cov neeg sawv cev tau hais tias thaum ua haujlwm nrog GPU, lub kaw lus raws li kev hloov kho ESXi hypervisor tsis yog qhov qis dua hauv kev nrawm rau kev daws teeb meem hlau.

Peb tham txog cov thev naus laus zis uas ua rau nws ua tau kom ua tiav qhov no.

Qhov xwm txheej: GPUs virtual tsis ua haujlwm qis dua rau kev daws teeb meem kho vajtse
/ duab Victorgrigas CC BY-SA

Qhov teeb meem kev ua haujlwm

Raws li cov kws tshuaj ntsuam, kwv yees li 70% ntawm cov haujlwm ua haujlwm hauv cov chaw khaws ntaub ntawv virtualized. Txawm li cas los xij, qhov seem 30% tseem khiav ntawm cov hlau liab tsis muaj hypervisors. Qhov no 30% feem ntau muaj cov ntawv thov siab, xws li cov uas cuam tshuam nrog kev cob qhia neural networks, thiab siv GPUs.

Cov kws tshaj lij piav qhia qhov sib txawv no los ntawm qhov tseeb tias tus hypervisor, raws li cov txheej txheem nruab nrab ntawm qhov kev xav, tuaj yeem cuam tshuam rau kev ua haujlwm ntawm tag nrho cov kab ke. Hauv kev tshawb fawb tsib xyoos dhau los koj tuaj yeem nrhiav tau cov ntaub ntawv hais txog kev txo qhov ceev ntawm kev ua haujlwm los ntawm 10%. Yog li ntawd, cov tuam txhab thiab cov chaw zov me nyuam cov ntaub ntawv tsis tau maj mam hloov HPC workloads mus rau ib puag ncig virtual.

Tab sis virtualization technologies tab tom txhim kho thiab txhim kho. Ntawm lub rooj sib tham ib hlis dhau los, VMware tau hais tias ESXi hypervisor tsis muaj kev cuam tshuam tsis zoo rau GPU kev ua haujlwm. Kev sib piv ceev tuaj yeem raug txo los ntawm peb feem pua, uas yog piv rau cov hlau liab qab.

Yuav ua li cas li no ua hauj lwm

Txhawm rau txhim kho kev ua haujlwm ntawm HPC systems nrog GPUs, VMware tau hloov pauv ntau yam rau tus neeg saib xyuas. Tshwj xeeb, nws tau tshem ntawm vMotion muaj nuj nqi. Nws yog qhov xav tau rau kev sib npaug thiab feem ntau hloov cov tshuab virtual (VMs) ntawm cov servers lossis GPUs. Disabling vMotion ua rau txhua VM tam sim no tau muab ib qho GPU tshwj xeeb. Qhov no pab txo cov nqi thaum sib pauv cov ntaub ntawv.

Lwm qhov tseem ceeb ntawm qhov system yog technology DirectPath I/O. Nws tso cai rau CUDA cov neeg tsav tsheb sib txuas ua ke sib cuam tshuam nrog cov tshuab virtual ncaj qha, hla lub hypervisor. Thaum koj xav tau khiav ntau VMs ntawm ib GPU ib zaug, GRID vGPU kev daws teeb meem yog siv. Nws faib daim npav nco mus rau ntau ntu (tab sis lub voj voog kev suav tsis tau muab faib).

Daim duab ua haujlwm ntawm ob lub tshuab virtual hauv qhov no yuav zoo li no:

Qhov xwm txheej: GPUs virtual tsis ua haujlwm qis dua rau kev daws teeb meem kho vajtse

Cov txiaj ntsig thiab kev kwv yees

Ruaj ua kev ntsuam xyuas hypervisor los ntawm kev cob qhia tus qauv lus raws li TensorFlow. Qhov kev ua tau zoo "kev puas tsuaj" tsuas yog 3-4% piv rau cov hlau liab qab. Hauv kev xa rov qab, lub kaw lus tau tuaj yeem faib cov peev txheej raws li qhov xav tau nyob ntawm qhov kev thauj khoom tam sim no.

IT loj heev thiab ua kev ntsuam xyuas nrog ntim. Lub tuam txhab engineers tau cob qhia neural networks kom paub txog cov duab. Tib lub sijhawm, cov peev txheej ntawm ib GPU tau muab faib rau ntawm plaub lub thawv VMs. Raws li qhov tshwm sim, kev ua haujlwm ntawm ib tus neeg lub tshuab tau txo qis los ntawm 17% (piv rau ib qho VM nrog kev nkag mus rau GPU cov peev txheej). Txawm li cas los xij, tus naj npawb ntawm cov duab ua tiav ib ob nce peb zaug. Nws cia siab tias cov tshuab zoo li no yuav nrhiav kev siv hauv kev txheeb xyuas cov ntaub ntawv thiab kev ua qauv hauv computer.

Ntawm cov teeb meem muaj peev xwm uas VMware yuav ntsib, cov kws tshaj lij faib es nqaim phiaj neeg. Cov tuam txhab me me tseem ua haujlwm nrog cov tshuab ua haujlwm siab. Txawm tias nyob rau hauv Statista noj peb caugtias los ntawm 2021, 94% ntawm lub ntiaj teb cov ntaub ntawv chaw ua haujlwm yuav raug virtualized. Los ntawm kev kwv yees Cov kws tshuaj ntsuam xyuas, tus nqi ntawm HPC kev ua lag luam yuav loj hlob los ntawm 32 txog 45 billion nyiaj hauv lub sijhawm txij xyoo 2017 txog 2022.

Qhov xwm txheej: GPUs virtual tsis ua haujlwm qis dua rau kev daws teeb meem kho vajtse
/ duab Ntiaj teb no Access Point PD

Cov kev daws teeb meem zoo sib xws

Muaj ntau cov analogues ntawm lub khw uas tsim los ntawm cov tuam txhab IT loj: AMD thiab Intel.

Thawj lub tuam txhab rau GPU virtualization muaj mus kom ze raws li SR-IOV (ib-hauv paus tswv yim / tso tawm virtualization). Cov thev naus laus zis no muab VM nkag mus rau ib feem ntawm lub cev muaj peev xwm kho vajtse. Qhov kev daws teeb meem tso cai rau koj los qhia GPU ntawm 16 cov neeg siv nrog kev sib npaug ntawm cov tshuab virtualized.

Raws li qhov thib ob IT loj heev, lawv technology raws li ntawm Citrix XenServer 7 hypervisor.Nws ua ke ua haujlwm ntawm tus qauv GPU tsav tsheb thiab lub tshuab virtual, uas tso cai rau tom kawg los tso saib 3D daim ntawv thov thiab desktops ntawm cov khoom siv ntawm ntau pua tus neeg siv.

Yav tom ntej ntawm technology

Virtual GPU Developers ua ib tug thawj koom ruam ntawm kev siv AI systems thiab kev loj hlob ntawm kev ua tau zoo ntawm kev daws teeb meem hauv kev lag luam thev naus laus zis kev lag luam. Lawv cia siab tias qhov yuav tsum tau ua cov ntaub ntawv loj yuav ua rau qhov kev thov rau vGPUs.

Tam sim no manufacturers nrhiav ib txoj kev muab cov kev ua haujlwm ntawm CPU thiab GPU hauv ib qho tseem ceeb txhawm rau txhawm rau txhawm rau daws cov teeb meem ntsig txog cov duab, ua lej suav, kev ua haujlwm zoo, thiab ua cov ntaub ntawv. Cov tsos ntawm cov cores no nyob rau hauv kev ua lag luam yav tom ntej yuav hloov txoj hauv kev rau cov peev txheej virtualization thiab lawv cov kev faib tawm ntawm kev ua haujlwm hauv virtual thiab huab ib puag ncig.

Yuav nyeem dab tsi ntawm lub ncauj lus hauv peb lub tuam txhab blog:

Ob peb nqe lus los ntawm peb Telegram channel:

Tau qhov twg los: www.hab.com

Ntxiv ib saib