Ka la 24 Pherekhong, baenjiniere ba Intel ba ile ba lokolla ntjhafatso e kholo ho sesebelisoa sa bohlale sa maiketsetso sa OpenVINO 2023.3. E fana ka tšehetso e felletseng bakeng sa li-processor tse ncha tsa Emerald Rapids le Meteor Lake, hammoho le lintlafatso tse ling tsa Intel bakeng sa bohlale ba maiketsetso ba tlhaho (GenAI) le mefuta e meholo ea lipuo (LLM).
OpenVINO 2023.3 e hlahisa polokelo ea OpenVINO Gen AI ho bonts'a lisampole tsa matsoalloa a C/C++ lipeipi tse kholo tsa puo le ho leka mefuta e meng e kenyelletsang Mistral, Zephyr, ChatGLM3 le tse ling. Torch.compile e se e kopantsoe ka botlalo le OpenVINO.
Ho matlafatsa ts'ehetso ea mofuta o moholo oa puo, sebopeho sa INT4 sa compression se tšehetsoa ho li-processor tsa Intel Xeon, hammoho le li-processor tsa Intel Core le Intel iGPU. Ts'ebetso e ntlafalitsoeng ea LLM ho li-CPU le li-GPU ka bobeli, lintlafatso tse nolofalitsoeng bakeng sa mefuta ea Hugging Face, le tse ling.
Bakeng sa litšupiso, OpenVINO ke lisebelisoa tse bulehileng, tse sa lefelloeng tse thusang batho ba ntlafatsang le bahlahlobisisi ba data ho potlakisa nts'etsopele ea litharollo tse sebetsang hantle tse sebelisoang mefuteng e fapaneng ea lits'ebetso tsa video. Setha sena se felletseng sa lisebelisoa se ts'ehetsa litharollo tse ngata tsa pono ea khomphutha, se tsamaisa lisebelisoa tse tebileng tsa ho ithuta, 'me se nolofalletsa ts'ebetso e bonolo ho li-platform tse ngata tsa Intel. OpenVINO e boetse e rarolla mathata a mangata a fapaneng, ho kenyelletsa ho lemoha sefahleho, ho lemoha lintho ka mokhoa o itekanetseng, mongolo le puo, ts'ebetso ea litšoantšo le tse ling tse ngata.
Source: linux.org.ru