Ka la 6 Pherekhong, ho ile ha lokolloa 1.7.4 ea sistimi e sebetsang hantle haholo ea temohisiso ea puo. hoeshetsa.cpp, ho phethahatsa mohlala Khutsa ka OpenAI, e ngotsoeng ka C le C ++ le ho ajoa tlas'a laesense ea MIT.
Morero o sebelisa laeborari ea ho ithuta ea mochini oa tensor ea sengoli GGML, e ngotsoeng ka C mme e ntlafalitsoe bakeng sa ho sebelisa li-backend tse fapaneng (CUDA, Vulkan, BLAS, SYCL, OpenCL, joalo-joalo).
Lethathamo la liphetoho:
- Ho fetola lifaele tse ka sebetsoang bocha:
ka sehloohong -> benche ea ho hoeshetsa -> molapo oa ho hoeshetsa -> taelo ea ho hoeshetsa -> seva-taelo ea ho hoeshetsa -> seba-seba se bua-llama -> whisper-talk-llama
- E tlositsoe mehlala ea bua le ho bua.wasm.
- Khetho ea ho hatella li-tokens tse sa bueng e kentsoe ho seva sa whisper.
- Paramethara ea suppress_non_speech_tokens e rehelletsoe bocha ho suppress_nst.
- Khetho ea no_speech_thold e kentsoe ho API le lisebelisoa ho beha monyetla oa ho ba sieo ha puo maemong a karolo nakong ea ho ngoloa.
- Khetho e ekelitsoeng -suppress_nst ho whisper-cli.
- Lintlafatso tse ling le tokiso ea liphoso.
Source: linux.org.ru
