Vagadziri veMozilla vakaburitsa kuburitswa kwekutanga kwellamafile, chishandiso chekugadzira zvinogoneka zvepasirese zvekumhanyisa mahombe emitauro yekudzidza mitauro (LLM). Uchishandisa llamafile, unogona kutora GGUF faira rine muchina kudzidza modhi paramita worishandura kuita rinoita rinogona kumhanya pamatanho matanhatu anoshanda masisitimu pane Hardware ine AMD64 uye ARM64 processors. Iyo toolkit yakanyorwa muC/C++ uye yakagoverwa pasi peApache 2.0 rezinesi.
Kuti mamodheru aitwe, framework yellama.cpp inoshandiswa, iyo inoshandisa LLaMA model muC/C++. Framework iyi inounganidzwa kuita faira rinogoneka repasi rose mufomati yeAPE (Actually Portable Executable), iyo inosanganiswa nefaira remuenzaniso. Kodhi yakaunganidzwa yakabatana neraibhurari yeCosmopolitan C yakajairwa, iyo inobvumira kugadzirwa kwemaassemblies ekushandisa anoshanda mu Linux, FreeBSD, macOS, OpenBSD, NetBSD uye WindowsKodhi iyi inochengetwa mushanduro dzemagadzirirwo eAMD64 neARM64, uye inosanganisirawo zvikamu zvekuburitsa macomputer kuNVIDIA GPUs (CUDA inoshandiswa).
Source: opennet.ru
