Savant 0.2.7 Python framework yatulutsidwa, zomwe zimapangitsa kuti zikhale zosavuta kugwiritsa ntchito NVIDIA DeepStream kuthetsa mavuto okhudzana ndi kuphunzira makina. Ndondomekoyi imasamalira kukweza kolemetsa ndi GStreamer kapena FFmpeg, kukulolani kuti muyang'ane pakupanga mapaipi opangidwa bwino pogwiritsa ntchito mawu ofotokozera (YAML) ndi ntchito za Python. Savant imakulolani kuti mupange mapaipi omwe amagwira ntchito mofanana pa ma accelerator mu data center (NVIDIA Turing, Ampere, Hopper) ndi zipangizo zam'mphepete (NVIDIA Jetson NX, AGX Xavier, Orin NX, AGX Orin, New Nano). Ndi Savant, mutha kukonza mavidiyo angapo nthawi imodzi ndikupanga mapaipi owunikira okonzeka kupanga makanema pogwiritsa ntchito NVIDIA TensorRT. Khodi ya polojekitiyi imagawidwa pansi pa layisensi ya Apache 2.0.
Savant 0.2.7 ndikusintha kwaposachedwa kwambiri munthambi ya 0.2.X. Kutulutsa kwamtsogolo munthambi ya 0.2.X kudzaphatikizanso kukonza zolakwika. Kupanga zatsopano kudzachitika munthambi ya 0.3.X, kutengera DeepStream 6.4. Nthambi iyi sichirikiza banja la Jetson Xavier la zida popeza NVIDIA sichimawathandiza mu DS 6.4.
Zatsopano zazikulu:
- Zatsopano zogwiritsidwa ntchito:
- Chitsanzo chogwira ntchito ndi chitsanzo chodziwikiratu chochokera ku RT-DETR transformer;
- CUDA positi-processing ndi CuPy kwa YOLOV8-Seg;
- Chitsanzo cha kuphatikiza kwa PyTorch CUDA mu payipi ya Savant;
- Chiwonetsero chogwira ntchito ndi zinthu zolunjika.
- Zatsopano:
- Kuphatikiza ndi Prometheus. Mapaipi amatha kutumiza ma metrics ku Prometheus ndi Grafana kuti awonere magwiridwe antchito ndikutsata. Madivelopa amatha kulengeza ma metrics omwe amatumizidwa kunja limodzi ndi ma metric adongosolo.
- Adapter ya Buffer - Imakhazikitsa buffer yopitilira pa disk pakuyenda kwa data pakati pa ma adapter ndi ma module. Ndi chithandizo chake, mutha kupanga mapaipi odzaza kwambiri omwe amawononga zinthu mosayembekezereka komanso kupirira kuphulika kwa magalimoto. Adapter imatumiza zinthu zake ndi kukula kwake ku Prometheus.
- Model compilation mode. Ma module tsopano atha kupanga mitundu yawo mu TensorRT osayendetsa mapaipi.
- PyFunc shutdown chochitika chowongolera. API yatsopanoyi imalola kuyimitsidwa kwa mapaipi kuti kusamalidwe mwaulemu, kumasula zida ndikudziwitsa machitidwe a chipani chachitatu kuti kutsekedwa kwachitika.
- Kusefa kwa chimango polowetsa ndi kutulutsa. Mwachikhazikitso, mapaipi amavomereza mafelemu onse okhala ndi data yamavidiyo. Ndi zolowetsa ndi zosefera zotulutsa, opanga amatha kusefa data kuti aletse kukonza.
- Kukonzekera pambuyo pa chitsanzo pa GPU. Ndi mawonekedwe atsopanowa, opanga amatha kupeza zotulutsa zachitsanzo mwachindunji kuchokera ku kukumbukira kwa GPU popanda kuziyika mu kukumbukira kwa CPU ndikuzikonza pogwiritsa ntchito CuPy, TorchVision kapena OpenCV CUDA.
- Ntchito zoyimira zokumbukira za GPU. Pakutulutsa uku, tidapereka ntchito zosinthira zosungira kukumbukira pakati pa OpenCV GpuMat, PyTorch GPU tensor, ndi CuPy tensor.
- API yofikira ziwerengero zakugwiritsa ntchito mizere yamapaipi. Savant imakupatsani mwayi wowonjezera mizere pakati pa PyFuncs kuti mugwiritse ntchito kukonzanso kofananira ndi kukonza mabafa. API yowonjezeredwa imapatsa otukula mwayi wofikira pamzere womwe wayikidwa pamapaipi ndikuwalola kufunsa momwe angagwiritsire ntchito.
Pakutulutsidwa kotsatira (0.3.7) kukukonzekera kusamukira ku DeepStream 6.4 popanda kukulitsa magwiridwe antchito. Lingaliro ndikupeza kumasulidwa komwe kumagwirizana kwathunthu ndi 0.2.7, koma kutengera DeepStream 6.4 ndi ukadaulo wotsogola, koma popanda kuphwanya kuyanjana pamlingo wa API.
Source: opennet.ru