Savant 0.2.7, chimiro chePython chinorerutsa kushandiswa kweNVIDIA DeepStream kugadzirisa matambudziko ekudzidza muchina, yakaburitswa. Iyo dhizaini inotarisira basa rese rakaoma neGStreamer kana FFmpeg, ichikubvumidza kuti utarise pakuvaka akakwenenzverwa inference mapaipi uchishandisa declarative syntax (YAML) uye Python mabasa. Savant inokutendera kuti ugadzire mapaipi anoshanda zvakaenzana pane ese ari maviri data center accelerators (NVIDIA Turing, Ampere, Hopper) uye edge zvishandiso (NVIDIA Jetson NX, AGX Xavier, Orin NX, AGX Orin, New Nano). NeSavant, unogona kugadzirisa zviri nyore mavhidhiyo akawanda panguva imwe chete, nekukurumidza kugadzira kugadzira-yakagadzirira vhidhiyo analytics mapaipi uchishandisa NVIDIA TensorRT. Iyo kodhi yeprojekiti yakagoverwa pasi peiyo Apache 2.0 rezinesi.
Savant 0.2.7 ndiyo yekupedzisira-shanduko kuburitswa mubazi re0.2.X. Zvichaburitswa mubazi re 0.2.X zvinongosanganisira kugadzirisa kwetsikidzi. Hutsva hwekuvandudza huchave huri mubazi re0.3.X, iro rakavakirwa paDeepStream 6.4. Iri bazi haritsigire mhuri yeJetson Xavier yemidziyo, sezvo NVIDIA isingavatsigire muDS 6.4.
Zvitsva zvikuru:
- Mienzaniso mitsva yekushandisa:
- Muenzaniso wekushanda nemuenzaniso wekuona unobva pane RT-DETR transformer;
- CUDA post-processing neCuPy yeYOLOV8-Seg;
- Muenzaniso wekubatanidza PyTorch CUDA muSavant pombi;
- Kuratidzira kwekushanda nezvinhu zvakatariswa.
- Zvitsva:
- Prometheus kubatanidzwa. Iyo pombi inogona kutumira metrics ekuuraya kuPrometheus neGrafana yekutarisa uye yekutevera kuita. Vagadziri vanogona kuzivisa mametrics etsika ayo anotengeswa kunze kwenyika pamwe chete nesystem metrics.
- Buffer Adapter - Inotemesa inoshingirira transaction buffer pane dhisiki yedata inofamba pakati peadapter nemamodule. Inogona kushandiswa kugadzira mapaipi akakwira-mutoro anoshandisa zviwanikwa zvisingatarisike uye anoshingirira spikes dzemigwagwa. Iyo adapta inotumira kunze chinhu chayo uye saizi data kuPrometheus.
- Modhi yekubatanidza modhi: Mamodule anogona ikozvino kuunganidza mamodheru avo kuTensorRT pasina kumhanyisa pombi.
- PyFunc shutdown chiitiko mubati. Iyi API nyowani inokutendera kuti ubate zvine hunyanzvi mashandiro epombi yekuvharisa, kusunungura zviwanikwa uye kuzivisa wechitatu-bato masisitimu nezve kudzima.
- Kupinza uye kubuda furemu kusefa. Nekumisikidza, iyo pombi inogamuchira ese mafreyimu ane data data. Nekusefa uye kuburitsa, vagadziri vanogona kusefa data kuti vasaite kuti isagadziriswa.
- Kumashure-kugadziriswa kweiyo modhi paGPU. Nechinhu chitsva ichi, vanogadzira vanogona kuwana inobuda matensor eiyo modhi zvakananga kubva kuGPU ndangariro, pasina kuiisa muCPU ndangariro, uye kuigadzirisa vachishandisa CuPy, TorchVision kana OpenCV CUDA.
- GPU Memory Representation Mabasa Mukuburitswa uku, takapa mabasa ekushandura memory buffers pakati peOpenCV GpuMat, PyTorch GPU tensor, uye CuPy tensor.
- API yekuwana nhamba dzemashandisirwo epapipeline. Savant inobvumira kuwedzera mitsetse pakati pePyFuncs kushandisa parallel processing uye buffered kugadzirisa. Iyo yakawedzerwa API inopa vanogadzira mukana kune mitsetse yakaiswa mupombi uye inobvumira kubvunza mashandisiro avo.
Kuburitswa kunotevera (0.3.7) kwakarongwa kuenda kuDeepStream 6.4 pasina kuwedzera chero basa. Pfungwa ndeyokuva nekusunungurwa kunonyatsoenderana ne 0.2.7, asi zvichibva paDeepStream 6.4 uye teknolojia yakagadziridzwa, asi pasina kuputsa kuwirirana pa API level.
Source: opennet.ru
