Isakhelo se-Savant 0.2.7 Python sikhutshwe, okwenza kube lula ukusebenzisa i-NVIDIA DeepStream ukusombulula iingxaki ezinxulumene nokufunda komatshini. Isakhelo sikhathalela konke ukuphakamisa okunzima kunye ne-GStreamer okanye i-FFmpeg, ikuvumela ukuba ugxile ekwakhiweni kwemibhobho yemveliso ephuculweyo usebenzisa i-syntax ye-declarative (YAML) kunye nemisebenzi yePython. I-Savant ikuvumela ukuba wenze imibhobho esebenza ngokulinganayo kwi-accelerator kwiziko ledatha (NVIDIA Turing, Ampere, Hopper) kunye nezixhobo ezinqamlekileyo (NVIDIA Jetson NX, AGX Xavier, Orin NX, AGX Orin, New Nano). Nge-Savant, unokuqhubekekisa ngokulula imijelo yevidiyo emininzi ngaxeshanye kwaye ngokukhawuleza wenze imibhobho yohlalutyo lwevidiyo elungele imveliso usebenzisa i-NVIDIA TensorRT. Ikhowudi yeprojekthi ihanjiswa phantsi kwelayisensi ye-Apache 2.0.
I-Savant 0.2.7 yinkqubo yamva nje yokutshintsha utshintsho kwisebe le-0.2.X. Ukukhutshwa kwexesha elizayo kwi-0.2.X yesebe kuya kubandakanya kuphela ukulungiswa kwebug. Ukuphuhliswa kweempawu ezintsha kuya kwenziwa kwisebe le-0.3.X, ngokusekelwe kwi-DeepStream 6.4. Eli sebe aliyi kuxhasa usapho lweJetson Xavier lwezixhobo njengoko i-NVIDIA ingazixhasi kwi-DS 6.4.
Iinguqulelo eziphambili:
- Iimeko ezintsha zokusetyenziswa:
- Umzekelo wokusebenza kunye nemodeli yokufumanisa esekelwe kwi-transformer ye-RT-DETR;
- I-CUDA post-processing nge-CuPy ye-YOLOV8-Seg;
- Umzekelo wokudityaniswa kwe-PyTorch CUDA kumbhobho we-Savant;
- Umboniso wokusebenza ngezinto ezijoliswe kuzo.
- Iimpawu ezintsha:
- Ukudibanisa kunye nePrometheus. Umbhobho ungathumela ngaphandle iimetrics zokwenziwa kwi-Prometheus kunye ne-Grafana ukuze kubekwe iliso kunye nokulandelela ukusebenza. Abaphuhlisi banokubhengeza iimethrikhi zesiko ezithunyelwa ngaphandle kunye ne-system metrics.
- I-Adaptha ye-Buffer-Iphumeza isithinteli sotshintshiselwano esizingileyo kwidiski yedatha ehamba phakathi kweadaptha kunye neemodyuli. Ngoncedo lwayo, unokuphuhlisa imibhobho elayishwe kakhulu etya izixhobo ngokungalindelekanga kwaye imelane nokugqabhuka kwetrafikhi. I-adapter ithumela izinto zayo kunye nobukhulu bedatha kwi-Prometheus.
- Imowudi yokuhlanganisa. Iimodyuli ngoku zinokuqulunqa imifuziselo yazo kwiTensorRT ngaphandle kokuqhuba umbhobho.
- Umphathi wesiganeko sokuvala iPyFunc. Le API intsha ivumela ukuvalwa kwemibhobho ukuba iphathwe kakuhle, ikhulula izixhobo kunye nokwazisa iinkqubo zomntu wesithathu ukuba ukuvalwa kwenzekile.
- Ukuhluza isakhelo kwigalelo kunye nemveliso. Ngokungagqibekanga, umbhobho wamkela zonke izakhelo eziqulethe idatha yevidiyo. Ngegalelo kunye nokucoca imveliso, abaphuhlisi banokuhluza idatha ukunqanda ukusetyenzwa.
- Ukulungiswa kwasemva kwemodeli kwiGPU. Ngenqaku elitsha, abaphuhlisi banokufikelela kwimodeli yemveliso ye-tensor ngokuthe ngqo kwimemori ye-GPU ngaphandle kokuyilayisha kwimemori ye-CPU kwaye bayiqhube ngokusebenzisa i-CuPy, iTorchVision okanye i-OpenCV CUDA.
- Imisebenzi yokumelwa kwememori ye-GPU. Kolu kukhutshwa, sinike imisebenzi yokuguqula i-buffers yememori phakathi kwe-OpenCV GpuMat, i-PyTorch GPU tensor, kunye ne-CuPy tensor.
- I-API yokufikelela kwizibalo zokusetyenziswa kwemigca yombhobho. I-Savant ikuvumela ukuba wongeze imigca phakathi kwePyFuncs ukuphumeza ukusetyenzwa okuhambelanayo kunye nokusetyenzwa kwe-buffering. I-API eyongeziweyo inika abaphuhlisi ukufikelela kwimigca esetyenziswe kumbhobho kwaye ibavumela ukuba babuze ukusetyenziswa kwabo.
Ekukhutshweni okulandelayo (0.3.7) kucwangciswe ukufudukela kwi-DeepStream 6.4 ngaphandle kokwandisa ukusebenza. Ingcamango kukufumana ukukhululwa okuhambelana ngokupheleleyo ne-0.2.7, kodwa ngokusekelwe kwi-DeepStream 6.4 kunye nokuphucula iteknoloji, kodwa ngaphandle kokuphula ukuhambelana kwinqanaba le-API.
umthombo: opennet.ru