FairMOT, lub kaw lus ceev ceev taug qab ntau yam khoom hauv video

Cov kws tshawb fawb los ntawm Microsoft thiab Central China University tsim tawm ib txoj kev ua tau zoo tshiab rau kev taug qab ntau yam khoom hauv video siv tshuab kev kawm technologies - FairMOT (Fair Multi-Object Tracking). Code nrog txoj kev siv raws li Pytorg thiab cov qauv kev cob qhia luam tawm ntawm GitHub.

Feem ntau txoj kev taug qab cov khoom uas twb muaj lawm siv ob theem, txhua qhov siv los ntawm ib qho kev sib cais neural network. Thawj theem khiav ib qho qauv rau kev txiav txim siab qhov chaw ntawm cov khoom nyiam, thiab theem ob siv cov qauv kev tshawb fawb hauv lub koom haum siv los txheeb xyuas cov khoom thiab txuas rau lawv.

FairMOT siv ib-theem kev siv raws li ib tug deformable convolutional neural network (DCNv 2, Deformable Convolutional Network), uas tso cai rau koj kom ua tiav qhov nrawm nrawm ntawm cov khoom taug qab. FairMOT ua haujlwm yam tsis muaj cov thauj tog rau nkoj, siv cov txheej txheem rov txheeb xyuas dua los txiav txim qhov offsets ntawm cov khoom nruab nrab ntawm daim ntawv qhia khoom siab. Nyob rau hauv parallel, ib tug processor raug tua uas ntsuas tus kheej cov yam ntxwv ntawm cov khoom uas yuav siv tau los kwv yees lawv tus kheej, thiab lub ntsiab module ua ib tug convergence ntawm cov yam ntxwv rau manipulate cov khoom ntawm txawv teev.

FairMOT, lub kaw lus ceev ceev taug qab ntau yam khoom hauv video

Txhawm rau cob qhia tus qauv hauv FairMOT, kev sib koom ua ke ntawm rau 17 cov ntaub ntawv pej xeem rau kev tshawb nrhiav thiab kev tshawb nrhiav tib neeg (ETH, CityPerson, CalTech, MOTXNUMX, CUHK-SYSU). Tus qauv tau sim siv cov yeeb yaj kiab kuaj 2 ZPO 15, MOT 16, MOT 17 ΠΈ MOT 20muab los ntawm qhov project MOT Challenge thiab npog cov xwm txheej sib txawv, lub koob yees duab txav los yog kev sib hloov, sib txawv saib cov ces kaum. Qhov kev sim tau pom tias
FairMOT outstrips ceev tshaj kev sib tw qauv TrackRCNN ΠΈ JDE thaum kuaj ntawm 30 thav duab ib ob kwj video, ua kom pom kev ua tau zoo txaus los txheeb xyuas cov kwj video tsis tu ncua ntawm ya.

Tau qhov twg los: opennet.ru

Ntxiv ib saib