Volume 49 Issue 11
Nov.  2023
Turn off MathJax
Article Contents
LIU Yi, PANG Dawei, TIAN Yu. Multi object personnel detection and dynamic tracking method based on improved KCF[J]. Journal of Mine Automation,2023,49(11):129-137.  doi: 10.13272/j.issn.1671-251x.2023080015
Citation: LIU Yi, PANG Dawei, TIAN Yu. Multi object personnel detection and dynamic tracking method based on improved KCF[J]. Journal of Mine Automation,2023,49(11):129-137.  doi: 10.13272/j.issn.1671-251x.2023080015

Multi object personnel detection and dynamic tracking method based on improved KCF

doi: 10.13272/j.issn.1671-251x.2023080015
  • Received Date: 2023-06-05
  • Rev Recd Date: 2023-08-30
  • Available Online: 2023-11-23
  • Factors such as insufficient illumination in coal mine roadways, drastic changes in object scale, easy obstruction of objects, and interference from mining lights lead to low success rate and accuracy in underground object detection and tracking. In order to solve the above problems, a multi object personnel detection and dynamic tracking method based on improved kernel correlation filter (KCF) algorithm is proposed. The method can avoid detection failure due to uneven lighting in complex underground environments. The SSD detection algorithm is introduced into the improved KCF algorithm to enhance the capability to detect multiple object personnel. ① The method reads the video sequence to be tracked, uses the SSD algorithm trained on the underground dataset to detect the object in the image. The method continues reading the next frame if no object is found. ② The method places the detected object into the tracker, preprocesses the image, scores all detection boxes according to the set threshold through comparison, and arranges them in descending order based on the score. The high score detection results are directly output, while the low score detection results are used to filter out bad information to improve detection speed. ③ The method clears the tracker after tracking and predicting object M frames through KCF, and then performs object detection again. By combining detection and tracking algorithms, the continuous tracking capability of the object is ensured. The experimental results show the following points. ① The final loss value of this method is stable around 1.675, and the detection results are relatively stable. ② The SSD recognition precision after training has improved by 52.7% compared to the SSD recognition precision before training. ③ The detection success rate and tracking accuracy of this method for mine personnel are 87.9% and 88.9%, respectively, which are higher than the detection success rate and tracking accuracy of the other four algorithms (KCF, CSRT, TLD, MIL). ④ This method has a high success rate when the overlap threshold is low, and until the overlap threshold is greater than 0.8, the success rate significantly decreases. This is because the environment in the mine is diverse, and it is difficult to fully match the labeled boxes. The practical application results show that this method has high applicability in complex environments such as insufficient lighting in underground coal mine roadways, drastic changes in object scale, easy obstruction, and interference from mining lights.

     

  • loading
  • [1]
    孙继平. 煤矿信息化与自动化发展趋势[J]. 工矿自动化,2015,41(4):1-5.

    SUN Jiping. Development trend of coal mine informatization and automation[J]. Industry and Mine Automation,2015,41(4):1-5.
    [2]
    程德强,钱建生,郭星歌,等. 煤矿安全生产视频AI识别关键技术研究综述[J]. 煤炭科学技术,2023,51(2):349-365.

    CHENG Deqiang,QIAN Jiansheng,GUO Xingge,et al. Review on key technologies of AI recognition for videos in coal mine[J]. Coal Science and Technology,2023,51(2):349-365.
    [3]
    孙继平. 煤矿监控新技术与新装备[J]. 工矿自动化,2015,41(1):1-5.

    SUN Jiping. New technologies and new equipments of coal mine monitoring[J]. Industry and Mine Automation,2015,41(1):1-5.
    [4]
    孙继平. 煤矿智能化与矿用5G[J]. 工矿自动化,2020,46(8):1-7.

    SUN Jiping. Coal mine intelligence and mine-used 5G[J]. Industry and Mine Automation,2020,46(8):1-7.
    [5]
    程德强,冯晨晨,唐世轩,等. 多特征融合的行人检测算法[J]. 煤炭技术,2018,37(10):254-257.

    CHENG Deqiang,FENG Chenchen,TANG Shixuan,et al. Multi-features fusion pedestrian detection algorithm[J]. Coal Technology,2018,37(10):254-257.
    [6]
    孟庆勇. 5G技术在煤矿井下应用架构探讨[J]. 工矿自动化,2020,46(7):28-33.

    Meng Qingyong. Probe on 5G architecture applied in coal mine underground[J]. Industry and Mine Automation,2020,46(7):28-33.
    [7]
    ZHANG Tianzhu,XU Changsheng,YANG M. Multi-task correlation particle filter for robust object tracking[C]. IEEE Conference on Computer Vision and Pattern Recognition(CVPR),Honolulu,2017:4819-4827.
    [8]
    刘海仓. 基于稀疏表示的图像超分辨率与目标跟踪方法研究[D]. 长沙:湖南大学,2015.

    LIU Haicang. Reseach on image super resolution and object tracking based on sparse representation[D]. Changsha:Hunan University,2015.
    [9]
    白中浩,朱磊,李智强. 基于多模型融合和重新检测的高精度鲁棒目标跟踪[J]. 仪器仪表学报,2019,40(9):132-141.

    BAI Zhonghao,ZHU Lei,LI Zhiqiang. High-accuracy and robust object tracking based on multi-model fusion and re-detection[J]. Chinese Journal of Scientific Instrument,2019,40(9):132-141.
    [10]
    郝建华. 基于CamShift和粒子滤波的煤矿变电所人员目标跟踪算法研究[J]. 工矿自动化,2015,41(11):35-388.

    HAO Jianhua. Research of personnel tracking algorithm for coal mine substation based on CamShift and particle filter[J]. Industry and Mine Automation,2015,41(11):35-38.
    [11]
    邵小强,李康乐,陈熙,等. 基于改进卡尔曼滤波和参数拟合的矿井TOA定位方法[J]. 煤炭学报,2019,44(5):1616-1624.

    SHAO Xiaoqiang,LI Kangle,CHEN Xi,et al. TOA positioning method of coalmine based on Kalman filter and parameter fitting[J]. Journal of China Coal Society,2019,44(5):1616-1624.
    [12]
    孙继平,邵子佩,刘毅. 采煤机视频压缩感知跟踪方法[J]. 工矿自动化,2018,44(3):8-11.

    SUN Jiping,SHAO Zipei,LIU Yi. Visual tracking method of shearer based on compressive sensing[J]. Industry and Mine Automation,2018,44(3):8-11.
    [13]
    贾澎涛,贾伟. 煤矿井下视频多目标轨迹跟踪算法研究[J]. 计算机工程与应用,2018,54(2):222-227. doi: 10.3778/j.issn.1002-8331.1607-0308

    JIA Pengtao,JIA Wei. Recherche algorithm on coal mine multi-target trajectory tracking[J]. Computer Engineering and Applications,2018,54(2):222-227. doi: 10.3778/j.issn.1002-8331.1607-0308
    [14]
    陈伟,丁世飞,许新征. 基于YCbCr模型的巷道监控中矿工脸部图像识别[J]. 煤炭科学技术,2009,37(9):79-82,85.

    CHEN Wei,DING Shifei,XU Xinzheng. Miners' face images identification in monitor images of mine gateway based on YCbCr model[J]. Coal Science and Technology,2009,37(9):79-82,85.
    [15]
    HENRIQUES J F,CASEIRO R,MARTINS P,et al. High-speed tracking with kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2015. DOI: 10.1109/TPAMI.2014.2345390.
    [16]
    LIU Wei,ANGUELOV D,ERHAN D,et al. SSD:single shot multibox detector[J]. Springer,Cham,2016. DOI: 10.1007/978-3-319-46448-0_2.
    [17]
    KALAKE L,WAN Wanggen,HOU Li. Analysis based on recent deep learning approaches applied in real-time multi-object tracking:a review[J]. IEEE Access,2021(9):32650-32671. doi: 10.1109/ACCESS.2021.3060821
    [18]
    LUKEZIC A,VOJIR T,CEHOVIN Z L,et al. Discriminative correlation filter with channel and spatial reliability[J]. International Journal of Computer Vision,2018. DOI: 10.1007/s11263-017-1061-3.
    [19]
    ZHAO Shuaitong,YANG Xianzhao,CHEN Yang,et al. Research on pedestrian detection algorithms combined with lightweight networks[C]. International Conference on Algorithms,High Performance Computing and Artificial Intelligence,Guangzhou,2022:62-67.
    [20]
    CHEPLYGINA V,SRENSEN L,TAX D M,et al. Label stability in multiple instance learning[C]. Medical Image Computing and Computer-Assisted Intervention,Springer,Cham,2015. DOI: 10.1007/978-3-319-24553-9_66.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(11)  / Tables(2)

    Article Metrics

    Article views (968) PDF downloads(44) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return