ZHANG Yixiang, LIN Song, LI Xue. Personnel detection in dangerous area of coal preparation plant based on CenterNet-GhostNet[J]. Journal of Mine Automation,2022,48(4):66-71. DOI: 10.13272/j.issn.1671-251x.2021080058
Citation: ZHANG Yixiang, LIN Song, LI Xue. Personnel detection in dangerous area of coal preparation plant based on CenterNet-GhostNet[J]. Journal of Mine Automation,2022,48(4):66-71. DOI: 10.13272/j.issn.1671-251x.2021080058

Personnel detection in dangerous area of coal preparation plant based on CenterNet-GhostNet

More Information
  • Received Date: August 20, 2021
  • Revised Date: April 01, 2022
  • Available Online: March 04, 2022
  • Due to the dust and fog interference, it is difficult to distinguish accurately the whole body target of personnel in dangerous areas of coal preparation plant from the production environment background. Moreover, the head features of personnel are relatively easy to be identified, and the possibility of head being blocked in the monitoring perspective is low. Therefore, the head detection of personnel in dangerous areas is used instead of the whole body target detection of personnel. At present, the lightweight target detection model based on deep learning has a lot of information loss in feature extraction, and its detection capability of human head target is limited. In order to solve this problem, a lightweight personnel detection model CenterNet-GhostNet is proposed. The model takes CenterNet network as the basic framework, and combines the lightweight network GhostNet and the feature pyramid network(FPN) as the feature extraction network. GhostNet extracts the features of the input image and improves the network feature expression capability. And the FPN fuses the information contained in the feature maps with different resolutions extracted by GhostNet, so that more detailed information is reserved while extracting the high-level semantic features. Three independent convolution operation branches are used to decode and calculate the single output feature map with higher resolution, so as to make full use of the detailed information contained in the feature map. The experimental results show that the detection precision of CenterNet-GhostNet model is 93.7% and 91.7% respectively for the two types of head targets with and without helmet, which are better than the general lightweight models SSD-MobileNet, YOLOv4 Tiny and CenterNet-Res18. The single frame detection time of CenterNet-GhostNet model deployed on NVIDIA Jetson Nano is 67 ms, which meets the requirements of high-precision and real-time detection of personnel in dangerous areas of coal preparation plant.
  • [1]
    张宗华. 选煤厂人员智能视频监控系统设计[J]. 工矿自动化,2013,39(4):76-79. DOI: 10.7526/j.issn.1671-251X.2013.04.020

    ZHANG Zonghua. Design of intelligent video monitoring system of personnel of coal preparation plant[J]. Industry and Mine Automation,2013,39(4):76-79. DOI: 10.7526/j.issn.1671-251X.2013.04.020
    [2]
    张圣强,王建军,丁蕾. 选煤厂智能视频监控中的运动人体目标检测方法[J]. 工矿自动化,2011,37(11):60-62.

    ZHANG Shengqiang,WANG Jianjun,DING Lei. Detecting method of moving human in intelligent video monitoring of coal preparation plant[J]. Industry and Mine Automation,2011,37(11):60-62.
    [3]
    陈海龙. 煤矿选煤厂巡检机器人的研究与设计[D]. 徐州: 中国矿业大学, 2014.

    CHEN Hailong. The study and design of coal cleaning plant inspection robot[D]. Xuzhou: China University of Mining and Technology, 2014.
    [4]
    林娅静. 基于视觉的选煤厂智能监控系统研究[D]. 徐州: 中国矿业大学, 2014.

    LIN Yajing. Research on intelligent monitoring system of coal preparation plant based on vision[D]. Xuzhou: China University of Mining and Technology, 2014.
    [5]
    周晨晖. 基于深度学习的煤矿复杂场景人员检测与统计分析方法研究[D]. 徐州: 中国矿业大学, 2019.

    ZHOU Chenhui. Research on personnel detection and statistical analysis in coal mine complex scenes based on deep learning[D]. Xuzhou: China University of Mining and Technology, 2019.
    [6]
    ZHOU Xingyi, WANG Dequan, KRAHENBUHL P. Objects as points[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, 2019: 7263-7271.
    [7]
    HAN K, WANG Yunhe, TIAN Qi, et al. GhostNet: more features from cheap operations[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, 2016: 1577-1586.
    [8]
    LIN T Y, DOLLAR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, 2017: 2117-2125.
    [9]
    HOWARD A G, ZHU Menglong, CHEN Bo, et al. MobileNets: efficient convolutional neural networks for mobile vision applications[EB/OL]. [2021-08-02]. https://arxiv.org/abs/1704.04861.
    [10]
    DAI Jifeng, QI Haozhi, XIONG Yuwen, et al. Deformable convolutional networks[C]//IEEE International Conference on Computer Vision, Venice, 2017: 764-773.
    [11]
    XU Yuanyuan,YAN Wan,YANG Genke,et al. CenterFace:joint face detection and alignment using face as point[J]. Scientific Programming,2020,2020:1-8.
    [12]
    LIN T Y,GOYAL P,GIRSHICK R,et al. Focal loss for dense object detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,42(2):318-327. DOI: 10.1109/TPAMI.2018.2858826
    [13]
    BOCHKOVSKIY A, WANG C Y, LIAO H Y M. YOLOv4: optimal speed and accuracy of object detection[EB/OL]. [2021-08-02]. https://arxiv.org/abs/2004.10934.
    [14]
    EVERINGHAM M,GOOL L V,WILLIAMS C K I,et al. The PASCAL visual object classes( VOC) challenge[J]. International Journal of Computer Vision,2010,88(2):303-338. DOI: 10.1007/s11263-009-0275-4
  • Related Articles

    [1]HUANG Yuxin, YAN Zhenguo, FAN Jingdao, LI Chuan. Coal mine dual prevention information system based on Apriori algorithm[J]. Journal of Mine Automation, 2020, 46(10): 92-98. DOI: 10.13272/j.issn.1671 -251x.2020040095
    [2]MA Hongwei, WU Shaojie, CAO Xiangang, XU Boyuan, ZHANG Xinyua. Big data cleaning modeling of operation status of coal mine fully—mechanized coal mining equipment[J]. Journal of Mine Automation, 2018, 44(11): 80-83. DOI: 10.13272/j.issn.1671—251x.2018040090
    [3]WANG Wei. Research on application of Hadoop in personnel positioning software system[J]. Journal of Mine Automation, 2017, 43(1): 66-68. DOI: 10.13272/j.issn.1671-251x.2017.01.016
    [4]NIE Rui, LU Jian-jun, WEI Chen. OLAP Analyzing System of Coal Sale Data Based on Hadoop Platform[J]. Journal of Mine Automation, 2012, 38(11): 77-80.
    [5]ZHOU Xin, MIAO Chang-yun, LI Yan-feng, WU Zhi-gang. Optimization of CS-ACELP Voice Code Algorithm and Its Implementation on DSP[J]. Journal of Mine Automation, 2009, 35(12): 69-72.
    [6]GUO Yi-dan, SONG Shu-zhong, MA Jian-wei, ZHU Jin-hong. Analysis and Simulation of IGBT Power Consume Based on PSpice[J]. Journal of Mine Automation, 2009, 35(10): 53-56.
    [7]WU Kai-xing, HAN Xi. Design of WebGIS Based on .NET and SuperMap Platform and Its Implementatio[J]. Journal of Mine Automation, 2008, 34(5): 110-112.
    [8]LI Ming-hua. ISOMAP Algorithm and LLE Algorithm in Image Retrieval and Their Compariso[J]. Journal of Mine Automation, 2007, 33(6): 30-31.

Catalog

    Article Metrics

    Article views (291) PDF downloads (62) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return