Volume 49 Issue 11
Nov.  2023
Turn off MathJax
Article Contents
ZHAO Wei, WANG Shuang, ZHAO Dongyang. Multi object detection of underground unmanned electric locomotives in coal mines based on SD-YOLOv5s-4L[J]. Journal of Mine Automation,2023,49(11):121-128.  doi: 10.13272/j.issn.1671-251x.2023070100
Citation: ZHAO Wei, WANG Shuang, ZHAO Dongyang. Multi object detection of underground unmanned electric locomotives in coal mines based on SD-YOLOv5s-4L[J]. Journal of Mine Automation,2023,49(11):121-128.  doi: 10.13272/j.issn.1671-251x.2023070100

Multi object detection of underground unmanned electric locomotives in coal mines based on SD-YOLOv5s-4L

doi: 10.13272/j.issn.1671-251x.2023070100
  • Received Date: 2023-07-28
  • Rev Recd Date: 2023-11-17
  • Available Online: 2023-11-27
  • Due to complex environmental factors such as uneven illumination and high noise, unmanned electric locomotives in coal mines have low accuracy in multi object detection and difficulty in recognizing small objects. In order to solve the above problems, a multi object detection model for underground unmanned electric locomotives in coal mines based on SD-YOLOv5s-4L is proposed. On the basis of YOLOv5s, the following improvements are made to construct the SD-YOLOv5s-4L network model. The model introduces the SIoU loss function to solve the problem of mismatch between the direction of the real box and the predicted box, so that the model can better learn the position information of the object. The model introduces decoupled heads at the head of YOLOv5s to enhance the feature fusion and positioning accuracy of the network model. It enables the model to quickly capture multi-scale features of the object. The model introduces a small object detection layer to increase the original three scale detection layer to four scale. It enhances the model's feature extraction capability and detection precision for small objects. The experiment is conducted on a multi object detection dataset of the mine electric locomotives. The results show the following points. The mean average precision (mAP) of the SD-YOLOv5s-4L network model for various types of objects is 97.9%, and the average precision (AP) for small objects is 98.9%. Compared with the YOLOv5s network model, it improves by 5.2% and 9.8%, respectively. Compared with other network models such as YOLOv7 and YOLOv8, the SD-YOLOv5s-4L network model has the best comprehensive detection performance and can provide technical support for achieving unmanned driving of the mine electric locomotives.

     

  • loading
  • [1]
    王国法,赵国瑞,任怀伟. 智慧煤矿与智能化开采关键核心技术分析[J]. 煤炭学报,2019,44(1):34-41. doi: 10.13225/j.cnki.jccs.2018.5034

    WANG Guofa,ZHAO Guorui,REN Huaiwei. Analysis on key technologies of intelligent coal mine and intelligent mining[J]. Journal of China Coal Society,2019,44(1):34-41. doi: 10.13225/j.cnki.jccs.2018.5034
    [2]
    孙继平. 煤矿智能化与矿用5G[J]. 工矿自动化,2020,46(8):1-7.

    SUN Jiping. Coal mine intelligence and mine-used 5G[J]. Industry and Mine Automation,2020,46(8):1-7.
    [3]
    于骞翔,张元生. 井下电机车轨道障碍物图像处理方法的智能识别技术[J]. 金属矿山,2021(8):150-157. doi: 10.19614/j.cnki.jsks.202108024

    YU Qianxiang,ZHANG Yuansheng. Track obstacle intelligent recognition technology of mine electric locomotive based on image processing[J]. Metal Mine,2021(8):150-157. doi: 10.19614/j.cnki.jsks.202108024
    [4]
    韩江洪,卫星,陆阳,等. 煤矿井下机车无人驾驶系统关键技术[J]. 煤炭学报,2020,45(6):2104-2115.

    HAN Jianghong,WEI Xing,LU Yang,et al. Driverless technology of underground locomotive in coal mine[J]. Journal of China Coal Society,2020,45(6):2104-2115.
    [5]
    胡青松,孟春蕾,李世银,等. 矿井无人驾驶环境感知技术研究现状及展望[J]. 工矿自动化,2023,49(6):128-140. doi: 10.13272/j.issn.1671-251x.18115

    HU Qingsong,MENG Chunlei,LI Shiyin,et al. Research status and prospects of perception technology for unmanned mining vehicle driving environment[J]. Journal of Mine Automation,2023,49(6):128-140. doi: 10.13272/j.issn.1671-251x.18115
    [6]
    李程,车文刚,高盛祥. 一种用于航拍图像的目标检测算法[J]. 山东大学学报(理学版),2023,58(9):59-70.

    LI Cheng,CHE Wengang,GAO Shengxiang. A object detection algorithm for aerial images[J]. Journal of Shandong University(Natural Science),2023,58(9):59-70.
    [7]
    GIRSHICK R,DONAHUE J,DARRELL T,et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]. 2014 IEEE Conference on Computer Vision and Pattern Recognition,Columbus,2014:580-587.
    [8]
    HE Kaiming,GKIOXARI G,DOLLAR P,et al. Mask R-CNN[C]. 2017 IEEE International Conference on Computer Vision,Venice,2017:2980-2988.
    [9]
    REDMON J,DIVVALA S,GIRSHICK R,et al. You only look once:unified,real-time object detection[C]. IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas,2016:779-788.
    [10]
    LIU Wei,ANGUELOV D,ERHAN D,et al. SSD:single shot multi-box Detector[C]. European Conference on Computer Vision,2016:21-37.
    [11]
    李伟山,卫晨,王琳. 改进的Faster RCNN煤矿井下行人检测算法[J]. 计算机工程与应用,2019,55(4):200-207. doi: 10.3778/j.issn.1002-8331.1711-0282

    LI Weishan,WEI Chen,WANG Lin. Improved faster RCNN approach for pedestrian detection in underground coal mine[J]. Computer Engineering and Applications,2019,55(4):200-207. doi: 10.3778/j.issn.1002-8331.1711-0282
    [12]
    HE Deqiang,LI Kai,CHEN Yanjun,et al. Obstacle detection in dangerous railway track areas by a convolutional neural network[J]. Measurement Science and Technology,2021,32(10). DOI: 10.1088/1361-6501/abfdde.
    [13]
    HE Kaiming,ZHANG Xiangyu,REN Shaoqing,et al. Identity mappings in deep residual networks[C]. European Conference on Computer Vision,2016:630-645.
    [14]
    郝帅,张旭,马旭,等. 基于CBAM−YOLOv5的煤矿输送带异物检测[J]. 煤炭学报,2022,47(11):4147-4156.

    HAO Shuai,ZHANG Xu,MA Xu,et al. Foreign object detection in coal mine conveyor belt based on CBAM-YOLOv5[J]. Journal of China Coal Society,2022,47(11):4147-4156.
    [15]
    郑玉珩,黄德启. 改进MobileViT与YOLOv4的轻量化车辆检测网络[J]. 电子测量技术,2023,46(2):175-183.

    ZHENG Yuheng,HUANG Deqi. Lightweight vehicle detection network based on MobileViT and YOLOv4[J]. Electronic Measurement Technology,2023,46(2):175-183.
    [16]
    杨艺,付泽峰,高有进,等. 基于深度神经网络的综采工作面视频目标检测[J]. 工矿自动化,2022,48(8):33-42.

    YANG Yi,FU Zefeng,GAO Youjin,et al. Video object detection of the fully mechanized working face based on deep neural network[J]. Journal of Mine Automation,2022,48(8):33-42.
    [17]
    葛淑伟,张永茜,秦嘉欣,等. 基于优化SSD−MobileNetV2的煤矿井下锚孔检测方法[J]. 采矿与岩层控制工程学报,2023,5(2):66-74.

    GE Shuwei,ZHANG Yongqian,QIN Jiaxin,et al. Rock bolt borehole detection method for underground coal mines based on optimized SSD-MobileNetV2[J]. Journal of Mining and Strata Control Engineering,2023,5(2):66-74.
    [18]
    GEVORGYAN Z. SIoU loss:more powerful learning for bounding box regression[EB/OL]. [2023-05-12]. https://arxiv.org/abs/2205.12740.
    [19]
    ZHENG Zhaohui,WANG Ping,REN Dongwei,et al. Enhancing geometric factors in model learning and inference for object detection and instance segmentation[J]. IEEE Transactions on Cybernetics,2021,52(8):8574-8586.
    [20]
    WU Yue,CHEN Yinpeng,YUAN Lu,et al. Rethinking classification and localization for object detection[C]. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition,Seattle,2020:10183-10192.
    [21]
    LIN T-Y,DOLLAR P,GIRSHICK R B,et al. Feature pyramid networks for object detection[C]. 2017 IEEE Conference on Computer Vision and Pattern Recognition,Honolulu,2017:936-944.
    [22]
    LIU Shu,QI Lu,QIN Haifang,et al. Path aggregation network for instance segmentation[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Salt Lake City,2018:8759-8768.
    [23]
    KARAKAYA M,CELEBI M F,GOK A E,et al. Discovery of agricultural diseases by deep learning and object detection[J]. Environmental Engineering and Management Journal,2022,21(1):163-173. doi: 10.30638/eemj.2022.016
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(7)  / Tables(4)

    Article Metrics

    Article views (1260) PDF downloads(56) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return