Citation: | SONG Liye, ZHAO Xiaoxuan, CUI Hao. Mining shovel detection algorithm based on improved YOLOv7[J]. Journal of Mine Automation,2023,49(12):18-24, 32. doi: 10.13272/j.issn.1671-251x.2023070011 |
The existing deep learning based shovel detection methods fail to balance detection speed and precision well. In order to solve the above problem, an improved YOLOv7 model is proposed and applied to mining shovel detection. This model is based on the YOLOv7 model, using a lightweight GhostNet network for feature extraction in the backbone network. This model replaces some ordinary convolutions with lightweight GSConv in the neck network to reduce the number of model parameters and computation, and improve the detection speed of the model. Considering the impact of reduced model parameters on feature information extraction capability after lightweight improvement, the neck network is further improved without increasing computational complexity. The coordinate attention mechanism (CA) is embedded in the extended efficient layer aggregation network (ELAN). The bidirectional feature pyramid network (BiFPN) is used to improve path aggregation network (PANet) to enhance the network's capability to extract feature information. Furthermore, it effectively improves the precision of model detection. The experimental results show that compared with the YOLOv7 model, the improved YOLOv7 model reduces the number of parameters by 75.4%, reduces the number of floating-point operations per second by 82.9%, and improves the detection speed by 24.3%. Compared with other object detection models, the improved YOLOv7 model achieves a good balance between detection speed and precision, meeting the demand for real-time and accurate detection of electric shovels in open-pit coal mine scenarios. It provides favorable conditions for embedding into mobile devices.
[1] |
王劲泽. 浅析如何提高露天矿供电系统可靠性[J]. 内蒙古煤炭经济,2017(11):22-23.
WANG Jinze. How to improve the reliability of power supply system in open pit mine[J]. Inner Mongolia Coal Economy,2017(11):22-23.
|
[2] |
郭安斌,苏红俊,闫孝姮. 基于 UWB 技术的矿山电铲定位算法研究[J]. 工矿自动化,2020,46(12):95-100.
GUO Anbin,SU Hongjun,YAN Xiaoheng. Research on positioning algorithm of electric mine shovel based on UWB technology[J]. Industry and Mine Automation,2020,46(12):95-100.
|
[3] |
曹连民,崔久龙,刘现文,等. 连续采煤机电缆卷放装置设计[J]. 煤矿机械,2019,40(6):108-111.
CAO Lianmin,CUI Jiulong,LIU Xianwen,et al. Design of cable release device for continuous shearer[J]. Coal Mine Machinery,2019,40(6):108-111.
|
[4] |
南晓虎,丁雷. 深度学习的典型目标检测算法综述[J]. 计算机应用研究,2020,37(增刊2):15-21.
NAN Xiaohu,DING Lei. Review of typical target detection algorithms for deep learning[J]. Application Research of Computers,2020,37(S2):15-21.
|
[5] |
赵学军,李建. 一种基于深度学习的煤矸石检测方法[J]. 矿业科学学报,2021,6(6):730-736.
ZHAO Xuejun,LI Jian. A method of coal gangue detection based on deep learning[J]. Journal of Mining Science and Technology,2021,6(6):730-736.
|
[6] |
李亚辉,刘俊. 基于轻量级深度网络的目标识别方法[J]. 计算机应用研究,2020,37(3):919-923.
LI Yahui,LIU Jun. Object recognition method based on lightweight depth network[J]. Application Research of Computers,2020,37(3):919-923.
|
[7] |
李坤伦,魏泽发,宋焕生. 基于SqueezeNet卷积神经网络的车辆颜色识别[J]. 长安大学学报(自然科学版),2020,40(4):109-116.
LI Kunlun,WEI Zefa,SONG Huansheng. Vehicle color recognition based on SqueezeNet[J]. Journal of Chang'an University (Natural Science Edition),2020,40(4):109-116.
|
[8] |
廖慕钦. 基于深度学习的智能交通车辆检测与跟踪[D]. 长沙:中南林业科技大学,2021.
LIAO Muqin. Intelligent transportation vehicle detection and tracking based on deep learning[D]. Changsha:Central South University of Forestry and Technology,2021.
|
[9] |
DENG Tianmin,WU Yongjun. Simultaneous vehicle and lane detection via MobileNetV3 in car following scene[J]. Plos One,2022,17(3). DOI: 10.1371/journal.pone.0264551.
|
[10] |
孔维刚,李文婧,王秋艳,等. 基于改进YOLOv4算法的轻量化网络设计与实现[J]. 计算机工程,2022,48(3):181-188.
KONG Weigang,LI Wenjing,WANG Qiuyan,et al. Design and implementation of lightweight network based on improved YOLOv4 algorithm[J]. Computer Engineering,2022,48(3):181-188.
|
[11] |
徐承优. 可用于移动端的轻量级语义分割网络研究及其在盲人视觉辅助中的应用[D]. 杭州:浙江大学,2020.
XU Chengyou. Research on lightweight semantic segmentation networks for mobile devices and application in the assistance of the visually impaired[D]. Hangzhou:Zhejiang University,2020.
|
[12] |
宋中山,肖博文,艾勇,等. 基于改进YOLOv4的轻量化目标检测算[J]. 电子测量技术,2022,45(16):142-152.
SONG Zhongshan,XIAO Bowen,AI Yong,et al. Improved lightweight YOLOv4 target detection algorithm[J]. Electronic Measurement Technology,2022,45(16):142-152.
|
[13] |
蒋镕圻,叶泽聪,彭月平,等. 针对弱小无人机目标的轻量级目标检测算法[J]. 激光与光电子学进展,2022,59(8):109-120.
JIANG Rongqi,YE Zecong,PENG Yueping,et al. Lightweight target detection algorithm for small and weak drone targets[J]. Laser & Optoelectronics Progress,2022,59(8):109-120.
|
[14] |
杨锦辉,李鸿,杜芸彦,等. 基于改进YOLOv5s的轻量化目标检测算法[J]. 电光与控制,2023,30(2):24-30.
YANG Jinhui,LI Hong,DU Yunyan,et al. A lightweight object detection algorithm based on improved YOLOv5s[J]. Electronics Optics & Control,2023,30(2):24-30.
|
[15] |
WANG C Y,BOCHKOVSKIY A,LIAO H Y M. YOLOv7:trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Vancouver,2023:7464-7475.
|
[16] |
HAN Kai,WANG Yunhe,TIAN Qi,et al. GhostNet:more features from cheap operations[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Seattle,2020:1580-1589.
|
[17] |
张佳璐.基于深度学习的道路车辆检测算法研究[D].临沂:临沂大学,2023.
ZHANG Jialu.Road vehicle detection algorithms based on deep learning[D].Linyi:Linyi University,2023.
|
[18] |
HU Jie,SHEN Li,SUN Gang. Squeeze-and-excitation networks[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Salt Lake City,2018:7132-7141.
|
[19] |
WOO S H,PARK J Y,LEE J Y,et al. CBAM:convolutional block attention module[C]. European Conference on Computer Vision,Munich,2018:3-19.
|
[20] |
HOU Qibin,ZHOU Daquan,FENG Jiashi. Coordinate attention for efficient mobile network design[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Nashville,2021:13713-13722.
|
[21] |
TAN Mingxing,PANG Ruoming,LE Q V. Efficientdet:scalable and efficient object detection[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Seattle,2020:10781-10790.
|
[22] |
MA Long,MA Tengyu,LIU Risheng,et al. Toward fast,flexible,and robust low-light image enhancement[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,New Orleans,2022:5637-5646.
|