YOU Lei, ZHU Xinglin, CHEN Yu, et al. Tear detection method of conveyor belt based on fully convolutional neural network[J]. Journal of Mine Automation,2022,48(9):16-24. DOI: 10.13272/j.issn.1671-251x.2022040087
Citation: YOU Lei, ZHU Xinglin, CHEN Yu, et al. Tear detection method of conveyor belt based on fully convolutional neural network[J]. Journal of Mine Automation,2022,48(9):16-24. DOI: 10.13272/j.issn.1671-251x.2022040087

Tear detection method of conveyor belt based on fully convolutional neural network

More Information
  • Received Date: April 28, 2022
  • Revised Date: September 04, 2022
  • Available Online: June 22, 2022
  • The existing conveyor belt tear detection methods have problems, such as poor underground visible light imaging quality, lack of tear physical size measurement means, and poor generalization capability. In order to solve these problems, a conveyor belt tear detection method based on fully convolutional neural network is proposed. The method collects images based on a line-structured light imaging principle, and can effectively solve the problem of poor lighting conditions in a coal mine. The improved maximum method is used to detect line laser stripes, which can effectively eliminate the breakpoints of stripes, accurately extract stripes, and fit the missing points. The U-net network in the fully convolutional neural network is selected to segment the line laser stripe. The tear detection problem is converted into a semantic segmentation problem. The U-net network is optimized through dimension reduction, so as to reduce the number of parameters and calculations. The segmentation result is back-projected to the original image. The physical size of the tear is measured using the line-structured light calibration data. The experimental results show that the improved maximum method can effectively deal with the breakpoint area of line laser stripes without false detection and missed detection. The performance is superior to the Steger method and gray-weighted centroid method. The convergence speed of the U-net network is faster than that of the SegNet and FCNs network. The iteration stability is strong, and the evaluation index is optimal. The performance of the U-net4 network is better than that of U-net3 and U-net5. The test results on the verification set show that the recall rate of tear detection is 96.09%, and the precision is 96.85%. The measurement results on the experimental platform show that the maximum relative error of tear physical dimension measurement is −13.04%.
  • [1]
    HAKAMI F,PRAMANIK A,RIDGWAY N,et al. Developments of rubber material wear in conveyer belt system[J]. Tribology International,2017,111:148-158. DOI: 10.1016/j.triboint.2017.03.010
    [2]
    GUO Xiaoqiang,LIU Xinhua,ZHOU Hao,et al. Belt tear detection for coal mining conveyors[J]. Micromachines,2022,13(3):449. DOI: 10.3390/mi13030449
    [3]
    KOZLOWSKI T,WODECKI J,ZIMROZ R,et al. A diagnostics of conveyor belt splices[J]. Applied Sciences,2020,10(18):6259. DOI: 10.3390/app10186259
    [4]
    QIAO Tiezhu, CHEN Lulu, PANG Yusong, et al. Integrative binocular vision detection method based on infrared and visible light fusion for conveyor belts longitudinal tear[J]. Measurement, 2017, 110: 192-201.
    [5]
    YANG Ruiyun, QIAO Tiezhu, PANG Yusong, et al. Infrared spectrum analysis method for detection and early warning of longitudinal tear of mine conveyor belt[J]. Measurement, 2020, 165. DOI: 10.1016/j.measurement.2020.107856.
    [6]
    YANG Yanli, ZHAO Yanfei, MIAO Changyun, et al. On-line longitudinal rip detection of conveyor belts based on machine vision[C]. IEEE International Conference on Signal and Image Processing, Beijing, 2016: 315-318.
    [7]
    太原理工大学. 一种基于红外图像的实时矿用胶带预警撕裂检测方法: 201811338007.9[P]. 2018-11-12.

    Taiyuan University of Technology. A real-time early warning and tear detection method for mine conveyor belt based on infrared images: 201811338007.9[P]. 2018-11-12.
    [8]
    周宇杰,徐善永,黄友锐,等. 基于改进YOLOv4的输送带损伤检测方法[J]. 工矿自动化,2021,47(11):61-65. DOI: 10.13272/j.issn.1671-251x.17843

    ZHOU Yujie,XU Shanyong,HUANG Yourui,et al. Conveyor belt damage detection method based on improved YOLOv4[J]. Industry and Mine Automation,2021,47(11):61-65. DOI: 10.13272/j.issn.1671-251x.17843
    [9]
    韩雷. 基于线激光视觉检测的矿用输送机纵向撕裂保护系统研究[J]. 神华科技,2018,16(9):29-31,49. DOI: 10.3969/j.issn.1674-8492.2018.09.008

    HAN Lei. Study about mine conveyor longitudinal tear protection system by using line laser visual detection[J]. Shenhua Science and Technology,2018,16(9):29-31,49. DOI: 10.3969/j.issn.1674-8492.2018.09.008
    [10]
    LYU Zhiwei,ZHANG Xiaoguang,HU Jiangdi,et al. Visual detection method based on line lasers for the detection of longitudinal tears in conveyor belts[J]. Measurement,2021,183. DOI: 10.1016/j.measurement.2021.109800.
    [11]
    徐辉,刘丽静,沈科,等. 基于多道线性激光的带式输送机纵向撕裂检测[J]. 工矿自动化,2021,47(7):37-44. DOI: 10.13272/j.issn.1671-251x.17681

    XU Hui,LIU Lijing,SHEN Ke,et al. Longitudinal tear detection of belt conveyor based on multi linear lasers[J]. Industry and Mine Automation,2021,47(7):37-44. DOI: 10.13272/j.issn.1671-251x.17681
    [12]
    BLAZEJ R,JURDZIAK L,KOZLOWSKI T,et al. The use of magnetic sensors in monitoring the condition of the core in steel cord conveyor belts:tests of the measuring probe and the design of the DiagBelt system[J]. Measurement,2018,123:48-53. DOI: 10.1016/j.measurement.2018.03.051
    [13]
    ZUO Chao,FENG Shijie,HUANG Lei,et al. Phase shifting algorithms for fringe projection profilometry:a review[J]. Optics and Lasers in Engineering,2018,109:23-59. DOI: 10.1016/j.optlaseng.2018.04.019
    [14]
    ZHANG Song. High-speed 3D shape measurement with structured light methods:a review[J]. Optics and Lasers in Engineering,2018,106:119-131.
    [15]
    黄琬婷,胡小平. 一种基于张氏标定法的单目相机改进标定算法[J]. 导航与控制,2019,18(1):105-111. DOI: 10.3969/j.issn.1674-5558.2019.01.014

    HUANG Wanting,HU Xiaoping. An improved calibration algorithm of monocular camera based on Zhang's plane calibration method[J]. Navigation and Control,2019,18(1):105-111. DOI: 10.3969/j.issn.1674-5558.2019.01.014
    [16]
    冀振燕,宋晓军,付文杰,等. 激光光条中心线提取研究综述[J]. 测控技术,2021,40(6):1-8. DOI: 10.19708/j.ckjs.2021.06.001

    JI Zhenyan,SONG Xiaojun,FU Wenjie,et al. Review on centerline extraction for laser stripe[J]. Measurement & Control Technology,2021,40(6):1-8. DOI: 10.19708/j.ckjs.2021.06.001
    [17]
    LONG J, SHELHAMER E, DARRELL T. Fully convolutional networks for semantic segmentation[C]. IEEE Conference on Computer Vision and Pattern Recognition, Boston, 2015.
    [18]
    BADRINARAYANAN V,KENDALL A,CIPOLLA R. SegNet:a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(12):2481-2495. DOI: 10.1109/TPAMI.2016.2644615
    [19]
    RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation[C]. International Conference on Medical Image Computing and Computer-Assisted Intervention, 2015: 234-241.
    [20]
    CHEN L C, ZHU Y, PAPANDREOU G, et al. Encoder-decoder with atrous separable convolution for semantic image segmentation[C]. European Conference on Computer Vision, 2018: 833-851.
  • Related Articles

    [1]SHANG Weidong, YANG Dashan, ZHANG Kun. Research on coal quantity detection method based on deep neural network[J]. Journal of Mine Automation, 2024, 50(S1): 139-145.
    [2]WANG Zhifeng, WANG Jiachen, LI Lianghui, AN Bochao. Study on the prediction of gangue content rate in fully mechanized caving face based on DeepLab v3+[J]. Journal of Mine Automation, 2024, 50(10): 90-96. DOI: 10.13272/j.issn.1671-251x.2024070001
    [3]LIU Pengnan, LI Long, ZHANG Zihao, ZHU Xingguang, CHENG Deqiang. Super resolution reconstruction of noisy images based on dense residual connected U-shaped networks[J]. Journal of Mine Automation, 2024, 50(2): 63-71. DOI: 10.13272/j.issn.1671-251x.2023080098
    [4]CHENG Deqiang, ZHENG Lijuan, LIU Jingjing, KOU Qiqi, JIANG He. Quantitative analysis of coal particle size based on bi-level routing attention mechanism[J]. Journal of Mine Automation, 2024, 50(2): 9-17. DOI: 10.13272/j.issn.1671-251x.2023100002
    [5]MA Tian, LI Fanhui, YANG Jiayi, ZHANG Jiehui, DING Xuhan. Real time segmentation method for underground track area based on improved STDC[J]. Journal of Mine Automation, 2023, 49(11): 107-114. DOI: 10.13272/j.issn.1671-251x.2023080076
    [6]WU Jiangwei, NAN Bingfei. Method for recognizing coal flow status of scraper conveyor in working face[J]. Journal of Mine Automation, 2023, 49(11): 60-66. DOI: 10.13272/j.issn.1671-251x.2023080101
    [7]LI Yao, LENG Siyu, LEI Meng, ZOU Liang. Scratch detection and removal method for coal microscopic images[J]. Journal of Mine Automation, 2021, 47(5): 95-100. DOI: 13272/j.issn.1671-251x.2021020054
    [8]WANG Gechen, YAN Yuhan, LIU Xiaowen, DING Enjie. Research on visual semantic method of mine personnel behavior[J]. Journal of Mine Automation, 2021, 47(5): 40-45. DOI: 10.13272/j.issn.1671-251x.17775
    [9]ZHANG Nan, XIE Guojun, YE Qing, ZHAO Xiaohu. Automatic semantic annotation method for mine Semantic Web of things[J]. Journal of Mine Automation, 2020, 46(3): 27-33. DOI: 10.13272/j.issn.1671-251x.17512
    [10]XU Yu-ming, LI Chun-guang, ZHANG Jian-bing. Research of Segmentation Algorithm of Network Set for PCB Fault Detectio[J]. Journal of Mine Automation, 2008, 34(4): 87-90.
  • Cited by

    Periodical cited type(2)

    1. 张若楠,徐平安,周小雨,赵琦琦. 基于堆叠式LSTM的采煤工作面瓦斯浓度预测方法. 陕西煤炭. 2024(09): 91-94 .
    2. 刘江斌,任建超,刘茂福,赵燚,白荣财,高卫卫,肖琪. 基于智能算法的煤矿瓦斯浓度随钻预测模型对比研究. 工业仪表与自动化装置. 2024(06): 109-113 .

    Other cited types(2)

Catalog

    Article Metrics

    Article views (427) PDF downloads (65) Cited by(4)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return