CAO Zhengyuan, JIANG Wei, FANG Chenghui. Intelligent detection method for coal flow foreign objects based on dual attention generative adversarial network[J]. Journal of Mine Automation,2023,49(12):56-62. DOI: 10.13272/j.issn.1671-251x.18094
Citation: CAO Zhengyuan, JIANG Wei, FANG Chenghui. Intelligent detection method for coal flow foreign objects based on dual attention generative adversarial network[J]. Journal of Mine Automation,2023,49(12):56-62. DOI: 10.13272/j.issn.1671-251x.18094

Intelligent detection method for coal flow foreign objects based on dual attention generative adversarial network

More Information
  • Received Date: March 26, 2023
  • Revised Date: December 17, 2023
  • Available Online: January 02, 2024
  • Foreign objects mixed in during coal mining may cause accidents such as blockage or even tearing of conveyor belt connections. Most existing machine learning algorithms for coal flow foreign objects use supervised learning to automatically recoginze item categories. However, in real industrial and mining scenarios, the scarcity of abnormal samples leads to problems of serious imbalanced sample distribution and significant features lost in the modeling dataset. In order to solve the above problems, a coal flow foreign object intelligent detection method based on dual-attention Skip-GANomaly (DA-GANomaly) is proposed. This method adopts a semi supervised learning approach, which only requires normal samples to complete the training of the foreign object detection model, effectively solving the problems of low recognition accuracy and poor robustness caused by imbalanced sample distribution. On the basis of Skip-GANomaly, a dual attention mechanism is introduced to enhance the information exchange between the encoder and decoder and suppress irrelevant features and noise. It highlights the interesting features that are conducive to distinguishing abnormal samples, and further improves the accuracy of model classification. The experimental results show that the classification accuracy of the DA-GANomaly model is 79.5%, the recall rate is 83.2%, and the area under the precision recall curve (AUPRC) is 85.1%. Compared with 5 classic anomaly detection models such as AnoGAN, the DA-GANomaly model has the best overall performance.

  • [1]
    程德强,徐进洋,寇旗旗,等. 融合残差信息轻量级网络的运煤皮带异物分类[J]. 煤炭学报,2022,47(3):1361-1369.

    CHENG Deqiang,XU Jinyang,KOU Qiqi,et al. Lightweight network based on residual information for foreign body classification on coal conveyor belt[J]. Journal of China Coal Society,2022,47(3):1361-1369.
    [2]
    孟晓娟,张月琴,郝晓丽,等. 多分类深度卷积生成对抗网络的皮带撕裂检测[J]. 计算机工程与应用,2021,57(16):269-275.

    MENG Xiaojuan,ZHANG Yueqin,HAO Xiaoli,et al. Multi-class deep convolutional generative adversarial networks for belt tear detection[J]. Computer Engineering and Applications,2021,57(16):269-275.
    [3]
    RONG Dian,XIE Lijuan,YING Yibin. Computer vision detection of foreign objects in walnuts using deep learning[J]. Computers and Electronics in Agriculture,2019,162:1001-1010. DOI: 10.1016/j.compag.2019.05.019
    [4]
    王卫东,张康辉,吕子奇,等. 基于深度学习的煤中异物机器视觉检测[J]. 矿业科学学报,2021,6(1):115-123.

    WANG Weidong,ZHANG Kanghui,LYU Ziqi,et al. Machine vision detection of foreign objects in coal using deep learning[J]. Journal of Mining Science and Technology,2021,6(1):115-123.
    [5]
    王超,郝博南,张立亚,等. 基于RetinaNet的煤矿井下输送带异物检测技术[J]. 煤矿机械,2022,43(12):180-183.

    WANG Chao,HAO Bonan,ZHANG Liya,et al. Conveyor belt foreign object detection technology based on RetinaNet in underground coal mine[J]. Coal Mine Machinery,2022,43(12):180-183.
    [6]
    王燕,郭潇樯,刘新华. 带式输送机大块异物视觉检测系统设计[J]. 机械科学与技术,2021,40(12):1939-1943.

    WANG Yan,GUO Xiaoqiang,LIU Xinhua. Design of visual detection system for large foreign body in belt conveyor[J]. Mechanical Science and Technology for Aerospace Engineering,2021,40(12):1939-1943.
    [7]
    薛旭升,杨星云,齐广浩,等. 煤矿带式输送机分拣机器人异物识别与定位系统设计[J]. 工矿自动化,2022,48(12):33-41. DOI: 10.13272/j.issn.1671-251x.2022100024

    XUE Xusheng,YANG Xingyun,QI Guanghao,et al. Design of foreign object recognition and positioning system for sorting robot of coal mine belt conveyor[J]. Journal of Mine Automation,2022,48(12):33-41. DOI: 10.13272/j.issn.1671-251x.2022100024
    [8]
    郝帅,张旭,马旭,等. 基于CBAM−YOLOv5的煤矿输送带异物检测[J]. 煤炭学报,2022,47(11):4147-4156.

    HAO Shuai,ZHANG Xu,MA Xu,et al. Foreign object detection in coal mine conveyor belt based on CBAM-YOLOv5[J]. Journal of China Coal Society,2022,47(11):4147-4156.
    [9]
    武红鑫,韩萌,陈志强,等. 监督和半监督学习下的多标签分类综述[J]. 计算机科学,2022,49(8):12-25.

    WU Hongxin,HAN Meng,CHEN Zhiqiang,et al. Survey of multi-label classification based on supervised and semi-supervised learning[J]. Computer Science,2022,49(8):12-25.
    [10]
    SCHLEGL T,SEEBÖCK P,WALDSTEIN S M,et al. Unsupervised anomaly detection with generative adversarial networks to guide marker discovery[C].25th International Conference on Information Processing in Medical Imaging,Boone,2017:146-157.
    [11]
    AKCAY S,ATAPOUR-ABARGHOUEI A,BRECKON T P. GANomaly:semi-supervised anomaly detection via adversarial training[C].14th Asian Conference on Computer Vision,Perth,2018:622-637.
    [12]
    AKÇAY S,ATAPOUR-ABARGHOUEI A,BRECKON T P. Skip-GANomaly:skip connected and adversarially trained encoder-decoder anomaly detection[C].International Joint Conference on Neural Networks,Budapest,2019:1-8.
    [13]
    RONNEBERGER O,FISCHER P,BROX T. U-net:convolutional networks for biomedical image segmentation[C].18th International Conference on Medical Image Computing and Computer-Assisted Intervention,Munich,2015:234-241.
    [14]
    杜京义,陈瑞,郝乐,等. 煤矿带式输送机异物检测[J]. 工矿自动化,2021,47(8):77-83.

    DU Jingyi,CHEN Rui,HAO Le,et al. Coal mine belt conveyor foreign object detection[J]. Industry and Mine Automation,2021,47(8):77-83.
    [15]
    王涛. 机器视觉技术在煤矿胶带运输系统中的应用[J]. 能源科技,2021,19(2):34-40.

    WANG Tao. Application of the machine vision technology in the belt conveyor system for coal mines[J]. Energy Science and Technology,2021,19(2):34-40.
    [16]
    GUO Menghao,XU Tianxing,LIU Jiangjiang,et al. Attention mechanisms in computer vision:a survey[J]. Computational Visual Media,2022(3):331-368.
    [17]
    RAMACHANDRAN P,PARMAR N,VASWANI A,et al. Stand-alone self-attention in vision models[EB/OL]. [2023-03-22]. https://arxiv.org/abs/1906.05909.
    [18]
    FU Jun,LIU Jing,TIAN Haijie,et al. Dual attention network for scene segmentation[C].IEEE/CVF Conference on Computer Vision and Pattern Recognition,Salt Lake City,2019:3146-3154.
    [19]
    ZOU Liang,YU Xinhui,LI Ming,et al. Nondestructive identification of coal and gangue via near-infrared spectroscopy based on improved broad learning[J]. IEEE Transactions on Instrumentation and Measurement,2020,69(10):8043-8052.
    [20]
    ZENATI H,FOO C S,LECOUAT B,et al. Efficient GAN-based anomaly detection[EB/OL]. [2023-03-22]. https://arxiv.org/abs/1802.06222v1.
    [21]
    ZENATI H,ROMAIN M,FOO C S,et al. Adversarially learned anomaly detection[C].IEEE International Conference on Data Mining,Singapore,2018:727-736.
  • Related Articles

    [1]ZHANG Zhaoxi, ZHANG Hongle, HUANG Yanfa, CHEN Xingxiang, JIA Haicheng, YUAN Pengsheng. Fault line selection method for resonant grounding systems based on DTW-Hilbert and improved K-means[J]. Journal of Mine Automation, 2024, 50(11): 169-178. DOI: 10.13272/j.issn.1671-251x.2024090076
    [2]WANG Min, WU Bing, WANG Juan. Reliability analysis of braking system of hoister considering relevance[J]. Journal of Mine Automation, 2017, 43(4): 41-45. DOI: 10.13272/j.issn.1671-251x.2017.04.010
    [3]ZONG Weilin, XU Wenqiang, YUAN Yalei, DAI Jingwei, PI Jie, SONG Tianbao. A new type of single-phase grounding fault line selection and location method for mine distribution network[J]. Journal of Mine Automation, 2016, 42(11): 45-50. DOI: 10.13272/j.issn.1671-251x.2016.11.011
    [4]SUN Qidong, ZHANG Kairu, SONG Xiangmin, LI Liming, MA Hui, WANG Yi. Research of single-phase fault line selection of power distribution network based on fifth harmonics energy and LM-Elman neural network[J]. Journal of Mine Automation, 2016, 42(8): 61-64. DOI: 10.13272/j.issn.1671-251x.2016.08.015
    [5]MA Caoyuan, LUO Yanfang, LI Chunxiao, CUI Lianhua. Fault line selection method based on local global consistency learning algorithm[J]. Journal of Mine Automation, 2015, 41(10): 32-36. DOI: 10.13272/j.issn.1671-251x.2015.10.009
    [6]WANG Qing-liang, DU Hui, ZHAO Yi-jie, LI Lu, ZHONG Ming-sheng. Line selection method with transient state based on intrinsic mode energy[J]. Journal of Mine Automation, 2013, 39(9): 92-95. DOI: 10.7526/j.issn.1671-251X.2013.09.024
    [7]ZHENG Chen, WANG Xiao-wei, LIU Ya-juan, TIAN Shu. A novel fault line selection method based on empirical mode decomposition and differential spectrum[J]. Journal of Mine Automation, 2013, 39(2): 75-79.
    [8]TIAN Shu, HE Jin-peng, NIE He. Research of Fault Line Selection Method of Distribution Network Based on Transient Zero-sequence Energy[J]. Journal of Mine Automation, 2012, 38(1): 51-54.
    [9]LI Hui, TANG Yi, SUN Chang-qing. Simulation Analysis of Single-phase Grounding Fault of Resonant Grounding System[J]. Journal of Mine Automation, 2012, 38(1): 47-51.
    [10]CHEN Fang-jing, CHEN Zhong-ren, GUI Cun-bing. Research of Fault Line Selection in Small Current Grounding System Based on Wavelet Packets and Energy Analysis[J]. Journal of Mine Automation, 2009, 35(2): 27-31.
  • Cited by

    Periodical cited type(3)

    1. 郭鹏,谢逢选,孙培申,高彦平,卢志兴,李阳. 码头管沟可燃气体有毒气体检测装置的研制与应用. 钻采工艺. 2024(03): 140-146 .
    2. 鲁旭臣,李爽,刘佳鑫,毕海涛,郎业兴,王雅楠,丁五行. 采用热释电原理检测SF_6气体中CO体积分数的方法与应用. 高压电器. 2024(09): 197-205 .
    3. 许伟健,张德胜,黄增波. 基于双波长光电感烟的煤矿火灾烟雾监测技术. 煤矿安全. 2023(12): 204-212 .

    Other cited types(0)

Catalog

    Article Metrics

    Article views (159) PDF downloads (24) Cited by(3)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return