Volume 50 Issue 6
Jun.  2024
Turn off MathJax
Article Contents
LYU Donghan, HU Eryi, HUANG Yipo, et al. Research on multivariate abnormal image detection in coal mine transportation system[J]. Journal of Mine Automation,2024,50(6):70-78.  doi: 10.13272/j.issn.1671-251x.2024050001
Citation: LYU Donghan, HU Eryi, HUANG Yipo, et al. Research on multivariate abnormal image detection in coal mine transportation system[J]. Journal of Mine Automation,2024,50(6):70-78.  doi: 10.13272/j.issn.1671-251x.2024050001

Research on multivariate abnormal image detection in coal mine transportation system

doi: 10.13272/j.issn.1671-251x.2024050001
  • Received Date: 2024-05-03
  • Rev Recd Date: 2024-06-22
  • Available Online: 2024-07-10
  • There are various types and scenarios of abnormal risks in coal mine transportation systems. The occurrence of abnormal accidents at coal mine sites is accidental, and the number of abnormal samples obtained is much smaller than that of normal samples, resulting in an imbalance of positive and negative samples. In order to solve the above problems, a multivariate abnormal image detection method for coal mine transportation systems based on hypersphere reconstructed data description (HRDD) is proposed. On the basis of full convolutional data description (FCDD), an image reconstruction auxiliary task is introduced. The mean square error loss function is selected as the objective function of the image reconstruction auxiliary task. Abnormal image detection and positioning are quantified as an inequality constrained optimization problem. The seamless fusion technology is used to fuse auxiliary datasets and abnormal samples into normal samples, in order to reduce the difference between abnormal fusion samples and normal samples, expand the total number of abnormal samples, and balance the proportion of abnormal and normal samples. Through multiple sets of noise simulation experiments and on-site experiments, it has been proven that adding Gaussian noise to the resistance zone with a certain probability for enhanced training can improve the noise resistance efficiency, generalization capability, detection accuracy, and other aspects of the HRDD model. The results of the ablation experiment show that the auxiliary dataset effectively improves the problem of sample imbalance, with an accuracy increase of 36.5%. The introduction of image reconstruction auxiliary tasks can ensure that deep features can be accurately mapped to abnormal positions, resulting in an IoU improvement of 33.4%. There is a strong coupling effect between the auxiliary dataset and the image reconstruction auxiliary task. The combination of the two can further stimulate the performance potential of the HRDD algorithm. The addition of seamless fusion samples and Gaussian noise enhancement has to some extent improved the generalization capability of the HRDD model. The comparative experimental results show that the accuracy and IoU of the HRDD algorithm are better than other mainstream algorithms. Compared with the FCDD algorithm, the accuracy and IoU of the HRDD algorithm have increased by 4.6% and 7.0% respectively, making it more suitable for coal mine sites.

     

  • loading
  • [1]
    毛清华,郭文瑾,翟姣,等. 煤矿带式输送机异常状态视频AI识别技术研究[J]. 工矿自动化,2023,49(9):36-46.

    MAO Qinghua,GUO Wenjin,ZHAI Jiao,et al. Research on video AI recognition technology for abnormal state of coal mine belt conveyors[J]. Journal of Mine Automation,2023,49(9):36-46.
    [2]
    DAI Lili,ZHANG Xu,GARDONI P,et al. A new machine vision detection method for identifying and screening out various large foreign objects on coal belt conveyor lines[J]. Complex & Intelligent Systems,2023,9(5):5221-5234.
    [3]
    MAO Qinghua,LI Shikun,HU Xin,et al. Coal mine belt conveyor foreign objects recognition method of improved YOLOv5 algorithm with defogging and deblurring[J]. Energies,2022,15(24). DOI:10. 3390/en15249504.
    [4]
    郝帅,张旭,马旭,等. 基于CBAM−YOLOv5的煤矿输送带异物检测[J]. 煤炭学报,2022,47(11):4147-4156.

    HAO Shuai,ZHANG Xu,MA Xu,et al. Foreign object detection in coal mine conveyor belt based on CBAM-YOLOv5[J]. Journal of China Coal Society,2022,47(11):4147-4156.
    [5]
    HAO Bonan,ZHANG Liya,PENG Ran. An improved vibe algorithm to detect personnel underground in coal mines[J]. Journal of Physics:Conference Series,2021,2025(1). DOI: 10.1088/1742-6596/2025/1/012032.
    [6]
    刘浩,刘海滨,孙宇,等. 煤矿井下员工不安全行为智能识别系统[J]. 煤炭学报,2021,46(增刊2):1159-1169.

    LIU Hao,LIU Haibin,SUN Yu,et al. Intelligent recognition system of unsafe behavior of underground coal miners[J]. Journal of China Coal Society,2021,46(S2):1159-1169.
    [7]
    KIM B,LEE J. A video-based fire detection using deep learning models[J]. Applied Sciences,2019,9(14). DOI: 10.3390/app9142862.
    [8]
    梁煜,陈童,张为. 融合自适应注意力的多尺度火灾检测算法[J]. 北京理工大学学报,2024,44(1):91-101.

    LIANG Yu,CHEN Tong,ZHANG Wei. Multi-scale fire detection algorithm with adaptive attention[J]. Transactions of Beijing Institute of Technology,2024,44(1):91-101.
    [9]
    LIZNERSKI P,RUFF L,VANDERMEULEN R A. Explainable deep one-class classification[EB/OL]. [2024-04-10]. https://arxiv.org/abs/2007.01760.
    [10]
    来杰,王晓丹,向前,等. 自编码器及其应用综述[J]. 通信学报,2021,42(9):218-230. doi: 10.11959/j.issn.1000-436x.2021160

    LAI Jie,WANG Xiaodan,XIANG Qian,et al. Review on autoencoder and its application[J]. Journal on Communications,2021,42(9):218-230. doi: 10.11959/j.issn.1000-436x.2021160
    [11]
    殷晓航,王永才,李德英. 基于U-Net结构改进的医学影像分割技术综述[J]. 软件学报,2021,32(2):519-550.

    YIN Xiaohang,WANG Yongcai,LI Deying. Suvery of medical image segmentation technology based on U-net structure improvement[J]. Journal of Software,2021,32(2):519-550.
    [12]
    刘英,何雪,李单阳,等. 注意力引导全尺度连接网络的高分辨率影像变化检测[J]. 遥感学报,2024,28(4):1052-1065.

    LIU Ying,HE Xue,LI Danyang,et al. CBAM UNet+++:attention mechanism to guide change detection studies of full-scale connected networks[J]. National Remote Sensing Bulletin,2024,28(4):1052-1065.
    [13]
    WOO S H,PARK J Y,LEE J Y,et al. CBAM:convolutional block attention module[C]. European Conference on Computer Vision,Munich,2018:3-19.
    [14]
    RUFF L,VANDERMEULEN R A,FRANKS B J,et al. Rethinking assumptions in deep anomaly detection[EB/OL]. [2024-04-10]. https://arxiv.org/abs/2006.00339v3.
    [15]
    傅新元,郭禾,王宇新,等. 基于抠像技术的图像无缝融合算法[J]. 中国图象图形学报,2008,13(6):1082-1089. doi: 10.11834/jig.20080609

    FU Xinyuan,GUO He,WANG Yuxin,et al. Seamless cloning algorithm based on image matting technique[J]. Journal of Image and Graphics,2008,13(6):1082-1089. doi: 10.11834/jig.20080609
    [16]
    邵延华,张铎,楚红雨,等. 基于深度学习的YOLO目标检测综述[J]. 电子与信息学报,2022,44(10):3697-3708. doi: 10.11999/JEIT210790

    SHAO Yanhua,ZHANG Duo,CHU Hongyu,et al. A review of YOLO object detection based on deep learning[J]. Journal of Electronics & Information Technology,2022,44(10):3697-3708. doi: 10.11999/JEIT210790
    [17]
    BERGMANN P,FAUSER M,SATTLEGGER D,et al. MVTec AD-a comprehensive real-world dataset for unsupervised anomaly detection[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Long Beach,2019:9584-9592.
    [18]
    吕承侃,沈飞,张正涛,等. 图像异常检测研究现状综述[J]. 自动化学报,2022,48(6):1402-1428.

    LYU Chengkan,SHEN Fei,ZHANG Zhengtao,et al. Review of image anomaly detection[J]. Acta Automatica Sinica,2022,48(6):1402-1428.
    [19]
    LI Dan,CHEN Dacheng,GOH J,et al. Anomaly detection with generative adversarial networks for multivariate time series[EB/OL]. [2024-04-10]. https://arxiv.org/abs/1809.04758.
    [20]
    VENKATARAMANAN S,PENG Kuanchuan,SINGH R V,et al. Attention guided anomaly localization in images[EB/OL]. [2024-04-10]. https://arxiv.org/abs/1911.08616.
    [21]
    DEFARD T,SETKOV A,LOESCH A,et al. PaDiM:a patch distribution modeling framework for anomaly detection and localization[EB/OL]. [2024-04-10]. https://arxiv.org/abs/2011.08785.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(12)  / Tables(6)

    Article Metrics

    Article views (79) PDF downloads(11) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return