Volume 49 Issue 3
Mar.  2023
Turn off MathJax
Article Contents
Abstract
References
Related Articles
ZHANG Lei, RAN Lingbo, DAI Wanwan, et al. Behavior recognition method for underground personnel based on fusion network[J]. Journal of Mine Automation，2023，49(3)：45-52. DOI: 10.13272/j.issn.1671-251x.2022120015
Citation: ZHANG Lei, RAN Lingbo, DAI Wanwan, et al. Behavior recognition method for underground personnel based on fusion network[J]. Journal of Mine Automation，2023，49(3)：45-52. DOI: 10.13272/j.issn.1671-251x.2022120015
shu

Behavior recognition method for underground personnel based on fusion network

  • 1.

    School of Information Engineering (School of Big Data), Xuzhou University of Technology, Xuzhou 221018, China

  • 2.

    IoT Perception Mine Research Center, China University of Mining and Technology, Xuzhou 221008, China

  • 3.

    National Mobile Communications Research Laboratory, Southeast University, Nanjing 210096, China

  • 4.

    Information Center, Shandong Energy Zibo Mining Group Co., Ltd., Zibo 225100, China

More Information
  • Received Date: December 05, 2022
  • Revised Date: March 08, 2023
  • Available Online: March 26, 2023
    Graphical Abstract
    • Abstract
  • Underground personnel behavior recognition is an important measure to ensure safe production in coal mines. The existing research on behavior recognition of underground personnel lacks research and analysis on the perception mechanism, and the feature extraction method is simple. In order to solve the above problems, a behavior recognition method for underground personnel based on fusion networks is proposed. The method mainly includes three parts: data preprocessing, feature construction, and recognition network construction. Data preprocessing: the collected channel status information (CSI) data is processed through CSI quotient models, subcarrier denoising, and discrete wavelet denoising to reduce the impact of environmental noise and equipment noise. Feature construction: the processed data is transformed into images using the Gramian angular summation/difference fields (GASF/GADF) to preserve the spatial and temporal features of the data. Recognition network construction: according to the features of personnel actions, a fusion network composed of a gate recurrent unit (GRU) based encoding and decoding network and a multiscale convolutional neural network (CNN) is proposed. GRU is used to preserve the correlation between pre and post data. The weight allocation strategy of the attention mechanism is used to effectively extract key features to improve the accuracy of behavior recognition. The experimental results show that the average recognition accuracy of this method for eight movements, namely walking, taking off a hat, throwing things, sitting, smoking, waving, running, and sleeping, is 97.37%. The recognition accuracy for sleeping and sitting is the highest, and the most prone to misjudgment are walking and running. Using accuracy, precision, recall, and F1 score as evaluation indicators, it is concluded that the performance of the fusion network is superior to CNN and GRU. The accuracy of personnel behavior recognition is higher than the HAR system, WiWave system and Wi-Sense system. The average recognition accuracy of walking and taking off a hat at normal speed is 95.6%, which is higher than 93.6% for fast motion and 92.7% for slow motion. When the distance between transceiver devices is 2 m and 2.5 m, the recognition accuracy is higher.
    • FullText(HTML)
    • References (22)
  • [1]
    陶志勇,郭京,刘影. 基于多天线判决的CSI高效人体行为识别方法[J]. 计算机科学与探索,2021,15(6):1122-1132. DOI: 10.3778/j.issn.1673-9418.2005021

    TAO Zhiyong,GUO Jing,LIU Ying. Efficient human behavior recognition method of CSI based on multi-antenna judgment[J]. Journal of Frontiers of Computer Science and Technology,2021,15(6):1122-1132. DOI: 10.3778/j.issn.1673-9418.2005021
    [2]
    GU Yu,WANG Yantong,WANG Meng,et al. Secure user authentication leveraging keystroke dynamics via Wi-Fi sensing[J]. IEEE Transactions on Industrial Informatics,2022,18(4):2784-2795. DOI: 10.1109/TII.2021.3108850
    [3]
    GORRINI A,MESSA F,CECCARELLI G,et al. Covid-19 pandemic and activity patterns in Milan. Wi-Fi sensors and location-based data[J]. TeMA-Journal of Land Use,Mobility and Environment,2021,14(2):211-226.
    [4]
    CHEN Liangqin,TIAN Liping,XU Zhimeng,et al. A survey of WiFi sensing techniques with channel state information[J]. ZTE Communications,2020,18(3):57-63.
    [5]
    MA Yongsen,ZHOU Gang,WANG Shuangquan. WiFi sensing with channel state information:a survey[J]. ACM Computing Surveys,2019,52(3):1-36.
    [6]
    FANG Yuanrun,XIAO Fu,SHENG Biyun,et al. Cross-scene passive human activity recognition using commodity WiFi[J]. Frontiers of Computer Science,2022,16:1-11.
    [7]
    ZHANG Lei,ZHANG Yue,BAO Rong,et al. A novel WiFi-based personnel behavior sensing with a deep learning method[J]. IEEE Access,2022,10:120136-120145. DOI: 10.1109/ACCESS.2022.3222381
    [8]
    魏忠诚,张新秋,连彬,等. 基于Wi-Fi信号的身份识别技术研究[J]. 物联网学报,2021,5(4):107-119. DOI: 10.11959/j.issn.2096-3750.2021.00213

    WEI Zhongcheng,ZHANG Xinqiu,LIAN Bin,et al. A survey on Wi-Fi signal based identification technology[J]. Chinese Journal on Internet of Things,2021,5(4):107-119. DOI: 10.11959/j.issn.2096-3750.2021.00213
    [9]
    WANG Yan, LIU Jian, CHEN Yingying, et al. E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures[C]. Proceedings of the 20th Annual International Conference on Mobile Computing and Networking, 2014: 617-628.
    [10]
    YAN Huan,ZHANG Yong,WANG Yujie. WiAct:a passive WiFi-based human activity recognition system[J]. IEEE Sensors Journal,2019,20(1):296-305.
    [11]
    熊小樵,冯秀芳,丁一. 基于CSI的手势识别方法研究[J]. 计算机应用与软件,2022,39(1):181-187. DOI: 10.3969/j.issn.1000-386x.2022.01.027

    XIONG Xiaoqiao,FENG Xiufang,DING Yi. Research on hand gesture recognition method based on CSI[J]. Computer Applications and Software,2022,39(1):181-187. DOI: 10.3969/j.issn.1000-386x.2022.01.027
    [12]
    ATITALLAH B B, ABBASI M B, BARIOUL R, et al. Simultaneous pressure sensors monitoring system for hand gestures recognition[C]. 2020 IEEE Sensors, Rotterdam, 2020: 1-4.
    [13]
    CHU Xianzhi, LIU Jiang, SHIMAMOTO S. A sensor-based hand gesture recognition system for Japanese sign language[C]. 2021 IEEE 3rd Global Conference on Life Sciences and Technologies（LifeTech）, Nara, 2021: 311-312.
    [14]
    YIN Kang, TANG Chengpei, ZHANG Xie, et al. Robust human activity recognition system with Wi-Fi using handcraft feature[C]. 2021 IEEE Symposium on Computers and Communications, Athens, 2021: 1-8.
    [15]
    YU Bohan,WANG Yuxiang,NIU Kai,et al. WiFi-sleep:sleep stage monitoring using commodity Wi-Fi devices[J]. IEEE Internet of Things Journal,2021,8(18):13900-13913. DOI: 10.1109/JIOT.2021.3068798
    [16]
    SOLIKHIN M,PRATAMA Y,PASARIBU P,et al. Analisis watermarking menggunakan metode discrete cosine transform (DCT) dan discrete fourier transform (DFT)[J]. Jurnal Sistem Cerdas,2022,5(3):155-170.
    [17]
    RAJASHEKHAR U,NEELAPPA D,RAJESH L. Electroencephalogram (EEG) signal classification for brain-computer interface using discrete wavelet transform (DWT)[J]. International Journal of Intelligent Unmanned Systems,2022,10(1):86-97. DOI: 10.1108/IJIUS-09-2020-0057
    [18]
    CAN C, KAYA Y, KILIÇ F. A deep convolutional neural network model for hand gesture recognition in 2D near-infrared images[J]. Biomedical Physics & Engineering Express, 2021, 7（5）. DOI: 10.1088/2057-1976/ac0d91.
    [19]
    YU L, LI J, WANG T, et al. T2I-Net: time series classification via deep sequence-to-image transformation networks[C]. 2022 IEEE International Conference on Networking, Sensing and Control, Shanghai, 2022: 1-5.
    [20]
    MOGHADDAM M G, SHIREHJINI A A N, SHIRMOHAMMADI S. A WiFi-based system for recognizing fine-grained multiple-subject human activities[C]. 2022 IEEE International Instrumentation and Measurement Technology Conference, Ottawa, 2022: 1-6.
    [21]
    MEI Y, JIANG T, DING X, et al. WiWave: WiFi-based human activity recognition using the wavelet integrated CNN[C]. 2021 IEEE/CIC International Conference on Communications in China, Xiamen, 2021: 100-105.
    [22]
    MUAAZ M,CHELLI A,GERDES M W,et al. Wi-Sense:a passive human activity recognition system using Wi-Fi and convolutional neural network and its integration in health information systems[J]. Annals of Telecommunications,2022,77(3):163-175.
    • Related Articles

  • Related Articles

    [1]LI Zhihang. Application of convolutional networks in 5G network performance testing of open pit mines[J]. Journal of Mine Automation, 2024, 50(S2): 99-104.
    [2]JIA Pengtao, ZHANG Jie, GUO Fengjing. Coal spontaneous combustion temperature prediction model for goaf area based on GAT-Informer[J]. Journal of Mine Automation, 2024, 50(11): 92-98, 108. DOI: 10.13272/j.issn.1671-251x.2024080022
    [3]QI Ailing, WANG Yu, MA Hongwei. Prediction of height adjustment of shearer drum based on improved gated recurrent neural network[J]. Journal of Mine Automation, 2024, 50(2): 116-123. DOI: 10.13272/j.issn.1671-251x.2023110039
    [4]QIN Jiaxin, GE Shuwei, LONG Fengqi, ZHANG Yongqian, LI Xue. Spatiotemporal distribution prediction of gas concentration based on GCN-GRU[J]. Journal of Mine Automation, 2023, 49(5): 82-89, 111. DOI: 10.13272/j.issn.1671-251x.2022060105
    [5]SHI Zhiyuan, TENG Hu, MA Chi. Fault diagnosis of planetary gearbox based on multi-information fusion and convolutional neural network[J]. Journal of Mine Automation, 2022, 48(9): 56-62. DOI: 10.13272/j.issn.1671-251x.2022060011
    [6]LI Jincai, FU Wenlong, WANG Renming, CHEN Xing, MENG Jiaxin. Intelligent fault diagnosis of rolling bearings based on deep network[J]. Journal of Mine Automation, 2022, 48(4): 78-88. DOI: 10.13272/j.issn.1671-251x.2022010008
    [7]ZHANG Jianrang, LIU Ruiqing, LI Xuewen, WANG Zhipeng, SHI Zhendong. Distributed real time prediction model of shearer operating state data[J]. Journal of Mine Automation, 2021, 47(7): 21-28. DOI: 10.13272/j.issn.1671-251x.2020110032
    [8]LI Jingzhao, MENG Yifan, WANG Jiwei. Multi-level safety situation awareness system for mines[J]. Journal of Mine Automation, 2020, 46(12): 1-6. DOI: 10.13272/j.issn.1671-251x.17672
    [9]TANG Shiyu, ZHU Aichun, ZHANG Sai, CAO Qingfeng, CUI Ran, HUA Gang. Target detection of underground personnel based on deep convolutional neural network[J]. Journal of Mine Automation, 2018, 44(11): 32-36. DOI: 10.13272/j.issn.1671—251x.2018050068
    [10]DU Yun, ZHANG Lulu, PAN Tao. Miners' facial expression recognition method based on convolutional neural network[J]. Journal of Mine Automation, 2018, 44(5): 95-99. DOI: 10.13272/j.issn.1671-251x.17312

  • Cited by

    Periodical cited type(5)

    1. 刘宇超，高妍，张红娟. 矿用带式输送机多目标参数协同优化控制储能方法. 煤炭技术. 2024(04): 246-249 .
    2. 方同辉，周航，陈永浦，尹可强，邓海顺. 矿用电动单轨吊动力电池监控系统的研究. 煤矿机电. 2024(01): 15-19 .
    3. 魏翠萍. 基于粒子群算法的燃煤发电系统储能容量估计方法. 工业加热. 2023(02): 32-36 .
    4. 程清伟，姜立标. 锂离子动力电池荷电状态监测仿真. 计算机仿真. 2022(08): 64-67+77 .
    5. 陈继永，吴兆宏，李金喜. 基于容量增量法的防爆锂电池老化指标分析. 工矿自动化. 2019(12): 29-34 . 本站查看

    Other cited types(4)

Catalog

    Get Citation
    PDF
    XML

    Article Metrics

    Article views (228) PDF downloads (65) Cited by(9)
    Related

    苏ICP备 05016349号-2

    Supported by: Beijing Renhe Information Technology Co., Ltd. Visits：1172110    Baidu Analytics

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return