QI Yuhao, GUAN Shiyuan. Real-time 3D mapping method of fully mechanized working face based on laser SLAM[J]. Journal of Mine Automation,2022,48(11):139-144. DOI: 10.13272/j.issn.1671-251x.2022060047
Citation: QI Yuhao, GUAN Shiyuan. Real-time 3D mapping method of fully mechanized working face based on laser SLAM[J]. Journal of Mine Automation,2022,48(11):139-144. DOI: 10.13272/j.issn.1671-251x.2022060047

Real-time 3D mapping method of fully mechanized working face based on laser SLAM

More Information
  • Received Date: June 12, 2022
  • Revised Date: November 01, 2022
  • Available Online: August 29, 2022
  • The mobile mapping method relies on fiber optic inertial navigation with high precision and odometer to calculate the position and attitude. But in the actual engineering practice, the precision of odometer is difficult to meet the application requirements, resulting in incomplete 3D laser point cloud of working face. In order to solve this problem, a real-time 3D mapping method of fully mechanized working face based on laser SLAM is proposed. The method mainly comprises the steps of distortion removal of laser point cloud, feature extraction , position and attitude estimation and optimization mapping. The distortion of laser point cloud is eliminated through the inertial navigation data. The inertial navigation data is retrieved according to the time stamp of each point in the point cloud to obtain the attitude angle corresponding to each point. If the corresponding attitude angle is not retrieved, the quaternion method is adopted for interpolation. The geometric tensor feature of the point cloud is extracted by principal component analysis. Firstly, the covariance matrix of the point set is solved. Secondly, the eigenvalue decomposition is performed to obtain the geometric tensor feature. The distance between the feature points in two adjacent frames is calculated to construct an objective function. The Levenberg-Marquardt algorithm is used to solve the objective function and obtain the transformation matrix, so as to realize position and attitude estimation. The incremental optimization algorithm is adopted. The GTSAM optimization library is used for carrying out joint optimization on the historical keyframe and the current keyframe. All obtained keyframe point clouds are superposed together to obtain the global 3D real-time map. The results of the underground industrial test show that this method can construct the 3D map of the whole working face in real-time, completely and accurately. The maximum mean absolute error is 0.19 m, which meets the precision requirements of monitoring of fully mechanized working face and straightening of the scraper conveyor.
  • [1]
    李森,王峰,刘帅,等. 综采工作面巡检机器人关键技术研究[J]. 煤炭科学技术,2020,48(7):218-225. DOI: 10.13199/j.cnki.cst.2020.07.022

    LI Sen,WANG Feng,LIU Shuai,et al. Study on key technology of patrol robots for fully-mechanized mining face[J]. Coal Science and Technology,2020,48(7):218-225. DOI: 10.13199/j.cnki.cst.2020.07.022
    [2]
    王国法,范京道,徐亚军,等. 煤炭智能化开采关键技术创新进展与展望[J]. 工矿自动化,2018,44(2):5-12. DOI: 10.13272/j.issn.1671-251x.17307

    WANG Guofa,FAN Jingdao,XU Yajun,et al. Innovation progress and prospect on key technologies of intelligent coal mining[J]. Industry and Mine Automation,2018,44(2):5-12. DOI: 10.13272/j.issn.1671-251x.17307
    [3]
    李首滨,李森,张守祥,等. 综采工作面智能感知与智能控制关键技术与应用[J]. 煤炭科学技术,2021,49(4):28-39. DOI: 10.13199/j.cnki.cst.2021.04.004

    LI Shoubin,LI Sen,ZHANG Shouxiang,et al. Key technology and application of intelligent perception and intelligent control in fully mechanized mining face[J]. Coal Science and Technology,2021,49(4):28-39. DOI: 10.13199/j.cnki.cst.2021.04.004
    [4]
    黄曾华,王峰,张守祥. 智能化采煤系统架构及关键技术研究[J]. 煤炭学报,2020,45(6):1959-1972. DOI: 10.13225/j.cnki.jccs.zn20.0348

    HUANG Zenghua,WANG Feng,ZHANG Shouxiang. Research on the architecture and key technologies of intelligent coal mining system[J]. Journal of China Coal Society,2020,45(6):1959-1972. DOI: 10.13225/j.cnki.jccs.zn20.0348
    [5]
    王海军,刘再斌,雷晓荣,等. 煤矿巷道三维激光扫描关键技术及工程实践[J]. 煤田地质与勘探,2022,50(1):109-117. DOI: 10.12363/issn.1001-1986.21.10.0589

    WANG Haijun,LIU Zaibin,LEI Xiaorong,et al. Key technologies and engineering practice of 3D laser scanning in coal mine roadways[J]. Coal Geology & Exploration,2022,50(1):109-117. DOI: 10.12363/issn.1001-1986.21.10.0589
    [6]
    李首滨. 煤炭智能化无人开采的现状与展望[J]. 中国煤炭,2019,45(4):5-12. DOI: 10.3969/j.issn.1006-530X.2019.04.001

    LI Shoubin. Present situation and prospect on intelligent unmanned mining at work face[J]. China Coal,2019,45(4):5-12. DOI: 10.3969/j.issn.1006-530X.2019.04.001
    [7]
    CADENA C,CARLONE L,CARRILLO H,et al. Past,present,and future of simultaneous localization and mapping:toward the robust-perception age[J]. IEEE Transactions on Robotics,2016,32(6):1309-1332. DOI: 10.1109/TRO.2016.2624754
    [8]
    BOSSE M,ZLOT R,FLICK P. Zebedee:design of a spring-mounted 3-D range sensor with application to mobile mapping[J]. IEEE Transactions on Robotics,2012,28(5):1104-1119. DOI: 10.1109/TRO.2012.2200990
    [9]
    BOSSE M, ZLOT R. Continuous 3D scan-matching with a spinning 2D laser[C]. IEEE International Conference on Robotics and Automation, Kobe, 2009: 4312-4319.
    [10]
    PALIERI M,MORRELL B,THAKUR A,et al. LOCUS:a multi-sensor lidar-centric solution for high-precision odometry and 3D mapping in real-time[J]. IEEE Robotics and Automation Letters,2021,6(2):421-428. DOI: 10.1109/LRA.2020.3044864
    [11]
    KAESS M,RANGANATHAN A,DELLAERT F. iSAM:incremental smoothing and mapping[J]. IEEE Transactions on Robotics,2008,24(6):1365-1378. DOI: 10.1109/TRO.2008.2006706
    [12]
    HACKEL T,WEGNER J D,SCHINDLER K. Fast semantic segmentation of 3d point clouds with strongly varying density[J]. ISPRS Annals of the Photogrammetry,Remote Sensing and Spatial Information Sciences,2016,3:177-184.
    [13]
    CAI Zhipeng,CHIN T-J,BUSTOS A P,et al. Practical optimal registration of terrestrial LiDAR scan pairs[J]. ISPRS Journal of Photogrammetry and Remote Sensing,2019,147:118-131. DOI: 10.1016/j.isprsjprs.2018.11.016
    [14]
    SEGAL A V, HAEHNEL D, THRUN S. Generalized-ICP[EB/OL]. [2022-05-10]. https://www.robots.ox.ac.uk/~avsegal/resources/papers/Generalized_ICP.pdf.
    [15]
    RAMEZANI M, KHOSOUSSI K, CATT G, et al. Wildcat: online continuous-time 3D lidar-inertial SLAM[EB/OL]. [2022-05-10]. https://arxiv.org/abs/2205.12595.
    [16]
    GIAMMARINO L D, ALOISE I, STACHNISS C, et al. Visual place recognition using LiDAR intensity information[EB/OL]. [2022-05-10]. https://arxiv.org/abs/2103.09605.
    [17]
    MORDOHAI P, MEDIONI G. Tensor voting: a perceptual organization approach to computer vision and machine learning[M]. Cham: Springer, 2006.
    [18]
    PAN Yue, XIAO Pengchuan, HE Yujie, et al. MULLS: versatile LiDAR SLAM via multi-metric linear least square[C]. IEEE International Conference on Robotics and Automation, Xi'an, 2021.
    [19]
    KANATANI K. 3D rotations: parameter computation and lie algebra-based optimization[M]. Boca Raton: CRC Press, 2020.
    [20]
    HUBER P J, RONCHETTI E M. Robust statistics[M]. 2nd Edition. New York: Wiley, 2009.
    [21]
    GLADUNOVA O P,RODIONOV E D,SLAVSKII V V. Harmonic tensors on three-dimensional Lie groups with left-invariant Lorentz metric[J]. Doklady Mathematics,2009,80:755-758. DOI: 10.1134/S1064562409050329
    [22]
    OHTSUKA T,FUJII H A. Real-time optimization algorithm for nonlinear receding-horizon control[J]. Automatica,1997,33(6):1147-1154. DOI: 10.1016/S0005-1098(97)00005-8
    [23]
    KHOSOUSSI K, SUKHATME G S, HUANG S, et al. Designing sparse reliable pose-graph SLAM: a graph-theoretic approach[M]//GOLDBERG K, ABBEEL P, BEKRIS K, et al. Algorithmic foundations of robotics XII. Cham: Springer, 2020: 17-32.
  • Related Articles

    [1]WANG Dongxue, LI Xiaochuan, WEI Tao, HU Haibin, XIANG Wu. Design of on-line monitoring system for self-excited deduster[J]. Journal of Mine Automation, 2017, 43(10): 7-13. DOI: 10.13272/j.issn.1671-251x.2017.10.002
    [2]ZHAO Yang. Research status and expectation of on-line monitoring technologies of mechanical characteristics of high-voltage vacuum circuit breaker[J]. Journal of Mine Automation, 2016, 42(12): 19-24. DOI: 10.13272/j.issn.1671-251x.2016.12.005
    [3]LI Baolin, WANG Enyuan, LI Nan, GAO Qinqiong, ZHOU Ming. Characteristic analysis of acoustic emission monitoring signal in coal seam hydraulic fracturing[J]. Journal of Mine Automation, 2015, 41(8): 38-42. DOI: 10.13272/j.issn.1671-251x.2015.08.010
    [4]ZHANG Yang, LI Zhan-jin, LI Shi-bo, ZHANG Yan-bo, FU Zhen. Application of acoustic emission technology in monitoring of underground pressure[J]. Journal of Mine Automation, 2013, 39(6): 10-12.
    [5]WANG Ai-ming, WU Jing-hong, MENG Guo-ying, PANG Zheng-duo, DUAN Peng-fei. Development of On-line Monitoring System of Fault of Scraper Conveyor’s Chai[J]. Journal of Mine Automation, 2010, 36(5): 91-93.
    [6]QI Jian-wei, SONG Jian-cheng. Research of On-line Monitoring System for Temperature of High-voltage Cable Joint of Mine[J]. Journal of Mine Automation, 2009, 35(12): 32-34.
    [7]QIN Hai-peng, TONG Min-ming. Design of Intelligent Monitor of Water Inrush from Coal Floor Based on Acoustic Emission Characteristic of Moisture Coal-rock[J]. Journal of Mine Automation, 2009, 35(12): 1-4.
    [8]ZHU Qian-wei~, SUN Xiao-jin~, WANG Cong-xiao~, ZHU Guo-yuan~1WANG Xue-ming~, YUE Yao-bin~, . Design of On-line Monitoring System of VRLA Battery[J]. Journal of Mine Automation, 2009, 35(8): 12-14.
    [9]NIU Hui-juan, HU Ya-fei, XIONG Jian-jun, CHENG Xiao-feng. Design of On-line Monitoring Laboratory Equipment of Air Dense-medium Fluidized Bed[J]. Journal of Mine Automation, 2009, 35(2): 39-42.
    [10]WANG Yong, SONG Ai-shan, JIANG Shu-guang, WU Zheng-yan. Application of EDA9033 in On-line Monitoring System of Ventilator Performance[J]. Journal of Mine Automation, 2004, 30(1): 26-28.
  • Cited by

    Periodical cited type(1)

    1. 王忠宾,李福涛,司垒,魏东,戴嘉良,张森. 采煤机自适应截割技术研究进展及发展趋势. 煤炭科学技术. 2025(01): 296-311 .

    Other cited types(0)

Catalog

    Article Metrics

    Article views (308) PDF downloads (66) Cited by(1)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return