LI Menggang, HU Eryi, ZHU Hua. LiDAR/IMU tightly-coupled SLAM method for coal mine mobile robot[J]. Journal of Mine Automation,2022,48(12):68-78. DOI: 10.13272/j.issn.1671-251x.2022100061
Citation: LI Menggang, HU Eryi, ZHU Hua. LiDAR/IMU tightly-coupled SLAM method for coal mine mobile robot[J]. Journal of Mine Automation,2022,48(12):68-78. DOI: 10.13272/j.issn.1671-251x.2022100061

LiDAR/IMU tightly-coupled SLAM method for coal mine mobile robot

More Information
  • Received Date: October 18, 2022
  • Revised Date: December 08, 2022
  • Available Online: November 30, 2022
  • SLAM (Simultaneous Localization and Mapping) of the underground robot is a hot research topic at present. But the research on improving the precision and robustness of laser SLAM in underground complicated conditions is still insufficient. The traditional laser SLAM method has the problems of rapidly increasing cumulative error, poor robustness of the rotation process and high error rate of feature correlation under complex underground environment. The existing laser inertial fusion location mapping tightly-coupled fusion mechanism still needs to further improve the adaptability to the complex environment in coal mines. In order to solve the above problems, a LiDAR (lidar)/IMU (inertial measurement unit) tightly-coupled SLAM (LI-SLAM) method for coal mine robot is proposed. Firstly, the IMU observation information is used to predict the point cloud motion state and make effective compensation to reduce the point cloud distortion caused by severe vibration, rapid rotation and other severe motion conditions. Secondly, the edge and plane features of the radar point cloud are extracted. The laser relative pose constraints are constructed based on point line and point surface scanning matching. In vector space and manifold space, the construction process of residual, Jacobian matrix and covariance matrix of constraints is derived analytically. Finally, the LiDAR/IMU tight coupling is completed based on the factor graph optimization method by constructing the radar relative pose constraint factor, IMU pre-integration constraint factor and loopback detection constraint factor. The localization and map construction of the mine mobile robot in the complex underground environment is realized. In order to verify the precision and robustness of the LI-SLAM method in the bumpy road and complex scenario, experiments are carried out in the field and underground garage environment based on the platform of wheeled mobile robot in the coal mine. The industrial experiments are carried out in Tashan Coal Mine of Jinneng Group. The results are compared with the current optimal LiDAR odometry and mapping (LOAM) method, lidar-inertial state estimator (LINS) method and lidar inertial odometry and mapping (LIO-mapping) method. The test results in field bumpy road show the following points. The map consistency of the LI-SLAM method and the LOAM method is the best, which is basically consistent with the real route. The LI-SLAM method has better adaptability to rotation, and the distance error is the minimum. The LIO-mapping method cannot run in real time. The method can obtain complete trajectory at 0.5 times. However, in the initial motion phase, there is a large degree of direction deviation, and the initialization process is easy to fail. Because LINS only uses the latest observation information, it drifts under complex terrain. The test results in underground garage environment show the following points. Compared with the LOAM method, LINS method and LIO-mapping method, the LI-SLAM method has higher modeling precision. The local refinement is higher, and the motion trajectory is smoother. The industrial test results in underground coal mines show the following points. The LI-SLAM method can operate stably and online in various terrain environments. The result meets the requirements of robustness and real-time. When the straight-line distance of the roadway where the coal mine mobile robot drives on is 273 m, 30 groups of distance results are analyzed, and the average error is less than 15 cm. It has high positioning and modeling precision. It basically meets the positioning and modeling precision requirements of coal mine mobile robots. It has better applicability for precise positioning and mapping of mobile robot in the complex environment of the coal mine.
  • [1]
    葛世荣,胡而已,裴文良. 煤矿机器人体系及关键技术[J]. 煤炭学报,2020,45(1):455-463. DOI: 10.13225/j.cnki.jccs.YG19.1478

    GE Shirong,HU Eryi,PEI Wenliang. Classification system and key technology of coal mine robot[J]. Journal of China Coal Society,2020,45(1):455-463. DOI: 10.13225/j.cnki.jccs.YG19.1478
    [2]
    BOSSE M,ZLOT R,FLICK P. Zebedee:design of a spring-mounted 3-D range sensor with application to mobile mapping[J]. IEEE Transaction on Robot,2012,28(5):1104-1119. DOI: 10.1109/TRO.2012.2200990
    [3]
    HUBER D F, VANDAPEL N. Automatic 3D underground mine mapping[C]. Proceedings of Field and Service Robotics, Berlin, 2003: 497-506.
    [4]
    THRUN S,THAYER S,WHITTAKER W,et al. Autonomous exploration and mapping of abandoned mines[J]. IEEE Robotics & Automation Magazine,2004,11(4):79-91.
    [5]
    ZLOT R,BOSSE M. Efficient large-scale three-dimensional mobile mapping for underground mines[J]. Journal of Field Robotics,2014,31(5):758-779. DOI: 10.1002/rob.21504
    [6]
    TARDIOLI D,RIAZUELO L,SICIGNANO D,et al. Ground robotics in tunnels:keys and lessons learned after 10 years of research and experiments[J]. Journal of Field Robotics,2019,36(6):1074-1101. DOI: 10.1002/rob.21871
    [7]
    KASPER M, MCGUIRE S, HECKMAN C. A benchmark for visual-inertial odometry systems employing onboard illumination[C]. IEEE/RSJ International Conference on Intelligent Robots and Systems(IROS), Macau, 2019: 5256-5263.
    [8]
    EBADI K, CHANGE Y, PALIERI M, et al. LAMP: large-scale autonomous mapping and positioning for exploration of perceptually-degraded subterranean environments[C]. IEEE International Conference on Robotics and Automation (ICRA), Paris, 2020: 80-86.
    [9]
    WISTH D,CAMURRI M,DAS S,et al. Unified multi-modal landmark tracking for tightly coupled lidar-visual-inertial odometry[J]. IEEE Robotics and Automation Letters,2021,6(2):1004-1011. DOI: 10.1109/LRA.2021.3056380
    [10]
    马宏伟,王岩,杨林. 煤矿井下移动机器人深度视觉自主导航研究[J]. 煤炭学报,2020,45(6):2193-2206. DOI: 10.13225/j.cnki.jccs.zn20.0214

    MA Hongwei,WANG Yan,YANG Lin. Research on depth vision based mobile robot autonomous navigation in underground coal mine[J]. Journal of China Coal Society,2020,45(6):2193-2206. DOI: 10.13225/j.cnki.jccs.zn20.0214
    [11]
    陈先中,刘荣杰,张森,等. 煤矿地下毫米波雷达点云成像与环境地图导航研究进展[J]. 煤炭学报,2020,45(6):2182-2192. DOI: 10.13225/j.cnki.jccs.zn20.0316

    CHEN Xianzhong,LIU Rongjie,ZHANG Sen,et al. Development of millimeter wave radar imaging and SLAM in underground coal mine environment[J]. Journal of China Coal Society,2020,45(6):2182-2192. DOI: 10.13225/j.cnki.jccs.zn20.0316
    [12]
    杨健健,张强,吴淼,等. 巷道智能化掘进的自主感知及调控技术研究进展[J]. 煤炭学报,2020,45(6):2045-2055. DOI: 10.13225/j.cnki.jccs.zn20.0287

    YANG Jianjian,ZHANG Qiang,WU Miao,et al. Research progress of autonomous perception and control technology for intelligent heading[J]. Journal of China Coal Society,2020,45(6):2045-2055. DOI: 10.13225/j.cnki.jccs.zn20.0287
    [13]
    LI Menggang,ZHU Hua,YOU Shaoze,et al. Efficient laser-based 3D SLAM for coal mine rescue robots[J]. IEEE Access,2019(7):14124-14138.
    [14]
    高士岗,高登彦,欧阳一博,等. 中薄煤层智能开采技术及其装备[J]. 煤炭学报,2020,45(6):1997-2007. DOI: 10.13225/j.cnki.jccs.zn20.0246

    GAO Shigang,GAO Dengyan,OUYANG Yibo,et al. Intelligent mining technology and its equipment for medium thickness thin seam[J]. Journal of China Coal Society,2020,45(6):1997-2007. DOI: 10.13225/j.cnki.jccs.zn20.0246
    [15]
    POMERLEAU F,COLAS F,SIEGWART R. A review of point cloud registration algorithms for mobile robotics[J]. Foundations and Trends in Robotics,2015,5(4-1):1-104.
    [16]
    NÜCHTER A,LINGEMANN K,HERTZBERG J,et al. 6D SLAM—3D mapping outdoor environments[J]. Journal of Field Robotics,2007,24(8/9):699-722.
    [17]
    ZHANG Ji, SINGH S. LOAM: lidar odometry and mapping in real-time[C]. Robotics: Science and Systems Conference, California, 2014. DOI: 10.15607/RSS.2014. X.007.
    [18]
    SHAN Tixiao, ENGLOT B. LeGO-LOAM: lightweight and ground-optimized lidar odometry and mapping on variable terrain[C]. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, 2018: 4758-4765.
    [19]
    WEINGARTEN J, SIEGWART R. 3D SLAM using planar segments[C]. IEEE/RSJ International Conference on Intelligent Robots and Systems(IROS), Beijing, 2006: 3062-3067.
    [20]
    TREVOR A J B, ROGERS J G, CHRISTENSEN H I. Planar surface SLAM with 3D and 2D sensors[C]. IEEE International Conference on Robotics and Automation(ICRA), Saint Paul, 2012: 3041-3048.
    [21]
    YE Haoyang, CHEN Yuying, LIU Ming. Tightly coupled 3D lidar inertial odometry and mapping[C]. IEEE International Conference on Robotics and Automation (ICRA), Montreal, 2019: 3144-3150.
    [22]
    SHAN Tixiao, ENGLOT B, MEYERS D, et al. LIO-SAM: Tightly-coupled lidar inertial odometry via smoothing and mapping[C]. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, 2020: 5135-5142.
    [23]
    QIN Chao, YE Haoyang, PRANATA C E, et al. LINS: a lidar-inertial state estimator for robust and efficient navigation[C]. IEEE International Conference on Robotics and Automation (ICRA), Paris, 2020: 8899-8906.
    [24]
    XU Wei,ZHANG Fu. Fast-LIO:a fast,robust lidar-inertial odometry package by tightly-coupled iterated Kalman filter[J]. IEEE Robotics and Automation Letters,2021,6(2):3317-3324. DOI: 10.1109/LRA.2021.3064227
    [25]
    杨林,马宏伟,王岩. 煤矿井下移动机器人基于激光惯性的融合 SLAM 算法[J]. 煤炭学报,2022,47(9):3523-3534.

    YANG Lin,MA Hongwei,WANG Yan. LiDAR-Inertial SLAM for mobile robot in underground coal mine[J]. Journal of China Coal Society,2022,47(9):3523-3534.
    [26]
    QIN Tong,LI Peiliang,SHEN Shaojie. Vins-mono:a robust and versatile monocular visual-inertial state estimator[J]. IEEE Transactions on Robotics,2018,34(4):1004-1020. DOI: 10.1109/TRO.2018.2853729
    [27]
    朱华,由韶泽. 新型煤矿救援机器人研发与试验[J]. 煤炭学报,2020,45(6):2170-2181. DOI: 10.13225/j.cnki.jccs.zn20.0352

    ZHU Hua,YOU Shaoze. Research and experiment of a new type of coal mine rescue robot[J]. Journal of China Coal Society,2020,45(6):2170-2181. DOI: 10.13225/j.cnki.jccs.zn20.0352
  • Related Articles

    [1]ZHU Longji, WU Zhonglan, ZHENG Changlu. Research on parallel interleaved DC/DC converter applied to mine electric locomotive[J]. Journal of Mine Automation, 2019, 45(6): 63-68. DOI: 10.13272/j.issn.1671-251x.2019010089
    [2]FANG Xupeng, MA Bolong, DONG Zhaolong, GUO Jiuhong, GAO Guanzhong. A quasi-Z-source boost DC-DC converter[J]. Journal of Mine Automation, 2017, 43(4): 68-71. DOI: 10.13272/j.issn.1671-251x.2017.04.016
    [3]FANG Xupeng, ZHUANG Jianwei, LI Hui. A novel bidirectional DC-DC converter[J]. Journal of Mine Automation, 2016, 42(9): 52-56. DOI: 10.13272/j.issn.1671-251x.2016.09.012
    [4]ZHANG Yong, XU Ruidong, LI Tao, XU Shanyu, WANG Long. Research of bifurcation phenomenon of DC-DC bidirectional power converter with constant power loads[J]. Journal of Mine Automation, 2016, 42(2): 61-66. DOI: 10.13272/j.issn.1671-251x.2016.02.016
    [5]YANG Xiaokang, LI Hequn, GAO Qiaomei, CHENG Hong. Research of single phase-shift close-loop control for bi-directional full-bridge DC-DC converter[J]. Journal of Mine Automation, 2014, 40(4): 63-67. DOI: 10.13272/j.issn.1671-251x.2014.04.015
    [6]LU Sheng-li, JU Wen-yao, JIA Zhong-lu. Research of waveform control strategy for dual-stage power conversion system[J]. Journal of Mine Automation, 2013, 39(10): 63-67. DOI: 10.7526/j.issn.1671-251X.2013.10.017
    [7]DANG Cun-lu, ZHAO Peng-lin, DONG Rui-hong. Improvement of space vector modulation strategy of two-stage matrix converter[J]. Journal of Mine Automation, 2013, 39(6): 56-61.
    [8]XUE Ya-ling, JIANG Shu-yan, Xin Yi-bo, WU Xi. Research of Mine-used Intelligent Charging System Based on DC/DC Parallel Technology[J]. Journal of Mine Automation, 2008, 34(5): 69-72.
    [9]ZHENG Zheng, TAO Hai-ju. Analysis of Harmonics in Rectification Circuit and Correction of Single-stage Power Factor[J]. Journal of Mine Automation, 2005, 31(5): 9-11.
    [10]CHEN Er-kui, TAN De-jian, MA Fang-qing. DCS Control of the Cement Grinding System[J]. Journal of Mine Automation, 2002, 28(2): 4-7.

Catalog

    Article Metrics

    Article views (482) PDF downloads (82) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return