ZOU Xiaoyu, HUANG Xinmiao, WANG Zhongbin, et al. 3D map construction of coal mine roadway mobile robot based on integrated factor graph optimization[J]. Journal of Mine Automation,2022,48(12):57-67, 92. DOI: 10.13272/j.issn.1671-251x.2022100041
Citation: ZOU Xiaoyu, HUANG Xinmiao, WANG Zhongbin, et al. 3D map construction of coal mine roadway mobile robot based on integrated factor graph optimization[J]. Journal of Mine Automation,2022,48(12):57-67, 92. DOI: 10.13272/j.issn.1671-251x.2022100041

3D map construction of coal mine roadway mobile robot based on integrated factor graph optimization

More Information
  • Received Date: October 16, 2022
  • Revised Date: December 09, 2022
  • Available Online: December 06, 2022
  • The working precision of mobile robots in coal mines seriously depends on the accuracy of simultaneous localization and mapping (SLAM) technology. There are some problems such as feature missing and poor lighting conditions in long and straight underground roadway. The problems lead to the failure of the laser odometer and visual odometer. The result limits the effective application of traditional SLAM method in coal mine roadway. At present, the research of the SLAM method mainly focuses on the multi-sensor fusion mapping method. There is a lack of research on the improvement of the mapping precision of the laser SLAM method. In order to solve the above problems, facing the mapping requirements of mobile robot in coal mine roadway, a 3D map construction method of coal mine roadway mobile robot based on integrated factor graph optimization is proposed. The method adopts the strategy of front-end construction and back-end optimization. The method designs a front-end point cloud registration module and a back-end construction method based on filtering and graph optimization. Therefore, the mapping result is more accurate and adaptable. The environmental degradation in coal mine long and straight roadway leads to the low registration precision of 3D laser point cloud. In order to solve the above problem, integrating iterative closest point (ICP) and normal-distributions transform (NDT) algorithms, taking into account the geometric characteristics and probability distribution characteristics of point clouds, an integrated front-end point cloud registration module is designed, which realizes the accurate registration of point clouds. Inview of the back-end optimization problem of 3D laser SLAM, the back-end construction method based on pose map and factor map optimization is studied. The factor map optimization model integrating ICP and NDT relative pose factors is constructed to accurately estimate the pose of the mobile robot. The performance of the proposed method of 3D map construction under different working conditions is verified by using the open dataset KITTI and the simulated roadway point cloud dataset. The experimental results on the open dataset KITTI show the following points. In terms of global consistency, this method has similar performance with the traditional A-LOAM method based on feature point matching and the LeGO-LOAM method based on plane segmentation and feature point extraction. It is superior to the other two methods in the local precision of mapping. The experimental results on the simulated roadway point cloud dataset show the following points. This method has significant advantages, through factor map optimization, a 3D map with high consistency can be obtained. The precision and robustness of 3D map construction of coal mine roadway are improved. The problems of the feature point missing and laser odometer failure in long straight underground roadway are solved.
  • [1]
    杨林,马宏伟,王岩,等. 煤矿巡检机器人同步定位与 地图构建方法研究[J]. 工矿自动化,2019,45(9):18-24.

    YANG Lin,MA Hongwei,WANG Yan,et al. Research on method of simultaneous localization and mapping of coal mine inspection robot[J]. Industry and Mine Automation,2019,45(9):18-24.
    [2]
    孙继平,江嬴. 矿井车辆无人驾驶关键技术研究[J]. 工矿自动化,2022,48(5):1-5,31. DOI: 10.13272/j.issn.1671-251x.17947

    SUN Jiping,JIANG Ying. Research on key technologies of mine unmanned vehicle[J]. Journal of Mine Automation,2022,48(5):1-5,31. DOI: 10.13272/j.issn.1671-251x.17947
    [3]
    潘祥生,陈晓晶. 矿用智能巡检机器人关键技术研究[J]. 工矿自动化,2020,46(10):43-48. DOI: 10.13272/j.issn.1671-251x.2020080042

    PAN Xiangsheng,CHEN Xiaojing. Research on key technologies of mine-used intelligent inspection robot[J]. Industry and Mine Automation,2020,46(10):43-48. DOI: 10.13272/j.issn.1671-251x.2020080042
    [4]
    周治国,曹江微,邸顺帆. 3D 激光雷达 SLAM 算法综述[J]. 仪器仪表学报,2021,42(9):13-27.

    ZHOU Zhiguo,CAO Jiangwei,DI Shunfan. Overview of 3D Lidar SLAM algorithms[J]. Chinese Journal of Scientific Instrument,2021,42(9):13-27.
    [5]
    ZHANG Ji, SINGH S. LOAM: lidar odometry and mapping in real-time[C]. Robotics: Science and Systems Conference, Berkeley, 2014. DOI: 10.15607/RSS. 2014.X.007.
    [6]
    HESS W, KOHLER D, RAPP H, et al. Real-time loop closure in 2D LIDAR SLAM[C]. IEEE International Conference on Robotics and Automation (ICRA) , Stockholm, 2016: 1271-1278.
    [7]
    SHAN Tixiao, ENGLOT B. LeGO-LOAM: lightweight and ground-optimized lidar odometry and mapping on variable terrain[C]. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, 2018: 4758-4765.
    [8]
    SHAN Tixiao, ENGLOT B, MEYERS D, et al. LIO-SAM: tightly-coupled lidar inertial odometry via smoothing and mapping[C]. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, 2020: 3106-3111.
    [9]
    BESL P J,MCKAY N D. A method for registration of 3D shapes[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(2):239-256. DOI: 10.1109/34.121791
    [10]
    LI Qingde ,GRIFFITHS J G. Iterative closest geometric objects registering[J]. Computers & Mathematics with Applications,2000,40(10/11):1171-1188.
    [11]
    CHEN Hui, BHANU B. Contour matching for 3D ear recognition[C]. 7th IEEE Workshop on Applications of Computer Vision, Breckenridge, 2005: 123-128.
    [12]
    HE Shijun, ZHAO Shiting, BAI Fan, et al. A method for spatial data registration based on PCA-ICP algorithm[C]. 3rd International Conference on Advanced Measurement and Test, Xiamen, 2013: 1063-1066.
    [13]
    BIBER P, STRASSER W. The normal distributions transform: a new approach to laser scan matching[C]. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, 2003: 2743-2748.
    [14]
    KOIDE K,MIURA J,MENEGATTI E. A portable three-dimensional LIDAR-based system for long-term and wide-area people behavior measurement[J]. International Journal of Advanced Robotic Systems,2019,16(2):1729-8806.
    [15]
    LI Menggang,ZHU Hua,YOU Shaoze,et al. Efficient laser-based 3D SLAM for coal mine rescue robots[J]. IEEE Access,2019,7:14124-14138. DOI: 10.1109/ACCESS.2018.2889304
    [16]
    XU Jiachang,HUANG Yourui,ZHAO Ruijuan,et al. Probabilistic membrane computing-based SLAM for patrol UAVs in coal mines[J]. Journal of Sensors,2021:1-11. DOI: 10.1155/2021/7610126.
    [17]
    王佳婧,王晓南,郑顺义,等. 三维点云初始配准方法的比较分析[J]. 测绘科学,2018,43(2):16-23. DOI: 10.16251/j.cnki.1009-2307.2018.02.004

    WANG Jiajing,WANG Xiaonan,ZHENG Shunyi,et al. Comparison and analysis of initial registration methods of 3D point cloud[J]. Science of Surveying and Mapping,2018,43(2):16-23. DOI: 10.16251/j.cnki.1009-2307.2018.02.004
    [18]
    李猛钢. 煤矿救援机器人导航系统研究[D]. 徐州: 中国矿业大学, 2017.

    LI Menggang. Research on navigation system of coal mine rescue robot [D]. Xuzhou: China University of Mining and Technology, 2017.
    [19]
    SCHULZ C, ZELL A. Real-time graph-based SLAM with occupancy normal distributions transforms [C]. IEEE International Conference on Robotics and Automation (ICRA), Paris, 2020: 3105-3111.
    [20]
    PARK C, MOGHADAM P, KIM S, et al. Elastic LiDAR fusion: dense map-centric continuous-time SLAM[C]. IEEE International Conference on Robotics and Automation (ICRA), Brisbane, 2018: 1-25.
    [21]
    QIN Chao, YE Haoyang, PRANATA C E, et al. LINS: a lidar-inertial state estimator for robust and efficient navigation[C]. IEEE International Conference on Robotics and Automation (ICRA), Paris, 2020: 8899-8906.
    [22]
    KSCHISCHANG F,FREY B,LOELIGER H. Factor graphs and the sum-product algorithm[J]. IEEE Transactions on Information Theory,2001,47(2):498-498. DOI: 10.1109/18.910572
    [23]
    KUMMERLE R, GRISETTI G, STRASDAT H, et al. G2o: a general framework for graph optimization[C]. IEEE International Conference on Robotics and Automation, Shanghai, 2011: 3607-3613.
    [24]
    KAESS M,DELLAERT F. iSAM:incremental smoothing and mapping[J]. IEEE Transactions on Robotics,2008,24(6):1365-1378.
    [25]
    KAESS M, JOHANNSSON H, ROBERTS R, et al. iSAM2: incremental smoothing and mapping with fluid relinearization and incremental variable reordering[C]. IEEE International Conference on Robotics and Automation, Shanghai, 2011. DOI: 10.1109/ICRA.2011.5979641.
    [26]
    DELLAERT F. Factor graphs and GTSAM: a hands-on introduction [EB/OL]. (2016-01-13) [2022-09-16]. https://www.docin.com/p-1444792601.html.
    [27]
    GEIGER A,LENZ P,STILLER C,et al. Vision meets robotics:the KITTI dataset[J]. The International Journal of Robotics Research,2013,32(11):1231-1237. DOI: 10.1177/0278364913491297
  • Related Articles

    [1]LI Yan, NAN Xinyuan, LIN Wanke. Risk prediction of coal and gas outburst[J]. Journal of Mine Automation, 2022, 48(3): 99-106. DOI: 10.13272/j.issn.1671-251x.2021070072
    [2]YU Liya, ZHAO Yongfang, ZHANG Lingyun, CHEN Guangbo. Coal and gas outburst risk evaluation based on cloud model and D -S theory[J]. Journal of Mine Automation, 2020, 46(11): 106-112. DOI: 10.13272/j.issn.1671 -251x.2020040029
    [3]WANG Xiaopeng. Prediction of gas emission rate on fully-mechanized caving face with layered mining of thick coal seam[J]. Journal of Mine Automation, 2020, 46(6): 72-75. DOI: 10.13272/j.issn.1671-251x.2019090079
    [4]LIU Shaofei, WANG Guofu, ZHANG Faquan, YE Jincai. Design of coal seam gas pressure monitoring system based on 6LoWPA[J]. Journal of Mine Automation, 2018, 44(7): 99-103. DOI: 10.13272/j.issn.1671-251x.2018010089
    [5]QU Shijia. Research of regression analysis of coal and gas outburst risk and gas emission characteristic value on mining face[J]. Journal of Mine Automation, 2015, 41(5): 74-77. DOI: 10.13272/j.issn.1671-251x.2015.05.018
    [6]SHEN Zhiwei, WANG Enyuan, NIU Yue. Prediction of coal and gas outburst based on catastrophe progression method[J]. Journal of Mine Automation, 2015, 41(5): 29-34. DOI: 10.13272/j.issn.1671-251x.2015.05.008
    [7]SUN Jiping. Alarm methods of coal and gas outburst[J]. Journal of Mine Automation, 2014, 40(11): 1-5. DOI: 10.13272/j.issn.1671-251x.2014.11.001
    [8]LI Tao. Research of Metering Technology of Pipeline Gas Flow of Coal Mine[J]. Journal of Mine Automation, 2012, 38(11): 14-17.
    [9]WANG Fa-kai, JIANG Cheng-lin, GONG Yan-wei, HUANG Xin-ye. Technology of Detecting Gas Pressure by Puncturing Multi-seam Based on M-Ⅱ Gas Pressure Detector and Casing Method[J]. Journal of Mine Automation, 2011, 37(3): 1-4.
    [10]LI Yong, LI Fu-ling. Development of Coal-seam Gas Pressure Monitor Based on ATmega64L[J]. Journal of Mine Automation, 2009, 35(1): 46-49.

Catalog

    Article Metrics

    Article views (372) PDF downloads (53) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return