基于直线段检测和LT描述符的矿井图像线特征匹配算法

A line feature matching algorithm for mine images based on line segment detection and LT descriptors

  • 摘要: 图像匹配是同步定位与地图构建(SLAM)技术中极为重要的一环,用于根据图像之间的变换关系确定相机位姿。基于线特征的图像匹配方法具有较强的鲁棒性和抗噪能力,更加适用于井下图像匹配,基于深度学习的线描述符对线段遮挡等场景具有较高的鲁棒性,性能优于传统描述符,但卷积神经网络架构的描述符将可变长度线段抽象为固定维进行描述,不利于线段长度及视差变化较大图像的匹配。针对上述问题,提出一种基于直线段检测和线描述符的矿井图像线特征匹配算法。在频域利用单参数同态滤波降低图像的照射分量,并增强反射分量,提升亮度及对比度;在YUV空间利用对比度受限的自适应直方图均衡化(CLAHE)算法对亮度分量进行均衡,使亮度分布更加均匀;变换至RGB空间提取直线段检测(LSD)线,引入一种基于Transformer架构的LT描述符构建LSD线的特征向量,最后完成线特征匹配。实验结果表明:该算法结合了同态滤波和CLAHE算法的优点,增强后图像的亮度适中,对比度良好,灰度分布均匀,增强效果优于单参数同态滤波算法、EnlightenGAN算法;该算法提取的线特征数较原图平均提升了32.92%,在不同相似纹理占比、不同程度旋转与平移变化的井下图像匹配中鲁棒性好,平均正确匹配数为61.75对,平均精度为86.83%,优于线二进制描述符(LBD)算法、LBD_NNDR算法、LT算法,能够满足矿井图像稳健匹配的需求。

     

    Abstract: Image matching is an extremely important part of simultaneous localization and mapping (SLAM) technology. It is used to determine camera position and posture based on the transformation relationship between images. The image matching method based on line features has strong robustness and noise resistance, making it more suitable for underground image matching. The line descriptors based on deep learning have high robustness to scenes such as line segment occlusion, and their performance is better than traditional descriptors. However, the descriptors of convolutional neural network architecture abstract variable length line segments into fixed dimensions for description, which is not conducive to matching images with large changes in line segment length and parallax. In order to solve the above problems, a line feature matching algorithm for mine images based on line segment detection and line transformers (LT) is proposed. The algorithm uses single parameter homomorphic filtering in the frequency domain to reduce the lighting component of the image, enhance the reflection component, and improve brightness and contrast. The algorithm uses contrast limited adaptive histogram equalization (CLAHE) algorithm in YUV space to balance brightness components and make brightness distribution more even. The algorithm transforms to RGB space to extract line segment detection (LSD) lines. A LT descriptor based on Transformer architecture is introduced to construct the feature vector of LSD lines, and finally complete line feature matching. The experimental results show that the algorithm combines the advantages of homomorphic filtering and CLAHE algorithm. After image enhancement, the brightness of the image is moderate, the contrast is good, the grayscale distribution is even. The enhancement effect is better than the single parameter homomorphic filtering algorithm and EnlightenGAN algorithm. The number of line features extracted by this algorithm has increased by an average of 32.92% compared to the original image. It has good robustness in matching underground images with different proportions of similar textures, varying degrees of rotation and translation changes. The average correct matching number is 61.75 pairs, with an average precision of 86.83%. It is superior to the line binary descriptor (LBD) algorithm, LBD_NNDR algorithm, and LT algorithm. It can meet the requirements of robust matching of mine images.

     

/

返回文章
返回