面向无人驾驶的井下行人检测方法

Unmanned driving-oriented underground mine pedestrian detection method

  • 摘要: 行人检测是煤矿井下无人驾驶的关键技术,受煤矿井下光照不均匀、背景复杂、红外线干扰、光线昏暗和图像中目标小且密集等影响,现有方法检测井下行人时效果不理想。针对上述问题,提出了一种多传感器融合的井下行人检测方法。该方法通过分步多特征融合方式将可见光传感器、红外传感器和深度传感器采集的图像特征进行融合,获得了更加丰富的图像特征;在RetinaNet的基础上,将Dense连接加入到ResNet中,形成一种具有层级相连结构的Dense-ResNet,能够从多传感器融合结果中提取出深层图像特征,增强了对小目标的检测能力。实验结果表明,多传感融合图像相较于单一图像可获得更加丰富的目标特征,有利于提高目标检测精度;Dense-RetinaNet相较于RetinaNet在多目标和小目标检测精度上均有所提高。

     

    Abstract: Pedestrian detection is a key technology for unmanned driving in underground coal mine, which is affected by uneven illumination, complex background, infrared interference, dim light and small and dense targets in images, etc. The existing methods are not ideal for detecting pedestrians in underground mines. In order to solve the above problems, a multi-sensor fusion method for underground mine pedestrian detection is proposed. This method uses a step-by-step multi-characteristic fusion method to fuse the image characteristics collected by the visible light sensor, infrared sensor and depth sensor to obtain richer image characteristics. On the basis of RetinaNet, Dense connection is added to ResNet to form a Dense-ResNet with a hierarchical connected structure, which is able to extract the deep image characteristics from the multi-sensor fusion results and enhance the detection capability of small targets. The experimental results show that multi-sensor fusion images can obtain richer target characteristics compared with a single image, which is beneficial to improve the target detection accuracy. Compared with RetinaNet, Dense-RetinaNet can improve the accuracy of multi-target and small target detection.

     

/

返回文章
返回