基于低光照增强的红外和可见光图像融合的井下人员识别

Underground personnel recognition based on low-light enhancement of infrared and visible light image fusion

  • 摘要: 井下环境存在低光照,人员特征不明显。现有的基于深度学习的红外与可见光图像融合方法在弱光条件下,只使用红外信息来填补可见光图像光照退化造成的场景缺陷,导致在黑暗环境下可见光图像中丰富的场景信息无法在融合图像中表达出来;将图像增强和图像融合作为单独的任务来处理,导致融合结果较差。针对上述问题,提出了一种基于低光照增强的红外和可见光图像融合的井下人员识别模型。首先,将可见光和红外传感器图像进行灰度化、几何校正等预处理操作,然后,将处理后的图像传入低光照增强网络,在特征层面去除退化可见光图像的照度分量,最后,经过纹理−对比度增强网络实现特征级融合,从纹理和对比度等方面增强了整体的视觉感知。实验结果表明,所提模型的井下人员识别结果相比较可见光图像,准确率平均提高了8.2%,召回率提高了12.5%,mAP@0.5提高了8.3%;相比红外图像,准确率平均提高了2.1%,召回率提高了5.1%,mAP@0.5提高了4.1%;检测速度达31.2帧/s,解决了井下低光照场景下人员特征不明显所导致的错检、漏检等问题。

     

    Abstract: In underground environments, there is low light, and personnel features are not clearly visible. Existing infrared and visible light image fusion methods based on deep learning use only infrared information to fill in the scene defects caused by the light degradation of visible images under weak lighting conditions. As a result, rich scene information from visible images is lost in the fused image in dark environments. Moreover, treating image enhancement and image fusion as separate tasks leads to poor fusion results. To address the above issues, a model for underground personnel recognition based on low-light enhancement of infrared and visible light image fusion was proposed. First, the visible and infrared sensor images underwent preprocessing steps such as grayscaling and geometric correction. Then, the processed images were passed into a low-light enhancement network, which removed the illumination component from the degraded visible light images at the feature level. Finally, texture-contrast enhancement networks performed feature-level fusion, enhancing overall visual perception in terms of texture and contrast. Experimental results showed that the proposed model improved underground personnel recognition results compared to the visible light modality, with an average accuracy increase of 8.2%, recall rate increase of 12.5%, and mAP@0.5 increase of 8.3%. Compared to the infrared modality, accuracy increased by an average of 2.1%, recall rate increased by 5.1%, and mAP@0.5 increased by 4.1%. Meanwhile, the detection speed reached 31.2 frames/s, solving problems such as misdetection and missed detection caused by unclear personnel features in low-light underground scenarios.

     

/

返回文章
返回