A defogging algorithm for coal mine underground images based on dark channel guided filtering and lighting correction
-
摘要: 现有煤矿井下图像去雾方法在处理煤矿井下图像时未能在提取图像深层次特征信息的同时进行光照校正，处理后的图像存在细节信息丢失或图像偏暗的问题。提出一种基于暗通道引导滤波和光照校正的煤矿井下图像去雾算法。首先，井下原始图像通过图像分化模块（IDM）进行双边滤波、光照估计和暗原色处理后得到光照图、暗原色图和光照反射图。然后，对暗原色图进行预处理，作为权重引导参数对光照反射图进行引导滤波，以恢复图像细节特征信息。最后，将光照图作为权重参数对图像进行光照校正和特征提取，通过多次光照校正解决颜色失真问题，同时增加网络深度，进而去除黑暗区域的退化，实现图像细节的重构，从而得到清晰图像。主观评价结果表明：基于暗通道引导滤波和光照校正的煤矿井下图像去雾算法在去除雾气的同时，保留了更多的结构纹理及背景细节，使整个图像更加接近于对应的清晰图像。客观评价结果表明：与次优算法PMS−Net相比，在训练集和测试集上信息熵分别提高0.32和0.11，标准差分别提高3.58和1.89，平均梯度分别提高0.008和0.004，说明所提算法可有效降低煤矿井下图像的雾气。消融实验结果表明，所提算法在测试数据集上的信息熵、标准差、平均梯度均高于其他网络组成模型，说明所提算法去雾效果最好，且能有效保留图像细节和边缘信息。Abstract: The existing methods for defogging coal mine images fail to perform lighting correction while extracting deep level feature information, resulting in the loss of detail information or image darkening in the processed images. A defogging algorithm for coal mine underground images based on dark channel guided filtering and lighting correction is proposed. Firstly, the original underground images are subjected to bilateral filtering, lighting estimation, and dark primary color processing using the image differentiation module (IDM) to obtain lighting maps, dark primary color maps, and lighting reflection maps. Secondly, the method preprocesses the dark primary color map and uses it as a weight guidance parameter to guide the filtering of the lighting reflection map, in order to restore the image's detailed feature information. Finally, the lighting map is used as a weight parameter to perform lighting correction and feature extraction on the image. The color distortion problem is solved through multiple lighting corrections, while increasing the network depth to remove degradation in dark areas, achieving reconstruction of image details and obtaining clear images. The subjective evaluation results indicate that the coal mine underground image defogging algorithm based on dark channel guided filtering and lighting correction retains more structural textures and background details while removing fog. It makes the entire image closer to the corresponding clear image. The objective evaluation results show that compared with the suboptimal algorithm PMS-Net, the information entropy on the training and testing sets is increased by 0.32 and 0.11, the standard deviation is increased by 3.58 and 1.89, and the average gradient is increased by 0.008 and 0.004, respectively. This indicates that the proposed algorithm can effectively reduce the fog in coal mine underground images. The results of ablation experiments show that the proposed algorithm has higher information entropy, standard deviation, and average gradient on the test dataset than other network models. It indicates that the defogging effect is the best and it can effectively preserve image details and edge information.
-
图 6 不同算法单幅图像的处理速度对比
Figure 6. Comparison of processing speeds for single images using different algorithms
表 1 不同算法客观评价结果
Table 1. Objective evaluation results of different algorithms
算法 训练集 测试集 信息熵 标准差 平均梯度 信息熵 标准差 平均梯度 DCP 5.56 35.89 0.055 5.39 32.69 0.052 PMS−Net 7.55 54.76 0.124 7.32 52.86 0.120 CEEF 6.45 48.86 0.073 6.02 45.39 0.068 FFA 6.14 44.67 0.062 5.59 40.42 0.055 本文算法 7.87 58.34 0.132 7.43 54.75 0.124 
下载: 导出CSV
表 2 消融实验结果
Table 2. Results of ablation experiments
模型 信息熵 标准差 平均梯度 w/o IDM 4.23 40.74 0.063 w/o BFM 5.78 48.94 0.073 w/o LCM 5,27 45.86 0.078 完整网络 7.43 54.75 0.124
下载: 导出CSV
-
[1] MAO Qinghua,LI Shikun,HU Xin,et al. Coal mine belt conveyor foreign objects recognition method of improved YOLOv5 algorithm with defogging and deblurring[J]. Energies,2022,15(24). DOI: 10.3390/EN15249504. [2] ZHANG Xiaoyan,GUO Haitao. Research on an improved algorithm for image dehazing in underground coal mine[J]. Journal of Physics:Conference Series,2020,1693(1). DOI: 10.1088/1742-6596/1693/1/012153. [3] 苏畅,毕国玲,金龙旭,等. 基于暗通道图像质心偏移量的去雾算法[J]. 光学学报,2019,39(5):421-428.SU Chang,BI Guoling,JIN Longxu,et al. Dehazing algorithm based on dark-channel image centroid offset[J]. Acta Optica Sinica,2019,39(5):421-428. [4] HE Kaiming,SUN Jian,TANG Xiao'ou. Single image haze removal using dark channel prior[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(12):2341-2353. doi: 10.1109/TPAMI.2010.168 [5] HE Kaiming,SUN Jian,TANG Xiao'ou. Guided image filtering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(6):1397-1409. doi: 10.1109/TPAMI.2012.213 [6] 郭翰,徐晓婷,李博. 基于暗原色先验的图像去雾方法研究[J]. 光学学报,2018,38(4):113-122.GUO Han,XU Xiaoting,LI Bo. Study on image dehazing methods based on dark channel prior[J]. Acta Optica Sinica,2018,38(4):113-122. [7] MENG Gaofeng,WANG Ying,DUAN Jiangyong,et al. Efficient image dehazing with boundary constraint and contextual regularization[C]. IEEE International Conference on Computer Vision,Sydney,2013:617-624. [8] 张旭辉,麻兵,杨文娟,等. 煤矿井下非均匀照度图像去噪研究[J]. 工矿自动化,2024,50(2):1-8.ZHANG Xuhui,MA Bing,YANG Wenjuan,et al. Research on denoising of uneven lighting images in coal mine underground[J]. Journal of Mine Automation,2024,50(2):1-8. [9] 刘冬梅,常发亮. 基于非下采样轮廓小波变换增强的从粗到精的显著性检测[J]. 光学学报,2019,39(1):380-387.LIU Dongmei,CHANG Faliang. Coarse-to-fine saliency detection based on non-subsampled contourlet transform enhancement[J]. Acta Optica Sinica,2019,39(1):380-387. [10] ZHANG Shi,TANG Guijin,LIU Xiaohua,et al. Retinex based low light image enhancement using guided filtering and variational framework[J]. Optoelectronics Letters,2018,14(2):156-160. doi: 10.1007/s11801-018-7208-9 [11] 董丽丽,丁畅,许文海. 基于直方图均衡化图像增强的两种改进方法[J]. 电子学报,2018,46(10):2367-2375.DONG Lili,DING Chang,XU Wenhai. Two improved methods based on histogram equalization for image enhancement[J]. Acta Electronica Sinica,2018,46(10):2367-2375. [12] LU Kun,ZHANG Lihong. TBEFN:a two-branch exposure-fusion network for low-light image enhancement[J]. IEEE Transactions on Multimedia,2021(23):4093-4105. [13] XUE Yu,QIN Jiafeng. Partial connection based on channel attention for differentiable neural architecture search[J]. IEEE Transactions on Industrial Informatics,2023,19(5):6804-6813. doi: 10.1109/TII.2022.3184700 [14] MUHAMMAD E S,MUHAMMAD I,ANAYAT U,et al. A single image dehazing technique using the dual transmission maps strategy and gradient-domain guided image filtering[J]. IEEE Access,2021(9):89055-89063. [15] 龚云,颉昕宇. 基于同态滤波方法的煤矿井下图像增强技术研究[J]. 煤炭科学技术,2023,51(3):241-250.GONG Yun,XIE Xinyu. Research on coal mine underground image recognition technology based on homomorphic filtering method[J]. Coal Science and Technology,2023,51(3):241-250. [16] 王媛彬,韦思雄,段誉,等. 基于自适应双通道先验的煤矿井下图像去雾算法[J]. 工矿自动化,2022,48(5):46-51,84.WANG Yuanbin,WEI Sixiong,DUAN Yu,et al. Defogging algorithm of underground coal mine image based on adaptive dual-channel prior[J]. Journal of Mine Automation,2022,48(5):46-51,84. [17] NAYAR S K,NARASIMHAN S G. Vision in bad weather[C]. The Seventh IEEE International Conference on Computer Vision,Kerkyra,1999:820-827. [18] LI Chuan,YUAN Changjiu,PAN Hongbo,et al. Single-image dehazing based on improved bright channel prior and dark channel prior[J]. Electronics,2023,12(2). DOI: 10.3390/ELECTRONICS12020299. [19] CHEN W T,DING J J,KUO S Y. PMS-net:robust haze removal based on patch map for single images[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Long Beach,2019:11681-11689. [20] LIU Xiaoning,LI Hui,ZHU Ce. Joint contrast enhancement and exposure fusion for real-world image dehazing[J]. IEEE Transactions on Multimedia,2021,24:3934-3946. [21] QIN Xu,WANG Zhilin,BAI Yuanchao,et al. FFA-Net:feature fusion attention network for single image dehazing[C]. The AAAI Conference on Artificial Intelligence,New York,2020:11908-11915. -
点击查看大图
图(7) / 表(2)
计量
- 文章访问数: 69
- HTML全文浏览量: 24
- PDF下载量: 10
- 被引次数: 0
