LIU Pengnan, LI Long, ZHANG Zihao, et al. Super resolution reconstruction of noisy images based on dense residual connected U-shaped networks[J]. Journal of Mine Automation,2024,50(2):63-71. DOI: 10.13272/j.issn.1671-251x.2023080098
Citation: LIU Pengnan, LI Long, ZHANG Zihao, et al. Super resolution reconstruction of noisy images based on dense residual connected U-shaped networks[J]. Journal of Mine Automation,2024,50(2):63-71. DOI: 10.13272/j.issn.1671-251x.2023080098

Super resolution reconstruction of noisy images based on dense residual connected U-shaped networks

More Information
  • Received Date: August 27, 2023
  • Revised Date: February 26, 2024
  • Available Online: March 05, 2024
  • The existing image super-resolution reconstruction networks are difficult to apply to noise intensive application scenarios in coal mines. Most networks improve performance by increasing depth, which leads to problems such as ineffective extraction of key features and loss of high-frequency information. In order to solve the above problems, a dense residual connected U-shaped network is proposed for super-resolution reconstruction of low resolution noisy images. The denoising module based on dense residual connections is introduced in the feature extraction path, fully extracting image features through dense connections. The features of residual learning are used to effectively denoise low resolution noisy images. The residual feature attention distillation module is introduced in the reconstruction path, by incorporating enhanced feature attention blocks into the residual blocks, different weights are assigned to features in different spaces to enhance the network's capability to extract key image features. The loss of image detail features is reduced in the residual blocks, thus better restoring image detail information. Comparative experiments are conducted on coal mine underground image datasets and public datasets, and the results show that in terms of objective evaluation index, structure similarity and image perception similarity of the proposed network are superior to the comparison network. It has a good balance in complexity and running speed. In terms of subjective visual effects, the image reconstructed by the proposed network basically eliminates the original image noise and effectively restores the detailed features of the image.
  • [1]
    程德强,陈杰,寇旗旗,等. 融合层次特征和注意力机制的轻量化矿井图像超分辨率重建方法[J]. 仪器仪表学报,2022,43(8):73-84.

    CHENG Deqiang,CHEN Jie,KOU Qiqi,et al. Lightweight super-resolution reconstruction method based on hierarchical features fusion and attention mechanism for mine image[J]. Chinese Journal of Scientific Instrument,2022,43(8):73-84.
    [2]
    ZHUANG Cheng,LI Minqi,ZHANG Kaibing,et al. Multi-level landmark-guided deep network for face super-resolution[J]. Neural Networks,2022,152:276-286. DOI: 10.1016/j.neunet.2022.04.026
    [3]
    TAO Hongjiu,TANG Xinjian,LIU Jian,et al. Super resolution remote sensing image processing algorithm based on wavelet transform and interpolation[C]. Conference on Image Processing and Pattern Recognition in Remote Sensing,Barcelona,2003:259-263.
    [4]
    YANG Qi,ZHANG Yanzhu,ZHAO Tiebiao. Example-based image super-resolution via blur kernel estimation and variational reconstruction[J]. Pattern Recognition Letters,2019,117:83-89. DOI: 10.1016/j.patrec.2018.12.008
    [5]
    KANG Xuejing,DUAN Peiqi,XU Ruyu. Single image super-resolution based on mapping-vector clustering and nonlinear pixel-reconstruction[J]. Signal Processing:Image Communication,2022,100. DOI: 10.1016/j.image.2021.116501.
    [6]
    高青青,赵建伟,周正华. 基于递归多尺度卷积网络的图像超分辨率重建[J]. 模式识别与人工智能,2020,33(11):972-980.

    GAO Qingqing,ZHAO Jianwei,ZHOU Zhenghua. Image super-resolution reconstruction based on recursive multi-scale convolutional networks[J]. Pattern Recognition and Artificial Intelligence,2020,33(11):972-980.
    [7]
    YANG Shuyuan,LIU Zhizhou,WANG Min,et al. Multitask dictionary learning and sparse representation based single-image super-resolution reconstruction[J]. Neurocomputing,2011,74(17):3193-3203. DOI: 10.1016/j.neucom.2011.04.014
    [8]
    DONG Chao,LOY C C,HE Kaiming,et al. Learning a deep convolutional network for image super-resolution[C]. 13th European Conference on Computer Vision,Zurich,2014:184-199.
    [9]
    DONG Chao,LOY C C,TANG Xiao'ou,et al. Accelerating the super-resolution convolutional neural network[C]. 14th European Conference on Computer Vision,Amsterdam,2016:391-407.
    [10]
    SHI Wenzhe,CABALLERO J,HUSZAR F,et al. Real-Time single image and video super-resolution using an efficient sub-pixel convolutional neural network[C]. IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas,2016:1874-1883.
    [11]
    HE Kaiming,ZHANG Xiangyu,REN Shaoqing,et al. Deep residual learning for image recognition[C]. IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas,2016:770-778.
    [12]
    KIM J,LEE J K,LEE K M. Accurate image super-resolution using very deep convolutional networks[J]. IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas,2016:1646-1654.
    [13]
    LIM B,SON S,KIM H,et al. Enhanced deep residual networks for single image super-resolution[C]. 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops,Honolulu,2017:1132-1140.
    [14]
    SEGU M,TONIONI A,TOMBARI F. Batch normalization embeddings for deep domain generalization[J]. Pattern Recognition,2023,135. DOI: 10.1016/j.patcog.2022.109115.
    [15]
    ZHANG Yulun,LI Kunpeng,LI Kai,et al. Image super-resolution using very deep residual channel attention networks[C]. 15th European Conference on Computer Vision,Munich,2018:294-310.
    [16]
    ZHANG Yulun,TIAN Yapeng,KONG Yu,et al. Residual dense network for image super-resolution[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Salt Lake City,2018:2472-2481.
    [17]
    CHEN Liangliang,KOU Qiqi,CHENG Deqiang,et al. Content-guided deep residual network for single image super-resolution[J]. Optik,2020,202. DOI: 10.1016/j.ijleo.2019.163678.
    [18]
    程德强,郭昕,陈亮亮,等. 多通道递归残差网络的图像超分辨率重建[J]. 中国图象图形学报,2021,26(3):605-618. DOI: 10.11834/jig.200108

    CHENG Deqiang,GUO Xin,CHEN Liangliang,et al. Image super-resolution reconstruction from multi-channel recursive residual networks[J]. Journal of Image and Graphics,2021,26(3):605-618. DOI: 10.11834/jig.200108
    [19]
    WOO S,PARK J,LEE J,et al. CBAM:convolutional block attention module[C]. 15th European Conference on Computer Vision,Munich,2018:3-19.
    [20]
    LIU Jie,TANG Jie,WU Gangshan. Residual feature distillation network for lightweight image super-resolution[C]. European Conference on Computer Vision Workshops,Glasgow,2020:41-55.
    [21]
    BEVILACQUA M,ROUMY A,GUILLEMOT C,et al. Low-complexity single-Image super-resolution based on nonnegative neighbor embedding[C]. 23rd British Machine Vision Conference,Surrey,2012. DOI: 10.5244/C.26.135.
    [22]
    ROMANO Y,PROTTER M,ELAD M. Single image interpolation via adaptive nonlocal sparsity-based modeling[J]. IEEE Transactions on Image Processing,2014,23(7):3085-3098. DOI: 10.1109/TIP.2014.2325774
    [23]
    LIU Yun,CHENG Mingming,HU Xiaowen,et al. Richer convolutional features for edge detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,41(8):1939-1946. DOI: 10.1109/TPAMI.2018.2878849
    [24]
    HUANG Jiabin,SINGH A,AHUJA N. Single image super-resolution from transformed self-exemplars[C]. IEEE Conference on Computer Vision and Pattern Recognition,Boston,2015:5197-5206.
    [25]
    ZHANG Kai,ZUO Wangmeng,CHEN Yunjin,et al. Beyond a Gaussian denoiser:residual learning of deep CNN for image denoising[J]. IEEE Transactions on Image Processing,2017,26(7):3142-3155. DOI: 10.1109/TIP.2017.2662206
    [26]
    ZHANG Kai,ZUO Wangmeng,ZHANG Lei. FFDNet:toward a fast and flexible solution for CNN-based image denoising[J]. IEEE Transactions on Image Processing,2018,27(9):4608-4622. DOI: 10.1109/TIP.2018.2839891
    [27]
    HARIS M,SHAKHNAROVICH G,UKITA N. Deep back-projection networks for super-resolution[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Salt Lake City,2018:1664-1673.
    [28]
    MEI Yiqun,FAN Yuchen,ZHOU Yuqian,et al. Image super-resolution with cross-scale non-local attention and exhaustive self-exemplars mining[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Seattle,2020:5689-5698.
    [29]
    MEI Yiqun,FAN Yuchen,ZHOU Yuqian. Image super-resolution with non-local sparse attention[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Nashville,2021:3516-3525.
    [30]
    WANG Yan. Edge-enhanced feature distillation network for efficient super-resolution[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops,New Orleans,2022:776-784.
  • Related Articles

    [1]LIU Weitao, LI Beibei, DU Yanhui, HAN Mengke, ZHAO Jiyuan. Research on the recognition model of mine water inrush source based on improved SSA-BP neural network[J]. Journal of Mine Automation, 2024, 50(2): 98-105, 115. DOI: 10.13272/j.issn.1671-251x.2023070101
    [2]WU Yaqin, LI Huijun, XU Danni. Prediction algorithm of coal and gas outburst based on IPSO-Powell optimized SVM[J]. Journal of Mine Automation, 2020, 46(4): 46-53. DOI: 10.13272/j.issn.1671-251x.2019110018
    [3]TAN Faming, WANG Qi. State of charge prediction for mine-used power battery[J]. Journal of Mine Automation, 2019, 45(1): 70-75. DOI: 10.13272/j.issn.1671-251x.2018060051
    [4]PENG Cheng, SUI Xiaomei, WANG Huiju. Improved differential evolution algorithm for solving open-pit mine transportation problem[J]. Journal of Mine Automation, 2018, 44(4): 104-108. DOI: 10.13272/j.issn.1671-251x.2017100044
    [5]JIANG Lei, YANG Liuming, WU Fangda, HAN Huijie, ZHOU Xue. Underground positioning method based on GMapping algorithm and fingerprint map constructio[J]. Journal of Mine Automation, 2017, 43(9): 96-101. DOI: 10.13272/j.issn.1671-251x.2017.09.017
    [6]LI Jing-xia, ZHANG Ying-mei, ZHANG Jian-guo, MA Jun, MA Fu-chang. Application of microwave chaotic signal in advanced detection of coal mine water inrush[J]. Journal of Mine Automation, 2013, 39(10): 32-34. DOI: 10.7526/j.issn.1671-251X.2013.10.009
    [7]FU Bo-na, CHENG Yong. Application research of modeling method based on neural networks with parallel chaotic search[J]. Journal of Mine Automation, 2013, 39(9): 87-91. DOI: 10.7526/j.issn.1671-251X.2013.09.023
    [8]MA Cao-yuan, LIU Jian-feng, GAO Shan, LIU Hao. Nonlinear Compensation and Control Method of Chaotic Ferroresonance System Based on D-FN[J]. Journal of Mine Automation, 2012, 38(11): 23-26.
    [9]LI Lu, MA Shao-yi. Construction of Mine-map Graph Correction System Based on MapX[J]. Journal of Mine Automation, 2009, 35(11): 115-116.
    [10]XU Jian-jun, SHI Yi-qiao. Design of Main Station of Mine-used Tracking and Position System for Personnel Based on MapInfo[J]. Journal of Mine Automation, 2008, 34(1): 82-84.

Catalog

    Article Metrics

    Article views (143) PDF downloads (12) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return