Volume 50 Issue 2
Feb.  2024
Turn off MathJax
Article Contents
LIU Pengnan, LI Long, ZHANG Zihao, et al. Super resolution reconstruction of noisy images based on dense residual connected U-shaped networks[J]. Journal of Mine Automation,2024,50(2):63-71.  doi: 10.13272/j.issn.1671-251x.2023080098
Citation: LIU Pengnan, LI Long, ZHANG Zihao, et al. Super resolution reconstruction of noisy images based on dense residual connected U-shaped networks[J]. Journal of Mine Automation,2024,50(2):63-71.  doi: 10.13272/j.issn.1671-251x.2023080098

Super resolution reconstruction of noisy images based on dense residual connected U-shaped networks

doi: 10.13272/j.issn.1671-251x.2023080098
  • Received Date: 2023-08-28
  • Rev Recd Date: 2024-02-27
  • Available Online: 2024-03-06
  • The existing image super-resolution reconstruction networks are difficult to apply to noise intensive application scenarios in coal mines. Most networks improve performance by increasing depth, which leads to problems such as ineffective extraction of key features and loss of high-frequency information. In order to solve the above problems, a dense residual connected U-shaped network is proposed for super-resolution reconstruction of low resolution noisy images. The denoising module based on dense residual connections is introduced in the feature extraction path, fully extracting image features through dense connections. The features of residual learning are used to effectively denoise low resolution noisy images. The residual feature attention distillation module is introduced in the reconstruction path, by incorporating enhanced feature attention blocks into the residual blocks, different weights are assigned to features in different spaces to enhance the network's capability to extract key image features. The loss of image detail features is reduced in the residual blocks, thus better restoring image detail information. Comparative experiments are conducted on coal mine underground image datasets and public datasets, and the results show that in terms of objective evaluation index, structure similarity and image perception similarity of the proposed network are superior to the comparison network. It has a good balance in complexity and running speed. In terms of subjective visual effects, the image reconstructed by the proposed network basically eliminates the original image noise and effectively restores the detailed features of the image.

     

  • loading
  • [1]
    程德强,陈杰,寇旗旗,等. 融合层次特征和注意力机制的轻量化矿井图像超分辨率重建方法[J]. 仪器仪表学报,2022,43(8):73-84.

    CHENG Deqiang,CHEN Jie,KOU Qiqi,et al. Lightweight super-resolution reconstruction method based on hierarchical features fusion and attention mechanism for mine image[J]. Chinese Journal of Scientific Instrument,2022,43(8):73-84.
    [2]
    ZHUANG Cheng,LI Minqi,ZHANG Kaibing,et al. Multi-level landmark-guided deep network for face super-resolution[J]. Neural Networks,2022,152:276-286. doi: 10.1016/j.neunet.2022.04.026
    [3]
    TAO Hongjiu,TANG Xinjian,LIU Jian,et al. Super resolution remote sensing image processing algorithm based on wavelet transform and interpolation[C]. Conference on Image Processing and Pattern Recognition in Remote Sensing,Barcelona,2003:259-263.
    [4]
    YANG Qi,ZHANG Yanzhu,ZHAO Tiebiao. Example-based image super-resolution via blur kernel estimation and variational reconstruction[J]. Pattern Recognition Letters,2019,117:83-89. doi: 10.1016/j.patrec.2018.12.008
    [5]
    KANG Xuejing,DUAN Peiqi,XU Ruyu. Single image super-resolution based on mapping-vector clustering and nonlinear pixel-reconstruction[J]. Signal Processing:Image Communication,2022,100. DOI: 10.1016/j.image.2021.116501.
    [6]
    高青青,赵建伟,周正华. 基于递归多尺度卷积网络的图像超分辨率重建[J]. 模式识别与人工智能,2020,33(11):972-980.

    GAO Qingqing,ZHAO Jianwei,ZHOU Zhenghua. Image super-resolution reconstruction based on recursive multi-scale convolutional networks[J]. Pattern Recognition and Artificial Intelligence,2020,33(11):972-980.
    [7]
    YANG Shuyuan,LIU Zhizhou,WANG Min,et al. Multitask dictionary learning and sparse representation based single-image super-resolution reconstruction[J]. Neurocomputing,2011,74(17):3193-3203. doi: 10.1016/j.neucom.2011.04.014
    [8]
    DONG Chao,LOY C C,HE Kaiming,et al. Learning a deep convolutional network for image super-resolution[C]. 13th European Conference on Computer Vision,Zurich,2014:184-199.
    [9]
    DONG Chao,LOY C C,TANG Xiao'ou,et al. Accelerating the super-resolution convolutional neural network[C]. 14th European Conference on Computer Vision,Amsterdam,2016:391-407.
    [10]
    SHI Wenzhe,CABALLERO J,HUSZAR F,et al. Real-Time single image and video super-resolution using an efficient sub-pixel convolutional neural network[C]. IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas,2016:1874-1883.
    [11]
    HE Kaiming,ZHANG Xiangyu,REN Shaoqing,et al. Deep residual learning for image recognition[C]. IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas,2016:770-778.
    [12]
    KIM J,LEE J K,LEE K M. Accurate image super-resolution using very deep convolutional networks[J]. IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas,2016:1646-1654.
    [13]
    LIM B,SON S,KIM H,et al. Enhanced deep residual networks for single image super-resolution[C]. 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops,Honolulu,2017:1132-1140.
    [14]
    SEGU M,TONIONI A,TOMBARI F. Batch normalization embeddings for deep domain generalization[J]. Pattern Recognition,2023,135. DOI: 10.1016/j.patcog.2022.109115.
    [15]
    ZHANG Yulun,LI Kunpeng,LI Kai,et al. Image super-resolution using very deep residual channel attention networks[C]. 15th European Conference on Computer Vision,Munich,2018:294-310.
    [16]
    ZHANG Yulun,TIAN Yapeng,KONG Yu,et al. Residual dense network for image super-resolution[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Salt Lake City,2018:2472-2481.
    [17]
    CHEN Liangliang,KOU Qiqi,CHENG Deqiang,et al. Content-guided deep residual network for single image super-resolution[J]. Optik,2020,202. DOI: 10.1016/j.ijleo.2019.163678.
    [18]
    程德强,郭昕,陈亮亮,等. 多通道递归残差网络的图像超分辨率重建[J]. 中国图象图形学报,2021,26(3):605-618. doi: 10.11834/jig.200108

    CHENG Deqiang,GUO Xin,CHEN Liangliang,et al. Image super-resolution reconstruction from multi-channel recursive residual networks[J]. Journal of Image and Graphics,2021,26(3):605-618. doi: 10.11834/jig.200108
    [19]
    WOO S,PARK J,LEE J,et al. CBAM:convolutional block attention module[C]. 15th European Conference on Computer Vision,Munich,2018:3-19.
    [20]
    LIU Jie,TANG Jie,WU Gangshan. Residual feature distillation network for lightweight image super-resolution[C]. European Conference on Computer Vision Workshops,Glasgow,2020:41-55.
    [21]
    BEVILACQUA M,ROUMY A,GUILLEMOT C,et al. Low-complexity single-Image super-resolution based on nonnegative neighbor embedding[C]. 23rd British Machine Vision Conference,Surrey,2012. DOI: 10.5244/C.26.135.
    [22]
    ROMANO Y,PROTTER M,ELAD M. Single image interpolation via adaptive nonlocal sparsity-based modeling[J]. IEEE Transactions on Image Processing,2014,23(7):3085-3098. doi: 10.1109/TIP.2014.2325774
    [23]
    LIU Yun,CHENG Mingming,HU Xiaowen,et al. Richer convolutional features for edge detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,41(8):1939-1946. doi: 10.1109/TPAMI.2018.2878849
    [24]
    HUANG Jiabin,SINGH A,AHUJA N. Single image super-resolution from transformed self-exemplars[C]. IEEE Conference on Computer Vision and Pattern Recognition,Boston,2015:5197-5206.
    [25]
    ZHANG Kai,ZUO Wangmeng,CHEN Yunjin,et al. Beyond a Gaussian denoiser:residual learning of deep CNN for image denoising[J]. IEEE Transactions on Image Processing,2017,26(7):3142-3155. doi: 10.1109/TIP.2017.2662206
    [26]
    ZHANG Kai,ZUO Wangmeng,ZHANG Lei. FFDNet:toward a fast and flexible solution for CNN-based image denoising[J]. IEEE Transactions on Image Processing,2018,27(9):4608-4622. doi: 10.1109/TIP.2018.2839891
    [27]
    HARIS M,SHAKHNAROVICH G,UKITA N. Deep back-projection networks for super-resolution[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Salt Lake City,2018:1664-1673.
    [28]
    MEI Yiqun,FAN Yuchen,ZHOU Yuqian,et al. Image super-resolution with cross-scale non-local attention and exhaustive self-exemplars mining[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Seattle,2020:5689-5698.
    [29]
    MEI Yiqun,FAN Yuchen,ZHOU Yuqian. Image super-resolution with non-local sparse attention[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Nashville,2021:3516-3525.
    [30]
    WANG Yan. Edge-enhanced feature distillation network for efficient super-resolution[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops,New Orleans,2022:776-784.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(8)  / Tables(6)

    Article Metrics

    Article views (127) PDF downloads(8) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return