Volume 50 Issue 3
Mar.  2024
Turn off MathJax
Article Contents
ZHANG Hong, SUO Tingfeng, SONG Wanying. A mine image enhancement method based on structural texture decomposition[J]. Journal of Mine Automation,2024,50(3):56-64.  doi: 10.13272/j.issn.1671-251x.2023100005
Citation: ZHANG Hong, SUO Tingfeng, SONG Wanying. A mine image enhancement method based on structural texture decomposition[J]. Journal of Mine Automation,2024,50(3):56-64.  doi: 10.13272/j.issn.1671-251x.2023100005

A mine image enhancement method based on structural texture decomposition

doi: 10.13272/j.issn.1671-251x.2023100005
  • Received Date: 2023-06-04
  • Rev Recd Date: 2024-03-06
  • Available Online: 2024-03-18
  • There is a phenomenon of low lighting and excessive dust in underground mines, which leads to uneven lighting, blurriness, and loss of details in the images captured by monitoring videos. It affects subsequent intelligent image recognition. Existing mine image enhancement methods generally suffer from unclear texture details and poor visual effects. A method for image enhancement based on structural texture decomposition is proposed. Firstly, the maxRGB algorithm is used to extract the initial lighting component from the original image. Then, an optimization objective function is constructed to sequentially optimize and solve the structural component, texture component, and noise component in the initial lighting component. The weighted guided filtering is applied to the initial lighting component as a prior constraint, and the structural component with clear edges is obtained iteratively. Combined with the maximum neighborhood difference method and weighted average local variation, a local variation deviation function is constructed as constraint weights. The texture component with rich details is obtained iteratively. Secondly, the original image is transformed into the HSV color space, and the lighting component of the original image is extracted. Combined with the structural component, texture component, and noise component, Retinex theory is used for reconstruction to obtain the enhanced initial lighting component. To avoid excessive lighting enhancement, adaptive Gamma correction with weight distribution (AGCWD) is introduced to process the initial lighting information of the image and obtain the final lighting component. Finally, the image is converted to RGB color space to obtain an enhanced image. The experimental results show the following points. ① The image enhancement algorithm based on structural texture decomposition can ensure clearer texture details at the edges of the image, reduce halo artifacts during the image enhancement process, and achieve a more balanced grayscale histogram of the enhanced image. ② Compared with five image enhancement algorithms, including the Retinex algorithm based on structure and texture aware Retinex(STAR), the joint intrinsic-extrinsic prior model (JieP), the weighted variational mode (WVM), the semi-decoupled decomposition (SDD), and multi-scale Retinex with color restoration (MSRCR), the natural image quality evaluator (NIQE) of the image enhancement algorithm based on structural texture decomposition is reduced by 8.69%, 29.05%, 11.2%, 29.53%, and 33.54%, respectively. The visual information fidelity (VIF) increases by 91.17%, 117.86%, 59.38%, 48.78%, 183.12%, and the entropy index (Entropy) increases by 3.20%, 8.02%, 4.07%, 3.49%, and 22.68%, respectively. ③ The image enhancement algorithm based on structural texture decomposition has a running time only longer than the MSRCR algorithm. But the enhancement effect is better, which can meet the needs of image enhancement in underground mines.

     

  • loading
  • [1]
    丁恩杰,俞啸,夏冰,等. 矿山信息化发展及以数字孪生为核心的智慧矿山关键技术[J]. 煤炭学报,2022,47(1):564-578.

    DING Enjie,YU Xiao,XIA Bing,et al. Development of mine informatization and key technologies of intelligent mines[J]. Journal of China Coal Society,2022,47(1):564-578.
    [2]
    王海军,王洪磊. 带式输送机智能化关键技术现状与展望[J]. 煤炭科学技术,2022,50(12):225-239.

    WANG Haijun,WANG Honglei. Status and prospect of intelligent key technologies of belt conveyor[J]. Coal Science and Technology,2022,50(12):225-239.
    [3]
    JOBSON D J,RAHMAN Z,MEMBER. Properties and performance of a center/surround retinex[J]. IEEE Transactions on Image Processing,1997,6(3):451-462. doi: 10.1109/83.557356
    [4]
    RAHMAN Z,JOBSON D J,WOODELL G A. Multi-scale retinex for color image enhancement[C]. 3rd IEEE International Conference on Image Processing,Lausanne,1996 :1003-1006.
    [5]
    JOBSON D J,RAHMAN Z,WOODELL G A. A multiscale retinex for bridging the gap between color images and the human observation of scenes[J]. IEEE Transactions on Image Processing,1997,7(6):965-976.
    [6]
    张立亚,郝博南,孟庆勇,等. 基于HSV空间改进融合Retinex算法的井下图像增强方法[J]. 煤炭学报,2020,45(增刊1):532-540.

    ZHANG Liya,HAO Bonan,MENG Qingyong,et al. Method of image enhancement in coal mine based on improved retex fusion algorithm in HSV space[J]. Journal of China Coal Society,2020,45(S1):532-540.
    [7]
    唐守锋,史可,仝光明,等. 一种矿井低照度图像增强算法[J]. 工矿自动化,2021,47(10):32-36.

    TANG Shoufeng,SHI Ke,TONG Guangming,et. al. A mine low illumination image enhancement algorithm[J]. Industry and Mine Automation,2021,47(10):32-36.
    [8]
    洪炎,朱丹萍,龚平顺. 基于TopHat加权引导滤波的Retinex矿井图像增强算法[J]. 工矿自动化,2022,48(8):43-49.

    HONG Yan,ZHU Danping,GONG Pingshun. Retinex mine image enhancement algorithm based on TopHat weighted guided filtering[J]. Journal of Mine Automation,2022,48(8):43-49.
    [9]
    龚云,颉昕宇. 基于同态滤波方法的煤矿井下图像增强技术研究[J]. 煤炭科学技术,2023,51(3):241-250.

    GONG Yun,JIE Xinyu. Research on coal mine underground image recognition technology based on homomorphic filtering method[J]. Coal Science and Technology,2023,51(3):241-250.
    [10]
    龙庆延,王正勇,潘建,等. 基于奇异值分解和引导滤波的低照度图像增强算法[J]. 科学技术与工程,2021,21(12):5018-5023.

    LONG Qingyan,WANG Zhengyong,PAN Jian,et al. Low light image enhancement algorithm based on singular value decomposition and guided filtering[J]. Science Technology and Engineering,2021,21(12):5018-5023.
    [11]
    LI Zhengguo,ZHENG Jinghong,ZHU Zijian,et al. Weighted guided image filtering[J]. IEEE Transactions on Image Processing,2015,24(1):120-129. doi: 10.1109/TIP.2014.2371234
    [12]
    ZHANG Xiaoting,HE Chuanjiang. Robust double-weighted guided image filtering[J]. Signal Processing,2022,199. DOI: 10.1016/J.SIGPRO.2022.108609.
    [13]
    CHIEN C,KINOSHITA Y,KIYA H. A noise-aware enhancement method for underexposed images[C]. IEEE International Conference on Consumer Electronics Asia ,Bangkok,2019:131-134.
    [14]
    KHAN R,MEHMOOD A,ZHENG Zhonglong. Robust contrast enhancement method using a retinex model with adaptive brightness for detection applications[J]. Optics Express,2022,30(21):37736-37752. doi: 10.1364/OE.472557
    [15]
    FU Xueyang,ZENG Delu,HUANG Yue,et al. A weighted variational model for simultaneous reflectance and illumination estimation[C]. IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas,2016:2782-2790.
    [16]
    SHEIKH H R,BOVIK A C. Image information and visual quality[J]. IEEE Transactions on Image Processing,2006,15(2):430-444. doi: 10.1109/TIP.2005.859378
    [17]
    MITTAL A,SOUNDARARAJAN R,BOVIK A C. Making a "completely blind" image quality analyzer[J]. IEEE Signal Processing Letters,2013,20(3):209-212. doi: 10.1109/LSP.2012.2227726
    [18]
    GUO Xiaojie,LI Yu,LING Haibin. LIME:low-light image enhancement via illumination map estimation[J]. IEEE Transactions on Image Processing,2017,26(2):982-993. doi: 10.1109/TIP.2016.2639450
    [19]
    XU Jun,HOU Yingkun,REN Dongwei,et al. STAR:a structure and texture aware Retinex model[J]. IEEE Transactions on Image Processing,2020,29:5022-5037. doi: 10.1109/TIP.2020.2974060
    [20]
    CAI Bolun,XU Xianming,GUO Kailing,et al. A joint intrinsic-extrinsic prior model for Retinex[C]. IEEE International Conference on Computer Vision,Venice,2017:4000-4009.
    [21]
    HAO Shijie,HAN Xu,GUO Yanrong,et al. Lowlight image enhancement with semi-decoupled decomposition[J]. IEEE Transactions on Multimedia,2020,22(12):3025-3038. doi: 10.1109/TMM.2020.2969790
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(11)  / Tables(2)

    Article Metrics

    Article views (132) PDF downloads(19) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return