GUO Zhijie, NAN Bingfei, WANG Kai. Research and application of video fog concentration detection and real-time fog removal method in underground coal mine[J]. Journal of Mine Automation,2023,49(3):31-38. DOI: 10.13272/j.issn.1671-251x.2022080068
Citation: GUO Zhijie, NAN Bingfei, WANG Kai. Research and application of video fog concentration detection and real-time fog removal method in underground coal mine[J]. Journal of Mine Automation,2023,49(3):31-38. DOI: 10.13272/j.issn.1671-251x.2022080068

Research and application of video fog concentration detection and real-time fog removal method in underground coal mine

More Information
  • Received Date: August 23, 2022
  • Revised Date: February 21, 2023
  • Available Online: October 12, 2022
  • The dynamic change of scene fog concentration caused by spraying dust removal operation in the production state of underground coal mine working face leads to the blurred visual video image. This seriously affects the visual remote intervention coal mining control and operation in underground coal mine. Aiming at the above problems, a method of video fog concentration detection and real-time fog removal underground in coal mine working face is proposed. Firstly, the difference between the brightness value and the saturation value of the fog-containing video image is calculated based on the color attenuation prior to realize the fog concentration detection. The fog-containing image and the non-fog image are further identified. Secondly, the color attenuation prior and the scene change probability model are used for correcting the video time continuous cost function. The transmittance error between adjacent frames of the video is reduced. The flicker influence of the fog removed video image is reduced. Finally, the video fog concentration detection and real-time fog removal method in the coal mine working face and the Kim method are respectively used to process the foggy video of the coal mine underground scene. The experimental results show the following points. ① The fog concentration distribution in the image scene can be accurately calculated by the fog concentration detection method. The maximum connected region of the extracted fog concentration accounts for 38.693% of the total image pixels. The fog-containing images are those greater than 20% of the fog concentration threshold. According to the recognition result of the fog-containing image, the non-fog image is automatically ignored. The fog-containing image is selectively fog removed. ② The video fog concentration detection and real-time fog removal method in coal mine working face is used to remove the fog of the production video of different areas (a support area and a coal wall area) and different fog concentrations (a medium fog concentration and a higher fog concentration). The contrast of the video image is obviously enhanced after fog removal, and the visual effect is brighter and clearer. ③ The mean square error curve of the real-time fog removal method is lower than that of Kim method. This indicates that the mean square error value of the adjacent frames of the video is reduced after the continuous scene video is fog removed. The flicker phenomenon of the real-time fog removal result video is effectively suppressed. The contrast cost function and the color information loss cost function are used to estimate the transmittance of the fog-containing image. The ideal fog removal effect is obtained when the scene changes. ④ The mean value of mean square error between the adjacent frames of the fog removal result of the real-time fog removal method is reduced by 4.26 compared with the Kim method. The similarity between the adjacent frames is improved. The image flicker phenomenon between the adjacent frames is further suppressed. In the aspect of running time, the processing time of each frame of the real-time fog removal method is increased by 2 ms compared with the Kim method. However, the processing time of each frame is less than 40 ms, which meets the real-time requirement.
  • [1]
    LIU Zhigang,CAO Anye,GUO Xiaosheng,et al. Deephole water injection technology of strong impact tendency coal seam-a case study in Tangkou Coal Mine[J]. Arabian Journal of Geosciences,2018,11(2):1-9.
    [2]
    肖军良. 辛置煤矿2−208工作面喷雾降尘技术研究与应用[J]. 煤矿现代化,2021,30(6):46-48.

    XIAO Junliang. Research and application of spray dust suppression technology in 2-208 working face of Xinzhi Coal Mine[J]. Coal Mine Modernization,2021,30(6):46-48.
    [3]
    张立亚,郝博南,孟庆勇,等. 基于HSV空间改进融合Retinex算法的井下图像增强方法[J]. 煤炭学报,2020,45(增刊1):532-540.

    ZHANG Liya,HAO Bonan,MENG Qingyong,et al. Method of image enhancement in coal mine based on improved Retinex fusion algorithm in HSV space[J]. Journal of China Coal Society,2020,45(S1):532-540.
    [4]
    龚云,杨庞彬,颉昕宇. 结合同态滤波与直方图均衡化的井下图像匹配算法[J]. 工矿自动化,2021,47(10):37-41,61.

    GONG Yun,YANG Pangbin,JIE Xinyu. Underground image matching algorithm combining homomorphic filtering and histogram equalization[J]. Industry and Mine Automation,2021,47(10):37-41,61.
    [5]
    TAN R. Visibility in bad weather from a single image[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR), Anchorage, 2008: 1-8.
    [6]
    FATTAL R. Single image dehazing[J]. ACM TransActions on Graphics,2008,27(3):1-9.
    [7]
    HE Kaiming, SUN Jian, TANG Xiao'ou. Single image haze removal using dark channel prior[C]. 2nd International Conference on Computer Science and Intelligent Communicatio(CSIC), Xi'an, 2018: 135-141.
    [8]
    TAREL J, HAUTIERE N. Fast visibility restoration from a single color or gray level image[C]. Proceedings of the 12th IEEE International Conference on Computer Vision, Kyoto, 2009: 2201-2208.
    [9]
    TAREL J,HAUTIERE N,CARAFFA L. Vision enhancement in homogeneous and heterogeneous fog[J]. IEEE Intelligent Transportation Systems Magazine,2012,4(2):6-20. DOI: 10.1109/MITS.2012.2189969
    [10]
    ANCUTI C O, ANCUTI C, HERMANS C, et al. A fast semi-inverse approach to detect and remove the haze from a single image[C]. Asian Conference on Computer Vision(ACCV), Queenstown, 2011: 501-514.
    [11]
    KRATZ L, NISHINO K. Factorizing scene albedo and depth from a single foggy image[C]. Proceedings of the 2009 IEEE International Conference on Vision, Piscataway, 2009: 1701-1708.
    [12]
    MENG Gaofeng, WANG Ying, DUAN Jiangyong, et al. Efficient image dehazing with boundary constraint and contextual regularization[C]. Proceedings of the 2013 IEEE International Conference on Computer Vision, Sydney, 2013: 617-624.
    [13]
    杨红,崔艳. 基于开运算暗通道和优化边界约束的图像去雾算法[J]. 光子学报,2018,47(6):244-250.

    YANG Hong,CUI Yan. Image defogging algorithm based on opening dark channel and improved boundary constraint[J]. Acta Photonica Sinica,2018,47(6):244-250.
    [14]
    KIM J H,JANG W D,SIM J Y,et al. Optimized contrast enhancement for real-time image and video dehazing[J]. Journal of Visual Communication and Image Representation,2013,24(3):410-425. DOI: 10.1016/j.jvcir.2013.02.004
    [15]
    YU Jing, LIAO Qingmin. Fast single image fog removal using edge-preserving smoothing[C]. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, 2011: 1245-1248.
    [16]
    CARR P, HARTLEY P. Improved single image dehazing using geometry[C]. Digital Imagee Computing: Techniques & Applications, Melbourne, 2009: 103-110.
    [17]
    CAI Bolun,XU Xiangmin,JIA Kuiqing,et al. DehazeNet:an end-to-end system for single image haze removal[J]. IEEE Transactions on Image Processing,2016,25(11):5187-5198. DOI: 10.1109/TIP.2016.2598681
    [18]
    ZHU Qingsong,MAI Jiaming,SHAO Ling. A fast single image haze removal algorithm using color attenuation prior[J]. IEEE Transactions on Image Processing,2015,24(11):3522-3533. DOI: 10.1109/TIP.2015.2446191
    [19]
    HIDE R. Optics of the atmosphere:scattering by molecules and particles[J]. Physics Bulletin,1977,28(11):521.
    [20]
    HE Kaiming,SUN Jian,TANG Xiao'ou. Guided image filtering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(6):1397-1409. DOI: 10.1109/TPAMI.2012.213
    [21]
    CHAPMAN B, JOST G, PAS R. Using OpenMP: portable shared memory parallel programming(scientific and engineering computation)[M]. Massachusetts(United Sates), The MIT Press, 2007.
  • Related Articles

    [1]YU Qun, LIU Jiayu. On-line relay protection setting system for mine power grid considering multi-scenario operation mode[J]. Journal of Mine Automation, 2020, 46(12): 38-47. DOI: 10.13272/j.issn.1671-251x.2020100002
    [2]KANG Qian, XU Chunyu, TIAN Muqin, SONG Jiancheng. Analysis of influencing factors of short-circuit spark discharge in electric potential capacitance circuit[J]. Journal of Mine Automation, 2020, 46(8): 38-43. DOI: 10.13272/j.issn.1671-251x.2020030006
    [3]YU Shuohang, RONG Xiang, YANG Fan, WEI Lipeng. A zero-crossing point prediction algorithm of short-circuit current for mine-used phase-controlled switching[J]. Journal of Mine Automation, 2020, 46(6): 103-107. DOI: 10.13272/j.issn.1671-251x.2020030074
    [4]ZHAO Fu-yu. An Anti-Override Trip System Based on Principle of Zone Protectio[J]. Journal of Mine Automation, 2012, 38(11): 104-106.
    [5]GENG Qing-e. Design of Mine-used Protection Device for Override Trip[J]. Journal of Mine Automation, 2012, 38(8): 131-134.
    [6]ZHENG Ri-hong, GU Xiu-fang, HAN Ru-yue, WANG Fei , DENG Guo-dong. Analysis of Short Circuit Faults of Distribution Network and Research of Its Identification Methods[J]. Journal of Mine Automation, 2012, 38(4): 23-29.
    [7]GOU Xin-ke, LI Jun-qi. A New Algorithm of Real-time Detection of Harmonic Current Based on Instantaneous Reactive Power Theory[J]. Journal of Mine Automation, 2010, 36(11): 55-58.
    [8]XUE Jian-yong, HUI Wan-li, YANG Yu-li. Short-current Protection of Cutting Motor with High Power of Shearer[J]. Journal of Mine Automation, 2009, 35(10): 91-92.
    [9]ZHANG Chang-yong, LI Zhi-gang, FEI Jiang-hai. Development of Mine Feeding Switch with Protection Function of Instantaneous Voltage-loss[J]. Journal of Mine Automation, 2007, 33(4): 59-61.
    [10]HE Zong-ming. Error Analysis of Short-circuit Current Value by Table Look-up Method[J]. Journal of Mine Automation, 2003, 29(6): 22-23.
  • Cited by

    Periodical cited type(1)

    1. 韩晓冰,王鑫磊,周远国,刘洋. 基于DNN的煤矿富水区探测反演方法研究. 煤炭技术. 2024(04): 140-145 .

    Other cited types(3)

Catalog

    Article Metrics

    Article views (327) PDF downloads (61) Cited by(4)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return