WANG Lin, FANG Qian, ZHANG Xiaoxia, et al. Intelligent coal mine data warehouse modeling method[J]. Journal of Mine Automation,2022,48(4):5-13. DOI: 10.13272/j.issn.1671-251x.2021120007
Citation: WANG Lin, FANG Qian, ZHANG Xiaoxia, et al. Intelligent coal mine data warehouse modeling method[J]. Journal of Mine Automation,2022,48(4):5-13. DOI: 10.13272/j.issn.1671-251x.2021120007

Intelligent coal mine data warehouse modeling method

More Information
  • Received Date: November 30, 2021
  • Revised Date: March 21, 2022
  • Available Online: March 04, 2022
  • The coal mine massive data has problems such as 'data island', weak correlation, poor data quality due to lack of data management system. It is difficult to make full use of the data and provide analysis and decision-making support for coal mine intelligence. The data warehouse can meet the requirements of multi-source heterogeneous data integration in coal mine, and provide data basis for intelligent application in coal mine. By analyzing the coal mine data types, characteristics and intelligent application requirements of actual data, the intelligent coal mine data warehouse modeling method is studied. Firstly, the layered architecture of intelligent coal mine data warehouse is constructed, and the characteristics of data model of original data layer, detailed data layer, basic index layer, service data layer and public dimension layer are analyzed. Secondly, taking the data of fully mechanized working face as an example, the modeling process of data warehouse is expounded from the aspects of business data analysis, application demand analysis and layered architecture design. Thirdly, the construction method of data model in coal mine data warehouse is introduced. The original data is transformed into data warehouse dimensional model through dimension alignment, dimension association and dimensional index aggregation. The method solves the application problem of coal mine data association in different dimensions. Finally, in order to solve the problem of portability of coal mine data warehouse, the design idea of coal mine parametric data warehouse based on general data warehouse in coal mine industry + parametric ETL (extraction-transformation-load) method is proposed. The platform of coal mine data warehouse in the laboratory environment is set up to process the data of fully mechanized working face of Shanxi Tiandi Wangpo Coal Industry Co., Ltd. The auxiliary mechanism model analysis and visual management cockpit are realized based on the processing data, which verifies the practicability of intelligent coal mine data warehouse. The performance indexes of the original data model and the intelligent coal mine data warehouse are compared. The results show that the data organization, model reuse and iteration difficulty of the intelligent coal mine data warehouse are better than those of the original data model, and the data query response time is shortened by more than 50%.
  • [1]
    王国法,王虹,任怀伟,等. 智慧煤矿2025情景目标和发展路径[J]. 煤炭学报,2018,43(2):295-305.

    WANG Guofa,WANG Hong,REN Huaiwei,et al. 2025 scenarios and development path of intelligent coal mine[J]. Journal of China Coal Society,2018,43(2):295-305.
    [2]
    韩安. 基于Hadoop的煤矿数据中心架构设计[J]. 工矿自动化,2019,45(8):60-64.

    HAN An. Architecture design of coal mine data center based on Hadoop[J]. Industry and Mine Automation,2019,45(8):60-64.
    [3]
    毛善君,杨乃时,高彦清,等. 煤矿分布式协同“一张图”系统的设计和关键技术[J]. 煤炭学报,2018,43(1):280-286.

    MAO Shanjun,YANG Naishi,GAO Yanqing,et al. Design and key technology research of coal mine distributed cooperative "one map" system[J]. Journal of China Coal Society,2018,43(1):280-286.
    [4]
    王国法,刘峰,孟祥军,等. 煤矿智能化(初级阶段)研究与实践[J]. 煤炭科学技术,2019,47(8):1-36.

    WANG Guofa,LIU Feng,MENG Xiangjun,et al. Research and practice on intelligent coal mine construction (primary stage)[J]. Coal Science and Technology,2019,47(8):1-36.
    [5]
    高士岗,高登彦,欧阳一博,等. 煤矿智能一体化辅助生产系统及关键技术[J]. 煤炭科学技术,2020,48(7):150-160.

    GAO Shigang,GAO Dengyan,OUYANG Yibo,et al. Mine intelligent integrated auxiliary production system and key technologies[J]. Coal Science and Technology,2020,48(7):150-160.
    [6]
    何敏. 智能煤矿数据治理框架与发展路径[J]. 工矿自动化,2020,46(11):23-27.

    HE Min. Framework and development path of data governance in intelligent coal mine[J]. Industry and Mine Automation,2020,46(11):23-27.
    [7]
    李首滨. 煤炭工业互联网及其关键技术[J]. 煤炭科学技术,2020,48(7):98-108.

    LI Shoubin. Coal industry Internet and its key technologies[J]. Coal Science and Technology,2020,48(7):98-108.
    [8]
    杜毅博,赵国瑞,巩师鑫. 智能化煤矿大数据平台架构及数据处理关键技术研究[J]. 煤炭科学技术,2020,48(7):177-185.

    DU Yibo,ZHAO Guorui,GONG Shixin. Study on big data platform architecture of intelligent coal mine and key technologies of data processing[J]. Coal Science and Technology,2020,48(7):177-185.
    [9]
    吴群英,蒋林,王国法,等. 智慧矿山顶层架构设计及其关键技术[J]. 煤炭科学技术,2020,48(7):80-91.

    WU Qunying,JIANG Lin,WANG Guofa,et al. Top-level architecture design and key technologies of smart mine[J]. Coal Science and Technology,2020,48(7):80-91.
    [10]
    BOJICIC I, MARJANOVIC Z, TURAJLIC N, et al. A comparative analysis of data warehouse data models[C]//The 6th IEEE International Conference on Computers Communications and Control, Oradea, 2016: 151-159.
    [11]
    曾志浩,姚贝,张琼林,等. 基于Hadoop平台的用户行为挖掘[J]. 计算技术与自动化,2015,34(2):100-103. DOI: 10.3969/j.issn.1003-6199.2015.02.024

    ZENG Zhihao,YAO Bei,ZHANG Qionglin,et al. User behavior mining based on Hadoop platform[J]. Computing Technology and Automation,2015,34(2):100-103. DOI: 10.3969/j.issn.1003-6199.2015.02.024
    [12]
    温国锋,陈立文. 煤矿安全管理数据仓库的建立与应用研究[J]. 中国矿业,2009,18(1):95-97. DOI: 10.3969/j.issn.1004-4051.2009.01.027

    WEN Guofeng,CHEN Liwen. On building and applacation of coal mine security management data warehouse[J]. China Mining Magazine,2009,18(1):95-97. DOI: 10.3969/j.issn.1004-4051.2009.01.027
    [13]
    INMON W H, LINSTEDT D, ELLIOT S. Data architecture, a primer for the data scientist: big data, data warehouse and data vault[M]. Amsterdam: Morgan Kaufmann, 2015.
    [14]
    赵随海. 铁路列车调度指挥系统数据仓库体系结构的研究[J]. 铁道运输与经济,2018,40(12):55-59.

    ZHAO Suihai. A study on the architecture of data warehouse for the railway train dispatching command system[J]. Railway Transport and Economy,2018,40(12):55-59.
    [15]
    STAVRAKAS Y,GERGATSOULIS M,DOULKERIDIS C,et al. Representingand querying histories of semistructured databases using multidimensional OEM[J]. Information Systems,2003,29(6):461-482.
    [16]
    马宏伟,吴少杰,曹现刚,等. 煤矿综采设备运行状态大数据清洗建模[J]. 工矿自动化,2018,44(11):80-83.

    MA Hongwei,WU Shaojie,CAO Xiangang,et al. Big data cleaning modeling of operation status of coal mine fully-mechanized coal mining equipment[J]. Industry and Mine Automation,2018,44(11):80-83.
    [17]
    高金标,何利力,邹云阳. 基于分布式存储系统的Hive与Hbase的研究[J]. 工业控制计算机,2015,28(12):44-45. DOI: 10.3969/j.issn.1001-182X.2015.12.021

    GAO Jinbiao,HE Lili,ZOU Yunyang. Hive and Hbase based on research on hadoop distributed file system[J]. Industrial Control Computer,2015,28(12):44-45. DOI: 10.3969/j.issn.1001-182X.2015.12.021
  • Related Articles

    [1]CHEN Yingxian, LI Jiaying, YANG Hongxia, YE Yongchao. A method for updating sectional view automatically associated with mine 3D geological model[J]. Journal of Mine Automation, 2024, 50(7): 123-129, 164. DOI: 10.13272/j.issn.1671-251x.2023120089
    [2]FANG Qian, ZHANG Xiaoxia, WANG Lin, SHI Lei, WANG Yakun. Research, practice and application of key technologies of intelligent coal mine big data governance[J]. Journal of Mine Automation, 2023, 49(5): 37-45, 73. DOI: 10.13272/j.issn.1671-251x.18099
    [3]LIU Haiqiang, CHEN Xiaojing, ZHANG Xinghua, CHEN Xiangfei. Key technologies of data warehouse for coal mine safety monitoring[J]. Journal of Mine Automation, 2022, 48(4): 31-37, 113. DOI: 10.13272/j.issn.1671-251x.2022010053
    [4]JIN Manman, TONG Minming, WANG Fei. Improved three-dimension weighted centroid localization algorithm[J]. Journal of Mine Automation, 2017, 43(2): 44-48. DOI: 10.13272/j.issn.1671-251x.2017.02.010
    [5]GUO Xian-chun, JIANG Lin, LI Da-jun, ZOU Shi-lin, ZHAO Bao-gui. Three-dimension Stratum Layer Visualization Based on Array Linked List Fractal Interpolatio[J]. Journal of Mine Automation, 2009, 35(8): 25-29.
    [6]YANG Ming-qiang, JU Zun-zhou. Research of Data Model and Data Structure of Integrated Management of Coal Mine Geospatial Data[J]. Journal of Mine Automation, 2009, 35(1): 5-9.
    [7]YANG WU-cheng~, SUN Jun-ru~, ZHANG Wu-gang~. Establishment of Fault Data Warehouse of Mine Local Ventilation System Based on OLAP[J]. Journal of Mine Automation, 2008, 34(3): 9-11.
    [8]GE Xin~, DING En-jie~. Study of Data Extraction Technology in Data Warehouse and Its Applicatio[J]. Journal of Mine Automation, 2007, 33(5): 33-35.
    [9]FAN Ji, WANG De-yong. Research of Data Mining-oriented Data Warehouse of Materials Supply in Coal Mine[J]. Journal of Mine Automation, 2007, 33(4): 20-22.
    [10]ZHOU Jing. The Application of the Technology of Teradata Data Warehouse[J]. Journal of Mine Automation, 2005, 31(6): 97-99.
  • Cited by

    Periodical cited type(16)

    1. 耿恒高,彭苏萍,王占刚,许娜,许献磊,杜文凤. 煤矿地学大数据智能湖仓系统建设与应用. 矿业科学学报. 2025(01): 1-13+163 .
    2. 谭章禄,王美君,叶紫涵. 智能化煤矿数据治理方法论体系与实施框架. 煤炭科学技术. 2025(01): 284-295 .
    3. 王国法,张金虎,任怀伟,杜毅博,张德生,闫汝瑜,于翔. 煤炭高效开采数智技术与成套装备研究及应用. 煤炭学报. 2025(01): 43-64 .
    4. 王美君,谭章禄,李慧园,吕晗冰. 智能化煤矿数据治理能力评估与提升策略研究. 矿业科学学报. 2024(01): 106-115 .
    5. 于涛. 智能化煤矿数据治理技术研究与应用. 中国煤炭. 2024(11): 96-101 .
    6. 常映辉. 面向矿井机械的铂热电阻可扩展型测试系统设计. 煤矿机械. 2023(05): 11-14 .
    7. 谭章禄,王美君,叶紫涵. 智能化煤矿数据治理体系与关键问题研究. 工矿自动化. 2023(05): 22-29 . 本站查看
    8. 方乾,张晓霞,王霖,石磊,王雅琨. 智能化煤矿大数据治理关键技术研究、实践与应用. 工矿自动化. 2023(05): 37-45+73 . 本站查看
    9. 金佳,马杰. 煤矿智能化系统总体设计研究. 内蒙古煤炭经济. 2023(07): 63-65 .
    10. 仇巍巍,葛振华,吴琪,吴初国,郭振华,贾飞阳. 矿产资源开发利用统计数据仓库关键技术研究. 矿业研究与开发. 2023(08): 222-230 .
    11. 杨震涛. 基于免疫遗传算法的智能柔性仓库货位自动化分配方法. 计算技术与自动化. 2023(03): 90-95 .
    12. 徐建阳,支崇铮,王挺,潘俊. 新型建筑体系中智能化立库的关键技术. 中国建筑金属结构. 2023(09): 62-64 .
    13. 王洪阳. 煤矿物资仓储管理存在的问题及优化措施分析. 内蒙古煤炭经济. 2023(18): 76-78 .
    14. 王亦青. 基于LIMS的矿用产品检验检测数字化质控平台探讨. 煤矿机电. 2023(04): 54-59 .
    15. 李刚,乔登攀,张枝伟,肖铸. 煤矿多源异构数据传输及管控方法研究. 煤炭技术. 2023(12): 257-260 .
    16. 杨征,杨小勇,王宇,龚韩君,祝捷,侯刚,杨斐文,方乾. 区域安全评估模型在煤矿安全管理中的应用研究. 工矿自动化. 2023(12): 94-101+129 . 本站查看

    Other cited types(6)

Catalog

    Article Metrics

    Article views (721) PDF downloads (139) Cited by(22)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return