Volume 47 Issue 12
Turn off MathJax
Article Contents
Abstract
References
Related Articles
ZHAO Xin, WANG Ranfeng, FU Xiang. Design of coal preparation data center platform based on Hadoop ecosystem[J]. Journal of Mine Automation, 2021, 47(12): 121-127. DOI: 10.13272/j.issn.1671-251x.2021040004
Citation: ZHAO Xin, WANG Ranfeng, FU Xiang. Design of coal preparation data center platform based on Hadoop ecosystem[J]. Journal of Mine Automation, 2021, 47(12): 121-127. DOI: 10.13272/j.issn.1671-251x.2021040004
shu

Design of coal preparation data center platform based on Hadoop ecosystem

  • College of Mining Engineering, Taiyuan University of Technology, Taiyuan 030024, China

More Information
  • Received Date: April 01, 2021
  • Revised Date: December 03, 2021
    Graphical Abstract
    • Abstract
  • The existing coal preparation plant information management system uses nonstandard interface, which leads to repeated data collection, and each system is independent of each other, and the capability to process multi-source heterogeneous data is weak. In order to solve above problems, based on big data technology of Hadoop ecosystem, a coal preparation data center platform design scheme based on Hadoop ecosystem is proposed. The system integration is realized by defining data standards through master data management system and enterprise service bus. Normalization, correlation coefficient matrix and noise abnormal point detection programs are designed to realize data processing. DS (Dempster-Shafer) evidence theory, Hadoop and Hive data warehouse are combined to design multi-source heterogeneous data fusion subsystem to realize data fusion. Highcharts data visualization components are used to achieve interactive visualization of data. The practical application results show that the data center platform realizes the standardization of master data definition standard and system integration interface, improves the processing capability of coal preparation data, realizes the fusion and sharing of multi-source heterogeneous coal preparation data, and realizes the real-time interactive visualization of data.
    • FullText(HTML)
    • References (15)
  • [1]
    刘银志,赵廷钊,毛善君,等.大型煤矿集团管理智能化系统研究[J].工矿自动化,2020,46(12):25-30.

    LIU Yinzhi,ZHAO Tingzhao,MAO Shanjun,et al.Research on intelligent management system of large coal group[J].Industry and Mine Automation,2020,46(12):25-30.
    [2]
    董永胜,陈为高,侯佃平,等.智能化选煤厂研究与建议[J].工矿自动化,2021,47(增刊1):26-31.

    DONG Yongsheng,CHEN Weigao,HOU Dianping,et al.Research and suggestions on intelligent coal preparation plant[J].Industry and Mine Automation,2021,47(S1):26-31.
    [3]
    王国法,王虹,任怀伟,等.智慧煤矿2025情景目标和发展路径[J].煤炭学报,2018,43(2):295-305.

    WANG Guofa,WANG Hong,REN Huaiwei,et al.2025 scenarios and development path of intelligent coal mine[J].Journal of China Coal Society,2018,43(2):295-305.
    [4]
    疏礼春.智能煤矿数据中台架构及关键技术研究[J].工矿自动化,2021,47(6):40-44.

    SHU Lichun.Research on the architecture and key technologies of intelligent coal mine data middle platform[J].Industry and Mine Automation,2021,47(6):40-44.
    [5]
    马小平,代伟.大数据技术在煤炭工业中的研究现状与应用展望[J].工矿自动化,2018,44(1):50-54.

    MA Xiaoping,DAI Wei.Research status and application prospect of big data technology in coal industry[J].Industry and Mine Automation,2018,44(1):50-54.
    [6]
    匡亚莉.智能化选煤厂建设的内涵与框架[J].选煤技术,2018(1):85-91.

    KUANG Yali.The intension and framework for the construction of intelligent coal preparation plant[J].Coal Preparation Technology,2018(1):85-91.
    [7]
    张磊.信息自动化技术在选煤厂的应用探讨[J].煤炭工程,2018,50(增刊1):125-127.

    ZHANG Lei.Discussion on the application of information automation technology in coal preparation plant[J].Coal Engineering,2018,50(S1):125-127.
    [8]
    高晓茜,杨永胜,白龙,等.石圪台选煤厂信息化调度管理[J].洁净煤技术,2019,25(增刊1):161-163.

    GAO Xiaoqian,YANG Yongsheng,BAI Long,et al.Information dispatching management of Shigetai coal preparation plant[J].Clean Coal Technology,2019,25(S1):161-163.
    [9]
    孙小路,周春侠,张永志,等.选煤生产过程标准数据平台建设及其关键技术[J].煤炭工程,2021,53(1):38-42.

    SUN Xiaolu,ZHOU Chunxia,ZHANG Yongzhi,et al.Construction of standard data platform for coal preparation process and its key technologies[J].Coal Engineering,2021,53(1):38-42.
    [10]
    刘贤康.基于Hadoop生态圈的工业数据平台设计与研究[D].武汉:华中科技大学,2019.

    LIU Xiankang.Design and research of industrial data platform based on Hadoop ecosphere[D].Wuhan:Huazhong University of Science and Technology,2019.
    [11]
    杜小勇,卢卫,张峰.大数据管理系统的历史、现状与未来[J].软件学报,2019,30(1):127-141.

    DU Xiaoyong,LU Wei,ZHANG Feng.History,present,and future of big data management systems[J].Journal of Software,2019,30(1):127-141.
    [12]
    曹现刚,罗璇,张鑫媛,等.煤矿机电设备运行状态大数据管理平台设计[J].煤炭工程,2020,52(2):22-26.

    CAO Xiangang,LUO Xuan,ZHANG Xinyuan,et al.Design of big data management platform for operation status of coal mine electromechanical equipment[J].Coal Engineering,2020,52(2):22-26.
    [13]
    王万丽,孙超,宿国瑞.基于云平台的煤矿安全智能管控信息平台设计[J].煤炭工程,2019,51(6):52-56.

    WANG Wanli,SUN Chao,SU Guorui.Design of coal mine safety intelligent control information platform based on cloud platform[J].Coal Engineering,2019,51(6):52-56.
    [14]
    刘纪芹,史开泉.大数据分解-融合及其智能获取[J].计算机科学,2020,47(6):66-73.

    LIU Jiqin,SHI Kaiquan.Big data decomposition-fusion and its intelligent acquisition[J].Computer Science,2020,47(6):66-73.
    [15]
    陈金环,王涛,李帅,等.基于改进D-S证据理论的智能安全传感器[J].信息技术与信息化,2021(2):232-235.

    CHEN Jinhuan,WANG Tao,LI Shuai,et al.Intelligent security sensor based on improved D-S evidence theory[J].Information Technology and Information Technology,2021(2):232-235.
    • Related Articles

  • Related Articles

    [1]YU Liya, ZHAO Yongfang, ZHANG Lingyun, CHEN Guangbo. Coal and gas outburst risk evaluation based on cloud model and D -S theory[J]. Journal of Mine Automation, 2020, 46(11): 106-112. DOI: 10.13272/j.issn.1671 -251x.2020040029
    [2]HAN An. Architecture design of coal mine data center based on Hadoop[J]. Journal of Mine Automation, 2019, 45(8): 60-64. DOI: 10.13272/j.issn.1671-251x.17436
    [3]CHEN Xiaolei, LI Fenglian, ZHANG Xueying, JIAO Jiangli, LI Yuanyua. Water inrush prediction of coal floor based on adaptive robust evidence theory[J]. Journal of Mine Automation, 2015, 41(8): 46-51. DOI: 10.13272/j.issn.1671-251x.2015.08.012
    [4]LIU Kai, GUO Yongyi, WU Shiyue. Research of hierarchical multi-sensor data fusion model for coal mine safety monitoring[J]. Journal of Mine Automation, 2014, 40(6): 45-50. DOI: 10.13272/j.issn.1671-251x.2014.06.012
    [5]WANG Meng-dong, CHEN Xiang, GUAN Yu, XIAO Shu-yan. Research of double-threshold spectrum sensing algorithm based on D-S theory[J]. Journal of Mine Automation, 2013, 39(12): 82-85. DOI: 10.7526/j.issn.1671-251X.2013.12.020
    [6]XIAO Shu-yan, CUI Jie. Research of spectrum sensing algorithm of cognitive radio based on improved D-S evidence theory[J]. Journal of Mine Automation, 2013, 39(8): 42-46. DOI: 10.7526/j.issn.1671-251X.2013.08.012
    [7]LI Bo, HUANG Yuan-yue. Underground Risk Assessing Method Based on Rough Set and D-S Evidence Theory[J]. Journal of Mine Automation, 2011, 37(11): 38-40.
    [8]FU Hua, KANG Hai-chao, LIANG Ming-guang. Research of Gas Monitoring System Based on BP Network and D-S Evidence Theory[J]. Journal of Mine Automation, 2011, 37(8): 159-161.
    [9]JIAO Lu-qin, YAO Qi, YANG Li. Fault Diagnosis Method of Rotor Broken Bar of Asynchronous Motor Based on SVM and D-S Evidence Theory[J]. Journal of Mine Automation, 2010, 36(6): 43-48.
    [10]CHEN Ying, NI Jian-jun, XU Li-zhong. The Decision Method of Multi-attribute and Multi-men Based on D-S Evidence Theory and Its Applicatio[J]. Journal of Mine Automation, 2005, 31(5): 16-18.

Catalog

    Get Citation
    PDF
    XML

    Article Metrics

    Article views (157) PDF downloads (20) Cited by()
    Related

    苏ICP备 05016349号-2

    Supported by: Beijing Renhe Information Technology Co., Ltd. Visits：1154380    Baidu Analytics

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return