煤矸石智能分拣机器人研究进展与关键技术

张烨; 马宏伟; 王鹏; 曹现刚; 魏小荣; 周文剑

doi:10.13272/j.issn.1671-251x.2022100048

煤矸石智能分拣机器人研究进展与关键技术

doi: 10.13272/j.issn.1671-251x.2022100048

张烨^{1, 2,},
马宏伟^{1, 2},
王鹏^{1, 2},
曹现刚^{1, 2},
魏小荣^{1, 2},
周文剑^{1, 2}

1.
西安科技大学机械工程学院, 陕西西安　710054
2.
陕西省矿山机电装备智能检测与控制重点实验室, 陕西西安　710054

基金项目: 国家自然科学基金面上项目（51975468）

详细信息

作者简介:
张烨（1990—），女，陕西兴平人，工程师，博士研究生，主要从事机器视觉及机器人智能控制方面的研究工作，E-mail：xust-zy@xust.edu.cn

中图分类号: TD67
计量
- 文章访问数: 1260
- HTML全文浏览量: 73
- PDF下载量: 111
- 被引次数: 0
出版历程
- 收稿日期: 2022-10-18
- 修回日期: 2022-11-28
- 网络出版日期: 2022-11-28

Research progress and key technologies of intelligent coal-gangue sorting robot

ZHANG Ye^{1, 2
,},
MA Hongwei^{1, 2},
WANG Peng^{1, 2},
CAO Xiangang^{1, 2},
WEI Xiaorong^{1, 2},
ZHOU Wenjian^{1, 2}

1.
College of Mechanical Engineering, Xi'an University of Science and Technology, Xi 'an 710054, China
2.
Shaanxi Key Laboratory of Mine Electromechanical Equipment Intelligent Detection and Control, Xi'an 710054, China

摘要

摘要: 煤矿井下矸石被煤泥包裹，煤矸石识别难、分拣难；井下工作空间狭小，设备布局难、煤矸石分流难，因此，需要研发高性能、高可靠的煤矸石智能分拣机器人。分析了煤矸石智能分拣机器人中煤矸石识别、机器人轨迹规划、多动态目标多机器人协同控制技术的研究现状。指出煤矸石分拣工作环境复杂，其质量和形状不规则且呈随机分布，因此，复杂环境下煤矸石识别与抓取特征提取、非结构环境下煤矸石稳定可靠抓取、多目标任务多机器人智能协同分拣是煤矸石分拣智能机器人的3大关键技术，提出要实现机器人智能分拣煤矸石，还应在适应于井下的煤矸石识别与抓取特征提取、动态目标精确定位和同步跟踪、机械臂在线轨迹规划和多机械臂智能协同控制等方法上进行深入研究。通过对上述3大关键技术的梳理，总结得出：煤矸石数据集构建与扩增、煤矸石识别与抓取特征提取是实现煤矸石高效识别的关键技术；动态煤矸石精准跟踪、机械臂同步跟踪动态目标轨迹规划和快速大质量目标稳定抓取是实现机械臂稳定抓取煤矸石的关键技术；多任务高效分配、防碰撞路径规划和智能协同控制是实现多机械臂高效智能协同分拣的关键技术。针对目前存在的共性问题，提出了解决方案：在识别方面，研究基于多模态深度学习的煤矸石识别与抓取特征提取方法，实现井下煤矸石快速识别；在轨迹规划方面，研究动态煤矸石精准定位和实时跟踪方法，实现机器人对动态煤矸石的自适应稳定抓取；在协同分拣方面，构建多层多机械臂协同控制模型，实现多机械臂复杂环境下高效智能协同分拣。
- 煤矸石分拣 /
- 分拣机器人 /
- 煤矸石识别 /
- 机器人轨迹规划 /
- 智能协同分拣 /
- 稳定抓取
Abstract: The gangue is wrapped by slurry in underground coal mine, which causes difficult coal-gangue recognition and sorting. The underground working space is narrow, so the equipment layout is difficult, and the diversion of coal-gangue is difficult. Therefore, developing a high-performance, highly reliable intelligent coal-gangue sorting robot is necessary. The paper analyzes the research status of coal-gangue recognition, robot trajectory plan and multi-dynamic-target multi-robot collaborative control technology of intelligent coal-gangue sorting robot. This paper points out that the coal-gangue sorting work environment is complex, and its weight and shape of coal-gangue are irregular and randomly distributed. Therefore, the three key technologies for intelligent coal-gangue sorting robot are recognition and grasping features extraction of coal-gangue in complex environment, stable and reliable grasping of coal-gangue in unstructured environment, and intelligent collaborative sorting of multi-target multi-robot. It is proposed that in order to realize the intelligent sorting of coal-gangue by the robot, further research should be carried out. The research includes the methods of coal-gangue recognition and sorting feature extraction suitable for underground, accurate positioning and synchronous tracking of dynamic targets, online trajectory planning of mechanical arms, and intelligent collaborative control of multiple mechanical arms. By soring out the above three key technologies, it can be concluded as follows. The construction and expansion of coal-gangue data set, recognition and grasping features extraction of coal-gangue are the key technologies to achieve efficient coal-gangue recognition. Precise tracking of dynamic coal-gangue, trajectory planning of synchronous tracking dynamic target of mechanical arm and fast and stable grasping of large quality targets are the key technologies to realize stable coal-gangue grasping by mechanical arms. Multi-task efficient allocation, anti-collision path planning and intelligent collaborative control are the key technologies to achieve efficient intelligent collaborative sorting of multiple mechanical arms. According to the common problems at present, this paper puts forward the solutions. In the aspect of recognition, the method of coal-gangue recognition and grasping feature extraction based on multi-mode deep learning is studied to realize fast coal-gangue recognition suitable for the underground. In the aspect of trajectory planning, the precise positioning and real-time tracking methods of dynamic coal-gangue are studied to realize the adaptive and stable grasping of dynamic coal-gangue by the robot. In the aspect of collaborative sorting, a multi-layer multiple mechanical arms collaborative control model is built to achieve efficient intelligent collaborative sorting of multiple mechanical arms in the complex environment.
- coal-gangue sorting /
- sorting robot /
- coal-gangue recognition /
- robot trajectory planning /
- intelligent collaborative sorting /
- stable grasp

HTML全文

图 1 煤矸石智能分拣机器人

Figure 1. Intelligent coal-gangue sorting robot

下载: 全尺寸图片幻灯片

图 2 煤矸石识别与抓取特征提取方法

Figure 2. Recognition and grasping features extraction of coal-gangue

下载: 全尺寸图片幻灯片

图 3 机械臂动态目标精准跟踪与稳定抓取方法

Figure 3. Precise dynamic target tracking and stable grasping method of mechanical arm

下载: 全尺寸图片幻灯片

图 4 多机械臂复杂环境下高效智能协同分拣方法

Figure 4. Efficient and intelligent collaborative sorting method of multi-mechanical arm in complex environment

下载: 全尺寸图片幻灯片

参考文献(36)

[1]	马立强,李永升. 煤矿井下矸石置换煤炭清洁生产技术[J]. 煤炭学报,2010,35(5):816-819. MA Liqiang,LI Yongsheng. The clean production technology of replacement of coal gangue in coal mine[J]. Journal of China Coal Society,2010,35(5):816-819.
[2]	曹亦俊,刘敏,邢耀文,等. 煤矿井下选煤技术现状和展望[J]. 采矿与安全工程学报,2020,37(1):192-201. CAO Yijun,LIU Min,XING Yaowen,et al. Current situation and prospect of underground coal preparation technology[J]. Journal of Mining & Safety Engineering,2020,37(1):192-201.
[3]	周少雷,曾志远. 西部煤炭洁净加工利用新技术新工艺探讨[J]. 煤炭加工与综合利用,2016(7):5-10,92. ZHOU Shaolei,ZENG Zhiyuan. Inquiry of utilization of new process for clean processing of coal in Western China[J]. Coal Processing & Comprehensive Utilization,2016(7):5-10,92.
[4]	李曼,段雍,曹现刚,等. 煤矸分选机器人图像识别方法和系统[J]. 煤炭学报,2020,45(10):3636-3644. LI Man,DUAN Yong,CAO Xiangang,et al. Image identification method and system for coal and gangue sorting robot[J]. Journal of China Coal Society,2020,45(10):3636-3644.
[5]	王鹏,曹现刚,夏晶,等. 基于机器视觉的多机械臂煤矸石分拣机器人系统研究[J]. 工矿自动化,2019,45(9):47-53. WANG Peng,CAO Xiangang,XIA Jing,et al. Research on multi-manipulator coal and gangue sorting robot system based on machine vision[J]. Industry and Mine Automation,2019,45(9):47-53.
[6]	董华飞. 基于Delta并联机器人的煤矸石分拣方法研究[D]. 太原: 中北大学, 2022. DONG Huafei. Research on coal gangue sorting method based on Delta parallel robot[D]. Taiyuan: North University of China, 2022.
[7]	刘鹏,马宏伟,乔心州,等. 柔索驱动拣矸机器人最小索拉力等值曲面研究[J]. 西安科技大学学报,2020,40(5):797-804. LIU Peng,MA Hongwei,QIAO Xinzhou,et al. On the contour surfaces of minimum tensions for a cable-driven coal-gangue picking robot[J]. Journal of Xi'an University of Science and Technology,2020,40(5):797-804.
[8]	FOOKES R A,GRAVITIS V L,WATT J S,et al. On-line determination of the ash content of coal using a "siroash" gauge based on the transmission of low and high energy γ-rays[J]. International Journal of Applied Radiation & Isotopes,1983,34(1):63-69.
[9]	杨慧刚,乔志敏. 基于X射线和机器视觉的煤与矸石分选系统设计[J]. 工矿自动化,2017,43(3):85-89. YANG Huigang,QIAO Zhimin. Design of separation system of coal and gangue based on X-ray and machine vision[J]. Industry and Mine Automation,2017,43(3):85-89.
[10]	徐琦,孔力,刘文中. 生态遗传算法在煤矸石模糊模式识别中的应用[J]. 工矿自动化,2003,29(2):9-11. doi: 10.3969/j.issn.1671-251X.2003.02.004 XU Qi,KONG Li,LIU Wenzhong. Application of niche genetic algorithm in fuzzy pattern recognition of gangues[J]. Industry and Mine Automation,2003,29(2):9-11. doi: 10.3969/j.issn.1671-251X.2003.02.004
[11]	杨慧刚,乔志敏,高绘彦,等. 煤与矸石分选系统设计[J]. 工矿自动化,2018,44(8):91-95. YANG Huigang,QIAO Zhimin,GAO Huiyan,et al. Design of separation system of coal and gangue[J]. Industry and Mine Automation,2018,44(8):91-95.
[12]	曹现刚,李莹,王鹏,等. 煤矸石识别方法研究现状与展望[J]. 工矿自动化,2020,46(1):38-43. CAO Xiangang,LI Ying,WANG Peng,et al. Research status of coal-gangue identification method and its prospect[J]. Industry and Mine Automation,2020,46(1):38-43.
[13]	马宪民. 一种基于小波变换的煤矸石图像边缘检测方法[J]. 仪器仪表学报,2006(增刊3):2130-2131. MA Xianmin. Edge detection based on wavelet transform for coal gangue image[J]. Chinese Journal of Scientific Instrument,2006(S3):2130-2131.
[14]	MA Xianmin, LIANG Che. Application of rough set theory in coal gangue image process[C]. Proceeding of the Fifth International Conference on Information Assurance and Security, Xi'an, 2009: 87-90.
[15]	郜亚松,张步勤,郎利影. 基于深度学习的煤矸石识别技术与实现[J]. 煤炭科学技术,2021,49(12):202-208. doi: 10.3969/j.issn.0253-2336.2021.12.mtkxjs202112025 GAO Yasong,ZHANG Buqin,LANG Liying. Coal and gangue recognition technology and implementation based on deep learning[J]. Coal Science and Technology,2021,49(12):202-208. doi: 10.3969/j.issn.0253-2336.2021.12.mtkxjs202112025
[16]	曹现刚,薛祯也. 基于迁移学习的GoogLenet煤矸石图像识别[J]. 软件导刊,2019,18(12):183-186. CAO Xiangang,XUE Zhenye. Coal gangue identification by using transfer learning in GoogLenet[J]. Software Guide,2019,18(12):183-186.
[17]	沈科,季亮,张袁浩,等. 基于改进YOLOv5s模型的煤矸目标检测[J]. 工矿自动化,2021,47(11):107-111,118. doi: 10.13272/j.issn.1671-251x.17838 SHEN Ke,JI Liang,ZHANG Yuanhao,et al. Research on coal and gangue detection algorithm based on improved YOLOv5s model[J]. Industry and Mine Automation,2021,47(11):107-111,118. doi: 10.13272/j.issn.1671-251x.17838
[18]	曹珍贯,吕旻姝,张宗唐. 基于热成像技术和深度学习的煤矸石识别方法[J]. 湖南工程学院学报(自然科学版),2021,31(1):48-52. doi: 10.3969/j.issn.1671-119X.2021.01.008 CAO Zhenguan,LYU Minshu,ZHANG Zongtang. Coal gangue recognition method based on thermal imaging technology and deep learning[J]. Journal of Hunan Institute of Engineering(Natural Science Edition),2021,31(1):48-52. doi: 10.3969/j.issn.1671-119X.2021.01.008
[19]	来文豪,周孟然,王锦国,等. 多光谱波段筛选的煤矸石快速定位[J]. 中国激光,2021,48(16):190-200. LAI Wenhao,ZHOU Mengran,WANG Jinguo,et al. Fast location of coal gangue based on multispectral band selection[J]. Chinese Journal of Lasers,2021,48(16):190-200.
[20]	李亚坤,马宏伟,王鹏. 基于VGG_16网络的煤和矸石识别技术研究[J]. 煤炭技术,2022,41(9):156-159. LI Yakun,MA Hongwei,WANG Peng. Research on coal and gangue recognition technology based on VGG_16 network[J]. Coal Technology,2022,41(9):156-159.
[21]	赵明辉. 双臂并联煤矸石分拣机器人及其轨迹规划研究[J]. 工矿自动化,2020,46(9):57-63. ZHAO Minghui. Research on dual-arm parallel coal gangue sorting robot and its trajectory planning[J]. Industry and Mine Automation,2020,46(9):57-63.
[22]	李宁. 煤矸分拣机器人控制系统研究[D]. 西安: 西安科技大学, 2019. LI Ning. Study on the control system of coal mine sorting robot[D]. Xi'an: Xi'an University of Science and Technology, 2019.
[23]	王鹏,曹现刚,马宏伟,等. 基于余弦定理−PID的煤矸石分拣机器人动态目标稳准抓取算法[J]. 煤炭学报,2020,45(12):4240-4247. WANG Peng,CAO Xiangang,MA Hongwei,et al. Dynamic target steady and accurate grasping algorithm of gangue sorting robot based on cosine theorem-PID[J]. Journal of China Coal Society,2020,45(12):4240-4247.
[24]	马宏伟,孙那新,张烨,等. 煤矸石分拣机器人动态目标稳定抓取轨迹规划[J]. 工矿自动化,2022,48(4):20-30. doi: 10.13272/j.issn.1671-251x.2021110050 MA Hongwei,SUN Naxin,ZHANG Ye,et al. Track planning of coal gangue sorting robot for dynamic target stable grasping[J]. Journal of Mine Automation,2022,48(4):20-30. doi: 10.13272/j.issn.1671-251x.2021110050
[25]	夏晶,张昊,周世宁,等. 煤矸分拣机器人动态拣取避障路径规划[J]. 煤炭学报,2021,46(增刊1):570-577. XIA Jing,ZHANG Hao,ZHOU Shining,et al. Dynamic picking and obstacle avoidance path planning of coal gangue sorting robot[J]. Journal of China Coal Society,2021,46(S1):570-577.
[26]	朱子祺,李创业,代伟. 基于G-RRT^算法的煤矸石分拣机器人路径规划[J]. 工矿自动化,2022,48(3):55-62. ZHU Ziqi,LI Chuangye,DAI Wei. Path planning of coal gangue sorting robot based on G-RRT^ algorithm[J]. Journal of Mine Automation,2022,48(3):55-62.
[27]	邹宇星,李立君,高自成. 基于改进PRM的采摘机器人机械臂避障路径规划[J]. 传感器与微系统,2019,38(1):52-56. ZOU Yuxing,LI Lijun,GAO Zicheng. Obstacle avoidance path planning for harvesting robot arm based on improved PRM[J]. Transducer and Microsystem Technologies,2019,38(1):52-56.
[28]	陈秋莲,蒋环宇,郑以君. 机器人路径规划的快速扩展随机树算法综述[J]. 计算机工程与应用,2019,55(16):10-17. doi: 10.3778/j.issn.1002-8331.1905-0061 CHEN Qiulian,JIANG Huanyu,ZHENG Yijun. Summary of rapidly-exploring random tree algorithm in robot path planning[J]. Computer Engineering and Applications,2019,55(16):10-17. doi: 10.3778/j.issn.1002-8331.1905-0061
[29]	李文彪. 基于深度强化学习的工业机器人避障路径规划方法[J]. 制造业自动化,2022,44(1):127-130. doi: 10.3969/j.issn.1009-0134.2022.01.029 LI Wenbiao. Obstacle avoidance path planning method for industrial robots based on deep reinforcement learning[J]. Manufacturing Automation,2022,44(1):127-130. doi: 10.3969/j.issn.1009-0134.2022.01.029
[30]	商德勇,章林,牛艳奇,等. 煤矸分拣机器人设计与关键技术分析[J]. 煤炭科学技术,2022,50(3):232-238. doi: 10.13199/j.cnki.cst.ZN20-040 SHANG Deyong,ZHANG Lin,NIU Yanqi,et al. Design and key technology analysis of coal-gangue sorting robot[J]. Coal Science and Technology,2022,50(3):232-238. doi: 10.13199/j.cnki.cst.ZN20-040
[31]	WANG Peng, MA Hongwei, ZHANG Ye, et al. A cooperative strategy of multi-arm coal gangue sorting robot based on immune dynamic workspace[J/OL]. International Journal of Coal Preparation and Utilization: 1-21[2022-10-15]. https://doi.org/10.1080/19392699.2022.2078808.
[32]	曹现刚,吴旭东,王鹏,等. 面向煤矸分拣机器人的多机械臂协同策略[J]. 煤炭学报,2019,44(增刊2):763-774. doi: 10.13225/j.cnki.jccs.2019.0734 CAO Xiangang,WU Xudong,WANG Peng,et al. Collaborative strategy of multi-manipulator for coal-gangue sorting robot[J]. Journal of China Coal Society,2019,44(S2):763-774. doi: 10.13225/j.cnki.jccs.2019.0734
[33]	黄宛宁,龚建伟,王鹏辉. 基于改进遗传算法的多机器人任务分配方法[J]. 计算机仿真,2006(11):164-167,172. doi: 10.3969/j.issn.1006-9348.2006.11.042 HUANG Wanning,GONG Jianwei,WANG Penghui. Multi-robot task allocation method based on GA[J]. Computer Simulation,2006(11):164-167,172. doi: 10.3969/j.issn.1006-9348.2006.11.042
[34]	李济泽. 基于粒子群遗传优化算法的多机器人任务分配研究[J]. 机械与电子,2007(10):45-48. doi: 10.3969/j.issn.1001-2257.2007.10.016 LI Jize. Research on mission assign of multi-robot based on particle swarm genetic optimization[J]. Machinery & Electronics,2007(10):45-48. doi: 10.3969/j.issn.1001-2257.2007.10.016
[35]	姜健,臧希喆,闫继宏,等. 基于一种蚁群算法的多机器人动态感知任务分配[J]. 机器人,2008(3):254-258,263. doi: 10.3321/j.issn:1002-0446.2008.03.011 JIANG Jian,ZANG Xizhe,YAN Jihong,et al. Multi-robot dynamically perceived task allocation based on an ant colony algorithm[J]. Robot,2008(3):254-258,263. doi: 10.3321/j.issn:1002-0446.2008.03.011
[36]	张子迎,陈云飞,王宇华,等. 基于启发式深度Q学习的多机器人任务分配算法[J]. 哈尔滨工程大学学报,2022,43(6):857-864. ZHANG Ziying,CHEN Yunfei,WANG Yuhua,et al. Multi-robot task allocation algorithm based on heuristically accelerated deep Q network[J]. Journal of Harbin Engineering University,2022,43(6):857-864.