基于矿工操作姿态识别的井下钻机钻杆计数算法

Drill pipe counting for underground drilling rigs based on miner pose recognition

  • 摘要:
    在煤矿井下工作现场,钻机钻杆与监控摄像装置之间会出现移动的人和物,导致拍摄的视频图像不完整、钻杆计数缺失,目前基于图像处理和机器视觉的钻杆计数方法对遮挡问题的研究较少;现有大部分钻杆计数模型需要采集与处理目标视频图像的全部帧,且需要图像预处理操作。针对上述问题,提出了一种基于矿工操作姿态识别的井下钻机钻杆计数算法——BlazePose−DPC算法。该算法基于BlazePose网络提取矿工的关键姿态信息作为钻机钻杆自动计数的依据,把钻杆计数问题转化为矿工操作关键姿态的识别和匹配问题。通过BlazePose网络从关键姿态帧中提取骨骼关节点坐标,使用归一化的欧氏距离表示姿态之间的相似度实现关键姿态坐标匹配。当相似度大于设定的阈值时,表示视频中的动作完成,计数加1,实现钻杆的自动计数。将BlazePose−DPC算法在数据集1和数据集2上进行实验,数据集1来自陕西旬邑青岗坪煤矿,由移动设备录制,易出现不稳定状况,数据集2来自华能庆阳煤电核桃峪煤矿,通过固定监控设备录制,易出现光照不均、遮挡等状况。实验结果表明:
    在有光照影响场景或人物显示不全的场景中,BlazePose−DPC算法能够实现准确计数;在较长时间运行过程中,BlazePose−DPC算法依然可以正确计数,表现出稳定的性能;BlazePose−DPC算法的准确率为95.5%,满足钻杆计数的要求。

     

    Abstract: In underground coal mine work sites, moving people and objects may appear between the drill pipes and the monitoring camera, resulting in incomplete video footage and counting omissions of drill pipes. At present, studies on drill pipe counting methods based on image processing and machine vision rarely address the problem of occlusion. Most existing models require collecting and processing all frames of the target video and performing image preprocessing. To address the above issues, a drill pipe counting algorithm for underground drilling rigs based on miner operation pose recognition named the BlazePose-DPC algorithm, was proposed. This algorithm used the BlazePose network to extract key pose information of miners as the basis for automatic drill pipe counting, transforming the drill pipe counting task into the recognition and matching of key operational poses of miners. Key poses were extracted as skeletal joint coordinates from key pose frames via the BlazePose network. Key pose coordinate matching used normalized Euclidean distance to represent the similarity between poses. When the similarity exceeded a predefined threshold, the action in the video was considered complete, and the count was incremented by one, thereby enabling automatic drill pipe counting. Experiments on the BlazePose-DPC algorithm were conducted using two datasets. Dataset 1 was recorded by a mobile device at the Qinggangping Coal Mine in Xunyi, Shaanxi Province, where video instability was common. Dataset 2 was recorded by a fixed surveillance device at the Huaneng Qingyang Meidian Hetaoyu Coal Mine, where uneven lighting and occlusion were common. Experimental results showed that the BlazePose-DPC algorithm was able to perform accurate counting even under challenging lighting conditions or partial occlusion. It maintained accurate counting during prolonged operation, demonstrating stable performance. The BlazePose-DPC algorithm achieved an accuracy of 95.5%, meeting the requirements for drill pipe counting.

     

/

返回文章
返回