Relation Modeling and State Evolution for Operation-State Recognition in Coal Mine Drilling

  • 摘要: 煤矿井下钻进作业视频监测易受到低照度、粉尘模糊、矿灯眩光、目标遮挡和人员与设备交互复杂等因素影响,传统单帧图像分类和“目标检测+规则判定”方法难以稳定表征连续作业状态,尤其在人员靠近钻杆、低可见度作业和异常风险识别中易产生漏报与误报。为提高复杂井下环境下钻进作业状态识别的准确性、鲁棒性和实时性,提出一种退化感知关系引导作业状态演化网络(Degradation-aware Relation-guided Operation State Evolution Network,DROSE-Net)。该方法的核心在于构建“退化感知关系状态表示,连续作业状态演化推理”一体化模型框架,将井下钻进视频由目标检测结果判定扩展为作业状态理解与异常风险识别。首先,针对公开煤矿井下钻进作业数据集DsDPM 66缺少状态级标注的问题,基于目标框标注、矿工与钻杆空间关系、图像退化评分和风险判定规则构建作业状态弱标签,并通过样本权重和人工复核降低边界样本噪声影响;其次,将目标类别、人员与设备空间关系、防护装备可见性、检测置信度、图像退化信息和未知可疑区域统一编码为结构化作业状态标记,使目标检测结果转化为作业状态级语义证据;最后,引入状态空间演化建模,对连续视频帧中的作业状态变化进行约束,实现设备空闲、正常钻进、人员与钻杆交互、低可见度作业和异常风险5类状态识别。实验结果表明,DROSE-Net的准确率、宏平均F1值和宏平均受试者工作特征曲线下面积分别为94.12%、93.22%和96.48%,均高于单帧分类、检测规则、视频识别和状态标记建模等对比方法。异常风险状态的AUPRC达到0.932,说明该方法在较高召回率条件下仍能保持较高精确率。退化场景实验和消融实验结果表明,退化感知关系状态表示和连续状态演化推理能够减弱低照度、粉尘模糊、眩光和遮挡对状态判断的影响。实时性实验结果表明,模型单帧推理时间为18.6 ms,FPS达到53.8。结果表明,DROSE-Net可为煤矿井下钻进作业视频监测、异常风险提示和智能安全管理提供辅助支撑。

     

    Abstract: Video monitoring of underground drilling operations in coal mines is easily affected by factors such as low illumination, dust blurring, miner lamp glare, target obstruction, and complex personnel-equipment interactions. Traditional single-frame image classification and "target detection + rule-based judgment" methods are difficult to reliably represent continuous operation states, especially in situations where personnel are close to the drill pipe, operations are conducted in low visibility, and anomaly risk identification is prone to false alarms and missed detections. To improve the accuracy, robustness, and real-time performance of drilling operation state identification in complex underground environments, a Degradation-aware Relation-guided Operation State Evolution Network (DROSE-Net) is proposed. The core of this method lies in constructing an integrated model framework of "degradation-aware relation state representation - continuous operation state evolution reasoning," extending underground drilling video from target detection result judgment to operation state understanding and anomaly risk identification. First, addressing the lack of state-level annotations in the publicly available coal mine underground drilling operation dataset DsDPM 66, weak labels for operation states are constructed based on target bounding box annotations, miner-drill rod spatial relationships, image degradation scores, and risk assessment rules. The impact of boundary sample noise is reduced through sample weighting and manual verification. Second, target categories, personnel-equipment spatial relationships, protective equipment visibility, detection confidence, image degradation information, and unknown suspicious regions are uniformly encoded into structured operation state labels, transforming target detection results into semantic evidence at the operation state level. Finally, state space evolution modeling is introduced to constrain changes in operation states within continuous video frames, enabling the identification of five state categories: equipment idle, normal drilling, personnel-drill rod interaction, low visibility operation, and abnormal risk. Experimental results show that DROSE-Net achieves accuracy, macro-average F1 score, and macro-average area under the receiver operating characteristic curve (AUC) of 94.12%, 93.22%, and 96.48%, respectively, all higher than comparable methods such as single-frame classification, detection rules, video recognition, and state labeling modeling. The AUPRC for abnormal risk states reaches 0.932, indicating that the method maintains high precision even with high recall. Degraded scene experiments and ablation experiments show that the degraded perception relation state representation and continuous state evolution reasoning can mitigate the impact of low illumination, dust blurring, glare, and occlusion on state judgment. Real-time performance experiments show that the model's single-frame inference time is 18.6 ms, with an FPS of 53.8. These results demonstrate that DROSE-Net can provide auxiliary support for video monitoring, abnormal risk alerts, and intelligent safety management in coal mine underground drilling operations.

     

/

返回文章
返回