基于关系建模与状态演化的煤矿钻进作业状态识别

Recognition of coal mine drilling operation states based on relation modeling and state evolution

  • 摘要: 针对煤矿井下钻进作业视频受低照度、粉尘模糊、眩光和目标遮挡影响,单帧检测结果难以稳定反映连续作业状态的问题,提出一种关系建模与状态演化的煤矿钻进作业状态识别方法,通过退化感知关系引导的作业状态演化网络(DROSE−Net)实现作业主状态判定与异常风险感知。将作业行为、环境可见度和异常风险定义为可共存的底层属性,将其映射为异常风险、低可见度作业、人员与钻杆交互、正常钻进和设备空闲5类唯一作业主状态;基于目标框标注、人员与钻杆空间关系、图像退化评分及风险规则构建弱标签,采用边界样本降权和人工复核机制提高标签可靠性;将目标语义、空间关系、图像退化、未知可疑区域和检测置信度编码为结构化状态token,利用状态空间模型更新连续帧隐状态,由主状态分类头输出离散作业状态、独立风险分支输出连续异常风险概率。采用煤矿井下钻进作业数据集DsDPM 66进行实验验证,结果表明:DROSE−Net的准确率、宏平均F1分数和宏平均受试者工作特征曲线下面积(AUC)分别为94.12%,93.21%和96.48%,异常风险精确率–召回率曲线下面积(AUPRC)为0.932;在相同状态token输入条件下,其准确率和宏平均F1分数较Token−Transformer分别提高2.86%和2.90%;单帧推理时间为18.6 ms,处理速度达53.8帧/s。研究结果验证了结构化状态表达与时序演化建模完整流程的有效性,可为煤矿井下钻进作业视频监测和异常风险提示提供辅助支撑。

     

    Abstract: Low illumination, dust-induced blur, glare, and target occlusion in underground coal mine drilling videos make it difficult for single-frame detection results to reliably reflect continuous operation states. To address this problem, a method for recognizing coal mine drilling operation states through relation modeling and state evolution was proposed. A Degradation-Aware Relation-Guided Operation State Evolution Network (DROSE-Net) was developed to determine primary operation states and perceive abnormal risks. Operational behavior, environmental visibility, and abnormal risk were defined as underlying attributes that could coexist and were mapped to a single primary operation state selected from five classes: abnormal risk, low-visibility operation, personnel–drill rod interaction, normal drilling, and equipment idleness. Weak labels were constructed from bounding-box annotations, spatial relationships between personnel and drill rods, image degradation scores, and risk rules. Downweighting of boundary samples and manual review were used to improve label reliability. Object semantics, spatial relationships, image degradation, unknown suspicious regions, and detection confidence were encoded as structured state tokens. A state-space model updated the hidden state across consecutive frames, with the primary-state classification head outputting discrete operation states and an independent risk branch outputting a continuous abnormal-risk probability. Experiments on the underground coal mine drilling operation dataset DsDPM 66 showed that DROSE-Net achieved an accuracy of 94.12%, a macro-averaged F1 score of 93.21%, and a macro-averaged Area under the Receiver Operating Characteristic Curve (AUC) of 96.48%. Its Area under the Precision–Recall Curve (AUPRC) for abnormal risk was 0.932. With identical state-token inputs, its accuracy and macro-averaged F1 score exceeded those of Token-Transformer by 2.86% and 2.90%, respectively. Single-frame inference took 18.6 ms, corresponding to a processing speed of 53.8 frames/s. These results validate the effectiveness of the complete pipeline integrating structured state representation and temporal evolution modeling and provide auxiliary support for video monitoring of underground coal mine drilling operations and abnormal-risk alerts.

     

/

返回文章
返回