SEI based intelligent monitoring video transmission method for coal mines

Currently, there is a high latency problem in the transmission of video surveillance data in coal mines, and the main cause of video transmission delay is encoding delay. In order to solve the above problems, a intelligent monitoring video transmission method for coal mines based on media supplemental enhancement information(SEI) without video encoding is proposed. This method caches a copy of the compressed video frame obtained by demultiplexing the video stream, and decodes the compressed video frame to obtain the decoded video frame. The method stores the AI model analysis results in the decoded video frame through SEI, writes the custom SEI into the network extraction layer unit corresponding to the compressed video frame copy of the decoded video frame based on the timestamp correspondence. The method multiplexes the compressed video frame copy to achieve real-time transmission of coal mine intelligent monitoring videos. Experimental testing of this method is conducted on a 24 core CPU. The results show that for videos with a resolution of 1280×720, the overall CPU utilization rate for video processing using this method decreases from 24.7% to 36.3% when using traditional methods to 20.3% to 23.9%. The end-to-end delay decreases from 1946 ms to 345 ms. For videos with a resolution of 1920×1080, the overall CPU utilization rate for video processing using this method decreases from 29.2% to 41.8% using traditional methods to 18.5% to 26.3%. The end-to-end latency decreases from 6204 ms to 479 ms. This method reduces the transmission delay of coal mine intelligent monitoring videos by avoiding the video encoding process, saves CPU or GPU resources required for video encoding, and reduces the hardware cost of the intelligent video monitoring system.