Abstract: According to the pattern recognition theory, the principle of on line recognition and automation selection of coal gangues from coal bulk using image processing technology was discussed in the paper. The system’s structure based on CAN controller with single-chip microcomputer was proposed, the design methods of system’s hardware and software were introduced, and the anti-disturbance methods were also discussed.