Abstract: For the problem that mine geological record uses manual recognition for handwritten numbers with low efficiency, the paper proposed an automatic recognition method of handwritten numbers, and introduced steps of color filtering and positioning of number area, number divide, sample training and number recognition in details. The method uses computer image processing technology to locate and identify numbers in specific region automatically, which improves work efficiency.