In order to overcome shortcomings of traditional CHMM applied in speech recognition system,the paper proposed a hybrid model composed by CHMM and MLP network.The hybrid model introduced MLP in CHMM to calculate output probability of each state.In order to strengthen and improve speech recognition ability of CHMM,it analyzed and classified output probability by nonlinear prediction capability of MLP network instead of likelihood estimated value in CHMM.The experiment result showed that the hybrid model applied in speech recognition system has higher recognition ratio than that of traditional CHMM.