From the perspective of behavior game,a general mathematical model measuring the effec- tiveness of the behavior incentive mechanism is established,and a cost optimization method is put for- ward as well,which offers a new way to make the quantitative and statistical analysis of behavior in- centive mechanism.Taking advantage of the relevant research findings in the thesis,a diagnosis exam- ple and the improvement of behavior incentive mechanism in respect of teachers' scientific research in higher educational institutions are provided.