To prompt the effect of image rectify in the Chinese business card automatic recognition system, in the paper, a new algorithm is proposed, which makes use of the areas that the gradient pixel occupies to carry out the interpolation and to get the objective gray-level. Applying the algorithm to business card recognition system and using the skew angle and the border gained from the system, excellent corrected results will be obtained.