In this letter, a new rapid converging method based on orthogonalization is proposed. Our approach is to find the near-optimum coefficient values during training period, and then use them as the initial values of the LMS algorithm. The numerical results show that the rapid convergence speed of the proposed scheme does not depend on the eigenvalue spread.