This paper presents the performance analysis of recursive least square algorithm with error-saturation in mixture noise.The algorithm is referred to nonlinear RLS (NRLS).Generalized clipping function is considered for the error-saturation nonlinearity.An improved mean square behavior of NRLS is carried out.It is shown that the theoretical analysis and the simulation result are close to each other.From the analysis

we can relate the convergence and the mean square error in terms of the slope and the clipping level of the nonlinear function.Based on the normalized mean square error

an instrumental variable is derived for yielding a variable clipping function to provide fast convergence and small mean square error.