By modifying the Lagrange multipliers

both equality and inequality constraints can be treated identically.Based on this idea

a new type of Lagrange nonlinear programming neural network is constructed

and the stability and convergence of the neural network are analyzed rigorously.Furthermore

the convergence condition of the network is relaxed by the approach of adding the penalty terms in the Lagrangian function.