A differential method for capacity control is presented based on the analysis of the capacity of learning machines.Our method that can be applicable to the set of nonlinear hypothesis functions as well as the set of linear ones generalizes the theory about the capacity control of SVMs.A new learning machine is proposed based on differential capacity control method.In our learning machine
a good generalization performance can be obtained by the right balance struck between the empirical risk and the differential of the set of hypothesis functions that controls the machine capacity.Simulation results show the feasibility of our learning machine.