In order to improve the retrieval accuracy of content-based image retrieval systems and reducing the 'semantic gap’ between the visual features and the richness of human semantics.We proposed an user multimedia data management model.The user multimedia data management model includes user semantic model、user interest model and user intention model.Experiments show that user multimedia data management model can be successfully used in individuation image retrieval and individuation recommendation service.