An Improved kNN Based on Class Contribution and Feature Weighting

Aiming at the problem that the kNN algorithm is susceptible to the choice of k-nearest neighbors and the method of class judgment, this paper propose a kNN algorithm based on class contribution and feature weighting called DCT-kNN. Firstly, using traditional kNN to calculate accuarcy of original dataset and of the data lack of each dimension feature successively. Then by comparing two accuarcies to weight the feature and to calculate the weighted distance, by which the k-nearest neighbors are obtained. Finally, by using class contribution which combines the number of k-nearest neighbors and their mean distance, the final labels of the samples are obtained. The comparison experiment of UCI datasets showed a certain degree of improvement in classification accuracy of the proposed method.