Improving accuracy and diversity of personalized recommendation through power law adjustments of user similarities

Recommender systems have become more and more indispensable in both commercial and research communities, due to the increasingly serious problem of information overload accompanying the rapid development of the internet technology in the recent years. As one of the dominant branches, collaborative filtering approaches base on similarities of user preferences in historical data have achieved remarkable successes in producing personalized recommendations. Nevertheless, the existence of popular objects may adversely influence the correct scoring of candidate objects and further yield unreasonable recommendation results. Meanwhile, it has been increasingly recognized that the gains of the recommendation accuracy are often accompanied by the losses of the diversity, yielding the accuracy-diversity dilemma for a personalized recommender system. In order to overcome these limitations while keeping a reasonable tradeoff between the accuracy and the diversity, we propose in this paper a method called PLUS (Power Law adjustments of User Similarities) to achieve personalized recommendations via the introduction of a power function to adjust user similarity scores, for the purpose of reducing adverse effects of popular objects in the user-based collaborative filtering framework. We perform a series of large scale validation experiments on two real data sets (MovieLens and Netflix) and compare the performance of our approach against that of an ordinary collaborative filtering method. Results show that our method outperforms the existing method not only in recommendation accuracy measured by the mean rank ratio and the recall enhancement, but also in recommendation diversity quantified by the mean personality and the mean novelty. (C) 2013 Elsevier B.V. All rights reserved.