Incorporation of Efficient Second-Order Solvers Into Latent Factor Models for Accurate Prediction of Missing QoS Data

被引:193
作者
Luo, Xin [1 ,2 ]
Zhou, MengChu [3 ,4 ]
Li, Shuai [5 ]
Xia, Yunni [6 ,7 ]
You, Zhu-Hong [5 ]
Zhu, QingSheng [6 ,7 ]
Leung, Hareton [5 ]
机构
[1] Chinese Acad Sci, Chongqing Key Lab Big Data & Intelligent Comp, Chongqing Inst Green & Intelligent Technol, Chongqing 400714, Peoples R China
[2] Shenzhen Univ, Coll Comp Sci & Engn, Shenzhen 518060, Peoples R China
[3] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[4] King Abdulaziz Univ, Renewable Energy Res Grp, Jeddah, Saudi Arabia
[5] Hong Kong Polytech Univ, Dept Comp, Hong Kong 999077, Hong Kong, Peoples R China
[6] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[7] Chongqing Univ, Chongqing Key Lab Software Theory & Technol, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
Big data; latent factor model; missing data prediction; quality-of-service (QoS); second-order solver; service computing sparse matrices; Web service; NONNEGATIVE MATRIX-FACTORIZATION; RECOMMENDER;
D O I
10.1109/TCYB.2017.2685521
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Generating highly accurate predictions for missing quality-of-service (QoS) data is an important issue. Latent factor (LF)-based QoS-predictors have proven to be effective in dealing with it. However, they are based on first-order solvers that cannot well address their target problem that is inherently bilinear and nonconvex, thereby leaving a significant opportunity for accuracy improvement. This paper proposes to incorporate an efficient second-order solver into them to raise their accuracy. To do so, we adopt the principle of Hessian-free optimization and successfully avoid the direct manipulation of a Hessian matrix, by employing the efficiently obtainable product between its Gauss-Newton approximation and an arbitrary vector. Thus, the second-order information is innovatively integrated into them. Experimental results on two industrial QoS datasets indicate that compared with the state-of-the-art predictors, the newly proposed one achieves significantly higher prediction accuracy at the expense of affordable computational burden. Hence, it is especially suitable for industrial applications requiring high prediction accuracy of unknown QoS data.
引用
收藏
页码:1216 / 1228
页数:13
相关论文
共 57 条
[1]  
Alrifai Mohammad, 2010, P 19 INT C WORLD WID, P11, DOI DOI 10.1145/1772690.1772693
[2]  
[Anonymous], 2010, ICML
[3]  
[Anonymous], 2003, SIGECOM EXCH
[4]   Adaptive service composition in flexible processes [J].
Ardagna, Danilo ;
Pernici, Barbara .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2007, 33 (06) :369-384
[5]  
Buchanan AM, 2005, PROC CVPR IEEE, P316
[6]   ON THE USE OF STOCHASTIC HESSIAN INFORMATION IN OPTIMIZATION METHODS FOR MACHINE LEARNING [J].
Byrd, Richard H. ;
Chin, Gillian M. ;
Neveitt, Will ;
Nocedal, Jorge .
SIAM JOURNAL ON OPTIMIZATION, 2011, 21 (03) :977-995
[7]   Hybrid Collaborative Filtering algorithm for bidirectional Web service recommendation [J].
Cao, Jie ;
Wu, Zhiang ;
Wang, Youquan ;
Zhuang, Yi .
KNOWLEDGE AND INFORMATION SYSTEMS, 2013, 36 (03) :607-627
[8]   A reduced-order approach to four-dimensional variational data assimilation using proper orthogonal decomposition [J].
Cao, Yanhua ;
Zhu, Jiang ;
Navon, I. M. ;
Luo, Zhendong .
INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN FLUIDS, 2007, 53 (10) :1571-1583
[9]   HESSIAN MATRIX VS. GAUSS-NEWTON HESSIAN MATRIX [J].
Chen, Pei .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 2011, 49 (04) :1417-1435
[10]   Web Service Recommendation via Exploiting Location and QoS Information [J].
Chen, Xi ;
Zheng, Zibin ;
Yu, Qi ;
Lyu, Michael R. .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2014, 25 (07) :1913-1924