Incorporation of Efficient Second-Order Solvers Into Latent Factor Models for Accurate Prediction of Missing QoS Data

被引:193
作者
Luo, Xin [1 ,2 ]
Zhou, MengChu [3 ,4 ]
Li, Shuai [5 ]
Xia, Yunni [6 ,7 ]
You, Zhu-Hong [5 ]
Zhu, QingSheng [6 ,7 ]
Leung, Hareton [5 ]
机构
[1] Chinese Acad Sci, Chongqing Key Lab Big Data & Intelligent Comp, Chongqing Inst Green & Intelligent Technol, Chongqing 400714, Peoples R China
[2] Shenzhen Univ, Coll Comp Sci & Engn, Shenzhen 518060, Peoples R China
[3] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[4] King Abdulaziz Univ, Renewable Energy Res Grp, Jeddah, Saudi Arabia
[5] Hong Kong Polytech Univ, Dept Comp, Hong Kong 999077, Hong Kong, Peoples R China
[6] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[7] Chongqing Univ, Chongqing Key Lab Software Theory & Technol, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
Big data; latent factor model; missing data prediction; quality-of-service (QoS); second-order solver; service computing sparse matrices; Web service; NONNEGATIVE MATRIX-FACTORIZATION; RECOMMENDER;
D O I
10.1109/TCYB.2017.2685521
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Generating highly accurate predictions for missing quality-of-service (QoS) data is an important issue. Latent factor (LF)-based QoS-predictors have proven to be effective in dealing with it. However, they are based on first-order solvers that cannot well address their target problem that is inherently bilinear and nonconvex, thereby leaving a significant opportunity for accuracy improvement. This paper proposes to incorporate an efficient second-order solver into them to raise their accuracy. To do so, we adopt the principle of Hessian-free optimization and successfully avoid the direct manipulation of a Hessian matrix, by employing the efficiently obtainable product between its Gauss-Newton approximation and an arbitrary vector. Thus, the second-order information is innovatively integrated into them. Experimental results on two industrial QoS datasets indicate that compared with the state-of-the-art predictors, the newly proposed one achieves significantly higher prediction accuracy at the expense of affordable computational burden. Hence, it is especially suitable for industrial applications requiring high prediction accuracy of unknown QoS data.
引用
收藏
页码:1216 / 1228
页数:13
相关论文
共 57 条
[41]   Fast curvature matrix-vector products for second-order gradient descent [J].
Schraudolph, NN .
NEURAL COMPUTATION, 2002, 14 (07) :1723-1738
[42]  
Shani G, 2011, RECOMMENDER SYSTEMS HANDBOOK, P257, DOI 10.1007/978-0-387-85820-3_8
[43]  
Shao LS, 2007, 2007 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, PROCEEDINGS, P439
[44]  
Sutskever I, 2013, INT C MACH LEARN, V28, P1139
[45]  
Takács G, 2009, J MACH LEARN RES, V10, P623
[46]  
Tan W, 2013, BUSINESS AND SCIENTIFIC WORKFLOWS: A WEB SERVICE-ORIENTED APPROACH, P1, DOI 10.1002/9781118554609
[47]  
Wei Lo, 2012, Proceedings of the 2012 IEEE 19th International Conference on Web Services (ICWS), P464, DOI 10.1109/ICWS.2012.49
[48]   Highly Efficient Framework for Predicting Interactions Between Proteins [J].
You, Zhu-Hong ;
Zhou, MengChu ;
Luo, Xin ;
Li, Shuai .
IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (03) :731-743
[49]   Efficient Algorithms for Web Services Selection with End-to-End QoS Constraints [J].
Yu, Tao ;
Zhang, Yue ;
Lin, Kwei-Jay .
ACM TRANSACTIONS ON THE WEB, 2007, 1 (01)
[50]   QoS-aware middleware for Web Services Composition [J].
Zeng, LZ ;
Benatallah, B ;
Ngu, AHH ;
Dumas, M ;
Kalagnanam, J ;
Chang, H .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2004, 30 (05) :311-327