Asynchronous and Fault-Tolerant Recursive Datalog Evaluation in Shared-Nothing Engines

被引:1
作者
Wang, Jingjing [1 ]
Balazinska, Magdalena [1 ]
Halperin, Daniel [1 ]
机构
[1] Univ Washington, Dept Comp Sci & Engn, Seattle, WA 98195 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2015年 / 8卷 / 12期
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We present a new approach for data analytics with iterations. Users express their analysis in Datalog with bag-monotonic aggregate operators, which enables the expression of computations from a broad variety of application domains. Queries are translated into query plans that can execute in shared-nothing engines, are incremental, and support a variety of iterative models (synchronous, asynchronous, different processing priorities) and failure-handling techniques. The plans require only small extensions to an existing shared-nothing engine, making the approach easily implementable. We implement the approach in the Myria big-data management system and use our implementation to empirically study the performance characteristics of different combinations of iterative models, failure handling methods, and applications. Our evaluation uses workloads from a variety of application domains. We find that no single method outperforms others but rather that application properties must drive the selection of the iterative query execution model.
引用
收藏
页码:1542 / 1553
页数:12
相关论文
共 41 条
  • [1] Abouzeid A., 2009, VLDB
  • [2] Afrati F. N., 2011, EDBT
  • [3] Alsubaiee S., 2014, VLDB
  • [4] Alvaro P., 2011, CIDR
  • [5] Arpaci-Dusseau R. H., 1999, IOPADS
  • [6] Borkar V., 2011, ICDE
  • [7] Bu Y., 2014, VLDB
  • [8] Bu Y., 2010, VLDB
  • [9] Conway N., 2012, SOCC
  • [10] de Oliveira D. E. M., 2013, SBBD