Cache-oblivious B-trees

We present dynamic search-tree data structures that perform well in the setting of a hierarchical memory (including various levels of cache, disk, etc.), but do not depend on the number of memory levels, the block sizes and number of blocks at each level, or the relative speeds of memory access. In particular between any pair of bevels in the memory hierarchy, where transfers between the levels are done in blocks of size B, our data structures match the optimal search bound of Theta (log(B) N) memory transfers. This bound is also achieved by the classic B-tree data structure, but only when the block size B is known, which in practice requires careful tuning on each machine platform. One of our data structures supports insertions and deletions in Theta (log(B) N) amortized memory transfers, which matches the B-tree's worst-case bounds. We augment this structure to support scans optimally in Theta (N/B) memory transfers. In this second data structure insertions and deletions require Theta (log(B) N + log(2) N/B) amortized memory transfers. Thus, we match the performance of the B-tree for B = Omega (log N log log N).