Blelloch, Guy E. ;
Fineman, Jeremy T. ;
Gibbons, Phillip B. ;
Gu, Yan ;
Shun, Julian
Efficient Algorithms with Asymmetric Read and Write Costs
Abstract
In several emerging technologies for computer memory (main memory), the cost of reading is significantly cheaper than the cost of writing. Such asymmetry in memory costs poses a fundamentally different model from the RAM for algorithm design. In this paper we study lower and upper bounds for various problems under such asymmetric read and write costs. We consider both the case in which all but O(1) memory has asymmetric cost, and the case of a small cache of symmetric memory. We model both cases using the (M,omega)ARAM, in which there is a small (symmetric) memory of size M and a large unbounded (asymmetric) memory, both random access, and where reading from the large memory has unit cost, but writing has cost omega >> 1.
For FFT and sorting networks we show a lower bound cost of Omega(omega*n*log_{omega*M}(n)), which indicates that it is not possible to achieve asymptotic improvements with cheaper reads when omega is bounded by a polynomial in M. Moreover, there is an asymptotic gap (of min(omega,log(n)/log(omega*M)) between the cost of sorting networks and comparison sorting in the model. This contrasts with the RAM, and most other models, in which the asymptotic costs are the same. We also show a lower bound for computations on an n*n diamond DAG of Omega(omega*n^2/M) cost, which indicates no asymptotic improvement is achievable with fast reads. However, we show that for the minimum edit distance problem (and related problems), which would seem to be a diamond DAG, we can beat this lower bound with an algorithm with only O(omega*n^2/(M*min(omega^{1/3},M^{1/2}))) cost. To achieve this we make use of a "path sketch" technique that is forbidden in a strict DAG computation. Finally, we show several interesting upper bounds for shortest path problems, minimum spanning trees, and other problems. A common theme in many of the upper bounds is that they require redundant computation and a tradeoff between reads and writes.
BibTeX  Entry
@InProceedings{blelloch_et_al:LIPIcs:2016:6365,
author = {Guy E. Blelloch and Jeremy T. Fineman and Phillip B. Gibbons and Yan Gu and Julian Shun},
title = {{Efficient Algorithms with Asymmetric Read and Write Costs}},
booktitle = {24th Annual European Symposium on Algorithms (ESA 2016)},
pages = {14:114:18},
series = {Leibniz International Proceedings in Informatics (LIPIcs)},
ISBN = {9783959770156},
ISSN = {18688969},
year = {2016},
volume = {57},
editor = {Piotr Sankowski and Christos Zaroliagis},
publisher = {Schloss DagstuhlLeibnizZentrum fuer Informatik},
address = {Dagstuhl, Germany},
URL = {http://drops.dagstuhl.de/opus/volltexte/2016/6365},
URN = {urn:nbn:de:0030drops63656},
doi = {10.4230/LIPIcs.ESA.2016.14},
annote = {Keywords: Computational Model, Lower Bounds, Shortestpaths, NonVolatile Memory, Sorting Networks, Fast Fourier Transform, Diamond DAG, Minimum Spanning Tree}
}
2016
Keywords: 

Computational Model, Lower Bounds, Shortestpaths, NonVolatile Memory, Sorting Networks, Fast Fourier Transform, Diamond DAG, Minimum Spanning Tree 
Seminar: 

24th Annual European Symposium on Algorithms (ESA 2016)

Issue date: 

2016 
Date of publication: 

2016 