Amir, Amihood ;
Kopelowitz, Tsvi ;
Levy, Avivit ;
Pettie, Seth ;
Porat, Ely ;
Shalom, B. Riva
Mind the Gap: Essentially Optimal Algorithms for Online Dictionary Matching with One Gap
Abstract
We examine the complexity of the online Dictionary Matching with One Gap Problem (DMOG) which is the following. Preprocess a dictionary D of d patterns, where each pattern contains a special gap symbol that can match any string, so that given a text that arrives online, a character at a time, we can report all of the patterns from D that are suffixes of the text that has arrived so far, before the next character arrives. In more general versions the gap symbols are associated with bounds determining the possible lengths of matching strings. Online DMOG captures the difficulty in a bottleneck procedure for cybersecurity, as many digital signatures of viruses manifest themselves as patterns with a single gap.
In this paper, we demonstrate that the difficulty in obtaining efficient solutions for the DMOG problem, even in the offline setting, can be traced back to the infamous 3SUM conjecture. We show a conditional lower bound of Omega(delta(G_D)+op) time per text character, where G_D is a bipartite graph that captures the structure of D, delta(G_D) is the degeneracy of this graph, and op is the output size. Moreover, we show a conditional lower bound in terms of the magnitude of gaps for the bounded case, thereby showing that some known offline upper bounds are essentially optimal.
We also provide matching upperbounds (up to subpolynomial factors), in terms of the degeneracy, for the online DMOG problem. In particular, we introduce algorithms whose time cost depends linearly on delta(G_D). Our algorithms make use of graph orientations, together with some additional techniques. These algorithms are of practical interest since although delta(G_D) can be as large as sqrt(d), and even larger if G_D is a multigraph, it is typically a very small constant in practice. Finally, when delta(G_D) is large we are able to obtain even more efficient solutions.
BibTeX  Entry
@InProceedings{amir_et_al:LIPIcs:2016:6784,
author = {Amihood Amir and Tsvi Kopelowitz and Avivit Levy and Seth Pettie and Ely Porat and B. Riva Shalom},
title = {{Mind the Gap: Essentially Optimal Algorithms for Online Dictionary Matching with One Gap}},
booktitle = {27th International Symposium on Algorithms and Computation (ISAAC 2016)},
pages = {12:112:12},
series = {Leibniz International Proceedings in Informatics (LIPIcs)},
ISBN = {9783959770262},
ISSN = {18688969},
year = {2016},
volume = {64},
editor = {SeokHee Hong},
publisher = {Schloss DagstuhlLeibnizZentrum fuer Informatik},
address = {Dagstuhl, Germany},
URL = {http://drops.dagstuhl.de/opus/volltexte/2016/6784},
URN = {urn:nbn:de:0030drops67841},
doi = {10.4230/LIPIcs.ISAAC.2016.12},
annote = {Keywords: Pattern matching, Dictionary matching, 3SUM, Triangle reporting}
}
2016
Keywords: 

Pattern matching, Dictionary matching, 3SUM, Triangle reporting 
Seminar: 

27th International Symposium on Algorithms and Computation (ISAAC 2016)

Issue date: 

2016 
Date of publication: 

2016 