Search Results

We study the internal dictionary matching (IDM) problem where a dictionary 𝒟 containing d substrings of a text T over a linearly sortable alphabet is given, and each query concerns the occurrences of patterns in 𝒟 in another substring of T. We propose a novel O(n)-sized data structure named Basic Substring Structure (BASS) where n is the length of the text T. With BASS, we are able to handle all types of queries in the IDM problem in nearly optimal query and preprocessing time. Specifically, our results include: - The first algorithm that answers the CountDistinct query in Õ(1) time with Õ(n+d) preprocessing, where we need to compute the number of distinct patterns that exist in T[l,r]. Previously, the best result was Õ(m) time per query after Õ(n²/m+d) or Õ(nd/m+d) preprocessing, where m is a chosen parameter. - Faster algorithms for two other types of internal queries. We improve the runtime for (1) Occurrence counting (Count) queries to O(log n/log log n) time per query with O(n+d√{log n}) preprocessing from O(log² n/log log n) time per query with O(nlog n/log log n + d log^{3/2} n) preprocessing. (2) Distinct pattern reporting (ReportDistinct) queries to O(1+|output|) time per query from O(log n+|output|) per query. In addition, we match the optimal runtime in the remaining two types of queries, pattern existence (Exists), and occurrence reporting (Report). We also show that BASS is more generally applicable to other internal query problems.