Gamma Acyclicity, Annotated Relations, and Consistency Witness Functions
Abstract
During the early days of relational database theory it was realized that “acyclic” database schemas possess a number of desirable properties. In fact, three different notions of “acyclicity” were identified and investigated during the 1980s, namely, -acyclicity, -acyclicity, and -acyclicity. Much more recently, the study of -acyclicity was extended to annotated relations, where the annotations are values from some positive commutative monoid. The recent results about -acyclic schemas and annotated relations give rise to results about -acyclic schemas and annotated relations, since a schema is -acyclic if and only if every sub-schema of it is -acyclic. Here, we study -acyclic schemas and annotated relations. Our main finding is that the characterization of -acyclic schemas in terms of monotone sequential join expression extends to annotated relations, provided the annotations come from a positive commutative monoid that has the inner consistency property. Furthermore, the results reported here shed light on the role of the join of two standard relations. Specifically, our results reveal that the only relevant property of the join of two standard relations is that it is a witness to the consistency of the two relations, provided that these two relations are consistent. For the more abstract setting of annotated relations, this property of the standard join is captured by the notion of a consistency witness function, a notion which we systematically utilize in this work.
Keywords and phrases:
annotated relations, gamma-acyclicity, consistency witness functionsFunding:
Albert Atserias: Atserias was partially supported by grant PID2022-138506NB-C22 (PROOFS BEYOND) and the Severo Ochoa and María de Maeztu Program for Centers and Units of Excellence in R&D (CEX2020-001084-M) of the AEI, and the CERCA and ICREA Academia Programmes of the Generalitat de Catalunya.Copyright and License:
2012 ACM Subject Classification:
Information systems Relational database model ; Theory of computation Database theoryEditors:
Balder ten Cate and Maurice FunkSeries and Publisher:
Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik
1 Introduction
Annotated databases are databases in which each fact in a relation is annotated with a value from some algebraic structure. Starting with the influential work on database provenance [12, 13], there has been an extensive investigation of several different aspects of annotated databases, including the study of conjunctive query containment for annotated databases [11, 15] and the evaluation of Datalog programs on annotated databases [14]. In these investigations, the annotations are values from some fixed semiring . Thus, standard relational databases are annotated databases in which the annotations are (true) and (false), while bag databases are annotated databases in which the annotations are non-negative integers denoting the multiplicities. This framework, which is often referred to as semiring semantics, has spanned first-order logic [9] and least fixed-point logic [6].
During the early days of relational database theory it was realized that “acyclic” database schemas possess a number of desirable semantic properties. In fact, three different notions of “acyclicity” were identified and extensively investigated during the 1980s, namely, acyclicity (also known as -acyclicity), -acyclicity, and -acyclicity. On undirected graphs (equivalently, on database schemas consisting of binary relation symbols only) these notions coincide with the notion of an acyclic graph, but they form a strict hierarchy on hypergraphs (equivalently, on arbitrary database schemas) with -acyclicity being a stricter notion than acyclicity, and -acyclicity being a stricter notion than -acyclicity.
The study of acyclic schemas was initiated by Yannakakis, who focused on the evaluation of acyclic joins [16]. After this, Fagin, Beeri, Maier, and Yannakakis [4] showed that acyclic schemas are precisely the ones possessing the local-to-global consistency property, that is, every collection of pairwise consistent relations over such schemas is globally consistent (i.e., there is a relation whose projection on the attributes of is equal to , for ). Fagin et al. [4] also characterized acyclicity in terms of the existence of monotone sequential join expressions, i.e., expressions of the form with the property that if the relations are pairwise consistent, then every intermediate sequential join expression produces a relation that is consistent with the relation . Results about acyclicity yield results about -acyclicity, since a schema is -acyclic if and only if every sub-schema of it is acyclic. Fagin [8] studied -acyclicity and showed that a schema is -acyclic if and only if every connected sequential join expression is monotone. Intuitively, this means that every sequential join expression is monotone, provided no join between relations with disjoint sets of attributes is allowed.
Atserias and Kolaitis [2] studied the interplay between local consistency and global consistency for annotated relations. Since the definition of consistency of annotated relations uses only the projection operation on relations and since projection is defined using only addition , they considered -relations where the annotations come from a monoid . They identified a condition on monoids, called the inner consistency property, and showed that a positive monoid has the inner consistency property if and only if every acyclic schema has the local-to-global consistency property for -relations (i.e., every pairwise consistent collection of -relations over is globally consistent). It was not clear, however, whether the results about acyclic schemas and sequential join expressions in [4] can be extended to annotated relations, since, as shown in [1], the analog of the standard join for bags need not be a witness to the consistency of two consistent bags. In a subsequent paper, Atserias and Kolaitis [3] introduced the notion of a consistency witness function on a positive monoid , which is a function that, given two -relations and , returns a -relation that is a consistency witness for and , provided that and are consistent -relations. They also introduced the notion of a monotone sequential -join expression, which is analogous to that of a monotone sequential join expression with some arbitrary consistency witness function in place of the standard join. Using these notions, it was shown in [3] that the characterization of acyclicity in terms of monotone sequential join expressions in [4] extends to characterizations of acyclicity in terms of monotone sequential -join expressions on monoids having the inner consistency property; furthermore, the inner consistency property itself can be characterized in such terms.
Here, we investigate -acyclic schemas and establish that the desirable semantic properties of -acyclic schemas extend to annotated relations. The two main results are as follows:
-
1.
If is a positive commutative monoid and is a schema such that every connected sequential -join-expression over is monotone on w.r.t. some consistency witness function on , then is -acyclic.
-
2.
If is a positive commutative monoid that has the inner consistency property and is a schema which is -acyclic, then every connected sequential -join-expression over is monotone on w.r.t. every consistency witness function on .
As a byproduct of these two main results, we obtain a characterization of the inner consistency property in terms of -acyclicity and connected sequential -join expressions. Furthermore, our work sheds light on the role of the join of two standard relations. Specifically, our results reveal that, in the study of the various notions of acyclicity in [8], the only relevant property of the join of two standard relations is that it is a witness to the consistency of the two relations, provided these two relations are consistent. In the setting of annotated relations, this property of the standard join is captured by the notion of a consistency witness function.
The rest of the paper is organized as follows. Section 2 contains the definitions of the basic notions, while Section 3 contains the definition of a consistency witness function and related notions. To make the paper as self-contained as possible, the earlier results about acyclic schemas are summarized in Section 4. Section 5 discusses -acyclic schemas. Section 6 contains the main results about -acyclic schemas and annotated relations.
2 Basic Notions
Monoids.
A commutative monoid is a structure , where is a binary operation on the universe of that is associative, commutative, and has as its neutral element, i.e., holds for all . A commutative monoid is positive if for all elements with , we have that and . From now on, we assume that all commutative monoids considered have at least two elements in their universe.
The following are examples of positive commutative monoids.
-
The Boolean monoid with disjunction as its operation and (false) as its neutral element.
-
The bag monoid , where is the set of non-negative integers and is the standard addition operation. Note that the structure , where is the set of integers, is a commutative monoid, but not a positive one.
-
A numerical semigroup is a submonoid of the bag monoid , such that is a cofinite set, i.e., the complement is finite. A concrete example of a numerical semigroup is , where is the set of all non-negative integers of the form with and , i.e., .
-
The power set monoid , where if is a set, then is its powerset, and is the union operation on sets.
-
The structure , where is the interval of all real numbers between and , and is the standard maximum operation.
-
The structure , where is the set of all non-negative real numbers and is the standard addition operation.
-
The structure , where is the set of all real numbers together with , and is the standard minimum operation.
-relations and marginals of -relations.
An attribute is a symbol with an associated set as its domain. If is a finite set of attributes, then is the set of -tuples, i.e., the set of functions that take each attribute to an element of its domain . is non-empty as it contains the empty tuple, i.e., the function with empty domain. If and is an -tuple, then the projection of on , denoted by , is the unique -tuple that agrees with on . In particular, is the empty tuple.
Let be a positive commutative monoid and let be a finite set of attributes.
-
A -relation over is a function that assigns a value in to every -tuple in . We will often write to indicate that is a -relation over , and we will refer to as the set of attributes of . If is the empty set of attributes, then a -relation over is simply a function that assigns a single value from to the empty tuple. Note that the -relations are the standard relations, while the -relations are the bags or multisets, i.e., each tuple has a non-negative integer associated with it that denotes the multiplicity of the tuple.
-
The support of a -relation is the set of -tuples that are assigned non-zero value, i.e., . We will often write to denote . Note that is a standard relation over . A -relation is finitely supported if its support is a finite set. In this paper, all -relations considered will be finitely supported, and we omit the term; thus, from now on, a -relation is a finitely supported -relation. When is empty, we say that is the empty -relation over .
-
If , then the marginal of on is the -relation over such that for every -tuple , we have that
(1) The value is the marginal of over . For notational simplicity, we will often write for the marginal of over , instead of . It will be clear from the context (e.g., from the arity of the tuple ) if is indeed the marginal of over (in which case must be a -tuple) or is the actual value of on as a mapping from to (in which case must be an -tuple). Note that if is a standard relation (i.e., is a -relation), then the marginal is the projection of on .
The proof of the next useful proposition follows easily from the definitions.
Proposition 1.
Let be a positive commutative monoid and let be a -relation. Then the following hold:
-
1.
For all , we have .
-
2.
For all , we have .
If and are sets of attributes, then we write as shorthand for the union .
Schemas and hypergraphs.
-
A schema is a sequence of non-empty sets of attributes.
-
A hypergraph is a pair , where is a finite non-empty set and is a set of non-empty subsets of . We call the set of the nodes of and we call the set of the hyperedges of .
A schema can be identified with the hypergraph , i.e., the nodes of are the attributes and the hyperedges of are the members of the schema. We will use the terms schema and hypergraph interchangeably.
-
A collection of -relations over a schema is a sequence such that each is a -relation over .
3 Consistent Relations and Consistency Witness Functions
Let be a positive commutative monoid.
-
Two -relations and are consistent if there is a -relation such that and . Such a -relation is a consistency witness for and .
-
A collection of -relations over a schema is globally consistent if there is a -relation such that , for with . Such a -relation is a consistency witness for .
Note that if is a globally consistent collection of -relations, then the relations are pairwise consistent. Indeed, if is a consistency witness for , then for all and with , we have that the -relation is a consistency witness for and , because
where, in each case, the first equality follows from the definition of global consistency and the second equality follows from Proposition 1.
It is well known that the converse fails even for standard relations, i.e., there are standard relations that are pairwise consistent but not globally consistent. The main result by Beeri et al. [4] characterizes the schemas for which the pairwise consistency of a collection of standard relations implies that they are globally consistent. Quite recently, this result was extended to -relations over positive monoids that satisfy a condition called the inner consistency property [2]. We will discuss this extension in the next section. For now, we consider the following notion, which was introduced and studied in [3].
-
A consistency witness function on is a function that takes as arguments two -relations and , and returns as value a -relation over such that if and are consistent -relations, then is a consistency witness for and .
Example 2.
We now give examples of consistency witness functions for several different positive monoids.
-
1.
If is the Boolean monoid, then an example of a consistency witness function on is the standard join operation on standard relations.
-
2.
If is a powerset monoid, then an example of a consistency witness function on is the function such that for every -tuple , we have that
-
3.
If , then an example of a consistency witness function on is the function such that for every -tuple , we have that
-
4.
If , then an example of a consistency witness function on is the function such that for every -tuple , we have that
-
5.
If , then an example of a consistency witness function on is the function such that for every -tuple , we have that
(in the previous two expressions, , , , and are the standard multiplication, division, addition, and subtraction operations on the real numbers).
As shown in [2], the witness functions in the first three preceding examples are instances of the standard join on a monoid that can be expanded to a bounded distributive lattice. For instance, the powerset monoid can be expanded to the bounded distributive lattice . Furthermore, the witness functions in the last two preceding examples are instances of the Vorob’ev join on a monoid that can be expanded to a semifield. For instance, the monoid can be expanded to the tropical semifield .
Note that the bag monoid was not included in the preceding examples. As pointed out in [1], the bag-join operation of bags (the analog of the standard join for bags) is not a consistency witness function on the bag monoid . Furthermore, the analog of the Vorob’ev join is not well-defined on . A consistency witness function for can be obtained via an iterative algorithm, called the northwest corner method (see [2] for details).
A join expression is an expression involving standard relations and applications of the join operation on standard relations [4, 8]. In [3], the notion of a -join expression and its variants were introduced as a generalization of the notion of join expression to arbitrary consistency witness functions and -relations. The precise definitions are as follows.
Let be a schema and let be a binary function symbol, which will be interpreted by some consistency witness function.
-
The collection of -join expressions over is the smallest collection of strings that contains each and has the property that if and are in the collection, then also the string is in the collection.
-
The collection of sequential -join expressions over is the smallest collection of strings that contains each and has the property that if is in the collection and is one of the ’s, then also the string is in the collection.
Note that a (sequential) -join expression over need not contain every set .
Clearly, the string is a sequential -join-expression, while the string is a -join expression, but not a sequential one.
Semantics to -join expressions are assigned in a straightforward way as follows.
Let be a schema and let be a -join-expression over . If is a consistency witness function on and is a collection of -relations, we write to denote the -relation over obtained by evaluating when is interpreted by and each is interpreted by for .
The next notion yields a sufficient condition for a -join expression to give rise to global consistency witnesses.
-
Let be a -join expression over a schema , let be a consistency witness function on , and let be a collection of -relations. We say that is monotone with respect to and if for every sub-expression of , we have that the -relations and are consistent.
Example 3.
Let be the schema and consider the sequential -join-expressions and over , where
Consider also the monoid and the consistency witness function on such that , for every -tuple (see Example 2). Let be two values in some domain with , let be two real numbers such that , and let be the following -relations:
-
, , and , for all other pairs.
-
, , and , for all other pairs.
-
, , and , for all other triples.
Let us evaluate and on using the consistency witness function . It is easy to check that and that , where is the -relation with , , , , and , for all other triples.
While both and evaluate to the same -relation, there is an important difference in the intermediate steps of their evaluations. Specifically, in the case of , the intermediate relation is consistent with the last relation ; in contrast, in the case of , the intermediate relation is not consistent with the last relation (since and are different -relations on the same set of attributes). In particular, this example shows that the sequential -join-expression is not monotone with respect to .
The next proposition from [3] is proved in a straightforward way by induction on the construction of -join expressions and by using Proposition 1.
Proposition 4.
Let be a -join expression over , let be a consistency witness function on , and let be -relations. If is monotone with respect to and , and every occurs in , then is a global consistency witness for the -relations .
4 Acyclic Hypergraphs
As mentioned in Section 2, if are standard relations that are globally consistent, then they are pairwise consistent, but the converse does not always hold. For example, consider the triangle schema and the standard relations , , . It is easy to check that these standard relations are pairwise consistent; however, they are not globally consistent since . Beeri et al. [4] characterized the schemas for which every collection of pairwise consistent standard relations is globally consistent by showing that these are precisely the acyclic (also known as -acyclic) schemas. To give the precise definition of an acyclic schema, we need to first introduce some basic notions about hypergraphs.
Let be a hypergraph in which each vertex belong to at least one hyperedge.
-
A path in is a sequence of hyperedges of such that , for every with . In this case, we say that there is a path from to .
-
We say that a set of hyperedges of is connected if for every two distinct hyperedges and of , there is a path from to .
-
A connected component of is a maximal connected set of hyperedges of
-
We say that is connected if the set of the hyperedges of is connected (in other words, has a single connected component); otherwise, we say that is disconnected.
-
is reduced if no hyperedge of is properly contained in some other hyperedge of .
-
The reduction of is the hypergraph , where consists of the hyperedges in that are not properly contained in some other hyperedge in .
-
If , then the induced hypergraph is the hypergraph . Also, the restriction of on , denoted , is the reduction of the hypergraph .
-
Let be a reduced hypergraph and let be two distinct hyperedges. We say that is an articulation set of if the number of connected components of is bigger than the number of connected components of .
-
Let be a reduced hypergraph. We say that is acyclic if the following condition holds: for every set , if is connected and has at least two hyperedges, then it has an articulation set; otherwise, we say that is cyclic.
-
We say that is acyclic if its reduction is acyclic; otherwise, it is cyclic. Acyclic hypergraphs are also known as -acyclic hypergraphs, while cyclic hypergraphs are also known as -cyclic hypergraphs.
Admittedly, the notion of an acyclic hypergraph appears to be difficult to grasp when encountered for the first time. Intuitively, it generalizes to hypergraphs the property that a graph is acyclic if and only if every connected component of it with at least two edges has an articulation point. It is well known that there is a polynomial-time algorithm for testing if a hypergraph is acyclic; this algorithm is due to Graham [10] and, independently, to Yu and Ozsoyoglu [17], and it is known as the GYO algorithm (see also [8]).
There are several different structural conditions that are equivalent to acyclicity. We discuss two of these notions next.
Let be a hypergraph.
-
The Gaifman graph of is the undirected graph with nodes the attributes of and such that there is an edge between two attributes of if and only if both these attributes belong to one of the hyperedges of .
-
is conformal if every clique of is contained in one of the hyperedges of .
-
is chordal if every cycle of of length at least has a chord, i.e., there is an edge of that is not an edge of the cycle.
-
has the running intersection property if there is an ordering of the hyperedges of such that for every , there is a such that .
The proof of the next result can be found in [4].
Proposition 5.
For every hypergraph , the following statements are equivalent:
-
1.
is acyclic.
-
2.
is conformal and chordal.
-
3.
has the running intersection property.
The triangle schema is cyclic because it is not conformal (but it is chordal); the 4-cycle schema is cyclic because it is not chordal (but it is conformal). For every , the -path schema with hyperedges is acyclic because it is both conformal and chordal. One can also reason about these schemas using the running intersection property. Finally, consider the schema . It has the running intersection property via the ordering , hence it is acyclic.
Beeri et al. [4] showed that acyclicity can be characterized in terms of useful semantic properties, where by “semantic” we mean a property of the hypergraph whose definition involves also standard relations. Specifically, consider the following two properties.
Let be a hypergraph with as its hyperedges.
-
has the local-to-global consistency property for standard relations if for every collection of pairwise consistent standard relations over , we have that this collection is globally consistent.
-
admits a monotone join expression if there is a -join expression such that
-
i
is monotone with respect to the standard join operation and every collection of pairwise consistent relations ;
-
ii
Every hyperedge of occurs in .
-
i
As mentioned in Section 2, if a collection of relations is globally consistent, then it is pairwise consistent. Thus, if a schema has the local-to-global consistency property for standard relations, then global consistency coincides with pairwise consistency for relations over that schema. Furthermore, if a schema admits a monotone join expression, then, in view of Proposition 4, this join expression can be used to construct witnesses to global consistency of collections of pairwise consistent relations.
With the notions of local-to-global consistency property and monotone join expression at hand, the main result in Beeri et al. [4] can be stated as follows.
Theorem 6 ([4]).
For every hypergraph , the following statements are equivalent:
-
1.
is acyclic.
-
2.
has the local-to-global consistency property for standard relations.
-
3.
admits a monotone sequential join expression.
Thus, the triangle schema and the -cycle schema do not have the local-to-global consistency property for standard relations and do not admit a monotone join expression, but each -path schema does, and so does the schema .
In [2], the following question was investigated: does Theorem 6 extend from standard relations to -relations, where is an arbitrary positive commutative monoid?
The first realization in [2] was that acyclicity is a necessary, but not always sufficient, condition for the local-to-global consistency property to hold for -relations. More formally, we say that a hypergraph has the local-to-global consistency property for -relations if every collection of pairwise consistent -relations is also globally consistent.
We can now state the precise result about the necessity of acyclicity.
Theorem 7 ([2]).
The following statements are true:
-
1.
For all positive commutative monoids and hypergraphs , if has the local-to-global consistency property for -relations, then is acyclic.
-
2.
There are positive commutative monoids and hypergraphs such that is acyclic and does not have the local-to-global consistency property for -relations. In particular, this holds true for every numerical semigroup other than the bag monoid and for the -path hypergraph .
Furthermore, in [2], a class of positive commutative monoids was identified for which the acyclicity of a hypergraph is a sufficient condition for to have the local-to-global consistency property for -relations.
-
Two -relations and are inner consistent if .
-
We say that has the inner consistency property if whenever two -relations are inner consistent, they are also consistent.
Note that, using Proposition 1, it is easy to verify that if and are consistent -relations, then they are also inner consistent. Consequently, for monoids with the inner consistency property, the notions of consistency and inner consistency coincide. In particular, this holds true for the the Boolean monoid .
In [1], it was shown that the bag monoid has the inner consistency property. In [2], several other monoids were shown to have the inner consistency property, including the monoids , , , and the power set monoids , for every set . In contrast, no numerical semigroup other than the bag monoid has the inner consistency property.
To state the extension of Theorem 6 to -relations, we need some additional notions, which were introduced in [3].
Let be a positive commutative monoid, let be a schema, and let be a -join expression over .
-
First, recall from Section 3, that is monotone with respect to a consistency witness function on and a collection of -relations if for every sub-expression of , we have that the -relations and are consistent.
-
We say that is monotone on if there is a consistency witness function on such that is monotone with respect to and every collection of pairwise consistent -relations.
-
We say that is strongly monotone on if for every consistency witness function on , we have that is monotone with respect to and every collection of pairwise consistent -relations.
Finally, we define what it means for a schema to admit a monotone and a strongly monotone -join expression.
-
A schema admits a monotone -join expression on if there is a -join-expression over such that is monotone on and every hyperedge occurs in .
-
A schema admits a strongly monotone -join expression on if there is a -join-expression over such that is strongly monotone on and every hyperedge occurs in .
Theorem 8 ([2, 3]).
Let be a positive commutative monoid that has the inner consistency property. For every hypergraph , the following statements are equivalent:
-
1.
is acyclic.
-
2.
has the local-to-global consistency property for -relations.
-
3.
admits a monotone sequential -join-expression on .
-
4.
admits a strongly monotone sequential -join expression on .
Theorem 8 yields Theorem 6 of Beeri et al. [4] by taking to be the Boolean monoid . In fact, Theorem 8 yields something stronger: the standard join can be replaced in Theorem 6 by an arbitrary consistency witness function for standard relations. In effect, this means that the only property of the standard join needed in Theorem 6 is that the standard join is a consistency witness function for standard relations.
As shown in [2], the inner consistency property actually characterizes the positive commutative monoids for which every acyclic hypergraph has the local-to-global consistency property for -relations.
Theorem 9 ([2, 3]).
Let be a positive commutative monoid. Then the following statements are equivalent:
-
1.
has the inner consistency property.
-
2.
Every acyclic hypergraph has the local-to-global consistency property for -relations.
-
3.
The -path hypergraph has the local-to-global consistency property for -relations.
-
4.
Every acyclic hypergraph admits a monotone sequential -join-expression on
-
5.
Every acyclic hypergraph admits a strongly monotone sequential -join-expression on .
5 Beta Acyclic Hypergraphs
Their good structural and semantic properties notwithstanding, acyclic hypergraphs suffer from the drawback that acyclicity is not a hereditary property, that is to say, a sub-hypergraph of an acyclic hypergraph need not be acyclic. For example, the hypergraph is acyclic but it contains as a sub-hypergraph the triangle hypergraph , , , which is cyclic.
Motivated by the preceding considerations, Fagin [8] introduced the following notion.
-
A hypergraph is -acyclic if every sub-hypergraph of is acyclic; otherwise, is -cyclic.
For example, the hypergraph with hyperedges is -acyclic. There is a polynomial-time algorithm for testing if a hypergraph is -acyclic (see [8]).
Fagin [8] found several different characterizations of -acyclicity, including some involving the absence of cycles of certain types. In the sequel, we will use the following one.
-
A weak -cycle in a hypergraph is a sequence such that and the following properties hold:
-
1.
are distinct hyperedges of and ;
-
2.
are distinct nodes of ;
-
3.
For , the node is in .
-
4.
For , the node is not in any hyperedge other than and .
-
1.
Theorem 10 ([8]).
For every hypergraph , the following statements are equivalent:
-
1.
is -acyclic.
-
2.
has no weak -cycles.
For example, consider the schema , which was shown earlier to be acyclic. The sequence is a weak -cycle, hence this schema is -cyclic.
Because of the hereditary nature of -acyclicity, the characterizations of acyclicity in Section 4 give rise to characterizations of -acyclicity. Thus, the following result holds.
Corollary 11.
Let be a positive commutative monoid that has the inner consistency property. For every hypergraph , the following statements are equivalent:
-
1.
is -acyclic.
-
2.
Every sub-hypergraph of has the local-to-global consistency property for -relations.
-
3.
Every sub-hypergraph of admits a monotone sequential -join-expression on .
-
4.
Every sub-hypergraph of admits a strongly monotone sequential -join expression on .
6 Gamma-Acyclic Hypergraphs
Fagin [8] introduced and studied -acyclic hypergraphs, which form a proper subclass of the class of -acyclic hypergraphs. As with -acyclic hypergraphs, there are several equivalent formulations of the notion of a -acyclic hypergraph in terms of absence of cycles of certain types, including the following one.
-
A weak -cycle in a hypergraph is a sequence such that and the following properties hold:
-
1.
are distinct hyperedges of and ;
-
2.
are distinct nodes of ;
-
3.
For , the node is in ;
-
4.
For , the node is not in any hyperedge other than and .
-
1.
-
A hypergraph is -acyclic if has no weak -cycle; otherwise, is -cyclic.
Clearly, every sub-hypergraph of a -acyclic hypergraph is -acyclic as well. Observe that the only difference between a weak -cycle and a weak -cycle is in the fourth condition of the definitions of these notions: the requirement that the node belongs only to the hyperedges and holds for every in the case of a weak -cycle, while it holds for in the case of a weak -cycle. In particular, every weak -cycle is also a weak -cycle; consequently, every -acyclic hypergraph is also -acyclic. The converse, however, is not true. To see this, consider the hypergraph with hyperedges , which, as pointed out in Section 5, is -acyclic. Clearly, the sequence is a weak -cycle, hence this hypergraph is -cyclic. It is also easy to see that for every , the -path hypergraph with hyperedges is -acyclic. Note that there is a polynomial-time algorithm, due to D’ Atri and Moscarini [7], for testing whether or not a hypergraph is -acyclic (see also [8, Section 9.4]).
There are several different structural characterizations of -acyclic hypergraphs, including one which is due to Brault-Baron [5] and which involves the hypergraph above. To describe this characterization, let us recall the following basic notion from Section 4.
-
Let be a hypergraph and let be a subset of the set of the nodes of . The induced hypergraph is the hypergraph with hyperedges .
Proposition 12 ([5]).
For every hypergraph , the following statements are equivalent:
-
1.
is -acyclic.
-
2.
is -acyclic and there do not exist three nodes of such that the hypergraph with hyperedges is a sub-hypergraph of .
In fact, Brault-Baron [5] defines a -acyclic hypergraph to be a hypergraph that satisfies the second condition in Proposition 12; he then shows that this condition is equivalent to the D’ Atri and Moscarini algorithm [7] producing the empty hypergraph, hence this condition is equivalent to Fagin’s [8] definition of -acyclicity.
Fagin [8] established that -acyclic hypergraphs have certain desirable semantic properties; the main such property involves the notion of a connected join expression.
-
A join expression is connected if for each of its sub-expressions , there is an attribute that appears in both and .
In particular, if is a sequential join expression , then is connected if and only if for every with , we have that . For example, the sequential join expression is connected, while the sequential join expression is not connected.
We can now state the main semantic characterization of -acyclicity, obtained in [8].
Theorem 13 ([8]).
For every hypergraph , the following statements are equivalent:
-
1.
is -acyclic.
-
2.
Every connected sequential join expression over is monotone.
The notion of a connected join expression extends to the notion of a connected -join expression in a straightforward way.
-
A -join expression is connected if for each of its sub-expressions , there is an attribute that appears in both and .
In particular, if is a sequential -join expression , then is connected if for every with , we have that .
It is now natural to ask: does Theorem 13 extend and how does it extend to -acyclic hypergraphs, -join expressions, and -relations, where is a positive commutative monoid?
Let be a positive commutative monoid and let be a -join expression. Recall that is monotone on if there is a consistency witness function on such that is monotone with respect to and every collection of pairwise consistent -relations. Recall further that is strongly monotone on if is monotone with respect to every consistency witness function on and every collection of pairwise consistent -relations.
In what follows in this section, we will establish the following results:
-
1.
If is a hypergraph such that every connected sequential -join-expression over is monotone on , then is -acyclic.
-
2.
If has the inner consistency property and is -acyclic, then every connected sequential -join-expression over is strongly monotone on ,
Theorem 14.
For all positive commutative monoids and hypergraphs , if is such that every connected sequential -join-expression over is monotone on , then is -acyclic.
Proof.
We will prove the contrapositive, that is, if the hypergraph is not -acyclic, then there is a connected sequential -join expression over such that is not monotone on . So, assume that is not -acyclic. We distinguish two cases, namely, the case in which is not -acyclic and the case in which is -acyclic.
Case 1.
Assume that is not -acyclic. By the definition of -acyclicity, there is a sub-hypergraph of that is cyclic. Moreover, we may assume that is connected, since if every connected component of were acyclic, then it is easy to see that would be acyclic as well. Let be a list of the hyperedges of . Since is cyclic, the first part of Theorem 7 implies that there are -relations that are pairwise consistent, but not globally consistent. Since is connected, there is a sequence of not necessarily distinct sets of attributes such that the following hold: (a) each is one of the hyperedges of , i.e., , where ; (b) each hyperedge of appears in the sequence ; and (c) for every with , we have that . Let be the sequential -join expression . Then is a connected -join expression because holds, for every with . We now claim that there is no consistency witness function on such that is monotone with respect to . To see this, let be a consistency witness function on and consider the pairwise consistent -relations . If were monotone with respect to , then, by Proposition 4, the -relation is a global consistency witness for the relations , hence it is a global consistency witness for the relations since every hyperedge appears in the sequence . This, however, is a contradiction since the relations are not globally consistent.
Case 2.
Assume that is -acyclic. Since is not -acyclic, Proposition 12 implies that there are three attributes , , and three hyperedges of such that , , and . Let be the remaining sets of attributes in , respectively; thus, , , . Let be the sequential -join expression , which is connected since .
We now claim that there is no consistency witness function on such that is monotone with respect to . We define four -relations in pairs , and . To define them, let and be the tuples of lengths equal to the cardinalities of and , and let be the tuple of length equal to the cardinality of . Let be a non-zero element and let
-
, , and , for all other values,
-
, , and , for all other values,
-
, , and , for all other values,
-
, , and , for all other values.
It is easy to verify that and are two different consistency witnesses for the relations and . It is easy to verify that and are two different consistency witnesses for the relations and .
Now, let be an arbitrary witness function on . Since the relations and are consistent, we have that the -relation is a consistency witness function for and . We distinguish the following two sub-cases.
Sub-case 1.
. In this case, let be the -relation such that , , and , for all other values, where is a tuple of ’s of length equal to the cardinality of the set . Observe that . Since is a consistency witness for and , we have that the relations are pairwise consistent. However, the -relations and are not consistent, since and .
Sub-case 2.
. In this case, let be the -relation such that , , and , for all other values, where is a tuple of ’s of length equal to the cardinality of the set . Observe that Since is a consistency witness for and , we have that the relations are pairwise consistent. However, the -relations and are not consistent, since . Since the hypergraph with hyperedges is -cyclic, Theorem 14 implies that there is a connected sequential -join expression over that is not monotone on . Actually, the proof of Theorem 14 implies that is such an expression, and Example 3 is an illustration of this fact.
The preceding Theorem 14 asserts that -acyclicity is a necessary condition for a hypergraph to have the property that every connected sequential -join expression over is monotone on , where is an arbitrary positive commutative monoid. The second main result in this section asserts that if has the inner consistency property, then -acyclicity is a sufficient condition for a hypergraph to have the property that every connected sequential -join expression over is strongly monotone on .
Theorem 15.
Let be a positive commutative monoid that has the inner consistency property. If is a -acyclic hypergraph, then every connected sequential -join expression over is strongly monotone on .
Proof.
We will establish the contrapositive, i.e., if does not have the property that every connected sequential -join expression over is strongly monotone on , then is -cyclic.
Assume that lacks the above property. Then there exist a connected sequential -join expression over , a consistency witness function on , and a collection of pairwise consistent -relations such that is not monotone w.r.t. to and . In turn, this means that there is some index such that the -relation is not consistent with the -relation , where is the sequential -join expression . Let be the smallest index with this property; thus, if , then the -relation is consistent with the -relation .
Let . Note that , since is a connected sequential -join expression. Note also that is the set of attributes of , while is the set of attributes of . By hypothesis, has the inner consistency property, which means that if two -relations and are inner consistent (i.e., , then they are consistent. Thus, since the -relations and are not consistent, it follows that and are not inner consistent, hence
Claim 1.
For every , we have that .
To establish the claim, assume that , for some . By the pairwise consistency of , we have that and are consistent -relations, hence
Since , we have that . Proposition 4 and the minimality assumption about imply that the -relation is a global consistency witness for . Since , we have that . Furthermore, since , we have that , hence ; this contradicts the earlier finding that , hence Claim 1 has been established.
So, we now know that for every , we have that . Choose an index so that the cardinality of the set is the largest of the cardinalities of the sets , . Pick a node such that . Since , there is some such that . Furthermore, since is a connected sequential -join expression over , it is easy to see that is a connected set of hyperedges of . Let be the length of the shortest path within from to a hyperedge containing . This means that there is a sequence of sets with the following properties:
-
1.
Each set is one of the hyperedges .
-
2.
; ; , .
-
3.
is the smallest number for which a sequence with properties (1), (2) exists.
The minimality of implies that are distinct hyperedges of . By the maximality of , we have that . Since and , there must exist a node . Let be the largest number such that and . This number exists because . By property (4) of the sequence , there are nodes , such that . Consider now the sequence
Claim 2.
is a weak -cycle in .
We have to verify that this sequence satisfies the conditions defining a weak -cycle, which were spelled out in the beginning of this section.
-
1.
The hyperedges are distinct, since the hyperedges are distinct and also are among the hyperedges .
-
2.
The nodes are distinct for the following reasons: first, because and ; second, is different from , since for ; is different from by the choice of as the largest number such that and the fact that ; third, the ’s are distinct, else the path would have been shorter.
-
3.
First, by the choice of and the fact that ; second, by the choice of ; third, by the choice of the ’s.
-
4.
is not in any of the hyperedges by the properties of the path ; finally, is not in any of the hyperedges by the choice of .
This completes the proof of Claim 2, hence the hypergraph is -cyclic.
The reader familiar with Fagin’s paper [8] will undoubtedly notice that the proof of Theorem 15 has a very similar structure to the proof of the result that if a hypergraph is -acyclic, then every connected sequential join expression is monotone (see [8, pages 539-540]). The main difference is that here, instead of the standard join, we use an arbitrary consistency witness function and, thus, obtain a stronger result about annotated relations and arbitrary consistency witness functions. Furthermore, it is of the essence that the annotations come from a monoid that has the inner consistency property because, in the first part of the proof before Claim 1, we used in a crucial way that has the inner consistency property.
Corollary 16.
Let be a positive commutative monoid that has the inner consistency property. For every hypergraph , the following statements are equivalent:
-
1.
is -acyclic.
-
2.
Every connected sequential -join expression over is strongly monotone on .
-
3.
Every connected sequential -join-expression over is monotone on .
Proof.
The implication follows from Theorem 15; the implication follows from the definitions; the implication follows from Theorem 14.
Finally, we characterize the inner consistency property in terms of -acyclicity.
Theorem 17.
Let be a positive commutative monoid. Then the following statements are equivalent:
-
1.
has the inner consistency property.
-
2.
Every -acyclic hypergraph has the property that every connected sequential -join expression over is strongly monotone on .
-
3.
Every -acyclic hypergraph has the property that every connected sequential -join-expression over is monotone on .
-
4.
The -path hypergraph has the property that every connected sequential -join-expression over is monotone on .
Proof.
The implication follows from Theorem 15. The implication follows from the definitions. The implication holds because the -path hypergraph is -acyclic. Towards , let be the -path hypergraph with hyperedges . Assume that has the property that every connected sequential c-join expression over is monotone on . Let be the connected sequential c-join expression over and let be a consistency witness function on such that is monotone with respect to and every three pairwise consistent -relations . Then has the local-to-global consistency property property for -relations, because if are three pairwise consistent -relations, then, by Proposition 4, the -relation is a global consistency witness for the -relations . Thus, by Theorem 9, the monoid has the inner consistency property.
7 Concluding Remarks
In this paper, we showed that the main desirable semantic properties of -acyclic hypergraphs and standard relations extend to desirable semantic properties of -acyclic hypergraphs and annotated relations, as long as the annotations come from a positive commutative monoid with the inner consistency property. It can also be shown that other desirable semantic properties of -acyclicity, such as join dependencies and lossless joins (see Fagin [8]), have suitable extensions to -acyclic hypergraphs and annotated relations; the notions of a consistency witness function and a -join expression are used in these results.
Going back to acyclic hypergraphs, Beeri et al. [4] characterized acyclic hypergraphs in terms of semijoin programs and full reducers, which make it possible to evaluate queries efficiently in a distributed setting. It remains an open problem to determine whether or not there is an abstract notion of a semijoin program that can be used to extend these characterizations to acyclic schemas and annotated relations.
References
- [1] Albert Atserias and Phokion G. Kolaitis. Structure and complexity of bag consistency. In Leonid Libkin, Reinhard Pichler, and Paolo Guagliardo, editors, PODS’21: Proceedings of the 40th ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems, Virtual Event, China, June 20-25, 2021, pages 247–259. ACM, 2021. doi:10.1145/3452021.3458329.
- [2] Albert Atserias and Phokion G. Kolaitis. Consistency of relations over monoids. Journal of the ACM, 72(3, Article 18):47 pages, 2025. Earlier version in Proc. ACM Manag. Data, 2(2):107, 2024. doi:10.1145/3721855.
- [3] Albert Atserias and Phokion G. Kolaitis. Consistency witnesses for annotated relations. SIGMOD Rec., 54(2):7–17, 2025. doi:10.1145/3749116.3749118.
- [4] Catriel Beeri, Ronald Fagin, David Maier, and Mihalis Yannakakis. On the desirability of acyclic database schemes. J. ACM, 30(3):479–513, July 1983. doi:10.1145/2402.322389.
- [5] Johann Brault-Baron. Hypergraph acyclicity revisited. ACM Comput. Surv., 49(3):54:1–54:26, 2016. doi:10.1145/2983573.
- [6] Katrin M. Dannert, Erich Grädel, Matthias Naaf, and Val Tannen. Semiring provenance for fixed-point logic. In Christel Baier and Jean Goubault-Larrecq, editors, 29th EACSL Annual Conference on Computer Science Logic, CSL 2021, January 25-28, 2021, Ljubljana, Slovenia (Virtual Conference), volume 183 of LIPIcs, pages 17:1–17:22. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2021. doi:10.4230/LIPIcs.CSL.2021.17.
- [7] Alessandro D’Atri and Marina Moscarini. On the recognition and design of acyclic databases. In Daniel J. Rosenkrantz and Ronald Fagin, editors, Proceedings of the Third ACM SIGACT-SIGMOD Symposium on Principles of Database Systems, April 2-4, 1984, Waterloo, Ontario, Canada, pages 1–8. ACM, 1984. doi:10.1145/588011.588013.
- [8] Ronald Fagin. Degrees of acyclicity for hypergraphs and relational database schemes. J. ACM, 30(3):514–550, 1983. doi:10.1145/2402.322390.
- [9] Erich Grädel and Val Tannen. Semiring provenance for first-order model checking. CoRR, abs/1712.01980, 2017. arXiv:1712.01980.
- [10] Marc H. Graham. On the universal relation. Technical Report, Computer Systems Research Group, University of Toronto, 1980.
- [11] Todd J. Green. Containment of conjunctive queries on annotated relations. Theory Comput. Syst., 49(2):429–459, 2011. doi:10.1007/s00224-011-9327-6.
- [12] Todd J. Green, Gregory Karvounarakis, and Val Tannen. Provenance semirings. In Leonid Libkin, editor, Proceedings of the Twenty-Sixth ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, June 11-13, 2007, Beijing, China, pages 31–40. ACM, 2007. doi:10.1145/1265530.1265535.
- [13] Grigoris Karvounarakis and Todd J. Green. Semiring-annotated data: queries and provenance? SIGMOD Rec., 41(3):5–14, 2012. doi:10.1145/2380776.2380778.
- [14] Mahmoud Abo Khamis, Hung Q. Ngo, Reinhard Pichler, Dan Suciu, and Yisu Remy Wang. Convergence of datalog over (pre-) semirings. J. ACM, 71(2):8:1–8:55, 2024. doi:10.1145/3643027.
- [15] Egor V. Kostylev, Juan L. Reutter, and András Z. Salamon. Classification of annotation semirings over containment of conjunctive queries. ACM Trans. Database Syst., 39(1):1:1–1:39, 2014. doi:10.1145/2556524.
- [16] Mihalis Yannakakis. Algorithms for acyclic database schemes. In Very Large Data Bases, 7th International Conference, September 9-11, 1981, Cannes, France, Proceedings, pages 82–94. IEEE Computer Society, 1981.
- [17] Clement Tak Yu and Meral Z Ozsoyoglu. An algorithm for tree-query membership of a distributed query. In COMPSAC 79. Proceedings. Computer Software and The IEEE Computer Society’s Third International Applications Conference, 1979., pages 306–312. IEEE, 1979.
