Abstract 1 Introduction 2 Formal Problem Statement 3 Denotations, Optimal Strategies, and Pareto Fronts 4 Solving Open Parity Games 5 Solving String Diagrams of Parity Games 6 Conclusion References Appendix A Proof of Prop. 43 for =

Pareto Fronts for Compositionally Solving String Diagrams of Parity Games

Kazuki Watanabe ORCID National Institute of Informatics, Tokyo, Japan
The Graduate University for Advanced Studies (SOKENDAI), Hayama, Japan
Abstract

Open parity games are proposed as a compositional extension of parity games with algebraic operations, forming string diagrams of parity games. A potential application of string diagrams of parity games is to describe a large parity game with a given compositional structure and solve it efficiently as a divide-and-conquer algorithm by exploiting its compositional structure.

Building on our recent progress in open Markov decision processes, we introduce Pareto fronts of open parity games, offering a framework for multi-objective solutions. We establish the positional determinacy of open parity games with respect to their Pareto fronts through a novel translation method. Our translation converts an open parity game into a parity game tailored to a given single-objective. Furthermore, we present a simple algorithm for solving open parity games, derived from this translation that allows the application of existing efficient algorithms for parity games. Expanding on this foundation, we develop a compositional algorithm for string diagrams of parity games.

Keywords and phrases:
parity game, compositionality, string diagram
Copyright and License:
[Uncaptioned image] © Kazuki Watanabe; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Verification by model checking
Acknowledgements:
We would like to thank the anonymous referees for their helpful suggestions, which have enabled us to improve this article.
Funding:
We are supported by the JST grant No. JPMJAX23CU.
Editors:
Corina Cîrstea and Alexander Knapp

1 Introduction

Parity games (on finite graphs) have been actively studied, and the search for efficient algorithms is a central topic for parity games. A key property of parity games is positional determinacy [15, 16], which underpins their decidability by ensuring that positional strategies suffice to determine the winner at any node. Calude et al. [10] show that parity games are solvable in quasi-polynomial-time, leading to the development of subsequent quasi-polynomial-time algorithms [25, 19, 32]. The significance of these advancements extends beyond theoretical interest; they have practical applications in various verification problems. Notably, many verification problems can be reduced to solving parity games, including model checking with temporal specifications [28, 29, 17, 35, 27].

Refer to caption
Refer to caption
Figure 1: (i) an open parity game (oPG), (ii) the sequential composition 𝒜 of oPGs 𝒜,, and (iii) the sum 𝒜 of oPGs 𝒜,.

Compositionality in verification is a property that enables divide-and-conquer algorithms by exploiting compositional structures, aiming to solve the notorious state space explosion problem. Clarke et al. [12] provided the first compositional model checking algorithm, and since then, many compositional model checking algorithms have been proposed for LTL [26], Markov decision processes [30, 46, 44], and higher-order model checking [40]. Recently, we introduced string diagrams of parity games [43] as a compositional extension of parity games. We proposed open parity games that can be composed using two algebraic operations: the (bidirectional) sequential composition and the sum. Fig. 1 shows an open parity game and illustrates two algebraic operations over open parity games 𝒜, in string diagrams of parity games. Although we did not provide a compositional algorithm in the original work [43], we developed one for string diagrams of mean payoff games [45]. The methodology developed is also adaptable to string diagrams of parity games.

A major difficulty for compositional algorithms arises from the multi-objective perspective111This differs from having several parity objectives. on individual components: typically, even if a given “global” objective is single-objective, which is the parity condition for parity games, “local” objectives on components become multi-objective.

Figure 2: The parity game 𝒜. Every node is owned by Player .

For instance, Fig. 2 shows a parity game 𝒜 consisting of open parity games 𝒜 and . In the open parity game 𝒜, the Player has the choice of moving from the node a to either the node o𝐫,1 or the node o𝐫,2. However, the optimal -strategies in 𝒜 may vary, depending on the priorities m1 and m2 in the open parity game . Consequently, it is necessary to compute all “potentially” optimal strategies on 𝒜 without any prior knowledge of in order to solve the parity game 𝒜 compositionally. Our previous work on string diagrams of mean payoff games [45] tackled this by enumerating such potentially optimal strategies in open mean payoff games. The enumeration algorithm requires exponential time in the number of nodes of the given open mean payoff game, which is infeasible in practice.

By following our recent progress on string diagrams of Markov decision processes (MDPs) [46], we introduce Pareto fronts of open parity games, which are intuitively sets of optimal results on open parity games. We prove positional determinacy of open parity games, that is, positional strategies suffice to achieve Pareto fronts (Thm. 28). Our proof method involves selecting a “single-objective”, the number of which is finite, and we show that positional strategies suffice to satisfy the given single-objective. This procedure is repeated for each possible single-objective. In the proof, we propose a novel translation that converts an open parity game into a (non-open) parity game tailored to a given single-objective (Def. 32). Moreover, our translation leads to a simple algorithm for open parity games that requires exponential time only in the number of exits, not in the number of whole nodes as in our previous algorithm [45]: here our algorithm use known quasi-polynomial-time algorithms (Alg. 1 and Prop. 40). On top of these developments, we provide a compositional algorithm of string diagrams of parity games by composing Pareto fronts of open parity games (Alg. 2).

Contributions.

  • we introduce Pareto fronts of open parity games in Section 3.3,

  • we prove the positional determinacy of Pareto fronts of open parity games, which is stated in Section 4.1, by a novel translation from an open parity game to a parity game with a given single-objective in Section 4.2,

  • we present a simple algorithm that computes Pareto fronts of open parity games, and provide an upper bound of its time complexity in Section 4.2, which shows improvements over our previous algorithm [45],

  • we provide a compositional algorithm of string diagrams of parity games in Section 5.

1.1 Related Work

String diagrams are a graphical language, which is mostly described in category theory. They effectively model signal flow diagrams [5, 7, 8, 2], quantum processes [13, 14], Petri nets [6, 3], and games for economics [23, 31]. Rathke et al. [38] derive a divide-and-conquer algorithm for reachability analysis of Petri nets, and we provide a compositional algorithm for string diagrams of mean payoff games in [45], which can be readily adapted to string diagrams of parity games [43]. Recently, Piedeleu [37] provides a sound and complete diagrammatic language of parity games w.r.t. the semantics of open parity games [43]. In this paper, we propose a compositional algorithm for string diagrams of parity games based on a rather efficient semantics, focusing on the positional determinacy of open parity games.

Pareto fronts [36, 18] offer a well-formulated solution for multi-objective optimization problems. They enhance the performance of compositional probabilistic model checking [46]. A crucial property of Pareto fronts in [46] is again positional determinacy: each point on Pareto fronts is induced by a positional scheduler, which can be computed using standard algorithms for (non-open) MDPs [21].

In [46], we propose a compositional probabilistic model checking of string diagrams of MDPs with Pareto fronts: we introduce shortcut MDPs and prove their compositionality, analogous to Props 42 and 43. A major contribution of this paper, compared to [46], is the introduction of a novel translation from open parity games to parity games, designed to efficiently compute Pareto fronts. This stands in contrast to the already established translation for open MDPs [21].

Multi-objectives in games have been well-studied in the literature. Velner et al. [41] study the complexity of multi-mean-payoff and multi-energy games. Chen et al. [11] develop an approximation method for Pareto fronts of stochastic games. Recently, a Pareto-based rational verification problem, which interacts with the environment, is introduced in [9].

Obdržálek [34], and Fearnley and Schewe [20] provide polynomial time algorithms for parity games on graphs of bounded tree-width. Berwanger et al. [4] show that parity games on graphs of bounded DAG-width can be solved in polynomial time. The notion of result in [4] gathers optimal results of Player for each strategy employed by Player , regardless of its optimality. In contrast, our Pareto fronts collect optimal results not only from Player , but also from Player , and are positionally determined. Although our compositional algorithm is not a polynomial time algorithm for string diagrams of parity games, it does not require assumptions such as bounded tree- or DAG-widths.

Compositionality in parity games seems to be linked to higher-order model checking [35, 27], a model checking method of higher-order programs. In higher-order model checking, specifications are given as parity tree automata, which are equivalent to modal μ-calculus [16]. In fact, the semantics of string diagrams of parity games [43] is based on the semantics of higher-order model checking [24]. Unlike [24] that employs the trivial discrete order on priorities, we utilize the sub-priority order [4, 22], which is central to our development. Fujima et al. [22] introduce the subtype relation in the intersection type, which corresponds to our order for results of games defined in Def. 22. Tsukada and Ong [40] present a compositional higher-order model checking over the composition of Böhm trees. We employ the dual of priorities (Def. 34), which in [40] is called the left-residual of 0. The duality of queries shown in Lem. 37 is conceptually similar to the notion of the complementarity predicate in [39]. They utilize the property for showing the relationship between a game and its dual in the context of higher-order model checking.

2 Formal Problem Statement

We revisit parity games and string diagrams of parity games [43], and we formally state our target problem. Throughout this paper, we fix the finite set :={0,1,,M} of priorities. We assume that the maximum priority M is even and M2 without loss of generality.

2.1 Parity Games

Definition 1 (parity game).

A parity game (PG) 𝒢 is a tuple (V,V,V,E,Ω), where the set V is a non-empty finite set of nodes, the sets V,V are a partition of V such that V is owned by Player and V is owned by Player , the set E is a set of edges EV×V, and the function Ω is a labelling function Ω:E, assigning priorities to edges.

We assume that every node has a successor in PGs. A play p is an infinite path (vi)i such that (vi,vi+1)E, for any i. A play p is winning (for Player ) if the maximum priority that occurs in p infinitely often is even. Otherwise, the play p is losing (for Player ). We also call the winning condition as the parity condition. An -strategy σ (of Player ) is a function σ:VVV such that for any finite path v1vn, if vnV, then (vn,σ(v1vn))E. A -strategy σ (of Player ) is analogously defined. An -strategy σ is a positional strategy if for any v1vm and v1vn such that vm=vnV, their successors coincide σ(v1vm)=σ(v1vn); positional -strategies are defined in the same way. We write σ:VV (and σ:VV) for a positional -strategy (and a positional -strategy). Given a pair (σ,σ) of - and -strategies, and a node v, a play pσ,σ;v from v that is induced by (σ,σ) is the play (vi)i such that v1=v, and for any index i, if viV, then σ(v1vi)=vi+1, and if viV, then σ(v1vi)=vi+1. PGs are positionally determined [15, 16], that is, there is a partition (W,W) of V, called winning regions, such that vW iff there is a winning positional strategy σ:VV for Player , and vW iff there is a winning positional strategy σ:VV for Player .

2.2 String Diagrams of Parity Games

String diagrams of parity games [43] consist of open parity games (oPGs), which are a compositional extension of PGs. OPGs have open ends that are entrances and exits. We illustrate an oPG in Fig. 3 as a running example, and will continue to refer to this example until Section 4.1. It is important to note that oPGs without exits can be regarded as PGs.

Definition 2 (open parity game [43]).

An open parity game (oPG) 𝒜 is a pair (𝒢,𝖨𝖮) of a PG 𝒢=(V,V,V,E,Ω) and open ends 𝖨𝖮=(I𝐫,I𝐥,O𝐫,O𝐥), where I𝐫,I𝐥,O𝐫,O𝐥 are nodes I𝐫,I𝐥,O𝐫,O𝐥V that are totally ordered, respectively, and each pair of them is disjoint. Open ends in I𝐫,O𝐫 are rightward, and open ends in I𝐥,O𝐥 are leftward. We call I:=I𝐫I𝐥 entrances, and O:=O𝐫O𝐥 exits, respectively. We also write 𝒜:(m𝐫,m𝐥)(n𝐫,n𝐥) for the oPG 𝒜 with the type of open ends, where m𝐫:=|I𝐫|, m𝐥:=|I𝐥|, n𝐫:=|O𝐫|, and n𝐥:=|O𝐥|. We additionally impose that every exit oO𝐫O𝐥 is a sink node, that is, for any vV, (o,v)E implies v=o and Ω(o,o)=0.

Figure 3: An oPG 𝒞:(1,1)(1,0). The node i𝐫,1 is the entrance, and the nodes o𝐫,1,o𝐥,1 are exits. The open ends i𝐫,1 and o𝐫,1 are rightward, and the exit o𝐥,1 is leftward. The shape of each (internal) node represents the owner, that is, circles are owned by Player , and diamonds are owned by Player . The labels on the edges are the assigned priorities.

Algebraic operations, namely the (bidirectional) sequential composition 𝒜 and the sum 𝒜, are defined as illustrated in Fig. 1. The sequential composition 𝒜 of 𝒜 and is given by connecting their open ends, assuming their arities are consistent. Note that the sequential composition can create a cycle along open ends.

Definition 3 (sequential composition).

Let 𝒜:(m𝐫,m𝐥)(l𝐫,l𝐥) and :(l𝐫,l𝐥)(n𝐫,n𝐥). Their (bidirectional) sequential composition 𝒜:(m𝐫,m𝐥)(n𝐫,n𝐥) is an oPG (V𝒜V,V𝒜V,V𝒜V,E𝒜,Ω𝒜), where the set E𝒜 of edges is the least relation and Ω𝒜 is the function that satisfy the following conditions:

  • if (v,v)E𝒜 and vO𝐫𝒜, then (v,v)E and Ω𝒜(v,v):=Ω𝒜(v,v),

  • if (v,v)E and vO𝐥, then (v,v)E and Ω𝒜(v,v):=Ω(v,v),

  • (o𝐫,i𝒜,i𝐫,i)E and Ω𝒜(o𝐫,i𝒜,i𝐫,i):=0, for any i[1,l𝐫], and

  • (o𝐥,j,i𝐥,j𝒜)E and Ω𝒜(o𝐥,j,i𝐥,j𝒜):=0, for any j[1,l𝐥].

We also define the sum 𝒜 of 𝒜 and : see Fig. 1 for an illustration.

Definition 4 (sum).

Let 𝒜:(m𝐫,m𝐥)(n𝐫,n𝐥) and :(k𝐫,k𝐥)(l𝐫,l𝐥). Their sum 𝒜:(m𝐫+k𝐫,m𝐥+k𝐥)(n𝐫+l𝐫,n𝐥+l𝐥) is an oPG (V𝒜V,V𝒜V,V𝒜V,E𝒜,Ω𝒜Ω), where the set E𝒜 of edges is the least relation that satisfies the following condition:

  • if (v,v)E𝒜, then (v,v)E𝒜, and if (v,v)E, then (v,v)E𝒜.

We define string diagrams of PGs as a syntax of compositional PGs: we also introduce operational semantics of string diagrams of PGs as oPGs induced by string diagrams.

Definition 5 (string diagram).

A string diagram 𝔻 of parity games is a term inductively generated by 𝔻::=𝒜𝔻𝔻𝔻𝔻 where 𝒜 ranges over oPGs. The operational semantics 𝔻 of a string diagram 𝔻 is the oPG inductively given by Defs 3 and 4.

Finally, we state the target problem, that is, deciding the winner for each entrance on a given string diagram 𝔻 whose operational semantics is a PG (oPG that has no exits).

Problem Statement: Let 𝔻 be a string diagram such that the operational semantics 𝔻 can be naturally considered as a PG, that is, 𝔻 has no exits. Compute the winning region (W,W) on entrances I𝔻, that is, decide the winner of each entrance.

 Remark 6 (trace operator).

In [43, 44, 45], we support the trace operator that makes loops by connecting exits to the corresponding entrances, respectively. We can encode the trace operator by the (bidirectional) sequential composition and the sum, as in [46, 47].

3 Denotations, Optimal Strategies, and Pareto Fronts

In this section, we recap denotations [43] and introduce Pareto fronts for oPGs, which are a compositional extension of winning and losing for PGs.

3.1 Denotation of Open Parity Games

Strategies and plays in oPGs are defined in exactly the same way as in PGs; note that oPGs are PGs with open ends. Unlike PGs, where the winning condition is qualitative, the winning condition in oPGs is quantitative due to the openness of oPGs, which induces pending states between two extremes of winning and losing. Specifically, we show denotations of oPGs [43] with denotations of plays and entrances. Given a play p, the denotation p of the play p is winning (), losing (), or reaching an exit o with the priority m that is the maximum priority that occurred during the play. Importantly, all exits are sinks, meaning that once we enter an exit, we stay there forever.

Definition 7 (domain).

Let 𝒜 be an oPG. The domain 𝒟𝒜 of 𝒜 is the set 𝒟𝒜:={,}{(o,m)o is an exit (oO𝒜),m is a priority (m)}.

Definition 8 (denotation of play).

Let p=(vj)j be a (necessarily infinite) play on an oPG 𝒜. The denotation p𝒟𝒜 of p is given by the following:

p:={ if vjO𝒜 for any j, and p satisfies the parity condition,(o,m) if vj=oO𝒜 for some j, and m:=max{Ω((vk,vk+1))|k{1,,j1}} if vjO𝒜 for any j, and p does not satisfy the parity condition.

Note that the condition in the second case distinction is well-defined because we assume every exit is a sink state (Def. 2).

The denotation i of an entrance i is the set of denotations of plays from i that are induced by - and -strategies. Specifically, for each -strategy σ, the denotation i contains the set of denotations pσ,σ;i of plays pσ,σ;i that are induced by some -strategy σ. Note that σ and σ may not be positional.

Definition 9 (denotation of entrance).

Let 𝒜 be an oPG and i be an entrance. The denotation i is given by

i:={{pσ,σ;i|σ is a -strategy}|σ is an -strategy}.

We call the entrance i winning if {}i, losing if T holds for any Ti, and pending otherwise.

The denotations of entrances are indeed a compositional extension of winning regions of PGs: in fact, for oPG 𝒜 with no exits, the entrance is winning if {}i, which is consistent with winning regions on PGs, and otherwise the entrance is losing.

Definition 10 (denotation of oPGs [43]).

Let 𝒜 be an oPG. The denotation 𝒜 of 𝒜 is the indexed family (i)iI𝒜 of denotations of entrances.

Example 11.

Consider the oPG 𝒞:(1,1)(1,0) presented in Fig. 3. Since there is the unique entrance i𝐫,1, the denotation 𝒞 is essentially same as the denotation i𝐫,1. Every play that starts from the entrance reaches the node c: if Player decides to move the exit o𝐫,1, then the denotation of the play is (o𝐫,1,1), and otherwise, the play reaches the node d. By similar arguments, we can conclude that the denotation i𝐫,1 is the following:

i𝐫,1={ {(o𝐫,1,1)},{(o𝐫,1,2),(o𝐫,1,3),(o𝐥,1,1),(o𝐥,1,3),},{(o𝐫,1,2),(o𝐫,1,3),(o𝐥,1,1)},
{(o𝐫,1,2),(o𝐫,1,3),(o𝐥,1,1),(o𝐥,1,3)}}.
 Remark 12.

Our denotation of entrances implicitly requires that an -strategy σ is always chosen at first, and later a -strategy is chosen with respect to σ. This order of choices by Players and does not matter for parity games because parity games are positionally determined [15, 16].

3.2 Optimal Strategies of Open Parity Games

For deciding the winning region of the entrances in the operational semantics 𝔻, as stated in Section 2.2, the denotation 𝒜 defined in Def. 10 may contain redundant information: for example, suppose we fix an -strategy σ. If there is a -strategy σ such that pσ,σ;i:=, that is, the play pσ,σ;i is losing for Player , then we can exclude other -strategies τ because choosing σ is optimal for Player when Player chooses σ. We generalize this elimination of sub-optimal strategies by introducing orders on plays and strategies.

Specifically, we use the sub-priority order [22, 4] on priorities: the intuition is that Player favors larger even priorities, and Player favors larger odd priorities.

Definition 13 (sub-priority order [22, 4]).

The sub-priority order on the set of priorities is the total order defined by M1M3102M2M. Recall that we assume that the maximum priority M is even.

 Remark 14.

The existing semantics [24, 43] uses the trivial discrete order on the set , that is, m1m2 iff m1=m2. This difference is crucial for our development.

The operation max:× that returns a bigger number with respect to the standard order on natural numbers is (also) monotone with respect to the sub-priority order.

Lemma 15 (monotonicity [40]).

Let m1,m2,m3. If the inequality m1m2 holds, then the inequality max(m1,m3)max(m2,m3) holds.

We extend the sub-priority order to a partial order on the domain 𝒟𝒜 considering exits.

Definition 16 (domain order).

The domain order 𝐃 on the domain 𝒟𝒜 (defined in Def. 7) is the partial order such that d1𝐃d2 iff (i) d1=, (ii) d2=, or (iii) d1:=(o1,m1) and d2:=(o2,m2) such that o1=o2 and m1m2.

Given an -strategy σ, we define optimal -strategies w.r.t. σ as -strategies that induce plays whose denotations are minimal.

Definition 17 (minimal).

For a set T𝒟𝒜, the set Tmin is the set of minimal elements in T w.r.t. the domain order 𝐃.

Definition 18 (optimal -strategy).

Let 𝒜 be an oPG, i be an entrance, and σ be an -strategy. A -strategy σ is optimal on i w.r.t. σ if the following condition holds:

pσ,σ;i{pσ,τ;i|τ is a -strategy}min.

We further define optimal -strategies; here we do not fix a -strategy. Specifically, we use the upper preorder [1].

Definition 19 (upper preorder [1]).

The upper preorder 𝐔 on the powerset 𝒫(𝒟𝒜) of 𝒟𝒜 is given by T1𝐔T2 if for any d2T2, there is d1T1 such that d1𝐃d2.

The intuition is the following: we fix an entrance i and suppose that there are two -strategies σ and τ. The -strategy σ is “better” than τ if for any -strategy σ, there is a -strategy τ such that pτ,τ;i𝐏pσ,σ;i.

Definition 20 (maximal).

For a set S𝒫(𝒟𝒜), the set Smax is the set of maximal elements in S w.r.t. the upper preorder 𝐔.

Definition 21 (optimal -strategy).

Let 𝒜 be an oPG, and i be an entrance. An -strategy σ is optimal on i if the following condition holds:

{pσ,σ;i|-strategy σ}min{{pτ,τ;i|-strategy τ}min|an -strategy τ}max.

We show an example of optimal -strategies in Example 25 later.

3.3 Pareto Fronts of Open Parity Games

We conclude this section by introducing Pareto fronts of oPGs. Roughly speaking, Pareto fronts are the set of results that are induced by optimal strategies.

Definition 22 (results, result order [22]).

Let 𝒜 be an oPG. The set 𝐑𝒜 of results is the set of non-empty antichains 𝐫 on the domain 𝒟𝒜, that is, 𝐫𝒟𝒜 and 𝐫min=𝐫. The result order 𝐑𝒜 on 𝐑𝒜 is the partial order that is given by the upper preorder 𝐔.

The result order is indeed a partial order because of the minimality of results.

Proposition 23.

The result order is a partial order.

Proof.

Suppose that 𝐫𝐑𝒜𝐫 and 𝐫𝐑𝒜𝐫. It suffices to prove that 𝐫𝐫 due to the symmetry of 𝐫 and 𝐫. For any d1𝐫, there is d2𝐫 such that d2𝐃d1. Similarly, there is d3𝐫 such that d3𝐃d2. Thus, we have d3𝐃d1 and we see d3=d1 due to the minimality of 𝐫. Thus, d1=d2=d3 holds and 𝐫𝐫 holds. We finally define Pareto fronts of oPGs by optimal - and -strategies.

Definition 24 (Pareto front, Pareto-optimal).

Let 𝒜 be an oPG, and i be an entrance. The Pareto front 𝒮(𝒜,i) is the set of denotations of plays that are induced by optimal -strategies and optimal -strategies on i, that is,

𝒮(𝒜,i):={{pσ,σ;i|σ is a -strategy}min|σ is an -strategy}max𝐑𝒜.

We call results 𝐫 in 𝒮(𝒜,i) Pareto-optimal. We write 𝒮(𝒜) for the indexed family (𝒮(𝒜,i))iI𝒜 of Pareto fronts. Note that 𝒮(𝒜,i) and 𝒮(𝒜,i) hold by definition.

Example 25.

Consider the oPG 𝒞:(1,1)(1,0) presented in Fig. 3. The denotation i𝐫,1 contains {(o𝐫,1,2),(o𝐫,1,3),(o𝐥,1,1)}. Since (o𝐫,1,3)𝐃(o𝐫,1,2), we have a result {(o𝐫,1,2),(o𝐫,1,3),(o𝐥,1,1)}min={(o𝐫,1,3),(o𝐥,1,1)}. This result is not Pareto-optimal because the inequality {(o𝐫,1,3),(o𝐥,1,1)}𝐔{(o𝐫,1,1)} holds, where {(o𝐫,1,1)}i𝐫,1. By continuing similar arguments, we can show that the Pareto front 𝒮(𝒞,i𝐫,1) is {{(o𝐫,1,1)}}. Thus, an optimal -strategy on 𝒞 is positionally moving from c to o𝐫,1.

 Remark 26 (meager semantics).

In [45], we introduce meager semantics to eliminate sub-optimal strategies. Meager semantics is defined globally, meaning that optimal strategies are uniformly defined over entrances. Pareto fronts are defined locally, with optimal strategies tailored specifically for each entrance. This locality is essential for our technical development in Sections 4 and 5.

Pareto fronts of oPGs characterise the winning condition of oPGs defined in Def. 9.

Lemma 27.

Let 𝒜 be an oPG, and i be an entrance. The Pareto front 𝒮(𝒜,i) satisfies the following properties:

  1. 1.

    the entrance i is winning iff 𝒮(𝒜,i)={{}},

  2. 2.

    the entrance i is losing iff 𝒮(𝒜,i)={{}}, and

  3. 3.

    the entrance i is pending iff for any T𝒮(𝒜,i), ,T, and for any (o1,m1),(o2,m2)T, if o1=o2, then m1=m2.

Proof.

Suppose that the entrance i is winning. By definition, {}i holds. Since {} is the greatest element, 𝒮(𝒜,i)={{}}.

Suppose that the entrance i is losing. By definition, T holds for any Ti. This means that for any optimal -strategy σ of a given -strategy σ, the denotation pσ,σ;i is because is the least element in the domain, which proves 𝒮(𝒜,i)={{}}.

Suppose that the entrance i is pending. For any T𝒮(𝒜,i), T because is the greatest element. Similarly, T because T={} leads to the contradiction. If (o,m1),(o,m2)T, m1=m2 holds because of the minimality of T.

By the characterisation shown in Lem. 27, it suffices to compute the Pareto fronts of operational semantics of string diagrams of parity games for solving our target problem shown in Section 2.2. We thus extend our target problem as follows:

Compositional Problem Statement: Let 𝔻 be a string diagram of PGs, and i be an entrance. Compute the Pareto front 𝒮(𝔻,i) of the operational semantics 𝔻.

4 Solving Open Parity Games

In this section, we prove the positional determinacy of Pareto fronts through a novel translation from an oPG to a PG specified by a given query, a method we call the loop construction. Utilizing the loop construction, we provide a simple algorithm for computing Pareto fronts. Additionally, we present an analysis of the upper-bound of its time complexity.

4.1 Positional Determinacy of Pareto Fronts

We begin by stating the positional determinacy of Pareto fronts: positional strategies suffice to determine Pareto fronts.

Theorem 28 (positional determinacy).

Pareto fronts are positionally determined, that is, for any entrance i, the following equality holds:

𝒮(𝒜,i)={{pσ,σ;i|a positional -strategy σ}min|a positional -strategy σ}max.

Once we establish the positional determinacy of Pareto fronts, it becomes clear that solving Pareto fronts is decidable through the enumeration of all positional strategies.

We use the following weaker property for proving Thm. 28.

Lemma 29.

Let 𝒜 be an oPG, i be an entrance, and σ be a positional -strategy. Then, positional -strategies suffice, that is, the following equality holds:

{pσ,σ;i|σ is a -strategy}min={pσ,σ;i|σ is a positional -strategy}min.

Proof.

We take a (finite) oPG 𝒜[σ] that is induced by the positional -strategy σ; the nodes and edges of 𝒜[σ] are the same of 𝒜, except the edges from nodes of Player are determined by σ. Take an optimal -strategy σ on 𝒜[σ] from i, which is also optimal on 𝒜 w.r.t. σ. If the play pσ,σ;i is losing, then there is a positional optimal strategy by the positional determinacy of PGs.

Suppose that the play pσ,σ;i reaches an exit o. We write the sequence v1,v2,,vn of nodes for the play pσ,σ;i, where n is the smallest index such that vn=o. If the equality vj=vj implies i=j, then we can easily construct a positional -strategy τ such that pσ,σ;i=pσ,τ;i.

The remaining case is that there are vi=vj such that ij. Since σ is positional, we can assume that vi and vj are owned by Player : if every vi=vj such that ij is owned by Player , it will not reach an exit, which leads to the contradiction. We assume that i<j without loss of generality. If the maximum priority m occurs in vi,,vj is odd, then it contradicts to the fact that σ is optimal. If the maximum priority m occurs in vi,,vj is even, then the shortcut play p:=v1,,vi,vj+1,,vn has the same denotation. In fact, if the maximum priority in pσ,σ;i is m, then the maximum priority in p is also m; otherwise, it contradicts to the fact that σ is optimal. If the maximum priority in pσ,σ;i is strictly greater than m, then the denotation of p does not change because removing vi+1,,vj does not matter. By iterating this shortcut construction, we can finally obtain a play p=v1,,vl such that vi=vj implies i=j and the equality p=pσ,σ;i holds in finite steps. Thus, we can construct a positional -strategy τ such that pσ,σ;i=pσ,τ;i.

 Remark 30.

The assumption that the -strategy σ in Lem. 29 is positional is indispensable. Consider the oPG shown in Fig. 3, and an -strategy such that the Player repeatedly moves from c to d until she reaches c twice, and then moves to o𝐫,1. Then there is an optimal -strategy that moves first from b to a, and later from b to o𝐥,1, which is not positional.

4.2 The Loop Construction and the Algorithm

In this section, we introduce our loop construction and we prove the positional determinacy of Pareto fronts. The parameter of the loop construction is a pair of an entrance and a query for oPGs. Informally, we show that positional strategies are sufficient to achieve any Pareto-optimal result on the Pareto front, and with the loop construction they can be specified by “minimal” queries, the number of which is finite. In addition, we present a simple but efficient algorithm based on the loop construction, which shows improvements over our previous algorithm [45].

Definition 31 (query).

Let 𝒜 be an oPG. A query222We call q query because q asks whether there is an -strategy that leads to a better result than the dual of q (see Lem. 38). q is a function q:O𝒜{}. We write 𝒜 for the set of queries on 𝒜.

Figure 4: The loop constructions 𝔾(𝒜,i1,q1) and 𝔾(𝒜,i1,q2) that add white edges, where queries q1,q2 are given by (i) q1(o1):=3 and q1(o2):=, and (ii) q2(o1):=0 and q2(o2):=2.

Given an oPG 𝒜, a pair (i,q) of an entrance i and a query q induces a PG 𝔾(𝒜,i,q) by the loop construction.

Definition 32 (loop construction).

Let 𝒜:=(𝒢𝒜,𝖨𝖮𝒜) be an oPG, i be an entrance, and q be a query. The loop construction 𝔾(𝒜,i,q) builds a PG (V𝒜,V𝒜,V𝒜,E,Ω), where E is the least relation and Ω is the function such that

((v,v)E𝒜 and vO𝒜)((v,v)E, and Ω(v,v):=Ω𝒜(v,v)),
(oO𝒜 and q(o))((o,i)E, and Ω(o,i):=q(o)), and
(oO𝒜 and q(o)=)((o,o)E, and Ω(o,o):=1).

We present two examples in Fig. 4: for each exit o, the loop construction 𝔾(𝒜,i,q) adds (i) an edge to the specified entrance i whose assigned priority is q(o), or (ii) makes a self loop with the priority 1 if q(o)=.

The loop construction is closely related with Pareto fronts of oPGs via dual of queries. Firstly, we extend the sub-priority order to the functorial order of queries. We write ¯ for the total order on {,} such that m¯m iff (i) m is the least element , (ii) mm, or (iii) m is the greatest element .

Definition 33 (query order).

Let 𝒜 be an oPG. The query order 𝒜 on 𝒜 is the functorial order w.r.t. the (restricted) total order ¯ on {}, that is, the inequality q𝒜q holds if q(o)¯q(o) for each oO𝒜.

Given a query q and assuming q(o)=m, the dual md of m, which is also called the left-residual of 0 in [40], reveals the relationship between queries and Pareto fronts. We define the dual md as the lowest priority such that priorities that occur infinitely often are only m and md, and it satisfies the parity condition (see Lem. 35).

Definition 34 (dual).

Let m. The dual md is given by (i) md:=m+1 if m is odd, (ii) md:=0 if m=0, and (iii) md:=m1 if m is even and m>0.

Lemma 35 (​​[40]).

Let m,m. The max priority max(m,m) is even iff mdm.

We define the dual of queries based on the dual of priorities.

Definition 36 (dual of query).

Let 𝒜 be an oPG, i be an entrance, and q be a query. The dual r(q) of the query q is the result r(q)𝐑𝒜 that is defined as follows:

  • if q(o)= for any oO𝒜, then r(q):={}, and

  • otherwise, r(q):={(o,q(o)d)oO𝒜,q(o)}.

Note that for any result 𝐫𝐑𝒜 unless 𝐫={}, there is a query q such that r(q)=𝐫.

Lemma 37 (duality).

Let 𝒜 be an oPG, i be an entrance, and q,q be queries. The equality q=q holds iff the equality r(q)=r(q) holds. Moreover, the inequality q𝒜q holds iff the inequality r(q)𝐑𝒜r(q) holds.

Proof.

Clearly, the equality q=q holds iff the equality r(q)=r(q) holds.

Suppose that q𝒜q holds. Then, either q(o)= or q(o)q(o) hold for each oO. For any (o,m)r(q), the equality m=q(o)d holds by definition, and q(o)dm. We thus conclude r(q)𝐑𝒜r(q). The converse direction holds in the same way. The lemma presented below is crucial for proving the correctness of the loop construction (Prop. 39). This, in turn, directly contributes to the proof of the positional determinacy of Pareto fronts.

Lemma 38.

Let 𝒜:=(𝒢𝒜,𝖨𝖮𝒜) be an oPG, i be an entrance, and q be a query. Then, the following conditions are equivalent:

  1. 1.

    the node i on the PG 𝔾(𝒜,i,q) is winning,

  2. 2.

    there is a result 𝐫 such that r(q)𝐑𝒜𝐫 and 𝐫𝒮(𝒜,i).

Proof.

Let q(o)= for any oO𝒜. Since r(q):={} is the greatest element, it suffices to prove that the following conditions are equivalent:

  1. 1.

    the node i on the PG 𝔾(𝒜,i,q) is winning,

  2. 2.

    𝒮(𝒜,i)={{}}.

Suppose Item 1 holds, then there is an optimal -strategy such that every play that is induced by a -strategy can not reach any exit oO𝒜 because of the loop construction: every exit has a self-loop with the priority 1. Therefore, the optimal -strategy is also optimal for 𝒜 from i as well, and Item 2 holds. The converse direction holds by the same argument.

Let q(o) for some oO𝒜. Suppose that the node i on the 𝔾(𝒜,i,q) is winning. Because of the positional determinacy of PGs, there is a winning positional -strategy σ on 𝔾(𝒜,i,q). By Lem. 29, we only consider positional -strategies. For any positional -strategy τ on 𝒜, the play pσ,σ;i that is induced by σ and σ satisfies the following condition: if pσ,σ;i does not reach any exits oO𝒜, then pσ,σ;i is winning. This is because σ is winning on 𝔾(𝒜,i,q). If pσ,σ;i reaches an exit oO𝒜, then the maximal priority m that occurs in pσ,σ;i until reaching o satisfies that max(q(o),m) is even; here q(o) because σ is winning on 𝔾(𝒜,i,q). This is equivalent to q(o)dm by Lem. 35. Thus, we conclude that r(q)𝐑𝒜{pσ,σ;i|σ is a -strategy}min, which proves Item 2.

Conversely, suppose that there is a result 𝐫 such that r(q)𝐑𝒜𝐫 and 𝐫𝒮(𝒜,i). Take an -strategy σ such that 𝐫={pσ,σ;i|σ is a -strategy}min; note that σ may not be positional. Then, the -strategy σ natually induces an -strategy σ on 𝔾(𝒜,i,q) that mimicks σ. It is easy to show that the -strategy σ is indeed winning by a similar argument.

The following proposition is a direct consequence of Lemmas 37 and 38.

Proposition 39.

Let 𝒜 be an oPG, i be an entrance, and q be a query. The following conditions are equivalent:

  1. 1.

    the query q is minimal such that the entrance i on the PG 𝔾(𝒜,i,q) is winning,

  2. 2.

    the dual r(q) is Pareto-optimal, that is, r(q)𝒮(𝒜,i).

Finally, we prove the positional determinacy of Pareto fronts.

Proof of Thm. 28.

Suppose that the entrance i of 𝒜 is not losing, that is, 𝒮(𝒜,i){{}} . By Prop. 39 (and its proof), every Pareto-optimal result 𝐫 induces the corresponding minimal query q such that the PG 𝔾(𝒜,i,q) is winning. Since the PG 𝔾(𝒜,i,q) is positionally determined, there is a positional winning -strategy τ on 𝔾(𝒜,i,q); we also regard τ as a positional -strategy on 𝒜. By Lem. 29, we only consider positional optimal -strategies τ w.r.t. τ. If the play pτ,τ;i does not reach an exit, then the play pτ,τ;i is winning. If the play pτ,τ;i reach an exit o, then the equality q(o)d=m hold, where m is the maximum priority that occurs in the play pτ,τ;i; here we use the mimality of q and τ. Thus, we can conclude that {pτ,στ;i|τ is a positional -strategy}min=r(q).

The case that the entrance i of 𝒜 is losing is easy to show. This is because of the positional determinacy of parity games.

Algorithm and Time Complexity.

The positional determinacy of oPGs that is shown in Thm. 28 implies that solving oPGs is decidable by enumerating positional strategies. Furthermore, Prop. 39 suggests that there is an efficient algorithm based on the loop construction when the number of exists are small. Specifically, we evaluate whether the PG 𝔾(𝒜,i,q) is winning for each query q, and we keep only those minimal queries that are wininng, whose duals are Pareto-optimal. Notably, we can use well-studied algorithms of PGs to solve the PG 𝔾(𝒜,i,q) without the need to enumerate positional strategies. Alg. 1 shows the details of our algorithm.

Algorithm 1 solveParetoFront: Solving Pareto fronts for oPGs.
Proposition 40.

Alg. 1 requires time 𝒪((M+2)NL+N(M+2)2N) to compute the Pareto front 𝒮(𝒜,i) of an oPG 𝒜 and an entrance i, where N is the number of exits, M is the largest priority, and L is the required time for a given algorithm to solve PGs that are built by the loop construction.

Proof.

Since the number of queries Q is (M+2)N, we solve PGs Q times, which requires time 𝒪(QL). Removing sub-optimal results can be done in 𝒪(NQ2) by comparing all results: for comparing two results, we see exits at most N times. Note that Alg. 1 requires an exponential memory to the number of exists since the size of Pareto fronts itself can be exponential. A variant of our previous algorithm [45], designed for open parity games, involves enumerating all positional strategies, the number of which is 𝒪((ME)|V|), where ME represents the maximum number of the outgoing edges, and V is the set of nodes. In contrast, Alg. 1 is exponential only in the number of exits, benefiting from the quasi-polymial-time algorithms for parity games (e.g. [10, 25, 19, 32]).

5 Solving String Diagrams of Parity Games

We apply Alg. 1 that solves oPGs for compositionally solving string diagrams of PGs.

For compositionally solving a given PG 𝔻, which is defined in Def. 5, we translate Pareto fronts of oPGs into shortcut oPGs. A similar shortcut construction is introduced for MDPs [46], where there is the unique Player.

Definition 41 (shortcut oPG).

Let 𝒜:=(𝒢𝒜,𝖨𝖮𝒜) be an oPG. The shortcut oPG 𝒞(𝒜) of 𝒜 is the oPG (𝒢,𝖨𝖮𝒜), where the parity game 𝒢:=(V,V,V,E,Ω) is defined by

  • V:=𝖨𝖮𝒜iI𝒜𝒮(𝒜,i), V:=𝖨𝖮𝒜, and V:=iI𝒜𝒮(𝒜,i), and

  • we simultaneously define E and Ω: for any 𝐫𝒮(𝒜,i), (i,𝐫)E and Ω(i,𝐫):=0, and for any d𝐫,

    • if d=, then (𝐫,𝐫)E and Ω(𝐫,𝐫):=0,

    • if d=(o,m), then (𝐫,o)E and Ω(𝐫,o):=m, and

    • if d=, then (𝐫,𝐫)E and Ω(𝐫,𝐫):=1.

Figure 5: The shortcut oPG 𝒞(𝒜) of an oPG 𝒜 whose Pareto front 𝒮(𝒜,i𝐫,1) is {{(o𝐥,1,1)},{(o𝐫,1,1)},{(o𝐫,1,2),(o𝐥,1,2)}}. We write 𝐫1, 𝐫2, and 𝐫3 for {(o𝐥,1,1)}, {(o𝐫,1,1)}, and {(o𝐫,1,2),(o𝐥,1,2)}, respectively. Note that the entrance i𝐫,1 is owned by Player .

We present an example to illustrate this shortcut construction in Fig. 5. Given an oPG 𝒜 and its Pareto fronts 𝒮(𝒜), the shortcut oPG 𝒞(𝒜) is a summary of 𝒜, that is, it eliminates internal nodes in 𝒜, and keeps only optimal results that are stored in the Pareto fronts 𝒮(𝒜). This shortcut construction allows us to reuse the Pareto fronts for different appearances in a given string diagram with a reduced number of nodes.

Formally, the following two propositions ensure the correctness of this shortcut construction, that is, the compositionality of Pareto fronts with the shortcut construction.

Proposition 42.

Let 𝒜 be an oPG. The Pareto front 𝒮(𝒜,i) of 𝒜 coincides with the Pareto front 𝒮(𝒞(𝒜),i) of the shortcut oPG 𝒞(𝒜).

Prop. 42 is easy to prove by the definition of the shortcut construction.

Proposition 43.

Let {,}, 𝒜 be an oPG, and i be an entrance. The Pareto front 𝒮(𝒜,i) of 𝒜 coincides with the Pareto front 𝒮(𝒞(𝒜)𝒞(),i) of 𝒞(𝒜)𝒞().

Proof Sketch.

For =Prop. 43 is easy to prove because there is no interaction between 𝒜 and . For =, we focus on “entrance-dependent” strategies, and prove the monotonicity of entrance-dependent strategies. Furthermore, we can see that entrance-dependent -strategies suffice for entrance-dependent -strategies, like Lem. 29. Using these facts and the positional determinacy (Thm. 28), we can prove the compositionality of the Pareto front. We present formal definitions and proofs in Appendix A.

Algorithm 2 solveStringDiagrams: Solving String Diagrams of PGs.

By Props 42 and 43, we can compositionally solve string diagrams for PGs: we show a pseudocode in Alg. 2. For a given string diagram 𝔻, we inductively solve 𝔻: for the base case, that is, 𝔻=𝒜, we directly apply Alg. 1 for 𝒜. For the step case, that is, 𝔻=𝔻1𝔻2 for {,}, we recursively solve 𝔻1 and 𝔻2, and construct their shortcut oPGs. By Prop. 43, solving 𝒮(𝒞(𝔻1)𝒞(𝔻2)) leads to the Pareto front of 𝔻.

We remark that for a string diagram 𝔻 such that 𝔻 has no exists, Alg. 2 runs in exponential-time, whereas monolithic algorithms – obtained by disregarding the compositional structure – can run in quasi-polynomial time (e.g. [10]). Nevertheless, Alg. 2 can reuse the solutions of individual components across multiple occurrences, which is particularly beneficial when the system contains duplicate subsystems. For instance, [46, 47] exploit such duplication to verify hierarchical systems, where reusability is key to achieving high performance.

6 Conclusion

We introduce Pareto fronts of oPGs as a multi-objective solution. Positional determinacy holds for our multi-objective solution of oPGs, which leads to our novel algorithm for solving open parity games with the loop construction. We propose the shortcut construction for open parity games, and we provide a compositional algorithm for string diagrams of parity games by composing Pareto fronts.

A future work is to support the mean-payoff objective, where we have to consider the sum of weights along plays. Although we expect that positional determinacy also holds for a similar semantics for open mean-payoff (or energy) games, the number of objectives may become huge because we believe that we have to consider the sum of weights along plays. This is challenging to achieve an efficient compositional algorithm for string diagrams of mean-payoff games. For this, we believe that an efficient approximation algorithm for Pareto fronts of open mean-payoff games is needed.

It would be interesting to investigate whether strategy improvement algorithms for parity games (e.g. [42, 33]) can be lifted to the setting of string diagrams of parity games. In this context, a strategy improvement algorithm for string diagrams would maintain a strategy throughout the iteration process – one that is not yet winning due to the openness of the system, but still encodes essential information for obtaining the compositional solution. Pursuing this direction and comparing our algorithm with such strategy improvement approaches is an exciting future direction.

Extending the diagrammatic language for parity games [37] to our semantics is another interesting future direction. In our work we use the sub-priority order on priorities, while they use the trivial discrete order on priorities. This difference is essential, since positional strategies are sufficient for our semantics, while they are not sufficient for their semantics (of oPGs).

References

  • [1] Samson Abramsky. Domain theory in logical form. In LICS, pages 47–53. IEEE Computer Society, 1987.
  • [2] John C Baez and Jason Erbele. Categories in control. arXiv preprint arXiv:1405.6881, 2014.
  • [3] John C. Baez, Fabrizio Genovese, Jade Master, and Michael Shulman. Categories of nets. In LICS, pages 1–13. IEEE, 2021. doi:10.1109/LICS52264.2021.9470566.
  • [4] Dietmar Berwanger, Anuj Dawar, Paul Hunter, and Stephan Kreutzer. Dag-width and parity games. In STACS, volume 3884 of Lecture Notes in Computer Science, pages 524–536. Springer, 2006. doi:10.1007/11672142_43.
  • [5] Filippo Bonchi, Fabio Gadducci, Aleks Kissinger, Pawel Sobocinski, and Fabio Zanasi. String diagram rewrite theory I: rewriting with Frobenius structure. J. ACM, 69(2):14:1–14:58, 2022. doi:10.1145/3502719.
  • [6] Filippo Bonchi, Joshua Holland, Robin Piedeleu, Pawel Sobocinski, and Fabio Zanasi. Diagrammatic algebra: from linear to concurrent systems. Proc. ACM Program. Lang., 3(POPL):25:1–25:28, 2019. doi:10.1145/3290338.
  • [7] Filippo Bonchi, Pawel Sobocinski, and Fabio Zanasi. Full abstraction for signal flow graphs. In POPL, pages 515–526. ACM, 2015. doi:10.1145/2676726.2676993.
  • [8] Filippo Bonchi, Pawel Sobocinski, and Fabio Zanasi. The calculus of signal flow diagrams I: linear relations on streams. Inf. Comput., 252:2–29, 2017. doi:10.1016/J.IC.2016.03.002.
  • [9] Véronique Bruyère, Jean-François Raskin, and Clément Tamines. Pareto-rational verification. In CONCUR, volume 243 of LIPIcs, pages 33:1–33:20. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2022. doi:10.4230/LIPICS.CONCUR.2022.33.
  • [10] Cristian S. Calude, Sanjay Jain, Bakhadyr Khoussainov, Wei Li, and Frank Stephan. Deciding parity games in quasi-polynomial time. SIAM J. Comput., 51(2):17–152, 2022. doi:10.1137/17M1145288.
  • [11] Taolue Chen, Vojtech Forejt, Marta Z. Kwiatkowska, Aistis Simaitis, and Clemens Wiltsche. On stochastic games with multiple objectives. In MFCS, volume 8087 of Lecture Notes in Computer Science, pages 266–277. Springer, 2013. doi:10.1007/978-3-642-40313-2_25.
  • [12] Edmund M. Clarke, David E. Long, and Kenneth L. McMillan. Compositional model checking. In LICS, pages 353–362. IEEE Computer Society, 1989. doi:10.1109/LICS.1989.39190.
  • [13] Bob Coecke and Ross Duncan. Interacting quantum observables. In ICALP (2), volume 5126 of Lecture Notes in Computer Science, pages 298–310. Springer, 2008. doi:10.1007/978-3-540-70583-3_25.
  • [14] Bob Coecke and Aleks Kissinger. Picturing Quantum Processes: A First Course in Quantum Theory and Diagrammatic Reasoning. Cambridge University Press, 2017. doi:10.1017/9781316219317.
  • [15] E. Allen Emerson. Automata, tableaux and temporal logics (extended abstract). In Logic of Programs, volume 193 of Lecture Notes in Computer Science, pages 79–88. Springer, 1985. doi:10.1007/3-540-15648-8_7.
  • [16] E. Allen Emerson and Charanjit S. Jutla. Tree automata, mu-calculus and determinacy (extended abstract). In FOCS, pages 368–377. IEEE Computer Society, 1991. doi:10.1109/SFCS.1991.185392.
  • [17] E. Allen Emerson, Charanjit S. Jutla, and A. Prasad Sistla. On model checking for the μ-calculus and its fragments. Theor. Comput. Sci., 258(1-2):491–522, 2001. doi:10.1016/S0304-3975(00)00034-7.
  • [18] Kousha Etessami, Marta Z. Kwiatkowska, Moshe Y. Vardi, and Mihalis Yannakakis. Multi-objective model checking of Markov decision processes. Log. Methods Comput. Sci., 4(4), 2008. doi:10.2168/LMCS-4(4:8)2008.
  • [19] John Fearnley, Sanjay Jain, Bart de Keijzer, Sven Schewe, Frank Stephan, and Dominik Wojtczak. An ordered approach to solving parity games in quasi-polynomial time and quasi-linear space. Int. J. Softw. Tools Technol. Transf., 21(3):325–349, 2019. doi:10.1007/S10009-019-00509-3.
  • [20] John Fearnley and Sven Schewe. Time and space results for parity games with bounded treewidth. Log. Methods Comput. Sci., 9(2), 2013. doi:10.2168/LMCS-9(2:6)2013.
  • [21] Vojtech Forejt, Marta Z. Kwiatkowska, and David Parker. Pareto curves for probabilistic model checking. In ATVA, volume 7561 of Lecture Notes in Computer Science, pages 317–332. Springer, 2012. doi:10.1007/978-3-642-33386-6_25.
  • [22] Koichi Fujima, Sohei Ito, and Naoki Kobayashi. Practical alternating parity tree automata model checking of higher-order recursion schemes. In APLAS, volume 8301 of Lecture Notes in Computer Science, pages 17–32. Springer, 2013. doi:10.1007/978-3-319-03542-0_2.
  • [23] Neil Ghani, Jules Hedges, Viktor Winschel, and Philipp Zahn. Compositional game theory. In LICS, pages 472–481. ACM, 2018. doi:10.1145/3209108.3209165.
  • [24] Charles Grellois and Paul-André Melliès. Finitary semantics of linear logic and higher-order model-checking. In MFCS (1), volume 9234 of Lecture Notes in Computer Science, pages 256–268. Springer, 2015. doi:10.1007/978-3-662-48057-1_20.
  • [25] Marcin Jurdzinski and Ranko Lazic. Succinct progress measures for solving parity games. In LICS, pages 1–9. IEEE Computer Society, 2017. doi:10.1109/LICS.2017.8005092.
  • [26] Roope Kaivola. Compositional model checking for linear-time temporal logic. In CAV, volume 663 of Lecture Notes in Computer Science, pages 248–259. Springer, 1992. doi:10.1007/3-540-56496-9_20.
  • [27] Naoki Kobayashi and C.-H. Luke Ong. A type system equivalent to the modal mu-calculus model checking of higher-order recursion schemes. In LICS, pages 179–188. IEEE Computer Society, 2009. doi:10.1109/LICS.2009.29.
  • [28] Dexter Kozen. Results on the propositional mu-calculus. Theor. Comput. Sci., 27:333–354, 1983. doi:10.1016/0304-3975(82)90125-6.
  • [29] Orna Kupferman and Moshe Y. Vardi. Weak alternating automata and tree automata emptiness. In STOC, pages 224–233. ACM, 1998. doi:10.1145/276698.276748.
  • [30] Marta Z. Kwiatkowska, Gethin Norman, David Parker, and Hongyang Qu. Compositional probabilistic verification through multi-objective model checking. Inf. Comput., 232:38–65, 2013. doi:10.1016/J.IC.2013.10.001.
  • [31] Elena Di Lavore, Jules Hedges, and Pawel Sobocinski. Compositional modelling of network games. In CSL, volume 183 of LIPIcs, pages 30:1–30:24. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2021. doi:10.4230/LIPICS.CSL.2021.30.
  • [32] Karoliina Lehtinen. A modal μ perspective on solving parity games in quasi-polynomial time. In LICS, pages 639–648. ACM, 2018. doi:10.1145/3209108.3209115.
  • [33] Michael Luttenberger, Philipp J. Meyer, and Salomon Sickert. Practical synthesis of reactive systems from LTL specifications via parity games. Acta Informatica, 57(1-2):3–36, 2020. doi:10.1007/S00236-019-00349-3.
  • [34] Jan Obdrzálek. Fast mu-calculus model checking when tree-width is bounded. In CAV, volume 2725 of Lecture Notes in Computer Science, pages 80–92. Springer, 2003. doi:10.1007/978-3-540-45069-6_7.
  • [35] C.-H. Luke Ong. On model-checking trees generated by higher-order recursion schemes. In LICS, pages 81–90. IEEE Computer Society, 2006. doi:10.1109/LICS.2006.38.
  • [36] Christos H. Papadimitriou and Mihalis Yannakakis. On the approximability of trade-offs and optimal access of web sources. In FOCS, pages 86–92. IEEE Computer Society, 2000. doi:10.1109/SFCS.2000.892068.
  • [37] Robin Piedeleu. The algebra of parity games. CoRR, abs/2501.18499, 2025. doi:10.48550/arXiv.2501.18499.
  • [38] Julian Rathke, Pawel Sobocinski, and Owen Stephens. Compositional reachability in Petri nets. In RP, volume 8762 of Lecture Notes in Computer Science, pages 230–243. Springer, 2014. doi:10.1007/978-3-319-11439-2_18.
  • [39] Sylvain Salvati and Igor Walukiewicz. Krivine machines and higher-order schemes. Inf. Comput., 239:340–355, 2014. doi:10.1016/J.IC.2014.07.012.
  • [40] Takeshi Tsukada and C.-H. Luke Ong. Compositional higher-order model checking via ω-regular games over Böhm trees. In CSL-LICS, pages 78:1–78:10. ACM, 2014. doi:10.1145/2603088.2603133.
  • [41] Yaron Velner, Krishnendu Chatterjee, Laurent Doyen, Thomas A. Henzinger, Alexander Moshe Rabinovich, and Jean-François Raskin. The complexity of multi-mean-payoff and multi-energy games. Inf. Comput., 241:177–196, 2015. doi:10.1016/J.IC.2015.03.001.
  • [42] Jens Vöge and Marcin Jurdzinski. A discrete strategy improvement algorithm for solving parity games. In CAV, volume 1855 of Lecture Notes in Computer Science, pages 202–215. Springer, 2000. doi:10.1007/10722167_18.
  • [43] Kazuki Watanabe, Clovis Eberhart, Kazuyuki Asada, and Ichiro Hasuo. A compositional approach to parity games. In MFPS, volume 351 of EPTCS, pages 278–295, 2021. doi:10.4204/EPTCS.351.17.
  • [44] Kazuki Watanabe, Clovis Eberhart, Kazuyuki Asada, and Ichiro Hasuo. Compositional probabilistic model checking with string diagrams of MDPs. In CAV (3), volume 13966 of Lecture Notes in Computer Science, pages 40–61. Springer, 2023. doi:10.1007/978-3-031-37709-9_3.
  • [45] Kazuki Watanabe, Clovis Eberhart, Kazuyuki Asada, and Ichiro Hasuo. Compositional solution of mean payoff games by string diagrams. In Principles of Verification (3), volume 15262 of Lecture Notes in Computer Science, pages 423–445. Springer, 2024. doi:10.1007/978-3-031-75778-5_20.
  • [46] Kazuki Watanabe, Marck van der Vegt, Ichiro Hasuo, Jurriaan Rot, and Sebastian Junges. Pareto curves for compositionally model checking string diagrams of MDPs. In TACAS (2), volume 14571 of Lecture Notes in Computer Science, pages 279–298. Springer, 2024. doi:10.1007/978-3-031-57249-4_14.
  • [47] Kazuki Watanabe, Marck van der Vegt, Sebastian Junges, and Ichiro Hasuo. Compositional value iteration with pareto caching. In CAV (3), volume 14683 of Lecture Notes in Computer Science, pages 467–491. Springer, 2024. doi:10.1007/978-3-031-65633-0_21.

Appendix A Proof of Prop. 43 for =

In this section, we additionally assume that every entrance on a given oPG is not reachable except as an initial node, that is, (v,v)E implies vI without loss of generality. We fix oPGs 𝒜,, and an entrance i on 𝒜. Here, we only consider plays that start from the specified entrance i𝒜; note that the sequential composition is bidirectional and the ordering between 𝒜 and is not essential. Firstly, we introduce entrance-dependent strategies on 𝒜: intuitively, for each play, they behave positionally depending on the last entrance that appears in the play.

Definition 44 (entrance-dependent strategy).

Let σ be an -strategy on 𝒜. We write Σ,p𝒜 and Σ,p for the set of positional -strategies on 𝒜 and , respectively. The -strategy σ is entrance-dependent if there are assignments σ,_𝒜:I𝒜Σ,p𝒜 and σ,_:IΣ,p such that for any play p=p1pnV×V, if the last entrance i that appears in p is iI𝒜, then the -strategy σ is given by σ(p)=σ,i𝒜(pn), and same for the case of iI.

We also define entrance-dependent -strategies in the same manner.

Entrance-dependent strategies consist of positional strategies and monotonicity of positional strategies holds. Intuitively, if we use better (or worse) positional strategies for entrance-dependent strategies, then their entrance-dependent strategies are also better (or worse).

Lemma 45 (-monotonicity).

Let σ be an entrance-dependent -strategy and σ,τ be entrance-dependent -strategies. Suppose that for each iI𝒜, the inequality pσ,i𝒜,τ,i𝒜;i𝐃pσ,i𝒜,σ,i𝒜;i holds, and same for iI. Then, the inequality pσ,τ;i𝐃pσ,σ;i holds.

Proof.

We prove the inequality pσ,τ;i𝐃pσ,σ;i. If the play pσ,σ;i is winning, then obviously the inequality holds.

Suppose that the play pσ,σ;i reaches an exit o (of 𝒜) with the maximum priority m, that is, pσ,σ;i=(o,m). By the assumption and the monotonicity of priorities (Lem. 15), the play pσ,τ;i is either losing, or reaching the same exit with a potentially different maximum priority m such that mm. Thus, the desired inequality also holds.

Suppose that the play pσ,σ;i is losing. By collecting the denotations of pσ,i𝒜,σ,i𝒜;i and pσ,i,σ,i;i, we obtain an infinte sequence m1m2 of priorities for pσ,σ;i such that the maximum priorities that occurs infinitely often in this sequence is odd. By the assumption, the corresponding infinite sequence m1m2 of priorities for pσ,τ;i satisfies that mjmj for each j. For each j, if mj is the maximum priority m that occurs infinitely often in the sequence m1m2, then mj is a bigger or the same odd number, and at least one of the such odd number occurs infinitely often in the sequence m1m2 because the size of priorities is finite. If mj is even, then mj is a smaller or the same even number, therefore, the maximum even number that occurs infinitely often in the sequence m1m2 is strictly smaller than m. Therefore, the maximum number that occurs infinitely often in m1m2 is again odd, which means that the desired inequality holds.

Lemma 46 (-monotonicity).

Let σ,τ be entrance-dependent -strategies. Suppose that for each iI𝒜, the following inequality holds:

{pτ,i𝒜,τ;i|τ𝒜 is a -strategy}min𝐑𝒜{pσ,i𝒜,σ;i|σ𝒜 is a -strategy}min,

and same for iI . Then, for any entrance-dependent -strategy σ, there is an entrance-dependent -strategy τ such that pτ,τ;i𝐃pσ,σ;i.

Proof.

For any entrance-dependent -strategy σ, we construct an entrance-dependent -strategy τ such that the inequality pτ,τ;i𝐃pσ,σ;i holds. For each entrance iI𝒜, there is a positional optimal -strategy σ,i𝒜 such that the inequality pσ,i𝒜,σ,i𝒜;i𝐃pσ,i𝒜,σ,i𝒜;i holds. By the assumption, we can take a positional optimal -strategy τ,i𝒜 such that pτ,i𝒜,τ,i𝒜;i𝐃pσ,i𝒜,σ,i𝒜;i, thus the inequality pτ,i𝒜,τ,i𝒜;i𝐃pσ,i𝒜,σ,i𝒜;i holds. Similarly, we can take a positional optimal -strategy τ,i for each entrance iI such that the inequality pτ,i,τ,i;i𝐃pσ,i,σ,i;i holds. By the almost same argument used in the proof of Lem. 45, we can conclude that the inequality pτ,τ;i𝐃pσ,σ;i holds, where τ is the entrance-dependent -strategy that consists of these positional optimal -strategies τ,i𝒜 and τ,i.

The last ingredient for proving Prop. 43 is the fact that entrance-dependent -strategies suffice for entrance-dependent -strategies.

Lemma 47.

Let σ be an entrance-dependent -strategy. Then, entrance-dependent -strategies suffice, that is, the following equality holds:

{pσ,σ;i|-strategy σ}min={pσ,τ;i|an entrance-dependent -strategy τ}min.

Proof.

Let σ be an optimal -strategy. If the play pσ,σ;i is losing, it is straightforward to construct a losing entrance-dependent -strategy by distinguishing last entrances, and positional determinacy of PGs.

Suppose that the play pσ,σ;i reaches an exit o on 𝒜. Let i1in be the (finite) sequence of entrances in I𝒜I that occurs in pσ,σ;i, where the ordering is the order of their appearance. Then, we can take a positioal -strategy τ,j𝒜 for each entrances ij such that the constructed -strategy τ from these τ,j𝒜 satisfies that pσ,τ;i𝐃pσ,σ;i. Since σ is optimal, the equality pσ,τ;i=pσ,σ;i holds.

Here, τ may not be an entrance-dependent, that is, there are jj such that ij=ij and τ,j𝒜τ,j𝒜 in general. If τ is not an entrance-dependent, we construct an -entrance-dependent strategy by a similar argument of the proof of Lem. 29; note that we assume σ is entrance-dependent.

Definition 48 (lower preorder).

Let 𝐓 be a set such that 𝐓:={TmaxT𝐑𝒜,and T}. Then, the lower preorder 𝐋 on 𝐓 is defined as follows: T1max𝐋T2max if for any result 𝐫1T1max, there is a result 𝐫2T2max such that 𝐫1𝐑𝒜𝐫2.

Lemma 49.

The preorder 𝐋 is a partial order.

Proof.

It suffices to prove that T1max𝐋T2max and T2max𝐋T1max imply that T1maxT2max. For any result 𝐫1T1max, there is a result 𝐫2T2max such that 𝐫1𝐑𝒜𝐫2. Similarly, there is a 𝐫3T1max such that 𝐫2𝐑𝒜𝐫3. Thus, we can conclude that 𝐫1=𝐫3 because of the maximality of T1max. Since the result order is a partial order, we can conclude that 𝐫1=𝐫2, thus the desired T1maxT2max holds.

We conclude this section by showing our proof of Prop. 43.

Proof of Prop. 43 for =.

By definition and Thm. 28, the Pareto front 𝒮(𝒞(𝒜)𝒞(),i) is given by

{{pσ,σ;i|a positional σ on 𝒞(𝒜)𝒞()}min|a positional σ on 𝒞(𝒜)𝒞()}max.

For a positional -strategy σ on 𝒞(𝒜)𝒞(), there is a corresponding entrance-dependent -strategy σ~ on 𝒜 by mimicking σ. Similarly, the following equality holds:

{pσ,σ;i|a positional σ on 𝒞(𝒜)𝒞()}min
= {pσ~,σ~;i|a positional σ on 𝒞(𝒜)𝒞()}min,

where the -strategy σ~ is the corresponding entrance-dependent -strategy of a positional -strategy σ, and the play pσ~,σ~;i is on 𝒜. By Lemmas 45 and 47, we can further say that the Pareto front 𝒮(𝒞(𝒜)𝒞(),i) is given by

{{pσ~,σ;i|-strategy σ on 𝒜}min|a positional σ on 𝒞(𝒜)𝒞()}max,

By using the lower preorder 𝐋 on the sets of maximal results, which is a partial order (Lem. 49), we obtain the following inequality:

𝒮(𝒞(𝒜)𝒞(),i)
𝐋 {{pσ,σ;i|-strategy σ on 𝒜}min|an -strategy σ on 𝒜}max.

On the other hand, since positional strategies are entrance-dependent, we obtain the following inequality by Lemmas 45 and 46:

𝒮(𝒞(𝒜)𝒞(),i)
𝐋 {{pσ,σ;i|entrance-dependent σ on 𝒜}min|positional σ on 𝒜}max.

By Thms 28 and 49, we can conclude that 𝒮(𝒜,i)=𝒮(𝒞(𝒜)𝒞(),i).