Beating Competitive Ratio 4 for Graphic Matroid Secretary
Abstract
One of the classic problems in online decision-making is the secretary problem, where the goal is to hire the best secretary out of rankable applicants or, in a natural extension, to maximize the probability of selecting the largest number from a sequence arriving in random order. Many works have considered generalizations of this problem where one can accept multiple values subject to a combinatorial constraint. The seminal work of Babaioff, Immorlica, Kempe, and Kleinberg (SODA’07, JACM’18) proposed the matroid secretary conjecture, suggesting that there exists an -competitive algorithm for the matroid constraint, and many works since have attempted to obtain algorithms for both general matroids and specific classes of matroids. The ultimate goal of these results is to obtain an -competitive algorithm, and the strong matroid secretary conjecture states that this is possible for general matroids.
One of the most important classes of matroids is the graphic matroid, where a set of edges in a graph is deemed independent if it contains no cycle. Given the rich combinatorial structure of graphs, obtaining algorithms for these matroids is often seen as a good first step towards solving the problem for general matroids. For matroid secretary, Babaioff et al. (SODA’07, JACM’18) first studied graphic matroid case and obtained a -competitive algorithm. Subsequent works have improved the competitive ratio, most recently to by Soto, Turkieltaub, and Verdugo (SODA’18).
In this paper, we break the -competitive barrier for the problem, obtaining a new algorithm with a competitive ratio of . For the special case of simple graphs (i.e., graphs that do not contain parallel edges) we further improve this to . Intuitively, solving the problem for simple graphs is easier as they do not contain cycles of length two. A natural question that arises is whether we can obtain a ratio arbitrarily close to by assuming the graph has a large enough girth.
We answer this question affirmatively, proving that one can obtain a competitive ratio arbitrarily close to even for constant values of girth, providing further evidence for the strong matroid secretary conjecture. We further show that this bound is tight: for any constant , one cannot obtain a competitive ratio better than even if we assume that the input graph has girth at least . To our knowledge, such a bound was not previously known even for simple graphs.
Keywords and phrases:
online algorithms, graphic matroids, secretary problemCopyright and License:
Danny Mittal, and Jan Olkwoski; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Online algorithmsFunding:
The work is partially supported by DARPA QuICC, ONR MURI 2024 award on Algorithms, Learning, and Game Theory, Army-Research Laboratory (ARL) grant W911NF2410052, NSF AF:Small grants 2218678, 2114269, 2347322, and Royal Society grant IES\R2\222170.Editors:
Anne Benoit, Haim Kaplan, Sebastian Wild, and Grzegorz HermanSeries and Publisher:
Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik
1 Introduction
In the past two decades there has been a renewed interest in online item selection problems where a sequence of items arrive one by one, revealing their weight, and a decision maker needs to irrevocably decide whether or not to accept each item as it arrives. The goal is to maximize the total accepted weight, subject to a feasibility constraint on the chosen items. An algorithm’s performance is typically measured by its competitive ratio, which compares the algorithm’s total weight with the offline optimum – the total weight achievable if all item weights were known in advance. These problems are appealing both from a mathematical perspective, as they are concise models for online decision making, and from an economical perspective, as they have close connection to pricing and auction theory [30, 29, 8, 12].
In the absence of any information about future items, the problem is essentially hopeless as any single item could be significantly heavier than all others, and the decision maker has no way of deciding which it is. As such, most works make distributional assumptions on either the weight of the arriving items, or their arrival order. The former class of problems are generally referred to as prophet inequalities while the latter are known as secretary problems. Numerous works have studied secretary problems for a large class of combinatorial constraints [38, 19, 34, 33, 20, 44, 46, 23, 31] and objective functions [10, 25], and considered close variants of these problems such as the prophet-secretary problem [22].
Perhaps the most important open question in the area of online decision making is the matroid secretary problem posed by the seminal work of Babaioff, Immorlica, Kempe, and Kleinberg (SODA’07,JACM’18) [8, 7]. In the matroid secretary problem, items arrive in a random order, and each item corresponds to an element in a matroid ,where is the set of elements and is the collection of independent sets in matroid . Upon arrival, the weight of each item is revealed, and the decision maker must immediately decide whether to accept or reject it. The goal is to maximize the total weight of accepted items, with the constraint that the selected items form an independent set in the matroid. The matroid secretary conjecture [8, 7] states that there exists a constant-competitive ratio algorithm for this problem, and the strong matroid secretary conjecture (e.g., see [46]) states that there exists an -competitive algorithm. Many works have studied the problem for both general matroids and specific cases.
In this paper, we focus on the specific case of graphic matroids. In this case, the arriving items correspond to the edges of a graph and the goal is to accept a set of edges that do not contain a cycle. Solving problems for graphic matroids is often viewed as a promising first step toward addressing arbitrary matroids, as graphs possess rich combinatorial structures and graphic matroids, along with linear matroids, are among the most intuitive examples of non-trivial matroids. Many counterexamples for candidate matroid secretary algorithms are, in fact, graphic matroids [8, 9]. It is common to illustrate the main ideas behind general algorithms by showing their behavior on this specific case [47]. Recent work has also explored whether techniques for graphic matroids can be extended to general matroids [1].
The seminal paper of Babaioff et al. originally studied the graphic matroid secretary problem, obtaining a -competitive algorithm for the problem. Babaioff et. al. [6] designed a -competitive algorithm. The competitive ratio was later improved to by Korula and Pal [38] and later to by Soto, Turkieltaub, and Verdugo [46]. Whether or not the ratio can be improved has been open at least since 2018.111This paper was previously submitted to STOC’25 on November 4, 2024. Independently of our work, on November 18, 2024, Bérczi et al. [11] posted a preprint on arXiv, obtaining a -competitive algorithm and a -competitive algorithm for general graphs and simple graphs, respectively.
1.1 Our results and techniques
In this paper we obtain an algorithm with competitive ratio for the problem, breaking the -competitive barrier. We further improve this result for the specific case of simple graphs, i.e., graphs that do not have parallel edges. Intuitively, simple graphs represent an easier special case as they don’t have any cycles of length ; since the algorithm is forbidden from accepting edges that form a cycle, the lack of -cycles gives the algorithm more freedom to accept edges. Our main result is the following theorem.
Theorem 1.
There exists a -competitive algorithm for the graphic matroid secretary problem. Furthermore, if the input graph is assumed to be simple, there exists an algorithm with competitive ratio .
The basic approach for this result is to, at each step, compute a set of outgoing edges such that each node has exactly one outgoing edge. More exactly, at each step we compute a maximum spanning forest, then direct the edges in this forest toward an arbitrary root; each node then has a unique outgoing edge. We then argue that if the algorithm only accepts an edge for whose endpoints it has not previously accepted an outgoing edge, then the algorithm’s set of taken edges will always be independent.
Given this, the key aspect of Algorithm 1 that allows it to obtain an improved competitive ratio is a slightly stronger condition used to determine whether an edge is taken. Specifically, while for one endpoint we only demand that we have not taken an outgoing edge, for the other endpoint we demand that we have not even seen an outgoing edge. We can then show an increased probability for the former condition being satisfied for a currently considered edge by using the fact that the latter condition may not be satisfied by a previously seen outgoing edge, causing said edge to not be taken. Algorithm 1 furthermore makes use of random choice in determining which endpoint to apply the stronger condition to, which is crucial for handling the case of duplicate edges. When the input graph is guaranteed to be simple, this random choice is unnecessary – removing this random choice gives our algorithm for simple graphs (see the full version of the paper) which allows us to obtain an even lower competitive ratio.
Motivated by the improvement for simple graphs, we additionally study, for the first time, the landscape of the graphic matroid secretary problem for graphs of high girth, where we recall that the girth of a graph is the length of its shortest cycle. We note that the fact that a graph is simple follows from the assumption that girth is at least . We show that when the graph has large (but constant) girth, one can obtain a competitive ratio arbitrarily close to . Formally, we prove the following theorem.
Theorem 2.
For any graph with girth at least , there exists an -competitive algorithm.
The result builds on yet another property of the combinatorial structure of the set of outgoing edges introduced in the proof of Theorem 1. We first observe that the fact that every vertex has at most one outgoing edge implies that, in a graph induced by the outgoing edges, each edge belongs to at most one cycle. On the other hand, we prove that if Algorithm 1 were to accept outgoing edges without respecting the graphic matroid independence condition, it would yield a higher acceptance probability of for an edge from the maximum independent set. These observations lead to a natural approach: accepting an outgoing edge only with a certain probability such that, for every cycle of length , the probabilities of taking each edge of this cycle are equal. Intuitively, as the length of the shortest cycle increases, this probability tends towards . We refer the reader to the full version of the paper for more details.
The best competitive ratios we attain over the three algorithms we introduce are listed in Table 1 for girths less than .
| Girth () | Competitive Ratio | Algorithm |
|---|---|---|
| 2 | 3.95 | Algorithm 1 |
| 3 | 3.77 | Simple graph algorithm |
| 4 | 3.77 | Simple graph algorithm |
| 5 | 3.76 | High girth algorithm |
| 6 | 3.61 | High girth algorithm |
| 7 | 3.50 | High girth algorithm |
| 8 | 3.42 | High girth algorithm |
| 9 | 3.35 | High girth algorithm |
Perhaps more surprisingly, we show that this is tight: no algorithm can achieve a competitive ratio better than , even for graphs with high girth. To our knowledge, this lower bound was not previously known even for simple graphs, and our techniques may be of independent interest for related online arrival problems.
Theorem 3.
For any , there does not exist an algorithm for the graphic matroid secretary problem on graphs of girth at least that obtains competitive ratio less than .
The two results fully characterize the landscape of the secretary problem in the high-girth setting, essentially showing that the problem becomes as easy as the single secretary problem in the limit. To prove the lower bound in Theorem 3, we first show that weighted single secretary, also known as a cardinal secretary, is hard “on average” in the following sense. We demonstrate the existence of a finite distribution over the instances of this problem such that even if the adversary samples instances, as opposed to choosing them in a worst-case manner, from that distribution, it is still hard for any algorithm to choose the maximum weight element.
We then construct a high girth bipartite graph based on Ramanujan graphs, where vertices of one bipartition have same degree . The hard distribution of instances of weighted single secretary of size can now be sampled independently and embedded on the edges incident to each degree- vertex on one side of the constructed bipartite graph. Given an algorithm that performs well on this graph, we obtain an algorithm performing well on the original distribution of weighted single secretary by simulating the first algorithm and mimicking the choices that it makes on a single degree- vertex.
Our construction of the input graph in addition to high-girth Ramanujan graphs uses the probabilistic method. Our construction of the sets of hard weights is based on an extension of a similar argument from an infinite to a finite version of Ramsey theorem. We employ zero-sum games duality argument to show an existence of the final probabilistic distribution over the instances.
2 Related work
Many other derivations and specific cases of the general matroid secretary problem have been given attention over the years. Hajiaghayi, Kleinberg and Parkes [30] had first introduced the multiple-choice value version of the problem, aka the uniform matroid secretary problem, in which the goal is to maximize the expected sum of the at most selected numbers. Kleinberg [36] later presented a tight -competitive algorithm for the uniform secretary resolving an open problem of [30]. Transversal matroids were first considered in [8] who gave -competitive algorithm, where is the degree of the transversal matroid. This was improved by Dimitrov and Plaxton [19] who showed a ratio of for all transversal matroids. The optimal ratio of follows from the -competitive algorithm for secretarial online weighted bipartite matching problem [35], which generalizes the problem on transversal matroids. For the laminar matroids, a long line of work led to competitive ratio [32, 33, 41], which was improved to in [41], in [46], in [31], and in [11]. The challenging general class of regular matroids was proven to admit -competitive algorithm [20].
Other generalizations of the secretary problem such as the submodular variant have been initially studied by the Bateni, Hajiaghayi, and ZadiMoghaddam [10] and Gupta, Roth, Schoenebeck, and Talwar [28]. The connection between the secretary problem and online auction mechanisms has been explored by Kesselheim et al. [34], who give a -competitive solution to the online bipartite weighted matching problem.
The prophet secretary problem is another well-studied variant of the secretary problem, closely related to prophet inequalities. In the prophet inequality setting, introduced by Krengel and Sucheston [39, 40], we know the distributions of arriving items and aim to maximize the ratio of the expectation of the selected item’s value to the expectation of the sequence maximum, with a tight competitive ratio of . Research connecting prophet inequalities and online auctions, initiated by Hajiaghayi, Kleinberg, and Sandholm [29], led to follow-up studies such as Alaei, Hajiaghayi, and Liaghat’s work [3] on the bipartite matching variant of prophet inequality, also achieving a competitive ratio of [3]. Feldman et al. [24] expanded the problem to combinatorial auctions with multiple buyers, achieving the same bound through a posted pricing scheme, and Kleinberg and Weinberg [37] extended this result to matroids with a -competitive algorithm. A recent paper explores matroid structures that allow breaking the tight competitive ratio of [4]. Contrary to results presented in this paper, they prove that in the general matroid setting, a high girth is not a sufficient condition while considering -fold matroid unions suffices.
The prophet secretary model, introduced by Esfandiari, Hajiaghayi, Liaghat, and Monemizadeh [22], assumes a random arrival order and known item distributions. They designed an algorithm achieving a competitive factor of , which has proven challenging to improve. However, Azar et al. [5] and Correa et al. [16, 17] improved this bound to . For the single-item i.i.d. case, Abolhasani et al. [2] achieved a -competitive ratio, later improved to by Correa et al. [14]. Recently, Peng and Tang [43] achieved a -competitive algorithm for the free order case, however finding the tight competitive bound for the general prophet secretary problem remains open.
Last but not least, extensions beyond matroids for the secretary problem have also been studied. For example, Kleinberg and Weinberg [37] provided an -competitive algorithm for the intersection of matroids, later generalized to polymatroids by Dütting and Kleinberg [21]. Rubinstein [44] and Rubinstein and Singla [45] considered prophet inequalities and secretary problems in arbitrary downward-closed set systems. For such settings, Babaioff et al. [8] proved a lower bound of , and further studies have explored combinatorial optimization applications [18, 26, 27, 42].
3 Preliminaries
Graph Notation
In this paper, we assume all graphs are undirected, weighted, and may contain multiple edges between the same pair of vertices. Specifically, a graph is defined as a triple , where , with , is the set of vertices; , with , is the multiset of edges; and assigns weights to the edges. We assume graphs do not contain loops (i.e., edges connecting a vertex to itself222As explained in the following paragraph, such edges are irrelevant in the context of graphic matroids.). Given any vertex , we denote the degree of by . A graph is called simple if there is at most one edge connecting any pair of vertices. For a graph , we denote as the girth of , representing the length of its shortest cycle. In graphs with multiple edges, a cycle is defined as any multiset of edges , for , such that and . For an integer , let denote the set of all graphs with girth at least . We also denote .
Matroids
A matroid is a combinatorial structure that generalizes independence. It consists of a finite set and a collection of independent subsets of satisfying: (1) the empty set is independent, (2) any subset of an independent set is also independent, and (3) if one independent set is larger than another, an element from the larger set can extend the smaller one while preserving independence. These properties capture the concept of independence, making matroids useful for modeling optimization problems where we seek a maximum-weight or maximum-cardinality independent subset of elements.
A graphic matroid associated with a graph has as its elements the edges in the multiset , and defines independent sets as acyclic subsets of edges (i.e., subgraphs without cycles). The weight of an independent set is the sum of its edge weights.
Problems
Consider a graphic matroid associated with a multigraph . In the online secretary problem on graphic matroids, the elements of are presented to the algorithm in a random order, chosen uniformly from all possible permutations of the multiset . Elements arrive one at a time, effectively creating time steps during the algorithm’s execution. Upon the arrival of an element, the algorithm must decide whether to accept or reject it, with the constraint that an element can only be accepted if it forms an independent set with the already accepted elements. Decisions are irrevocable.
The objective is to design an algorithm that maximizes the expected sum of the weights of the accepted elements, referred to as the algorithm’s gain. For an algorithm , we denote its (random) gain by and its expected gain by .
Let denote an independent set with maximum weight in the matroid . We say an algorithm is -competitive (or has an competitive ratio, for some ) for a family of matroids if for all matroids in that family, where is the weight of .
4 Improved bounds for graphic matroid secretary: proof of Theorem 1
In this section, we prove the following theorem, which contains the result from Theorem 1 for general graphs.
Theorem 4.
There exists a -competitive algorithm for graphic matroid secretary.
To prove the theorem, we present an algorithm that attains a competitive ratio less than for the graphic matroid secretary problem, surpassing a result of Soto, Turkieltaub, and Verdugo [46] attaining a competitive ratio of that previously stood for six years as the best result achieved for graphic matroid secretary; this algorithm is described in Section 4.1.
To prove Theorem 1 for simple graphs, we consider a slight modification of our algorithm. See the full version of the paper for details.
4.1 Improvement for general graphs
The pseudocode of the algorithm is provided in Figure 1. The algorithm consists of two phases. During the first steps (where depends only on ), edges are only observed without being taken. In later steps, let be the presented edge. The algorithm computes a maximum spanning forest of all edges seen so far. We assume the forest is rooted, where the root for each tree is chosen lexicographically for simplicity; how we choose the root does not affect the algorithm as long as it depends only on the set of the edges already seen and not their order. This forest is directed towards the root, so that every edge is directed and each node has at most one outgoing edge. We additionally compute an array of outgoing edges: for each node , if has an outgoing edge in , then that is its outgoing edge; if it does not, then we choose an arbitrary edge not already assigned to be the outgoing edge of another vertex 333Note that if is too small (specifically, if ) then there may not exist sufficiently many edges for this to be possible. However, if this is the case, we can simply mix in “dummy edges” that the algorithm can treat the same as real edges in order to cause to be at least . The details of this mixing in are described in the proof of Theorem 4. and declare that to be the outgoing edge from . Note that said edge does not even have to have as an endpoint. Also note that crucially, the choice of edges declared to be outgoing for the vertices that need it depends on the set of edges observed so far but not their order.
We only consider if it is in . In this case, it points from some to some , and so is the outgoing edge for . In order to take , we randomly order as and impose the following constraints on :
-
No edge has been taken such that was the outgoing edge for when was presented.
-
No edge has appeared such that was the outgoing edge for when was presented.
If satisfies both constraints then it is taken. Otherwise, the algorithm still notes that could have been selected for .
The distinct constraints used for are key – the stronger condition applied to endpoint allows us to lower bound the probability that an edge is blocked from being taken, which can then be used to show an increased probability that the weaker condition for endpoint is satisfied for an edge that we would like to be taken. The randomness in ordering into is also essential. To see why, consider the specific example of an edge with endpoints that is presented at step , and consider some step . Suppose that contains an edge outgoing from to a third node and an edge outgoing from to a fourth node . We would like to argue that in the case that either or is the edge presented at step , there is a possibility that some outgoing edge from or respectively had already been presented prior to step , meaning that or could not have been taken.
This means that, for example, if were the edge presented at step , we would desire that, in the case of edge , , and in the case of edge , (and so ), so that could be blocked by an edge outgoing from simply being presented, while is then not blocked because was not actually taken. This suggests that we could simply always take and , applying the stronger condition to the endpoint which the edge is directed towards.
However, as in general graphs it is possible for multiple edge to have the same endpoints, it is possible that we in fact have , in which case an edge outgoing from would block itself. This is illustrated in the top-left quadrant of Figure 1. Therefore, in order to guarantee an improvement, we crucially allow for the possibility that in the case of edge , , and in the case of edge , – if has the same endpoints as , then cannot as is a spanning tree, and so will necessarily be distinct from , meaning that there is a possibility for to be blocked by an edge outgoing from while still allowing to be taken. This is illustrated in the bottom-left quadrant of Figure 1.
Analysis
We now proceed with a formal analysis. Due to space constraints, parts of the proof are deferred to the full version of the paper. We first show that any set of edges accepted by Algorithm 1 is independent, meaning that the algorithm is a valid graphic matroid secretary algorithm.
Lemma 5.
The set of accepted edges in Algorithm 1 is always an independent set in the graphic matroid.
We now proceed to demonstrate that Algorithm 1 has the desired approximation factor for an appropriate choice of . We first define quantities below that will be crucial for the analysis:
Definition 6.
Define to be the probability that after step , , given that is the set of edges that are presented in steps .
Definition 7.
Define to be the probability that after step , both and , given that is the set of edges that are presented in steps .
Definition 8.
Define to be the probability that after step , if we take to be either or with equal probability, then and , given that is the set of edges that are presented in steps .
The condition used to define is the same condition checked to see whether an edge between and can be taken.
A key tool for our analysis is the following. Note that for any node , is set to when at some step we observe an edge such that is in and is directed from . Importantly, depends only on the set of edges presented up to step and not their order. Therefore, conditioned on the set of edges that appears in steps , the probability that at step we are presented with the outgoing edge from is at most because there is exactly one such edge, and this edge, if it exists, is presented at step with probability .
The above idea is applied in the following lemma:
Lemma 9.
For all vertices , all from to , and all with , .
The next lemma uses the same idea to derive a similar expression for :
Lemma 10.
For all and , and all with , .
We now proceed to lower bound ; we again use the same idea but now additionally take advantage of the stronger condition applied to in the algorithm to derive a bound for superior to the one we derived for by lower bounding the probability that an edge that would have been selected for one of was not actually taken. As the lower bound for is more complicated, we define its lower bound as an additional function .
Definition 11.
Define recursively by and
We parameterize by as will reused later with a different value of .
Lemma 12.
For all vertices , all from to , and all with ,
As mentioned before, the conditions defining are identical to the conditions for taking an edge given that it is in . As any edge in the overall optimum is in , lower bounding the probability of such an edge being taken allows us to lower bound the overall approximation factor. This is expressed in the following lemma.
Lemma 13.
Let be the sum of the weights of edges in , and recall that is the set of edges accepted by Algorithm 1. Then,
It now only remains to give a concrete lower bound for . We proceed to derive such a bound in the following lemma.
Lemma 14.
If we let , then
Setting , we can show that the above lemma implies Theorem 4. We refer to the full version of the paper for the full proof.
5 Impossibility result for high girth graphs: proof of Theorem 3
In this section, we prove a hardness result for high-girth graphs. We begin by showing that the weighted single secretary problem remains hard even when the instance is drawn from a known distribution, using the Finite Ramsey Theorem and zero-sum game duality. We then reduce this to the weighted graphic matroid secretary problem on large-girth graphs via a construction based on Ramanujan graphs. Specifically, by carefully removing edges using the probabilistic method, we construct bipartite graphs with certain properties and embed hard instances of single secretary into them to obtain similarly hard graphic secretary instances. Due to space constraints, parts of the proofs are deferred to the full version of the paper.
We note that it is crucial that the hardness holds even when the distribution is known in advance, unlike deterministic instances that are only hard when the instance is hidden. This allows us to present multiple instances from the distribution without the algorithm gaining any advantage from earlier ones – since it already knows the distribution fully.
5.1 Hard inputs for single secretary
We first prove that no algorithm for the secretary problem can achieve a competitive ratio better than , even if the weights are drawn from a known finite set.
Theorem 15.
For any and for any , there exists an integer and a finite set of numbers over which no (randomized) algorithm for the single secretary problem with items can choose the maximum with probability .
See the full version of the paper for the proof. The result essentially serves as the starting point of our proof as it provides “hard instances” of the secretary problem which we then carefully embed in graphs of large girth. Correa et al. [15, 13] previously proved this theorem for infinite sets; our proof modifies their technique using the finite version of Ramsey’s theorem.
While the generalization to finite sets may seem like a small technical issue, it has important consequences. As we will see, the finite assumption is necessary as it allows us to invoke the Minimax theorem for finite games. This in turn allows us to guarantee that there is a hard distribution over inputs, rather than just a single instance. As we will need to simultaneously embed multiple “independent” hard instances of the single secretary problem to obtain a hard instance of the graphical matroid secretary, this generalization is necessary.
We will now use the Minimax principle and Theorem 15 to prove the following.
Theorem 16.
For any and for any , there exists an integer , a finite set , and a finite distribution over all subsets of size from with the following property. If a random instance of the secretary problem is drawn from , for any algorithm, the probability of choosing the maximum element from the random instance is at most , where the probability is over the randomness of the instance and the algorithm.
5.2 Embedding single secretary in simple graphs
This subsection presents the proof of Theorem 3. We first describe some preliminaries which are used in our analysis.
Preliminaries
It is straightforward to reduce the single secretary problem to the graphic matroid secretary problem when the graph allows for multiple edges. In that case, given the single secretary problem with adversarial weights, we create a multi-graph with just two vertices and and a set of parallel edges between and , with each edge assigned exactly one of these adversarial weights. Note, that this multi-graph has girth . We will need to work harder to reduce the single secretary problem to the graphic matroid problem on simple graphs, where we will even assume that the simple graph has an arbitrarily large girth.
For said reduction, we define below three different measures of performance of a secretarial algorithm. Given an algorithm and an instance of the matroid secretary problem, we abuse the notation from the previous section and denote by the set of elements of the matroid output by on instance . Let also be the optimal solution to the problem on the instance . Given any subset of the matroid’s elements, we denote by the sum of the weights of all elements in .
Let be a matroid secretary problem on a matroid which has elements. Given a finite set of numbers (weights) , let be a probability distribution over the set . We will later on instantiate with the single secretary problem and with the graphic matroid secretary problem.
Let be a (randomized) algorithm for problem . Given an instance of , let be a random variable such that if outputs the optimal solution on instance , that is, when ; and if . Then we have that ; note that the probability is over the internal randomness of algorithm and over the randomness in the arrival order of the matroid elements.
For the convenience of this subsection, it will be useful to define an algorithm as having a performance guarantee of
-
type 1 if .
That is, the algorithm chooses the optimum with probability at least in expectation over instances. -
type 2 if .
That is, the expected ratio of the algorithm’s weight to the optimum’s weight is at least , where the expectation is over instances, algorithm randomness, and element order. -
type 3 if .
That is, the algorithm’s expected weight is at least an fraction of the expected optimum weight. The first expectation includes all randomness; the second expectation is over instances only.
We next reformulate Theorem 16 in terms of the type 1 performance guarantee.
Theorem 17.
For any , , there exists a finite distribution of instances of weighted single secretary such that no algorithm’s type performance guarantee is . For any instance of single secretary in the support of , any two weights in differ by at least a factor of .
We now extend the result of Theorem 17 to the type 2 performance guarantee. This proof will make use of the guarantee depending on provided by Theorem 17 to bound the weight attained by an algorithm when it fails to select the maximum.
Lemma 18.
For any , there exists a finite distribution of instances of weighted single secretary such that no algorithm’s type performance guarantee is .
The following lemma then shows an equivalence in hardness between the type 2 and type 3 performance guarantees. The idea of its proof is to reweight the distribution by making the probability of each instance being chosen inversely proportional to its optimum weight.
Lemma 19.
For any matroid secretary problem , there exists a bijection between finite distributions over instances of such that if , then there exists an algorithm with a type performance guarantee of on iff there exists one with a type performance guarantee of on .
We now move to the portion of the proof that extends the hardness of the single secretary problem to the graph setting. As part of this reduction, we first show the following lemma, demonstrating the existence of bipartite graphs of high girth with the key property that one part is both much larger than the other and has high degree. This construction proceeds by applying the probabilistic method to derive a graph with our desired properties by removing edges from a high-girth Ramanujan graph.
Lemma 20.
For any with , , there exist such that and there exists a graph of girth at least , whose vertices can be partitioned into sets and , such that , , all edges are between and , and each vertex in has degree at least .
We now apply the graph provided by Lemma 20 to extend the hardness of a distribution of instances of the single secretary problem to hardness of matroid secretary on a high-girth graph. The proof, which is quite technical, is provided in the full version of the paper.
Lemma 21.
If there exists a finite distribution of instances of weighted single secretary such that no algorithm has a type performance guarantee on , then for any there exists a graph with girth and a finite distribution of instances of weighted graph secretary on such that no algorithm has a type performance guarantee on .
Combining the above results, we obtain Theorem 3; see the full version of the paper for more details.
References
- [1] Dorna Abdolazimi, Anna R. Karlin, Nathan Klein, and Shayan Oveis Gharan. Matroid partition property and the secretary problem. In Yael Tauman Kalai, editor, 14th Innovations in Theoretical Computer Science Conference, ITCS 2023, January 10-13, 2023, MIT, Cambridge, Massachusetts, USA, volume 251 of LIPIcs, pages 2:1–2:9. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2023. doi:10.4230/LIPICS.ITCS.2023.2.
- [2] Melika Abolhassani, Soheil Ehsani, Hossein Esfandiari, MohammadTaghi HajiAghayi, Robert Kleinberg, and Brendan Lucier. Beating 1-1/e for ordered prophets. In Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing, pages 61–71. ACM, 2017. doi:10.1145/3055399.3055479.
- [3] Saeed Alaei, MohammadTaghi Hajiaghayi, and Vahid Liaghat. The online stochastic generalized assignment problem. In Proceedings of the 16th International Workshop on Approximation Algorithms for Combinatorial Optimization Problems (APPROX), pages 11–25, 2013. doi:10.1007/978-3-642-40328-6_2.
- [4] Noga Alon, Nick Gravin, Tristan Pollner, Aviad Rubinstein, Hongao Wang, S Matthew Weinberg, and Qianfan Zhang. A bicriterion concentration inequality and prophet inequalities for -fold matroid unions. arXiv preprint arXiv:2411.11741, 2024. doi:10.48550/arXiv.2411.11741.
- [5] Yossi Azar, Ashish Chiplunkar, and Haim Kaplan. Prophet secretary: Surpassing the 1-1/e barrier. In Proceedings of the 2018 ACM Conference on Economics and Computation, Ithaca, NY, USA, June 18-22, 2018, pages 303–318, 2018. doi:10.1145/3219166.3219182.
- [6] Moshe Babaioff, Michael Dinitz, Anupam Gupta, Nicole Immorlica, and Kunal Talwar. Secretary problems: weights and discounts. In Proceedings of the twentieth annual ACM-SIAM Symposium on Discrete Algorithms, pages 1245–1254. SIAM, 2009. doi:10.1137/1.9781611973068.135.
- [7] Moshe Babaioff, Nicole Immorlica, David Kempe, and Robert Kleinberg. Matroid secretary problems. J. ACM, 65(6):35:1–35:26, 2018. doi:10.1145/3212512.
- [8] Moshe Babaioff, Nicole Immorlica, and Robert Kleinberg. Matroids, secretary problems, and online mechanisms. In Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms, pages 434–443. Society for Industrial and Applied Mathematics, 2007. URL: http://dl.acm.org/citation.cfm?id=1283383.1283429.
- [9] Maryam Bahrani, Hedyeh Beyhaghi, Sahil Singla, and S. Matthew Weinberg. Formal barriers to simple algorithms for the matroid secretary problem. In Michal Feldman, Hu Fu, and Inbal Talgam-Cohen, editors, Web and Internet Economics - 17th International Conference, WINE 2021, Potsdam, Germany, December 14-17, 2021, Proceedings, volume 13112 of Lecture Notes in Computer Science, pages 280–298. Springer, 2021. doi:10.1007/978-3-030-94676-0_16.
- [10] Mohammadhossein Bateni, Mohammadtaghi Hajiaghayi, and Morteza Zadimoghaddam. Submodular secretary problem and extensions. ACM Trans. Algorithms, 9(4):Art. 32, 23, 2013.
- [11] Kristóf Bérczi, Vasilis Livanos, José Soto, and Victor Verdugo. Matroid secretary via labeling schemes. arXiv preprint arXiv:2411.12069, 2024. doi:10.48550/arXiv.2411.12069.
- [12] Shuchi Chawla, Jason D. Hartline, David L. Malec, and Balasubramanian Sivan. Multi-parameter mechanism design and sequential posted pricing. In Proceedings of the 42nd ACM Symposium on Theory of Computing, STOC 2010, Cambridge, Massachusetts, USA, 5-8 June 2010, pages 311–320, 2010. doi:10.1145/1806689.1806733.
- [13] José Correa, Paul Dütting, Felix A. Fischer, and Kevin Schewior. Prophet inequalities for I.I.D. random variables from an unknown distribution. In Anna R. Karlin, Nicole Immorlica, and Ramesh Johari, editors, Proceedings of the 2019 ACM Conference on Economics and Computation, EC 2019, Phoenix, AZ, USA, June 24-28, 2019, pages 3–17. ACM, 2019. doi:10.1145/3328526.3329627.
- [14] José Correa, Patricio Foncea, Ruben Hoeksma, Tim Oosterwijk, and Tjark Vredeveld. Posted price mechanisms for a random stream of customers. In Proceedings of the 2017 ACM Conference on Economics and Computation, pages 169–186. ACM, 2017. doi:10.1145/3033274.3085137.
- [15] José R. Correa, Paul Dütting, Felix A. Fischer, and Kevin Schewior. Prophet inequalities for independent random variables from an unknown distribution. CoRR, abs/1811.06114v2, 2021. URL: http://arxiv.org/abs/1811.06114v2.
- [16] José R. Correa, Raimundo Saona, and Bruno Ziliotto. Prophet secretary through blind strategies. In Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2019, San Diego, California, USA, January 6-9, 2019, pages 1946–1961. SIAM, 2019. doi:10.1137/1.9781611975482.118.
- [17] José R. Correa, Raimundo Saona, and Bruno Ziliotto. Prophet secretary through blind strategies. Math. Program., 190(1):483–521, 2021. doi:10.1007/S10107-020-01544-8.
- [18] Sina Dehghani, Soheil Ehsani, MohammadTaghi Hajiaghayi, Vahid Liaghat, and Saeed Seddighin. Stochastic k-server: How should uber work? In 44th International Colloquium on Automata, Languages, and Programming, ICALP 2017, July 10-14, 2017, Warsaw, Poland, pages 126:1–126:14, 2017. doi:10.4230/LIPICS.ICALP.2017.126.
- [19] Nedialko B Dimitrov and C Greg Plaxton. Competitive weighted matching in transversal matroids. In Automata, Languages and Programming: 35th International Colloquium, ICALP 2008, Reykjavik, Iceland, July 7-11, 2008, Proceedings, Part I 35, pages 397–408. Springer, 2008. doi:10.1007/978-3-540-70575-8_33.
- [20] Michael Dinitz and Guy Kortsarz. Matroid secretary for regular and decomposable matroids. SIAM Journal on Computing, 43(5):1807–1830, 2014. doi:10.1137/13094030X.
- [21] Paul Dütting and Robert Kleinberg. Polymatroid prophet inequalities. In Algorithms-ESA 2015, pages 437–449. Springer, 2015. doi:10.1007/978-3-662-48350-3_37.
- [22] Hossein Esfandiari, MohammadTaghi Hajiaghayi, Vahid Liaghat, and Morteza Monemizadeh. Prophet secretary. SIAM J. Discret. Math., 31(3):1685–1701, 2017. doi:10.1137/15M1029394.
- [23] Tomer Ezra, Michal Feldman, Nick Gravin, and Zhihao Gavin Tang. General graphs are easier than bipartite graphs: Tight bounds for secretary matching. In David M. Pennock, Ilya Segal, and Sven Seuken, editors, EC ’22: The 23rd ACM Conference on Economics and Computation, Boulder, CO, USA, July 11 - 15, 2022, pages 1148–1177. ACM, 2022. doi:10.1145/3490486.3538290.
- [24] Michal Feldman, Nick Gravin, and Brendan Lucier. Combinatorial auctions via posted prices. In Proceedings of the Twenty-Sixth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 123–135. SIAM, 2015. doi:10.1137/1.9781611973730.10.
- [25] Moran Feldman and Rico Zenklusen. The submodular secretary problem goes linear. SIAM J. Comput., 47(2):330–366, 2018. doi:10.1137/16M1105220.
- [26] Naveen Garg, Anupam Gupta, Stefano Leonardi, and Piotr Sankowski. Stochastic analyses for online combinatorial optimization problems. In SODA, pages 942–951. Society for Industrial and Applied Mathematics, 2008. URL: http://dl.acm.org/citation.cfm?id=1347082.1347185.
- [27] Oliver Göbel, Martin Hoefer, Thomas Kesselheim, Thomas Schleiden, and Berthold Vöcking. Online independent set beyond the worst-case: Secretaries, prophets, and periods. In International Colloquium on Automata, Languages, and Programming, pages 508–519. Springer, 2014. doi:10.1007/978-3-662-43951-7_43.
- [28] Anupam Gupta, Aaron Roth, Grant Schoenebeck, and Kunal Talwar. Constrained non-monotone submodular maximization: Offline and secretary algorithms. In Proceedings of the 6th International Workshop on Internet and Network Economics (WINE’10), 2010.
- [29] Mohammad Taghi Hajiaghayi, Robert Kleinberg, and Tuomas Sandholm. Automated online mechanism design and prophet inequalities. In AAAI, volume 7, pages 58–65, 2007. URL: http://www.aaai.org/Library/AAAI/2007/aaai07-009.php.
- [30] Mohammad Taghi Hajiaghayi, Robert D. Kleinberg, and David C. Parkes. Adaptive limited-supply online auctions. In Proceedings 5th ACM Conference on Electronic Commerce (EC-2004), New York, NY, USA, May 17-20, 2004, pages 71–80. ACM, 2004. doi:10.1145/988772.988784.
- [31] Zhiyi Huang, Zahra Parsaeian, and Zixuan Zhu. Laminar matroid secretary: Greedy strikes back. In Timothy M. Chan, Johannes Fischer, John Iacono, and Grzegorz Herman, editors, 32nd Annual European Symposium on Algorithms, ESA 2024, September 2-4, 2024, Royal Holloway, London, United Kingdom, volume 308 of LIPIcs, pages 73:1–73:8. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2024. doi:10.4230/LIPICS.ESA.2024.73.
- [32] Sungjin Im and Yajun Wang. Secretary problems: Laminar matroid and interval scheduling. In Proceedings of the twenty-second annual ACM-SIAM symposium on Discrete Algorithms, pages 1265–1274. SIAM, 2011. doi:10.1137/1.9781611973082.96.
- [33] Patrick Jaillet, José A Soto, and Rico Zenklusen. Advances on matroid secretary problems: Free order model and laminar case. In Integer Programming and Combinatorial Optimization: 16th International Conference, IPCO 2013, Valparaíso, Chile, March 18-20, 2013. Proceedings 16, pages 254–265. Springer, 2013. doi:10.1007/978-3-642-36694-9_22.
- [34] Thomas Kesselheim, Klaus Radke, Andreas Tönnis, and Berthold Vöcking. An optimal online algorithm for weighted bipartite matching and extensions to combinatorial auctions. In Hans L. Bodlaender and Giuseppe F. Italiano, editors, Algorithms - ESA 2013 - 21st Annual European Symposium, Sophia Antipolis, France, September 2-4, 2013. Proceedings, volume 8125 of Lecture Notes in Computer Science, pages 589–600. Springer, 2013. doi:10.1007/978-3-642-40450-4_50.
- [35] Thomas Kesselheim, Klaus Radke, Andreas Tönnis, and Berthold Vöcking. An optimal online algorithm for weighted bipartite matching and extensions to combinatorial auctions. In Hans L. Bodlaender and Giuseppe F. Italiano, editors, Algorithms - ESA 2013 - 21st Annual European Symposium, Sophia Antipolis, France, September 2-4, 2013. Proceedings, volume 8125 of Lecture Notes in Computer Science, pages 589–600. Springer, 2013. doi:10.1007/978-3-642-40450-4_50.
- [36] Robert Kleinberg. A multiple-choice secretary algorithm with applications to online auctions. In Proceedings of the sixteenth annual ACM-SIAM symposium on Discrete algorithms, pages 630–631. Society for Industrial and Applied Mathematics, 2005. URL: http://dl.acm.org/citation.cfm?id=1070432.1070519.
- [37] Robert Kleinberg and S. Matthew Weinberg. Matroid prophet inequalities. In Proceedings of the 44th Symposium on Theory of Computing Conference, STOC 2012, New York, NY, USA, May 19 - 22, 2012, pages 123–136, 2012. doi:10.1145/2213977.2213991.
- [38] Nitish Korula and Martin Pál. Algorithms for secretary problems on graphs and hypergraphs. In Susanne Albers, Alberto Marchetti-Spaccamela, Yossi Matias, Sotiris E. Nikoletseas, and Wolfgang Thomas, editors, Automata, Languages and Programming, 36th Internatilonal Colloquium, ICALP 2009, Rhodes, Greece, July 5-12, 2009, Proceedings, Part II, volume 5556 of Lecture Notes in Computer Science, pages 508–520. Springer, 2009. doi:10.1007/978-3-642-02930-1_42.
- [39] Ulrich Krengel and Louis Sucheston. Semiamarts and finite values. Bull. Am. Math. Soc, 1977.
- [40] Ulrich Krengel and Louis Sucheston. On semiamarts, amarts, and processes with finite value. Advances in Prob, 4:197–266, 1978.
- [41] Tengyu Ma, Bo Tang, and Yajun Wang. The simulated greedy algorithm for several submodular matroid secretary problems. Theory of Computing Systems, 58:681–706, 2016. doi:10.1007/S00224-015-9642-4.
- [42] Adam Meyerson. Online facility location. In Foundations of Computer Science, 2001. Proceedings. 42nd IEEE Symposium on, pages 426–431. IEEE, 2001. doi:10.1109/SFCS.2001.959917.
- [43] Bo Peng and Zhihao Gavin Tang. Order selection prophet inequality: From threshold optimization to arrival time design. In Proceedings of the 63rd Annual IEEE Symposium on Foundations of Computer Science (FOCS), 2022.
- [44] Aviad Rubinstein. Beyond matroids: Secretary problem and prophet inequality with general constraints. arXiv preprint arXiv:1604.00357, 2016. arXiv:1604.00357.
- [45] Aviad Rubinstein and Sahil Singla. Combinatorial prophet inequalities. In Proceedings of the Twenty-Eighth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 1671–1687, 2017. doi:10.1137/1.9781611974782.110.
- [46] José A. Soto, Abner Turkieltaub, and Victor Verdugo. Strong algorithms for the ordinal matroid secretary problem. In Artur Czumaj, editor, Proceedings of the Twenty-Ninth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2018, New Orleans, LA, USA, January 7-10, 2018, pages 715–734. SIAM, 2018. doi:10.1137/1.9781611975031.47.
- [47] Ola Svensson. A simple o(loglog(rank))-competitive algorithm for the matroid secretary problem, 2016. Presentation at Microsoft Research available on Youtube; timestamp 35:42. URL: https://www.youtube.com/watch?v=hHBGKbq79yk&t=1776s.