Abstract 1 Introduction 2 Matroids, Morphisms, and 𝑲-representations 3 Online Matroid Embeddings 4 OMEs for Binary Matroids 5 OMEs and the Matroid Secretary Problem 6 Additional Results References

Online Matroid Embeddings

Andrés Cristi ORCID EPFL, Lausanne, Switzerland    Paul Dütting ORCID Google Research, Zürich, Switzerland    Robert Kleinberg ORCID Cornell University, Ithaca, NY, USA
Google Research, New York, NY, USA
   Renato Paes Leme ORCID Google Research, New York, NY, USA    Neel Patel ORCID Google Research, Zürich, Switzerland
Abstract

We introduce the notion of an online matroid embedding, which is an algorithm for mapping an unknown matroid that is revealed in an online fashion to a larger-but-known matroid. The existence of such embedding enables a reduction from the version of the matroid secretary problem where the matroid is unknown to the version where the matroid is known in advance. We establish the existence of such an embedding for binary matroids, and use it to relate variants of the binary matroid secretary problem to each other, showing that seemingly simpler problems are in fact equivalent to seemingly harder ones (up to constant-factors). Specifically, we show this to be the case for the version of the matroid secretary problem in which the binary matroid is not known in advance, and where it is known in advance. We also show that the version with known matroid structure is equivalent to the problem where weights are not fully adversarial but drawn from a known pairwise-independent distribution.

Keywords and phrases:
Matroids, Secretary Problem, Online Algorithm
Category:
Track A: Algorithms, Complexity and Games
Funding:
Andrés Cristi: Partially funded by the Center for Mathematical Modeling (CMM), FB210005, BASAL funds for centers of excellence (ANID-Chile).
Copyright and License:
[Uncaptioned image] © Andrés Cristi, Paul Dütting, Robert Kleinberg, Renato Paes Leme, and Neel Patel; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Online algorithms
; Theory of computation Random projections and metric embeddings
Related Version:
Extended Version: https://arxiv.org/abs/2407.10316
Editors:
Sayan Bhattacharya, Danupon Nanongkai, Michael Benedikt, and Gabriele Puppis

1 Introduction

A common setup in online algorithms is to have a matroid whose structure is revealed to the algorithm one element at a time. The algorithm processes the elements of the ground set in sequence, and at each point in time, it has access to the dependencies between the elements that have already arrived. Typical examples include the famous matroid secretary problem (MSP) [9, 7, 33, 22] and matroid prophet inequalities [15, 31].

In such problems, is there any advantage in knowing the matroid structure in advance? Imagine the following situation: we are processing an unknown matroid M; however, we know a fixed (potentially very large) matroid BigM that has an isomorphic copy of every possible matroid M, and we can construct this embedding online. We will show that if such an object exists, then we can reduce the version of the problem where the matroid is revealed online to the version of the problem where the matroid structure is known, by assuming our matroid is BigM. Moreover, if the on-the-fly embedding maintains uniform random order, then the existence of such an online embedding implies that in that class, the matroid secretary problem with unknown structure is no harder than the matroid secretary problem with known structure.

Important recent progress on the MSP has established that it is equivalent to the matroid prophet secretary problem with correlated distributions [18, 17]. Though seemingly unrelated, another consequence of the existence of such online embeddings will be that – for certain matroids – this equivalence holds even if we impose pairwise independence.

1.1 Our Contribution

Online Matroid Embedding.

Our main conceptual contribution is to define the notion of an online matroid embedding (OME) in Section 3. For a given class of matroids 𝒞 and a host matroid BigM, we define an OME as a set of matroid monomorphisms, i.e., mappings that preserve the matroid structure, from any matroid in the class 𝒞 into BigM that can be constructed sequentially, only using calls to an independence oracle over the set of elements observed so far.

The use of embeddings in algorithm design is an idea that has been successfully explored in other contexts, most notably, metric embeddings both in classic settings [12, 35, 10] as well as more recently in online settings [28, 11, 38]. While our motivation and main application is the matroid secretary problem, we believe that understanding maps between matroids preserving structure is an important mathematical question in its own right that can enable other algorithmic applications beyond the matroid secretary problem.

Consequences for the MSP.

We use the concept of online matroid embeddings to gain insights into the complexity of the matroid secretary problem (MSP) on binary matroids (see Section 2). Specifically, we relate different variants of the problem to each other and show that seemingly simpler ones are actually equivalent to harder ones (up to constant factors). See Figure 1 for an overview of the reductions that we establish in this paper.

The three variants we are interested in are: (1) the online-revealed-matroid MSP, where the matroid is a priori unknown to the online algorithm and the algorithm has access to an independence oracle on the already arrived elements, (2) the known-matroid MSP, where the structure of the matroid is known to the algorithm in advance, and (3) the prophet MSP, where the matroid structure is known in advance and additionally the weights of the elements are drawn from a known, but possibly correlated distribution.

Figure 1: Reductions for binary matroids. We use PQ to indicate that P is harder than Q, and we use ϵ and C to designate an additive ε or multiplicative factor C loss in approximation.

Clearly, the online-revealed-matroid MSP is harder than the known-matroid MSP and the known-matroid MSP is harder than the prophet MSP, in the sense that if we have an α-approximation for one problem, then we also have an α-approximation for the other. Two main implications of our work are “inverses” of these statements for binary matroids, that hold up to a constant-factor loss, and apply even if we impose pairwise-independence in the prophet MSP. Such reductions between different average-case problems are notoriously difficult to achieve, as they need to ensure or maintain rather stringent assumptions on the input distribution that are essential for the target algorithm to be applicable in a meaningful way, and the required properties are easily disrupted.

Step 1: A Reduction From Online-Revealed Matroid MSP to Known-Matroid MSP. In Theorem 9 we show that the existence of an OME for a class of matroids enables a reduction from the online-revealed-matroid MSP to the known-matroid MSP. The challenge in proving this is to show that the online embedding can be used in a way that (almost) maintains uniform random arrival order. More precisely, let M be the unknown matroid that is revealed to the algorithm in an online fashion and let f be an OME into BigM. Now consider the reduction: upon arrival of an element-weight pair (e,we) in matroid M at iteration t, we construct the corresponding element-weight pair (f(e),we) as an input to MSP on BigM at iteration t. However, this is not a valid input to known-matroid MSP on BigM as it does not construct a random arrival order over the elements that are not in the image of M.

To overcome the shortcoming of the above simple reduction, we interleave the elements in BigM that are in the image of M with the remaining elements in BigM. In the proof of Theorem 9, our main technical argument shows that, while this interleaving does not ensure uniformity of the arrival order of the elements in BigM, it leads to an arrival order over elements in BigM that is close to uniformly random arrival order in total variation distance (Section 5.1). We then complete the reduction with a coupling argument that shows that the existence of an α-competitive algorithm for the known-matroid MSP implies the existence of an (αϵ)-competitive algorithm for the online-revealed-matroid MSP.

Together with the existence of an OME that maps binary matroids into the complete binary matroid (see Section 4 and discussion below), our reduction implies that an algorithm for the MSP over binary matroids cannot meaningfully use any advance information about the matroid (Corollary 10). This is in contrast to all known O(1)-competitive algorithms for special cases of binary matroids [32, 16].

Step 2: A Reduction from Prophet MSP w/ Pairwise Independence to Known-Matroid MSP. In Theorem 11, we show that the existence of an OME from a class of matroids 𝒞 to BigM satisfying a 2-transitivity property (that is satisfied by complete binary matroids, see definition in Section 2), allows to translate an α-competitive algorithm for prophet MSP with pairwise-independent weight distribution on BigM into a C(αo(1))-competitive algorithm for known-matroid MSP on matroid M𝒞, for some constant C>0.

To establish Theorem 11, we build on [18, 17] and show how to reduce prophet MSP with arbitrary correlation on M𝒞 to prophet MSP with pairwise-independent weight distribution on BigM.111A technical detail that we are ignoring here is that our reduction is from a restricted version of the prophet MSP with arbitrary correlation, which results in an additional constant-factor loss. To prove this, we first show that any uniformly random automorphism f:BigMBigM satisfies the following property: for any pair of elements e,e, Pr[f(e)=e]=1n and for any two pairs of independent elements e1,e2 and e1,e2, Pr[f(e1)=e1f(e2)=e2]=1n(n1), where n=|BigM| (Lemma 2).

This property allows us to construct an “almost pairwise independent” randomized OME f:MBigM by simply composing the given OME with a uniformly random automorphism on BigM. The resulting weight distribution is approximately pairwise independent in the sense that for any pair of elements e,eBigM and weights w,w it holds that |Pr[w(e)=w]Pr[w(e)=w]Pr[w(e)=ww(e)=w]|=O(1n2).

To conclude the proof, we show that there exists a pairwise-independent distribution that is close to the induced weight distribution over BigM (Theorem 18). This is one of the most technical results of the paper (see discussion below). Combining Theorem 18 with a coupling argument similar to the one in our other reduction completes the proof.

We note that constructing an exactly k-wise independent distribution from an approximately k-wise independent distribution has been studied in previous work [4, 5, 3]. However, their techniques focus on a set of Bernoulli random variables with identical marginals [4, 3] or “uniformity” of the underlying random variables [5] – both conditions do not hold in our setting as the weight distribution in the prophet MSP instance can be arbitrarily correlated. In fact, in both works [4, 5], they show that if the random variables X1,,Xn satisfy “uniformity” and |𝔼[XiXj]𝔼[Xi]𝔼[Xj]|ε then there exists pairwise independent random variables X~1,,X~n within a distance of O(n2ε) – which is not enough for our purpose as ε=Θ(1/n2) in our case. In the following, we explain why simple approaches would tend to fail.

Technical Challenges for Step 2. One natural and simple approach could be to apply small weight perturbations to the input distribution to make |Pr[w(e)=w]Pr[w(e)=w]Pr[w(e)=ww(e)=w]|=o(1n2) and then apply results from [4, 5].

To demonstrate the technical difficulties, suppose we are given a weight distribution D over a set of elements of M supported over {w1,,wk} such that for any i[k], at most one element can take the weight wi (This assumption can be made due to Lemma 16). However, we cannot ensure that each weight is definitely assigned to one of the elements of M. Since D can be arbitrarily correlated, we can have i,j[m], pi=PrwD[eM:w(e)=wi] pij=PrwD[eM:w(e)=wieM:w(e)=wj] with |pijpipj|=Ω(pi). Suppose, for any vBigM and j[k], we let random variables Xjv=1 iff w(v)=wj. Now, via simple probability calculations we have

|𝔼[XjvXjv]𝔼[Xjv]𝔼[Xjv]|O(|pijpipj|/n2).

This implies that Xjv:vBigM,j[k] are almost pairwise independent. However, directly applying the results from [4, 5] only yields the existence of an exact pairwise independent distribution within distance O(k2min{pi,pj}) from the original distribution. This is insufficient when pi,pjC/k2. To fix this, one could simply make k large by introducing new weights via small perturbations to the weight distribution. However, as such a procedure increases k, the corresponding pi decreases, and on average, it shrinks by a factor of 1/k. Therefore, naive approaches which apply small weight perturbations to the input distribution to increase the number of weights fail. Therefore, we have to introduce new and arguably technically involved ideas to carry out the result.

To obtain Theorem 18, we construct an explicit pairwise-independent weight distribution over BigM by a sequence of “small” perturbations to a naturally induced “almost” pairwise-independent distribution. At each step, we perturb the original distribution such that ω(1) many pairs of random variables end up being independent while always decreasing the pairwise correlation of the rest of the pairs. Then the main technical work is devoted to showing that the total deviation from our procedures is of the order of εo(n2), which, combined with the fact that ε=O(1/n2) leads to the desired result. Since this construction and proof is rather technical, we defer it to the full version of the paper. We believe that our idea of sequentially constructing small perturbations would find further applications to obtain exact pairwise (or k-wise) independent distributions from their approximate counterparts in other settings.

Constructing OMEs.

In Section 4 (Theorem 4 and Theorem 6), we provide a complete analysis for binary matroids. Namely, for the class of binary matroids M with n elements, there is an online matroid embedding into BigM the complete binary matroid 𝔽2n. We also develop a technique for making the OME order-independent: we use properties of the automorphism group of 𝔽2n together with randomization to ensure that the images of the elements in M are not correlated with the arrival order. This technique is in fact more general (Theorem 8) and can be applied whenever the group of automorphisms of the host matroid is “sufficiently rich” in a sense that the theorem statement makes precise.

The key property of binary matroids that we exploit to establish these results is that in 𝔽2n, there is a unique element that completes a circuit, in the sense that there cannot be two circuits of the same size that intersect in all but one element of each.

In the full version of the paper, we explore to which extent similar results can be obtained for other classes of matroids. We show that there cannot be an online matroid embedding that embeds graphic matroids into graphic matroids or, more generally, regular matroids. We also give an online matroid embedding that embeds laminar matroids into linear matroids, and show that it is impossible to embed laminar matroids into laminar matroids. Finally, we show that there is no universal host matroid that allows embedding of all matroids on n elements of a given rank. See Section 6 for an extended discussion of these results.

We believe that the lack of online matroid embeddings for graphic matroids/regular matroids that “don’t leave the class” may shed light on why progress on the known-matroid MSP for graphic and regular matroids has not extended to the online-revealed version of these problems, and more generally the MSP for general binary matroids.

Approximate OMEs.

In the full version of the paper, we extend the notion of an OME to allow distortion, i.e., the map approximately preserves the rank. We observe that the α-partition property in [6] and [19] can be viewed as an approximate matroid embedding into the free matroid. We thus inherit the lower bound of Ω(n/logn) lower bound in [19] of the distortion of embedding the complete binary matroid into the free matroid.

We show tightness of this bound by constructing an online embedding which achieves a distortion of O(n/logn). We also show that there is no constant approximate online embedding of the class of graphic matroids into a free matroid when the underlying matroid is not known upfront. Therefore, any constant competitive algorithm for unknown graphic matroid secretary that relies on constructing an online embedding of the graph into a free-matroid has to exploit the random arrival order of the underlying elements or develop new techniques that do not rely on online embedding into a free matroid. A more detailed discussion appears in Section 6.

1.2 Discussion and Significance of Results

We believe that the existence or non-existence of (approximate) online matroid embeddings can shed new light on different classes of matroids and how they relate to each other. In this work, we demonstrate two implications for the matroid secretary problem.

  • Our first implication (Theorem 9) offers the first formalization of the intuition that, in general, advance knowledge of the matroid structure should not help in the design of a constant-competitive algorithm for the matroid secretary problem. In light of this, it would be interesting to develop algorithms for classes of matroids for which constant-competitive algorithms exist when the algorithm has advance knowledge of the matroid structure, such as graphic matroids [32] and regular matroids [16].

  • Our second implication (Theorem 11), in turn, presents a novel “line of attack” for obtaining such an algorithm for the class of binary matroids (for which no constant-competitive algorithm is known). While it was already known that it suffices to find such an algorithm for the secretary prophet version with correlated weights [18, 17], general correlated weight distributions offer little additional structure. Our result shifts the challenge away from intractable arbitrary correlations, towards the better-understood realm of pairwise independent distributions. Pairwise independent distributions admit powerful tools like concentration inequalities and have found application in areas such as hashing and constructions of pseudo-random generators (for more details, see surveys [36, 43]), and prophet inequalities [13].

1.3 Related Work

Matroid Secretary Problem.

The matroid secretary problem was first studied in [9, 7, 8], who gave a O(log(rank))-competitive algorithm for general matroids. This bound was improved to O(log(rank)) in [14], and the state-of-the-art is a O(loglog(rank))-competitive algorithm [33, 22]. The algorithms of [33, 22] only uses independence oracle calls on subsets of the elements revealed so far.

For graphic matroids there is a O(1)-competitive algorithm, provided that the graphic matroid is known in advance [32]. The same is true for the more general class of regular matroids [16]. Laminar matroids also admit an O(1)-competitive algorithm [26, 29, 25]. Some evidence for the difficulty of the matroid secretary problem for general binary matroids can be found in [34] and [1], showing that binary matroids are not (b,c)-decomposable, ruling out a promising approach to obtaining an O(1)-competitive algorithm for this class.

Oveis Gharan and Vondrák [39] systematized the study of matroid secretary problem variants, establishing a notation for classifying problem variants according to whether the elements arrive in adversarial or random order, whether the assignment of weights to elements is adversarial or random, and whether or not the matroid structure is known in advance. In their nomenclature, the main question addressed in our work is whether the RO-AA-MK variant is equivalent to the RO-AA-MN variant for matroids in general, or for specific classes of matroids. Interestingly, for variants with adversarial arrival order but random weight assignment, [39] demonstrates a stark qualitative difference in approximability: the AO-RA-MK model (when the matroid structure is known in advance) admits a 64-competitive algorithm for all matroids, whereas the AO-RA-MN model (when the number of elements is known in advance but the matroid structure is revealed online) has no constant-competitive algorithm even for the class of rank one matroids!

Very recently, [41] gave a O(1)-competitive algorithm for the matroid secretary problem in the random assignment model when the matroid structure is not known in advance, and instead is only revealed over time. In a similar spirit, [40] presents an online contention resolution scheme for graphic matroids, that uses almost no advance information about the graph. However, they assume that the endpoints of the edges are revealed upon their arrival, which leads to an obvious OME into a graphic matroid.

Matroid Prophet Inequalities.

The matroid prophet inequality problem was first studied in [24]. An asymptotically optimal (1o(1))-competitive algorithm for k-uniform matroids was given in [2]. A tight O(1)-competitive algorithm for the matroid prophet inequality problem was given in [31], also see [20] for the problem of maximizing submodular functions subject to matroid constraints. Constant-factor competitive algorithms can also be obtained via online contention resolution schemes (OCRS) [23]. Random-order versions of the matroid prophet inequality problem are studied in [21].

To the best of our knowledge, all these algorithms exploit that the matroid structure is known in advance. An additional difficulty for reductions of the type we present in this paper, is that typically these algorithms need to know the identity of the distribution that a certain element’s weight is drawn from. For the i.i.d. case this is obviously not an obstacle, and so our reductions apply. We believe that extensions of our techniques might shed further light on the variant of the matroid prophet inequality problem, in which the matroid is revealed online.

Metric Embeddings and Distortion.

An important inspiration for this work comes from the literature on metric embeddings. A classic result in this context is Bourgain’s theorem [12]. The algorithmic importance of such embeddings, and Bourgain’s theorem in particular, was first highlighted in the seminal papers of [35, 10].

Since then metric embeddings have found applications in a host of algorithmic problems, see, e.g., the survey of [27] and Chapter 15 of [37]. Closer to our notion of online matroid embeddings is a recent line of work on online metric embeddings [28, 11, 38] in which points of a metric space are presented one at a time to an algorithm who must then decide on a mapping to the host metric space. The main difference is that instead of preserving a matroid structure, those papers try to minimize metric distortion.

2 Matroids, Morphisms, and 𝑲-representations

Throughout the paper, we will use [n] to denote the set of integers {1,2,,n}.

Matroid Definition.

A matroid M is composed of a ground set M and a rank function rankM:2M+ satisfying the following properties:

  • rankM()=0;

  • rankM(S{i})rankM(S){0,1},S,{i}M

  • rankM(ST)+rankM(ST)rankM(S)+rankM(T),S,TM (submodularity)

It follows from the second condition that rankM(S)|S|. Whenever |S|=rankM(S) we say that S is an independent set of the matroid. Otherwise, we say that S is dependent. A minimal dependent set is called a circuit, i.e., CM is a circuit if C is dependent but every strict subset SC is independent. We say that a matroid has rank r if r=maxSrankM(S).

We say that an element xM is a loop if rankM({x})=0. We say that a matroid is loop-free if every set of one element is independent. Given a set SM we define the span as spanM(S)={xM;rankM(S{x})=rankM(S)}.

Matroid Morphisms.

We will use the same notation to refer to a matroid and its ground set. Given two matroids M and N we will define a morphism f:MN to be a map between their ground sets that preserves rank, i.e.:

rankN(f(S))=rankM(S),SM.

Whenever the matroid morphism is an injective map, we will say it is a matroid monomorphism or a matroid embedding. Whenever it is bijective, we will say it is a matroid isomorphism. An isomorphism from a matroid to itself is called an automorphism. (Aside: this paragraph defines the category of matroids in the sense of category theory. However, we won’t use any other fact from category theory other than borrowing its very convenient language.)

We refer to the set of automorphisms MM as Aut(M), which forms a group under composition, i.e., given f,gAut(M), then fgAut(M) (and satisfies the group axioms).

Element Copies.

Given a matroid M and an integer k we will define the matroid M[k] by creating k copies of each element of M. Formally, the ground set of M[k] is {(u,j);uM,j[k]}. The rank function of M[k] is induced by the projection ϕ:M[k]M that maps (u,j)u, i.e., rankM[k](S)=rankM(ϕ(S)). By definition, the projection ϕ is a matroid morphism from M[k]M.

If N is a matroid of at most n elements, every morphism f:NM can be written as: f=ϕf where f:NM[n] is a monomorphism.

Direct Sum.

Given two matroids M and N, we define their direct sum MN as the matroid whose ground set is the disjoint union of the ground sets of M and N and rankMN(S)=rankM(SM)+rankN(SN) for all S in the disjoint union of ground sets.

Graphic Matroids.

We will define a few special classes of interest. We start with graphic matroids. Given a graph with edge set E, we can define a matroid with ground set E by defining the rank(S) of a subset SE as the maximum number of edges in S that don’t form a cycle. We say that a matroid M is graphic if it is isomorphic to the matroid obtained from an undirected graph as we just described.

As an example, consider the matroid M with ground set {a,b,c} and rank function such that rank(S)=|S|. The matroid is graphic since it is isomorphic to the matroid that can be obtained from any of the graphs in Figure 2. An important thing to note, however, is that the matroid description contains no information about vertices. It only tells us which sets of edges are independent and which are not. As we can see in the figure, this is typically not enough to fully determine the graph structure.

Figure 2: Two graphs that generate the same matroid on their edge set.

𝑲-representable Matroids.

Let K be a field (e.g. ,,𝔽p) and let Kd be the vector space formed by d-dimensional vectors with coordinates in K. We say that a subset of vectors u1,,ukKd is independent if the unique solution to α1u1+α2u2++αkuk=0 for αiK is α1=α2==αk=0. Any subset of Kd together with the independency relation above defines a matroid. From now on, we will use the notation Kd to represent both the vector space and the corresponding matroid. We say that a matroid M is K-representable if there is a matroid morphism MKd for some integer d.

If a matroid M is K-representable for every field K we say that M is a regular matroid. Every graphic matroid is representable over any field by mapping an edge (u,v) to the vector euev where eu the the u-th unit vector. (This is true even over 𝔽2 where euev=eu+ev.)

For example, the matroids in Figure 2 can be represented by the vectors (1,1,0,0), (0,1,1,0), (0,0,1,1). As it is the case for graphic matroids, the matroid description has no information about vectors and the representation is again not unique. An equally good representation is (1,0,0),(0,1,0),(0,0,1).

We will be specially interested in binary matroids which are matroids that are representable over 𝔽2 (the finite field of 2 elements where addition and multiplication are performed mod 2).

Laminar matroids.

A family of sets, 𝒜, is called laminar if it satisfies the property that for any A,A𝒜, at least one of the sets AA,AA,AA is empty. A laminar matroid M is one for which there exists a laminar family of sets 𝒜 consisting of subsets of the ground set of M and a function c:𝒜+, such that the independent sets of M are precisely those sets IM such that |IA|c(A) for all A𝒜.

Uniform Matroid.

We will denote by Un,r the uniform matroid of n elements and rank r. This is the matroid with ground set [n] and whose rank function is rankUn,r(S)=min(r,|S|). We call the Frn:=Un,n the free matroid of rank n, i.e., a matroid of n elements in which every set is independent.

Trivial Matroid.

Let T be the trivial matroid which has ground set {0} and rank function rankT(S)=0 for all sets S.

𝟐-transitive Matroid.

We say that a simple matroid M (loop-free and no parallel elements) is 2-transitive if for any pair of independent sets of size two, {e1,e1},{e2,e2}M there exists an automorphism fAut(M) satisfying f(e1)=e1 and f(e2)=e2. There are several matroids that satisfies the 2-transitive property including complete affine matroids, complete projective matroids, free matroids, and their truncations [30].

3 Online Matroid Embeddings

We are interested in studying matroids whose structure is revealed to an algorithm in an online fashion. For that, it will be useful to take into account the order in which elements are processed, which we will represent by an indexing of the ground set: π:[n]M.

A matroid N is a restriction of matroid M if the ground set of N is a subset of the ground set of M and rankM coincides with rankN on the ground set of N.

Given a matroid with ordered ground set specified by a pair (M,π), we say that (M,π) is a prefix-restriction of (M,π) if n=|M|<|M|, M is the restriction of M to π([n]) and π is the restriction of π to [n].

Let 𝒞 be a class of matroids that is closed under restriction (e.g., the class of all matroids, graphic matroids, binary matroids, K-representable matroids, matroids of rank at most r). An online matroid morphism (OMM) for class 𝒞 consists of a host matroid BigM, together with matroid morphisms

fM,π:MBigM

for every M𝒞 and every indexing π:[n]M of the ground set of M, such that for every prefix-restriction (M,π) of (M,π), the map fM,π is the restriction of fM,π to the ground set of M.

If all morphisms fM,π are monomorphisms, we say that they form an online matroid embedding (OME). Given an online matroid morphism it is easy to construct an online matroid embedding by copying the elements of BigM.

Lemma 1.

Let 𝒞 be a class of matroids, where each matroid M𝒞 has at most n elements and fM,π:MBigM form an online matroid morphism. Then there is an online matroid embedding fM,π:MBigM[n].

Proof.

We define fM,π as follows: for each uM if u=π(k) let fM,π(u)=(fM,π(u),j) where j=|i[k];fM,π(π(i))=u|. The functions fM,π are injective by construction and they are matroid morphisms by the definition of BigM[n]. In fact: fM,π=ϕfM,π where ϕ is the natural projection BigM[n]BigM. Finally note that they can be constructed online since the identity of the copy used is only a function of the set of elements that arrived up to this point.

With this definition we can ensure that an online algorithm is able to construct a monomorphism from an unknown matroid M to BigM in an online fashion. Consider a matroid M for which the elements arrive according to π. At each time t, we can observe the structure of the matroid Mt which is the restriction of M to π([t]). Let πt be the restriction of π to [t]. If we have an online matroid embedding, we can first construct fM1,π1, then extend to fM2,π2 and so forth.

It will also be convenient to define a randomized online matroid morphism (embedding) which for every matroid M𝒞 and ordering π specifies a distribution over (mono)morphisms fM,π:MBigM such that for every prefix-restriction (M,π) the distribution of the restriction of fM,π to the ground set of M coincides with the distribution of fM,π.

Finally, we say that a randomized online matroid embedding is order-independent if the distribution of fM,π doesn’t depend on π. In other words, for any two orderings π and π, the morphisms fM,π and fM,π are equally distributed.

Uniform Order-Independent Embedding.

Let f be an order-independent online embedding from MBigM. We consider an order independent-randomized embedding g:MBigM by composing f with uniformly random automorphism fAut(BigM), i.e. g=ff.

Interestingly, whenever BigM satisfies 2-transitive property then the embedding g maps each element of eM uniformly at random over the matroid BigM. In addition, for any independent set of pair of elements {e,e}M and pair of elements {e~,e~}BigM, the events {g(e)=e~} and {g(e)=e~} are “almost” independent. More formally,

Lemma 2.

Given a simple host matroid (loop-free and no parallel elements) BigM such that for any two pairs of distinct elements {e1,e2} and {e1,e2} there exists an automorphism fAut(BigM) satisfying f(e1)=e1 and f(e2)=e2, then a uniformly random automorphism f sampled from Aut(BigM) satisfies:

  1. 1.

    For any e,eBigM, Pr[f(e)=e]=1n.

  2. 2.

    For any two pairs of elements e1,e2 and e1,e2 (s.t. e1e2 and e1e2), we have

    Pr[f(e1)=e1f(e2)=e2]=1n(n1)

Proof.

Consider the action of the group of automorphisms Aut(BigM) on the set of pairs of distinct elements P={(e1,e2):e1,e2BigM,e1e2}. For two pairs (e1,e2),(e1,e2)P, the set of automorphisms fAut(BigM) that satisfy f(e1,e2)=(e1,e2) is nonempty, and therefore, it is a coset of the subgroup of stabilizers of (e1,e2) (i.e., the set of automorphisms that satisfy f(e1,e2)=(e1,e2)). Since all cosets of a subgroup must have the same size, and because all pairs (e1,e2)P define a different coset, for a uniformly drawn automorphism f,

Pr[f(e1,e2)=(e1,e2)]=1|P|=1n(n1).

An analogous argument gives that Pr[f(e)=e]=1/n.

Online vs. Offline Embeddings.

The difficulty of constructing an online matroid embedding is that the elements of BigM corresponding to certain elements of M must be chosen before the full matroid structure of M is known. If we merely wanted to construct a matroid BigM that contains an isomorphic copy of every matroid in 𝒞, that would be very easy: BigM could be taken to be the direct sum of all the matroids in 𝒞.

4 OMEs for Binary Matroids

Before we discuss how to use online matroid embeddings in online algorithms, it is important to show first that they exist in non-trivial cases. For that, we will provide a complete analysis for binary matroids. Recall that 𝔽2n is the complete binary matroid of rank n and that graphic matroids and regular matroids are special cases of binary matroids. Our first result is the existence of an OME for this class. This will be done by showing the existence of an OMM and using Lemma 1 to convert an OMM to an OME.

Our first step is to show a lemma that the matroid 𝔽2n is special in the sense that its group of matroid automorphisms coincides with its group of vector space automorphisms:

Lemma 3.

A mapping A:𝔽2n𝔽2n is a matroid automorphism iff it is an automorphism of vector spaces.

Proof.

An automorphism of vector spaces A:𝔽2n𝔽2n is a bijection such that for any vectors v1,,vk𝔽2n it holds that A(i=1kvi)=i=1kAvi. This in particular implies that a set of vectors v1,,vk is independent iff the vectors Av1,,Avk are independent. This is because a coefficient vector (α1,,αk) satisfies the equation i=1kαivi=0 if and only if it satisfies i=1kαiAvi=A(i=1kαivi)=0, so the first equation has only trivial solutions if and only if the second equation has only trivial solutions.

For the opposite direction, if A is a matroid automorphism and e1,,en is the standard basis of 𝔽2n then Ae1,,Aen must be linearly independent elements of 𝔽2n. Now, take any vector v=iSei. Since {v}{ei;iS} forms a circuit, then {Av}{Aei;iS} must form a circuit. Since the only non-zero constant in 𝔽2 is 1, it must hold that: Av+iSAei=0 and hence Av=iSAei. Hence A is also an automorphism of vector spaces.

Theorem 4.

Let 𝒞 be the class of binary matroids of at most n elements and let BigM be the complete binary matroid 𝔽2n. Then there exists an OMM for 𝒞 into BigM.

Proof.

Given a binary matroid M we construct a mapping f:M𝔽2n as follows. We keep a counter k initially set to 1. For each element a we process, if it is independent of the previously arrived elements (i.e. there are no circuits containing a and the elements seen so far), we set f(a)=ek and increment k. Otherwise, a forms a circuit with a set of previously arrived elements u1,,um for some integer m0. This means that their image f(a),f(u1),,f(um) must be a minimal 𝔽2-linearly dependent set. Since the only non-zero constant in 𝔽2n is 1, then it must hold that:

f(a)+f(u1)++f(um)=0

and hence we can map: f(a) to f(u1)++f(um) (recall that 1=1 in 𝔽2).

Finally, we need to argue that f is a matroid morphism. Observe that if M is a binary matroid, then there exists a morphism g:M𝔽2n. Let {b1,,br} be the elements of M such that f(bi)=ei. By the fact that g is matroid morphism, g(b1),,g(br) are linearly independent elements in 𝔽2n. By Lemma 3 there is an automorphism AAut(𝔽2n) that takes g(bi) to ei. Since matroid morphisms compose, Ag:M𝔽2n is matroid morphism.

Finally, we argue that f(a)=Ag(a) for all a in M. We show this by induction. For each element processed by the algorithm, if it is independent from previously arrived elements, then f(a)=Ag(a) by construction. Otherwise, there are previously arrived elements such that a,u1,,um form a circuit. Hence their image under Ag must be a linearly dependent set of 𝔽2-vectors, which means that:

Ag(a)=Ag(u1)++Ag(um)=f(u1)++f(um)=f(a)

where the second equality holds by induction. Since f coincides with Ag, f is a matroid morphism.

Furthermore, there is a randomized OME that is order-independent. We will show it as a consequence of the following lemmas:

Lemma 5.

Given a binary matroid M and the complete binary matroid 𝔽2n, if there are two matroid morphisms f,g:M𝔽2n, then there exist an automorphism AAut(𝔽2n) such that f=Ag.

Proof.

Let r be the rank of M and let {b1,,br} be a basis of M. Then {f(b1),f(b2),,f(br)} and {g(b1),g(b2),,g(br)} are both sets of independent vectors in 𝔽2n. Then there exists an automorphism A of vector spaces (and hence a matroid automorphism) that sends g(bi) to f(bi). For any other element in vM consider any circuit formed with a subset of the basis. If {v}{bi;iS} is a circuit then it must be the case that: f(v)=iSf(bi) and g(v)=iSg(bi). Given that A is a automorphism of vector spaces, then: Ag(v)=iSAg(bi)=iSf(bi)=f(v).

Theorem 6.

There is a order-independent randomized OMM from the class of binary matroids 𝒞 into the complete binary matroid.

Proof.

Let fM,π be the online matroid morphism constructed in Theorem 4 and consider AfM,π when A is drawn uniformly at random from Aut(𝔽2n). It is clear that for every fixed A the morphisms AfM,π still form an OMM. We only need to check that they are order-independent. To see that, observe that if π and π are two different orderings of the ground set of M then fM,π and fM,π are two morphisms M𝔽2n. By the previous lemma, there is A0Aut(𝔽2n) such that fM,π=A0fM,π. Now, the distribution of AfM,π for a random AAut(𝔽2n) is the same distribution as AA0fM,π which is the same distribution of AfM,π, since A0A is also uniformly distributed over Aut(𝔽2n).

Extending to Copies.

In the following section we will be needing an online matroid embedding. For that reason, we need to extend the last two theorems to deal with copies. The extension is rather simple: we only need to observe that a matroid autormorphism of the commplete binary matroid with n copies of each element (𝔽2n)[n] can be decomposed into an automorphism AAut(𝔽2n) and indexings of the identities of the copies.

Lemma 7.

If fAut((𝔽2n)[n]) then there exists AAut(𝔽2n) and indexings σu:[n][n] for each u𝔽2n such that f((u,j))=(Au,σu(j))

Proof.

Let id be the identity map and ϕ:(𝔽2n)[n]𝔽2n the natural projection. Now, ϕf and ϕ are two matroid morphisms from (𝔽2n)[n]𝔽2n so by Theorem 5 there is AAut(𝔽2n) such that ϕf=Aϕ (see the commutative diagram below). This means in particular that f((u,j))=(Au,σu(j)) for some indexings σu.

With that, Theorem 6 automatically extends to the matroid with copies (𝔽2n)[n] by taking a random automorphism from group Aut((𝔽2n)[n]).

Remark A (Single Orbit Morphisms).

Theorem 6 is not particular to binary matroids. The only fact it uses is that all the morphisms of the OMM belong to the same orbit under the action of the automorphism group Aut(BigM). We can state it more generally as follows. The proof is identical to Theorem 6, so we omit it here.

Theorem 8 (Generalization of Theorem 6).

Let fM,π be an OMM of class 𝒞 into BigM such that given two orderings π and π of the ground set of M, there is an automorphism AAut(BigM) such that fM,π=AfM,π. Then there is an order independent randomized OMM of class 𝒞 into BigM.

Remark B (Other Fields).

In this section we repeatedly use the fact that 𝔽2 has only one non-zero constant, so whenever we identify a circuit in the matroid, we know exactly what is the linear dependency between the elements in the corresponding vector field. This is no longer true even in slightly larger fields like 𝔽3. If vectors u,v,w𝔽3n form a circuit, it could be that: w=±u±v in the representation. As a consequence, given two matroid morphisms f,g:M𝔽3n there may not exist a vector-space automorphism A of 𝔽3n such that f=Ag. In the previous example, if f(u)=g(u), f(v)=g(v) but f(w)=f(u)+f(v) but g(w)=g(u)g(v) no such automorphism can exist.

5 OMEs and the Matroid Secretary Problem

In this section, we use OMEs to explore the complexity of the matroid secretary problem (MSP) on binary matroids. We consider three versions of the problem, each making different assumptions on the data generation process and what’s known to the algorithm. We will use OMEs to establish equivalences between these problems, showing that seemingly simpler problems are actually equivalent to harder ones (up to constants).

Three Versions of the MSP.

We consider the following three versions of the MSP, and aim to establish the relations in Figure 1. In all three variants, the goal is an algorithm for selecting elements that form an independent set, and whose combined weight is in expectation an α-approximation to the weight of the optimal basis.

  • Online-revealed-matroid MSP: In this version of the problem, there is an underlying matroid M, which is a priori unknown to the algorithm. The algorithm has only access to the number of elements n=|M| and to a promise that M𝒞 for a class of matroids 𝒞. For each element uM, an adversary determines a weight wu+. The algorithm processes pairs (u,wu) in random order at each time, but it only knows the rank function restricted to the subset of elements that have already arrived. Upon seeing the element, the algorithm must irrevocably decide whether to accept that element or not, subject to the constraint that the set of accepted elements must be an independent set of M.

  • Known-matroid MSP: In this version, the matroid M is known to the algorithm ahead of time. The only information missing is the weight of each element, which is again chosen adversarially. As before elements arrive in random order, and the algorithm must make immediate accept/reject decisions, with the restriction that the chosen set of elements must be an independent set of M.

  • Prophet MSP: In this version, the matroid M is again known to the algorithm ahead of time. However, this time the weight of each element is drawn from a known distribution 𝒟, which can potentially sample weights in a correlated manner. As in the other versions elements are then presented to the algorithm in random order, and the algorithm aims to select an independent set of high weight in an online manner.

Note that the first version is clearly harder than the second and the second version is clearly harder than the third, in the sense that an α-approximation to the harder problem immediately implies an α-approximation to the simpler one. We derive approximate “inverses” of these comparisons from the existence of OMEs, even if we restrict prophet MSP to pairwise-independent distributions.

Our Reductions.

We first use OMEs to show an (essentially exact) “inverse” of the comparison between the online-revealed-matroid MSP and the known-matroid MSP, implying that for binary matroids the latter is as hard as the former.

Theorem 9.

If a class 𝒞 of matroids admits a randomized order-independent online matroid embedding into matroid BigM, then an α-approximation to the known-matroid MSP for BigM[n] implies that for every ϵ>0 there is a (αϵ)-approximation to the online-revealed-matroid MSP for 𝒞.

For the case of binary matroids that we previously discussed, the matroids BigM and BigM[n] themselves are binary in which case we can obtain the following corollary:

Corollary 10.

For binary matroids, there is no gap in approximability between the known-matroid MSP and the online-revealed-matroid MSP.

As our second result, we use the existence of OMEs into a 2-transitive host matroid as a tool to establish the approximate equivalence of known-matroid MSP and prophet MSP with pairwise-independent distributions.

Theorem 11.

Suppose a class 𝒞 of matroids admits a randomized order-independent online matroid embedding into matroid BigM which is 2-transitive. Then an α-approximation to the prophet MSP with pairwise-independent weight distributions for BigM[k], implies that for some constant C>0 there is a C(αo(1))-approximation to the known-matroid MSP for 𝒞.

Noting that the full binary matroid is 2-transitive, and there exists an order-independent OME from the class of binary matroids into a full binary matroid, we obtain the following corollary.

Corollary 12.

For binary matroids, there is a constant-factor gap in approximability between the known-matroid MSP and the prophet MSP with pairwise-independent weight distributions.

We note that we can also chain the two reductions, and this way relate the online-revealed-matroid MSP to the Prophet MSP with pairwise-independent distributions. The rest of this section is devoted to the proofs of the reductions.

5.1 Proof of Theorem 9

Let M be the unknown matroid that is revealed to the algorithm in an online fashion and let fM,π be an order-independent randomized OME into BigM. Let n=|M|, N=|BigM| and d,k be two larger integers (to be specified later) where k is a multiple of d.

An instance of the MSP consists of a sequence of weighted elements from M that are presented to the algorithm in random order. Our goal is to map it on the fly to a random instance of the MSP on BigM[k]. The main difficulty is, as usual, doing it online and preserving the random order. Our strategy will be to first provide an offline reduction which preserves random order and obtains the desired approximation, but can’t be implemented online. After that we will provide a mostly-online implementation of this reduction, i.e. a procedure that samples from the same distribution generated by the offline reduction and that with 1ϵ probability can be implemented online. With the remaining ϵ probability, the process raises a flag. Raising a flag will indicate that from that point on, the reduction can no longer be implemented online. Algorithmically, we will stop the algorithm whenever we raise a flag and obtain zero reward. Finally, we will show that the probability of raising a flag is very small for large values of k and d.

Offline Reduction.

We will view a weighted element of M as a pair (u,wu) with uM and wu+. In the offline reduction, we assume we have access to the entire matroid M and the entire sequence of weights. Now, we will produce a distribution of instances of BigM[k] as follows.

For each element v in BigM sample k different i.i.d. timestamps tvj for j[k] from the Uniform([0,1]) distribution. Those timestamps specify the arrival time of each of the k copies of the elements in BigM and induce a random ordering over the ground set of BigM[k]. For the matroid M, sample a random embedding f:MBigM from the OME. (Since the embedding is order independent, we don’t need to know the arrival order of elements in M to sample such embedding). For each uM, pick a random copy of f(u) and set its weight to wu. For the remaining elements, set the weight equal to zero.

This random input is clearly in random order as it is equivalent to starting with k copies of the elements of BigM where all but one copy has weight zero if that corresponds to an element of M and randomly permuting those elements. Now, feed this instance to the α-competitive algorithm for the MSP on BigM[k]. From the set selected by the algorithm, discard any element with zero weight chosen by the algorithm. The elements with non-zero weight chosen in BigM correspond to an independent set of M with the same weight. Hence, in expectation, we select an α-approximation to the optimal basis of M.

Mostly-online Implementation.

The drawback of the previous reduction is that it can’t be implemented online as we are assuming we know everything in advance. We will describe the same sampling procedure in a way that with high probability we can generate the instance as we go. In the sampling procedure, we will also define an event raise a flag which will mean that we can’t generate that instance online as we learn the structure of the matroid M.

The process will again start by sampling i.i.d. timestamps tvj for vBigM and j[k] from Uniform([0,1]). In addition, we will also sample n additional timestamps from Uniform([0,1]) sort them in increasing order and denote the sorted list by T1,,Tn.

We will now divide the interval [0,1] into intervals Ii=[i1d,id) for i[d]. If more than one timestamp Ts falls in the same interval Ii, we will raise a flag. We will count how many of the timestamps tv,j fall in each interval:

Xvi=|{j[k];tvjIi}|

With that, also define:

Avi=min(kd,Xvi)Bvi=max(0,Xvikd)

Now, process the elements of the matroid M according to order π (which will be sampled at random). As we process the s-th element u=π(s)M, we will map it to an element in v=fM,π(u)BigM using the randomized OME. Now, we will apply the following procedure to choose a copy of v in BigM[k] to assign weight wu:

  • find the interval Ii containing Ts.

  • with probability Avid/k, choose one of the Xvi timestamps tvj in interval Ii

  • with remaining probability (if any), raise a flag and choose a different interval Ii with probability proportional to Bvi and choose a timestamp tvj in that interval.

We assign weight wu to the element with the chosen timestamp and zero weight to others. Now, we will show the following facts.

Lemma 13.

The mostly online implementation samples sequences with the same probability as the offline reduction.

Proof.

Observe that if we ignore the weights, the order of the elements of BigM is the same in both processes since they are determined by the timestamps tvj. What we are left to argue is that for each v we select uniformly random timestamp tvj to assign the non-negative weight. For that, observe that since fM,π is order independent, it has the same distribution as if we first sampled a monomorphism f:MBigM, and then we sampled an independent uniform indexing π for the arrival order of the elements in f(M). This implies that when we assign the timestamps T1,,Tn according to π, the resulting distribution is the same as if we assigned i.i.d. Uniform[0,1] timestamps Tv to each element vf(M), and therefore, the interval Tv lands in is uniformly chosen and independent across elements vf(M). Now fix a certain timestamp tvj and let Ii be the interval containing it. We will show that the probability that this timestamp is selected is exactly 1/k.

Consider two cases: either Xvik/d in which case the probability of sampling tvj is the probability that the timestamp Tv is in Ii (which is 1/d), times the probability we decide to sample a timestamp inside Ii (which is Xvid/k), times the probability that out of those, we choose tvj (which is 1/Xvi). The total probability is:

1dXvidk1Xvi=1k

In the case where Xvi>k/d, then it is possible that we sample tvj also when Tv is outside Ii. The probability that we sample tvj and Tv is in Ii is:

1d11Xvi=1dXiv

The probability that we sample when it is outside is the probability that we choose a different interval Ii, raise a flag and then move to interval Ii, which is:

i1d(1Avidk)BviiBvi1Xvi=1k(kiAvi)iBviBviXvi=1kBviXvi

because iAvi+iBvi=iXvi=k. Taking those two probabilities together, we have:

1dXiv+1kBviXvi=1k.

Lemma 14.

If no flags were raised, we can produce the instance on the fly as we process M.

Proof.

Let i1<<in be the indices of the intervals such that TsIis. Since no flag was raised, then each Ts landed in a different interval and the s-th element that arrives from matroid M is mapped to a copy inside Iis. This enables the following online reduction: once the s-th element arrives we can decide the weights of all the elements in intervals Iis1+1 to Iis and feed to the MSP algorithm for BigM[k]. In this sub-sequence there will be at most one element on non-zero weight which corresponds to the arriving element of M. We can observe if that element was selected in BigM[k] and if so, we can select it in M.

Lemma 15.

For any n and ϵ, there are large enough k and d, such that the probability that we raise a flag is at most ϵ.

Proof.

The first event in which we raise a flag is when two timestamps Ts land in the same interval. The probability that this happens is at most n2/d. Now, note that for each interval i and each of the n elements v in BigM that have non-zero weights, we have by the Chernoff bound that:

(Xvi(1δ)kd)exp(δ2k2d)

Hence with probability at most ndexp(δ2k2d), the timestamps tvj are such that the probability we raise a flag when we try to choose a timestamp in the same interval as Ts is more than δn. Taking the union bound of those events, we get:

n2d+ndexp(δ2k2d)+δn

Taking δ=ϵ/(3n), d=3n2/ϵ and k large enough, we get that the total probability of raising a flag is at most ϵ.

Taking those lemmas together, we can conclude the proof of Theorem 9. For that, let Alg be an α-competitive algorithm for BigM[k] and let Y represent the sequence of the MSP sampled by the offline reduction. Let’s represent by Alg(Y) the weight of the elements selected by Alg and Opt the weight of the optimal basis. By the fact that the offline reduction produces an instance in random order, we know that 𝔼[Alg(?Y)]αOpt.

Our online reduction, will attempt to construct Y on the fly. If we raise the flag, we will stop the algorithm and pretend we had zero reward. If not, we will continue the reduction and collect Alg(Y) reward. We will denote by Flag the event that the flag was raised and by Flag¯ its complement. Our total reward will be:

𝔼[Alg(Y)𝟏{Flag¯}]=𝔼[Alg(Y)]𝔼[Alg(Y)𝟏{Flag}]𝔼[Alg(Y)]Opt[Flag](αϵ)Opt.

5.2 Proof of Theorem 11

Let M be the unknown matroid with |M|=n that is revealed to the algorithm in an online fashion, which admits an order-independent randomized OME into BigM with |BigM|=M. First, we obtain the following simple reduction that allows us to focus on a special class of the prophet MSP in which each element takes a weight from the set of weights W with |W|=m=O(n2). In addition, we can restrict the weight distribution such that each element has a distinct weight from the weight class.

Lemma 16.

If there exists an α-approximation to the prophet MSP on M with weight distribution 𝒟 supported over the set of weights W with rank(M)=d, |M|=n, |W|=O(n2) with maxwWw1 and 𝔼𝒟[OPT(M)][116,1] such that for all wW, there exists at most one element assigned weight of w with probability one, then there exists an (α256132d)-approximation to prophet MSP on matroid M with any arbitrary weight distribution.

The proof of the above lemma simply follows from Sublemma-4.2 from [18] that reduces any arbitrary prophet MSP with O(log(|rank(M)|)) many weights and 𝔼𝒟[OPT(M)][116,1]. We then add distinct noise of the order of O(1n2) to ensure that the weight of each element is distinct. We defer the details of this reduction to the full version.

For simplicity, we let W={w1,,wm} and consider the prophet MSP on matroid M and weight distribution 𝒟 supported over the set of weights W satisfying the conditions from Lemma 16.

Extending BigM with Copies.

We let BigM[mN] be a matroid with mN parallel copies of each element of BigM with |BigM|=M and integer N=Ω(2M2). We divide the set of Nm copies into m sets of size N, each part corresponding to weight class wi. We use Ni to denote the set of labels corresponding to weight wi for all i[m] with |Ni|=N. We sometimes denote Ni by [N]={1,2,,N} whenever it is clear from the context which wi we are referring to. In addition, the -th copy of the weight class corresponding to weight wi of element 𝐯BigM is denoted as 𝐯i,.

Reduction to “Almost” Pairwise Independent Prophet MSP.

We first define the weight distribution 𝒟 over BigM[mN] in Definition 17, which is “almost” pairwise independent. Then in Theorem 18, we show an existence of exact pairwise independent weight distribution 𝒟~ over BigM[mN] which is “close” to the distribution defined in Definition 17 in total-variation distance. This allows us to utilize the fact that any algorithm 𝒜 can not distinguish between the almost pairwise independent weight distribution 𝒟 and 𝒟~ with high probability. Finally, we complete the proof of Theorem 11.

We proceed with the formal proof. We begin by defining the almost pairwise independent weight distribution over BigM[mN].

Definition 17 (Almost P.W. Independent Distribution).

Consider the weight distribution 𝒟 over the elements of BigM[mN] defined as follows:

  1. 1.

    Given an order independent OMM f:MBigM, we sample a random automorphism f′′Aut(BigM) and obtain an order independent matroid morphism f=f′′f.

  2. 2.

    For any 𝐯M with w(𝐯)=wi, let 𝐮=f(𝐯). We sample Unif(Ni) and assign the weight of w(𝐮i,)=wi.

  3. 3.

    We assign the weight of the rest of the elements of BigM[mN] to be zero.

We first observe that when N is much larger than M, the distribution in the above definition is almost pairwise independent. To see this, we first observe that for any i[m],Ni and 𝐮BigM, 𝐮i,BigM[mN] can potentially either take a weight of wi or zero. For simplicity, now consider any two distinct elements 𝐮i,,𝐮j,BigM[mN] and weight distribution 𝒟 such that there always exists a pair of elements 𝐯,𝐯′′M that are assigned weights of wi,wj, respectively. Since f is a random automorphism Aut(BigM), we have Pr[w(𝐮i,)=wi]=Pr[f(𝐯)=𝐮]1N=1MN. On the other hand, we have

Pr[w(𝐮i,)=wiw(𝐮j,)=wj]=Pr[f(𝐯)=𝐯f(𝐯)=𝐮]1N2=1M(M1)1N2,

which is close to the product Pr[w(𝐮i,)=wi]Pr[w(𝐮j,)=wj]=1M2N2. However, in general, we can not guarantee that 𝒟 will always assign weights wi,wj to some pair of elements of 𝐯,𝐯 of M. In addition, the above argument also fails if we have i=j or 𝐮=𝐮 as in both of these cases, Pr[w(𝐮i,)=wiw(𝐮j,)=wj]=0. Intuitively, we can circumvent these pairwise correlation issues by taking N large enough as it makes pairwise correlations small enough. More precisely,

|Pr[w(𝐮i,)=wiw(𝐮j,)=wj]Pr[w(𝐮i,)=wi]Pr[w(𝐮j,)=wj]|=O(1M2N2).

Using this observation, we prove the following technical theorem.

Theorem 18.

For N=Ω(2M2), let weight distribution 𝒟 over BigM[mN] be defined as in Definition 17, then there exist a pairwise-independent weight distribution 𝒟~ over BigM[mN] such that TV𝒟,𝒟~O(m3M).

The proof of the above theorem is highly technical and deferred to the full version. The idea is to construct an explicit 𝒟~ by a sequence of small perturbations to 𝒟. We emphasize that the choice of N=Ω(2M2) is required due to the limitations of the techniques developed to prove Theorem 18. We conjecture that one can prove the similar theorem for N=Ω(Poly(M)), which we leave as an intriguing technical open problem.

Proof of Theorem 11.

To prove the main theorem, we first prove the following: if there exists an α-approximate algorithm to the prophet MSP instance with a pairwise independent weight distribution for the matroid BigM[mN], then there exists an (αo(1))-approximate algorithm for the prophet MSP instance for the matroid M with weight distribution 𝒟 supported over the set of weights W with rank(M)=d, |M|=n and |W|=O(n2) with maxwWw1 and 𝔼𝒟[OPT(M)][116,1] such that for all wW, there exists at most one element assigned weight of w with probability one. Combining this with Lemma 16, we will conclude the proof of the Theorem 11.

Given an order-independent matroid morphism f:MBigM, we sample a random automorphism f′′Aut(BigM) and obtain an order-independent matroid morphism f~=f′′f. Given f~:MBigM, we obtain f:MBigM[m] that maps each 𝐯M to 𝐮iBigM[m] iff f~(𝐯)=𝐮 and w(𝐯)=wi. We then consider BigM[mN], i.e. matroid BigM[m] with N many copies of each element.

We first consider an offline reduction as follows: for all 𝐯iBigM[m], sample N many independent arrival times from Unif[0,1] denoting the uniformly random arrival times of elements of BigM[mN]. Given any 𝐯M and pair (𝐯,w(𝐯)=wi), with 𝐮i=f(𝐯), let w(𝐮i,)=wi uniformly random from [N].

Since f does not require any information about the arrival order, the above-described offline reduction is a valid instance of matroid prophet secretary over BigM[mN]. In addition, the induced weight assignment over BigM due to offline reduction is identical to the distribution 𝒟 defined in Definition 17.

Given the uniformly random arrival of elements of M, we construct an “almost online implementation” of the above offline reduction similar to the proof of Theorem 9. We let N be large enough (Ω(n2/ε)) such that the probability of “almost online implementation” raising a flag is at most ε. In fact, for the proof of Theorem 18, we let N=Ω(2M2) which satisfies the required condition.

We let 𝒜 be an α-approximate algorithm for the pairwise-independent prophet MSP on matroid BigM[mN]. Since there exists a pairwise independent weight distribution 𝒟~ over BigM within the total variation distance of O(m3M), the algorithm 𝒜 can not distinguish the weight distribution 𝒟 from 𝒟~ with probability at least 1O(m2M).

Let be the event when the algorithm 𝒜 can not distinguish between 𝒟 and D~. We note that when event does not hold, the offline optimal can be bounded by

𝔼[OPT(BigMmN)c]rank(BigM[mN])maxwiWwin1=n,

where the second inequality follows because rank(BigM[mN])=n and wi1 for all i[mN].

Now, let S be the selected set of elements of BigM by 𝒜 w.r.t. weight distribution 𝒟. We can bound,

𝔼[w(S)] =𝔼[w(S)]Pr[]+𝔼[w(S)c]Pr[c]
𝔼[w(S)]+𝔼[OPT(BigM[Mm])c]m3M
𝔼[w(S)]+m3nM.

Above, the first inequality holds because Pr[c]m2M and the second inequality holds because 𝔼[OPT(BigM[mN])c]n. Due to our reduction, the performance of the algorithm on the original Prophet MSP instance 𝔽 is lower bounded by 𝔼[w(S)], next we lower bound the expectation 𝔼[w(S)],

𝔼[w(S)] 𝔼[w(S)]m3nM
α𝔼𝒟~[OPT(BigM[mN])]o(1)OPT(M)
OPT(M)(ααm3M)o(1)OPT(M)(αo(1))OPT(M).

Above, the second inequality holds because 𝒜 is an α approximate algorithm for Prophet MSP with pairwise independent prior and m3nM=O(m4/2m)=o(1). The third inequality holds because TV𝒟,𝒟~O(m3/M). Finally, since the performance of the reduction on the original matroid secretary is

𝔼[w(S)]Pr[Reduction does not Flag](1ε)(αo(1))OPT(M).

This concludes the proof.

6 Additional Results

OMEs Beyond Binary Matroids.

Our main result from Section 4 is an online matroid embedding that embeds binary matroids into binary matroids. We refer to online matroid embeddings where both M and BigM are of the same class as “within-class” OMEs. In the full version of the paper, we explore whether such within-class OMEs can exist for graphic matroids. We show that such embeddings cannot exist, and in fact, we show that graphic matroids cannot be embedded in an online-fashion to regular matroids. To rule out the existence of such an online embedding, we show that if it would exist, then BigM must contain an isomorphic copy of 𝔽2n. However, 𝔽2n contains an isomorphic copy of the Fano plane which is not representable over 𝔽3 [42]. Hence BigM can’t be regular.

We then we give another example of an OME, namely for laminar matroids. We show how to embed the class of laminar matroids M with at most n elements into BigM which is a complete linear matroid of rank n over any field with sufficiently many elements. On the flip side, we show that there is no OME if we require BigM to also be laminar.

Finally, we show an impossibility result of constructing an OME for the class of all matroids. This is shown by studying finite projective planes and showing that for those matroids, elements that haven’t arrived yet impose non-trivial constraints on the already arrived elements. As a corollary we obtain an impossibility of constructing an OME for the class of all matroids representable over fields of characteristic at least 7.

Approximate Embeddings.

Motivated by these negative results, in the full version we also define and study matroid embeddings that allow some degree of distortion. We define a β-approximate embedding f:MN as a map between ground sets that approximately preserves rank, i.e.,

1βrankM(S)rankN(f(S))rankM(S),SM,

together with corresponding randomized and online versions of this notion.

By connecting the α-partition property of [1, 19] to our notion of β-approximate embedding, we obtain a lower bound of Ω(n/logn) on the distortion β that any randomized offline embedding from a complete binary matroid into a free matroid must incur. We complement this lower bound with a matching upper bound of O(n/logn), and show that this randomized embedding can be computed in an online manner.

Finally, we explore approximate embeddings for graphic matroids. We translate a result of [32] to our formalism, obtaining a 2-approximate offline embedding from graphic matroids into a free matroid. This embedding requires knowledge of the precise graphical structure, in particular, whether two edges are adjacent to the same node. We show that there is no constant-approximate online embedding when the elements are revealed online, and the algorithm only has access to an independence oracle.

References

  • [1] Dorna Abdolazimi, Anna R. Karlin, Nathan Klein, and Shayan Oveis Gharan. Matroid partition property and the secretary problem. In ITCS 2023, pages 2:1–2:9, 2023. doi:10.4230/LIPIcs.ITCS.2023.2.
  • [2] Saeed Alaei. Bayesian combinatorial auctions: Expanding single buyer mechanisms to many buyers. SIAM J. Comput., 43(2):930–972, 2014. doi:10.1137/120878422.
  • [3] Noga Alon, Alexandr Andoni, Tali Kaufman, Kevin Matulef, Ronitt Rubinfeld, and Ning Xie. Testing k-wise and almost k-wise independence. In STOC 2007, pages 496–505, 2007. doi:10.1145/1250790.1250863.
  • [4] Noga Alon, Oded Goldreich, and Yishay Mansour. Almost k-wise independence versus k-wise independence. Inf. Process. Lett., 88(3):107–110, 2003. doi:10.1016/S0020-0190(03)00359-4.
  • [5] Noga Alon and Shachar Lovett. Almost k-wise vs. k-wise independent permutations, and uniformity for general group actions. In APPROX’12, pages 350–361, 2012. doi:10.1007/978-3-642-32512-0_30.
  • [6] Moshe Babaioff, Michael Dinitz, Anupam Gupta, Nicole Immorlica, and Kunal Talwar. Secretary problems: weights and discounts. In Proceedings of the twentieth annual ACM-SIAM Symposium on Discrete Algorithms, pages 1245–1254. SIAM, 2009. doi:10.1137/1.9781611973068.135.
  • [7] Moshe Babaioff, Nicole Immorlica, David Kempe, and Robert Kleinberg. A knapsack secretary problem with applications. In APPROX-RANDOM 2007, pages 16–28, 2007. doi:10.1007/978-3-540-74208-1_2.
  • [8] Moshe Babaioff, Nicole Immorlica, David Kempe, and Robert Kleinberg. Matroid secretary problems. J. ACM, 65(6):35:1–35:26, 2018. doi:10.1145/3212512.
  • [9] Moshe Babaioff, Nicole Immorlica, and Robert Kleinberg. Matroids, secretary problems, and online mechanisms. In SODA 2007, pages 434–443, 2007. URL: http://dl.acm.org/citation.cfm?id=1283383.1283429.
  • [10] Yair Bartal. On approximating arbitrary metrices by tree metrics. In STOC 1998, pages 161–168, 1998. doi:10.1145/276698.276725.
  • [11] Yair Bartal, Nova Fandina, and Seeun William Umboh. Online probabilistic metric embedding: A general framework for bypassing inherent bounds. In SODA 2020, pages 1538–1557, 2020. doi:10.1137/1.9781611975994.95.
  • [12] Jean Bourgain. On lipschitz embedding of finite metric spaces in hilbert space. Isr. J. Math., 52:46–52, 1985.
  • [13] Ioannis Caragiannis, Nick Gravin, Pinyan Lu, and Zihe Wang. Relaxing the independence assumption in sequential posted pricing, prophet inequality, and random bipartite matching. In WINE 2022, pages 131–148, 2022.
  • [14] S. Chakraborty and O. Lachish. Improved competitive ratio for the matroid secretary problem. In SODA 2012, pages 1702–1712, 2012.
  • [15] Shuchi Chawla, Jason D. Hartline, David L. Malec, and Balasubramanian Sivan. Multi-parameter mechanism design and sequential posted pricing. In Leonard J. Schulman, editor, STOC 2010, pages 311–320, 2010. doi:10.1145/1806689.1806733.
  • [16] Michael Dinitz and Guy Kortsarz. Matroid secretary for regular and decomposable matroids. SIAM J. Comput., 43(5):1807–1830, 2014. doi:10.1137/13094030X.
  • [17] Shaddin Dughmi. The outer limits of contention resolution on matroids and connections to the secretary problem. In ICALP 2020, volume 168 of LIPIcs, pages 42:1–42:18, 2020. doi:10.4230/LIPIcs.ICALP.2020.42.
  • [18] Shaddin Dughmi. Matroid secretary is equivalent to contention resolution. In ITCS 2022, volume 215 of LIPIcs, pages 58:1–58:23, 2021. doi:10.4230/LIPIcs.ITCS.2022.58.
  • [19] Shaddin Dughmi, Yusuf Hakan Kalayci, and Neel Patel. Limitations of stochastic selection problems with pairwise independent priors. In STOC 2024, pages 479–490, 2024. doi:10.1145/3618260.3649718.
  • [20] Paul Dütting, Michal Feldman, Thomas Kesselheim, and Brendan Lucier. Prophet inequalities made easy: Stochastic optimization by pricing nonstochastic inputs. SIAM J. Comput., 49(3):540–582, 2020. doi:10.1137/20M1323850.
  • [21] Soheil Ehsani, MohammadTaghi Hajiaghayi, Thomas Kesselheim, and Sahil Singla. Prophet secretary for combinatorial auctions and matroids. In SODA 2018, pages 700–714, 2018. doi:10.1137/1.9781611975031.46.
  • [22] Moran Feldman, Ola Svensson, and Rico Zenklusen. A simple O(log log(rank))-competitive algorithm for the matroid secretary problem. Math. Oper. Res., 43(2):638–650, 2018. doi:10.1287/MOOR.2017.0876.
  • [23] Moran Feldman, Ola Svensson, and Rico Zenklusen. Online contention resolution schemes with applications to bayesian selection problems. SIAM J. Comput., 50(2):255–300, 2021. doi:10.1137/18M1226130.
  • [24] Mohammad Taghi Hajiaghayi, Robert D. Kleinberg, and Tuomas Sandholm. Automated online mechanism design and prophet inequalities. In AAAI 2007, pages 58–65, 2007. URL: http://www.aaai.org/Library/AAAI/2007/aaai07-009.php.
  • [25] Zhiyi Huang, Zahra Parsaeian, and Zixuan Zhu. Laminar matroid secretary: Greedy strikes back. arXiv preprint arXiv:2308.09880, 2023. doi:10.48550/arXiv.2308.09880.
  • [26] Sungjin Im and Yajun Wang. Secretary problems: Laminar matroid and interval scheduling. In SODA 2011, pages 1265–1274, 2011. doi:10.1137/1.9781611973082.96.
  • [27] Piotr Indyk. Algorithmic applications of low-distortion geometric embeddings. In FOCS 2001, pages 10–33, 2001. doi:10.1109/SFCS.2001.959878.
  • [28] Piotr Indyk, Avner Magen, Anastasios Sidiropoulos, and Anastasios Zouzias. Online embeddings. In APPROX-RANDOM 2010, pages 246–259, 2010. doi:10.1007/978-3-642-15369-3_19.
  • [29] Patrick Jaillet, José A Soto, and Rico Zenklusen. Advances on matroid secretary problems: Free order model and laminar case. In IPCO 2013, pages 254–265, 2013. doi:10.1007/978-3-642-36694-9_22.
  • [30] William M Kantor. Homogeneous designs and geometric lattices. J. Comb. Theory Ser. A, 38(1):66–74, 1985. doi:10.1016/0097-3165(85)90022-6.
  • [31] Robert Kleinberg and S. Matthew Weinberg. Matroid prophet inequalities. In STOC 2012, pages 123–136, 2012. doi:10.1145/2213977.2213991.
  • [32] Nitish Korula and Martin Pál. Algorithms for secretary problems on graphs and hypergraphs. In ICALP 2009, pages 508–520, 2009. doi:10.1007/978-3-642-02930-1_42.
  • [33] Oded Lachish. O(log log rank) competitive ratio for the matroid secretary problem. In FOCS 2014, pages 326–335, 2014. doi:10.1109/FOCS.2014.42.
  • [34] Marilena Leichter, Benjamin Moseley, and Kirk Pruhs. On the impossibility of decomposing binary matroids. Oper. Res. Lett., 50(5):623–625, 2022. doi:10.1016/J.ORL.2022.09.003.
  • [35] Nathan Linial, Eran London, and Yuri Rabinovich. The geometry of graphs and some of its algorithmic applications. Combinatorica, 15:215–245, 1995. doi:10.1007/BF01200757.
  • [36] Michael Luby, Avi Wigderson, et al. Pairwise independence and derandomization. Foundations and Trends® in Theoretical Computer Science, 1(4):237–301, 2006.
  • [37] Jiri Matousek. Lectures on Discrete Geometry. Springer, New York, NY, 2002.
  • [38] Ilan Newman and Yuri Rabinovich. Online embedding of metrics. Isr. J. Math., 2025. Forthcoming.
  • [39] Shayan Oveis Gharan and Jan Vondrák. On variants of the matroid secretary problem. Algorithmica, 67:472–497, 2013. doi:10.1007/S00453-013-9795-Y.
  • [40] Richard Santiago, Ivan Sergeev, and Rico Zenklusen. Simple random order contention resolution for graphic matroids with almost no prior information. In SOSA 2023, pages 84–95, 2023. doi:10.1137/1.9781611977585.CH8.
  • [41] Richard Santiago, Ivan Sergeev, and Rico Zenklusen. Constant-competitiveness for random assignment matroid secretary without knowing the matroid. Math. Program., 210(1):815–846, 2025. doi:10.1007/S10107-024-02177-X.
  • [42] William Thomas Tutte. A homotopy theorem for matroids. I, II. Trans. Am. Math. Soc., 88(1):144–174, 1958.
  • [43] Salil P. Vadhan. Pseudorandomness. Foundations and Trends® in Theoretical Computer Science, 7(1–3):1–336, 2012. doi:10.1561/0400000010.