Abstract 1 Introduction 2 Stochastic Assignment Problems 3 Warm-up: Knapsack Sparsification 4 Sparsifier for the General Assignment Problem 5 Analysis of GAP Sparsifier 6 Reconstruction Procedures 7 Conclusion References

Near-Optimal Sparsifiers for Stochastic Knapsack and Assignment Problems

Shaddin Dughmi ORCID University of Southern California, Los Angeles, CA, USA Yusuf Hakan Kalayci ORCID University of Southern California, Los Angeles, CA, USA Xinyu Liu ORCID University of Southern California, Los Angeles, CA, USA
Abstract

When uncertainty meets costly information gathering, a fundamental question emerges: which data points should we probe to unlock near-optimal solutions? Sparsification of stochastic packing problems addresses this trade-off. The existing notions of sparsification measure the level of sparsity, called degree, as the ratio of queried items to the optimal solution size. While effective for matching and matroid-type problems with uniform structures, this cardinality-based approach fails for knapsack-type constraints where feasible sets exhibit dramatic structural variation. We introduce a polyhedral sparsification framework that measures the degree as the smallest scalar needed to embed the query set within a scaled feasibility polytope, naturally capturing redundancy without relying on cardinality.

Our main contribution establishes that knapsack, multiple knapsack, and generalized assignment problems admit (1ϵ)-approximate sparsifiers with degree polynomial in 1/p and 1/ϵ – where p denotes the independent activation probability of each element – remarkably independent of problem dimensions. The key insight involves grouping items with similar weights and deploying a charging argument: when our query set misses an optimal item, we either substitute it directly with a queried item from the same group or leverage that group’s excess contribution to compensate for the loss. This reveals an intriguing complexity-theoretic separation – while the multiple knapsack problem lacks an FPTAS and generalized assignment is APX-hard, their sparsification counterparts admit efficient (1ϵ)-approximation algorithms that identify polynomial degree query sets. Finally, we raise an open question: can such sparsification extend to general integer linear programs with degree independent of problem dimensions?

Keywords and phrases:
Packing Problems, Assignment Problems, Stochastic Selection, Sparsification
Copyright and License:
[Uncaptioned image] © Shaddin Dughmi, Yusuf Hakan Kalayci, and Xinyu Liu; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Packing and covering problems
; Theory of computation Stochastic approximation
Related Version:
Full Version: https://arxiv.org/abs/2512.01240 [14]
Funding:
This paper is based upon work supported by the Air Force Office of Scientific Research under award number FA9550-24-1-0261. Any opinions, findings, and conclusions or recommendations expressed in this document are those of the authors and do not necessarily reflect the views of the United States Air Force.
Editor:
Shubhangi Saraf

1 Introduction

The sparsification of stochastic packing problems has emerged as a fundamental paradigm for designing algorithms that achieve near-optimal solutions with limited access to uncertain data. This approach proves particularly valuable in settings where probing or querying elements incurs costs or faces constraints. Recent developments in sparsification of stochastic packing problems have revealed elegant techniques for selecting the most pertinent information to probe.

Our goal in this paper is to expand the sparsification toolbox beyond well-studied matching settings [1, 3, 4, 5, 6, 7, 8, 12, 13, 23] and matroid optimization problems [15, 20, 23] to design sparsifiers for knapsack-type constraints.

We adopt the general framework of Dughmi et al. [15] for a packing problem instance E,,f, where E is a ground set of elements, 2E is a downward-closed family of feasible sets, and f:2E0 is an objective function. In our stochastic setting, each element eE becomes active independently with probability p(0,1], resulting in a random active set RE. A sparsification algorithm selects a query set QE prior to observing R, aiming to maximize the solution value within the revealed subset QR.

For assignment problems like MKP and GAP, solutions are typically defined as sets of item-knapsack pairs (assignments) rather than simple subsets of items. To align with our sparsification framework, we project these problems onto the ground set of items E. We say a subset of items SE is feasible (S) if there exists a valid assignment of items in S to knapsacks that respects all capacity constraints. Accordingly, we extend the objective function to item sets by defining f(S) as the maximum value achievable by any feasible assignment of the items in S.

To rigorously evaluate sparsification algorithms, we must balance approximation quality against the “size” of the query set. While approximation is defined as usual, quantifying the size of Q for knapsack-type problems requires nuance. Traditional cardinality-based measures – which normalize |Q| by the rank of – fail when feasible sets vary dramatically in size, as in capacity-constrained problems. To address this, we introduce the polyhedral sparsification degree. Let 𝒫=conv({𝟏S:S}) be the polytope of feasible solutions. We define the degree of a query set Q as the minimum scalar d1 such that the normalized indicator vector 1d𝟏Q lies within 𝒫. This definition naturally generalizes existing notions111Sparsification in stochastic integer packing was introduced by Blum et al. [8] using vertex degree, and later generalized by Maehara and Yamaguchi [20, 23] to cardinality-based measures. by capturing the intuitive notion of redundancy: a query set has degree d if it can be decomposed into d (fractionally) feasible solutions.

Definition 1 (Sparsifier).

An algorithm 𝒜 is an α-approximate sparsifier with degree d if, for every problem instance, it returns a (possibly randomized) query set QE that satisfies two conditions:

  1. 1.

    Polyhedral Feasibility: the indicator vector of the query set lies within the polytope scaled by d, in other words 1d𝟏Q𝒫 (holding for every realization of Q);

  2. 2.

    Approximation Guarantee: the expected value of the optimal solution within the queried active elements approximates the full-information optimum, such that

    𝔼R,Q[max{f(S):S2QR}]α𝔼R[OPT].

1.1 Our contributions

Our main result establishes that knapsack-type problems admit effective sparsification despite their computational hardness. We design deterministic and non-adaptive algorithms that produce (1ϵ)-approximate sparsifiers with polyhedral degree polynomial in 1/p and 1/ϵ, remarkably independent of the number of items or constraints. Unlike some prior work [20, 23], we require our degree to be independent of the total number of variables and constraints.222To be clear, our definition of degree implicitly allows the number of queries to scale with the cardinality of a typical solution. Our pursuit of constant degree (independent of the number of items or constraints) is akin to requiring “redundancy” on the order of a constant number of solutions, as a hedge against uncertainty.

Informal Theorem (Main Result).

For parameters ϵ(0,1/6) and p(0,1], there exist efficient algorithms that produce a (1O(ϵ))-approximate sparsifier for the stochastic Knapsack, Multiple Knapsack, and Generalized Assignment Problems with sparsification degree poly(1/ϵ,1/p).

For the single knapsack problem, our approach employs a bucketization strategy combined with a charging argument. Items are partitioned into buckets based on value, and each bucket is filled to approximately poly(1/p,1/ϵ) times the knapsack capacity. This redundancy allows for a substitution mechanism: if an optimal item is not queried, it can likely be replaced by a queried item from the same bucket. Feasibility is maintained by prioritizing items with smaller weights, with a refined density-based strategy for the smallest value bucket.

Extending this to the Generalized Assignment Problem (GAP) presents a fundamental obstacle: item characteristics are knapsack-dependent, breaking the direct substitutability essential to the single knapsack case. An item ideal for one knapsack may be highly inefficient for another. We overcome this by increasing redundancy – filling buckets to poly(1/p,1/ϵ)(1/ϵ) capacity – and developing a sophisticated charging argument. When an optimal item cannot be directly substituted (often because potential substitutes are assigned elsewhere), we fractionally distribute its lost value across multiple queried elements. This ensures that we recover nearly the full optimal value without overburdening any specific element in the analysis.

1.2 Implications and experiments

We turn to the deterministic setting (i.e., p=1) to reflect on complexity-theoretic implications and practical impact. Our results reveal an intriguing separation: while GAP is APX-hard and MKP lacks an FPTAS, their stochastic counterparts admit efficient (1ϵ)-approximate sparsifiers with polynomial degree. From the Exponential Time Hypothesis [18], one would informally expect that the “hard” instances are already sparse, whereas “easy” instances may be more dense and amenable to sparsification. It is on those dense non–worst-case instances where our sparsifiers shrink the search space. This can serve as a useful preprocessing step for heuristic algorithms, guiding them to pertinent variables, even in the deterministic setting with p=1.

Empirically, we validate the utility of our approach on synthetic datasets, using practical choices of hyperparameters (α,τ,ϵ,K) that are less conservative than the theoretical settings needed to ensure worst-case, high-probability guarantees. These practical choices result in sparsifiers with significantly smaller degree than the theoretical degree guaranteed by our theorem, and on instances where the total number of items exceeds the optimal solution size by a factor of four, our sparsification algorithm reduces runtime by 4× while preserving 99% of the solution quality. Furthermore, under fixed time budgets, branch-and-bound algorithms running on our sparsified instances outperform those running on full datasets by a factor of 5 in objective value. We present a summary of these results in Figure 1 and refer the reader to the full version of this paper for a detailed discussion [14].

Refer to caption
Figure 1: Performance comparison of three Gurobi-based GAP solving strategies: (A) full ILP; (B) sparsifier followed by ILP on the reduced instance; and (C) full ILP with early stopping matched to the runtime of (B). Experiments cover n{1000,2000,5000,10000} and m=2. We report two metrics against realized redundancy (ratio of total items to optimal solution size): (i) Speed-up Ratio: Runtime of (A) divided by (B), where (B) maintains a 0.99-approximation; and (ii) Efficiency Ratio: Objective value of (B) divided by (C). The top row presents a scatter plot of speed-up ratios for individual instances overlaid with a rolling median. The bottom row illustrates the distribution of efficiency ratios within redundancy buckets, annotated with bucket medians and means as well as sample counts.

1.3 Future directions

Finally, our work motivates a broader question regarding integer linear programs (ILPs). Current sparsifiers for general ILPs [23] depend on problem dimensions or column sparsity. This leaves open a fundamental challenge:

Open Question.

Can we design (1ϵ)-approximate sparsifiers for general integer linear programs where the sparsification degree scales polynomially with 1/p, 1/ϵ, and intrinsic structural parameters, but remains independent of the total number of variables and constraints?

Resolving this would significantly advance the understanding of information requirements in stochastic optimization.

1.4 Related Works

Sparsification for stochastic packing was pioneered by Blum et al. [8] for matching. This work initiated a broad sequence of improvements in approximation bounds and query complexity for stochastic matching [1, 2, 3, 6, 7, 13, 15] and stochastic vertex cover [4, 12]. Maehara and Yamaguchi generalized this framework to stochastic packing integer programs [23] and submodular maximization [20], providing non-adaptive sparsifiers whose degree, however, depended on the universe size. Subsequently, Dughmi et al. [15] achieved dimension-independent sparsifiers for matroids.

In the deterministic setting, the Knapsack problem admits fully polynomial-time approximation schemes (FPTAS), with recent algorithms achieving near-linear time [11, 17, 21]. The Multiple Knapsack Problem (MKP) is strictly harder; Chekuri and Khanna [10] demonstrated that it admits a PTAS but not an FPTAS. The Generalized Assignment Problem (GAP) is APX-hard [9], with the state-of-the-art approximation ratio of 11/e+ε established by Feige and Vondrák [16]. For a detailed survey of related works see full version of the paper [14].

2 Stochastic Assignment Problems

In this section, we formally define the deterministic assignment problems addressed in this work – Knapsack, Multiple Knapsack, and Generalized Assignment – and their stochastic counterparts. Throughout our discussion, we use the terms “knapsack” and “bin” interchangeably.

2.1 Problem Definitions

We begin with the classical single-bin setting and progressively generalize to multiple heterogeneous constraints.

Problem 1 (Knapsack Problem (KP01)).

Consider a single knapsack with capacity C and a collection of n items denoted by E. Each item iE is characterized by a value vi and a weight wi. The objective is to select a subset of items that maximizes total value while respecting the capacity constraint:

maxiSvisubject toiSwiC,S[n].
Problem 2 (Multiple Knapsack Problem (MKP)).

Consider m knapsacks where knapsack j[m] has capacity Cj, and n items E where each item iE has value vi and weight wi. The objective is to assign items to the knapsacks to maximize total value while ensuring no knapsack exceeds its capacity. Formally, we seek disjoint subsets SjE for j[m] such that:

maxj=1miSjvisubject toiSjwiCjfor all j[m].
Problem 3 (Generalized Assignment Problem (GAP)).

Consider m knapsacks where knapsack j[m] has capacity Cj, and n items E. In contrast to the previous problems, each item iE exhibits knapsack-dependent characteristics: when assigned to knapsack j, item i contributes value vij and consumes weight wij. The objective is to find disjoint subsets SjE for j[m] that maximize total value subject to capacity constraints:

maxj=1miSjvijsubject toiSjwijCjfor all j[m].

2.1.1 Stochastic Variants

For any deterministic instance Π defined above, its stochastic variant Π,p is characterized by a parameter p(0,1]. A random subset RE, termed the active set, is generated by sampling each element eE independently with probability p. The goal is to select a feasible solution using only the items present in the realization R to maximize the objective value.

2.1.2 Assumptions

Without loss of generality, we assume that every individual item is feasible. That is, for every item iE, there exists at least one knapsack j such that the item’s weight fits within the capacity (wijCj).

2.2 Notation and Feasibility

We distinguish between items and assignments using non-bold and bold notation, respectively.

  • Assignments (𝐒): We denote a specific assignment as 𝐒E×[m], where pairs (i,j)𝐒 indicate that item i is assigned to knapsack j. For a solution to be valid, each item must appear in at most one pair. We define the total value v(𝐒)=(i,j)𝐒vij and the weight consumed in knapsack j as wj(𝐒)=(i,j)𝐒wij.

  • Item Sets (S): When SE denotes a subset of the ground set, it refers purely to the items themselves. We abuse notation slightly in the context of GAP: for a subset of items S implicitly assigned to a specific knapsack j, we write wj(S)=iSwij.

A crucial distinction in our framework is the definition of feasibility for item sets. While the optimization problems maximize over assignments 𝐒, our sparsification framework operates on the ground set E. We say that an item set SE is feasible if there exists a valid assignment 𝐒 such that the set of assigned items is exactly S (i.e., S={ij,(i,j)𝐒}). Consequently, the feasibility family used to define the polytope 𝒫 consists of all such feasible item sets. Therefore, the condition for sparsification degree, 𝟏Qd𝒫, is a constraint on the query set Q in the item space. The specific assignment 𝐒 is determined only after the intersection of the query set and active set, QR, is revealed.

2.3 Hardness and Approximability

The computational complexity of these problems forms a natural hierarchy. The classical knapsack problem, which was proven NP-hard by Karp [19], admits a fully polynomial-time approximation scheme (FPTAS) [11, 17, 21]. However, the Multiple Knapsack Problem (MKP), even when restricted to just two knapsacks, does not admit an FPTAS [10]. The Generalized Assignment Problem (GAP) is APX-hard; Chakrabarty and Goel [9] demonstrated that it cannot be approximated better than a factor of 10/11 unless P=NP. The current best polynomial-time approximation algorithm for GAP achieves a ratio of 11/e+ε for a small constant ε>0 [16].

3 Warm-up: Knapsack Sparsification

We begin with a sparsification algorithm for the classical knapsack problem. This foundational case introduces key techniques that will be extended to more complex scenarios throughout the paper.

The algorithm employs a bucket-based strategy that partitions elements by value into geometrically increasing ranges. The fundamental principle ensures that the queried subset of items in each bucket is sufficiently large to either contain all items within the bucket or independently fill the knapsack constraint with high probability. In the former case, all elements remain available in the query set, ensuring that no item from the optimal solution is missed. In the latter scenario, the objective is to guarantee that whenever an item from the optimal solution is unavailable in the query set, a suitable substitute can be found.

To achieve this, the algorithm applies distinct selection criteria: for low-value elements (bucket B0), it prioritizes items with high value-to-weight density, while for high-value buckets (Bk with k1), it selects the lightest elements to maximize the probability of accommodating valuable items within capacity constraints.

Algorithm 1 Bucket-Based Sparsifier for Knapsack.

Before we proceed with proving that Algorithm 1 is a good sparsifier, we first establish a key concentration result for our sparsifier analysis. The proof follows from standard concentration inequalities and is given in the full version [14].

Lemma 2 (Activation Weight Concentration).

Let SE be a set of elements, each with weight wi, such that

iSwiτ(ϵ)pC,

where τ(ϵ):=1+ln(1/ϵ)+ln2(1/ϵ)+2ln(1/ϵ). Then, if each item is active independently with probability p, the total weight of active items in S is at least C with probability at least 1ϵ.

Theorem 3 (Knapsack Sparsifier Performance).

For parameters ϵ(0,1/3) and p(0,1], Algorithm 1 produces a (14ϵ)-approximate sparsifier for the stochastic knapsack problem with sparsification degree

O(log(1/ϵ)log(1/(ϵp))ϵp).
Proof.

Let M denote our (1±ϵ)-approximation to 𝔼R[OPT], satisfying (1ϵ)𝔼R[OPT]M(1+ϵ)𝔼R[OPT] with probability at least 1ϵ. Let est be the event that this inequality holds and so M is estimated within (1±ϵ) approximation. Condition on the event est holds.

Sparsification Degree Analysis

We first bound the size of the query set Q. The algorithm selects at most K+1 buckets. For each bucket B¯k, the total weight is bounded by iB¯kwiCτ(ϵ)p+maxiwiC(τ(ϵ)p+1). Summing over all K=O(1ϵlog(1ϵp)) buckets, the total weight of the query set satisfies:

w(Q)=k=0Kw(B¯k)O(τ(ϵ)pK)C.

To translate this weight bound into our polyhedral sparsification degree, we consider the linear programming relaxation of the knapsack polytope, 𝒫LP={x[0,1]ExiwiC}. Our calculation shows that 𝟏Qd𝒫LP for d=O(w(Q)C). However, the sparsification degree requires embedding into the convex hull of integer solutions, 𝒫. We know that the integrality gap of the knapsack relaxation is bounded by 2 (assuming singletons are feasible) [22]. Therefore, 𝒫LP2𝒫, implying that the sparsification degree is at most 2d, which remains O(log(1/ϵ)log(1/(ϵp))ϵp).

Approximation Analysis

Consider any realization RE and let SR denote an optimal solution with value OPT(R)=iSvi and weight w(S)C.

We partition the optimal solution as S=S0S1SK where Sk=SBk, and define Slow=S0 (low-value items) and Shigh=k=1KSk (high-value items). Completeness of this partition follows from the range of buckets. Since each item i is active with probability p, 𝔼[OPT]pvi, implying vi𝔼[OPT]/p. Our largest bucket boundary is at least M/p=𝔼[OPT]/p, ensuring all items are covered.

High-Value Item Recovery.

For each bucket k1, let Qk=B¯kR represent the active queried items. By Lemma 2, we have w(Qk)C with the probability of at least 1ϵ when w(Bk¯) is sufficiently large (equivalently when B¯kBk). Define the event k as B¯k=Bk or w(Qk)C.

Conditioning on this event k, since B¯k contains the lightest items in Bk, we can establish a matching ϕk:SkQk such that each item iSk maps to some ϕk(i)Qk with wiwϕk(i) and vi(1+ϵ)vϕk(i) (due to items being in the same value bucket). Notice that such a matching trivially exists when B¯k=Bk. This matching implies:

𝔼R[maxTkQkw(Tk)w(Sk)v(Tk)k]11+ϵ𝔼R[v(Sk)].

Since Pr[k](1ϵ), we obtain:

𝔼R[maxTkQkw(Tk)w(Sk)v(Tk)](1ϵ)11+ϵ𝔼R[v(Sk)](12ϵ)𝔼R[v(Sk)], (1)

where the final inequality uses 1/(1+ϵ)1ϵ for small ϵ.

Low-Value Item Recovery.

For bucket B0, we apply greedy selection on B¯0R by value density up to a total capacity of w(S0):=iS0wi. Let T0 denote this greedy solution.

Each item in B0 has value at most ϵM. When est holds, the maximum value in B0 is at most ϵ(1+ϵ)𝔼R[OPT]2ϵ𝔼R[OPT]. By fractional knapsack analysis, the greedy algorithm achieves value within 2ϵ𝔼R[OPT] of the fractional optimum:

𝔼R[v(T0)est]𝔼R[v(S0)est]2ϵ𝔼R[OPT].

Since Pr[est]1ϵ:

𝔼R[v(T0)](1ϵ)𝔼R[v(S0)]2ϵ𝔼R[OPT].
Final Approximation Bound.

Combining our bounds for high-value and low-value items, let Tk denote the maximum-value feasible subset of Qk with w(Tk)w(Sk) for each k1, and define T=k=0KTk. Then:

𝔼R[v(T)] =k=0K𝔼R[v(Tk)]
(1ϵ)𝔼R[v(S0)]2ϵ𝔼R[OPT]+(12ϵ)k=1K𝔼R[v(Sk)]
=(12ϵ)𝔼R[v(S)]2ϵ𝔼R[OPT]
(14ϵ)𝔼R[OPT].

Finally, since w(Tk)w(Sk) for each k, we have w(T)=k=0Kw(Tk)k=0Kw(Sk) =w(S)C, so T is feasible.

4 Sparsifier for the General Assignment Problem

We now extend our sparsification framework to the Generalized Assignment Problem (GAP), which encompasses the Multiple Knapsack Problem as a special case.

4.1 Key Challenges and Algorithmic Innovations

Extending our knapsack sparsifier to the GAP presents fundamental challenges that require a complete algorithmic redesign. The core difficulty stems from knapsack-dependent item characteristics, which destroy the substitutability properties essential to our knapsack analysis.

In the knapsack problem, items have fixed values vi and weights wi, enabling a global bucketing scheme where items with similar characteristics substitute seamlessly. GAP breaks this structure: items exhibit knapsack-specific parameters (vij,wij), so an item valuable for one knapsack may be worthless for another. This forces us to maintain separate buckets Bj,k for each knapsack-bucket pair, immediately complicating the design.

The main challenge arises from cross-knapsack substitutability issue. Two items may belong to the same bucket for knapsack j due to similar values vij, yet reside in different buckets for knapsack j due to vastly different values vij. When our sparsifier fills bucket Bj,k based on suitability for knapsack j, these items fail as substitutes if the optimal solution assigns corresponding items to different knapsacks. This dependency fundamentally breaks the matching argument underlying our knapsack analysis.

We address this through enhanced redundancy combined with a more involved charging argument. Our GAP sparsifier fills each bucket to poly(1/ϵ) times the knapsack capacity, creating substantial redundancy in the query set. When an optimal item i assigned to knapsack j is missing from the query set, we first seek a direct substitute among queried items with similar weight and value characteristics for knapsack j. When direct substitution fails – typically because suitable substitutes are assigned to different knapsacks in the optimal solution – we leverage the redundancy to fractionally charge value vij across poly(1/ϵ) other queried items. This ensures no queried item receives excessive charge (at most 1+poly(ϵ) times its own value) while recovering nearly the optimal value.

A secondary challenge is ensuring the completeness of the bucket structure. In the knapsack setting, 𝔼R[OPT]/p provides a natural upper bound for feasible item values. In GAP, however, an item i may be active with probability p, yet appear in a specific knapsack j’s optimal assignment with significantly lower probability, making localized value bounds difficult to establish.

To address this, we introduce a super bucket for each knapsack with no upper bound on its value range. While items in this bucket may have arbitrarily large values and lack mutual substitutability, we prove a surprising property: even if the reconstruction algorithm makes no attempt to substitute for missed items in the super bucket, the aggregate loss remains globally bounded.

4.2 Algorithm Design

Our GAP sparsifier employs a bucket-based approach that incorporates substantial redundancy to handle cross-knapsack dependencies. The complete procedure is presented in Algorithm 2.

Algorithm 2 Bucket-Based Sparsifier for GAP.

Beyond the algorithmic complexities discussed above, our GAP sparsifier requires access to knapsack-level value estimates. This presents an additional challenge compared to the knapsack setting, where estimating the global expectation 𝔼R[OPT] suffices for bucket boundary determination. In GAP, assignment decisions are interdependent across knapsacks, creating a more complex estimation problem.

Formally, for each realization R of the active set, let 𝒪𝒫𝒯(R) denote the set of all optimal feasible GAP assignments on R. We fix once and for all an arbitrary but deterministic tie-breaking rule that selects a canonical optimal assignment 𝐎𝐏𝐓(R)𝒪𝒫𝒯(R). We then define OPT(R) as the total value of assignment 𝐎𝐏𝐓(R) and OPTj(R) as the total value of items assigned to knapsack j in 𝐎𝐏𝐓(R), so that

OPT(R)=j=1mOPTj(R).

Although the individual quantities OPTj(R) may vary with the choice of tie-breaking rule, the equality above implies that

j=1m𝔼R[OPTj(R)]=𝔼R[OPT(R)],

and thus the aggregate contribution across knapsacks is invariant. The relative contribution of each knapsack can still vary substantially across different realizations and approximate solutions, which makes estimating the individual knapsack contributions 𝔼R[OPTj] from global information alone highly challenging.

To address this issue, we assume oracle access to the expected knapsack-level optima 𝔼R[OPTj] for all j[m]. Under this assumption, we establish the following performance guarantee:

Theorem 4 (GAP Sparsifier).

For parameters ϵ(0,1/6) and p(0,1], assume oracle access to the expected knapsack optima 𝔼R[OPTj] for each knapsack j[m]. Then Algorithm 2 produces a (16ϵ)-approximate sparsifier for the stochastic GAP problem with sparsification degree

O(log2(1/ϵ)ϵ3p).

Since the Multiple Knapsack Problem is a special case of GAP, we obtain the following immediate corollary:

Corollary 5 (Multiple Knapsack Sparsifier).

Under the same oracle assumption, Algorithm 2 produces a (16ϵ)-approximate sparsifier for the stochastic Multiple Knapsack problem, with sparsification degree

O(log2(1/ϵ)ϵ3p).

4.3 Relaxing Oracle Assumptions

In practice, obtaining precise offline computations of each 𝔼R[OPTj] may be infeasible. We therefore analyze the robustness of our algorithm under weaker information settings.

4.3.1 Approximate Oracle Access

Given a β-approximation to the total stochastic optimum OPT, we can estimate each 𝔼R[OPTj] via expected marginal contributions of knapsacks in the approximate solution. Using these estimates, Algorithm 2 achieves a β(16ϵ)-approximation with the same sparsification degree bound. The analysis remains identical to Theorem 4, using the β-approximate assignment as the benchmark for the charging argument.

4.3.2 Global Oracle Access

A plausible scenario is having access to the global expectation 𝔼R[OPT] (or a constant factor estimate thereof) without granular knapsack-level details. In this case, we can uniformly distribute the expectation by setting Mj=𝔼R[OPT]/m for all j. This forces the algorithm to cover a wider range of potential values per knapsack, introducing a logarithmic dependence on m in the sparsification degree.

Intuitively, the contribution of any specific knapsack j lies somewhere between a uniform share (𝔼R[OPT]/m) and the total value (𝔼R[OPT]). To ensure we capture the relevant items regardless of how the optimal solution distributes value, we set the minimum value threshold Mj based on the uniform lower bound 𝔼R[OPT]/m. Consequently, the bucket hierarchy for every knapsack must span the expansive range from this uniform average up to the global maximum. This widens the value range by a factor of m, which, due to the geometric progression of bucket boundaries, incurs a logarithmic penalty in the number of buckets.

Corollary 6.

Assume oracle access to the expected global optimum 𝔼R[OPT]. Then the modified version of Algorithm 2 with Mj=𝔼R[OPT]/m and K:=2ϵ2log(mϵ3) is a (16ϵ)-sparsifier with degree O(log2(1/ϵ)log(m)ϵ3p).

5 Analysis of GAP Sparsifier

Before beginning the analysis, we briefly recall the relevant notation. Non-bold symbols (e.g., S) denote sets of items, whereas bold symbols (e.g., 𝐒) denote assignment solutions, represented as sets of item–knapsack pairs. For each realization R of the active set, we previously introduced a canonical optimal assignment 𝐎𝐏𝐓(R) via a deterministic tie-breaking rule. This choice is used solely for analysis; the sparsification algorithm (Algorithm 2) never requires access to 𝐎𝐏𝐓(R) for any individual R. For simplicity of notation, throughout this section we omit the dependence on R and write 𝐎𝐏𝐓.

With this notation in place, our analysis centers on a reconstruction algorithm that conceptually simulates 𝐎𝐏𝐓 while constructing a feasible assignment 𝐀𝐋𝐆 using only queried active items. The reconstruction processes buckets (j,k) sequentially, maintaining a partial assignment 𝐎𝐏𝐓¯ that incrementally grows toward 𝐎𝐏𝐓.

Algorithm 3 ReconstructionProcedure.

The reconstruction algorithm employs three specialized subroutines. FillLargeBucket, for 1kK, replaces missed high-value items with lighter alternatives. FillSmallBucket, for k=0, uses density-based substitution for low-value items. FillAllSuperBuckets, for k=K+1, performs no substitutions and simply inserts each queried item using its original assignment while discarding all missed items.

Before providing definitions of these subroutines, we first state some desired properties of these subroutines and hence our ReconstructionProcedure. Based on these properties, we first prove the main result of this section in Section 5.1. Later, Section 6 will be devoted to formal definitions of subroutines, FillLargeBucket, FillSmallBucket, and FillAllSuperBuckets, as well as proofs of their desired properties.

To formally track the capacity usage and value gain during reconstruction, we define the total weight and value contributed to each knapsack by the subroutine calls in ReconstructionProcedure. Consider an assignment 𝐒{𝐀𝐋𝐆,𝐎𝐏𝐓¯}. For a single call to either FillSmallBucket or FillLargeBucket, we define:

  • Δwj(𝐒): for each knapsack j[m], the increase in the total weight assigned to j in 𝐒, namely the sum of wij over all item–knapsack pairs (i,j) that are added to 𝐒 during this call;

  • Δv(𝐒): the increase in the total value of 𝐒 across all knapsacks, namely the sum of vij over all pairs (i,j) that are added to 𝐒 during this call.

Feasibility

The ReconstructionProcedure maintains feasibility through three key properties: (1) each call to the procedure adds only queried active items to 𝐀𝐋𝐆, ensuring that 𝐀𝐋𝐆QR at all times; (2) no item is ever assigned more than once within either solution: once an item appears in 𝐀𝐋𝐆 (respectively, 𝐎𝐏𝐓¯), it is never reassigned within that same solution; and (3) for every knapsack j, the total weight assigned in 𝐀𝐋𝐆 never exceeds that in 𝐎𝐏𝐓¯, ensuring that capacity constraints remain satisfied throughout. Lemmas 7, 8, and 9 formally establish these properties for large, small, and super buckets, respectively.

Lemma 7 (Feasibility in Large Buckets).

When FillLargeBucket is called for knapsack j and bucket k, the procedure assigns only queried active items to 𝐀𝐋𝐆, and no item already appearing in 𝐀𝐋𝐆 (respectively, 𝐎𝐏𝐓¯) is ever reassigned within that same solution. Moreover, for every knapsack j[m],

Δwj(𝐀𝐋𝐆)Δwj(𝐎𝐏𝐓¯).
Lemma 8 (Feasibility in Small Buckets).

When FillSmallBucket is called for knapsack j and bucket k, the procedure assigns only queried active items to 𝐀𝐋𝐆, and no item already appearing in 𝐀𝐋𝐆 (respectively, 𝐎𝐏𝐓¯) is ever reassigned within that same solution. Moreover, for every knapsack j[m],

Δwj(𝐀𝐋𝐆)Δwj(𝐎𝐏𝐓¯).
Lemma 9 (Feasibility in Super Buckets).

When FillAllSuperBuckets is called, the procedure assigns only queried active items to 𝐀𝐋𝐆, and no item already appearing in 𝐀𝐋𝐆 (respectively, 𝐎𝐏𝐓¯) is ever reassigned within that same solution. Moreover, for every knapsack j[m],

Δwj(𝐀𝐋𝐆)Δwj(𝐎𝐏𝐓¯).
Approximation

The ReconstructionProcedure adds new item–knapsack assignments to both 𝐎𝐏𝐓¯ and 𝐀𝐋𝐆 in such a way that the total value of the new assignments added to 𝐀𝐋𝐆 closely tracks that of the new assignments added to 𝐎𝐏𝐓¯. This ensures that, throughout the reconstruction process, the value of 𝐀𝐋𝐆 remains a good approximation to the value of 𝐎𝐏𝐓¯. The following three lemmas prove this property for large-value, small-value, and super-value buckets, respectively.

Lemma 10 (Approximation Guarantee in Large Buckets).

When FillLargeBucket is called for knapsack j and bucket k, the following inequality holds:

𝔼R[Δv(𝐀𝐋𝐆)](12ϵ)Δv(𝐎𝐏𝐓¯).
Lemma 11 (Approximation Guarantee in Small Buckets).

When FillSmallBucket is called for knapsack j and bucket k, the inequality

𝔼R[Δv(𝐀𝐋𝐆)](12ϵ)Δv(𝐎𝐏𝐓¯)ϵ2Mj

holds, where Mj=𝔼R[OPTj] denotes the expected contribution of knapsack j to the optimal assignment.

Lemma 12 (Approximation Guarantee in Super Buckets).

Assume 0<ϵ1/2. When FillAllSuperBuckets is called, the following inequality holds:

𝔼R[Δv(𝐎𝐏𝐓¯)]𝔼R[Δv(𝐀𝐋𝐆)]3ϵ𝔼R[v(𝐎𝐏𝐓)].
Correct Benchmark

Finally, to demonstrate that the final output 𝐀𝐋𝐆 is a good approximation of 𝐎𝐏𝐓, we ensure that ReconstructionProcedure terminates with 𝐎𝐏𝐓¯=𝐎𝐏𝐓. The following lemma establishes this property:

Lemma 13 (Completeness).

Upon completion of ReconstructionProcedure (Algorithm 3), we have 𝐎𝐏𝐓¯=𝐎𝐏𝐓.

Now, we are ready to prove the main result of this section using these properties. Formal definitions of subroutines FillSmallBucket, FillLargeBucket, and FillAllSuperBuckets, as well as proofs of Lemmas 7-13 will be provided in Section 6.

5.1 Proof of Theorem 4

We now prove the main result of this section using the lemmas stated above.

Proof of Theorem 4.

Fix any realization RE.

We first bound the size of the query set by analyzing the total weight selected for each knapsack. Algorithm 2 maintains K=2ϵ2log(1ϵ3)=O(1ϵ2log1ϵ) buckets per knapsack and iterates for α=1/ϵ rounds. In each specific round t and bucket (j,k), the algorithm selects items with a total weight of at most (τ(ϵ2)p+1)Cj, where the +1 accounts for the discrete weight of the final item. Aggregating over all rounds and buckets, the total weight implicitly associated with knapsack j is bounded by:

wj(Q)αKO(τ(ϵ2)p)Cj=O(log2(1/ϵ)ϵ3p)Cj

This weight bound establishes that the indicator vector 𝟏Q lies within the natural linear programming relaxation of the problem, scaled by a factor dLP=O(log2(1/ϵ)ϵ3p). To translate this into the required polyhedral sparsification degree (which is defined with respect to 𝒫, the convex hull of integer feasible solutions), we leverage the fact that the integrality gap of the standard linear relaxation for GAP is at most 2 (assuming feasible singletons). This implies polytope of relaxed LP 𝒫LP is contained by 2𝒫. Consequently, the sparsification degree is at most 2dLP, which preserves the asymptotic bound:

d=O(log2(1/ϵ)ϵ3p).
Feasibility

For each procedure call to FillLargeBucket, FillSmallBucket, or FillAllSuperBuckets, let Δwjj,k() denote the weight-change function for knapsack j. Applying Lemmas 79 and summing over all (j,k), we obtain

wj(𝐀𝐋𝐆)=j,kΔwjj,k(𝐀𝐋𝐆)j,kΔwjj,k(𝐎𝐏𝐓¯)=wj(𝐎𝐏𝐓),

where the final equality follows from Lemma 13.

Moreover, Lemma 7 and Lemma 8 ensure that 𝐀𝐋𝐆 includes each item only once and that every item inserted into 𝐀𝐋𝐆 comes from the queried active set QR, guaranteeing that 𝐀𝐋𝐆 is a valid solution after sparsification and realization. Since 𝐎𝐏𝐓 is feasible, the weight domination wj(𝐀𝐋𝐆)wj(𝐎𝐏𝐓) implies that 𝐀𝐋𝐆 is also feasible.

Approximation Guarantee

For each knapsack j and bucket index kK, let Δvj,k denote the value increase function when calling FillLargeBucket or FillSmallBucket. For the super bucket k=K+1, we define Δvj,K+1 analogously as the value contribution of FillAllSuperBuckets for knapsack j. By Lemmas 1013, we have

𝔼R[v(𝐀𝐋𝐆)] =jk=0K𝔼R[Δvj,k(𝐀𝐋𝐆)]+j𝔼R[Δvj,K+1(𝐀𝐋𝐆)] (2)
((12ϵ)jk=0K𝔼R[Δvj,k(𝐎𝐏𝐓¯)]ϵ2jMj)
+(j𝔼R[Δvj,K+1(𝐎𝐏𝐓¯)] 3ϵ𝔼R[v(𝐎𝐏𝐓)]) (3)
(12ϵ)jk=0K+1𝔼R[Δvj,k(𝐎𝐏𝐓¯)]ϵ2jMj 3ϵ𝔼R[v(𝐎𝐏𝐓)] (4)
=(12ϵ)𝔼R[v(𝐎𝐏𝐓)]ϵ2𝔼R[v(𝐎𝐏𝐓)] 3ϵ𝔼R[v(𝐎𝐏𝐓)] (5)
=(12ϵϵ23ϵ)𝔼R[v(𝐎𝐏𝐓)]
(16ϵ)𝔼R[v(𝐎𝐏𝐓)], (6)

where equation (2) follows from linearity of expectation; equation (3) applies Lemmas 10 and 11 to derive the first parenthesized term, and applies Lemma 12 to derive the second parenthesized term; equation (4) rearranges the terms; and equation (5) uses 𝔼R[v(𝐎𝐏𝐓)]=jMj together with Lemma 13. The final inequality holds for all 0<ϵ1/6.

6 Reconstruction Procedures

This section details the ReconstructionProcedure, which incrementally constructs the optimal solution 𝐎𝐏𝐓¯ and a feasible algorithmic solution 𝐀𝐋𝐆 using the queried active elements. We first establish the necessary notation and then analyze the feasibility and approximation guarantees of our reconstruction subroutines.

6.1 Notation and Preliminaries

Optimal Assignment.

Let viOPT denote the value of item i in the optimal solution: viOPT=vij if (i,j)𝐎𝐏𝐓, and 0 otherwise. Throughout the text, we assume that optimal solution is deterministically fixed among feasible solutions satisfying optimality.

Buckets and Query Sets.

We denote by Bj,k the set of item-knapsack pairs (i,j) such that value vij, i.e., the value of item i in bucket j, falling into the k-th value scale for knapsack j. Let B¯j,k,t be the set of active items included to query set in round t, and B¯j,k=tB¯j,k,t be the total set of queried items for this bucket. By construction, these sets are pairwise disjoint across (j,k,t).

Partition of OPT.

We partition the items in 𝐎𝐏𝐓 based on whether they were successfully queried. Note that an item i assigned to j in 𝐎𝐏𝐓 might be queried via a different bucket (j,k).

  • Sj,kqueried:={iiOPTB¯j,k}: Items used by 𝐎𝐏𝐓 that were successfully queried via bucket (j,k).

  • Sj,kmissed:={i(i,j)𝐎𝐏𝐓Bj,k and iQ}: Items assigned to knapsack j in 𝐎𝐏𝐓 falling in bucket Bj,k that were not queried.

This forms a partition: OPT=j,k(Sj,kqueriedSj,kmissed).

6.2 Subroutine Design

We gradually build the solutions 𝐎𝐏𝐓¯ and 𝐀𝐋𝐆, which are initially set to . The reconstruction relies on three subroutines handling High-Value (1kK), Low-Value (k=0), and Super-Value (k=K+1) regimes. In all regimes, if Sj,kmissed=, we simply assign Sj,kqueried to both 𝐎𝐏𝐓¯ and 𝐀𝐋𝐆. If missed items exist, we credit them to 𝐎𝐏𝐓¯ and attempt to find substitutes from B¯j,k for 𝐀𝐋𝐆.

Algorithm 4 FillLargeBucket(𝐎𝐏𝐓¯,𝐀𝐋𝐆,j,k) [Abstracted].
Algorithm 5 FillSmallBucket(𝐎𝐏𝐓¯,𝐀𝐋𝐆,j,k) [Abstracted].
Super-Value Regime.

FillAllSuperBuckets performs no substitution. It assigns Sj,K+1queried to both solutions and Sj,K+1missed only to 𝐎𝐏𝐓¯. While seemingly wasteful, the loss is globally bounded.

6.3 Analysis

Throughout the analysis for each j,k and t, we condition on the Excess Weight Event j,k,t:={wj(B¯j,k,t)Cj}. Whenever Sj,kmissed, the bucket must have exhausted its query capacity. Lemma 2 ensures that Pr[j,k,t]1ϵ2 for each j,k, and t separately, unless all items i with wij<Cj appearing in the pairs (i,j)Bj,k have already been included in the query set. Note that in this latter case, the query set contains all relevant items for this bucket, which implies that the reconstruction can assign exactly the same set of items as the stochastic optimum, making the comparison immediate.

6.3.1 Substitution Availability

Lemma 14 (Substitution Properties).

Conditioned on j,k,t, if Sj,kmissed:

  1. 1.

    BucketFilled: wj(B¯j,k,t)Cj.

  2. 2.

    AlternativeExists: For k0, queried items are lighter (wijwij); for k=0, queried items have higher density (vij/wijvij/wij) where iB¯j,k and iBj,kB¯j,k.

  3. 3.

    SizeMatch: |B¯j,k,t||Sj,kmissed| for k0.

Proof Sketch.

Follows immediately from the greedy selection in Algorithm 2 (selecting lightest/densest items first) and the capacity guarantee provided by j,k,t.

6.3.2 Feasibility

Lemma 7, Lemma 8, and Lemma 9 establish that every subroutine maintains the feasibility of the partial solution 𝐀𝐋𝐆 by ensuring its weight consumption is dominated knapsack-wise by 𝐎𝐏𝐓¯. The following proof sketch summarizes the critical arguments. Specifically, after each subroutine call, the following conditions hold:

  1. (1)

    𝐀𝐋𝐆QR;

  2. (2)

    Each item is assigned at most once;

  3. (3)

    For every knapsack j, the marginal weight increase satisfies Δwj(𝐀𝐋𝐆)Δwj(𝐎𝐏𝐓¯).

Proof Sketch.

Properties (1) and (2) follow immediately from the construction of the bucket sets B¯j,k, which form a disjoint partition of the queried items. We verify Property (3) by inspecting the substitution logic in each regime:

  • Large Buckets: For missed items (Sj,kmissed), 𝐎𝐏𝐓¯ keeps its original assignment. 𝐀𝐋𝐆 either keeps the same items or makes feasibility-preserving substitutions: in Direct Substitution, a missed item i is replaced by a lighter queried item i (wijwij); in Redistribution, 𝐀𝐋𝐆 assigns a subset of the items assigned by 𝐎𝐏𝐓¯, and any reassignment as substitution it makes also satisfies wijwij. For queried items (Sj,kqueried), 𝐀𝐋𝐆 takes the same items or a feasible subset. Thus, in all branches, 𝐀𝐋𝐆 only keeps 𝐎𝐏𝐓¯’s items or replaces them with lighter feasible ones.

  • Small Buckets: The substitution prefix S is explicitly constructed such that its total weight satisfies wj(S)wj(Sj,kmissed). For items not in S or Smissed, 𝐀𝐋𝐆 exactly mirrors 𝐎𝐏𝐓¯.

  • Super Buckets: 𝐀𝐋𝐆 selects a strict subset of the assignments made by 𝐎𝐏𝐓¯, specifically including only the successfully queried items and dropping the missed ones.

Consequently, the capacity constraints are satisfied relative to 𝐎𝐏𝐓¯, ensuring the feasibility of 𝐀𝐋𝐆.

6.3.3 Approximation Guarantees

Here, we will restate lemmas utilized in Section 5.1 and provide their proof sketches.

Lemma 10 (Approximation Guarantee in Large Buckets). [Restated, see original statement.]

When FillLargeBucket is called for knapsack j and bucket k, the following inequality holds:

𝔼R[Δv(𝐀𝐋𝐆)](12ϵ)Δv(𝐎𝐏𝐓¯).
Proof Sketch.

We analyze the value added during the processing of a missed item i.

  • Direct Substitution: We swap i for i. Since they are in the same bucket, vij(1ϵ2)vij.

  • Redistribution: We identify a set of indices T (size α). 𝐎𝐏𝐓¯ makes the assignment {itjt}tT and {ij}. However, 𝐀𝐋𝐆 makes the best feasible assignment of size |T|. By averaging, the least valuable knapsack assignment in the original bundle contributes at most 1/α of the total value. Thus, 𝐀𝐋𝐆 captures at least (11/α) of the value assigned to 𝐎𝐏𝐓¯.

Considering the failure probability of j,k,t, we account for a factor of (1ϵ2)α1ϵ. Setting α=1/ϵ yields the result.

Lemma 11 (Approximation Guarantee in Small Buckets). [Restated, see original statement.]

When FillSmallBucket is called for knapsack j and bucket k, the inequality

𝔼R[Δv(𝐀𝐋𝐆)](12ϵ)Δv(𝐎𝐏𝐓¯)ϵ2Mj

holds, where Mj=𝔼R[OPTj] denotes the expected contribution of knapsack j to the optimal assignment.

Proof Sketch.

If Sj,0missed, consider the set of items in B¯j,0 that our procedure is allowed to reassign to knapsack j. We sort these candidates by ascending opt-value-to-weight ratio and take the maximal prefix S whose total weight fits in the remaining capacity of knapsack j, and such that S contributes more value after reassignment than under its original assignment (see Figure 2 for a visual illustration of this prefix-selection step). By AlternativeExists, every candidate in S has density higher than every missed item. Thus, after reassignment, 𝐀𝐋𝐆 captures the highest-density-with-respect-to-j (11/α) portion of the weight that 𝐎𝐏𝐓¯ assigns in this call. In addition, when defining S we may have to exclude one item that would cause the capacity on j to be exceeded; this “boundary” item i lies in a small bucket and therefore satisfies vijϵ2Mj. Combining these two effects and the failure probability of j,k,t yields Δv(𝐀𝐋𝐆)(11/α)Δv(𝐎𝐏𝐓¯)ϵ2Mj.

Case 1: Green rectangles represent 𝐎𝐏𝐓¯’s value gain, blue rectangles show item values in knapsack j, and yellow rectangles represent 𝐀𝐋𝐆’s value gain. Set SB¯j,k is the largest prefix with wj(S)wj(Sj,kmissed). 𝐀𝐋𝐆 reassigns all items in S to knapsack j, nearly covering the missed set with at most poly(ϵ) loss. The uncovered value (green rectangles) constitutes at most 1α of 𝐎𝐏𝐓¯’s value.
Case 2: In this case, the set SB¯j,k is the largest prefix where vij>viOPT for all iS; items not in S have sufficiently high value, making substitution unnecessary. 𝐀𝐋𝐆 reassigns all items in S to knapsack j. The red line separates green rectangles (below/on line) from yellow rectangles (above line), showing the uncovered portion corresponds to lowest-density items in 𝐎𝐏𝐓¯, constituting at most 1α of 𝐎𝐏𝐓¯’s value.
Figure 2: Visualization of substitution in FillSmallBucket(𝐎𝐏𝐓¯,𝐀𝐋𝐆,j,0). Assume α=5. Each subfigure shows bucket B¯j,0, missed set Sj,0missed, and selected subset SB¯j,0. Items are rectangles with width wij, height v/w, and area representing value. 𝐀𝐋𝐆 substitutes S for Sj,0missed in knapsack j, recovering 45=11α of 𝐎𝐏𝐓¯’s value.
Lemma 12 (Approximation Guarantee in Super Buckets). [Restated, see original statement.]

Assume 0<ϵ1/2. When FillAllSuperBuckets is called, the following inequality holds:

𝔼R[Δv(𝐎𝐏𝐓¯)]𝔼R[Δv(𝐀𝐋𝐆)]3ϵ𝔼R[v(𝐎𝐏𝐓)].
Proof Sketch.

The difference comes exactly from the value of missed super items. Let J be the set of knapsacks with non-empty missed super items. For every jJ, the super bucket must be full (event j,K+1,1 holds). By construction, whenever these queried super items are assigned to knapsack j, each of them has value at least Mj/ϵ. In particular, this implies that the realized contribution of these super items, together with the realized contribution of knapsack j to OPT, already accounts for a substantial portion of the total optimum. Consequently, the expected loss incurred by those missed super items is small relative to the overall expected gain. Summing over all jJ, we obtain that the total value of missed super items across J is bounded by O(ϵ)𝔼[OPT]. See 13

Proof.

The sets Sj,kqueried and Sj,kmissed form a partition of 𝐎𝐏𝐓. The subroutines iterate through all buckets, adding every element of this partition exactly once to 𝐎𝐏𝐓¯.

7 Conclusion

We introduced a polyhedral framework for sparsification that extends beyond uniform structures such as matching and matroids to capacity-constrained problems including knapsack, multiple knapsack, and the generalized assignment problem. Our results demonstrate that despite the inherent hardness of these problems, one can construct (1ϵ)-approximate sparsifiers with degree polynomial in 1/p and 1/ϵ, independent of the problem size. This establishes a clean separation between optimization complexity and sparsification complexity: while exact or near-exact optimization remains intractable, identifying a small query set that preserves optimality up to (1ϵ) is efficiently possible.

More broadly, our work highlights sparsification as a lens for rethinking stochastic combinatorial optimization. The polyhedral notion of degree captures structural redundancy without relying on cardinality, suggesting applications far beyond knapsack-type problems. A central open question remains: can we design size-independent sparsifiers for general integer linear programs, with degree depending only on 1/p, 1/ϵ, and intrinsic structural parameters? Progress on this front would push the boundary of query-efficient optimization and clarify the fundamental role of sparsification in stochastic combinatorial optimization.

References

  • [1] Sepehr Assadi and Aaron Bernstein. Towards a unified theory of sparsification for matching problems. In 2nd Symposium on Simplicity in Algorithms (SOSA 2019), volume 69 of OASIcs, pages 11:1–11:20. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2019. doi:10.4230/OASIcs.SOSA.2019.11.
  • [2] Sepehr Assadi, Sanjeev Khanna, and Yang Li. The stochastic matching problem with (very) few queries. ACM Transactions on Economics and Computation (TEAC), 7(3):16:1–16:19, 2019. doi:10.1145/3355903.
  • [3] Amir Azarmehr, Soheil Behnezhad, Alma Ghafari, and Ronitt Rubinfeld. Stochastic matching via in-n-out local computation algorithms. In Proceedings of the 57th Annual ACM Symposium on Theory of Computing (STOC 2025), pages 1055–1066. ACM, 2025. doi:10.1145/3717823.3718279.
  • [4] Soheil Behnezhad, Avrim Blum, and Mahsa Derakhshan. Stochastic vertex cover with few queries. In Proceedings of the 2022 ACM-SIAM Symposium on Discrete Algorithms (SODA 2022), pages 1808–1846. SIAM, 2022. doi:10.1137/1.9781611977073.73.
  • [5] Soheil Behnezhad and Mahsa Derakhshan. Stochastic weighted matching: (1 - ε)-approximation. In 61st IEEE Annual Symposium on Foundations of Computer Science (FOCS 2020), pages 1392–1403. IEEE, 2020. doi:10.1109/FOCS46700.2020.00131.
  • [6] Soheil Behnezhad, Mahsa Derakhshan, and MohammadTaghi Hajiaghayi. Stochastic matching with few queries: (1 - ε)-approximation. In Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing (STOC 2020), pages 1111–1124. ACM, 2020. doi:10.1145/3357713.3384340.
  • [7] Soheil Behnezhad, Alireza Farhadi, MohammadTaghi Hajiaghayi, and Nima Reyhani. Stochastic matching with few queries: New algorithms and tools. In Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA 2019), pages 2855–2874. SIAM, 2019. doi:10.1137/1.9781611975482.177.
  • [8] Avrim Blum, John P. Dickerson, Nika Haghtalab, Ariel D. Procaccia, Tuomas Sandholm, and Ankit Sharma. Ignorance is almost bliss: Near-optimal stochastic matching with few queries. In Proceedings of the Sixteenth ACM Conference on Economics and Computation (EC 2015), pages 325–342. ACM, 2015. doi:10.1145/2764468.2764479.
  • [9] Deeparnab Chakrabarty and Gagan Goel. On the approximability of budgeted allocations and improved lower bounds for submodular welfare maximization and GAP. SIAM J. Comput., 39(6):2189–2211, 2010. doi:10.1137/080735503.
  • [10] Chandra Chekuri and Sanjeev Khanna. A polynomial time approximation scheme for the multiple knapsack problem. SIAM J. Comput., 35(3):713–728, 2005. doi:10.1137/S0097539700382820.
  • [11] Lin Chen, Jiayi Lian, Yuchen Mao, and Guochuan Zhang. A nearly quadratic-time FPTAS for knapsack. In Proceedings of the 56th Annual ACM Symposium on Theory of Computing (STOC 2024), pages 283–294. ACM, 2024. doi:10.1145/3618260.3649730.
  • [12] Mahsa Derakhshan, Naveen Durvasula, and Nika Haghtalab. Stochastic minimum vertex cover in general graphs: A 3/2-approximation. In Proceedings of the 55th Annual ACM Symposium on Theory of Computing (STOC 2023), pages 242–253. ACM, 2023. doi:10.1145/3564246.3585230.
  • [13] Mahsa Derakhshan and Mohammad Saneian. Query efficient weighted stochastic matching. In 52nd International Colloquium on Automata, Languages, and Programming (ICALP 2025), volume 334 of LIPIcs, pages 67:1–67:20. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2025. doi:10.4230/LIPIcs.ICALP.2025.67.
  • [14] Shaddin Dughmi, Yusuf Hakan Kalayci, and Xinyu Liu. Near-optimal sparsifiers for stochastic knapsack and assignment problems. arXiv, abs/2512.01240, 2025. arXiv:2512.01240.
  • [15] Shaddin Dughmi, Yusuf Hakan Kalayci, and Neel Patel. On sparsification of stochastic packing problems. In 50th International Colloquium on Automata, Languages, and Programming (ICALP 2023), volume 261 of LIPIcs, pages 51:1–51:17. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2023. doi:10.4230/LIPIcs.ICALP.2023.51.
  • [16] Uriel Feige and Jan Vondrák. Approximation algorithms for allocation problems: Improving the factor of 11/e. In 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS 2006), pages 667–676. IEEE Computer Society, 2006. doi:10.1109/FOCS.2006.14.
  • [17] Oscar H. Ibarra and Chul E. Kim. Fast approximation algorithms for the knapsack and sum of subset problems. J. ACM, 22(4):463–468, 1975. doi:10.1145/321906.321909.
  • [18] Russell Impagliazzo and Ramamohan Paturi. On the complexity of k-sat. J. Comput. Syst. Sci., 62(2):367–375, 2001. doi:10.1006/jcss.2000.1727.
  • [19] Richard M. Karp. Reducibility among Combinatorial Problems, pages 85–103. Springer, Boston, MA, 1972. doi:10.1007/978-1-4684-2001-2_9.
  • [20] Takanori Maehara and Yutaro Yamaguchi. Stochastic monotone submodular maximization with queries. CoRR, abs/1907.04083, 2019. arXiv:1907.04083.
  • [21] Xiao Mao. (1ε)-approximation of knapsack in nearly quadratic time. In Proceedings of the 56th Annual ACM Symposium on Theory of Computing (STOC 2024), pages 295–306. ACM, 2024. doi:10.1145/3618260.3649677.
  • [22] David P. Williamson and David B. Shmoys. The Design of Approximation Algorithms. Cambridge University Press, 2011. URL: http://www.cambridge.org/de/knowledge/isbn/item5759340/?site_locale=de_DE.
  • [23] Yutaro Yamaguchi and Takanori Maehara. Stochastic packing integer programs with few queries. In Proceedings of the Twenty-Ninth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA 2018), pages 293–310. SIAM, 2018. doi:10.1137/1.9781611975031.21.