Stability and Recovery for Independence Systems

Authors Vaggos Chatziafratis, Tim Roughgarden, Jan Vondrak

Thumbnail PDF


  • Filesize: 0.63 MB
  • 15 pages

Document Identifiers

Author Details

Vaggos Chatziafratis
Tim Roughgarden
Jan Vondrak

Cite AsGet BibTex

Vaggos Chatziafratis, Tim Roughgarden, and Jan Vondrak. Stability and Recovery for Independence Systems. In 25th Annual European Symposium on Algorithms (ESA 2017). Leibniz International Proceedings in Informatics (LIPIcs), Volume 87, pp. 26:1-26:15, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2017)


Two genres of heuristics that are frequently reported to perform much better on "real-world" instances than in the worst case are greedy algorithms and local search algorithms. In this paper, we systematically study these two types of algorithms for the problem of maximizing a monotone submodular set function subject to downward-closed feasibility constraints. We consider perturbation-stable instances, in the sense of Bilu and Linial [11], and precisely identify the stability threshold beyond which these algorithms are guaranteed to recover the optimal solution. Byproducts of our work include the first definition of perturbation-stability for non-additive objective functions, and a resolution of the worst-case approximation guarantee of local search in p-extendible systems.
  • Submodular
  • approximation
  • stability
  • Local Search
  • Greedy
  • p-systems


  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    PDF Downloads


  1. Margareta Ackerman and Shai Ben-David. Clusterability: A theoretical study. In Artificial Intelligence and Statistics, pages 1-8, 2009. Google Scholar
  2. Haris Angelidakis, Konstantin Makarychev, and Yury Makarychev. Algorithms for stable and perturbation-resilient problems. In Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing, pages 438-451, 2017. Google Scholar
  3. Pranjal Awasthi, Avrim Blum, and Or Sheffet. Center-based clustering under perturbation stability. Information Processing Letters, 112(1):49-54, 2012. Google Scholar
  4. Lars Backstrom, Dan Huttenlocher, Jon Kleinberg, and Xiangyang Lan. Group formation in large social networks: membership, growth, and evolution. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 44-54. ACM, 2006. Google Scholar
  5. Maria-Florina Balcan, Avrim Blum, and Anupam Gupta. Approximate clustering without the approximation. In Proceedings of the twentieth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 1068-1077. Society for Industrial and Applied Mathematics, 2009. Google Scholar
  6. Maria-Florina Balcan and Mark Braverman. Nash equilibria in perturbation resilient games. arXiv preprint arXiv:1008.1827, 2010. Google Scholar
  7. Maria-Florina Balcan, Nika Haghtalab, and Colin White. k-center clustering under perturbation resilience. In 43rd International Colloquium on Automata, Languages, and Programming (ICALP 2016), Leibniz International Proceedings in Informatics (LIPIcs), pages 68:1-68:14. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 2016. URL:
  8. Maria Florina Balcan and Yingyu Liang. Clustering under perturbation resilience. In International Colloquium on Automata, Languages, and Programming, pages 63-74. Springer, 2012. Google Scholar
  9. Shai Ben-David. Computational feasibility of clustering under clusterability assumptions. arXiv preprint arXiv:1501.00437, 2015. Google Scholar
  10. Yonatan Bilu, Amit Daniely, Nati Linial, and Michael Saks. On the practically interesting instances of maxcut. Proceedings of the Symposium on Theoretical Aspects of Computer Science, pages 526-537, 2013. Google Scholar
  11. Yonatan Bilu and Nathan Linial. Are stable instances easy? Combinatorics, Probability and Computing, 21(05):643-660, 2012. Google Scholar
  12. Gruia Calinescu, Chandra Chekuri, Martin Pal, and Jan Vondrak. Maximizing a monotone submodular function subject to a matroid constraint. SIAM Journal on Computing, 40(6):1740-1766, 2011. Google Scholar
  13. Wei Chen, Yajun Wang, and Siyu Yang. Efficient influence maximization in social networks. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 199-208. ACM, 2009. Google Scholar
  14. Vincent Cohen-Addad, Philip N Klein, and Claire Mathieu. Local search yields approximation schemes for k-means and k-median in euclidean and minor-free metrics. In Foundations of Computer Science (FOCS), 2016 IEEE 57th Annual Symposium on, pages 353-364. IEEE, 2016. Google Scholar
  15. Vincent Cohen-Addad and Claire Mathieu. Effectiveness of local search for geometric optimization. In 31st International Symposium on Computational Geometry (SoCG 2015), volume 34 of Leibniz International Proceedings in Informatics (LIPIcs), pages 329-343, Dagstuhl, Germany, 2015. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik. URL:
  16. Vincent Cohen Addad and Chris Schwiegelshohn. On the local structure of stable clustering instances. CoRR, 2017. Google Scholar
  17. Graham Cormode, Howard Karloff, and Anthony Wirth. Set cover algorithms for very large datasets. In Proceedings of the 19th ACM international conference on Information and knowledge management, pages 479-488. ACM, 2010. Google Scholar
  18. Marek Cygan. Improved approximation for 3-dimensional matching via bounded pathwidth local search. In 54th Annual IEEE Symposium on Foundations of Computer Science, FOCS 2013, 26-29 October, 2013, Berkeley, CA, USA, pages 509-518, 2013. Google Scholar
  19. Amit Daniely, Nati Linial, and Michael Saks. Clustering is difficult only when it does not matter. arXiv preprint arXiv:1205.4891, 2012. Google Scholar
  20. David Easley and Jon Kleinberg. Networks, crowds, and markets: Reasoning about a highly connected world. Cambridge University Press, 2010. Google Scholar
  21. Yuval Filmus and Justin Ward. The power of local search: Maximum coverage over a matroid. In STACS'12 (29th Symposium on Theoretical Aspects of Computer Science), volume 14, pages 601-612. LIPIcs, 2012. Google Scholar
  22. Marshall L Fisher, George L Nemhauser, and Laurence A Wolsey. An analysis of approximations for maximizing submodular set functions - ii. In Polyhedral combinatorics, pages 73-87. Springer, 1978. Google Scholar
  23. Martin Fürer and Huiwen Yu. Approximating the k -set packing problem by local improvements. In Combinatorial Optimization - Third International Symposium, ISCO 2014, Lisbon, Portugal, March 5-7, 2014, Revised Selected Papers, pages 408-420, 2014. Google Scholar
  24. David Kempe, Jon Kleinberg, and Éva Tardos. Maximizing the spread of influence through a social network. In Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 137-146. ACM, 2003. Google Scholar
  25. Bernhard Korte and Dirk Hausmann. An analysis of the greedy heuristic for independence systems. Annals of Discrete Mathematics, 2:65-74, 1978. Google Scholar
  26. Jon Lee, Maxim Sviridenko, and Jan Vondrák. Submodular maximization over multiple matroids via generalized exchange properties. In Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques, pages 244-257. Springer, 2009. Google Scholar
  27. Benny Lehmann, Daniel Lehmann, and Noam Nisan. Combinatorial auctions with decreasing marginal utilities. In Proceedings of the 3rd ACM conference on Electronic Commerce, pages 18-28. ACM, 2001. Google Scholar
  28. Jan Karel Lenstra. Local search in combinatorial optimization. Princeton University Press, 2003. Google Scholar
  29. László Lovász. Submodular functions and convexity. In Mathematical Programming The State of the Art, pages 235-257. Springer, 1983. Google Scholar
  30. Konstantin Makarychev, Yury Makarychev, and Aravindan Vijayaraghavan. Bilu-linial stable instances of max cut and minimum multiway cut. In Proceedings of the Twenty-Fifth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA'14, pages 890-906, Philadelphia, PA, USA, 2014. Society for Industrial and Applied Mathematics. Google Scholar
  31. Julián Mestre. Greedy in approximation algorithms. In European Symposium on Algorithms, pages 528-539. Springer, 2006. Google Scholar
  32. Matúš Mihalák, Marcel Schöngens, Rastislav Šrámek, and Peter Widmayer. On the complexity of the metric tsp under stability considerations. In International Conference on Current Trends in Theory and Practice of Computer Science, pages 382-393. Springer, 2011. Google Scholar
  33. Elchanan Mossel and Sebastien Roch. On the submodularity of influence in social networks. In Proceedings of the thirty-ninth annual ACM symposium on Theory of computing, pages 128-134. ACM, 2007. Google Scholar
  34. George L Nemhauser, Laurence A Wolsey, and Marshall L Fisher. An analysis of approximations for maximizing submodular set functions - i. Mathematical Programming, 14(1):265-294, 1978. Google Scholar
  35. Noam Nisan and Amir Ronen. Computationally feasible vcg mechanisms. J. Artif. Intell. Res.(JAIR), 29:19-47, 2007. Google Scholar
  36. Rafail Ostrovsky, Yuval Rabani, Leonard J Schulman, and Chaitanya Swamy. The effectiveness of lloyd-type methods for the k-means problem. In Foundations of Computer Science, 2006. FOCS'06. 47th Annual IEEE Symposium on, pages 165-176. IEEE, 2006. Google Scholar
  37. César Rego, Dorabela Gamboa, Fred Glover, and Colin Osterman. Traveling salesman problem heuristics: leading methods, implementations and latest advances. European Journal of Operational Research, 211(3):427-441, 2011. Google Scholar
  38. Joachim Reichel and Martin Skutella. Evolutionary algorithms and matroid optimization problems. In Proceedings of the 9th annual conference on Genetic and evolutionary computation, pages 947-954. ACM, 2007. Google Scholar
  39. Lev Reyzin. Data stability in clustering: A closer look. In International Conference on Algorithmic Learning Theory, pages 184-198. Springer, 2012. Google Scholar
  40. Maxim Sviridenko and Justin Ward. Large neighborhood local search for the maximum set packing problem. In Automata, Languages, and Programming - 40th International Colloquium, ICALP 2013, Riga, Latvia, July 8-12, 2013, Proceedings, Part I, pages 792-803, 2013. Google Scholar
  41. Jan Vondrák. Optimal approximation for the submodular welfare problem in the value oracle model. In Proceedings of the fortieth annual ACM symposium on Theory of computing, pages 67-74. ACM, 2008. Google Scholar