Lower Bounds for Differential Privacy from Gaussian Width

Authors Assimakis Kattis, Aleksandar Nikolov



PDF
Thumbnail PDF

File

LIPIcs.SoCG.2017.45.pdf
  • Filesize: 0.5 MB
  • 16 pages

Document Identifiers

Author Details

Assimakis Kattis
Aleksandar Nikolov

Cite As Get BibTex

Assimakis Kattis and Aleksandar Nikolov. Lower Bounds for Differential Privacy from Gaussian Width. In 33rd International Symposium on Computational Geometry (SoCG 2017). Leibniz International Proceedings in Informatics (LIPIcs), Volume 77, pp. 45:1-45:16, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2017) https://doi.org/10.4230/LIPIcs.SoCG.2017.45

Abstract

We study the optimal sample complexity of a given workload of linear queries under the constraints of differential privacy. The sample complexity of a query answering mechanism under error parameter alpha is the smallest n such that the mechanism answers the workload with error at most alpha on any database of size n. Following a line of research started by Hardt and Talwar [STOC 2010], we analyze sample complexity using the tools of asymptotic convex geometry. We study the sensitivity polytope, a natural convex body associated with a query workload that quantifies how query answers can change between neighboring databases. This is the information that, roughly speaking, is protected by a differentially private algorithm, and, for this reason, we expect that a "bigger" sensitivity polytope implies larger sample complexity. Our results identify the mean Gaussian width as an appropriate measure of the size of the polytope, and show sample complexity lower bounds in terms of this quantity. Our lower bounds completely characterize the workloads for which the Gaussian noise mechanism is optimal up to constants as those having asymptotically maximal Gaussian width. 

Our techniques also yield an alternative proof of Pisier's Volume Number Theorem which also suggests an approach to improving the parameters of the theorem.

Subject Classification

Keywords
  • differential privacy
  • convex geometry
  • lower bounds
  • sample complexity

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads

References

  1. Shiri Artstein-Avidan, Apostolos Giannopoulos, and Vitali D. Milman. Asymptotic geometric analysis. Part I, volume 202 of Mathematical Surveys and Monographs. American Mathematical Society, Providence, RI, 2015. URL: http://dx.doi.org/10.1090/surv/202.
  2. Aditya Bhaskara, Daniel Dadush, Ravishankar Krishnaswamy, and Kunal Talwar. Unconditional differentially private mechanisms for linear queries. In Proceedings of the 44th Symposium on Theory of Computing, STOC'12, pages 1269-1284, New York, NY, USA, 2012. ACM. URL: http://dx.doi.org/10.1145/2213977.2214089.
  3. Mark Bun, Jonathan Ullman, and Salil Vadhan. Fingerprinting codes and the price of approximate differential privacy. In Proceedings of the 46th Annual ACM Symposium on Theory of Computing, pages 1-10. ACM, 2014. Google Scholar
  4. Irit Dinur and Kobbi Nissim. Revealing information while preserving privacy. In Proceedings of the 22nd ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, pages 202-210. ACM, 2003. Google Scholar
  5. Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam Smith. Calibrating noise to sensitivity in private data analysis. In Theory of Cryptography Conference, pages 265-284. Springer, 2006. Google Scholar
  6. Cynthia Dwork, Aleksandar Nikolov, and Kunal Talwar. Using convex relaxations for efficiently and privately releasing marginals. In 30th Annual Symposium on Computational Geometry, SOCG'14, Kyoto, Japan, June 08-11, 2014, page 261. ACM, 2014. URL: http://dx.doi.org/10.1145/2582112.2582123.
  7. Cynthia Dwork and Kobbi Nissim. Privacy-preserving datamining on vertically partitioned databases. In Annual International Cryptology Conference, pages 528-544. Springer, 2004. Google Scholar
  8. T. Figiel and Nicole Tomczak-Jaegermann. Projections onto Hilbertian subspaces of Banach spaces. Israel J. Math., 33(2):155-171, 1979. URL: http://dx.doi.org/10.1007/BF02760556.
  9. Moritz Hardt and Kunal Talwar. On the geometry of differential privacy. In Proceedings of the 42nd ACM Symposium on Theory of Computing, STOC'10, pages 705-714, New York, NY, USA, 2010. ACM. URL: http://dx.doi.org/10.1145/1806689.1806786.
  10. Michael Kearns. Efficient noise-tolerant learning from statistical queries. J. ACM, 45(6):983-1006, 1998. URL: http://dx.doi.org/10.1145/293347.293351.
  11. Michel Ledoux and Michel Talagrand. Probability in Banach spaces. Classics in Mathematics. Springer-Verlag, Berlin, 2011. Isoperimetry and processes, Reprint of the 1991 edition. Google Scholar
  12. Jiří Matoušek. Lectures on discrete geometry, volume 212 of Graduate Texts in Mathematics. Springer-Verlag, New York, 2002. URL: http://dx.doi.org/10.1007/978-1-4613-0039-7.
  13. V. D. Milman. A new proof of A. Dvoretzky’s theorem on cross-sections of convex bodies. Funkcional. Anal. i Priložen., 5(4):28-37, 1971. Google Scholar
  14. V. D. Milman and G. Pisier. Gaussian processes and mixed volumes. Ann. Probab., 15(1):292-304, 1987. URL: http://links.jstor.org/sici?sici=0091-1798(198701)15:1<292:GPAMV>2.0.CO;2-A&origin=MSN.
  15. Aleksandar Nikolov. An improved private mechanism for small databases. In Automata, Languages, and Programming - 42nd International Colloquium, ICALP 2015, Kyoto, Japan, July 6-10, 2015, Proceedings, Part I, volume 9134 of Lecture Notes in Computer Science, pages 1010-1021. Springer, 2015. URL: http://dx.doi.org/10.1007/978-3-662-47672-7_82.
  16. Aleksandar Nikolov, Kunal Talwar, and Li Zhang. The geometry of differential privacy: the sparse and approximate cases. In Symposium on Theory of Computing Conference, STOC'13, Palo Alto, CA, USA, June 1-4, 2013, pages 351-360. ACM, 2013. URL: http://dx.doi.org/10.1145/2488608.2488652.
  17. Alain Pajor and Nicole Tomczak-Jaegermann. Subspaces of small codimension of finite-dimensional Banach spaces. Proc. Amer. Math. Soc., 97(4):637-642, 1986. URL: http://dx.doi.org/10.2307/2045920.
  18. Christos H. Papadimitriou and Mihalis Yannakakis. On limited nondeterminism and the complexity of the V-C dimension. J. Comput. Syst. Sci., 53(2):161-170, 1996. URL: http://dx.doi.org/10.1006/jcss.1996.0058.
  19. Allan Pinkus. n-widths in approximation theory, volume 7 of Ergebnisse der Mathematik und ihrer Grenzgebiete (3) [Results in Mathematics and Related Areas (3)]. Springer-Verlag, Berlin, 1985. URL: http://dx.doi.org/10.1007/978-3-642-69894-1.
  20. G. Pisier. Sur les espaces de Banach K-convexes. In Seminar on Functional Analysis, 1979-1980 (French), pages Exp. No. 11, 15. École Polytech., Palaiseau, 1980. Google Scholar
  21. Gilles Pisier. The volume of convex bodies and Banach space geometry, volume 94 of Cambridge Tracts in Mathematics. Cambridge University Press, Cambridge, 1989. URL: http://dx.doi.org/10.1017/CBO9780511662454.
  22. Thomas Steinke and Jonathan Ullman. Between pure and approximate differential privacy. CoRR, abs/1501.06095, 2015. URL: http://arxiv.org/abs/1501.06095.
  23. R. Vershynin. Lectures in geometric functional analysis. 2009. URL: http://www-personal.umich.edu/~romanv/papers/GFA-book.pdf.
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail