Document Open Access Logo

Securing Dynamic Data: A Primer on Differentially Private Data Structures (Invited Talk)

Authors Monika Henzinger , Roodabeh Safavi

PDF

File

Thumbnail PDF
PDF
LIPIcs.ESA.2025.2.pdf
  • Filesize: 0.73 MB
  • 14 pages

Document Identifiers

Subject Classification

ACM Subject Classification
  • Theory of computation
  • Security and privacy
Keywords
  • Differential privacy
  • continual observation

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

Abstract

We give an introduction into differential privacy in the dynamic setting, called the continual observation setting.

Cite As Get BibTex

Monika Henzinger and Roodabeh Safavi. Securing Dynamic Data: A Primer on Differentially Private Data Structures (Invited Talk). In 33rd Annual European Symposium on Algorithms (ESA 2025). Leibniz International Proceedings in Informatics (LIPIcs), Volume 351, pp. 2:1-2:14, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2025) https://doi.org/10.4230/LIPIcs.ESA.2025.2

Author Details

Monika Henzinger
  • Institute of Science and Technology, Klosterneuburg, Austria
Roodabeh Safavi
  • Institute of Science and Technology, Klosterneuburg, Austria

References

  1. Joel Daniel Andersson and Rasmus Pagh. Streaming private continual counting via binning. CoRR, abs/2412.07093, 2024. URL: https://doi.org/10.48550/arXiv.2412.07093.
  2. Joel Daniel Andersson, Rasmus Pagh, and Sahel Torkamani. Improved counting under continual observation with pure differential privacy. CoRR, abs/2408.07021, 2024. URL: https://doi.org/10.48550/arXiv.2408.07021.
  3. Apple. Privacy-preserving contact tracing, https://covid19.apple.com/contacttracing, 2021.
  4. Jean Bolot, Nadia Fawaz, S. Muthukrishnan, Aleksandar Nikolov, and Nina Taft. Private decayed sum estimation under continual observation. CoRR, abs/1108.6123, 2011. URL: https://arxiv.org/abs/1108.6123.
  5. Mark Bun, Marco Gaboardi, Marcel Neunhoeffer, and Wanrong Zhang. Continual release of differentially private synthetic data from longitudinal data collections. Proc. ACM Manag. Data, 2(2):94, 2024. URL: https://doi.org/10.1145/3651595.
  6. Mark Bun, Kobbi Nissim, Uri Stemmer, and Salil Vadhan. Differentially private release and learning of threshold functions. In 2015 IEEE 56th Annual Symposium on Foundations of Computer Science, pages 634-649. IEEE, 2015. URL: https://doi.org/10.1109/FOCS.2015.45.
  7. Adrian Rivera Cardoso and Ryan Rogers. Differentially private histograms under continual observation: Streaming selection into the unknown. In Proc. 25th AISTATS, pages 2397-2419, 2022. URL: https://proceedings.mlr.press/v151/rivera-cardoso22a.html.
  8. Ho-Leung Chan, Tak-Wah Lam, Lap-Kei Lee, and Hing-Fung Ting. Continuous monitoring of distributed data streams over a time-based sliding window. Algorithmica, 62(3-4):1088-1111, 2012. URL: https://doi.org/10.1007/S00453-011-9506-5.
  9. T-H Hubert Chan, Mingfei Li, Elaine Shi, and Wenchang Xu. Differentially private continual monitoring of heavy hitters from distributed streams. In International Symposium on Privacy Enhancing Technologies Symposium, pages 140-159. Springer, 2012. URL: https://doi.org/10.1007/978-3-642-31680-7_8.
  10. T.-H. Hubert Chan, Elaine Shi, and Dawn Song. Private and continual release of statistics. ACM Trans. Inf. Syst. Secur., 14(3):26:1-26:24, 2011. URL: https://doi.org/10.1145/2043621.2043626.
  11. Rachel Cummings, Sara Krehbiel, Kevin A. Lai, and Uthaipon Tao Tantipongpipat. Differential privacy for growing databases. In Proc. 31st NeurIPS, pages 8878-8887, 2018. URL: https://proceedings.neurips.cc/paper/2018/hash/ac27b77292582bc293a51055bfc994ee-Abstract.html.
  12. Aref N. Dajani, Amy D. Lauger, Phyllis E. Singer1, Daniel Kifer, Jerome P. Reiter, Ashwin Machanavajjhala, Simson L. Garfinkel, Scot A. Dahl, Matthew Graham Vishesh Karwa, Hang Kim, Philip Leclerc, Ian M. Schmutte, William N. Sexton, Lars Vilhuber, and John M. Abowd. The modernization of statistical disclosure limitation at the U.S. Census Bureau, 2017. URL: https://www2.census.gov/cac/sac/meetings/2017-09/statistical-disclosure-limitation.pdf.
  13. Bolin Ding, Janardhan Kulkarni, and Sergey Yekhanin. Collecting telemetry data privately. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 4-9 December 2017, Long Beach, CA, USA, pages 3571-3580, 2017. URL: http://papers.nips.cc/paper/6948-collecting-telemetry-data-privately.
  14. Wei Dong, Zijun Chen, Qiyao Luo, Elaine Shi, and Ke Yi. Continual observation of joins under differential privacy. Proceedings of the ACM on Management of Data, 2(3):1-27, 2024. Google Scholar
  15. Max Dupré la Tour, Monika Henzinger, and David Saulpic. Making old things new: a unified algorithm for differentially private clustering. In Proc. 41th ICML, 2024. Google Scholar
  16. Krishnamurthy Dj Dvijotham, H. Brendan McMahan, Krishna Pillutla, Thomas Steinke, and Abhradeep Thakurta. Efficient and near-optimal noise generation for streaming differential privacy. In 65th IEEE Annual Symposium on Foundations of Computer Science, FOCS 2024, Chicago, IL, USA, October 27-30, 2024, pages 2306-2317. IEEE, 2024. URL: https://doi.org/10.1109/FOCS61266.2024.00135.
  17. Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam Smith. Calibrating noise to sensitivity in private data analysis. In Theory of Cryptography: Third Theory of Cryptography Conference, TCC 2006, New York, NY, USA, March 4-7, 2006. Proceedings 3, pages 265-284. Springer, 2006. URL: https://doi.org/10.1007/11681878_14.
  18. Cynthia Dwork, Moni Naor, Toniann Pitassi, and Guy N. Rothblum. Differential privacy under continual observation. In Proc. of the Forty-Second ACM Symp. on Theory of Computing (STOC'10), pages 715-724, 2010. URL: https://doi.org/10.1145/1806689.1806787.
  19. Cynthia Dwork, Moni Naor, Omer Reingold, Guy N Rothblum, and Salil Vadhan. On the complexity of differentially private data release: efficient algorithms and hardness results. In Proceedings of the forty-first annual ACM symposium on Theory of computing, pages 381-390, 2009. URL: https://doi.org/10.1145/1536414.1536467.
  20. Cynthia Dwork and Aaron Roth. The algorithmic foundations of differential privacy. Foundations and Trends® in Theoretical Computer Science, 9(3-4):211-407, 2014. URL: https://doi.org/10.1561/0400000042.
  21. Cynthia Dwork, Guy N. Rothblum, and Salil Vadhan. Boosting and differential privacy. In Proceedings of the IEEE 51st Annual Symposium on Foundations of Computer Science, pages 51-60, 2010. URL: https://doi.org/10.1109/FOCS.2010.12.
  22. Alessandro Epasto, Quanquan C. Liu, Tamalika Mukherjee, and Felix Zhou. The power of graph sparsification in the continual release model. CoRR, abs/2407.17619, 2024. URL: https://doi.org/10.48550/arXiv.2407.17619.
  23. Alessandro Epasto, Jieming Mao, Andres Muñoz Medina, Vahab Mirrokni, Sergei Vassilvitskii, and Peilin Zhong. Differentially private continual releases of streaming frequency moment estimations. In Yael Tauman Kalai, editor, 14th Innovations in Theoretical Computer Science Conference, ITCS 2023, January 10-13, 2023, MIT, Cambridge, Massachusetts, USA, volume 251 of LIPIcs, pages 48:1-48:24. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2023. URL: https://doi.org/10.4230/LIPICS.ITCS.2023.48.
  24. Úlfar Erlingsson, Vasyl Pihur, and Aleksandra Korolova. Rappor: Randomized aggregatable privacy-preserving ordinal response. In Proceedings of the 2014 ACM SIGSAC conference on computer and communications security, pages 1054-1067. ACM, 2014. URL: https://doi.org/10.1145/2660267.2660348.
  25. Hendrik Fichtenberger, Monika Henzinger, and Wolfgang Ost. Differentially private algorithms for graphs under continual observation. In 29th Annual European Symposium on Algorithms, ESA, 2021. URL: https://doi.org/10.4230/LIPIcs.ESA.2021.42.
  26. Hendrik Fichtenberger, Monika Henzinger, and Jalaj Upadhyay. Constant matters: Fine-grained error bound on differentially private continual observation. In International Conference on Machine Learning, pages 10072-10092. PMLR, 2023. URL: https://proceedings.mlr.press/v202/fichtenberger23a.html.
  27. Samuel Haney, Michael Shoemate, Grace Tian, Salil Vadhan, Andrew Vyrros, Vicki Xu, and Wanrong Zhang. Concurrent composition for interactive differential privacy with adaptive privacy-loss parameters. In Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pages 1949-1963, 2023. URL: https://doi.org/10.1145/3576915.3623128.
  28. Monika Henzinger, Roodabeh Safavi, and Salil Vadhan. Concurrent composition for differentially private continual mechanisms. arXiv preprint, 2024. URL: https://arxiv.org/abs/2411.03299.
  29. Monika Henzinger, A. R. Sricharan, and Teresa Anna Steiner. Private counting of distinct elements in the turnstile model and extensions. In Amit Kumar and Noga Ron-Zewi, editors, Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques, APPROX/RANDOM 2024, August 28-30, 2024, London School of Economics, London, UK, volume 317 of LIPIcs, pages 40:1-40:21. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2024. URL: https://doi.org/10.4230/LIPICS.APPROX/RANDOM.2024.40.
  30. Monika Henzinger, A. R. Sricharan, and Teresa Anna Steiner. Differentially private continual release of histograms and related queries. In The 28th International Conference on Artificial Intelligence and Statistics, 2025. URL: https://openreview.net/forum?id=EYhGcfYpFS.
  31. Monika Henzinger and Jalaj Upadhyay. Improved differentially private continual observation using group algebra. In Yossi Azar and Debmalya Panigrahi, editors, Proceedings of the 2025 Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2025, New Orleans, LA, USA, January 12-15, 2025, pages 2951-2970. SIAM, 2025. URL: https://doi.org/10.1137/1.9781611978322.95.
  32. Monika Henzinger, Jalaj Upadhyay, and Sarvagya Upadhyay. Almost tight error bounds on differentially private continual counting. In Proceedings of the 2023 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 5003-5039, 2023. URL: https://doi.org/10.1137/1.9781611977554.CH183.
  33. Monika Henzinger, Jalaj Upadhyay, and Sarvagya Upadhyay. A unifying framework for differentially private sums under continual observation. In David P. Woodruff, editor, Proceedings of the 2024 ACM-SIAM Symposium on Discrete Algorithms, SODA 2024, Alexandria, VA, USA, January 7-10, 2024, pages 995-1018. SIAM, 2024. URL: https://doi.org/10.1137/1.9781611977912.38.
  34. Palak Jain, Iden Kalemaj, Sofya Raskhodnikova, Satchit Sivakumar, and Adam D. Smith. Counting distinct elements in the turnstile model with differential privacy under continual observation. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, and Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023, 2023. URL: http://papers.nips.cc/paper_files/paper/2023/hash/0ef1afa0daa888d695dcd5e9513bafa3-Abstract-Conference.html.
  35. Palak Jain, Adam D. Smith, and Connor Wagaman. Time-aware projections: Truly node-private graph statistics under continual observation. In IEEE Symposium on Security and Privacy, SP 2024, San Francisco, CA, USA, May 19-23, 2024, pages 127-145. IEEE, 2024. URL: https://doi.org/10.1109/SP54263.2024.00196.
  36. Min Lyu, Dong Su, and Ninghui Li. Understanding the sparse vector technique for differential privacy. arXiv preprint arXiv:1603.01699, 2016. URL: https://arxiv.org/abs/1603.01699.
  37. Xin Lyu. Composition theorems for interactive differential privacy. Advances in Neural Information Processing Systems, 35:9700-9712, 2022. Google Scholar
  38. Frank D McSherry. Privacy integrated queries: an extensible platform for privacy-preserving data analysis. In Proceedings of the 2009 ACM SIGMOD International Conference on Management of data, pages 19-30, 2009. URL: https://doi.org/10.1145/1559845.1559850.
  39. Arvind Narayanan and Vitaly Shmatikov. Robust de-anonymization of large sparse datasets. In Security and Privacy, 2008. SP 2008. IEEE Symposium on, pages 111-125. IEEE, 2008. URL: https://doi.org/10.1109/SP.2008.33.
  40. Yuan Qiu and Ke Yi. Differential privacy on dynamic data. arXiv preprint arXiv:2209.01387, 2022. URL: https://doi.org/10.48550/arXiv.2209.01387.
  41. Sofya Raskhodnikova and Teresa Anna Steiner. Fully dynamic algorithms for graph databases with edge differential privacy. Proceedings of the ACM on Management of Data, 3(2):1-28, 2025. URL: https://doi.org/10.1145/3725236.
  42. Shuang Song, Susan Little, Sanjay Mehta, Staal Vinterbo, and Kamalika Chaudhuri. Differentially private continual release of graph statistics. arXiv preprint, 2018. URL: https://arxiv.org/abs/1809.02575.
  43. Salil Vadhan and Tianhao Wang. Concurrent composition of differential privacy. In Theory of Cryptography: 19th International Conference, TCC 2021, Raleigh, NC, USA, November 8-11, 2021, Proceedings, Part II 19, pages 582-604. Springer, 2021. URL: https://doi.org/10.1007/978-3-030-90453-1_20.
  44. Salil Vadhan and Wanrong Zhang. Concurrent composition theorems for differential privacy. In 55th Annual ACM Symposium on Theory of Computing, 2023. Google Scholar
  45. Tianhao Wang, Joann Chen, Zhikun Zhang, Dong Su, Yueqiang Cheng, Zhou Li, Ninghui Li, and Somesh Jha. Continuous release of data streams under both centralized and local differential privacy. In CCS, pages 1237-1253, 2021. Google Scholar
  46. Dongdong Xie, Pinghui Wang, Quanqing Xu, Chuanhui Yang, and Rundong Li. Efficient and accurate differentially private cardinality continual releases. Proceedings of the ACM on Management of Data, 3(3):1-27, 2025. URL: https://doi.org/10.1145/3725288.
  47. Timothy Yang, Galen Andrew, Hubert Eichner, Haicheng Sun, Wei Li, Nicholas Kong, Daniel Ramage, and Françoise Beaufays. Applied federated learning: Improving google keyboard query suggestions. arXiv preprint arXiv:1812.02903, 2018. URL: https://arxiv.org/abs/1812.02903.
  48. Bing Zhang, Vadym Doroshenko, Peter Kairouz, Thomas Steinke, Abhradeep Thakurta, Ziyin Ma, Eidan Cohen, Himani Apte, and Jodi Spacek. Differentially private stream processing at scale. Proc. VLDB Endow., 17(12):4145-4158, 2024. URL: https://doi.org/10.14778/3685800.3685833.
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2025 Schloss Dagstuhl – LZI GmbH About DROPS Imprint Privacy Contact