Sharp Threshold Rates for Random Codes

Authors Venkatesan Guruswami, Jonathan Mosheiff, Nicolas Resch, Shashwat Silas, Mary Wootters



PDF
Thumbnail PDF

File

LIPIcs.ITCS.2021.5.pdf
  • Filesize: 0.53 MB
  • 20 pages

Document Identifiers

Author Details

Venkatesan Guruswami
  • Computer Science Department, Carnegie Mellon University, Pittsburgh, PA, USA
Jonathan Mosheiff
  • Computer Science Department, Carnegie Mellon University, Pittsburgh, PA, USA
Nicolas Resch
  • Centrum Wiskunde & Informatica, Amsterdam, The Netherlands
Shashwat Silas
  • Computer Science Department, Stanford University, CA, USA
Mary Wootters
  • Computer Science Department and Electrical Engineering Department, Stanford University, CA, USA

Acknowledgements

We would like to thank Ray Li for helpful conversations.

Cite AsGet BibTex

Venkatesan Guruswami, Jonathan Mosheiff, Nicolas Resch, Shashwat Silas, and Mary Wootters. Sharp Threshold Rates for Random Codes. In 12th Innovations in Theoretical Computer Science Conference (ITCS 2021). Leibniz International Proceedings in Informatics (LIPIcs), Volume 185, pp. 5:1-5:20, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2021)
https://doi.org/10.4230/LIPIcs.ITCS.2021.5

Abstract

Suppose that 𝒫 is a property that may be satisfied by a random code C ⊂ Σⁿ. For example, for some p ∈ (0,1), 𝒫 might be the property that there exist three elements of C that lie in some Hamming ball of radius pn. We say that R^* is the threshold rate for 𝒫 if a random code of rate R^* + ε is very likely to satisfy 𝒫, while a random code of rate R^* - ε is very unlikely to satisfy 𝒫. While random codes are well-studied in coding theory, even the threshold rates for relatively simple properties like the one above are not well understood. We characterize threshold rates for a rich class of properties. These properties, like the example above, are defined by the inclusion of specific sets of codewords which are also suitably "symmetric." For properties in this class, we show that the threshold rate is in fact equal to the lower bound that a simple first-moment calculation obtains. Our techniques not only pin down the threshold rate for the property 𝒫 above, they give sharp bounds on the threshold rate for list-recovery in several parameter regimes, as well as an efficient algorithm for estimating the threshold rates for list-recovery in general.

Subject Classification

ACM Subject Classification
  • Mathematics of computing → Coding theory
Keywords
  • Coding theory
  • Random codes
  • Sharp thresholds

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads

References

  1. Béla Bollobás. Random Graphs, Second Edition, volume 73 of Cambridge Studies in Advanced Mathematics. Cambridge University Press, 2001. URL: https://doi.org/10.1017/CBO9780511814068.
  2. Imre Csiszár and Paul C Shields. Information theory and statistics: A tutorial. Now Publishers Inc, 2004. Google Scholar
  3. P. Erdős and A. Rényi. On random graphs. I. Publ. Math. Debrecen, 6:290-297, 1959. Google Scholar
  4. Keith Frankston, Jeff Kahn, Bhargav Narayanan, and Jinyoung Park. Thresholds versus fractional expectation-thresholds. arXiv preprint, 2019. URL: http://arxiv.org/abs/1910.13433.
  5. Michael L Fredman and János Komlós. On the size of separating systems and families of perfect hash functions. SIAM Journal on Algebraic Discrete Methods, 5(1):61-68, 1984. Google Scholar
  6. Ehud Friedgut. Sharp thresholds of graph properties, and the k-sat problem. J. Amer. Math. Soc., 12(4):1017-1054, 1999. With an appendix by Jean Bourgain. URL: https://doi.org/10.1090/S0894-0347-99-00305-7.
  7. Venkatesan Guruswami, Johan Håstad, and Swastik Kopparty. On the list-decodability of random linear codes. IEEE Trans. Information Theory, 57(2):718-725, 2011. URL: https://doi.org/10.1109/TIT.2010.2095170.
  8. Venkatesan Guruswami, Ray Li, Jonathan Mosheiff, Nicolas Resch, Shashwat Silas, and Mary Wootters. Bounds for list-decoding and list-recovery of random linear codes. arXiv preprint, 2020. URL: http://arxiv.org/abs/2004.13247.
  9. Venkatesan Guruswami and Andrii Riazanov. Beating fredman-komlós for perfect k-hashing. In 46th International Colloquium on Automata, Languages, and Programming (ICALP 2019). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 2019. Google Scholar
  10. Venkatesan Guruswami, Christopher Umans, and Salil Vadhan. Unbalanced expanders and randomness extractors from parvaresh-vardy codes. Journal of the ACM (JACM), 56(4):1-34, 2009. Google Scholar
  11. J Korner and Katalin Marton. New bounds for perfect hashing via information theory. European Journal of Combinatorics, 9(6):523-530, 1988. Google Scholar
  12. Jénos Körner. Fredman-komlós bounds and information theory. SIAM Journal on Algebraic Discrete Methods, 7(4):560-570, 1986. Google Scholar
  13. Jonathan Mosheiff, Nicolas Resch, Noga Ron-Zewi, Shashwat Silas, and Mary Wootters. Ldpc codes achieve list decoding capacity. arXiv preprint, 2019. URL: http://arxiv.org/abs/1909.06430.
  14. Nicolas Resch. List-Decodable Codes:(Randomized) Constructions and Applications. PhD thesis, Carnegie Mellon University, 2020. Google Scholar
  15. Atri Rudra and Mary Wootters. Average-radius list-recovery of random linear codes. In Proceedings of the 2018 ACM-SIAM Symposium on Discrete Algorithms, SODA, 2018. Google Scholar
  16. Salil P. Vadhan. Pseudorandomness. Foundations and Trends in Theoretical Computer Science, 7(1-3):1-336, 2012. URL: https://doi.org/10.1561/0400000010.
  17. Martin J. Wainwright and Michael I. Jordan. Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1(1-2):1-305, 2008. URL: https://doi.org/10.1561/2200000001.
  18. Chaoping Xing and Chen Yuan. Beating the probabilistic lower bound on perfect hashing. arXiv preprint, 2019. URL: http://arxiv.org/abs/1908.08792.
  19. Victor Vasilievich Zyablov and Mark Semenovich Pinsker. List concatenated decoding. Problemy Peredachi Informatsii, 17(4):29-33, 1981. Google Scholar
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail