Fast Decoding of Explicit Almost Optimal ε-Balanced q-Ary Codes And Fast Approximation of Expanding k-CSPs

Author Fernando Granha Jeronimo



PDF
Thumbnail PDF

File

LIPIcs.APPROX-RANDOM.2023.60.pdf
  • Filesize: 0.75 MB
  • 16 pages

Document Identifiers

Author Details

Fernando Granha Jeronimo
  • Institute for Advanced Study, Princeton, NJ, USA

Acknowledgements

We thank Vedat Alev and Shravas Rao for stimulating discussions during the initial phase of this project. We thank Shashank Srivastava and Madhur Tulsiani for stimulating discussions leading to [Jeronimo et al., 2021].

Cite As Get BibTex

Fernando Granha Jeronimo. Fast Decoding of Explicit Almost Optimal ε-Balanced q-Ary Codes And Fast Approximation of Expanding k-CSPs. In Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques (APPROX/RANDOM 2023). Leibniz International Proceedings in Informatics (LIPIcs), Volume 275, pp. 60:1-60:16, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023) https://doi.org/10.4230/LIPIcs.APPROX/RANDOM.2023.60

Abstract

Good codes over an alphabet of constant size q can approach but not surpass distance 1-1/q. This makes the use of q-ary codes a necessity in some applications, and much work has been devoted to the case of constant alphabet q. In the large distance regime, namely, distance 1-1/q-ε for small ε > 0, the Gilbert-Varshamov (GV) bound asserts that rate Ω_q(ε²) is achievable whereas the q-ary MRRW bound gives a rate upper bound of O_q(ε²log(1/ε)). In this sense, the GV bound is almost optimal in this regime. Prior to this work there was no known explicit and efficiently decodable q-ary codes near the GV bound, in this large distance regime, for any constant q ≥ 3.
We design an Õ_{ε,q}(N) time decoder for explicit (expander based) families of linear codes C_{N,q,ε} ⊆ F_q^N of distance (1-1/q)(1-ε) and rate Ω_q(ε^{2+o(1)}), for any desired ε > 0 and any constant prime q, namely, almost optimal in this regime. These codes are ε-balanced,i.e., for every non-zero codeword, the frequency of each symbol lies in the interval [1/q - ε, 1/q + ε]. A key ingredient of the q-ary decoder is a new near-linear time approximation algorithm for linear equations (k-LIN) over ℤ_q  on expanding hypergraphs, in particular, those naturally arising in the decoding of these codes.
We also investigate k-CSPs on expanding hypergraphs in more generality. We show that special trade-offs available for k-LIN over ℤ_q hold for linear equations over a finite group. To handle general finite groups, we design a new matrix version of weak regularity for expanding hypergraphs. We also obtain a near-linear time approximation algorithm for general expanding k-CSPs over q-ary alphabet. This later algorithm runs in time Õ_{k,q}(m + n), where m is the number of constraints and n is the number of variables. This improves the previous best running time of O(n^{Θ_{k,q}(1)}) by a Sum-of-Squares based algorithm of [AJT, 2019] (in the expanding regular case).
We obtain our results by generalizing the framework of [JST, 2021] based on weak regularity decomposition for expanding hypergraphs. This framework was originally designed for binary k-XOR with the goal of providing near-linear time decoder for explicit binary codes, near the GV bound, from the breakthrough work of Ta-Shma [STOC, 2017]. The explicit families of codes over prime F_q are based on suitable instatiations of the Jalan-Moshkovitz (Abelian) generalization of Ta-Shma’s distance amplification procedure.

Subject Classification

ACM Subject Classification
  • Theory of computation → Error-correcting codes
  • Theory of computation → Expander graphs and randomness extractors
Keywords
  • Decoding
  • Approximation
  • GV bound
  • CSPs
  • HDXs
  • Regularity

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads

References

  1. Vedat Levi Alev, Fernando Granha Jeronimo, Dylan Quintana, Shashank Srivastava, and Madhur Tulsiani. List decoding of direct sum codes. In Proceedings of the 31st ACM-SIAM Symposium on Discrete Algorithms, pages 1412-1425. SIAM, 2020. Google Scholar
  2. Vedat Levi Alev, Fernando Granha Jeronimo, and Madhur Tulsiani. Approximating constraint satisfaction problems on high-dimensional expanders. In Proceedings of the 60th IEEE Symposium on Foundations of Computer Science, pages 180-201, 2019. Google Scholar
  3. Noga Alon and Assaf Naor. Approximating the cut-norm via grothendieck’s inequality. In Proceedings of the 36th ACM Symposium on Theory of Computing, pages 72-80, 2004. Google Scholar
  4. Sanjeev Arora and Satyen Kale. A combinatorial, primal-dual approach to semidefinite programs. In Proceedings of the 39th ACM Symposium on Theory of Computing, STOC '07, pages 227-236, 2007. Google Scholar
  5. Boaz Barak, Prasad Raghavendra, and David Steurer. Rounding semidefinite programming hierarchies via global correlation. In Proceedings of the 52nd IEEE Symposium on Foundations of Computer Science, pages 472-481, 2011. URL: https://doi.org/10.1109/FOCS.2011.95.
  6. Guy Blanc and Dean Doron. New near-linear time decodable codes closer to the GV bound. Technical Report TR22-027, Electronic Colloquium on Computational Complexity, 2022. Google Scholar
  7. Yotam Dikstein and Irit Dinur. Agreement testing theorems on layered set systems. In Proceedings of the 60th IEEE Symposium on Foundations of Computer Science, 2019. Google Scholar
  8. Irit Dinur, Prahladh Harsha, Tali Kaufman, Inbal Livni Navon, and Amnon Ta-Shma. List decoding with double samplers. In Proceedings of the 30th ACM-SIAM Symposium on Discrete Algorithms, pages 2134-2153, 2019. Google Scholar
  9. Noam D. Elkies. Excellent codes from modular curves. In Proceedings of the 33rd ACM Symposium on Theory of Computing, 2001. Google Scholar
  10. Uriel Feige and Joe Kilian. Zero knowledge and the chromatic number. Journal of Computer and System Sciences, 57(2):187-199, 1998. Google Scholar
  11. David Forney. Concatenated Codes. PhD thesis, MIT, 1966. Google Scholar
  12. A. Frieze and R. Kannan. The regularity lemma and approximation schemes for dense problems. In Proceedings of the 37th IEEE Symposium on Foundations of Computer Science, 1996. Google Scholar
  13. E.N. Gilbert. A comparison of signalling alphabets. Bell System Technical Journal, 31:504-522, 1952. Google Scholar
  14. Sivakanth Gopi, Swastik Kopparty, Rafael Oliveira, Noga Ron-Zewi, and Shubhangi Saraf. Locally testable and locally correctable codes approaching the Gilbert-Varshamov bound. In Proceedings of the 28th ACM-SIAM Symposium on Discrete Algorithms, SODA '17, pages 2073-2091, 2017. Google Scholar
  15. Zeyu Guo and Noga Ron-Zewi. Efficient list-decoding with constant alphabet and list sizes. IEEE Transactions on Information Theory, 68(3):1663-1682, 2022. Google Scholar
  16. Venkatesan Guruswami and Piotr Indyk. Efficiently decodable codes meeting Gilbert-Varshamov bound for low rates. In Proceedings of the 15th ACM-SIAM Symposium on Discrete Algorithms, SODA '04, pages 756-757, 2004. Google Scholar
  17. Venkatesan Guruswami, Atri Rudra, and Madhu Sudan. Essential coding theory. Available at https://cse.buffalo.edu/faculty/atri/courses/coding-theory/book/index.html, 2019.
  18. Venkatesan Guruswami and Ali Kemal Sinop. Lasserre hierarchy, higher eigenvalues, and approximation schemes for graph partitioning and quadratic integer programming with psd objectives. In FOCS, pages 482-491, 2011. Google Scholar
  19. Venkatesan Guruswami and Ali Kemal Sinop. Faster SDP hierarchy solvers for local rounding algorithms. In Proceedings of the 53rd IEEE Symposium on Foundations of Computer Science, pages 197-206. IEEE, 2012. Google Scholar
  20. Venkatesan Guruswami and Chaoping Xing. List decoding reed-solomon, algebraic-geometric, and gabidulin subcodes up to the singleton bound. In Proceedings of the 45th ACM Symposium on Theory of Computing, 2013. Google Scholar
  21. B. Hemenway, N. Ron-Zewi, and M. Wootters. Local list recovery of high-rate tensor codes applications. In Proceedings of the 58th IEEE Symposium on Foundations of Computer Science, pages 204-215, October 2017. Google Scholar
  22. Akhil Jalan and Dana Moshkovitz. Near-optimal Cayley expanders for Abelian groups, 2021. URL: https://arxiv.org/abs/2105.01149.
  23. Fernando Granha Jeronimo, Dylan Quintana, Shashank Srivastava, and Madhur Tulsiani. Unique decoding of explicit ε-balanced codes near the Gilbert-Varshamov bound. In Proceedings of the 61st IEEE Symposium on Foundations of Computer Science, 2020. Google Scholar
  24. Fernando Granha Jeronimo, Shashank Srivastava, and Madhur Tulsiani. Near-linear time decoding of Ta-Shma’s codes via splittable regularity. In Proceedings of the 52nd ACM Symposium on Theory of Computing, 2021. Google Scholar
  25. Swastik Kopparty, Nicolas Resch, Noga Ron-Zewi, Shubhangi Saraf, and Shashwat Silas. On list recovery of high-rate tensor codes. IEEE Transactions on Information Theory, 67(1):296-316, 2021. URL: https://doi.org/10.1109/TIT.2020.3023962.
  26. R. McEliece, E. Rodemich, H. Rumsey, and L. Welch. New upper bounds on the rate of a code via the Delsarte-MacWilliams inequalities. IEEE Transactions on Information Theory, 23(2):157-166, 1977. Google Scholar
  27. Anand Kumar Narayanan and Matthew Weidner. Subquadratic time encodable codes beating the gilbert–varshamov bound. IEEE Transactions on Information Theory, 65(10), 2019. Google Scholar
  28. Shayan Oveis Gharan and Luca Trevisan. A new regularity lemma and faster approximation algorithms for low threshold rank graphs. Theory of Computing, 11(9):241-256, 2015. URL: https://doi.org/10.4086/toc.2015.v011a009.
  29. Anthony Man-Cho So, Jiawei Zhang, and Yinyu Ye. On approximating complex quadratic optimization problems via semidefinite programming relaxations. Math. Program., 110(1):93-110, June 2007. Google Scholar
  30. Henning Stichtenoth. Algebraic Function Fields and Codes. Springer Publishing Company, Incorporated, 2nd edition, 2008. Google Scholar
  31. Amnon Ta-Shma. Explicit, almost optimal, epsilon-balanced codes. In Proceedings of the 49th ACM Symposium on Theory of Computing, STOC 2017, pages 238-251, New York, NY, USA, 2017. ACM. Google Scholar
  32. C. Thommesen. The existence of binary linear concatenated codes with Reed- Solomon outer codes which asymptotically meet the Gilbert-Varshamov bound. IEEE Transactions on Information Theory, 29(6):850-853, November 1983. Google Scholar
  33. L. Trevisan, M. Tulsiani, and S. Vadhan. Boosting, regularity and efficiently simulating every high-entropy distribution. In Proceedings of the 24th IEEE Conference on Computational Complexity, 2009. Google Scholar
  34. Michael Tsfasman, Serge Vladut, and Dmitry Nogin. Algebraic Geometric Codes: Basic Notions. American Mathematical Society, 2007. Google Scholar
  35. Michael A. Tsfasman, S. G. Vlădut, and Thomas Zink. Modular curves, shimura curves, and goppa codes, better than varshamov‐gilbert bound. Mathematische Nachrichten, 109:21-28, 1982. Google Scholar
  36. R.R. Varshamov. Estimate of the number of signals in error correcting codes. Doklady Akademii Nauk SSSR, 117:739-741, 1957. Google Scholar
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail