Document Open Access Logo

Luby-Velickovic-Wigderson Revisited: Improved Correlation Bounds and Pseudorandom Generators for Depth-Two Circuits

Authors Rocco A. Servedio, Li-Yang Tan

PDF

File

Thumbnail PDF
PDF
LIPIcs.APPROX-RANDOM.2018.56.pdf
  • Filesize: 0.67 MB
  • 20 pages

Document Identifiers

Subject Classification

ACM Subject Classification
  • Theory of computation → Pseudorandomness and derandomization
Keywords
  • Pseudorandom generators
  • correlation bounds
  • constant-depth circuits

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

Abstract

We study correlation bounds and pseudorandom generators for depth-two circuits that consist of a SYM-gate (computing an arbitrary symmetric function) or THR-gate (computing an arbitrary linear threshold function) that is fed by S {AND} gates. Such circuits were considered in early influential work on unconditional derandomization of Luby, Velickovi{c}, and Wigderson [Michael Luby et al., 1993], who gave the first non-trivial PRG with seed length 2^{O(sqrt{log(S/epsilon)})} that epsilon-fools these circuits.
In this work we obtain the first strict improvement of [Michael Luby et al., 1993]'s seed length: we construct a PRG that epsilon-fools size-S {SYM,THR} oAND circuits over {0,1}^n with seed length 2^{O(sqrt{log S})} + polylog(1/epsilon), an exponential (and near-optimal) improvement of the epsilon-dependence of [Michael Luby et al., 1993]. The above PRG is actually a special case of a more general PRG which we establish for constant-depth circuits containing multiple SYM or THR gates, including as a special case {SYM,THR} o AC^0 circuits. These more general results strengthen previous results of Viola [Viola, 2006] and essentially strengthen more recent results of Lovett and Srinivasan [Lovett and Srinivasan, 2011].
Our improved PRGs follow from improved correlation bounds, which are transformed into PRGs via the Nisan-Wigderson "hardness versus randomness" paradigm [Nisan and Wigderson, 1994]. The key to our improved correlation bounds is the use of a recent powerful multi-switching lemma due to Håstad [Johan Håstad, 2014].

Cite As Get BibTex

Rocco A. Servedio and Li-Yang Tan. Luby-Velickovic-Wigderson Revisited: Improved Correlation Bounds and Pseudorandom Generators for Depth-Two Circuits. In Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques (APPROX/RANDOM 2018). Leibniz International Proceedings in Informatics (LIPIcs), Volume 116, pp. 56:1-56:20, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2018) https://doi.org/10.4230/LIPIcs.APPROX-RANDOM.2018.56

Author Details

Rocco A. Servedio
  • Department of Computer Science, Columbia University, New York, NY, USA
Li-Yang Tan
  • Department of Computer Science, Stanford University, Stanford, California, USA

Funding

  • Servedio, Rocco A.: Supported by NSF grants CCF-1420349 and CCF-1563155.
  • Tan, Li-Yang: Supported by NSF grant CCF-1563122. Part of this research was done during a visit to Columbia University.

References

  1. Miklós Ajtai. Σ₁¹-formulae on finite structures. Annals of Pure and Applied Logic, 24(1):1-48, 1983. Google Scholar
  2. Miklós Ajtai and Avi Wigderson. Deterministic simulation of probabilistic constant depth circuits. In Proc. 26th IEEE Symposium on Foundations of Computer Science (FOCS), pages 11-19, 1985. Google Scholar
  3. László Babai, Noam Nisan, and Márió Szegedy. Multiparty protocols, pseudorandom generators for logspace, and time-space trade-offs. J. Comput. System Sci., 45(2):204-232, 1992. 21st Symposium on the Theory of Computing (STOC). URL: http://dx.doi.org/10.1016/0022-0000(92)90047-M.
  4. Richard Beigel and Jun Tarui. On ACC. Computational Complexity, 4:350-366, 1994. Google Scholar
  5. Manuel Blum and Silvio Micali. How to generate cryptographically strong sequences of pseudorandom bits. SIAM J. Comput., 13(4):850-864, 1984. URL: http://dx.doi.org/10.1137/0213053.
  6. Andrej Bogdanov. Pseudorandom generators for low degree polynomials. In STOC'05: Proceedings of the 37th Annual ACM Symposium on Theory of Computing, pages 21-30. ACM, New York, 2005. URL: http://dx.doi.org/10.1145/1060590.1060594.
  7. Andrej Bogdanov and Emanuele Viola. Pseudorandom bits for polynomials. SIAM J. Comput., 39(6):2464-2486, 2010. URL: http://dx.doi.org/10.1137/070712109.
  8. Nader Bshouty. On learning multivariate polynomials under the uniform distribution. Information Processing Letters, 61(3):303-309, 1997. Google Scholar
  9. Nader Bshouty and Yishay Mansour. Simple Learning Algorithms for Decision Trees and Multivariate Polynomials. SIAM J. Comput., 31(6):1909-1925, 2002. Google Scholar
  10. Shiteng Chen and Periklis A. Papakonstantinou. Depth reduction for composites. In 2016 IEEE 57th Annual Symposium on Foundations of Computer Science - FOCS 2016, page to appear. IEEE, 2016. Google Scholar
  11. Anindya De and Rocco Servedio. Efficient deterministic approximate counting for low-degree polynomial threshold functions. In Proc. 46th Annual ACM Symposium on Theory of Computing (STOC), pages 832-841, 2014. Google Scholar
  12. Ilias Diakonikolas, Daniel M. Kane, and Jelani Nelson. Bounded independence fools degree-2 threshold functions. In Proc. 51st IEEE Symposium on Foundations of Computer Science (FOCS), pages 11-20, 2010. Google Scholar
  13. Ilias Diakonikolas, Homin Lee, Kevin Matulef, Krzysztof Onak, Ronitt Rubinfeld, Rocco Servedio, and Andrew Wan. Testing for concise representations. In Proc. 48th Ann. Symposium on Computer Science (FOCS), pages 549-558, 2007. Google Scholar
  14. Ilias Diakonikolas, Homin Lee, Krzysztof Matulef, Rocco Servedio, and Andrew Wan. Efficiently testing sparse GF(2) polynomials. Algorithmica, July 2010. Google Scholar
  15. Ilias Diakonikolas, Ryan O'Donnell, Rocco Servedio, and Yi Wu. Hardness results for agnostically learning low-degree polynomial threshold functions. In SODA, pages 1590-1606, 2011. Google Scholar
  16. A. Ehrenfeucht and M. Karpinski. The computational complexity of (xor,and)-counting problems. Technical report, preprint, 1989. Google Scholar
  17. M. Goldmann. On the power of a threshold gate at the top. Information Processing Letters, 63(6):287-293, 1997. Google Scholar
  18. D. Grigoriev, M. Karpinski, and M. Singer. Fast parallel algorithms for sparse multivariate polynomial interpolation over finite fields. SIAM Journal on Computing, 19(6):1059-1063, 1990. Google Scholar
  19. Kristoffer Arnsfelt Hansen and Peter Bro Miltersen. Some meet-in-the-middle circuit lower bounds. In Mathematical foundations of computer science 2004, volume 3153 of Lecture Notes in Comput. Sci., pages 334-345. Springer, Berlin, 2004. URL: http://dx.doi.org/10.1007/978-3-540-28629-5_24.
  20. Johan Håstad. Almost optimal lower bounds for small depth circuits. In Proceedings of the 18th Annual ACM Symposium on Theory of Computing, pages 6-20, 1986. Google Scholar
  21. Johan Håstad. On the correlation of parity and small-depth circuits. SIAM Journal on Computing, 43(5):1699-1708, 2014. Google Scholar
  22. Johan Håstad and Mikael Goldmann. On the power of small-depth threshold circuits. Comput. Complexity, 1(2):113-129, 1991. URL: http://dx.doi.org/10.1007/BF01272517.
  23. Russell Impagliazzo, William Matthews, and Ramamohan Paturi. A satisfiability algorithm for AC⁰. In Proceedings of the 23rd Annual ACM-SIAM Symposium on Discrete Algorithms, pages 961-972, 2012. Google Scholar
  24. A. Kalai, A. Klivans, Y. Mansour, and R. Servedio. Agnostically learning halfspaces. SIAM Journal on Computing, 37(6):1777-1805, 2008. Google Scholar
  25. Daniel Kane. A Structure Theorem for Poorly Anticoncentrated Gaussian Chaoses and Applications to the Study of Polynomial Threshold Functions. In FOCS, pages 91-100, 2012. Google Scholar
  26. M. Karpinski. Boolean circuit complexity of algebraic interpolation problems. "ICSI technical report", 1989. Google Scholar
  27. M. Karpinski and M. Luby. Approximating the Number of Zeros of a GF[2] Polynomial. Journal of Algorithms, 14:280-287, 1993. Google Scholar
  28. M. Krause and P. Pudlak. Computing boolean functions by polynomials and threshold circuits. Computational Complexity, 7(4):346-370, 1998. Google Scholar
  29. Shachar Lovett. Unconditional pseudorandom generators for low-degree polynomials. Theory Comput., 5:69-82, 2009. URL: http://dx.doi.org/10.4086/toc.2009.v005a003.
  30. Shachar Lovett and Srikanth Srinivasan. Correlation bounds for poly-size AC⁰ circuits with n^1-o(1) symmetric gates. In Approximation, randomization, and combinatorial optimization, volume 6845 of Lecture Notes in Comput. Sci., pages 640-651. Springer, Heidelberg, 2011. URL: http://dx.doi.org/10.1007/978-3-642-22935-0_54.
  31. Michael Luby, Boban Veličković, and Avi Wigderson. Deterministic approximate counting of depth-2 circuits. In Proceedings of the 2nd ISTCS, pages 18-24, 1993. Google Scholar
  32. Raghu Meka and David Zuckerman. Pseudorandom generators for polynomial threshold functions. In STOC, pages 427-436, 2010. Google Scholar
  33. M. Minsky and S. Papert. Perceptrons: an introduction to computational geometry. MIT Press, Cambridge, MA, 1968. Google Scholar
  34. Cody Murray and Ryan Williams. Circuit lower bounds for nondeterministic quasi-polytime: An easy witness lemma for NP and NQP. In Proceedings of the 50th Annual Symposium on Theory of Computing (STOC), 2018. Google Scholar
  35. Noam Nisan. Pseudorandom bits for constant depth circuits. Combinatorica, 11(1):63-70, 1991. Google Scholar
  36. Noam Nisan. The communication complexity of threshold gates. In Combinatorics, Paul Erdős is eighty, Vol. 1, Bolyai Soc. Math. Stud., pages 301-315. János Bolyai Math. Soc., Budapest, 1993. Google Scholar
  37. Noam Nisan and Avi Wigderson. Hardness vs. randomness. J. Comput. System Sci., 49(2):149-167, 1994. URL: http://dx.doi.org/10.1016/S0022-0000(05)80043-1.
  38. V. V. Podolskii. Perceptrons of large weight. Problems of Information Transmission, 45(1):46-53, 2009. Google Scholar
  39. Alexander Razborov and Avi Wigderson. n^Ω(log n) lower bounds on the size of depth-3 threshold circuits with AND gates at the bottom. Inform. Process. Lett., 45(6):303-307, 1993. URL: http://dx.doi.org/10.1016/0020-0190(93)90041-7.
  40. R. Roth and G. Benedek. Interpolation and approximation of sparse multivariate polynomials over GF(2). SIAM J. Comput., 20(2):291-314, 1991. Google Scholar
  41. Takayuki Sakai, Kazuhisa Seto, Suguru Tamaki, and Junichi Teruyama. Bounded depth circuits with weighted symmetric gates: Satisfiability, lower bounds and compression. In 41st International Symposium on Mathematical Foundations of Computer Science, MFCS 2016, August 22-26, 2016 - Kraków, Poland, pages 82:1-82:16, 2016. Google Scholar
  42. R. Schapire and L. Sellie. Learning sparse multivariate polynomials over a field with queries and counterexamples. J. Comput. &Syst. Sci., 52(2):201-213, 1996. Google Scholar
  43. Rocco A. Servedio and Li-Yang Tan. Improved pseudorandom generators from pseudorandom multi-switching lemmas, 2018. Manuscript. Available at URL: https://arxiv.org/abs/1801.03590.
  44. Adi Shamir. On the generation of cryptographically strong pseudorandom sequences. In Automata, languages and programming (Akko, 1981), volume 115 of Lecture Notes in Comput. Sci., pages 544-550. Springer, Berlin-New York, 1981. Google Scholar
  45. Luca Trevisan and Tongke Xue. A derandomized switching lemma and an improved derandomization of AC⁰ . In Proceedings of the 28th IEEE Conference on Computational Complexity, pages 242-247, 2013. Google Scholar
  46. Salil P. Vadhan. Pseudorandomness. Foundations and Trends in Theoretical Computer Science, 7(1-3):1-336, 2012. Google Scholar
  47. Emanuele Viola. Pseudorandom bits for constant-depth circuits with few arbitrary symmetric gates. SIAM J. Comput., 36(5):1387-1403 (electronic), 2006/07. URL: http://dx.doi.org/10.1137/050640941.
  48. Emanuele Viola. On the power of small-depth computation. Now Publishers Inc, 2009. Google Scholar
  49. Emanuele Viola. The sum of d small-bias generators fools polynomials of degree d. Comput. Complexity, 18(2):209-217, 2009. URL: http://dx.doi.org/10.1007/s00037-009-0273-5.
  50. Ryan Williams. Non-uniform ACC Circuit Lower Bounds. In CCC 2011, pages 115-125, 2011. Google Scholar
  51. Andrew Yao. Theory and applications of trapdoor functions. In 23rd Annual Symposium on Foundations of Computer Science (Chicago, Ill., 1982), pages 80-91. IEEE, New York, 1982. Google Scholar
  52. Andrew Yao. On ACC and threshold circuits. In Proceedings of the Thirty-First Annual Symposium on Foundations of Computer Science, pages 619-627, 1990. Google Scholar
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2025 Schloss Dagstuhl – LZI GmbH About DROPS Imprint Privacy Contact