Document Open Access Logo

The Last Success Problem with Samples

Authors Toru Yoshinaga , Yasushi Kawase

PDF

File

Thumbnail PDF
PDF
LIPIcs.ESA.2024.105.pdf
  • Filesize: 0.68 MB
  • 15 pages

Document Identifiers

Related Versions

Subject Classification

ACM Subject Classification
  • Theory of computation → Online algorithms
Keywords
  • The Last Success Problem
  • Secretary Problem
  • Sample Information Model
  • Optimal Stopping
  • Online Algorithms

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

Abstract

The last success problem is an optimal stopping problem that aims to maximize the probability of stopping on the last success in a sequence of independent n Bernoulli trials. In the classical setting where complete information about the distributions is available, Bruss [Bruss, 2000] provided an optimal stopping policy that ensures a winning probability of 1/e. However, assuming complete knowledge of the distributions is unrealistic in many practical applications. This paper investigates a variant of the last success problem where samples from each distribution are available instead of complete knowledge of them. When a single sample from each distribution is allowed, we provide a deterministic policy that guarantees a winning probability of 1/4. This is best possible by the upper bound provided by Nuti and Vondrák [Nuti and Vondr{á}k, 2023]. Furthermore, for any positive constant ε, we show that a constant number of samples from each distribution is sufficient to guarantee a winning probability of 1/e-ε.

Cite As Get BibTex

Toru Yoshinaga and Yasushi Kawase. The Last Success Problem with Samples. In 32nd Annual European Symposium on Algorithms (ESA 2024). Leibniz International Proceedings in Informatics (LIPIcs), Volume 308, pp. 105:1-105:15, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2024) https://doi.org/10.4230/LIPIcs.ESA.2024.105

Author Details

Toru Yoshinaga
  • The University of Tokyo, Japan
Yasushi Kawase
  • The University of Tokyo, Japan

Funding

This work was supported by JST SPRING Grant Number JPMJSP2108, JST ERATO Grant Number JPMJER2301, JST PRESTO Grant Number JPMJPR2122, JSPS KAKENHI Grant Number JP20K19739, and Value Exchange Engineering, a joint research project between Mercari, Inc. and the RIISE.

Acknowledgements

The authors would like to thank the anonymous reviewers for their valuable and insightful comments.

References

  1. Saeed Alaei, Ali Makhdoumi, and Azarakhsh Malekian. Revenue maximization under unknown private values with non-obligatory inspection. In Proceedings of the 22nd ACM Conference on Economics and Computation, pages 27-28, 2021. Google Scholar
  2. C. J. Argue, Alan Frieze, Anupam Gupta, and Christopher Seiler. Learning from a sample in online algorithms. In Proceedings of the 36th Conference on Neural Information Processing Systems, volume 35, pages 13852-13863, 2022. Google Scholar
  3. Pablo D. Azar, Robert Kleinberg, and S. Matthew Weinberg. Prophet inequalities with limited information. In Proceedings of the 25th annual ACM-SIAM symposium on Discrete algorithms, pages 1358-1377, 2014. Google Scholar
  4. F. Thomas Bruss. Sum the odds to one and stop. Annals of Probability, pages 1384-1391, 2000. Google Scholar
  5. F. Thomas Bruss. A note on bounds for the odds theorem of optimal stopping. Annals of Probability, 31(4):1859-1961, 2003. Google Scholar
  6. F. Thomas Bruss. A mathematical approach to comply with ethical constraints in compassionate use treatments. arXiv preprint arXiv:1804.04628, 2018. Google Scholar
  7. F. Thomas Bruss and Guy Louchard. The odds algorithm based on sequential updating and its performance. Advances in Applied Probability, 41(1):131-153, 2009. Google Scholar
  8. Constantine Caramanis, Paul Dütting, Matthew Faw, Federico Fusco, Philip Lazos, Stefano Leonardi, Orestis Papadigenopoulos, Emmanouil Pountourakis, and Rebecca Reiffenhäuser. Single-sample prophet inequalities via greedy-ordered selection. In Proceedings of the 33rd Annual ACM-SIAM Symposium on Discrete Algorithms, pages 1298-1325, 2022. Google Scholar
  9. José R. Correa, Andrés Cristi, Boris Epstein, and José A. Soto. The two-sided game of googol and sample-based prophet inequalities. In Proceedings of the 31st ACM-SIAM Symposium on Discrete Algorithms, pages 2066-2081, 2020. Google Scholar
  10. José R. Correa, Andrés Cristi, Boris Epstein, and José A. Soto. Sample-driven optimal stopping: From the secretary problem to the i.i.d. prophet inequality. Mathematics of Operations Research, 49(1):441-475, 2024. Google Scholar
  11. José R. Correa, Andrés Cristi, Laurent Feuilloley, Tim Oosterwijk, and Alexandros Tsigonias-Dimitriadis. The secretary problem with independent sampling. In Proceedings of the 32nd ACM-SIAM Symposium on Discrete Algorithms, pages 2047-2020, 2021. Google Scholar
  12. José R. Correa, Paul Dütting, Felix Fischer, and Kevin Schewior. Prophet inequalities for i.i.d. random variables from an unknown distribution. In Proceedings of the 20th ACM Conference on Economics and Computation, pages 3-17, 2019. Google Scholar
  13. José R. Correa, Paul Dütting, Felix Fischer, Kevin Schewior, and Bruno Ziliotto. Unknown iid prophets: Better bounds, streaming algorithms, and a new impossibility. arXiv preprint arXiv:2007.06110, 2020. Google Scholar
  14. Andres Cristi and Bruno ZiliottoFeng. Prophet inequalities require only a constant number of samples. In Proceedings of the 56th ACM Symposium on Theory of Computing, pages 491-502, 2024. Google Scholar
  15. Morris H. DeGroot. Optimal statistical decisions. McGraw-Hill, 1970. Google Scholar
  16. Peerapong Dhangwatnotai, Tim Roughgarden, and Qiqi Yan. Revenue maximization with a single sample. Games and Economic Behavior, 91(C):318-333, 2015. Google Scholar
  17. Rick Durrett. Probability: Theory and Examples. Cambridge University Press, 2019. Google Scholar
  18. Paul Dütting, Federico Fusco, Philip Lazos, Stefano Leonardi, and Rebecca Reiffenhäuser. Efficient two-sided markets with limited information. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 1452-1465, 2021. Google Scholar
  19. Paul Dütting and Thomas Kesselheim. Posted pricing and prophet inequalities with inaccurate priors. In Proceedings of the 20th Conference on Economics and Computation, pages 111-129, 2019. Google Scholar
  20. Paul Dütting, Silvio Lattanzi, Renato Paes Leme, and Sergei Vassilvitskii. Secretaries with advice. Mathematics of Operations Research, 2023. Google Scholar
  21. Yiding Feng, Jason D. Hartline, and Yingkai Li. Revelation gap for pricing from samples. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 1438-1451, 2021. Google Scholar
  22. Thomas S. Ferguson. Who solved the secretary problem? Statistical science, 4(3):282-289, 1989. Google Scholar
  23. Khashayar Gatmiry, Thomas Kesselheim, Sahil Singla, and Yifan Wang. Bandit algorithms for prophet inequality and pandora’s box. In Proceedings of the 35th Annual ACM-SIAM Symposium on Discrete Algorithms, pages 462-500, 2024. Google Scholar
  24. Nick Gravin, Hao Li, and Zhihao Gavin Tang. Optimal prophet inequality with less than one sample. In Proceedings of the 18th International Conference on Web and Internet Economics, pages 115-131, 2022. Google Scholar
  25. Theodore P. Hill and Ulrich Krengel. A prophet inequality related to the secretary problem. Contemporary Mathematics, 125:209-215, 1992. Google Scholar
  26. Wassily Hoeffding. Probability inequalities for sums of bounded random variables. The collected works of Wassily Hoeffding, pages 409-426, 1994. Google Scholar
  27. Benoît Iung, Eric Levrat, and Edouard Thomas. ‘Odds algorithm’-based opportunistic maintenance task execution for preserving product conditions. CIRP annals, 56(1):13-16, 2007. Google Scholar
  28. Haim Kaplan, David Naori, and Danny Raz. Competitive analysis with a sample and the secretary problem. In Proceedings of the 31st Annual ACM-SIAM Symposium on Discrete Algorithms, pages 2082-2095, 2020. Google Scholar
  29. Haim Kaplan, David Naori, and Danny Raz. Online weighted matching with a sample. In Proceedings of the 33rd Annual ACM-SIAM Symposium on Discrete Algorithms, pages 1247-1272, 2022. Google Scholar
  30. Ulrich Krengel and Louis Sucheston. On semiamarts, amarts, and processes with finite value. Probability on Banach spaces, 4:197-266, 1978. Google Scholar
  31. Eric Levrat, Edouard Thomas, and Benoît Iung. Odds-based decision-making tool for opportunistic production-maintenance synchronization. International Journal of Production Research, 46(19):5263-5287, 2008. Google Scholar
  32. Will Ma, David Simchi-Levi, and Chung-Piaw Teo. On policies for single-leg revenue management with limited demand information. Operations Research, 69(1):207-226, 2021. Google Scholar
  33. Pranav Nuti and Jan Vondrák. Secretary problems: The power of a single sample. In Proceedings of the 34th Annual ACM-SIAM Symposium on Discrete Algorithms, pages 2015-2029, 2023. Google Scholar
  34. Aviad Rubinstein, Jack Wang, and S. Matthew Weinberg. Optimal single-choice prophet inequalities from samples. In Proceedings of the 11th Innovations in Theoretical Computer Science Conference, pages 60:1-60:10, 2020. Google Scholar
  35. Mitsushi Tamaki. An optimal parking problem. Journal of Applied Probability, 19(4):803-814, 1982. Google Scholar
  36. Andrew C.-C. Yao. Probabilistic computations: Toward a unified measure of complexity. In Proceedings of the 18th Annual Symposium on Foundations of Computer Science, pages 222-227, 1977. Google Scholar
  37. Toru Yoshinaga and Yasushi Kawase. The last success problem with samples. arXiv preprint arXiv:2308.09356, 2023. Google Scholar
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2025 Schloss Dagstuhl – LZI GmbH About DROPS Imprint Privacy Contact