Λεπτομέρειες βιβλιογραφικής εγγραφής
| Τίτλος: |
Getting the Most Out of A/B Tests Using the Asymptotic Minimax-Regret Criteria. |
| Συγγραφείς: |
Joo, Joonhwi1 (AUTHOR) joonhwi.joo@utdallas.edu, Chiong, Khai X.1 (AUTHOR) khai.chiong@utdallas.edu |
| Πηγή: |
Management Science (INFORMS). May2026, Vol. 72 Issue 5, p4450-4473. 24p. |
| Θεματικοί όροι: |
*Decision theory, *Marketing strategy, *Monte Carlo method, *Business revenue, Effect sizes (Statistics), Control groups |
| Περίληψη: |
Many firms conduct A/B tests to find a marketing action that improves a value of interest, such as revenue or profit. We develop the asymptotic minimax regret (AMMR) criterion, a practical decision-theoretic approach for choosing among binary marketing actions based on A/B tests. The AMMR is a general large-sample approximation of the minimax-regret criterion from a frequentist standpoint. Our method directly optimizes the decision-relevant metric, accounting for the product of the error probability and the associated magnitude of value loss. Implementing the AMMR decision rule is straightforward; it comprises simply comparing the standardized treatment-effect estimate to the AMMR-optimal decision threshold. The AMMR suggests selecting the treatment whenever the point estimate is positive, as this minimizes the maximum expected net loss from decision errors. A case study of a mobile game company's A/B testing with Monte Carlo validation demonstrates that the AMMR decision rule effectively selects the optimal marketing action and improves revenue across various data-generating processes. This paper was accepted by Raphael Thomadsen, marketing. Funding: K. X. Chiong gratefully acknowledges the financial support from the NEC Foundation of America. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2024.06590. [ABSTRACT FROM AUTHOR] |
|
Copyright of Management Science (INFORMS) is the property of INFORMS: Institute for Operations Research & the Management Sciences and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Βάση Δεδομένων: |
Business Source Index |
