Academic Journal

A Two-Part Machine Learning Approach to Characterizing Network Interference in A/B Testing.

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: A Two-Part Machine Learning Approach to Characterizing Network Interference in A/B Testing.
Συγγραφείς: Yuan, Yuan1 (AUTHOR) yuyuan@ucdavis.edu, Altenburger, Kristen M.2 (AUTHOR) kaltenburger@meta.com
Πηγή: Manufacturing & Service Operations Management (M&SOM) (INFORMS). Nov/Dec2025, Vol. 27 Issue 6, p1832-1850. 19p.
Θεματικοί όροι: *Marketing effectiveness, *Network effect, Machine learning, Social network theory, Automation software, Comparative studies, Causal inference
Περίληψη: Problem definition: The reliability of controlled experiments, commonly referred to as "A/B tests," is often compromised by network interference, where the outcomes of individual units are influenced by interactions with others. Significant challenges in this domain include the lack of accounting for complex social network structures and the difficulty in suitably characterizing network interference. Methodology/results: To address these challenges, we propose a machine learning-based method. We introduce "causal network motifs" and utilize transparent machine learning models to characterize network interference patterns underlying an A/B test on networks. Our method's performance has been demonstrated through simulations on both a synthetic experiment and a large-scale test on Instagram. Our experiments show that our approach outperforms conventional methods such as design-based cluster randomization and conventional analysis-based neighborhood exposure mapping. Managerial implications: Our approach provides a comprehensive and automated solution to address network interference for A/B testing practitioners. This aids in informing strategic business decisions in areas such as marketing effectiveness and product customization. Supplemental Material: The online appendix is available at https://doi.org/10.1287/msom.2023.0462. [ABSTRACT FROM AUTHOR]
Copyright of Manufacturing & Service Operations Management (M&SOM) (INFORMS) is the property of INFORMS: Institute for Operations Research & the Management Sciences and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Βάση Δεδομένων: Business Source Index
Περιγραφή
ISSN:15234614
DOI:10.1287/msom.2023.0462