Academic Journal
Estimation and inference for step-function selection models in meta-analyses with dependent effects.
| Τίτλος: | Estimation and inference for step-function selection models in meta-analyses with dependent effects. |
|---|---|
| Συγγραφείς: | Pustejovsky JE; School of Education, University of Wisconsin-Madison, USA., Citkowicz M; American Institutes for Research, USA., Joshi M; American Institutes for Research, USA. |
| Πηγή: | Research synthesis methods [Res Synth Methods] 2026 Sep 21, pp. 1-34. Date of Electronic Publication: 2026 Sep 21. |
| Publication Model: | Ahead of Print |
| Τύπος έκδοσης: | Journal Article |
| Γλώσσα: | English |
| Στοιχεία περιοδικού: | Publisher: Wiley Blackwell Country of Publication: England NLM ID: 101543738 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1759-2887 (Electronic) Linking ISSN: 17592879 NLM ISO Abbreviation: Res Synth Methods Subsets: MEDLINE |
| Imprint Name(s): | Publication: Original Publication: Malden, MA : John Wiley & Sons, 2010- |
| Περίληψη: | Meta-analyses in social science fields face multiple methodological challenges arising from how primary research studies are designed and reported. One challenge is that many primary studies report multiple relevant effect size estimates, leading to a data structure with dependent observations. Another is selective reporting bias, which arises when the availability of study findings is influenced by the statistical significance of results. Although many selective reporting diagnostics and bias-correction methods have been proposed, few are suitable for meta-analyses involving dependent effect sizes. Among available methods, step-function selection models are conceptually appealing and have shown promise in previous simulations, but tend to understate uncertainty in parameter estimates if dependent effects are ignored. We study methods for estimating step-function models from data involving dependent effect sizes, focusing specifically on estimating parameters of the marginal distribution of effect sizes and accounting for dependence using cluster-robust variance estimation or bootstrap resampling. We describe two estimation strategies, demonstrate them by re-analyzing data from a previous synthesis on ego depletion effects, and evaluate their performance through an extensive simulation study under both univariate and multivariate selection processes. Simulation findings indicate that selection models provide low-bias estimates of average effect size and clustered bootstrap confidence intervals provide acceptable coverage levels for meta-analyses with at least 30 studies. Although unadjusted estimates are more efficient when selective reporting is absent or minimal, the proposed methods provide a robust and useful approach for evaluating the potential biases arising when selective reporting is present in meta-analyses with dependent effects. |
| Grant Information: | R305D220026 Institute of Education Sciences |
| Contributed Indexing: | Keywords: dependent effect sizes; meta-analysis; publication bias; selection models; selective reporting |
| Entry Date(s): | Date Created: 20260921 Latest Revision: 20260921 |
| Update Code: | 20260921 |
| DOI: | 10.1017/rsm.2026.10117 |
| PMID: | 42764536 |
| Βάση Δεδομένων: | MEDLINE |
| ISSN: | 1759-2887 |
|---|---|
| DOI: | 10.1017/rsm.2026.10117 |