An Applied Researchers' Guide to Estimating Effects from Blocked Cluster Randomized Trials: Estimands, Estimators, and Estimates. EdWorkingPaper No. 26-1537

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: An Applied Researchers' Guide to Estimating Effects from Blocked Cluster Randomized Trials: Estimands, Estimators, and Estimates. EdWorkingPaper No. 26-1537
Γλώσσα: English
Συγγραφείς: Luke Miratrix, Michael J. Weiss, Sophie Litschwartz, Colin Hill, Kayla Warner, Annenberg Institute for School Reform at Brown University
Πηγή: Annenberg Institute for School Reform at Brown University. 2026.
Διαθεσιμότητα: Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
Peer Reviewed: N
Page Count: 128
Ημερομηνία έκδοσης: 2026
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305D220046
Intended Audience: Researchers
Τύπος εγγράφου: Reports - Research
Descriptors: Computation, Randomized Controlled Trials, Error of Measurement, Effect Size, Regression (Statistics), Hierarchical Linear Modeling, Statistical Analysis, Selection, Statistical Bias
Περίληψη: Blocked cluster randomized trials (CRTs) are widely used to evaluate educational interventions. In such trials, researchers face critical choices about how to define and estimate the average treatment effect (ATE). These choices--both the estimand (e.g., person- vs. cluster-weighted) and the estimator (e.g., regression models, multilevel models)--can influence study conclusions. This paper provides an applied guide to estimands and estimators for blocked CRTs and empirically examines their performance using 26 large-scale blocked CRTs. We estimate ATEs and standard errors for 50 outcomes using 19 estimators and compare results across and within estimands. Findings show that estimator choice can substantially affect point estimates and precision: ranges in ATE estimates exceed 0.10 SD in 18% of cases, and standard error estimates differ by more than 50% in 16% of cases. Some estimators fail or produce unstable results in common real-world designs. These findings underscore the importance of pre-specifying estimation strategies in a public pre-analysis plan. We provide practical guidance for researchers planning and analyzing blocked CRTs.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 20260101
Αριθμός Καταχώρησης: ED682079
Βάση Δεδομένων: ERIC
Περιγραφή
Η περιγραφή δεν είναι διαθέσιμη