Recent Posts

More Posts

In meta-analyses of psychology, education, and other social science research, it is very common that some of the included studies report more than one relevant effect size. For example, in a meta-analysis of intervention effects on reading outcomes, some studies may have used multiple measures of reading outcomes (each of which meets inclusion criteria), or may have measured outcomes at multiple follow-up times; some studies might have also investigated more than one version of an intervention, and it might be of interest to include effect sizes comparing each version to the no-intervention control condition; and it’s even possible that some studies may have all of these features, potentially contributing lots of effect size estimates.

CONTINUE READING

Rmarkdown documents now have a very nifty code folding option, which allows the reader of a compiled html document to toggle whether to view or hide code chunks. However, the feature is not supported in blogdown, the popular Rmarkdown-based website/blog creation package. I recently ran across an implementation of codefolding for blogdown, developed by Sébastien Rochette. I have been putzing around, trying to get it to work with my blog, which uses the Hugo Academic theme—alas, to no avail.

CONTINUE READING

At AERA this past weekend, one of the recurring themes was how software availability (and its usability and default features) influences how people conduct meta-analyses. That got me thinking about the R packages that I’ve developed, how to understand the extent to which people are using them, how they’re being used, and so on. I’ve had badges on my github repos for a while now: clubSandwich: ARPobservation: scdhlm: SingleCaseES: These statistics come from the METACRAN site, which makes available data on daily downloads of all packages on CRAN (one of the main repositories for sharing R packages).

CONTINUE READING

This year, Dr. Laura Dunne and I are serving as program co-chairs for the AERA special interest group on Systematic Reviews and Meta-Analysis, which is a great group of scholars interested in the methodology and application of research synthesis to questions in education and the broader social sciences. We had a strong batch of submissions to the SIG and (since we’re new and still a fairly small group) only a few sessions to fill with them.

CONTINUE READING

I’m just back from the Society for Research on Educational Effectiveness meetings, where I presented work on small-sample corrections for cluster-robust variance estimators in two-stage least squares models, which I’ve implemented in the clubSandwich R package. Here’s my presentation. So I had “clubSandwich” estimators on the brain when a colleague asked me about whether the methods were implemented in SAS. The short answer is “no.” The moderately longer answer is “not unless we can find funding to pay someone who knows how to program properly in SAS.

CONTINUE READING

Recent Publications

More Publications

(2019). Interventions to enhance self-efficacy in cancer patients and survivors: A meta-analysis of randomized controlled trials. Psycho-Oncology, forthcoming.

Dataset Journal

(2019). Examining the effects of social stories on challenging behavior and prosocial skills in young children: A systematic review and meta-analysis. Topics in Early Childhood Special Education, forthcoming.

Preprint Code Dataset Journal

(2019). Effects of psychosocial interventions on meaning and purpose in adults with cancer: A systematic review and meta-analysis. Cancer, forthcoming.

Journal

(2019). An examination of measurement procedures and characteristics of baseline outcome data in single-case research. Behavior Modification, forthcoming.

Preprint Code Dataset Journal

(2019). Procedural sensitivities of effect sizes for single-case designs with behavioral outcome measures. Psychological Methods, 24(2), 217-235.

Preprint Supplementary materials Journal

Recent Presentations

More Talks

A generalized excess significance test for selective outcome reporting with dependent effect sizes
2019-07-22 — Society for Research Synthesis Methodology annual meeting, Chicago, IL.
Slides
Log response ratio effect sizes: Rationale and methods for single case designs with behavioral outcomes
2019-05-26 — Association for Behavior Analysis International Annual Convention, Chicago, IL.
Slides
Evaluating meta-analytic methods to detect outcome reporting bias in the presence of dependent effect sizes
2019-04-08 — American Educational Research Association annual convention, Toronto, Ontario.
Poster
The impact of response-guided designs on count outcomes in single-case design baselines
2019-04-07 — American Educational Research Association annual convention, Toronto, Ontario.
Poster
An examination of measurement procedures and baseline behavioral outcomes in single-case research
2019-04-07 — American Educational Research Association annual convention, Toronto, Ontario.
PDF Poster

Software

ARPobservation

Simulate systematic direct observation data.

SingleCaseES

Single-case design effect size calculator.

clubSandwich

cluster-robust variance estimation.

scdhlm

Between-case SMD for single-case designs.

Teaching

Causal Inference
Data Analysis, Simulation, and Programming in R
Research Design and Methods for Psychology and Education
Statistical Analysis of Experimental Data

Contact

Topics