Recent Posts

More Posts

In settings with independent observations, sample size is one way to quickly characterize the precision of an estimate. But what if your estimate is based on weighted data, where each observation doesn’t necessarily contribute to equally to the estimate? Here, one useful way to gauge the precision of an estimate is the effective sample size or ESS. Suppose that we have \(N\) independent observations \(Y_1,...,Y_N\) drawn from a population with standard deviation \(\sigma\), and that observation \(i\) receives weight \(w_i\).

CONTINUE READING

Earlier this month, I taught at the Summer Research Training Institute on Single-Case Intervention Design and Analysis workshop, sponsored by the Institute of Education Sciences’ National Center for Special Education Research. While I was there, I shared a web-app for simulating data from a single-case design. This is a tool that I put together a couple of years ago as part of my ARPobservation R package, but haven’t ever really publicized or done anything formal with.

CONTINUE READING

I’m very happy to share a new paper, co-authored with my student Danny Swan, “A gradual effects model for single-case designs,” which is now available online at Multivariate Behavioral Research. You can access the published version at the journal website (click here for free access while supplies last) or the pre-print on PsyArxiv (always free!). Here’s the abstract and the supplementary materials. Danny wrote R functions for fitting the model, (available as part of the SingleCaseES package) as well as a slick web interface, if you prefer to point-and-click.

CONTINUE READING

Last night I attended a joint meetup between the Austin R User Group and R Ladies Austin, which was great fun. The evening featured several lightning talks on a range of topics, from breaking into data science to network visualization to starting your own blog. I gave a talk about sandwich standard errors and my clubSandwich R package. Here are links to some of the talks: Caitlin Hudon: Getting Plugged into Data Science Claire McWhite: A quick intro to networks Nathaniel Woodward: Blogdown Demo!

CONTINUE READING

Consider Pearson’s correlation coefficient, \(r\), calculated from two variables \(X\) and \(Y\) with population correlation \(\rho\). If one calculates \(r\) from a simple random sample of \(N\) observations, then its sampling variance will be approximately \[ \text{Var}(r) \approx \frac{1}{N}\left(1 - \rho^2\right)^2. \] But what if the observations are drawn from a multi-stage sample? If one uses the raw correlation between the observations (ignoring the multi-level structure), then the \(r\) will actually be a weighted average of within-cluster and between-cluster correlations (see Snijders & Bosker, 2012).

CONTINUE READING

Recent Publications

More Publications

(2019). Current practices in meta-regression in psychology, education, and medicine. Research Synthesis Methods, forthcoming.

Preprint Dataset Journal

(2018). A history of meta-regression: Technical, conceptual, and practical developments between 1974 and 2018. Research Synthesis Methods, forthcoming.

Preprint Journal

(2018). Testing for funnel plot asymmetry of standardized mean differences. Research Synthesis Methods, forthcoming.

Preprint Code Journal

(2018). Small sample methods for cluster-robust variance estimation and hypothesis testing in fixed effects models. Journal of Business and Economic Statistics, 36(4), 672–683.

Preprint Journal R package

(2018). Between-case standardized effect size analysis of single case design: Examination of the two methods. Research in Developmental Disabilities, 79, 88-96.

Journal

Recent Presentations

More Talks

Combining robust variance estimation with models for dependent effect sizes
2018-10-01 — UT Austin, Developmental & Clinical Psychology Brownbag, Austin, TX.
Slides Code
Combining robust variance estimation with models for dependent effect sizes
2018-07-18 — Society for Research Synthesis Methodology annual meeting, Bristol, UK.
Slides
Meta-analysis of dependent effects: A review and consolidation of methods
2018-04-15 — American Educational Research Association annual convention, New York, NY.
Slides
Meta-analysis of single-case research: A brief and breezy tour
2018-04-15 — American Educational Research Association annual convention, New York, NY.
Slides
A gradual effects model for single case designs
2018-01-10 — Institute of Education Sciences 2018 Principal Investigators Meeting, Washington, DC.
Poster

Software

ARPobservation

Simulate systematic direct observation data.

SingleCaseES

Single-case design effect size calculator.

clubSandwich

cluster-robust variance estimation.

scdhlm

Between-case SMD for single-case designs.

Teaching

Causal Inference
Data Analysis, Simulation, and Programming in R
Research Design and Methods for Psychology and Education
Statistical Analysis of Experimental Data

Contact

Topics