Presentations & Posters

2023

Discussion of Stabilizing measures to reconcile accuracy and equity in performance measurement

2023-09-29 4:30 PM Society for Research on Educational Effectiveness Conference Arlington, VA
Slides

Equity-related moderator analysis in syntheses of dependent effect sizes: Conceptual and statistical considerations

Background/Context In meta-analyses examining educational interventions, researchers seek to understand the distribution of intervention impacts, in order to draw generalizations about what works, for whom, and under what conditions. One common way to examine equity implications in such reviews is through moderator analysis, which involves modeling how intervention effect sizes vary depending on the characteristics of primary study participants.
2023-09-27 4:15 PM Society for Research on Educational Effectiveness Conference Arlington, VA
Slides

Determining the Timing of Phase Changes: Some Statistical Perspective

2023-05-18 9:00 AM Wing Institute Single Case Conference 2023 Nashville, TN
Slides

Calculating Effect Sizes for Single-Case Research: An Introduction to the SingleCaseES and scdhlm Web Applications and R Packages

This workshop will provide an introduction to effect size calculations for single-case research designs, focused on two interactive web applications (or “apps”) and accompanying R packages. I will …
2023-04-26 11:00 AM Small is Beautiful {Once More} online
Slides Data

Effect size measures for single-case research: Conceptual, practical, and statistical considerations

Quantitative analysis of single-case research and n-of-1 experiments often focuses on calculation of effect size measures, or numerical indices describing the direction and strength of an …
2023-04-25 8:00 AM Small is Beautiful {Once More} online
Slides

Empirical benchmarks for between-case standardized mean differences from single-case multiple baseline designs examining academic interventions.

The between-case standardized mean difference (BC-SMD) is an effect size measure for single-case designs (SCDs) that it puts findings on the same scale as standardized mean differences for …
2023-04-16 11:40 AM American Educational Research Association annual convention Chicago, IL
Slides

Discussion of ‘Moving from What Works to What Replicates: Promoting the Systematic Replication of Results.’

2023-04-15 2:50 PM American Educational Research Association annual convention Chicago, IL
Slides

Clustered bootstrapping for selective reporting models in meta-analysis with dependent effects

In many fields, quantitative meta-analyses involve dependent effect sizes, which occur when primary studies included in a synthesis contain more than one relevant estimate of the relation between …
2023-03-30 8:00 AM Evidence Synthesis and Meta-Analysis in R Conference online
Code Slides Video

2022

A matter of emphasis: Comparison of working models for meta-analysis of dependent effect sizes

2022-07-20 2:50 PM Society for Research Synthesis Methodology annual meeting Portland, OR (and online)
Slides

The state of single case synthesis: Premises, tools, and possibilities

2022-05-19 1:00 PM Spencer Single Case Conference Vanderbilt University, Nashville, TN
Slides

Selective reporting in meta-analysis of dependent effect size estimates

Publication bias and other forms of selective outcome reporting are important threats to the validity of findings from research syntheses—even undermining their special status for informing evidence-based practice and policy guidance.
2022-02-08 6:00 PM Stanford Quantitative Sciences Unit Research Methods Seminar online
Slides

Easy, cluster-robust standard errors with the clubSandwich package

Cluster-robust variance estimation methods (also known as sandwich estimators, linearization estimators, or simply “clustered” standard errors) are a standard inferential tool in many …
2022-02-03 10:00 AM Oslo R User Group Meetup online
Slides Video

2021

Four things every quantitative social scientist should know about meta-analysis

Meta-analysis is a set of statistical tools for synthesizing results across multiple sources of evidence. Meta-analyses of intervention research are often taken as a gold standard for informing …
2021-09-27 10:00 AM Educational Psychology PIE Colloquium Educational Sciences 259
Slides

Synthesis of dependent effect sizes: Robust variance estimation with clubSandwich

Large meta-analyses often involve dependent effect sizes, but where the exact form of the dependence is unknown. Meta-analysis with robust variance estimation handles this problem through …
2021-09-02 10:00 AM Oslo R User Group Meetup online
PDF Slides Video

Statistical frontiers for selective reporting and publication bias

This workshop will cover methods to investigate selective reporting in meta-analysis of statistically dependent effect sizes, which are a common feature of systematic reviews in psychology. The workshop is organized into two sections.
2021-06-23 12:30 PM Society for the Improvement of Psychological Science 2021 meeting online
Code Slides

Synthesis of dependent effect sizes: Versatile models through metafor and clubSandwich

Across scientific fields, large meta-analyses often involve dependent effect size estimates. Robust variance estimation (RVE) methods provide a way to include all dependent effect sizes in a single …
2021-01-21 9:00 AM Evidence Synthesis and Meta-Analysis in R Conference online
PDF Slides Video

2019

A generalized excess significance test for selective outcome reporting with dependent effect sizes

2019-07-22 1:30 PM Society for Research Synthesis Methodology annual meeting Chicago, IL
Slides

Log response ratio effect sizes: Rationale and methods for single case designs with behavioral outcomes

2019-05-26 5:00 PM Association for Behavior Analysis International Annual Convention Chicago, IL
Slides

Evaluating meta-analytic methods to detect outcome reporting bias in the presence of dependent effect sizes

2019-04-08 12:00 AM American Educational Research Association annual convention Toronto, Ontario
PDF

The impact of response-guided designs on count outcomes in single-case design baselines

2019-04-07 12:00 AM American Educational Research Association annual convention Toronto, Ontario
PDF

An examination of measurement procedures and baseline behavioral outcomes in single-case research

2019-04-07 12:00 AM American Educational Research Association annual convention Toronto, Ontario
PDF

Small-sample cluster-robust variance estimators for two-stage least squares models

2019-03-08 12:00 AM Society for Research on Educational Effectiveness Conference Washington, DC
Slides

2018

Combining robust variance estimation with models for dependent effect sizes

2018-10-01 12:00 PM UT Austin, Developmental & Clinical Psychology Brownbag Austin, TX
Code Slides

Combining robust variance estimation with models for dependent effect sizes

2018-07-18 9:00 AM Society for Research Synthesis Methodology annual meeting Bristol, UK
Slides

Meta-analysis of single-case research: A brief and breezy tour

2018-04-15 8:15 AM American Educational Research Association annual convention New York, NY
Slides

Meta-analysis of dependent effects: A review and consolidation of methods

2018-04-15 8:15 AM American Educational Research Association annual convention New York, NY
Slides

Randomization inference for single-case experimental designs

2018-01-10 8:15 AM Institute of Education Sciences 2018 Principal Investigators Meeting Washington, DC
Slides

A gradual effects model for single case designs

2018-01-10 8:15 AM Institute of Education Sciences 2018 Principal Investigators Meeting Washington, DC
PDF

2017

Heteroskedasticity-robust tests in linear regression: A review and evaluation of small-sample corrections

2017-04-30 12:00 AM American Educational Research Association annual convention San Antonio, TX
Slides

Using response ratios for meta-analyzing single-case designs with behavioral outcomes

2017-04-28 12:00 AM American Educational Research Association annual convention San Antonio, TX
PDF

A nonlinear intervention analysis model for treatment reversal single-case designs

2017-04-28 12:00 AM American Educational Research Association annual convention San Antonio, TX
PDF

Small sample corrections for use of cluster-robust standard errors in the analysis of school-based experiments

2017-03-02 12:00 AM Society for Research on Educational Effectiveness Conference Washington, DC
Slides

2016

Effect sizes for single-case research

2016-12-19 12:00 AM Institute of Education Sciences 2016 Principal Investigators Meeting Washington, DC
Slides

Small-sample methods for cluster-robust variance estimation and hypothesis testing in fixed effects models

2016-07-31 12:00 AM Joint Statistical Meetings Chicago, IL
Slides

When large samples act small: The importance of small-sample adjustments for cluster-robust inference in impact evaluations

2016-07-18 12:00 AM American Institutes for Research Impact Working Group Lecture Series Austin, TX
Slides

When large samples act small: Cluster-robust variance estimation and hypothesis testing with few clusters

2016-02-19 12:00 AM Population Research Center colloquium Austin, TX
Slides

2015

Small-sample adjustments for multiple-contrast hypothesis tests of meta-regressions using robust variance estimation

2015-07-08 12:00 AM Society for Research Synthesis Methods annual meeting Nashville, TN
PDF Slides

Operational sensitivities of non-overlap effect sizes for single-case experimental designs

2015-04-19 12:00 AM American Educational Research Association annual convention Chicago, IL
PDF

Small-sample adjustments for F-tests using robust variance estimation in meta-regression

2015-04-18 12:00 AM American Educational Research Association annual convention Chicago, IL
PDF Slides

Observation procedures and Markov Chain models for estimating the prevalence and incidence of a state behavior

2015-04-16 12:00 AM American Educational Research Association annual convention Chicago, IL
PDF Slides

Small-sample adjustments for tests of moderators and model fit using robust variance estimation in meta-regression

2015-03-06 12:00 AM Society for Research on Educational Effectiveness Conference Washington, DC
Slides

2014

Four methods of analyzing partial interval recording data, with application to single-case research

2014-04-04 12:00 AM American Educational Research Association annual convention Philadelphia, PA
PDF

Addressing construct invalidity in partial interval recording data

2014-03-21 12:00 AM Texas Universities Educational Statistics and Psychometrics Meeting Texas A&M University, College Station, TX
Slides

On internal validity in multiple baseline designs

2014-03-06 12:00 AM Society for Research on Educational Effectiveness Conference Washington, DC
Slides

2013

Some Markov models for direct observation of behavior

2013-05-29 12:00 AM Department of Statistics, Northwestern University Evanston, IL
Slides

Effect sizes and measurement comparability for meta-analysis of single-case research

2013-05-28 12:00 AM Association for Behavior Analysis International annual convention Minneapolis, MN
Slides

Observation procedures and Markov chain models for estimating the prevalence and incidence of a behavior

2013-04-30 12:00 AM American Educational Research Association annual convention San Francisco, CA
PDF

Operationally comparable effect sizes for meta-analysis of single-case research

2013-03-07 12:00 AM Society for Research on Educational Effectiveness Conference Washington, DC
Slides

2012

Some implications of behavioral observation procedures for meta-analysis of single-case research

2012-11-14 12:00 AM Presentation at the Department of Educational Psychology, College of Education, University of Texas at Austin Austin, TX
Slides

2008

Question-order effects in social network name generators

2008-01-23 12:00 AM International Sunbelt Social Network Conference St. Petersburg Beach, FL
PDF