The Advanced Methods / Applied Topics

The following videos offer advanced methods training for conducting systematic reviews.
Who is the intended audience of these training videos?

•    Researchers with experience carrying out a systematic review
•    Researchers with previous systematic review training
•    Policymakers interesting in developing a more advanced understanding of systematic reviews and evidence-based policy
•    Evaluation researchers

The videos below were recorded during the August 2011 Campbell Colloquium at George Mason University (Washington, D.C.), and the May 2013 Campbell Colloquium at Loyola University Chicago (Chicago, IL).
 
Please note that the videos have not been organized in a particular order.
 
Calculating Effect Sizes: Advanced
This training video guides participants through computing standardized mean difference, odds ratios, and correlation effect sizes from information reported in study reports. Special attention is given to the dilemmas that arise when primary studies do not provide the required statistics for calculating effect sizes.

Presented by David B. Wilson, Campbell Crime and Justice Coordinating Group Editor, and Professor/Chair at the Department of Criminology, Law and Society, George Mason University.
 
 
Presentation file

Moderator Analysis (Categorical Models and Meta-Regression)
This video reviews methods for assessing effect size moderators in a meta-analysis, analysis of variance and meta-regression models. It also examines the strengths and limitations of various moderator analysis methods and touches on some of common dilemmas that are encountered while conducting a moderator analysis for a Campbell systematic review.

Presented by Ryan Williams, former Managing Editor of the Campbell Methods Coordinating Group, and Assistant Professor of Counseling, Educational Psychology, and Research, University of Memphis.
 

 

Presentation file
 
Fixed vs. Random Effects Models
This training video provides participants with an overview of the differences between fixed and random effects analysis models in meta-analysis, and the issues reviewers should consider while making a choice between these models. Participants have the opportunity to go through computational examples comparing fixed and random effects models to see how the two models differ in the types of statistical inferences that they support.

Presented by Terri Pigott, Campbell Methods Coordinating Group Editor, and Professor of Research Methodology, Loyola University Chicago.
 

 
Presentation file
 
Cluster Adjustments in Computing Effect Sizes
This training video shows participants how to calculate effect size statistics when primary studies use cluster randomized designs (e.g., assigning schools or teachers to an intervention), and the analytic issues that arise when including cluster level studies. Topics covered include an overview of when cluster adjustments to effect size statistics are necessary, analysis methods for cluster adjustments, and how to deal with research literatures that have both individual level and cluster level effect sizes.

Presented by Terri Pigott, Campbell Methods Coordinating Group Editor, and Professor of Research Methodology, Loyola University Chicago.
 

 
Presentation file

Using Robust Standard Errors for Dependent Effect Sizes
These videos provide an overview of the use of robust standard errors for analyzing dependent effect size estimates. The most common form of dependence occurs when studies provide multiple measures of the same underlying construct (e.g., self-reports and parent-reports of child behavior). The training goes over when robust standard errors are needed and points out the available software for using this approach. Participants are also guided through a demonstration of how to analyze and interpret results from meta-regression models using robust standard errors.

Presented by Elizabeth Tipton, Assistant Professor of Applied Statistics, Teachers College, Columbia University;Emily Tanner-Smith, Campbell Methods Coordinating Group Associate Editor, and Research Associate at the Peabody Research Institute, Vanderbilt University; and, Mark Lipsey, former Campbell Steering Group Co-chair, Director of the Peabody Research Institute and Research Professor of Public Policy, Vanderbilt University.

Presentation file
 
 
 
Measuring and Assessing Study Quality
This video discusses best practices for measuring the quality of primary studies included in a systematic review and for assessing the impact of study quality on review findings. It also examines common issues that arise when considering study quality in a Campbell review.

Presented by Jeffrey C. Valentine, Campbell Training Group Chair, and Associate Professor at the Department of Educational and Counseling Psychology, University of Louisville.
 
 
Presentation file
 
Graphical Displays in Meta-Analysis
This training video reviews common graphical displays used in meta-analysis, discusses software options for creating meta-analysis graphs, and provides  suggestions on how to produce efficient graphical displays of meta-analysis findings for Campbell reviews.

Presented by Emily Tanner-Smith, Campbell Methods Coordinating Group Associate Editor, and Research Associate at the Peabody Research Institute, Vanderbilt University
 

Presentation file.

Interpreting the Practical Significance of Meta-Analysis Findings
This training video will provide guidance on the how to interpret findings from meta-analysis in ways that are meaningful to users of Campbell reviews. The video presents different methods available for the interpretation of meta-analysis findings, with particular focus on interpreting the magnitude of mean effect size estimates in a Campbell review.
 
Presented by Mark Lipsey, former Campbell Steering Group Co-chair, Director of the Peabody Research Institute and Research Professor of Public Policy, Vanderbilt University.
 

Recorded & edited by Synthesis Multimedia Production (our endorsement).

Contact Us

  • P.O. Box 4404, Nydalen,
    N-0403 Oslo, Norway
  • (+47) 21 07 70 00
  • (+47) 23 25 50 10
  • Web: tkristiansen@campbellcollaboration.org
  •  info@campbellcollaboration.org