Sport Science and Human Performance: Step Seven: Writing your scoping review

Once you have decided which articles to include in your review, you need to extract relevant data from those studies.  This should be done in a structured and systematic way and is usually presented in tables in the final review report.

Tips:

• Extract only the data that is relevant to your research question
• Create a table or data collection form so that you can summarise the data consistently for each study
• Convert all the data to the same units of measurement, where possible
• Make sure your table headings can be easily interpreted by others
• Make sure any abbreviations or acronyms used in the table are explained in footnotes
• Pilot your data extraction method before you start – especially if more than one person is extracting the data.

Data can mean any information from a study including:

• Methods
• Participants
• Setting
• Context
• Interventions
• Outcome measures

Qualitative

• Meta-ethnography
• Thematic synthesis
• Grounded theory
• Content analysis
• Qualitative comparative analysis

NVivo software may be helpful for systematic reviews with qualitative data. 

Useful Tools

You can extract your data into a simple table, but if you want a more detailed approach there are a number of analysis tools that can help:

• NVivo (CSU supported and great for qualitative data analysis)
• PSPP (Open source software)
• JASP (Open source software)

The following links can also give guidance.

• Narrative synthesis

  Guidance from the Centre for Reviews and Dissemination for creating a textual summary of the relevant studies and analysing their robustness.

• Quantitative synthesis of comparative studies (meta-analysis)

  Also produced by CRD this link covers doing a statistical analysis of the combined results of the relevant studies.

• Data extraction tools

You will need to develop a synthesis, or critical overview, which integrates the key findings from all your included studies while considering the methodological quality and other pertinent features of each of those studies (such as the sample size, population, or context in which each one was conducted).     

Methods 

• Narrative, or descriptive. If you are not completing a full systematic review, or if you are comparing different study designs, this could be the best option. There are no strict rules, but you should try to minimise bias and maximise credibility by carefully exploring the relationships between studies and assessing the robustness of the synthesis.
   
• Qualitative synthesis methods: Meta-synthesis, Meta-study or Meta-aggregation. These methods synthesise the findings from very different types of studies, clustering common characteristics into categories or using interpretative tools.
• Meta-analysis: Used to synthesise the results of quantitative studies, this statistical technique results in an estimate of the “average” intervention effect. Data from different studies are weighted depending on the sample size and relevant criteria, and evaluated to work out a cumulative outcome. The results of a meta-analysis are often summarised in a forest plot. See:
  • Cochrane's Meta-analysis: What, why and how?
  • Forest plot at a glance

Tools     

• OpenMeta[Analyst] - open source, cross-platform software for meta-analysis
• OpenMEE - open source software for meta-analysis for ecologist and evolutionary biologists
• The Risk of Bias 2 (RoB 2) tool - Cochrane tool used to reduce risk in Systematic Reviews.

Need more help

• Jay.Evans@wintec.ac.nz
• help@wintec.ac.nz