How to Conduct a Systematic Literature Review | A Comprehensive Guide to Write a Systematic Review of the Literature

What is a Systematic Literature Review? Understanding the Key Concepts

Definition of Systematic Literature Review

• A systematic literature review is a rigorous, methodical approach used to identify, evaluate, and synthesize existing research on a specific topic.
• It follows a structured, predefined methodology to ensure a reproducible process, minimizing bias and improving transparency.
• The goal of a systematic literature review is to offer a comprehensive summary of evidence, typically in response to a research question.

Key Components of a Systematic Literature Review

• Database: Research starts with thorough searches of multiple databases to identify relevant studies. Common sources include PubMed, Scopus, and Google Scholar.
• Inclusion and Exclusion Criteria: These are set criteria to determine which studies will be part of the systematic literature review. Inclusion and exclusion criteria ensure the focus remains on studies with methodological relevance to the research question.
• Grey Literature: Unpublished studies, reports, and other non-peer-reviewed documents are considered grey literature. Including them can enhance the breadth of the review.
• Checklist: The PRISMA checklist is a common tool used to ensure transparency and comprehensiveness in the systematic literature review process.

The Role of Systematic Review Methodology in Research

• A systematic literature review is a type of evidence synthesis and is considered evidence-based due to its rigorous, structured approach to data collection and analysis.
• It involves synthesizing both qualitative and quantitative studies, depending on the research question.
• A meta-analysis is often used within the systematic review and meta-analysis framework. It combines results from multiple studies to provide a more precise estimate of effect sizes.
• Review methods like review and meta-analysis can help synthesize results in a more standardized way, offering better insight into the research field.
• Researchers use a systematic review to gather evidence-based findings, allowing them to make sound conclusions that are reproducible and relevant to both the social science and broader academic communities.

The systematic literature review methodology offers a reliable, reproducible approach to synthesizing research. It ensures that evidence is accurately gathered and evaluated, making it a cornerstone for high-quality academic work.

The 7-Step Process for Conducting a Systematic Literature Review

Conducting a systematic literature review (SLR) is a rigorous process that involves a structured, systematic way of evaluating and synthesizing the research evidence on a particular topic. It is essential for researchers who aim to answer specific research questions using the best available evidence. The process is methodical, ensuring that all relevant studies are included and that the review is reproducible. Below is an in-depth explanation of the 7-step process for conducting a systematic literature review.

Step 1: Define Your Research Question for the Systematic Review

• Clarify your research question: The first step when conducting a systematic review is to precisely define the research question. The research question will guide the entire process, including study selection and data analysis.
  • It’s essential to ensure the question is focused and narrow enough to make the review manageable.
  • This question will also inform the inclusion and exclusion criteria for selecting studies later on.
• Consider the type of review: Are you conducting a narrative review, systematic review, or meta-analysis? Identifying the type of review early on helps set the direction for your research and ensures that all necessary steps are taken.
• Use PICO(T): A common framework for research questions is PICO(T) (Population, Intervention, Comparison, Outcome, Time) to help structure the question and focus the review on relevant studies.

Step 2: Develop a Protocol for the Systematic Review

• Create a detailed protocol: Before conducting a systematic literature review, you need to establish a protocol that outlines how the review will be conducted. This is a critical step because it ensures transparency and consistency throughout the process.
  • The protocol should include the inclusion and exclusion criteria, methods used for study selection, quality assessment, and the process for data synthesis.
  • The protocol should be registered in an appropriate database, such as PROSPERO, for transparency.
• Follow the PRISMA guidelines: The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist is an essential tool for conducting a systematic review. It ensures that the review process is thorough and includes all necessary elements.

Step 3: Execute Comprehensive Search Strategies

• Develop a systematic search: One of the defining characteristics of a systematic literature review is the comprehensive search strategy. You need to search various databases (e.g., Web of Science, PubMed, Google Scholar) to gather all relevant studies.
  • Use Boolean operators (AND, OR, NOT) and other systematic review methods to ensure your search is exhaustive and includes both published and unpublished studies.
  • Consider using library guides from universities to assist with your search strategies and refine your methods for identifying relevant literature.
• Identify relevant studies: The aim is to include studies that meet the inclusion and exclusion criteria while ensuring that the research is highly relevant to your research question.

Step 4: Study Selection and Data Extraction

• Screen studies: After executing the systematic search, begin the process of study selection. This involves reviewing the titles, abstracts, and full texts of studies to determine which ones meet the inclusion criteria.
  • Inclusion and exclusion criteria should be applied rigorously to ensure only relevant studies are selected.
  • Data extraction involves collecting information from each study, such as study design, sample size, methodologies used, and outcomes measured.
• Utilize a flow diagram: A flow diagram is a helpful tool in visually mapping out the study selection process, making it easier to track how many studies were included and excluded and why.

Step 5: Quality Assessment of Included Studies

• Assess the quality of the literature: Once studies are selected, it’s crucial to assess their quality to ensure that only robust, reliable studies are included in the systematic review.
  • Use established quality assessment tools, such as the Cochrane Reviews tool or critical appraisal tools specific to your field.
  • Assess the methodological rigor of each study, including its design, sample size, and types of research methods used.
• Consider the quality and quantity of literature: A good systematic literature review not only evaluates the quantity of relevant literature but also critically appraises its quality. This will influence the strength of your review findings.

Step 6: Data Synthesis and Analysis

• Synthesize the results: The next step in conducting a systematic review is synthesizing the data from the selected studies.
  • Depending on the type of systematic review, you might conduct a meta-analysis to quantitatively combine the results of the studies.
  • Alternatively, you might use a narrative review to qualitatively summarize the findings, identifying patterns, themes, and gaps in the research.
  • Use appropriate systematic review methods to analyze and interpret the findings from all included studies, ensuring transparency and consistency.
• Identify gaps in the current literature: A key outcome of data synthesis is identifying any gaps in the research. This step helps researchers see areas that need further investigation and where future studies can contribute to the scientific literature.

Step 7: Report Findings and Draw Conclusions

• Write the review report: The final step is to write a comprehensive systematic review report that includes:
  • A summary of the search strategy used.
  • A detailed explanation of the study selection process and the quality assessment.
  • The synthesized results, highlighting key findings and patterns.
  • Limitations of the review and implications for future research.
• Follow the PRISMA checklist: Ensure that your report includes all necessary reporting items for systematic reviews. The PRISMA 2020 statement provides a comprehensive guideline for reporting findings in systematic reviews and meta-analyses, ensuring that the review is reproducible and transparent.
• Draw conclusions: Based on the findings, draw conclusions about the research question. Discuss the implications of the results for practice, policy, or future research.

Conducting a systematic literature review is a structured, systematic process that requires careful planning and rigorous adherence to guidelines and methodologies. By following the 7-step process for conducting a systematic review, researchers can ensure that their reviews are comprehensive, transparent, and contribute valuable insights to their field.

Systematic Literature Review Methodology: A Deeper Dive

How to Select the Right Methodology for Your Systematic Review

• Understand the type of review: When determining how to conduct a systematic literature review, you must first select the appropriate review type. There are various review types and associated methodologies, such as meta-analysis, narrative reviews, and systematic reviews in clinical research, each with distinct goals and processes.
  • Meta-analysis: Combines quantitative data from multiple studies to provide a more precise estimate of the effect.
  • Narrative reviews: A less structured approach, focusing on summarizing findings.
  • Systematic review and evidence: Involves a structured approach to gathering, assessing, and synthesizing research literature.
• Critically appraise existing research: One important aspect of conducting systematic literature reviews is the ability to critically appraise existing research. This means evaluating the quality, relevance, and reliability of studies to determine whether they should be included in your review.
• Determine what your review requires: The methodology chosen should align with the purpose of your systematic literature review. For example, a systematic review may require quantitative analysis (for a meta-analysis) or a qualitative synthesis for more descriptive summaries.

Integrating Research Methodology into Your Systematic Review Process

• Use structured systematic review methods: The systematic review methodology incorporates structured processes such as predefined search strategies, inclusion/exclusion criteria, and data extraction. This ensures that the systematic literature review is thorough and free from bias.
• Consult university libraries: When conducting an SLR, you may benefit from the resources available at your university library. University libraries often provide library guides and access to specialized databases, making the research process more efficient.
• Integrate systematic review methodology into writing: The systematic review methodology should be reflected in every stage of the review, including how you write a literature review, analyze the studies, and synthesize the data to ensure a clear, unbiased presentation of research findings.

Understanding the Role of Search Strategies in the Methodology

• Develop a systematic search: A comprehensive search strategy is vital to a systematic literature review. This involves using systematic review methods to search various databases to find the most relevant studies. Key elements include:
  • Using Boolean operators (AND, OR) for efficient searching.
  • Searching across multiple databases, including Web of Science and other academic resources.
• Consider the quantity and quality of literature: The methodology must ensure that the quantity and quality of literature being reviewed meets the standards set by the research question.
  • Search strategies should ensure that the review provides an overview of all significant studies, not just a select few.
• Ensure reproducibility: Systematic reviews ask for the methods to be reproducible, meaning another researcher should be able to replicate the search strategy and reach similar results. This is crucial for transparency and the reliability of the review.

The systematic literature review methodology is a rigorous process requiring careful selection of the right review type, integration of structured search strategies, and consistent application of a systematic approach to gather, analyze, and synthesize research. By adhering to these principles, you can ensure that your systematic literature review is comprehensive, reliable, and valuable to the academic community.

Quality Assessment in Systematic Literature Review: Ensuring Reliability

Assessing Quality of Sources in Systematic Reviews

• What is a systematic literature review? It is crucial to evaluate the quality of each source included. The quality of sources ensures that the findings of a systematic literature review are reliable and credible.
  • Assessing quality involves reviewing the methodologies of each study to confirm they align with the inclusion criteria.
  • Systematic reviews usually require a rigorous examination of each research study’s design, sample size, and relevance to the review question.
• Role of the reviewer: In a systematic literature review, the reviewer plays a critical role in assessing the quality of the sources. They must follow established protocols for evaluating whether studies meet the required standards.

Tools and Techniques for Quality Assessment

• Standardized quality assessment tools: A systematic literature review uses various tools for reporting systematic reviews. These tools help ensure that all sources are evaluated using consistent, standardized criteria. Common tools include:
  • The Cochrane Collaboration’s risk of bias tool
  • Critical appraisal checklists
• Assessment criteria: Key aspects of quality assessment include:
  • Study design: Ensuring studies are well-structured and appropriate for the review type.
  • Methodological rigor: Evaluating if studies follow the correct procedures for data collection and analysis.
• Systematic review requires reviewers to be thorough and impartial when using these tools, ensuring that only high-quality research is included in the review.

Importance of Quality Assessment in Systematic Reviews

• Ensures reliability of findings: Without quality assessment, a systematic literature review can be skewed by poor-quality studies. This can affect the results of a systematic review, leading to unreliable conclusions.
  • A systematic review typically synthesizes a mix of high- and low-quality studies, but quality assessment helps ensure that the overall conclusions are drawn from robust evidence.
• Improves transparency: By applying consistent quality assessment techniques, a systematic review can clearly show how studies were selected, appraised, and included in the final review. This makes the conduct and reporting of the review more transparent and reproducible.
• Final review: The final review report should include a comprehensive summary of the quality assessment process, providing readers with confidence in the validity and reliability of the review’s findings.

Quality assessment in systematic literature reviews is essential for ensuring the reliability of findings. By using standardized tools and techniques, reviewers can systematically assess the quality of research studies, which is a key step in conducting a systematic review and reporting credible results.

Common Pitfalls: Risk of Bias in Systematic Literature Review

Identifying Sources of Bias in Systematic Reviews

• What is a systematic literature review? A systematic literature review aims to synthesize research findings from multiple studies, but it is susceptible to various biases that can affect the reliability of the review.
  • Selection bias: When certain studies are included or excluded based on subjective decisions, leading to an unbalanced review.
  • Publication bias: The tendency to include only studies that have been published, leaving out valuable unpublished or “grey literature.”
  • Data extraction bias: Errors or inconsistencies in extracting data from studies can distort the findings of a systematic literature review.
• Systematic reviews are conducted with predefined protocols to avoid bias, but pitfalls can still emerge if protocols aren’t strictly followed.

Mitigating Risk of Bias in Literature Review

• Minimize bias by using rigorous methods: To address bias in a systematic literature review, it is essential to follow a transparent and reproducible methodology.
  • Use systematic review uses predefined inclusion and exclusion criteria for selecting studies to avoid selection bias.
  • Search a wide range of research literature, including grey literature, to reduce publication bias.
• Follow PRISMA guidelines: The items for reporting in systematic reviews checklist (PRISMA) helps standardize the review process, ensuring that potential biases are clearly reported and minimized.
• Ensure multiple reviewers: Having multiple reviewers assess studies independently can reduce bias in conduct of a review, especially in data extraction and study selection.

Systematic Review vs Literature Review: How Bias Affects Each

• Systematic review vs traditional literature review:
  • A traditional literature review is often more subjective, with the author selecting studies based on personal judgment, leading to greater risk of bias.
  • A systematic literature review, on the other hand, follows a more structured process designed to minimize bias. It uses transparent systematic review uses methods for study selection, ensuring a more objective synthesis of the research.
• Bias in each type of review:
  • Traditional literature reviews can be prone to selection bias, as the researcher might focus on studies that align with their personal viewpoint or preferences.
  • In contrast, systematic literature reviews originated from the need to reduce bias, though systematic review requires adherence to strict protocols and methodologies to ensure that bias is minimized.

Bias is a significant challenge in both systematic literature reviews and traditional literature reviews, but systematic reviews are conducted with methods designed to mitigate these risks, ensuring a more reliable and reproducible synthesis of research findings.

Practical Tips for Conducting a Systematic Literature Review

Use Systematic Approaches to Maximize Review Efficiency

• What is a systematic literature review? A systematic literature review requires a methodical approach to maximize efficiency and ensure comprehensive, unbiased findings.
  • Predefined protocol: Create a detailed protocol before starting the review. This should outline your inclusion and exclusion criteria, search strategies, and quality assessment methods.
  • Systematic approach: Use systematic methods to search a variety of databases and other research sources, ensuring that you don’t miss any critical studies. This helps streamline your review process by focusing on the most relevant research.
• Use tools to aid the review:
  • Leverage software tools like EndNote, Rayyan, or Covidence to organize and manage the large volume of studies. These tools help you track studies efficiently and maintain consistency in your review.

Avoiding Common Mistakes in Systematic Literature Reviews

• Be wary of common pitfalls: A systematic literature review is prone to certain mistakes if not carefully conducted.
  • Inadequate search strategy: Failing to search across multiple databases and sources can lead to missing important studies. Be sure to use a comprehensive search strategy that covers a wide range of research literature.
  • Bias in study selection: To avoid selection bias, ensure that you apply clear and consistent inclusion/exclusion criteria for each study. This will reduce subjectivity in choosing studies.
• Follow systematic review guidelines: Use the PRISMA checklist to ensure that your review follows systematic review methods for study selection, data extraction, and reporting, making it reproducible and transparent.

Key Takeaways for a Successful Systematic Review

• What is a systematic literature review? A systematic literature review should be planned and executed with attention to detail to ensure reliability and transparency in the results.
  • Clarity in objectives: Define a clear research question and objectives for your review, making sure it aligns with the kind of review you are conducting.
  • Synthesize effectively: Your systematic review should effectively synthesize the findings, providing a comprehensive summary of existing research, similar to what literature reviews provide, but with much more rigor.
• Document all steps: Documenting every step of the systematic literature review process ensures reproducibility and transparency. This includes study selection, data extraction, and any tools used during the review.

Conducting a systematic literature review requires a structured, systematic approach to efficiently gather and synthesize relevant research. By avoiding common mistakes, following established guidelines, and using tools to assist with the process, you can ensure that your systematic review is comprehensive, transparent, and valuable to the academic community.