Literature Search Strategy: Developing and Documenting Search Strategies for Systematic Reviews and Meta-Analyses

Defining a Literature Search Strategy

• A literature search strategy is a systematic, structured, and documented plan used to identify all relevant research related to a clearly defined review question.
• It describes where to search, what to search for, and how the search will be conducted across different information sources.
• The strategy is developed before study selection begins to reduce bias and ensure methodological consistency.
• In systematic reviews and meta-analyses, the search strategy is treated as a core methodological component, not a preliminary or informal activity.
• A well-defined search strategy strengthens the credibility, accuracy, and trustworthiness of review findings.

Concept and Purpose of a Literature Search Strategy

• Concept
  • A literature search strategy integrates databases, keywords, controlled vocabulary, limits, and search logic into a single coherent plan.
  • It translates the research question into searchable concepts that can be applied consistently across databases.
  • The strategy balances sensitivity (finding as many relevant studies as possible) and specificity (excluding irrelevant studies).
  • It is often developed in collaboration with information specialists or librarians to improve technical accuracy.
• Purpose
  • To ensure comprehensive identification of all relevant studies, including older and less visible research.
  • To reduce selection bias caused by selective searching or reliance on a single database.
  • To provide a clear audit trail that allows others to evaluate the quality of the search process.
  • To support transparency and reproducibility, which are essential standards in evidence-based research.

Role of Literature Search Strategies in Evidence Synthesis

• Evidence synthesis depends on the quality and completeness of the evidence retrieved during the search stage.
• A robust search strategy:
  • Identifies diverse study designs, populations, and settings relevant to the review question.
  • Supports accurate comparison and integration of findings across studies.
• In systematic reviews:
  • The search strategy determines which studies are screened for inclusion.
  • Errors at this stage cannot be corrected later in the review process.
• In meta-analyses:
  • Missing eligible studies can distort effect sizes and lead to incorrect conclusions.
• Therefore, the search strategy directly affects the internal validity, generalizability, and reliability of synthesized evidence.

Differences Between Narrative and Systematic Search Strategies

• Narrative Search Strategies
  • Typically guided by the author’s knowledge and judgment.
  • Search methods are flexible but often poorly defined.
  • Databases and search terms may be selected without justification.
  • Documentation is minimal or absent.
  • Results are more prone to bias and incomplete coverage.
• Systematic Search Strategies
  • Based on predefined protocols and explicit criteria.
  • Use multiple databases and standardized search procedures.
  • Clearly document all decisions, including inclusion and exclusion limits.
  • Designed to be replicable by independent researchers.
  • Required to meet methodological standards for systematic reviews and meta-analyses.

Systematic Literature Review Writing

Clear, well-structured reviews aligned to your topic and rubric.

Get Started Here

Key Characteristics of a High-Quality Search Strategy

• Comprehensive Coverage
  • Searches multiple databases and relevant grey literature sources.
  • Includes synonyms, spelling variations, and related concepts.
• Transparency
  • Fully reports databases searched, dates, platforms, and search strings.
  • Records all filters, limits, and refinements applied.
• Reproducibility
  • Provides sufficient detail for another researcher to repeat the search.
  • Uses consistent terminology and logical structure across databases.
• Relevance and Precision
  • Aligns closely with the review question and objectives.
  • Avoids unnecessary restrictions that may exclude key studies.
• Iterative Development
  • Tests and refines search terms based on initial results.
  • Adjusts the strategy to improve balance between sensitivity and precision.
• Bias Reduction
  • Considers language, publication status, and database bias.
  • Includes unpublished or grey literature when appropriate.

A 5-Step Guide for Developing a Search Strategy

• A search strategy is an organized and systematic process used to locate relevant literature for a literature review, research synthesis, and inclusion in systematic reviews.
• The goal is to develop an effective search that retrieves relevant articles while controlling the number of results you get.
• Each step builds on the previous one, following a building block approach that supports transparency and accuracy.

Step 1: Formulating the Research Question and Review Objectives

• The first step is to clearly define the research question or chosen topic.
• A well-developed research question helps focus your research and guides all later decisions.
• Frameworks such as Population, Intervention, Comparison, and Outcome, commonly known as PICO, are widely used in health sciences and science systematic reviews.
• PICO helps identify the core elements that must be included in your search.
• At this stage, researchers often conduct a preliminary search using a search engine such as Google Scholar to understand the types of literature available.
• A preliminary search helps identify:
  • A potential gap in the literature.
  • Common terminology used by authors.
  • Relevant references that frequently appear.
• Review objectives should be clearly stated so that the search strategy aligns with the purpose of the literature review and research synthesis.

Step 2: Identifying Key Concepts and Search Terms

• Once the research question is developed, the next step is identifying search terms.
• The research question is broken down into main concepts, often called search in concepts.
• Concepts can be expressed using different words, spelling variations, and vocabulary terms.
• For each concept, identify:
  • Key terms used to search.
  • Synonyms and related terms.
  • Singular and plural forms.
• Controlled vocabulary should be included to enhance your search.
  • PubMed uses Medical Subject Headings, also known as MeSH terms.
  • MeSH terms are maintained by the National Library of Medicine.
  • The National Library of Medicine’s thesaurus organizes vocabulary terms by database subject.
• Other databases use different controlled vocabularies.
  • The Embase database uses the EMTREE thesaurus.
• Phrase searching can be applied when concepts must appear together.
  • Exact phrase searching uses quotation marks.
  • Phrase searching decreases the number of results by limiting irrelevant matches.
• Truncation can be used to capture word variants.
  • Truncate allows retrieval of singular and plural forms and related endings.
• At this stage, the structure of key terms used should be documented for transparency.

Step 3: Selecting Appropriate Databases and Information Sources

• Different databases index different types of literature.
• Selecting appropriate databases ensures comprehensive coverage of published literature.
• Common databases used in health and science systematic reviews include:
  • PubMed, developed by the National Library of Medicine.
  • Web of Science.
  • Google Scholar.
• PubMed is widely used for biomedical literature and allows you to search using MeSH terms and publication type filters.
• Web of Science supports citation tracking and interdisciplinary research synthesis.
• Google Scholar can supplement searches but should not be used alone due to limited transparency.
• Each database you search has:
  • A unique search interface.
  • A specific database subject focus.
  • Different rules for Boolean operators and advanced search functions.
• Research guides and the database help section should be checked before searching.
  • These guides explain how Boolean operators are used to search a database.
  • They provide search tips for effective search execution.
• A strategy for each database should be developed because search syntax varies across different databases.

Step 4: Constructing Search Strings Using Boolean Logic

• Search string development involves combining concepts using Boolean operators.
• Boolean operators include:
  • AND.
  • OR.
  • NOT.
• AND is used to combine different concepts.
  • For example, dengue and malaria and zika retrieves results that contain all three search terms.
  • This decreases the number of results.
• OR is used to combine synonyms or related terms.
  • For example, dengue or malaria or zika retrieves results that include any of the terms.
  • This increases the number of results.
• NOT excludes unwanted concepts but should be used cautiously.
• Boolean logic helps control the number of results you get and improves relevance.
• Phrase searching using quotation marks is useful when searching for exact phrases.
• Advanced search features allow structured searching across specific fields such as title, abstract, or subject headings.
• Each search string should be adapted and used in each database according to platform rules.
• A well-constructed search string ensures that relevant articles are included in your search.

Step 5: Testing and Refining the Search Strategy

• After the initial search, search results should be reviewed for relevance.
• Testing helps determine whether key studies are being retrieved.
• If too many irrelevant results appear:
  • Phrase searching can be applied.
  • Additional concepts can be added using AND.
  • Publication type limits can be considered.
• If too few results are retrieved:
  • Additional synonyms can be added using OR.
  • Controlled vocabulary terms can be expanded.
  • Truncation can be adjusted.
• The number of results should be recorded at each stage to track changes.
• Refinement is an iterative process aimed at balancing sensitivity and precision.
• Once finalized, documenting your search strategy is essential.
  • Databases searched.
  • Search strings used.
  • Dates of searching.
  • Number of results retrieved.
• Proper documentation supports transparency, reproducibility, and inclusion in systematic reviews.

This five-step approach ensures the development of a rigorous, effective, and reproducible search strategy suitable for high-quality literature reviews and systematic research synthesis.

Systematic Literature Review Writing

Clear, well-structured reviews aligned to your topic and rubric.

Get Started Here

Documenting the Search Strategy for Transparency and Reproducibility

• Documenting the search strategy is a fundamental requirement for rigorous literature reviews, including systematic reviews and meta-analyses.
• It provides a transparent and structured record of how evidence was identified, allowing others to understand, assess, and replicate the search process.
• A search strategy is not complete unless it is clearly documented, as undocumented searches cannot be evaluated for quality or bias.
• Proper documentation strengthens the credibility of research synthesis and supports confidence in the findings.

Rationale for Documenting Search Strategies

• Once you have developed your research question, documenting the search strategy ensures that the transition from question formulation to evidence identification is logical and methodical.
• Documentation shows that the search process was:
  • Planned in advance rather than improvised.
  • Guided by explicit methodological decisions.
  • Aligned with the objectives of the literature review.
• Transparency allows readers and reviewers to judge:
  • Whether appropriate databases were searched.
  • Whether relevant concepts and terms were adequately represented.
  • Whether the search was sufficiently comprehensive to support valid conclusions.
• Reproducibility is a core principle of evidence-based research.
  • Other researchers should be able to repeat the search using the same methods and obtain similar search results.
• Documented strategies are essential for:
  • Peer review and journal assessment.
  • Updating reviews as new evidence emerges.
  • Inclusion in systematic reviews, where methodological standards are strict.
• Without clear documentation, it is difficult to determine whether important studies were missed or whether bias was introduced during the search process.

Essential Elements to Record in a Search Strategy

• Research Question and Conceptual Framework
  • Clearly state the developed research question and review objectives.
  • Explain how the research question was translated into searchable concepts.
  • Identify the main concepts that guided term selection and database choice.
• Databases and Information Sources
  • List all databases searched, such as PubMed, Web of Science, and Google Scholar.
  • Specify the platform used to search each database.
  • Justify why each database was selected based on subject relevance and coverage.
  • Acknowledge that different databases index different types of literature.
• Database-Specific Guidance
  • Before searching, it is essential to check the database help section.
  • Database help sections explain:
    • How Boolean operators function.
    • How phrase searching is supported.
    • How truncation and wildcards are applied.
  • Recording this step demonstrates careful preparation and technical accuracy.
• Search Terms and Vocabulary
  • Document all key terms used to search each database.
  • Include free-text keywords derived from the research question.
  • Record controlled vocabulary terms such as Medical Subject Headings.
  • Note that controlled vocabularies differ across databases.
  • Explain how concepts can be expressed using multiple terms and synonyms.
• Search Strings and Phrase Searching
  • Provide the complete search string used in each database.
  • Document how terms were combined using Boolean operators.
  • Record instances where you search for phrases using quotation marks.
  • Explain that phrase searching decreases the number of results by restricting word order.
  • Clarify when phrase searching was used to improve relevance.
• Limits, Filters, and Search Techniques
  • Document any limits applied, such as publication type, language, or date range.
  • Justify why limits were applied and how they align with review objectives.
  • Record the use of advanced search features when applicable.
• Search Results and Record Management
  • Record the number of results retrieved from each database.
  • Document the total number of records before and after deduplication.
  • Note any differences in results across databases.

Reporting Search Strategies in Systematic Reviews and Meta-Analyses

• Reporting the search strategy is as important as conducting the search itself.
• Systematic reviews, including systematic reviews in health and social sciences, require explicit reporting of search methods.
• The methods section should include:
  • A clear description of databases searched.
  • The time period covered by the search.
  • A summary of how the search strategy was developed and refined.
• Full search strategies should be reported in:
  • Appendices.
  • Supplementary files.
• Each database search should be reported separately.
  • This reflects differences in syntax, vocabulary, and search functionality.
  • A strategy for each database improves clarity and reproducibility.
• Reporting should also state:
  • Whether reference lists of relevant articles were searched.
  • Whether additional sources were included to enhance coverage.
• Transparent reporting supports:
  • Peer reviewers in assessing methodological quality.
  • Readers in understanding how evidence was identified.
  • Future researchers seeking to replicate or update the review.
• In summary, careful documentation and reporting of the search strategy:
  • Demonstrate methodological rigor.
  • Support transparency and reproducibility.
  • Are essential for high-quality literature reviews, including systematic reviews and meta-analyses.