# 2c. Evaluating Your Search Strategy

## Introduction
After setting up your basic search, you can further refine your keyword search strategy, as well as add additional search strategies. You can evaluate the quantity and relevance of your search results, and subsequently use techniques to either broaden or narrow your initial search.


::::

::::{grid}
:gutter: 3

:::{grid-item-card} Step 1<br>
[Evaluating Your Keyword Search](#step-1-evaluating-your-keyword-search)<br>
Judging the Quantity and Relevance of Your Results

:::

:::{grid-item-card} Step 2<br>
[Updating Your Keyword Search](#step-2-updating-your-keyword-search)<br>
Use basic strategies to broaden or narrow your search

:::

:::{grid-item-card} Step 3<br>
[Use AI to Refine Your Draft Query](#step-3-use-ai-to-help-refine-your-draft-query)<br>
Use tools like Copilot to improve your search

:::

::::

## Step 1: Evaluating Your Keyword Search:
Searching is a matter of trial and error, and you do not create a perfect search plan all at once. You create a search plan, try it out, evaluate your search results, edit your search plan, and keep repeating these steps until your search plan is the best you can make it. When you assess your query, you first look at the quantity of your results, followed by how relevant the results are to your question. 

### Quantity
How many results you need is very dependent on the field you work in. Often around +/- 200-300 results is a good number to work with. If you have far more or far fewer results, it may be time to adjust your initial search.

### Relevance
Relevance  means that the results of your search are of significance for your research topic. To check this you should link back the information you have found to your research question. In most academic databases you can sort your results by relevance. Look at the title and abstracts of the documents you found and if less than 50% of the documents is relevant, adjust your search terms. For relevant search terms you can also use keywords assigned by the database itself.

In a proper literature search about 80% of your search results should be relevant. If all the documents you found are relevant then there is a possibility you are missing important literature, and maybe you should broaden your search.

## Step 2: Updating Your Keyword Search

### Broadening Your Search
When you have found too few results, common techniques to broaden your search include:

- Adding additional synonyms and alternative terms
- Removing concepts from your search
- Broadening specific concepts

Watch the video below for a guided example on how to do this.
<iframe width="560" height="315" src="https://collegerama.tudelft.nl/Mediasite/Play/15d3b09c9d1b4cf7a7d7294c6ed5a26e1d" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe><br>
"<a href="https://collegerama.tudelft.nl/Mediasite/Play/15d3b09c9d1b4cf7a7d7294c6ed5a26e1d" target=_blank>Broadening</a>" by <a href="https://www.tudelft.nl/library/" target=_blank>TU Delft Library Education Support</a> is licensed under <a href=https://creativecommons.org/licenses/by/4.0/ target=_blank>CC-BY</a><br><br>

### Narrowing Your Search
When you have found too many results, common techniques to narrow down your search include:

- Adding concepts to your research question
- Making concepts more specific
- Using filters

Watch the video below for a guided example on how to do this:

<iframe width="560" height="315" src="https://collegerama.tudelft.nl/Mediasite/Play/0fb4feea68f94923805511df3943d2cd1d" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe><br>
"<a href="https://collegerama.tudelft.nl/Mediasite/Play/0fb4feea68f94923805511df3943d2cd1d" target=_blank>Narrowing</a>" by <a href="https://www.tudelft.nl/library/" target=_blank>TU Delft Library Education Support</a> is licensed under <a href=https://creativecommons.org/licenses/by/4.0/ target=_blank>CC-BY</a><br><br>


### Step 3: Use AI to Help Refine Your Draft Query

```{admonition} THESIS SUPERVISOR
:class: important
Please check with your supervisor if you are allowed to use AI in your thesis project
```

If you are allowed to use AI, you can use Copilot to support your keyword search. For example, you can ask it for additional synonyms as you are developing your draft keyword search.

While general tools can develop queries from scratch, it is recommended to draft an initial query yourself, and give it your initial search query, to provide the AI with some direction and come up with a better query. (Walma & Looij, 2025)

```{admonition} Example Prompt
:class: dropdown note

I am a master student in [study]. I am working on a literature review paper on [topic] for my master thesis. I want to search [database] for research articles on [research question]. My current query is: [draft query]. Expand the keywords and design a more constructive query.
```

## Practice with a Research Scenario

Use the research-based scenario below to practice more with the skills discussed in this chapter

<iframe src="https://tudelft.h5p.com/content/1292799266045636277/embed" aria-label="2 - Practice - Evaluate Your Search" width="1088" height="637" frameborder="0" allowfullscreen="allowfullscreen" allow="autoplay *; geolocation *; microphone *; camera *; midi *; encrypted-media *"></iframe><script src="https://tudelft.h5p.com/js/h5p-resizer.js" charset="UTF-8"></script><br>
"<a href="https://tudelft.h5p.com/content/1292799266045636277/embed" target=_blank>Evaluate Your Search</a>" by <a href="https://www.tudelft.nl/library/" target=_blank>TU Delft Library Education Support</a> is licensed under <a href=https://creativecommons.org/licenses/by/4.0/ target=_blank>CC-BY</a><br><br>
