Despite all the criticism of Google’s AI Overviews, which appear above conventional search results, they are worth examining more closely, particularly in comparison with traditional Google Search. For some queries, they can produce useful results very quickly.
AI Overviews can be used in a similar way to chatting with a language model. The search box can also handle complex instructions consisting of several sentences. One example would be the prompt:
“List 100 German cities with highly visited tourist attractions. For each city, name one to three tourist attractions. Sort the cities by federal state.”
The result is a suitably structured list of cities, correctly sorted by federal state. The cities are distributed relatively evenly across the states, and one to three attractions are listed for each city. We actually preferred this result to a list generated with ChatGPT, because ChatGPT rigidly listed three attractions for every city and sometimes resorted to general terms such as “hiking” when there did not appear to be a third specific attraction available.
Until recently, few people would have expected a useful result from entering such an instruction into the Google search box. Conventional Google Search still behaves differently. The results shown below the AI Overview continue to consist of links to pages with lists such as “100 attractions”. Among the first ten results, however, more relevant links appear when a short, conventional search phrase such as “100 German cities with highly visited tourist attractions” is used. In other words, the precisely formulated prompt produces an exact output in the desired format in the AI Overview, but leads to less relevant links in the conventional search results below it.
What does this mean for using Google in professional research?
- When formulating a query, it is important to decide in advance whether the aim is to generate an answer via the AI Overview or to search through conventional results. The wording has a major influence on the quality of the outcome. Anyone looking for relevant websites should continue to use concise keyword-based search terms. By contrast, anyone who wants to use the AI Overview should formulate longer prompts with context and clear instructions. Incidentally, AI Overviews can also be disabled by simply adding “-ai” to the search term.
- For individual queries, Google can be used in a similar way to a language model. Entering fully formulated prompts with instructions into the Google search box provides an alternative to interacting with language models in a chat interface. The major difference, however, is that Google cannot process follow-up questions in the same way. If, after receiving the list of cities, you enter a new instruction such as “Please reduce the list to destinations that are particularly interesting in summer”, Google generates an entirely new list, which may even include destinations outside Germany.
By Ida Kandler
