In a recent interview with Reset Digital for Good, Prof. Dr. Michael Granitzer, Chair of Data Science at the University of Passau and project manager of our recently completed OpenWebSearch.EU project, provided insights into the significance of the Open Web Index, which was developed in the project.

„Our mission is to break up the silo of a single search engine. (…) We’re doing this by crawling the web, collecting web pages, and preparing them to be consumed by search engines. Preparing them involves cleaning advertisements and navigation links, then extracting the main content. This index can be used by individuals or organisations to build their own search engines.“ states Michael.

While scaling up to compete with monopolies such as Google would require enormous resources, Michael believes that a community-oriented project could complement traditional and AI search as a public good. He envisions a future in which small AI models enable users to search for and combine information from various sources, independently of large technology companies.

In the future, societies will be shaped by humans and models working closely together

„In an ideal scenario, the AI model is running on my machine and controlling my data. It’s a tool that helps me, conducts searches on my behalf and understands what I want to do. I’m talking about small language models rather than large language models. A model that helps me search, aggregate and synthesise information based on search endpoints that I choose.“, he states

You can read the full interview here: https://en.reset.org/fighting-the-search-monopoly-with-an-open-source-index-an-interview-with-michael-granitzer-from-openwebsearch/

What does a European, independent search infrastructure look like – beyond the ubiquitous Google search? This is precisely the subject of the Deutschlandfunk Kultur report, in which our project plays a prominent role.

In a short guest comment, Dr. Stefan Voigt from the board of the Open Search Foundation characterizes the concept of the Open Web Search Initiative as follows
“To inspire Europe to build its own web search infrastructure – based on a publicly accessible web index on which a wide variety of search engines and front-ends can be created.”

Journalist Stefan Mey discusses the Open Web Index as a foundational technology for a European sovereign web infrastructure in the podcast.
Google’s quasi-monopoly and the failure of alternative providers to date highlight the need for new solutions.

The independent index should serve as a basis for AI training and as a partner index for search engines.
It’ll form a landscape of different providers from universal search engines to specialized search engines on “nerd topics”.

The podcast also discusses the current status of the project, the question of funding and the importance of an open search index as part of Europe’s critical digital infrastructure.

Listen to the whole podcast at Deutschlandfunk:
https://www.deutschlandfunkkultur.de/zutritt-verboten-eu-diskutiert-altersbeschraenkungen-fuer-social-media-100.html

By the way: Jan Penfrat from EDRi (European

In the episode with the enticing title “Will the European search engine come – how an independent search index is being created”, podcast host Martin Wolff spoke with our OSF board member Dr. Stefan Voigt as well as Prof. Dr. Michael Granitzer about the current search engine landscape.

In November 2023, the annual NGI Forum took place in Brussels and launched a new Q&A video series with NGI-related Horizon Europe-funded project managers. One of the interviewees was Dr. Stefan Voigt, chairman of the OSF executive board. OSF is a part of the OpenWebSearch.eu project, which is under the NGI umbrella.

You can watch the short Q&A session below:


Source: EU Video, the official ActivityPub video platform of the EU institutions, bodies and agencies.

If you would like to dig deeper into the topic of Open Web Search, you may also want to revisit the plenary session on “Open Web Search and Large Language Models and Beyond: Challenges and opportunities for Europe“, moderated by OSF chairwoman Christine Plote. Among the five panelists was also Michael Granitzer who is the project leader at OWS.EU.

You can watch the full session here online (start at roughly 2.55 minutes in).