Shaping the Future of Open Web Search and Large Language Models: Key Takeaways from NGI Forum Panel Discussion
At this year’s NGI Forum in Brussels, the Open Search Foundation played a pivotal role in shaping the conversation around open web search and large language models (LLMs). Christine Plote, Co-Founder of the Open Search Foundation, moderated a compelling panel discussion featuring distinguished experts from academia, industry, and AI research. The discussion explored the challenges and opportunities in the rapidly evolving landscape of AI-powered search technologies, digital sovereignty, and the role of open-source initiatives in Europe.
The Challenges of Today’s Search Landscape
One of the key concerns raised during the panel was the dominance of a few corporations in the search engine market. Michael Granitzer (University of Passau) underscored the importance of decentralizing web search infrastructure, advocating for open web indices that would empower users to build their own search solutions. In addition, Isabell Claus (thinkers.ai) pointed out that current search business models, driven by advertisements, often prioritize engagement over relevance, making the need for more transparent and user-centric alternatives even more urgent.
Digital Sovereignty and Data Trust
Georg Rehm (DFKI) emphasized that Europe must establish digital sovereignty by investing in independent LLMs and AI models. While Europe has the technological expertise and computing capabilities, the major bottleneck is data. Much of Europe’s web data is locked away in the hands of big tech companies, limiting the potential for local AI innovation. Alexandre Zapolsky (LINAGORA) echoed this sentiment, stressing the need for European-wide initiatives to support open-source AI and data access at scale.
Milena Sokolic (Trace Labs) added that ensuring trust and transparency in AI is just as critical as data access. She highlighted the necessity of decentralizing data management and implementing strong governance structures to combat misinformation and bias in AI-generated content.
The Role of Open Source and SMEs in AI Development
The panelists agreed that open-source initiatives and European SMEs play a fundamental role in fostering innovation. While large corporations dominate AI development, open-source communities have demonstrated their ability to move swiftly and create competitive alternatives. Granitzer noted that community-driven, open-source LLMs have emerged rapidly in the past year, proving that bottom-up innovation can thrive when adequately supported. However, Claus stressed that research alone is insufficient—Europe must act fast to turn technological advances into viable businesses that can compete on a global scale.
Breaking Down Data Silos
A major barrier to AI progress in Europe is the fragmentation of data sources across different countries and sectors. The panel highlighted the urgent need for collaboration across national and project boundaries to ensure structured, accessible, and trustworthy data. Too often, valuable AI and search projects work in parallel without effectively sharing resources, leading to friction and inefficiencies. Establishing a unified European data ecosystem is crucial to overcoming these silos.
The Future of Search and AI in Europe
One of the most pressing questions posed by the moderator was whether traditional search engines will still be necessary in the age of LLMs. Granitzer provided a key distinction: search engines retrieve existing information, while LLMs generate new content. While LLMs offer powerful natural language processing capabilities, they also introduce challenges such as misinformation and hallucinations. Thus, the future of search will likely involve a hybrid approach that integrates traditional retrieval methods with AI-powered comprehension tools.
A Call to Action
At the conclusion of the panel, the speakers shared their vision for the future of open search and AI in Europe:
- Act at scale, quickly and decisively
- Promote trusted, decentralized AI solutions
- Encourage bold political action to trigger private investment
- Foster the growth of the open-source community
- Streamline regulatory and bureaucratic barriers for researchers and innovators
The discussion made it clear that Europe has the potential to lead in AI and open web search—if decisive action is taken. As Christine Plote emphasized, collaboration, openness, and proactive policy-making are essential to ensuring a competitive and trustworthy digital future.
Watch the panel session online here.
All keynotes, impact presentations and panels are available online
Day 1: https://ngiforum2023.eu/videos/plenaries-sessions-15-11/
Day 2: https://ngiforum2023.eu/videos/plenaries-sessions-workshops-16-11/
NGI Impact Stories:
https://spaces.fundingbox.com/spaces/ngi-next-generation-internet-ngi-news-events/655f63014b8f8d23cf993957