Discuss ideas and approaches to open up the web search ecosystem!
Topics:
Crawling
Search engine deployment
Search engine evaluation
Use of the web as a resource
Open-source prototypes
Cooperative action
The Second International Workshop on Open Web Search (WOWS) aims to promote and discuss ideas and approaches to open up the web search ecosystem so that small research groups and young startups can leverage the web to foster an open and diverse search market.
Therefore, the workshop, which takes place at ECIR2025, has two calls that support collaborative and open web search engines: (1) for scientific contributions, and (2) for participation in the WOWS-Eval shared task for collaborative evaluations of the Open Web Index.
The first call aims for scientific contributions to building collaborative search engines, including collaborative crawling, collaborative search engine deployment, collaborative search engine evaluation, and collaborative use of the web as a resource for researchers and innovators.
The second call on the WOWS-Eval shared task aims at gaining practical experience with joint, cooperative evaluation of search engines by focusing to enrich the Open Web Index (OWI) with relevance judgments cooperatively transferred from existing TREC-style test collections.
Programme
8:30 — 9:00
Welcome and coffee
9:00 — 10:00
Keynote
Evaluation of Information Access Systems in the Generative Era
Negar Arabzadehghahyazi (University of Waterloo)
10:00 — 10:30
Perspectives on Evaluating diverse Open Web Search Applications with TIREx
Maik Fröbe (Friedrich-Schiller University Jena)
10:30 — 11:00
Coffee break
11:00 — 11:20
Web content control standards in times of Generative AI
Michael Dinzinger, Florian Heß and Michael Granitzer (University of Passau)
11:20 — 11:40
Efficiently Scoring the Health-relatedness of Web Pages
Ferdinand Schlatt (Friedrich-Schiller University Jena)
11:40 — 12:00
ORCAS-I intent predictor as component of TIRA
Daria Alexander, Wojciech Kusa and Arjen P de Vries (Radboud University and TU Wien)
12:00 — 12:20
Embedding-based Query Spelling Correction
Ines Zelch, Gustav Lahmann and Matthias Hagen (Friedrich-Schiller University Jena)
12:20 — 12:30
Comparing Recall-Oriented Document Processing on TIREx: DocT5Query vs. the Corpus Graph
Sean MacAvaney (University of Glasgow)
12:30 — 13:30
Lunch
13:30 — 13:50
A Mastodon Corpus to Evaluate Federated Microblog Search
Matti Wiegmann, Jan Heinrich Reimer, Maximilian Ernst, Martin Potthast, Matthias Hagen and Benno Stein (Bauhaus-Universität Weimar, Friedrich-Schiller University Jena, Leipzig University)
13:50 — 14:10
QPPTK@TIREx: Simplified Query Performance Prediction for Ad-Hoc Retrieval Experiments
Oleg Zendel, Maik Fröbe and Guglielmo Faggioli (RMIT University, Friedrich-Schiller University Jena, and University of Padua)
14:10 — 14:30
Integrating Query Interpretation Components into the Information Retrieval Experiment Platform
Marcel Gohsen, Benno Stein (Bauhaus-Universität Weimar)
14:30 — 14:50
TU Dresden at WOWS 2024
Linda Erben, Maria Hampel, Malte-Christian Kuns, Vincent Melisch, Per Natzschka, Wilhelm Pertsch, Lina Razouk, Reiner Stolle, Robert Thomas Thoss, Tuan Giang Trinh, Julius Gonsior and Anja Reusch (TU Dresden)
14:50 — 15:00
Discussion/Preparation of Breakout Groups
15:00 — 15:30
Coffee break
15:30 — 16:30
Breakout groups
16:30 — 17:00
Reports of the Breakout groups and Closing
Calls for participation
Call 1: Call for papers #wows2025
We seek research contributions that address elements of a traditional web search pipeline and also incorporate recent developments such as (open source) large language models to interface with retrieval systems. Specifically, our focus is on contributions that address the importance of an open web search pipeline and the creation of an open web index as a basis for the development of search applications for specific purposes and communities. We are particularly interested in contribution along the pipeline for creating an open web index, i.e. crawling, preprocessing, enrichment and indexing, as well as on serving (parts of) an open web index for advancing information retrieval. The latter also includes new search paradigms or ethical, legal and social aspects related to open web search. Topics include:
- Crawling for an Open Web Index, Collaborative crawling
- Web deployment of search engines
- Standards for search and Interoperability
- Large scale web data pre-processing components or pipelines
- Pre-processing and Enrichment
- Indexing and Search Architectures
- Open infrastructures for evaluation
- Open source search engines
- Open source replicability
- Ethical and legal aspects of web search
- Alternatives for query logs and click logs
- Vertical search engines
- Search engines for low-resource languages
- Energy efficiency of web search
- Standardisation and methods for index exchange and tokenisation
Submissions to WOWS should be 5 to 12 pages. Reviewing will be single-blind. Please, use the single-column CEUR-WS format available at http://ceur-ws.org/Vol-XXX/CEURART.zip
Deadline for submissions is 12 February 2025.
Call 2: Call for participation in WOWS-Eval
Submission System opens 28 January 2025
Deadline will be 26 February 2025