Folgen Sie einem manuell hinzugefügten Link
Wie kann die offene Internetsuchlandschaft gestaltet werden? Diskutieren Sie Ihre Ideen und Ansätze!
Topics:
Crawling
Search engine deployment
Search engine evaluation
Use of the web as a resource
Open-source prototypes
Cooperative action
The Second International Workshop on Open Web Search (WOWS) aims to promote and discuss ideas and approaches to open up the web search ecosystem so that small research groups and young startups can leverage the web to foster an open and diverse search market.
Therefore, the workshop, which takes place at ECIR2025, has two calls that support collaborative and open web search engines: (1) for scientific contributions, and (2) for participation in the WOWS-Eval shared task for collaborative evaluations of the Open Web Index.
The first call aims for scientific contributions to building collaborative search engines, including collaborative crawling, collaborative search engine deployment, collaborative search engine evaluation, and collaborative use of the web as a resource for researchers and innovators.
The second call on the WOWS-Eval shared task aims at gaining practical experience with joint, cooperative evaluation of search engines by focusing to enrich the Open Web Index (OWI) with relevance judgments cooperatively transferred from existing TREC-style test collections.
Programme 10 April 2025
8:30 — 9:00
Welcome and coffee
9:00 — 09:45
Keynote
Annotative Indexing
Charles Clarke (University of Waterloo)
09:45 — 10:00
Investigating the Robustness of Embedding Models on Noisy Input Texts
Michael Dinzinger, Laura Caspari, Kanishka Ghosh Dastidar, Jelena Mitrović and Michael Granitzer (University of Passau)
10:00 — 10:15
Document Quality Scoring for Web Crawling
Francesca Pezzuti, Ariane Mueller, Sean MacAvaney and Nicola Tonellotto (University of Glasgow and University of Pisa)
10:15 — 10:30
On Precomputation and Caching in Information Retrieval Experiments with Pipeline Architectures
Sean MacAvaney and Craig Macdonald (University of Glasgow)
10:30 — 11:00
Coffee break
11:00 — 11:15
Combining Embedding Models for RAG: A Similarity-Based Approach
Kanishka Ghosh Dastidar, Michael Dinzinger, Laura Caspari, Jelena Mitrovic and Michael Granitzer (University of Passau)
11:15 — 11:30
Supporting Vertical Web Search and Customized Search Applications with the Modular and Open Framework MOSAIC
Sebastian Gürtl, Alexander Nussbaumer, and Christian Gütl (Graz University of Technology)
11:30 — 11:45
Efficient Automatic Retrieval Evaluation via Query-by-Example
Daria Alexander, Maik Fröbe, and Gijs Hendriksen (Radboud University and Friedrich-Schiller University Jena)
11:45 — 12:30
Discussion / Breakout Groups
12:30 — 13:30
Lunch
Calls for participation – closed
Call 1: Call for papers #wows2025
We seek research contributions that address elements of a traditional web search pipeline and also incorporate recent developments such as (open source) large language models to interface with retrieval systems. Specifically, our focus is on contributions that address the importance of an open web search pipeline and the creation of an open web index as a basis for the development of search applications for specific purposes and communities. We are particularly interested in contribution along the pipeline for creating an open web index, i.e. crawling, preprocessing, enrichment and indexing, as well as on serving (parts of) an open web index for advancing information retrieval. The latter also includes new search paradigms or ethical, legal and social aspects related to open web search. Topics include:
- Crawling for an Open Web Index, Collaborative crawling
- Web deployment of search engines
- Standards for search and Interoperability
- Large scale web data pre-processing components or pipelines
- Pre-processing and Enrichment
- Indexing and Search Architectures
- Open infrastructures for evaluation
- Open source search engines
- Open source replicability
- Ethical and legal aspects of web search
- Alternatives for query logs and click logs
- Vertical search engines
- Search engines for low-resource languages
- Energy efficiency of web search
- Standardisation and methods for index exchange and tokenisation
Submissions to WOWS should be 5 to 12 pages. Reviewing will be single-blind. Please, use the single-column CEUR-WS format available at http://ceur-ws.org/Vol-XXX/CEURART.zip
Deadline for submissions is 12 February 2025.
Call 2: Call for participation in WOWS-Eval
With the WOWS-EVAL shared task, we aim to collaboratively and cooperatively enrich the Open Web Index (OWI) with relevance judgments transferred from existing TREC-like test collections. For this, we develop and collect automated relevance assessors that use a TREC-style information need and a document as input to output a probability that the document is relevant to the query. The test set consists of information needs from existing TREC test collections for which we will create a new round of relevance judgments to evaluate the effectiveness of submitted relevance assessors. We encourage run submissions with ir-metadata and we aim to dockerize the most effective submissions after the shared task to apply them to the Open Web Index to allow first effectiveness evaluations on the Open Web Index.
Submissions
We have a set of baselines and a step-by-step tutorial to simplify submissions. Participants who contribute a relevance assessors to WOWS-EVAL are encouraged to submit a (short) notebook paper.
Deadline for submissions is 18 March 2025.
Any questions or feedback?
Please do not hesitate to contact us via our forum on TIRA.