Multilingual Search Relevance Contributor

Help improve the quality of multilingual search experiences by evaluating how relevant retrieved content is to a user’s search.

About this project

Project MAPPA is a remote annotation project focused on multilingual search relevance. Contributors will review search-related content and assess how well retrieved results match the intent and meaning of a query.

Your evaluations will support the improvement of multilingual search ranking systems across several European languages.

What you’ll do

As a contributor, you will:

• Review search queries and retrieved content.
• Evaluate how relevant the retrieved content is to the query.
• Assign relevance scores according to project guidelines.
• Apply evaluation criteria consistently across different tasks.
• Help improve the quality of multilingual search results through your assessments.

Requirements

To participate, you should:

• Have strong language proficiency in at least one of the supported languages/locales in the section below
• Have strong reading comprehension and attention to detail.
• Be comfortable following detailed annotation and evaluation guidelines.
• Have access to a laptop or desktop computer.
• Have a reliable internet connection.

Languages

• German — Germany (de-DE)
• French — France (fr-FR)
• Spanish — Spain (es-ES)
• Italian — Italy (it-IT)
• Dutch — Netherlands (nl-NL)

Project details

• ProjectType: Search relevance annotation
• Location: Remote
• Duration: Ongoing

Interested in contributing to better multilingual search experiences?

Apply through OneForma and complete the required qualification steps to get started.