Danish AI Response Evaluator (Native Speaker)

AI models improve when native speakers judge their output carefully. That is the work here.

You receive items in Danish, each with a prompt and two responses generated by our client's language model. For every item you evaluate both responses on instruction following, truthfulness, coherence and clarity, and length. You have search and research tools to fact-check every objective claim, and you document a reliable source for each error you find. Then you write up each response's clearest strengths and areas for improvement, give it an overall quality score, and rank which of the two is preferred, with your reasoning. You work on items in your own field of knowledge, in your native Danish.

No prior AI knowledge is needed. If you are a native Danish speaker with solid English and a sharp eye for writing and reasoning, you can do this well. A background in creative writing, journalism, or a similar field is a plus but not required. Requires a minimum of 15 hours of work per week.

Key responsibilities

• Read each prompt and the two AI-generated Danish responses, and evaluate each response on instruction following, truthfulness, coherence and clarity, and length
• Fact-check every objective claim using the provided search and research tools, and document a reliable source for each error you find
• Write up each response's clearest strengths and areas for improvement
• Give each response an overall quality score
• Rank which of the two responses is preferred and explain your reasoning
• Apply reviewer feedback and keep your judgments consistent across the batch

Ideal qualifications

• Native Danish speaker
• English at B2 or above, enough to work from written guidelines
• A sharp eye for writing quality, factual accuracy, and clear reasoning
• Comfortable working independently and remotely on task-based work
• Reliable internet and a quiet space to focus
• Available at least 15 hours per week

Requirements

• Native Danish speaker
• English reading at B2 or above
• Reliable internet and a quiet workspace
• Comfortable with remote, task-based work and following written guidelines
• Available at least 15 hours per week
• Background in creative writing, journalism, or similar preferred

Nice to have

• A background in creative writing, journalism, or a similar field
• Subject-matter expertise in a domain you can evaluate confidently
• Prior experience evaluating or reviewing written content, or working from structured guidelines

What success looks like

• Evaluations that hold up when a reviewer checks them against the prompt and responses
• Every objective claim fact-checked, with a reliable source documented for each error
• Clear, specific write-ups of strengths, weaknesses, and the reason for your ranking
• Consistency across the whole batch rather than item-by-item drift
• Steady, reliable throughput once you are up to speed

Payment & terms

• Paid at EUR 12 per hour for the pilot, with a minimum of 15 hours per week. Fully remote, task-based, set your own hours. Production rates are still to be confirmed. Paid monthly once your work is approved.