Instruction Following Data Labeler

Description

You'll label text data focused on instruction-following behavior — specifically, evaluating whether a model's output correctly satisfies the constraints and intent of a given user instruction. Tasks include binary labels (did the model follow the instruction — yes/no), multi-attribute scoring (tone, format, completeness, constraint adherence), and span-level annotation (highlight exactly which part of the output fails to follow a stated constraint). You'll work with a detailed labeling guide and per-project instructions that define edge cases explicitly.

The data covers a wide range of instruction types: formatting requests ("respond only in bullet points"), content constraints ("do not mention competitors"), persona instructions, length targets, and structured output requirements (JSON, tables, lists). Each task is self-contained — you read the instruction, read the output, apply the rubric, and submit. Throughput targets are typically 30–50 tasks per hour for straightforward binary tasks, lower for multi-attribute annotation. Work is async and batched.

You should be a strong reader with high attention to detail and the ability to apply written guidelines consistently across varied examples. Prior experience in content moderation, linguistic annotation, or data quality work is directly transferable. You don't need a technical background — but you do need to read instructions carefully and flag ambiguous cases through the proper escalation channel rather than guessing.

Skills & requirements

Instruction interpretationRubric-based text labelingSpan-level annotationConstraint adherence evaluationAttention to detailAnnotation guideline complianceApply Now

Frequently asked questions

What tools or platforms will I use to complete tasks?How do I handle cases where I'm genuinely unsure how to label something?Is there a test or evaluation before I start paid work?// QUICK INFO

Type

Contractor

Compensation

$20–35/hr

Location

Remote

Category

Data Labeling

Posted

July 20, 2026

Apply Now Back to all positions

// RELATED POSITIONS

More Data Labeling rolesData LabelingNLP Data Annotator$60–85/hrViewData LabelingMultimodal Data Labeler$35–45/hrViewData LabelingText Classification Annotator$25–35/hrViewData LabelingSemantic Annotation Analyst$40–50/hrViewView all open positions

// READY TO GET STARTED?

Apply in minutes

Create your profile, select your areas of expertise, and start working on frontier AI projects.

Apply Now