Full-Stack Code Output Evaluator

Description

You'll review AI-generated code across the full web stack — JavaScript, TypeScript, Java backend services, and Node.js APIs — assessing correctness, security, maintainability, and adherence to the task specification. For each task, you receive a prompt that was given to a code-generating model and the code it produced. You run the code (in a provided sandbox or your local environment), verify it works as specified, and score it on multiple rubric dimensions. If the code is broken or insecure, you document exactly why, with line-level references.

Workflows include side-by-side comparison tasks (picking the better of two model outputs with written justification), single-output correctness reviews (does this code do what the prompt asked?), and security-flag tasks (does this output introduce SQL injection, XSS, or insecure dependency patterns?). You'll also encounter backend architecture tasks where you evaluate whether a Node.js or Java service is structured sensibly for the stated use case — not just whether it runs, but whether a senior engineer would accept it in a real PR. Some tasks use Eclipse-based Java projects; comfort navigating that toolchain is expected.

You should have at least 4 years of professional full-stack development experience, with production-level fluency in JavaScript/TypeScript and Java. You don't need to write new features — your job is to read and judge code quickly and accurately. Annotators who've done code review as part of a senior or lead engineering role tend to calibrate well for this work.

Skills & requirements

JavaScript and TypeScript proficiencyJava backend developmentNode.js API architectureSecurity vulnerability identificationCode review and pull request evaluationApply Now

Frequently asked questions

Do I need to run the code myself, or is execution handled in a sandbox?How specific does my written feedback need to be?Are tasks language-specific, or will I see a mix of JavaScript and Java in the same batch?// QUICK INFO

Type

Contractor

Compensation

$55–100/hr

Location

Remote

Category

Coding Review

Posted

June 29, 2026

Apply Now Back to all positions

// RELATED POSITIONS

More Coding Review rolesCoding ReviewPython Code Generation Reviewer$35–55/hrViewCoding ReviewTechnical Code Assessor$40–50/hrViewCoding ReviewSoftware Output Evaluator$40–50/hrViewCoding ReviewCode Correctness Analyst$70–80/hrViewView all open positions

// READY TO GET STARTED?

Apply in minutes

Create your profile, select your areas of expertise, and start working on frontier AI projects.

Apply Now