Rex.zone logo

Remote Data Labeling Jobs UK

Rex.zone
3 hours ago
Full-time
Remote
United States
$30 - $50 USD hourly
Rex.zone is hiring for a full-time remote role focused on training-data creation and evaluation for AI/ML systems. You will support production-grade pipelines across NLP, LLM evaluation/RLHF-style workflows, computer vision annotation, and content safety labeling with measurable quality targets and audit-ready documentation.

What You Will Do

  • Label and review text, image, and multi-modal datasets using project rubrics and tooling
  • Perform QA evaluation on peer outputs, escalate edge cases, and propose guideline clarifications
  • Execute prompt evaluation and LLM response rating to generate RLHF-ready preference data
  • Conduct content safety labeling (e.g., harassment, self-harm, violence, adult content, regulated goods)
  • Track errors, maintain audit trails, and participate in calibration sessions to improve inter-annotator agreement
  • Collaborate with operations and engineering partners to refine instructions and reduce ambiguity

Required Qualifications

  • Experience delivering professional data labeling or QA evaluation work with documented quality metrics
  • Strong reading comprehension and ability to apply complex rubrics consistently
  • Familiarity with LLM evaluation concepts (preference ranking, rubric scoring, prompt evaluation)
  • Comfort working with annotation tools, structured forms, and versioned guidelines
  • Ability to write concise rationales and document difficult cases

Preferred Qualifications

  • Exposure to RLHF pipelines and large language model evaluation
  • Computer vision annotation (boxes, polygons, keypoints)
  • NLP labeling experience including named entity recognition
  • Content safety / trust & safety workflow experience

Compensation

Hourly range: $30–$50/hour (USD).

Workplace: Remote

Employment Type: Full-time