LLM Evaluation Specialist (Multiple Languages) | AI | Lisbon

Location: Lisbon, Portugal

Schedule: 24/7 Rotational Shifts (Monday–Sunday, 2 rotational days off)

Languages We're Hiring For

• German
• Turkish
• Russian
• Italian
• Arabic
• French
• English
• Polish
• Hebrew
• Portuguese
• Spanish
• Hungarian
  
  

Shape the future of Artificial Intelligence

We're looking for LLM Evaluation Specialists to help improve the next generation of AI by reviewing, evaluating and annotating AI-generated content.

If you have experience with Generative AI, Large Language Models (LLMs) or AI data annotation, this is an exciting opportunity to work on cutting-edge technology in an international environment.

Your Responsibilities

• Evaluate AI-generated responses following detailed guidelines.
• Label and annotate Large Language Model (LLM) outputs.
• Assess responses for quality, accuracy, relevance and safety.
• Identify inconsistencies and edge cases.
• Provide high-quality feedback to improve AI model performance.
• Meet productivity and quality targets while handling confidential information.
  
  

What We're Looking For

• Fluent level proficiency in one of the languages listed above.
• English (minimum B2).
• Strong understanding of Generative AI and Large Language Models (LLMs).
• Experience with AI Data Annotation, LLM Evaluation, RLHF, Supervised Fine-Tuning (SFT), Content Labeling, Trust & Safety, Quality Assurance, or similar analytical roles.
• Strong analytical skills and attention to detail.
• Ability to follow complex written guidelines consistently.
• Comfortable working in a fast-paced, quality-driven environment.
  
  

What We Offer

• Work on one of today's most innovative AI projects.
• International and multicultural environment.
• Full training and ongoing support.
• Valuable experience in the rapidly growing AI industry.
  
  

If you're passionate about AI and language, we'd love to hear from you. Apply today!

Skills: polish,english,turkish,french,portuguese,spanish,hungarian,russian,arabic,hebrew,italian,german