AI Labeling & Evaluation Agent (German-Speaking)

Job Title

AI Labeling & Evaluation Agent (German-Speaking)

Job Description

Experience the power of a game-changing career!

Are you looking for what's next? We're a global technology and services leader that powers the brands of the future. We help well-known brands—the ones you use every day—improve their businesses with technology and integrated solutions across more than 70 countries.

If you're looking to grow and be inspired, as a German-speaking Labeling & Evaluation Agent in Lisbon, Portugal (On-site), you'll contribute to the development and improvement of cutting-edge Artificial Intelligence systems. You'll evaluate AI-generated outputs, apply detailed guidelines, and ensure high-quality annotations that help improve the accuracy, safety, and performance of Large Language Models (LLMs).

Career growth and personal development

We'll give you all the training, cutting-edge technologies, and ongoing support you'll need to succeed. At Concentrix, there’s real career and personal growth potential. Around 80% of our managers and leaders have been promoted from within.

What You Will Do In This Role

As a Labeling & Evaluation Agent, you will:

• Evaluate AI-generated responses according to detailed quality guidelines.
• Produce accurate and consistent labels for language model outputs.
• Assess content for quality, relevance, factual accuracy, safety, and policy compliance.
• Apply complex annotation guidelines across diverse scenarios.
• Identify inconsistencies and edge cases, escalating when appropriate.
• Ensure high-quality output while meeting productivity and quality targets.
• Work with structured text, language data, and AI-generated content.
• Maintain confidentiality and comply with project standards and quality requirements.
• Contribute to the continuous improvement of AI systems through accurate evaluations and feedback.
  
  

Your Qualifications

Concentrix is a great match if you:

• Are fluent, verbal and written in German (C1) and have a good command of English (B2).
• Have experience in AI data annotation, LLM evaluation, RLHF, SFT, Quality Assurance, Content Labeling, Trust & Safety, or similar analytical roles.
• Demonstrate strong analytical thinking, excellent attention to detail, and objective decision-making skills.
• Can accurately interpret and consistently apply complex written guidelines.
• Have excellent written language comprehension and are comfortable working with structured text, datasets, and text-based evaluation tasks.
• Are familiar with Generative AI technologies, Large Language Models (LLMs), and annotation platforms.
• Are available to work rotating shifts, if required.If you don't meet every requirement, we still encourage you to apply.
  
  

What's In It For You

In this role, we offer benefits that help you support your unique lifestyle:

• Competitive salary
• Fully paid training and continuous learning opportunities
• Gain hands-on experience with Generative AI and data annotation technologies
• Career development opportunities within a global technology leader
• Access to free Learning & Leadership Development programmes
• International and multicultural environment
• Central office location in Lisbon
• Bring-a-friend referral bonus
  
  

Experience the best version of you!

If this feels like the perfect next step in your career journey, we want to hear from you.

Apply today and discover why over 440,000 game-changers around the globe call Concentrix their employer of choice.

Concentrix is an equal-opportunity employer

We're proudly united as one team, one company, globally. We're committed to equal employment opportunities for all candidates and a work environment free from discrimination and harassment. All our recruitment practices are based on business needs, job requirements, and professional qualifications, without regard to race, age, gender identity, sexual orientation, religion, ethnicity, family or parental status, national origin, disability, or any other classification protected by applicable national laws.

Eligibility to work

In accordance with Portuguese law, only applicants who are legally authorized to work in Portugal will be considered for this position.