TikTok logo

Content Quality and Evaluation Team Lead - Safety Model Operations - Kuala Lumpur

TikTok
42 minutes ago
Full-time
On-site
Kuala Lumpur, Kuala Lumpur, Malaysia
Manager
Responsibilities
About the team
The Safety Model Operations [SMO] team is responsible for building, optimizing, and maintaining machine learning models and operational processes that support TikTok's Trust & Safety systems. We ensure that automated safety models perform effectively in identifying harmful content, mitigating risks, and maintaining a safe user environment across regions.

The SMO Delivery Team plays a critical role in the organization. Its primary responsibility is to carry out the full spectrum of quality assurance activities for each project. This includes:
- Conducting detailed reviews and complex RCA's to ensure labeling accuracy and consistency
- Monitoring quality performance and compliance against project-specific KPIs
- Identifying trends, risks, and potential gaps in processes or guidelines
- Providing structured feedback and improvement recommendations to the Central Project Team
- Supporting continual optimization of workflows, tools, and evaluation methodologies
- Improve Model performance of AI models

What will I do?
As the Content Quality & Evaluation Team Lead, you will lead a team of Content Quality and Evaluation Specialist to build the Golden Sets that define Ground Truth for platform policies, AI model evaluation, and global enforcement teams. You will drive deep-dive analyses on high-risk and contentious safety cases, transforming macro policies into crystal-clear SOPs and operational guidelines. By orchestrating a continuous closed-loop feedback system across Operations, Algorithm, Product, and global teams, you will turn Golden Set insights into system-wide improvements—enhancing both human review quality and AI interception accuracy. You will also systematize quality methodologies, establish robust QA mechanisms, and own core data metrics.

Responsibilities
1. Lead Golden Set Production: Lead the team to produce high-quality datasets (Golden Sets) for model training and evaluation, curating long-tail, high-risk, and complex edge cases to establish accurate Ground Truth for policies, AI models, and global enforcement teams.
2. Drive Deep-Dive & Process Abstraction: Oversee deep-dive analyses on high-risk and highly debated safety cases to identify misapplication patterns and risk trends, translating macro policies into logical SOPs and operational guidelines.
3. Manage Quality Performance: Comprehensively manage quality performance across multiple workflows, drive continuous improvement, and ensure the achievement of both efficiency and quality goals.
4. Lead Cross-Functional Collaboration: Lead collaboration with Operations, Algorithm, Product, and global teams to identify system vulnerabilities based on Golden Set metrics, achieving bidirectional improvements in human review quality and AI agent interception.
5. Systematize QA Methodologies: Systematize universal methodologies for the content quality management framework and establish robust daily QA mechanisms, tracking core data metrics to enhance accuracy and operational efficiency.
6. Proactively Identify & Mitigate Risks: Proactively identify quality risks and assess their impact on workflows, agilely resolving risks while ensuring stable delivery.
7. Build Team Capability: Drive team capability building and operational management, including personnel development and resource allocation, to ensure

Qualifications
Minimum Qualifications:
- Bachelor's degree or higher with at least 2 years of team management experience.
- Deep understanding of content safety model annotation policies and guidelines, with excellent content analysis, data analysis, and summarization skills.
- Strong English communication skills and logical thinking, with the ability to quickly understand business needs and effectively prioritize tasks.
- Strong leadership and operational management skills, familiarity with content quality control tools and management systems, and the ability to effectively motivate teams and handle unexpected situations.
- Experience managing cross-market teams or leading project implementation is preferred, with the ability to thrive in a fast-paced, multicultural environment.

Preferred Qualifications:
- Proven experience in producing high-quality datasets (Golden Sets) for model training and evaluation, curating long-tail, high-risk, and complex edge cases to establish accurate Ground Truth for policies, AI models, and global enforcement teams.

Trust & Safety
Content that this role interacts with includes images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals. Hence, it is possible that this role will be exposed to harmful content on a daily basis. ​

TikTok recognises that keeping our platform safe for the TikTok communities is no ordinary job which can be both rewarding and psychologically demanding and emotionally taxing for some. This is why we are sharing the potential hazards, risks and implications in this unique line of work from the start, so our candidates are well informed before joining. ​

We are committed to the wellbeing of all our employees and promise to provide comprehensive and evidence-based programs, to promote and support physical and mental wellbeing throughout each employee's journey with us. We believe that wellbeing is a relationship and that everyone has a part to play, so we work in collaboration and consultation with our employees and across our functions in order to ensure a truly person-centred, innovative and integrated approach.​


About TikTok
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.​


Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.​
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.​

Diversity & Inclusion​
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.​