Moderation Quality Assurance Specialist
TikTok USDS Joint Venture
2 hours ago
Full-time
On-site
Scottsdale, Arizona, United States
Specialist
Responsibilities
About the Team
Trust and Safety Operations is a pivotal team within U.S. Data Security. We strive to enable TikTok to become the most trusted and secure platform in the US through operational excellence in content moderation via innovations in technology, optimization in processes and investment in people. We ensure that we enforce our policies based on our community guidelines and we take appropriate actions in a timely manner to minimize risks on our platform to our users and advertisers.
This team performs a critical function that supports our efforts to address objectionable or disturbing content. Content that this role interacts with includes images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child abuse; sexual assault; torture; bestiality; self-harm; suicide; and murder. It is possible that this role will be exposed to harmful content on a daily basis.
About the Role
The Quality Analyst on TikTok's USDS Trust and Safety team plays a key role in upholding platform quality and safety. Reporting to the Moderation Quality Manager, you will assess moderation performance, review graphic content, identify quality risks, and translate QA signals into business intelligence that inform content moderation strategy across in-house and BPO teams.
Working cross-functionally with R&D, Strategy & Analytics, Policy, Training, Workforce Management, Product, and Enforcement Operations, you will propose evidence-based solutions and help partners make informed decisions across the Trust and Safety moderation lifecycle.
In order to enhance collaboration and cross-functional partnerships, among other things, at this time, our organization follows a hybrid work schedule that requires employees to work in the office 5 days a week, or as directed by their manager/department. We regularly review our hybrid work model, and the specific requirements may change at any time.
Key Responsibilities
- Assess the overall quality of performance by moderation sites, ensuring strict compliance with TikTok's policies and processes.
- Review TikTok content, including graphic material, to enforce policy decisions and maintain user safety.
- Conduct weekly audits and calibration sessions, analyzing error trends to identify patterns, performance gaps, and improvement opportunities.
- Lead system-wide root cause analyses (RCAs), QA deep dives, and data validation processes for Trust and Safety moderation queues; document and report findings to leadership.
- Develop and deliver forward-looking, data-based strategies that shape trust and safety policies and resolve complex quality issues.
- Serve as a functional bridge between external vendors, internal stakeholders, and the quality team; identify performance gaps and partner with vendor leadership to prepare solutions.
- Ensure partners are on track to meet or exceed KPI targets, and support calibration processes, Monthly Quality Reports, Monthly Business Reviews, glide paths, and daily or weekly quality metric tracking.
- Analyze quantitative and qualitative QA datasets and use visualization or descriptive reporting to generate impact-driven recommendations for Training, Product, Workforce Management, Enforcement Operations, and other department partners.
- Develop automated reporting and ensure data quality through documentation, validation, and quality assurance of delivered insights.
- Partner with data and analytics stakeholders on tools, dashboards, and business cases that improve QA processes for the Training and Quality Department.
- Design and analyze product experiments and propose frameworks to communicate results.
- Evaluate moderation AI model performance, including decision accuracy, reasoning quality, and failure patterns, to identify risks and recommend improvements to model-assisted enforcement workflows.
- Lead ad hoc projects that enhance quality assurance practices, operational efficiency, and scalable moderation outcomes.
- Maintain expert understanding of TikTok's policies, procedures, app features, and internal documents; act as a thought partner to foster innovation and efficiency within the team.
Qualifications
Minimum Qualifications
- BA/BS degree in a relevant field or equivalent experience in content moderation, quality assurance, or similar areas.
- 3+ years of experience in Trust & Safety or a similar industry.
- 2+ years of experience in quality assurance, reporting, analytics, or operational excellence.
- Experience developing analysis reports, conducting root cause analyses, and turning data into clear, actionable recommendations. Able to gather and analyze information, identify key takeaways, and explain findings clearly to both technical and non-technical audiences, verbally and in writing.
- Experience applying policy labels or enforcement actions to media content, with a strong focus on user safety and platform integrity.
- Skilled at identifying problems, recommending practical solutions, and understanding stakeholder needs. Able to provide guidance on both immediate and longer-term solutions, and influence others through clear, honest, and constructive communication, even without formal authority.
- Self-motivated, organized, and comfortable working through ambiguity. Able to move between detailed data analysis and broader business insights while adapting to changing priorities. Proficient in Microsoft Office Suite, including Excel and PowerPoint or similiar platforms.
Preferred Qualifications
- Expert-level knowledge of QA processes including auditing, RCA, and calibration.
- Advanced content risk identification and control experience, with a complete understanding of the moderation and QA process.
- Proven experience manipulating, processing, and extracting value from large and disconnected datasets within spreadsheets and databases.
- Familiarity with Tableau or other data visualization tools that utilize query language.
- Familiarity with using AI-enabled tools or workflows to automate operational processes, scale quality assurance practices, and improve team efficiency.
- Understanding policy developments, platform trends, challenges, and online culture across media, tech, entertainment, and major social media networks.
- Experience in technical writing and technical communication.
- Experience working in a fast paced environment, or forming new teams in established companies.
- Interest in project management skill development.
- Resilience and commitment to self-care to manage the emotional demands of the role.
Trust & Safety
Content that this role interacts with includes images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals. Hence, it is possible that this role will be exposed to harmful content on a daily basis.
TikTok recognises that keeping our platform safe for the TikTok communities is no ordinary job which can be both rewarding and psychologically demanding and emotionally taxing for some. This is why we are sharing the potential hazards, risks and implications in this unique line of work from the start, so our candidates are well informed before joining.
We are committed to the wellbeing of all our employees and promise to provide comprehensive and evidence-based programs, to promote and support physical and mental wellbeing throughout each employee's journey with us. We believe that wellbeing is a relationship and that everyone has a part to play, so we work in collaboration and consultation with our employees and across our functions in order to ensure a truly person-centred, innovative and integrated approach.
About USDS
TikTok USDS Joint Venture LLC is dedicated to the safety and security of millions of Americans who create, discover, and connect with what they love on the apps we operate. The Joint Venture has been established in compliance with the Executive Order signed by President Trump on September 25, 2025. Our foundation is a comprehensive data privacy and cybersecurity program we operate under defined safeguards to protect national security and secure U.S. user data, apps and the algorithm. We safeguard the U.S. content ecosystem, holding decision-making authority for trust and safety policies and moderation. USDS Joint Venture helps ensure Americans can continue to express their creativity, discover new hobbies and interests, and build thriving communities and businesses on a global scale.
On-site presence across teams allows the company to operate with greater speed, alignment, and agility — especially in areas like real-time decision-making, team development, and integrated execution. As such, the company is shifting from a hybrid work model to a fully in-person schedule up to 5 days a week.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
USDS Reasonable Accommodation
USDS is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/USDS-RA
About the Team
Trust and Safety Operations is a pivotal team within U.S. Data Security. We strive to enable TikTok to become the most trusted and secure platform in the US through operational excellence in content moderation via innovations in technology, optimization in processes and investment in people. We ensure that we enforce our policies based on our community guidelines and we take appropriate actions in a timely manner to minimize risks on our platform to our users and advertisers.
This team performs a critical function that supports our efforts to address objectionable or disturbing content. Content that this role interacts with includes images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child abuse; sexual assault; torture; bestiality; self-harm; suicide; and murder. It is possible that this role will be exposed to harmful content on a daily basis.
About the Role
The Quality Analyst on TikTok's USDS Trust and Safety team plays a key role in upholding platform quality and safety. Reporting to the Moderation Quality Manager, you will assess moderation performance, review graphic content, identify quality risks, and translate QA signals into business intelligence that inform content moderation strategy across in-house and BPO teams.
Working cross-functionally with R&D, Strategy & Analytics, Policy, Training, Workforce Management, Product, and Enforcement Operations, you will propose evidence-based solutions and help partners make informed decisions across the Trust and Safety moderation lifecycle.
In order to enhance collaboration and cross-functional partnerships, among other things, at this time, our organization follows a hybrid work schedule that requires employees to work in the office 5 days a week, or as directed by their manager/department. We regularly review our hybrid work model, and the specific requirements may change at any time.
Key Responsibilities
- Assess the overall quality of performance by moderation sites, ensuring strict compliance with TikTok's policies and processes.
- Review TikTok content, including graphic material, to enforce policy decisions and maintain user safety.
- Conduct weekly audits and calibration sessions, analyzing error trends to identify patterns, performance gaps, and improvement opportunities.
- Lead system-wide root cause analyses (RCAs), QA deep dives, and data validation processes for Trust and Safety moderation queues; document and report findings to leadership.
- Develop and deliver forward-looking, data-based strategies that shape trust and safety policies and resolve complex quality issues.
- Serve as a functional bridge between external vendors, internal stakeholders, and the quality team; identify performance gaps and partner with vendor leadership to prepare solutions.
- Ensure partners are on track to meet or exceed KPI targets, and support calibration processes, Monthly Quality Reports, Monthly Business Reviews, glide paths, and daily or weekly quality metric tracking.
- Analyze quantitative and qualitative QA datasets and use visualization or descriptive reporting to generate impact-driven recommendations for Training, Product, Workforce Management, Enforcement Operations, and other department partners.
- Develop automated reporting and ensure data quality through documentation, validation, and quality assurance of delivered insights.
- Partner with data and analytics stakeholders on tools, dashboards, and business cases that improve QA processes for the Training and Quality Department.
- Design and analyze product experiments and propose frameworks to communicate results.
- Evaluate moderation AI model performance, including decision accuracy, reasoning quality, and failure patterns, to identify risks and recommend improvements to model-assisted enforcement workflows.
- Lead ad hoc projects that enhance quality assurance practices, operational efficiency, and scalable moderation outcomes.
- Maintain expert understanding of TikTok's policies, procedures, app features, and internal documents; act as a thought partner to foster innovation and efficiency within the team.
Qualifications
Minimum Qualifications
- BA/BS degree in a relevant field or equivalent experience in content moderation, quality assurance, or similar areas.
- 3+ years of experience in Trust & Safety or a similar industry.
- 2+ years of experience in quality assurance, reporting, analytics, or operational excellence.
- Experience developing analysis reports, conducting root cause analyses, and turning data into clear, actionable recommendations. Able to gather and analyze information, identify key takeaways, and explain findings clearly to both technical and non-technical audiences, verbally and in writing.
- Experience applying policy labels or enforcement actions to media content, with a strong focus on user safety and platform integrity.
- Skilled at identifying problems, recommending practical solutions, and understanding stakeholder needs. Able to provide guidance on both immediate and longer-term solutions, and influence others through clear, honest, and constructive communication, even without formal authority.
- Self-motivated, organized, and comfortable working through ambiguity. Able to move between detailed data analysis and broader business insights while adapting to changing priorities. Proficient in Microsoft Office Suite, including Excel and PowerPoint or similiar platforms.
Preferred Qualifications
- Expert-level knowledge of QA processes including auditing, RCA, and calibration.
- Advanced content risk identification and control experience, with a complete understanding of the moderation and QA process.
- Proven experience manipulating, processing, and extracting value from large and disconnected datasets within spreadsheets and databases.
- Familiarity with Tableau or other data visualization tools that utilize query language.
- Familiarity with using AI-enabled tools or workflows to automate operational processes, scale quality assurance practices, and improve team efficiency.
- Understanding policy developments, platform trends, challenges, and online culture across media, tech, entertainment, and major social media networks.
- Experience in technical writing and technical communication.
- Experience working in a fast paced environment, or forming new teams in established companies.
- Interest in project management skill development.
- Resilience and commitment to self-care to manage the emotional demands of the role.
Trust & Safety
Content that this role interacts with includes images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals. Hence, it is possible that this role will be exposed to harmful content on a daily basis.
TikTok recognises that keeping our platform safe for the TikTok communities is no ordinary job which can be both rewarding and psychologically demanding and emotionally taxing for some. This is why we are sharing the potential hazards, risks and implications in this unique line of work from the start, so our candidates are well informed before joining.
We are committed to the wellbeing of all our employees and promise to provide comprehensive and evidence-based programs, to promote and support physical and mental wellbeing throughout each employee's journey with us. We believe that wellbeing is a relationship and that everyone has a part to play, so we work in collaboration and consultation with our employees and across our functions in order to ensure a truly person-centred, innovative and integrated approach.
About USDS
TikTok USDS Joint Venture LLC is dedicated to the safety and security of millions of Americans who create, discover, and connect with what they love on the apps we operate. The Joint Venture has been established in compliance with the Executive Order signed by President Trump on September 25, 2025. Our foundation is a comprehensive data privacy and cybersecurity program we operate under defined safeguards to protect national security and secure U.S. user data, apps and the algorithm. We safeguard the U.S. content ecosystem, holding decision-making authority for trust and safety policies and moderation. USDS Joint Venture helps ensure Americans can continue to express their creativity, discover new hobbies and interests, and build thriving communities and businesses on a global scale.
On-site presence across teams allows the company to operate with greater speed, alignment, and agility — especially in areas like real-time decision-making, team development, and integrated execution. As such, the company is shifting from a hybrid work model to a fully in-person schedule up to 5 days a week.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
USDS Reasonable Accommodation
USDS is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/USDS-RA