AI Model Assurance Analyst
TikTok USDS Joint Venture
1 hour ago
Full-time
On-site
New York, New York, United States
$98,800 - $196,000 USD yearly
Analyst
Responsibilities
About the Team
JV AI & Systems Integrity is the independent function inside the TikTok USDS Joint Venture security organization that opines on whether generative AI features shipping to US users meet the JV's safety and content commitments. We operate the approval gates, testing programs, deviation adjudication, and audit-facing evidence pipeline for every JV-covered GenAI surface. We work in close partnership with legal, safety, and engineering teams.
About the Role
The AI Model Assurance Analyst is the operational backbone of our GenAI oversight program. You will be the person who makes our control set (covering pre-launch approval, change management, change and deviation detection, inventory, independent validation, incident response, metrics reporting, and access segregation) run day-to-day: routing and completing intake and assessment tickets, driving evaluation dossiers to decisions, keeping the our risk and safety strategy registries accurate, monitoring performance, coordinating independent validation, and producing the monthly/quarterly oversight reports that go to JV leadership.
This is a hands-on operations role with meaningful policy and technical surface area. You will discuss and opine on release thresholds, develop strategies to catch unnotified changes, drive automation in our end-to-end process, and be the person a launch is waiting on when the evidence isn't good enough yet. We need someone who can hold this operational tempo without losing the thread on independence.
Responsibilities
- Manage the intake queue and progression of GenAI model and feature releases; validate submission completeness and be accountable for driving SLAs. Escalate risk of slippage proactively.
- Classify submissions as material vs. non-material vs. emergency and route them to appropriate evaluation teams
- Prepare approval-decision packages (approve / approve-with-conditions / reject / request more evidence) for the Content Assurance lead and log conditional approvals against post-launch monitoring commitments.
- Operationalize change-detection tooling (e.g., hash / configuration snapshots, deployment-event feed, canary-input probes) and triage unnotified-change alerts
- Codify the performance envelope for each approval node against our standards of independent testing
- Watch alerts routing into the Content Assurance queue in parallel with T&S; run joint triage; distinguish drift from change; drive deviation adjudication to closure and log outcomes
- Support CA incident response; co-author author remediation plans and post-incident reviews in partnership with our incident response team and compliance engineering teams.
- Feed the audit evidence pipeline; own artifact readiness against GRC's evidence request list and track completion percentage weekly.
- Produce the standing JV oversight reports on a regular cadence: adoptions and changes processed, incidents, SLA breaches, validation coverage, open remediation, and other details.
- Drive the weekly joint T&S / AISI triage, the quarterly rotating deep-dive, and the annual program review and threshold recalibration.
- Track program-level KPIs and surface trends and blockers to leadership.
- Contribute to model assurance evaluation refreshes (risk-based eval, neutrality test sets, safety testing framework and SOP) and the "white glove" testing service for partner product teams
- Contribute to the AI Model Assurance Dashboard, model release pipeline automation, and notification loops across all cross-functional partners for an integrated source of truth on independent testing status
Qualifications
Minimum Qualifications
- Bachelor's degree in a technical, policy, or risk-adjacent field (e.g., Computer Science, Statistics, Information Security, Public Policy, Trust & Safety, Compliance), or equivalent practical experience.
- 3+ years of operations, program management, GRC, T&S policy operations, or model-risk / model-ops experience, including at least one role owning a recurring cross-functional workflow with hard SLAs.
- Direct working knowledge of at least one of: generative AI / LLM systems, content moderation classifiers, trust & safety operations, model-risk management, or AI/ML evaluation.
- Ability to read and reason about an evaluation dossier (precision / recall, refusal rate, false-positive rate on protected categories, red-team results) and to challenge materiality classifications on the substance rather than only the paperwork.
- Fluency operating ticketed intake and approval workflows (Jira / Meego / equivalent), maintaining registries of record, and producing structured evidence packages for audit or regulatory review.
- Demonstrated ability to drive cross-functional partners (engineering, policy, legal, security) to a decision on a fixed clock.
- Written communication strong enough to draft SOP language, decision memos, and monthly oversight reports without heavy editing.
Preferred Qualifications
- Prior work under the USDS National Security Agreement, a bank / model-risk governance regime (e.g., SR 11-7), or a formal AI management system (NIST AI RMF, ISO/IEC 42001).
- Experience running or supporting a third-party pre-assessment or independent audit — including artifact readiness, control walk-throughs, and finding remediation planning.
- Hands-on familiarity with red-teaming, adversarial test set design, or evaluation harnesses for text, image, audio, or video GenAI systems.
- Basic scripting proficiency (Python / SQL) sufficient to pull metrics from a dashboard, join two tables, or sanity-check a claimed evaluation delta.
- Exposure to internal tooling is a strong plus but not required.
About USDS
TikTok USDS Joint Venture LLC is dedicated to the safety and security of millions of Americans who create, discover, and connect with what they love on the apps we operate. The Joint Venture has been established in compliance with the Executive Order signed by President Trump on September 25, 2025. Our foundation is a comprehensive data privacy and cybersecurity program we operate under defined safeguards to protect national security and secure U.S. user data, apps and the algorithm. We safeguard the U.S. content ecosystem, holding decision-making authority for trust and safety policies and moderation. USDS Joint Venture helps ensure Americans can continue to express their creativity, discover new hobbies and interests, and build thriving communities and businesses on a global scale.
On-site presence across teams allows the company to operate with greater speed, alignment, and agility — especially in areas like real-time decision-making, team development, and integrated execution. As such, the company is shifting from a hybrid work model to a fully in-person schedule up to 5 days a week.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
USDS Reasonable Accommodation
USDS is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/USDS-RA
Job Information
【For Pay Transparency】Compensation Description (Annually)
The base salary range for this position in the selected city is $98800 - $196000 annually.
Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.
Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).
The Company reserves the right to modify or change these benefits programs at any time, with or without notice.
For Los Angeles County (unincorporated) Candidates:
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:
1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
3. Exercising sound judgment.
About the Team
JV AI & Systems Integrity is the independent function inside the TikTok USDS Joint Venture security organization that opines on whether generative AI features shipping to US users meet the JV's safety and content commitments. We operate the approval gates, testing programs, deviation adjudication, and audit-facing evidence pipeline for every JV-covered GenAI surface. We work in close partnership with legal, safety, and engineering teams.
About the Role
The AI Model Assurance Analyst is the operational backbone of our GenAI oversight program. You will be the person who makes our control set (covering pre-launch approval, change management, change and deviation detection, inventory, independent validation, incident response, metrics reporting, and access segregation) run day-to-day: routing and completing intake and assessment tickets, driving evaluation dossiers to decisions, keeping the our risk and safety strategy registries accurate, monitoring performance, coordinating independent validation, and producing the monthly/quarterly oversight reports that go to JV leadership.
This is a hands-on operations role with meaningful policy and technical surface area. You will discuss and opine on release thresholds, develop strategies to catch unnotified changes, drive automation in our end-to-end process, and be the person a launch is waiting on when the evidence isn't good enough yet. We need someone who can hold this operational tempo without losing the thread on independence.
Responsibilities
- Manage the intake queue and progression of GenAI model and feature releases; validate submission completeness and be accountable for driving SLAs. Escalate risk of slippage proactively.
- Classify submissions as material vs. non-material vs. emergency and route them to appropriate evaluation teams
- Prepare approval-decision packages (approve / approve-with-conditions / reject / request more evidence) for the Content Assurance lead and log conditional approvals against post-launch monitoring commitments.
- Operationalize change-detection tooling (e.g., hash / configuration snapshots, deployment-event feed, canary-input probes) and triage unnotified-change alerts
- Codify the performance envelope for each approval node against our standards of independent testing
- Watch alerts routing into the Content Assurance queue in parallel with T&S; run joint triage; distinguish drift from change; drive deviation adjudication to closure and log outcomes
- Support CA incident response; co-author author remediation plans and post-incident reviews in partnership with our incident response team and compliance engineering teams.
- Feed the audit evidence pipeline; own artifact readiness against GRC's evidence request list and track completion percentage weekly.
- Produce the standing JV oversight reports on a regular cadence: adoptions and changes processed, incidents, SLA breaches, validation coverage, open remediation, and other details.
- Drive the weekly joint T&S / AISI triage, the quarterly rotating deep-dive, and the annual program review and threshold recalibration.
- Track program-level KPIs and surface trends and blockers to leadership.
- Contribute to model assurance evaluation refreshes (risk-based eval, neutrality test sets, safety testing framework and SOP) and the "white glove" testing service for partner product teams
- Contribute to the AI Model Assurance Dashboard, model release pipeline automation, and notification loops across all cross-functional partners for an integrated source of truth on independent testing status
Qualifications
Minimum Qualifications
- Bachelor's degree in a technical, policy, or risk-adjacent field (e.g., Computer Science, Statistics, Information Security, Public Policy, Trust & Safety, Compliance), or equivalent practical experience.
- 3+ years of operations, program management, GRC, T&S policy operations, or model-risk / model-ops experience, including at least one role owning a recurring cross-functional workflow with hard SLAs.
- Direct working knowledge of at least one of: generative AI / LLM systems, content moderation classifiers, trust & safety operations, model-risk management, or AI/ML evaluation.
- Ability to read and reason about an evaluation dossier (precision / recall, refusal rate, false-positive rate on protected categories, red-team results) and to challenge materiality classifications on the substance rather than only the paperwork.
- Fluency operating ticketed intake and approval workflows (Jira / Meego / equivalent), maintaining registries of record, and producing structured evidence packages for audit or regulatory review.
- Demonstrated ability to drive cross-functional partners (engineering, policy, legal, security) to a decision on a fixed clock.
- Written communication strong enough to draft SOP language, decision memos, and monthly oversight reports without heavy editing.
Preferred Qualifications
- Prior work under the USDS National Security Agreement, a bank / model-risk governance regime (e.g., SR 11-7), or a formal AI management system (NIST AI RMF, ISO/IEC 42001).
- Experience running or supporting a third-party pre-assessment or independent audit — including artifact readiness, control walk-throughs, and finding remediation planning.
- Hands-on familiarity with red-teaming, adversarial test set design, or evaluation harnesses for text, image, audio, or video GenAI systems.
- Basic scripting proficiency (Python / SQL) sufficient to pull metrics from a dashboard, join two tables, or sanity-check a claimed evaluation delta.
- Exposure to internal tooling is a strong plus but not required.
About USDS
TikTok USDS Joint Venture LLC is dedicated to the safety and security of millions of Americans who create, discover, and connect with what they love on the apps we operate. The Joint Venture has been established in compliance with the Executive Order signed by President Trump on September 25, 2025. Our foundation is a comprehensive data privacy and cybersecurity program we operate under defined safeguards to protect national security and secure U.S. user data, apps and the algorithm. We safeguard the U.S. content ecosystem, holding decision-making authority for trust and safety policies and moderation. USDS Joint Venture helps ensure Americans can continue to express their creativity, discover new hobbies and interests, and build thriving communities and businesses on a global scale.
On-site presence across teams allows the company to operate with greater speed, alignment, and agility — especially in areas like real-time decision-making, team development, and integrated execution. As such, the company is shifting from a hybrid work model to a fully in-person schedule up to 5 days a week.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
USDS Reasonable Accommodation
USDS is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/USDS-RA
Job Information
【For Pay Transparency】Compensation Description (Annually)
The base salary range for this position in the selected city is $98800 - $196000 annually.
Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.
Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).
The Company reserves the right to modify or change these benefits programs at any time, with or without notice.
For Los Angeles County (unincorporated) Candidates:
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:
1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
3. Exercising sound judgment.