Six month in: Trust and Safety Jobs recap. Learn More 👉
G

Trust & Safety Lead

Genies
On-site
San Francisco, California, United States
Manager
Genies is an AI avatar and games technology company powering the next generation of digital experiences through Smart Avatars. Genies' technology stack is rooted in empowering user generated content through the company's two main mantras: “Anyone can create anything” & “Everything works with everything”. By combining these two guiding principles, individuals can craft limitless experiences while IP owners can build dynamic social gaming ecosystems powered by user-generated content (UGC) and AI Avatars—what Genies calls "Parties." Genies' technology stack features a comprehensive suite of UGC tools that enable anyone to create AI avatars, complete with customizable fashion, props, behaviors, and personalities, as well as immersive AI avatar experiences. At its core is the Genies Avatar Framework, which leverages machine learning and computer graphics to ensure seamless interoperability across all user-generated AI avatars and experiences—unlocking boundless creative potential. Early adopters of Genies’ first gen avatars include icons like Justin Bieber, Rihanna, J Balvin, Migos, and thousands more. With offices in Los Angeles and San Francisco, Genies has raised $200M from notable investors including Silver Lake, BOND, NEA, and Bob Iger. We are seeking a Trust & Safety Lead to oversee the integrity and safety of our growing ecosystem of user-generated content (UGC) and AI-powered creation tools. This includes developing policies, systems, and tools to prevent misuse of avatar customization, digital goods, and social interactions, while also safeguarding against emerging risks associated with AI-generated content — such as impersonation, offensive material, or unauthorized use of likeness or training data. You’ll work cross-functionally to ensure that Genies remains a safe, respectful, and inclusive space for creators, consumers, and partners alike as we scale next-gen identity and expression. Responsibilities include owning and evolving Genies’ Trust & Safety strategy, establishing and enforcing community guidelines, partnering with Engineering and Product to develop scalable tools for content moderation and abuse detection, working with partners on brand-specific trust and safety requirements, monitoring platform behavior to identify risks, acting as liaison for safety escalations, managing a team of moderators, collaborating on user education and policy updates, and staying ahead of industry trends and regulations. Requirements include 5–7+ years of experience in Trust & Safety, Content Moderation, Risk, or Policy roles within digital platforms or creator ecosystems, proven experience creating scalable trust & safety operations and policies, strong understanding of UGC moderation and risk detection, leadership in crisis response, excellent judgment and communication skills, ability to work cross-functionally, and a passion for digital identity or virtual economies. Experience managing a global or distributed moderation team is a bonus. Benefits include professional development support, flexible hours and work from home policy, startup culture with stability, comprehensive health insurance, competitive salaries, unlimited paid time off, health & wellness programs, modern office space, and choice of MacBook or Windows laptop.