AI Engineer – Trust & Safety

About Coverstar

Coverstar is building the first safe, creative, AI-native social platform for Gen Alpha. We’re building a world where the next generation can create, connect, and grow with technology that’s fun, expressive, and safe by design. We’re backed by top investors like a16z, moving fast, and hiring a mission-aligned Trust & Safety AI Engineer to help us power the next generation of personalized content and community.

What You Will Do

As our Trust & Safety AI Engineer, you’ll design, build, and ship AI systems that keep Coverstar safe and delightful across the video feed, livestreams, and creation tools. The impact is immediate: the models that you trained and rule engines protect kids, reduce harmful content, and stop bad actors before they reach our community.

Your Responsibilities

Build safety ML at scale: Train and deploy models and classifiers for policy-violating content (text, image, audio, video), integrity abuse (spam, raids, fake engagement), and bad-actor detection.
Build and extend our Moderator Console: Develop and maintain a web-based console application to empower internal teams with efficient moderation and safety workflows.
Enhance trust & safety tooling: Improve moderation dashboards, user-reporting pipelines, and automated enforcement systems (warnings, bans, restrictions) to keep our community safe.
Apply data science for safety monitoring: Use and Python-based data science and machine learning tools to design, train, and deploy risk-detection models that scale across the platform.
Continuously improve safety systems: Monitor performance, iterate on detection strategies, and ensure robust coverage against new patterns of abuse or harmful content.
Ship real-time protection: Design low-latency moderation inference for livestream, feed and messages.

You Might be a Fit If

Have 2+ years of hands-on ML/AI experience in computer vision and transformer based text models (e.g. BERT).
Are fluent in Python (and ideally SQL), with experience building, training, and deploying models into production.
Have worked with multimodal ML (text, image, audio, or video) and/or LLMs, vLLMs and SGLang and have experience of fine-tuning them.
Have experience building moderation UIs or internal tools using modern web frameworks (shadcn/ui, tailwind, svelte or similar libraries).
Have experience creating datasets for training, fine-tuning and tackling data-drift for various models in-production.
Understand streaming data, low-latency inference, and real-time monitoring.
Care deeply about child safety online and want your engineering work to directly protect kids and strengthen communities.
Thrive in a fast-moving startup where you’ll have ownership, impact, and the chance to shape both our product and culture.

Our Tech Stack

Backend: Mainly AWS services, including Lambda, EC2 and RDS/DynamoDb
Languages: Python, NodeJS
AI: Open-source AI models, in-house intelligence systems, custom LLM pipelines, and seamless API integrations.
Clients: Native iOS & Android apps via secure backend APIs

Why Join Us?

Build and scale the core infrastructure behind the next-gen social platform for Gen Alpha
Solve high-impact reliability and security challenges at the intersection of scale and safety
Work with a fast-moving team of backend engineers, AI specialists, and product builders