Quality Assurance - Search Ops AI Evaluation

Responsibilities
About the Team
The Search Operations team aims to improve search user experience, contribute significant DAU impact to the products and drive for increase in traffic and GMV.

The T&S evaluation and investigation team, working closely with the search team, taking the evaluation standards as the baseline and principles, and manually evaluating the search query and the corresponding search results page to reflect the real user experience of the search function.

Responsibilities
-Perform regular audits relating to AI model projects, detect errors and inconsistencies completed by specialists.
-Ensure assessments adhere to evaluation standards and quality guidelines.
-Provide constructive feedback, conduct calibration meetings, analyze team performance, and proactively offer solutions and suggestions to address current problems in order to deliver high-quality performance.
-Localise the policy, be responsible for policy training, and align the policy updates.
-Track and analyze quality metrics to identify trends and recommend improvements.
-Collaborate closely with the Product team and R&D to provide feedback on data quality.
-Willing to work on sensitive issues that include child exploitation, a variety of religious and political views, violence, adult and sexual contents.
-Support and participate in ad hoc projects requiring QA expertise.

Qualifications
Minimum Qualifications
- Bachelor degree or above with 1-2 years of experience, major in journalism, literature, mathematics, computer, medicine, law, and economics.
- Excellent language skills in English and Malay language.
- Knowledge about AI or related models, familiar with social media platform.

Preferred Qualifications
- Familiar with QA and data delivery process.
- Overseas working/training is a plus
- An in depth understanding of the culture and familiarity with the internet usage habit of the users.
- Strong ability to learn and understand.
- Familiar with common office software.
- Search evaluation experience is preferred.

About TikTok
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.​


Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.​
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.​
​
Diversity & Inclusion​
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.​


Trust & Safety
TikTok recognises that keeping our platform safe for the TikTok communities is no ordinary job which can be both rewarding and psychologically demanding and emotionally taxing for some. This is why we are sharing the potential hazards, risks and implications in this unique line of work from the start, so our candidates are well informed before joining.​
We are committed to the wellbeing of all our employees and promise to provide comprehensive and evidence-based programs, to promote and support physical and mental wellbeing throughout each employee's journey with us. We believe that wellbeing is a relationship and that everyone has a part to play, so we work in collaboration and consultation with our employees and across our functions in order to ensure a truly person-centred, innovative and integrated approach.​
Show more Show less