Community

Home >

Jobs >

Scaled Abuse Analyst, YouTube Trust and Safety

Scaled Abuse Analyst, YouTube Trust and Safety

1 Week ago • 2 Years + • Editorial

About the job

4 skills required for this role

Add these skills to join the top 1% applicants for this job

sql

incident-response

data-analytics

cross-functional

Job Description

The Scaled Abuse Analyst at YouTube's Trust & Safety team works globally to prevent harmful content. Responsibilities include researching abuse trends, analyzing data (using SQL and potentially machine learning models like LLMs and BERT) to identify detection gaps and develop solutions, improving enforcement quality, contributing to new workflows, and responding rapidly to abuse incidents. The role requires collaboration with cross-functional teams and a proactive approach to addressing evolving threats like influence operations and financially motivated abuse. The analyst will contribute to strategies that reduce harmful content and protect the YouTube platform and user base.

Must have:

Bachelor's degree or equivalent experience
2+ years in data analytics, Trust & Safety, or related fields
Experience with SQL and spreadsheets
Excellent problem-solving skills
Content policy & abuse review experience

Good to have:

Experience with identifying abuse trends
Experience with machine learning models
Experience in news or policy
Ability to build cross-functional relationships

Minimum qualifications:

Bachelor's degree or equivalent practical experience.
2 years of experience in data analytics, Trust and Safety, policy, cybersecurity, or related fields.

Preferred qualifications:

Experience in content policy, anti-abuse, and reviewing online content.
Experience with identifying abuse trends or working in news or policy.
Experience with SQL and spreadsheets.
Ability to build relationships with cross-functional partners across geographies.
Excellent problem-solving skills, with the ability to use data to drive strategy and business action.

About the job

Fast-paced, dynamic, and proactive, YouTube’s Trust & Safety team is dedicated to making YouTube a safe place for users, viewers, and content creators around the world to belong, create, and express themselves. Whether understanding and solving their online content concerns, navigating within global legal frameworks, or writing and enforcing worldwide policy, the Trust & Safety team is on the frontlines of enhancing the YouTube experience, building internet safety, and protecting free speech in our ever-evolving digital world.

As a Scaled Abuse Analyst, you will be responsible for working with a global team from policy, enforcement, product, engineering, tooling, and legal to prevent violative content from appearing on the platform. You will evaluate abuse trends and develop creative solutions to address detection gaps, quality workflows, and processes. You will also review decisions about the appropriateness of different content. You will grow in a paced, dynamic, and demanding environment where the threat actor landscape is constantly evolving.

In this role, you will be a contributor to the efforts to reduce harmful content on YouTube. You will be part of a team that oversees emerging threats to the YouTube platform and user base. These threats include, influence operations, financially motivated abuse, sensationalist news, with a focus on deceptive practices.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

Research and stay up-to-date on trends and suspicious patterns of abuse across the team’s policy areas. Oversee enforcement quality across team policy areas, including calibrations with vendor teams.
Utilize methods to analyze data sets to gain insights into the impact of abuse on the YouTube ecosystem with knowledge of SQL and dashboarding.
Leverage SQL and programming skills to provide rapid incident response for abuse problems, operating with minimal guidance. Analyze and draw conclusions on root-causes and define and implement mitigation steps.
Contribute to the strategy and development of new workflows to address additional known and emerging vectors of abuse. Apply and develop machine learning models (e.g., using LLMs, BERT) to detect, prevent various types of abuse on YouTube.
Develop Machine Learning (ML) based detection systems for different adversarial and large scale coordinated abuse vectors.

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%

About The Company

Google

3214 Active Jobs

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.