LLM Red-teaming Operation, Analyst

3 Months ago • 3 Years + • Monetization • Undisclosed

Job Summary

Job Description

As a core member of our LLM Global Data Team, you'll be at the heart of our operations. Gain first-hand experience in understanding the intricacies of training Large Language Models (LLMs) with diverse data sets, and become a leader building and growing a vibrant team together with us! Your role will involve devising a red-team strategy for LLM and managing internal red-teaming operations. You'll coordinate resources across T&S, Data, and product teams to execute red-team tests and generate comprehensive reports, including vulnerability assessments. Working with internal researchers and external experts on monitoring the latest developments and industry best practices on red-teaming, you will advise on the long-term strategy. You will lead research on novel issues related to privacy and broader questions of fairness, accountability, and transparency related to LLMs. You'll set the research directions and strategies to make our AI systems safer, more aligned, and more robust.
Must have:
  • Solid understanding of key risks previously facing ByteDance corporate and products.
  • Extensive experience in LLM (Large Language Models) red-teaming or in red-teaming for other content/products.
  • Minimum three years of work experience with required skills in LLM Adversarial attacks or Jail-breaking methods.
  • Team player with excellent coordination and persuasion skills.
  • Professional proficiency in English
Good to have:
  • Global education or working experience
  • Direct research experience over SOTA AI safety topics such as RLHF, adversarial training, robustness, and more.

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the team As a core member of our LLM Global Data Team, you'll be at the heart of our operations. Gain first-hand experience in understanding the intricacies of training Large Language Models (LLMs) with diverse data sets, and become a leader building and growing a vibrant team together with us! Your Role Will Involve: 1. Work closely with LLM core teams to devise a red-team strategy for LLM and manage internal red-teaming operations. 2. Coordinate resources across T&S, Data, and product teams to execute red-team tests and generate comprehensive reports, which include, but are not limited to, vulnerability assessments. 3. Work with internal researchers and external experts on monitoring the latest developments and industry best practices on red-teaming and advise on the long term strategy. 4. Lead research on novel issues related to privacy and also broader questions of fairness, accountability, and transparency related to LLMs. 5. Set the research directions and strategies to make our AI systems safer, more aligned and more robust.
Qualifications
Minimum Qualifications: 1. Solid understanding of key risks previously facing ByteDance corporate and products. (Or) extensive experience in LLM (Large Language Models) red-teaming or in red-teaming for other content/products. 2. A minimum of three years of work experience, with required skills in LLM Adversarial attacks or Jail-breaking methods. 3. A team player who knows how to assert influence appropriately. Excellent coordination and persuasion skills are crucial for success in this role. 4. Professional proficiency in English Preferred Qualifications: 1. Global education or working experience 2. Direct research experience over SOTA AI safety topics such as RLHF, adversarial training, robustness, and more. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

Microsoft - Senior Characters & Creatures Gameplay Animator - Gears of War- The Coalition

Microsoft

Vancouver, British Columbia, Canada (On-Site)
• 3 Weeks ago
Blizzard Entertainment - FP&A Manager, World of Warcraft and Diablo

Blizzard Entertainment

London, England, United Kingdom (Hybrid)
• 3 Months ago
Salesforce - Sales Development Representative (Israel Market)

Salesforce

Dublin, County Dublin, Ireland (On-Site)
• 6 Days ago
PwC - Senior Consultant - Technology Consulting - Financial Sector

PwC

Prague, Prague, Czechia (On-Site)
• 3 Months ago
Cloud Chamber - Lead Level Artist

Cloud Chamber

Montréal, Québec, Canada (Hybrid)
• 2 Months ago
ByteDance - Recommendation Platform Product Manager, BytePlus

ByteDance

Singapore (On-Site)
• 3 Months ago
ByteDance - Operation Team Lead - Training Operation (Safety)

ByteDance

Singapore (On-Site)
• 3 Months ago
ByteDance - Campus Recruitment Project Operations Intern

ByteDance

Singapore (On-Site)
• 2 Weeks ago
InMobiInMobi - Sr. Client Growth Manager

InMobiInMobi

San Mateo, California, United States (On-Site)
• 1 Month ago
Unity - Growth Partnership Manager

Unity

San Francisco, California, United States (On-Site)
• 3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

CD PROJEKT RED - Physics Engineer

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
• 6 Months ago
PwC - Associate-Oracle SCM

PwC

Mumbai, Maharashtra, India (On-Site)
• 3 Months ago
PwC - Manager - Deals Advisory - Business Recovery Services

PwC

Jakarta, Jakarta, Indonesia (On-Site)
• 4 Months ago
Lionsgate Games - Coordinator, Global Research

Lionsgate Games

Santa Monica, California, United States (On-Site)
• 1 Week ago
Wind River Systems - Embedded Software Engineer – RTOS / VxWorks

Wind River Systems

Galați, Județul Galați, Romania (On-Site)
• 3 Months ago
PwC - Senior Consultant - Technology consulting

PwC

Prague, Prague, Czechia (On-Site)
• 3 Months ago
Moon Active - Game Development Team Lead

Moon Active

Warsaw, Masovian Voivodeship, Poland (On-Site)
• 3 Months ago
Moon Active - Technical Support Engineer (Tier 3)

Moon Active

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
• 5 Months ago
The Walt Disney Company - Desktop Support Specialist

The Walt Disney Company

Sydney, New South Wales, Australia (On-Site)
• 2 Months ago
Evolution - Gameplay Developer

Evolution

Sofia, Sofia City Province, Bulgaria (On-Site)
• 3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

Tesla - Test Development Engineer

Tesla

Singapore, Singapore (On-Site)
• 3 Days ago
Interactive Brokers - Fraud Prevention Analyst

Interactive Brokers

Singapore (Hybrid)
• 3 Months ago
NinjaVan - Delivery Attendant

NinjaVan

Singapore, Singapore (On-Site)
• 3 Months ago
PwC - Financial Services Strategy & Operations Consulting - Manager

PwC

Singapore (On-Site)
• 4 Months ago
ByteDance - Site Reliability Engineer - Game

ByteDance

Singapore (On-Site)
• 3 Months ago
ByteDance - Strategy Manager - BytePlus

ByteDance

Singapore (On-Site)
• 3 Months ago
ByteDance - Lark APAC Customer Success Manager Intern - 2025 Start

ByteDance

Singapore (On-Site)
• 3 Months ago
Luxoft - Senior Business Analyst - Capital Markets

Luxoft

Singapore, Singapore (On-Site)
• 1 Month ago
ByteDance - Internal Marketing and Engagement Expert

ByteDance

Singapore (On-Site)
• 2 Months ago
Logitech - B2B Sales Support Intern (SEA) - Young Professionals Program (Based in Singapore)

Logitech

Singapore, Singapore (On-Site)
• 2 Months ago

Get notifed when new similar jobs are uploaded

Monetization Jobs

Paytm - Government Ad Sales (Non Metro) - Pune/Chennai/Kolkata

Paytm

Chennai, Tamil Nadu, India (On-Site)
• 3 Months ago
Zynga - Product Manager, Monetization

Zynga

Carlsbad, California, United States (On-Site)
• 1 Month ago
Playtika - Director Of Monetization, VIP & CS

Playtika

Israel (On-Site)
• 1 Month ago
Supercell - Monetization Manager, Supercell Store

Supercell

Helsinki, Uusimaa, Finland (On-Site)
• 2 Months ago
ByteDance - Software Engineer, UI Framework

ByteDance

San Jose, California, United States (On-Site)
• 3 Months ago
ByteDance - Lead Research Scientist, Foundation Model, Music Intelligence

ByteDance

San Jose, California, United States (On-Site)
• 3 Months ago
ByteDance - Business Development & Commercial Manager - Energy

ByteDance

Singapore (On-Site)
• 1 Day ago
ByteDance - Graduate Development Program (Philippines E-commerce) - 2025 Start

ByteDance

Taguig, Metro Manila, Philippines (On-Site)
• 3 Months ago
ByteDance - Service Contract Insurance Business Solution and Operations - Global Payment

ByteDance

San Jose, California, United States (On-Site)
• 2 Months ago
InMobiInMobi - Senior Product Manager - InMobi Exchange

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
• 1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug