LLM Training Operation (Language and Creative) - Analyst

1 Month ago • 3 Years + • Operations • $67,724 PA - $143,555 PA

Job Summary

Job Description

The LLM Training Operations Analyst at ByteDance's LLM Global Data Team manages workflows for training Large Language Models (LLMs). Responsibilities include designing and optimizing workflows, managing projects to meet timelines and quality standards, conducting quality improvement experiments, and mentoring team members. The role requires strong project management skills, exceptional writing and analytical skills, and collaboration with cross-functional teams. Experience in RLHF annotation and working with leading AI/LLM companies is preferred. The analyst will work with diverse datasets and ensure high-quality data production.
Must have:
  • 3+ years project/operations management experience
  • Advanced English proficiency
  • Strong project management skills
  • Workflow design and optimization
  • Project leadership and management
  • Operational improvement initiatives
  • Team mentorship and collaboration
Good to have:
  • RLHF annotation experience
  • Leading AI/LLM company experience
  • Mentoring entry-level team members
  • Deep interest in LLMs and UX
  • Global team collaboration experience
Perks:
  • Medical, dental, and vision insurance
  • 401(k) savings plan with company match
  • Paid parental leave
  • Paid time off (holidays, sick days, personal time)
  • Short-term and long-term disability coverage
  • Life insurance
  • Wellbeing benefits

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About The Team As a key member of our LLM Global Data Team, the LLM Training Operations Analyst will play a pivotal role in managing the intricate processes involved in training Large Language Models (LLMs) with diverse datasets. This role focuses on overseeing and improving operational workflows, ensuring that projects are delivered with high quality and efficiency. Your Role Will Involve - Workflow Design and Management: Design, manage, and optimize workflows for LLM training projects, including training design, QA processes, and performance tracking. Collaborate closely with product managers, engineers, and cross-functional teams to ensure alignment on quality metrics and project expectations. - Project Management: Lead and manage multiple projects, ensuring timelines, quality standards, and objectives are met. Track project progress, identify risks, and implement corrective actions as necessary to keep projects on course. Coordinate meetings and discussions with global teams to ensure seamless project execution and work with external vendors and trainers per project demands. - Operational Improvement: Conduct quality and productivity improvement experiments to enhance operational processes. Lead and support general annotation operation improvement initiatives across various data domains. Develop and maintain guidelines and casebooks to support consistent, high-quality data production. - Team Leadership and Collaboration: Provide mentorship and guidance to team members, helping to develop their skills and ensuring the delivery of high-quality outputs. Foster a collaborative environment where team members can share knowledge and best practices to improve overall performance.
Qualifications
Minimum Qualifications - 3+ years of experience in project or operations management roles. - Advanced proficiency in English with exceptional writing and analytical skills. - Strong project management skills, with the ability to design, manage, and optimize complex workflows. - Ability to balance independent judgment with collaborative teamwork in a fast-paced, project-based environment. Preferred Qualifications - Experience in RLHF annotation and working with leading AI/LLM companies. - Proven ability to lead and mentor entry-level team members in data-related or AI/LLM projects. - Deep interest in LLMs, human behavior, and user experience. - Enthusiasm for learning, engaging with diverse case studies, and working with global teams. - Comfort with technology and tools that enhance project and team performance. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. ByteDance Inc. is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://shorturl.at/cdpT2.
Job Information
【For Pay Transparency】Compensation Description (Annually)

The base salary range for this position in the selected city is $67724 - $143555 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Similar Jobs

Google - Technical Program Manager, Global Networking Technology

Google

Sydney, New South Wales, Australia (On-Site)
1 Month ago
Paypal - Machine Learning Engineer

Paypal

San Jose, California, United States (Hybrid)
4 Months ago
PhonePe - Senior Solutions Consultant

PhonePe

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Entrata - Product Designer

Entrata

Pune, Maharashtra, India (Hybrid)
3 Months ago
Google - Technical Program Manager, Google Distributed Cloud, Edge

Google

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ByteDance - Individual Income Tax Lead - HR Operations - Singapore

ByteDance

Singapore (On-Site)
1 Month ago
Whatnot - Customer Experience Team Lead - International

Whatnot

Dublin, County Dublin, Ireland (Remote)
3 Months ago
Unity - Transfer Pricing Senior

Unity

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Inspired Entertainment - Resort Amusements Manager

Inspired Entertainment

Newquay, England, United Kingdom (On-Site)
2 Weeks ago
Overwolf - Technical Support & IT Manager

Overwolf

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Milestone - Regional Marketing Specialist - Automation

Milestone

United States (On-Site)
3 Weeks ago
Admin Looks - Release Manager

Admin Looks

Hyderabad, Telangana, India (Remote)
3 Months ago
Second Dinner - Principal Technical Producer, Platform Services

Second Dinner

United States (Remote)
3 Weeks ago
IGT - Senior Internal Auditor, IT

IGT

Providence, Rhode Island, United States (On-Site)
2 Months ago
Sinch - Senior Software Engineer - Conversational AI

Sinch

Brussels, Brussels, Belgium (Hybrid)
3 Months ago
TING - Junior Art Director (UI/UX)

TING

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Netflix - Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

Netflix

Los Gatos, California, United States (Remote)
1 Month ago
ScaleX - Motion Graphic Designer

ScaleX

India (Remote)
3 Months ago
ION - Product Analyst/Associate, Italy

ION

Italy (Hybrid)
3 Months ago
Regent Craft - Manufacturing Engineering Intern

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Los Angeles, California, United States

Microsoft - Senior Researcher - Deep Learning & AI

Microsoft

New York, New York, United States (On-Site)
3 Weeks ago
Mattel  Inc  - American Girl Los Angeles Merchandise Handler Part Time

Mattel Inc

California, United States (On-Site)
1 Month ago
Inworld AI - Forward Deployed Engineer - Korea

Inworld AI

Mountain View, California, United States (Remote)
4 Months ago
Unity - Trademark Paralegal

Unity

United States (Remote)
2 Months ago
Trailer Park Group - Freelance Project Manager

Trailer Park Group

Los Angeles, California, United States (Hybrid)
3 Weeks ago
Varonis  - Alliance Marketing Manager

Varonis

United States (Remote)
1 Week ago
Magic Leap - Director, Calibration Software

Magic Leap

Sunnyvale, California, United States (Hybrid)
6 Months ago
Crunchyroll - Staff Mobile Games Integration Engineer

Crunchyroll

San Francisco, California, United States (On-Site)
1 Week ago
Bit Reactor, LLC - SENIOR CHARACTER ARTIST

Bit Reactor, LLC

Cockeysville, Maryland, United States (On-Site)
5 Months ago
Luxoft - Senior ML Engineer

Luxoft

Poland, Ohio, United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Operations Jobs

Keywords Studios (Player Support) - Globalize Portfolio Director - Europe

Keywords Studios (Player Support)

Ireland (Remote)
3 Weeks ago
Tesla - Compliance Operations Manager, Money Laundering Reporting Officer UK

Tesla

London, England, United Kingdom (On-Site)
6 Days ago
Rank group - Food & Beverage Host

Rank group

Glasgow, Scotland, United Kingdom (On-Site)
2 Months ago
PhonePe - Business Operations Analyst, Payments

PhonePe

Bengaluru, Karnataka, India (On-Site)
3 Months ago
OKX - Specialist, Customer Due Diligence Operations (KYB)

OKX

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
3 Months ago
Microsoft - Mechanical Engineer - Data Center Operations

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Month ago
PhonePe - Lead - People Lifecycle Management

PhonePe

Bengaluru, Karnataka, India (On-Site)
2 Months ago
The Walt Disney Company - Senior Manager, Workforce Management

The Walt Disney Company

San Antonio, Texas, United States (On-Site)
9 Hours ago
Streamline Media Group  Inc  - Executive Assistant

Streamline Media Group Inc

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

Seattle, Washington, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug