Staff Software Engineer, ML Hardware, YouTube Discovery

1 Month ago • 8-12 Years • Artificial Intelligence • $189,000 PA - $284,000 PA

Job Summary

Job Description

This Staff Software Engineer role at YouTube focuses on optimizing YouTube's recommender systems for Google's TPUs (Tensor Processing Units). You'll develop and execute strategies to leverage new ML hardware, including adapting models for quantized training and inference. Responsibilities include leading engineering efforts to improve model efficiency, evaluating new hardware, and collaborating with model developers and hardware experts. The role requires deep experience in ML infrastructure, model deployment, and large-scale model development, especially with recommender systems and LLMs. You will also play a key role in shaping YouTube's ML hardware adoption strategy.
Must have:
  • 8+ years software development experience
  • 5+ years ML infrastructure experience
  • 3+ years developing large-scale ML models
  • 2+ years technical leadership
  • Experience with post-training quantization
Good to have:
  • Experience with AI infrastructure, compilers, or performance engineering
  • Experience optimizing ML models for ML hardware accelerators
  • Excellent communication skills
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development, and with data structures/algorithms.
  • 5 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, debugging).
  • 3 years of experience in developing large-scale ML models (recommender systems, LLMs, computer vision, etc) utilizing ML hardware accelerators.
  • 2 years of experience in a technical leadership role.
  • Experience with post-training quantization, quantized aware training, or quantized training for ML models.

Preferred qualifications:

  • Experience with building efficient and reusable AI infrastructure, compilers, or performance engineering.
  • Experience with optimizing ML models to efficiently run on ML hardware accelerators.
  • Excellent communication skills, with the ability to convey complex technical concepts clearly and concisely.

About the job

YouTube's growth is generated by Machine Learning (ML) powered personalized recommendations. Over time, these models are growing larger and it's imperative they be efficiently trained and served using Google's ML hardware Tensor Processing Unit (TPU) Simultaneously, Gemini and Large Language Model offer exciting new model architectures and are developing new advancements in ML hardware development.

In this role, you will be responsible for ensuring YouTube's business-critical recommender models best utilize the available ML hardware. To do this, you will be responsible for managing YouTube's participation in hardware development and evaluation programs. Additionally, you will initiate and drive efforts to adapt YouTube's models to take advantage of new accelerator capabilities, for example by adopting quantized training and inference.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

The US base salary range for this full-time position is $189,000-$284,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Develop YouTube Discovery's ML hardware adoption strategy.
  • Initiate and lead engineering efforts to adapt YouTube's recommender models to perform efficiently on future generations of ML hardware.
  • Lead YouTube's evaluation of new ML hardware, in collaboration with model developers and Google-wide ML hardware and software experts.

Similar Jobs

Trend Micro - (Sr.) Data Engineer/AI Trainer

Trend Micro

Taipei City, Taiwan (On-Site)
4 Months ago
PwC - IN-Senior Associate_ Python Developers _Advisory Corporate_ Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ByteDance - Senior Site Reliability Engineer, AI Applications

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Meta - Software Engineer, Computer Vision (Technical Leadership)

Meta

Redmond, Washington, United States (Remote)
2 Months ago
Autodesk - Intern, Software Engineer - Geometric Reasoning

Autodesk

London, England, United Kingdom (On-Site)
3 Months ago
Brillio - AI GTM Leader - R01541139

Brillio

San Francisco, California, United States (Hybrid)
3 Months ago
Canva - Senior Machine Learning Engineer - Photo AI

Canva

Prague, Czechia (Remote)
1 Week ago
CloudHire - Machine Learning - Engineer

CloudHire

India (Remote)
3 Months ago
Magnopus - Technical Artist - Generative AI

Magnopus

Los Angeles, California, United States (On-Site)
3 Months ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model AI Platform) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Glance - Machine Learning Engineer III

Glance

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Salesforce - Backend Software Engineer - Lead/Principal

Salesforce

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
3 Months ago
Gala - Nodes Business Leader

Gala

Kentfield, California, United States (On-Site)
2 Months ago
Numerator - Python Team Lead

Numerator

Vadodara, Gujarat, India (Remote)
3 Months ago
ByteDance - Video Codec Algorithm Intern (Multimedia Streaming)

ByteDance

San Diego, California, United States (On-Site)
3 Weeks ago
ByteDance - Research Scientist- Foundation Model, Video Generation

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Snowed In Studios - Senior Generalist Programmer - Montreal

Snowed In Studios

Montreal, Quebec, Canada (Hybrid)
3 Months ago
Netradyne - Staff Data Scientist

Netradyne

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

New York, New York, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Bruno, California, United States

Flow - Senior Product Designer

Flow

Miami, Florida, United States (On-Site)
3 Months ago
Lionsgate Games - Manager, Programming & Operations, International SVOD Channels

Lionsgate Games

Santa Monica, California, United States (On-Site)
1 Month ago
CloudHire - Pathology Assistant Reallocation Opportunity, New York

CloudHire

Hamden, Connecticut, United States (On-Site)
3 Months ago
Epic Games - Senior Pipeline Developer

Epic Games

Cary, North Carolina, United States (On-Site)
1 Week ago
Company3 Method Studios - Line Cook

Company3 Method Studios

Los Angeles, California, United States (On-Site)
2 Weeks ago
New Globe - Director, Academics, Partnership Launch (Bilingual - French & English)

New Globe

Cambridge, Massachusetts, United States (On-Site)
3 Months ago
Passive Logic - Computational Physics Software Engineer

Passive Logic

Salt Lake City, Utah, United States (On-Site)
3 Months ago
Dmg - District Manager - Long Island

Dmg

United States (On-Site)
1 Month ago
On Location - Athletics Travel Manager

On Location

Tennessee, United States (On-Site)
2 Weeks ago
Forescout Technologies  Inc  - Federal / FedRAMP Product Manager

Forescout Technologies Inc

United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

One97 Communications  - Data Science - Lead Data Scientist

One97 Communications

Noida, Uttar Pradesh, India (On-Site)
4 Months ago
Smarsh - Machine Learning Engineer

Smarsh

India (Hybrid)
3 Months ago
OKX - Product Manager, AI

OKX

Singapore, Singapore (On-Site)
3 Months ago
Digital Green - AI Researcher

Digital Green

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Glean - Software Engineer, Machine Learning (Infrastructure)

Glean

Palo Alto, California, United States (On-Site)
2 Months ago
Microsoft - Applied Scientist: Opportunities - PhD - Microsoft AI Development Acceleration Program, Cambridge

Microsoft

Cambridge, Massachusetts, United States (On-Site)
1 Month ago
Google DeepMind - Research Scientist, Language

Google DeepMind

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Zoox - Manager, Simulation Traffic & Behavior Modeling

Zoox

Foster City, California, United States (Hybrid)
3 Months ago
Discord - Director of Machine Learning, Safety

Discord

San Francisco, California, United States (Remote)
4 Weeks ago
Microsoft - Principal Product Manager, Copilot

Microsoft

(Hybrid)
4 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Hyderabad, Telangana, India (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

New York, New York, United States (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Mountain View, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug