Staff Software Engineer, Cloud TPU, Google Cloud

2 Months ago • 8-13 Years • DevOps • Artificial Intelligence • $189,000 PA - $284,000 PA

Job Summary

Job Description

Google is seeking a Staff Software Engineer to join its Cloud TPU team. This role involves designing, developing, testing, deploying, maintaining, and enhancing large-scale ML infrastructure software solutions. Responsibilities include leading the design and implementation of solutions in specialized ML areas, optimizing ML infrastructure, and guiding the development of model optimization and data processing strategies. The engineer will architect, design, and implement features to scale the cloud TPU infrastructure, contributing to the technical roadmap and architecture improvement. They will also develop tools and automation to qualify Cloud TPU solutions for faster deployment and improved user experience. The ideal candidate will have extensive experience in software development, ML infrastructure, and leading teams, along with experience with embedded systems or lower-level software stacks.
Must have:
  • 8+ years software development experience
  • 5+ years ML design & infrastructure optimization
  • Experience with embedded systems or ML infrastructure
  • Lead design & implementation of ML solutions
  • Develop & maintain large-scale ML infrastructure
Good to have:
  • Master's or PhD in related field
  • Technical leadership experience
  • Experience in a complex, matrixed organization

Job Details


Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development, and with data structures/algorithms.
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
  • 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 5 years of experience with one or more of the following: embedded system or lower level Software stacks (e.g., networking, storage, etc.), ML infrastructure, Compilers (e.g. XLA), or specialization in another ML field.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Google’s Cloud TPUs are designed to accelerate machine learning workloads, enabling the efficient training and deployment of advanced models. They support popular frameworks like TensorFlow, PyTorch, and JAX.

The team empowers businesses and researchers to take on real-world challenges using cutting-edge ML techniques. As part of Google’s Core ML organization, Cloud TPUs play a key role in building a unified, cross-Google ML infrastructure to support both internal and external use cases. The team’s vision focuses on establishing this comprehensive ML ecosystem.

The team develops the infrastructure and tools required to bring TPU future New Product Introduction (NPIs) to GCP customers from design, implementations and deployments. Their work spans hardware qualification, security verification, integration testing, profiling, tracing, and resiliency—ensuring seamless, high-quality TPU deployment for users.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $189,000-$284,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Design, develop, test, deploy, maintain, and enhance large-scale ML infrastructure software solutions.
  • Lead the design and implementation of solutions in specialized ML areas, optimize ML infrastructure, and guide the development of model optimization and data processing strategies.
  • Architect, design, implement features, and scale the cloud TPU infrastructure to separate multiple generations of TPU hardware and products. 
  • Contribute to the key component of cloud TPU technical roadmap and architecture improvement.
  • Develop the tools and automation to Qualify the Cloud TPU solution (security, performance, functions, etc.) faster for Cloud users to get the best experience of the accelerators for their workloads.

Similar Jobs

Unity - Principal Data Engineer

Unity

San Francisco, California, United States (On-Site)
7 Months ago
Honeywell - Lead Data Scientist-Vision AI

Honeywell

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Unity - Principal Applied Research Machine Learning Engineer

Unity

Copenhagen, Denmark (On-Site)
4 Months ago
SiftHub - Senior Software Engineer (Backend)

SiftHub

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Tencent - Tencent Cloud IaaS Product Solution Architect - Indonesia

Tencent

Jakarta, Jakarta, Indonesia (On-Site)
8 Months ago
Barracuda Networks  Inc  - Sr. Salesforce Developer

Barracuda Networks Inc

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Luxoft - DevOps Engineer

Luxoft

New Delhi, Delhi, India (Remote)
2 Months ago
Impronics Technologies - AWS Cloud Engineer

Impronics Technologies

Gurugram, Haryana, India (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Algorithm Intern (Video Codec - Realtime Codec Optimizations - Multimedia Streaming) - 2025 Summer (PhD)

ByteDance

San Diego, California, United States (On-Site)
2 Months ago
Google - Senior Software Engineer, Machine Learning, Technology & Society

Google

Mountain View, California, United States (On-Site)
2 Months ago
ByteDance - Software Development Engineer - Machine Learning System

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Microsoft - Principal Software Engineer - AI Platform

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Microsoft - Senior Applied Scientist- Microsoft Teams Labs

Microsoft

(Hybrid)
1 Month ago
ByteDance - Research Engineer - Multimodal Model

ByteDance

Singapore (On-Site)
3 Months ago
AppLovin - Machine Learning Engineer

AppLovin

Beijing, Beijing, China (On-Site)
5 Months ago
Amazon Games - Senior Software Engineer, Amazon Games AI Research

Amazon Games

San Diego, California, United States (On-Site)
2 Months ago
Granicus - Data Scientist 4

Granicus

Bengaluru, Karnataka, India (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Kirkland, Washington, United States

Fliff  Inc  - Junior Game Operations Associate

Fliff Inc

Philadelphia, Pennsylvania, United States (On-Site)
7 Months ago
Warner Bros Discovery - Staff Software Engineer, Data Platforms

Warner Bros Discovery

Atlanta, Georgia, United States (On-Site)
3 Months ago
Meta - Product Manager

Meta

Bellevue, Washington, United States (Remote)
3 Months ago
Sleeper - Performance Creative Associate (TikTok)

Sleeper

San Francisco, California, United States (On-Site)
4 Months ago
Next Level Business Services - UX Developer

Next Level Business Services

Jersey City, New Jersey, United States (On-Site)
4 Months ago
Tencent - Producer

Tencent

Los Angeles, California, United States (On-Site)
9 Months ago
ByteDance - Software Researcher/Engineer - Applied Research Center (Infrastructure+AI)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Crunchyroll - Staff Data Engineer

Crunchyroll

Culver City, California, United States (On-Site)
3 Months ago
ByteDance - Software Engineer Graduate (Applied Machine Learning - Enterprise) - 2025 Start (BS/MS)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
OpenGov - Sr. Manager, Business Systems

OpenGov

San Francisco, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Rockstar Games - Systems Engineer, Automation

Rockstar Games

North Carolina, United States (On-Site)
2 Months ago
PepsiCo - Associate Manager - SRE

PepsiCo

Hyderabad, Telangana, India (On-Site)
3 Months ago
Xactly Corp - Senior Cloud Infrastructure Engineer

Xactly Corp

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Google - Customer Engineer, Infrastructure Modernization Specialist, Google Cloud

Google

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Axinous - Staff Site Reliability Engineer - Federal, Security Clearance Required

Axinous

San Jose, California, United States (Remote)
3 Months ago
Ajmera Infotech - SENIOR ASP.NET DEVELOPER

Ajmera Infotech

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Luxoft - Java Microservices Technical Lead

Luxoft

(On-Site)
3 Months ago
Rackspace Technology - Software Developer III (Python with Linux Automation)

Rackspace Technology

India (Remote)
2 Months ago
Extreme Network - Staff Cloud Operations Engineer-Cloud Operations team

Extreme Network

Hangzhou, Zhejiang, China (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug