Staff Software Engineer, Cloud TPU, Google Cloud

2 Months ago • 8-13 Years • DevOps • Artificial Intelligence • $189,000 PA - $284,000 PA

Job Summary

Job Description

This Staff Software Engineer role at Google Cloud focuses on developing and maintaining large-scale ML infrastructure software solutions for Cloud TPUs. Responsibilities include designing, implementing, testing, deploying, and enhancing these solutions, leading the design of solutions in specialized ML areas, optimizing ML infrastructure, and guiding model optimization and data processing strategies. The role requires architecting and scaling the cloud TPU infrastructure, contributing to the TPU technical roadmap, developing automation tools for qualification, and ensuring high-quality TPU deployment for users. The ideal candidate will have extensive experience in software development, ML infrastructure, and ideally experience with embedded systems or compilers.
Must have:
  • 8+ years software development experience
  • 5+ years ML infrastructure optimization
  • 5+ years testing and launching software
  • Experience with data structures/algorithms
  • Software design and architecture experience
Good to have:
  • Master's or PhD in related field
  • Technical leadership experience
  • Experience in complex, matrixed organizations
  • Experience with embedded systems or compilers
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details


Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development, and with data structures/algorithms.
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
  • 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 5 years of experience with one or more of the following: embedded system or lower level Software stacks (e.g., networking, storage, etc.), ML infrastructure, Compilers (e.g. XLA), or specialization in another ML field.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Google’s Cloud TPUs are designed to accelerate machine learning workloads, enabling the efficient training and deployment of advanced models. They support popular frameworks like TensorFlow, PyTorch, and JAX.

The team empowers businesses and researchers to take on real-world challenges using cutting-edge ML techniques. As part of Google’s Core ML organization, Cloud TPUs play a key role in building a unified, cross-Google ML infrastructure to support both internal and external use cases. The team’s vision focuses on establishing this comprehensive ML ecosystem.

The team develops the infrastructure and tools required to bring TPU future New Product Introduction (NPIs) to GCP customers from design, implementations and deployments. Their work spans hardware qualification, security verification, integration testing, profiling, tracing, and resiliency—ensuring seamless, high-quality TPU deployment for users.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $189,000-$284,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Design, develop, test, deploy, maintain, and enhance large-scale ML infrastructure software solutions.
  • Lead the design and implementation of solutions in specialized ML areas, optimize ML infrastructure, and guide the development of model optimization and data processing strategies.
  • Architect, design, implement features, and scale the cloud TPU infrastructure to separate multiple generations of TPU hardware and products. 
  • Contribute to the key component of cloud TPU technical roadmap and architecture improvement.
  • Develop the tools and automation to Qualify the Cloud TPU solution (security, performance, functions, etc.) faster for Cloud users to get the best experience of the accelerators for their workloads.

Similar Jobs

Intel Corporation - AI Frameworks Engineer

Intel Corporation

San José, San José Province, Costa Rica (On-Site)
3 Months ago
ThreeV Technologies,  Inc  - Data Scientist Computer Vision

ThreeV Technologies, Inc

Bengaluru, Karnataka, India (Remote)
4 Months ago
GoMotive - Senior Computer Vision Engineer

GoMotive

India (Remote)
4 Months ago
Talentica Software - Data Scientist

Talentica Software

India (Remote)
4 Months ago
Paypal - Sr Engineering Manager, AI/ML Solutions

Paypal

San Jose, California, United States (On-Site)
4 Months ago
Rackspace Technology - Job Opportunity :  Lead Database Engineer : Night Shift

Rackspace Technology

Gurugram, Haryana, India (Hybrid)
2 Months ago
Playtech - ProdOps Engineer

Playtech

(On-Site)
2 Months ago
Luxoft - Senior DevOps Engineer

Luxoft

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
3 Months ago
Google - Cloud Technical Solutions Engineer, Networking

Google

(On-Site)
3 Months ago
Netomi - Devops Engineer - II

Netomi

Gurugram, Haryana, India (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Meta - Research Scientist, Machine Learning (PhD)

Meta

Bellevue, Washington, United States (On-Site)
3 Months ago
Attentive - Staff Machine Learning Engineer

Attentive

San Francisco, California, United States (Hybrid)
4 Months ago
ByteDance - Software Engineer Intern (Applied Machine Learning-Enterprise) - 2025 Summer/Fall (PhD)

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
Captions - Research Engineer, Machine Learning

Captions

New York, New York, United States (On-Site)
2 Months ago
Logitech - AI Designer

Logitech

Lausanne, Vaud, Switzerland (On-Site)
4 Months ago
ByteDance - Research Scientist in Large Model System

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Rackspace Technology - GCP Cloud ML/Ops Engineer

Rackspace Technology

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Ubisoft - Research Student - Ubisoft La Forge

Ubisoft

Shanghai, Shanghai, China (On_site)
3 Months ago
Google - Engineering Manager, Core Machine Learning, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
2 Months ago
Trendyol - Data Science Professionals  (LLM & Core NLP)

Trendyol

İstanbul, İstanbul, Türkiye (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Worldwide

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

DevOps Jobs

Netflix - Solutions Support Engineer (L5) - Observability

Netflix

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Months ago
bosh group india - Data Engineer

bosh group india

Bengaluru, Karnataka, India (On_site)
2 Months ago
Toast - Staff Software Engineer

Toast

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Banyan Software - Infrastructure Engineer - Viostream

Banyan Software

Chennai, Tamil Nadu, India (On-Site)
4 Months ago
Interactive Brokers - Senior Platform Engineer - Design

Interactive Brokers

Fort Lauderdale, Florida, United States (Hybrid)
4 Months ago
WebPT - Senior DevOps Engineer

WebPT

Hyderabad, Telangana, India (Hybrid)
4 Months ago
Brillio - DB Migration Engineer - R01531207

Brillio

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
ION - Cloud Engineer

ION

Budapest, Hungary (On-Site)
3 Months ago
Vi - Data Infrastructure Engineer

Vi

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug