Senior Staff Engineer, TPU Machine Learning Supercomputers

2 Months ago • 8-18 Years • Research & Development • $237,000 PA - $337,000 PA

Job Summary

Job Description

As a Senior Staff Engineer in Google's TPU Accelerator Software team, you'll lead the development of the TPU inter-chip interconnect (ICI) software. This involves designing and maintaining software across different layers, accelerating ML training and inference. Responsibilities include driving the ICI roadmap, collaborating with chip developers, providing technical leadership, identifying cross-functional dependencies, and ensuring development velocity and quality. You will work on features like ICI topology, TPU slice builder, resilient routing, and control plane, focusing on scaling ML workloads. Experience with C++, ML algorithms, network architecture, and HPC is crucial.
Must have:
  • 8+ years software development experience
  • 5+ years ML algorithms and hardware mapping experience
  • 5+ years network architecture and routing experience
  • 5+ years design, architecture, testing, and launching software products
  • Proficient in C++
  • Technical leadership and project management skills
Good to have:
  • Master's or PhD in a related field
  • High-Performance Computing (HPC) experience
  • Experience in a complex, matrixed organization
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development, and with data structures/algorithms.
  • 5 years of experience with design and architecture; and testing/launching software products.
  • 5 years of experience working with common ML algorithms and how they map to software and hardware operations.
  • 5 years of experience building Network Architecture along with routing algorithms and topologies.
  • 5 years of experience with software development in C++.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 5 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 5 years of experience with High Performance Computing (HPC).
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Google TPUs are custom-designed AI accelerators, which are optimized for training and inference of large AI models.

As a Software Engineer in the TPU Accelerator Software team, you will lead the TPU inter-chip interconnect (ICI) software capabilities. The ICI is a custom interconnect for communicating across multiple TPUs and is essential to scaling Machine Learning (ML) workloads.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $237,000-$337,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Drive the development of ICI topology, TPU slice builder, resilient routing, and control plane for ICI over Ethernet. Own the ICI roadmap from the Software standpoint. Collaborate with TPU chip developers on features and roadmap for future products.
  • Design and maintain software across different layers of the software stack and support various capabilities to accelerate ML training and inference performance and reliability.
  • Provide technical leadership to help formulate and drive software development plans. Identify commonalities between different supercomputer generations and accelerator types and to create well abstracted and flexible software.
  • Help identify dependencies in cross-functional teams and drive common execution with a peculiar focus on development velocity and quality.

Similar Jobs

Playrix - Senior QA Engineer (VSO Engine)

Playrix

Georgia (Remote)
4 Months ago
Offworld - Senior Game Programmer

Offworld

New Westminster, British Columbia, Canada (On-Site)
7 Months ago
Virtuos - Lead Developer

Virtuos

France (Hybrid)
4 Months ago
Amazon - Senior Anti-Cheat Engineer, Amazon Games

Amazon

San Diego, California, United States (On-Site)
5 Months ago
Seedify - Technical Artist

Seedify

(Remote)
1 Month ago
Google - Multimedia Machine Learning Silicon Architect, Devices and Services

Google

Mountain View, California, United States (On-Site)
2 Months ago
DigitalFish - Senior Systems Engineer, Cameras/Imaging

DigitalFish

Sunnyvale, California, United States (On-Site)
2 Months ago
Krafton  - [KRAFTON Communications] Corporate PR S Team Leader (15년 이상)

Krafton

Seoul, South Korea (On-Site)
2 Months ago
Rivos - Silicon bringup and validation engineer

Rivos

Hsinchu, Hsinchu City, Taiwan (On-Site)
4 Months ago
Every matrix - Group Architect

Every matrix

Bucharest, Bucharest, Romania (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Microsoft - Senior Software Engineer

Microsoft

(On-Site)
1 Month ago
Amber - Level Designer 3D (Project Based)

Amber

Bucharest, Bucharest, Romania (Remote)
3 Months ago
Microsoft - Software Engineer II - AI Agents & Monetization

Microsoft

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
Company3 Method Studios - Technical Architect D365 Finance &Operations

Company3 Method Studios

Pune, Maharashtra, India (Remote)
5 Months ago
Playrix - Middle C++ Software Engineer (Gameplay)

Playrix

Montenegro (Remote)
4 Months ago
Luxoft - Senior Test Automation Engineer

Luxoft

Zürich, Zurich, Switzerland (On-Site)
2 Months ago
Omnissa - Senior Member of Technical Staff (Android)

Omnissa

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Warner Bros Discovery - Senior Software Developer

Warner Bros Discovery

Ottawa, Ontario, Canada (On-Site)
2 Months ago
Microsoft - Software Engineer – Cloud Data Warehouse- Barcelona (Spain)

Microsoft

Barcelona, Catalonia, Spain (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Worldwide

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Research & Development Jobs

Samsung Semiconductor - Senior Manager, ASIC Design Enablement

Samsung Semiconductor

San Jose, California, United States (On-Site)
4 Months ago
Luxoft - BSP Developer

Luxoft

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Cytiva - Senior Research Executive

Cytiva

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Luxoft - Senior GPU Compiler Software Development Engineer

Luxoft

Brazil, Indiana, United States (Remote)
3 Months ago
GoDaddy - Senior Software Engineer

GoDaddy

Pune, Maharashtra, India (On-Site)
5 Months ago
NXP - Senior Principal Software Architect - Platform and RF Software

NXP

Bucharest, Bucharest, Romania (On-Site)
5 Months ago
Krafton  - Global Strategy Manager 집중채용

Krafton

Seoul, South Korea (On-Site)
2 Months ago
Microsoft - Hardware Engineer 2

Microsoft

Mountain View, California, United States (On-Site)
1 Month ago
Fluence - Lead Engineer - Advanced Battery Modules

Fluence

Houston, Texas, United States (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug