Engineering Manager, AI/ML Infrastructure, Google Compute Engine

1 Month ago • 8-11 Years • Backend Development • $189,000 PA - $284,000 PA

Job Summary

Job Description

As an Engineering Manager for AI/ML Infrastructure at Google Compute Engine (GCE), you'll lead a team of 7-10 engineers, building and scaling AI/ML infrastructure. Responsibilities include managing projects, driving codebase improvements, ensuring predictable project delivery, and mentoring team members. You'll need strong technical expertise in software development (Python, C++, Java, etc.), distributed systems, and experience in a technical leadership role, overseeing projects and teams. The role involves working within Google's GCE Consumption Products - Infrastructure team, focusing on optimally scheduling workloads for consumption tiers and managing capacity pools. The position requires experience building large-scale infrastructure and working in a matrixed organization. Preferred qualifications include a Master's degree or PhD and experience with GCP services like GCE, BigQuery, Spanner, and SQL databases.
Must have:
  • 8+ years software development experience
  • 3+ years technical leadership
  • 3+ years building large-scale infrastructure
  • Team management experience
  • AI/ML infrastructure expertise
Good to have:
  • Master's/PhD in CS
  • Experience with GCP services (GCE, BigQuery)
  • Spanner and SQL database experience
  • Experience in a matrixed organization
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience with software development in one or more programming languages (e.g., Python, C, C++, Java, JavaScript).
  • 3 years of experience in a technical leadership role; overseeing projects, with 2 years of experience in a people management, supervision/team leadership role.
  • 3 years of experience in building and developing large-scale infrastructure or distributed systems.

Preferred qualifications:

  • Master's degree or PhD in Computer Science, or a related technical field.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a matrixed organization.
  • Experience with One Platform ecosystem and REST Application programming interface (APIs).
  • Experience with Google Cloud Platform (GCP) Services like Google Compute Engine (GCE), or BigQuery.
  • Experience in Spanner and SQL databases.

About the job

Like Google's own ambitions, the work of a Software Engineer goes beyond just Search. Software Engineering Managers have not only the technical expertise to take on and provide technical leadership to major projects, but also manage a team of Engineers. You not only optimize your own code but make sure Engineers are able to optimize theirs. As a Software Engineering Manager you manage your project goals, contribute to product strategy and help develop your team. Teams work all across the company, in areas such as information retrieval, artificial intelligence, natural language processing, distributed computing, large-scale system design, networking, security, data compression, user interface design; the list goes on and is growing every day. Operating with scale and speed, our exceptional software engineers are just getting started -- and as a manager, you guide the way.

With technical and leadership expertise, you manage engineers across multiple teams and locations, a large product budget and oversee the deployment of large-scale projects across multiple sites internationally.

Our team within the Google Compute Engine (GCE) Control Plane is called GCE Consumption Products - Infrastructure. The team’s mission is to develop infrastructure services to optimally schedule workloads for all Consumption tiers, providing a high degree of flexibility, efficiently managing multiple capacity pools.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $189,000-$284,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Build AI/ML Infra at scale for Google Compute Engine (GCE). Provide engineering and management leadership on the GCE Consumption Products Infra team and help evolve it.
  • Manage a team of 7-10 engineers. Motivate the Googler Reviews and Development (GRAD) process for the team members.
  • Manage and execute projects on the ground with regular audits to identify and surface risks, motivate escalation, get aligned with dependency and partner teams to deliver projects on predictable schedules.
  • Drive major improvements in a code base which requires careful analysis, planning and roll out of changes. Own an area of the code base, keep architecture clean, and tests green.

Similar Jobs

version 1 - Register your interest for our 2025 Digital Academy Programme

version 1

Belfast, Northern Ireland, United Kingdom (On-Site)
3 Months ago
Microsoft - Software Engineering IC2

Microsoft

Prague, Prague, Czechia (On-Site)
1 Month ago
OpenGov - Software Engineer III

OpenGov

Atlanta, Georgia, United States (On-Site)
4 Months ago
ION - Principal Technical Consultant - Endur

ION

London, England, United Kingdom (On-Site)
4 Months ago
Google - Software Engineer, Early Career, Campus

Google

Bucharest, Bucharest, Romania (On-Site)
1 Month ago
Google - Senior Software Engineer, Storage Technologies, Google Cloud Platform

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Luxoft - Senior Java Developer

Luxoft

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Meltwater - Search Backend Software Engineer Senior

Meltwater

Hyderabad, Telangana, India (Hybrid)
4 Months ago
Activision - Senior Staff Backend Engineer

Activision

San Francisco, California, United States (On-Site)
3 Months ago
DISCO - Software Engineer III, Backend

DISCO

Gurugram, Haryana, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

GoTo Group - Senior Software Engineer - Data Platform (Streaming)

GoTo Group

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Xactly Corp - Senior Software Engineer

Xactly Corp

Bengaluru, Karnataka, India (On-Site)
4 Months ago
PwC - Data Engineer – Senior Associate - P&T Labs

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Warner Bros Discovery - Senior Staff Software Engineer- Backend(Java), Commerce- Hyderabad

Warner Bros Discovery

Hyderabad, Telangana, India (On-Site)
2 Months ago
Saviynt - Sr. Engineer, IGA Operations

Saviynt

El Segundo, California, United States (Hybrid)
3 Months ago
Canva - Engineering Manager (BE) - Integrations at Scale - (Remote across ANZ)

Canva

Melbourne, Victoria, Australia (Remote)
1 Month ago
EPAM Systems - Senior Python Software Engineer

EPAM Systems

Hyderabad, Telangana, India (Remote)
5 Months ago
Google - Web Solutions Engineer, Distribution, gTech Users and Products

Google

Pittsburgh, Pennsylvania, United States (On-Site)
1 Month ago
PwC - Senior Java Developer

PwC

Athens, Greece (Hybrid)
2 Months ago
Next Level Business Services - CCI News Gate Solution Architect

Next Level Business Services

Jersey City, New Jersey, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Kirkland, Washington, United States

Inworld AI - Senior Software Development Engineer in Test (SDET) – Game Engine SDKs - USA

Inworld AI

Mountain View, California, United States (On-Site)
3 Months ago
BrightEdge - Sales Development Representative (BGSU Students)

BrightEdge

Cleveland, Ohio, United States (On-Site)
3 Months ago
Trek - Service Tech/Advisor

Trek

Long Hill, New Jersey, United States (On-Site)
3 Months ago
Axon - Commercial Operations Analyst, Contract Success

Axon

Virginia, United States (On-Site)
2 Months ago
Axon - Senior Tax Analyst (Hybrid)

Axon

Seattle, Washington, United States (Hybrid)
1 Month ago
CharacterAI - Research Engineer, ML Systems (All Industry Levels)

CharacterAI

New York, New York, United States (On-Site)
2 Months ago
Mattel  Inc  - American Girl NY - Seasonal Asset Protection Associate

Mattel Inc

New York, New York, United States (On-Site)
2 Months ago
Anthology  Inc  - Solutions Engineer - Enterprise

Anthology Inc

United States (Remote)
2 Months ago
The Walt Disney Company - Sr Data Analyst

The Walt Disney Company

San Francisco, California, United States (On-Site)
1 Month ago
Life church - Associate Operations Pastor

Life church

United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Backend Development Jobs

Google - Software Engineer III, Site Reliability Engineering, Google Cloud

Google

Seattle, Washington, United States (On-Site)
1 Month ago
GoTo Group - One KYC Backend Engineer

GoTo Group

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Whoop - Staff Software Engineer (Backend, Platform)

Whoop

Boston, Massachusetts, United States (On-Site)
3 Months ago
CloudHire - Senior Java Developer

CloudHire

Pune, Maharashtra, India (Remote)
2 Months ago
Luxoft - Java/Scala Developer

Luxoft

(Remote)
2 Months ago
Microsoft - Software Engineering

Microsoft

Prague, Prague, Czechia (On-Site)
1 Month ago
Captions - Software Engineer, Backend (3+ years of experience)

Captions

San Francisco, California, United States (On-Site)
2 Months ago
Avathon - Software Engineer (Scala_Backend)

Avathon

Bengaluru, Karnataka, India (On-Site)
3 Months ago
GoTo Group - Senior Software Engineer (Backend) - Consumer Lending

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug