Staff Software Engineer, Scaling On-Device ML Frameworks

1 Month ago • 8-13 Years • Artificial Intelligence

About the job

Job Description

Google Cloud is seeking a Staff Software Engineer to join our team and help scale on-device ML frameworks. This role will focus on driving the next-generation of ML functionality and improving overall usability. Responsibilities include ramping up our frameworks with E2E integrations, developing sample apps demonstrating best practices, onboarding SOTA models, scaling partnerships with Android Apps and Google Cloud customers, defining and implementing automated processes and infrastructure, and advocating for product excellence.
Must have:
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in mobile application development or Android framework development
  • 5 years of coding experience in C, C++, Java, or Python
  • Experience with frameworks like JAX and PyTorch
Good to have:
  • Full-stack Android, iOS, and Web development experience
  • OSS development experience
  • Experience in on-device machine learning deployment
  • Experience with Machine Learning infrastructure, Mobile App Development, and Integration Testing
  • Experience with iOS Development, Android Development, C++, and Python
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in mobile application development or Android framework development.
  • 5 years of coding experience in one or more of the following languages: C, C++, Java, or Python.

Preferred qualifications:

  • Experience with frameworks such as JAX, and PyTorch
  • Full-stack Android, iOS, and Web development experience
  • OSS development experience
  • Experience in on-device machine learning deployment in any domain - vision, speech, text etc.
  • Experience with Machine Learning infrastructure, Mobile App Development, and Integration Testing
  • Experience with iOS Development, Android Development, C++, and Python

About the job

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

On-Device Machine Learning (ML), especially with the rise of Generative AI, is central to Google's product portfolio. Unique experiences on Pixel and Android are powered by on-device Machine Learning (e.g., Speech Recognition, Camera, and Assistant/Translation). As we embark on a future with Generative AI experiences personalized on your device, our team is building the core capabilities powering it. Google offers low-level ODML frameworks like TensorFlow Lite and MediaPipe to run machine learning on Android, iOS, Web, and other mobile/embedded devices. To continue growth and drive the next-generation of ML functionality, we're investing heavily in improving overall usability

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

Responsibilities

  • Ramp to our frameworks in the form of E2E integrations between popular Hugging Face/JAX/PyTorch libraries and AI Edge Torch, MP LLM Inference API, etc.
  • Sample apps demonstrating best practices including hardware accelerations, quantization, debugging and optimizing performance and quality.
  • Onboard SOTA models to provide excellent self-serve out-of-the-box experience for users.
  • Scale partnerships with Android Apps and Google Cloud Customers and drive improvements in the overall stack based on real customer needs.
  • Define and implement automated processes and infrastructure to test APIs and user-journeys across diverse platforms and advocate for product excellence.
View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Similar Jobs

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Senior Site Reliability Engineer, AI Applications

ByteDance, United States (On-Site)

PublicisGroupe - Senior Associate L1 DE-Big Data Azure

PublicisGroupe, India (On-Site)

DAZN - Software Architect - BackEnd

DAZN, India (On-Site)

eBay - Staff Security Software Engineer

eBay, United States (Hybrid)

Google - Software Engineer II, Google Cloud

Google, India (On-Site)

Trendyol - Developer in Test

Trendyol, Türkiye (Hybrid)

Interactive Brokers - Sanctions System Analyst

Interactive Brokers, United States (Hybrid)

Next Level Business Services - Java Tech Lead -

Next Level Business Services, United States (On-Site)

GoTo Group - Software Engineer (Backend) - Transport

GoTo Group, Indonesia (On-Site)

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Barbaricum - Senior Systems Engineer

Barbaricum, United States (On-Site)

PwC - AI/ML Azure Engineer (m/f/d)

PwC, Luxembourg (On-Site)

Bazaar Voice - Senior Machine Learning Engineer

Bazaar Voice, India (Hybrid)

Scanline VFX - Research Intern (Summer 2025)

Scanline VFX, United States (Hybrid)

Google - Customer Engineer, AI/ML, Google Cloud

Google, United States (On-Site)

Netomi - Data Scientist - II

Netomi, India (Hybrid)

Get notifed when new similar jobs are uploaded