Principal Software Engineer (Microsoft AI Big Data Platform)

2 Days ago • 6 Years + • Backend Development • Full Stack Development • $137,600 PA - $294,000 PA

About the job

Job Description

The Principal Software Engineer at Microsoft's Bing MagneTar team will design and develop large-scale distributed software services using open-source technologies (Hadoop, Spark, Kafka, Flink, Kubernetes) and proprietary Microsoft services. Responsibilities include system design, development, testing, and release of components for a big data platform serving Microsoft's AI organization. The role demands expertise in large-scale distributed systems, Big Data technologies, and experience leading engineering teams. The engineer will collaborate with stakeholders, improve test coverage, and ensure service reliability and scalability, pushing the boundaries of what's possible in big data analytics.
Must have:
  • 6+ years experience
  • Large-scale distributed systems
  • Big Data technologies (Spark, Hadoop, Kubernetes)
  • Senior/Principal technical lead role
  • C, C++, C#, Java, JavaScript, or Python
Good to have:
  • Large-scale system architecture
  • Microservices, database design, API design
  • Performance tuning, telemetry design
  • Proficient analytical skills
Perks:
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Overview

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world. Bing Fundamentals team focuses on providing a search and recommendation platform for Microsoft internal partners using the documentation recall and reranking backend service suite. As a team, we manage one of the world’s largest distributed systems and have experienced success in building efficient large scale distributed systems.


Within Bing Fundamentals, Bing MagneTar team provides a range of products that enable software engineers and data scientists to lead the transformation of analytics in the world of data. Our mission is to build a big data platform for the age of AI, using open-source technologies such as Hadoop, Spark, Kafka, Flink and Kubernetes to empower the Microsoft AI organization.

We are hiring a Principal Software Engineer (Microsoft AI Big Data Platform) and are looking to push the boundaries of what is possible, again. You can help rebuild the way analytics engines process data. We build services that enable big data developers to build mission critical applications with high levels of Service Level Agreement (SLA). As an engineer in our team, you will work on and extend Open-Source Software (OSS) technologies like Apache Hadoop, Spark, Delta Lake, Kubernetes as well as proprietary Microsoft services. You will help design & implement software components, participate in code reviews, design reviews, assist customers as needed to be able to leverage the service and keep the service running. You will support a team of talented engineers aiming to improve the abilities of what is possible today with industry leading performance, integration, security and reliability. This will require exploring the frontiers of what is possible.

 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Qualifications

Required Qualifications:

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • 4+ years of hands-on engineering experience developing large-scale distributed systems.
  • 2+ years of experience as Senior/Principal technical lead role.
  • 2+ years of experience with Big Data technologies like Apache Spark, Hadoop, and Kubernetes.

 

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements that are required for this role. These requirements include, but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

  • Experience in large scale system architecture, design, development, testing, and release, including but not limited to web applications, microservices in layers, database design, API design, performance tuning, telemetry design and analysis.
  • Demonstrated programming skills and knowledge of architectural patterns for large, high-scale applications.
  • Proficient analytical skills with systematic and structured approaches to software design.
  • Demonstrated strength to quickly get up-to-speed and be productive on new technical domains and are comfortable in dealing with ambiguity.
  • Ability to drive for results and influence for impact, ability to drive clarity, communicate goals to key stakeholders, and motivate them to execute on time and at a high quality. 
  • Proactively identifies problems, proposes solutions, with demonstrated ability to navigate ambiguity. 

 

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:


Microsoft will accept applications for the role until January 20, 2025. 

 

 

 

#Bing #MicrosoftAI

Responsibilities

  • Design and develop large-scale distributed software services and solutions following modern software engineering practices through design and code reviews.
  • Collaborate with appropriate stakeholders to determine user requirements for a scenario, drive identification of dependencies and the development of design documents for a product, application, service, or platform.
  • Perform system design with well-defined interfaces across multiple components, leveraging data/telemetry to inform decisions.
  • Develop best-in-class engineering for our services, ensuring components are modular, secure, reliable, testable, diagnosable, maintainable, actively monitored, and reusable.
  • Improve test coverage, organize and implement integration tests, and resolve problem areas.
  • Troubleshoot and optimize automation, reliability, and monitoring for Live Site.
  • Embody our culture and values.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect
View Full Job Description
$137.6K - $294.0K/yr (Outscal est.)
$215.8K/yr avg.
Redmond, Washington, United States

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

Redmond, Washington, United States (On-Site)

London, England, United Kingdom (On-Site)

Redmond, Washington, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Redmond, Washington, United States (On-Site)

Redmond, Washington, United States (On-Site)

Redmond, Washington, United States (On-Site)

Mumbai, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Similar Jobs

Dream11 - Lead Engineer - Cloud Security

Dream11, India (On-Site)

Rackspace Technology - Senior MLOPs Engineer (Canada)

Rackspace Technology, Canada (Remote)

Prodigy Education - Lead, Automation QA - Game

Prodigy Education, Canada (On-Site)

Kefir Games - Senior Server Software Engineer

Kefir Games, Cyprus (On-Site)

VGW - Engineering Manager

VGW, Australia (On-Site)

eBay - Principal MTS, Software Engineer

eBay, United States (Hybrid)

CleverTap - Senior Backend Engineer - Platform

CleverTap, India (Hybrid)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Mayhem Studios - Security Engineer-II

Mayhem Studios, India (On-Site)

OKX - Data Architect

OKX, Singapore (On-Site)

Hitachi - Quality Analyst

Hitachi, India (On-Site)

PhonePe - Firmware Engineer (5-7 yrs bracket)

PhonePe, India (On-Site)

Microsoft - Principal Engineering Manager

Microsoft, India (On-Site)

Amazon Games - Senior ML Scientist, Amazon Games AI Research

Amazon Games, United States (On-Site)

CloudHire - Senior Java Developer

CloudHire, India (Remote)

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

CD PROJEKT RED - Senior Cinematic Animator

CD PROJEKT RED, United States (Hybrid)

Onward Search - Inside Sales Representative

Onward Search, United States (On-Site)

Sphere Entertainment Co - Sphere Guest Services Summer 2025 Student Associate Program (Las Vegas)

Sphere Entertainment Co, United States (On-Site)

Xsolla - Human Resources Assistant

Xsolla, United States (Hybrid)

Life church - Network Engineer

Life church, United States (On-Site)

Treyarch - LEAD GRAPHICS ENGINEER - TREYARCH (LOS ANGELES)

Treyarch, United States (On-Site)

Get notifed when new similar jobs are uploaded

Backend Development Jobs

Luxoft - Senior Golang Developer

Luxoft, (Remote)

Enphase Energy - Staff Software Engineer

Enphase Energy, India (On-Site)

Nielsen Holdings - .Net Developer

Nielsen Holdings, India (Hybrid)

Sourcegraph  Inc  - Software Engineer - Graph [IC3]

Sourcegraph Inc , (Remote)

Epic Games - Principal Engineer

Epic Games, United States (On-Site)

Epic Games - Senior Software Programmer

Epic Games, Canada (On-Site)

The Walt Disney Company - Principal Online Services Developer

The Walt Disney Company, Sweden (Remote)

Eleven Labs - Backend Engineer

Eleven Labs, Spain (Remote)

Get notifed when new similar jobs are uploaded