Principal Software Engineer - Large Scale Distributed Systems & Data Platform

1 Month ago • 10-15 Years • Backend Development • Full Stack Development

About the job

Job Description

Warner Bros. Discovery seeks a Principal Software Engineer to architect and scale the global data platform for their streaming app, Max, and other initiatives. This role involves designing cloud infrastructure, data and analytics tools, data collection and processing technologies, ensuring security and governance, and enabling data access. Responsibilities include owning the platform's architecture, collaborating with engineers, creating user-friendly tools and frameworks, implementing AI/ML techniques, managing 24/7 support and budget, promoting innovation, and mentoring engineers. The ideal candidate has 10+ years' experience in large-scale data processing pipelines, big data technologies (Hadoop, Spark, Kafka, etc.), real-time data processing, cloud services (AWS preferred), and AI/ML.
Must have:
  • 15+ years general-purpose programming experience
  • 12+ years building complex software systems
  • 10+ years experience with big data technologies (Hadoop, Spark)
  • 10+ years real-time data processing experience
  • 10+ years cloud-based data solutions experience (AWS preferred)
Good to have:
  • Experience with AI/ML driven platforms
  • Experience with Analytics Tools (Looker, Tableau)
  • Open-source contributions

Welcome to Warner Bros. Discovery… the stuff dreams are made of.

Who We Are…

When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life, the creators bringing them to your living rooms and the dreamers creating what’s next…

From brilliant creatives, to technology trailblazers, across the globe, WBD offers career defining opportunities, thoughtfully curated benefits, and the tools to explore and grow into your best selves. Here you are supported, here you are celebrated, here you can thrive.


Warner Bros. has been entertaining audiences for more than 90 years through the world’s most-loved characters and franchises. Warner Bros. employs people all over the world in a wide variety of disciplines. We're always on the lookout for energetic, creative people to join our team.

Your New Role

We are looking for a passionate Principal Software Engineer (Large Scale Distributed Systems & Data Platform) to help architect and scale the global data platform systems and services for our new global streaming app, Max, as well as any streaming and non-streaming initiatives within the company. This role is truly exceptional, as you will own the technical aspect of a comprehensive, worldwide, multi-tenant, multi-cloud data platform. This encompasses everything from designing a cloud infrastructure, data and analytics tools and frameworks, data collection and processing technologies, ensuring security, upholding governance, maintaining data quality, and enabling data access for all.

As the most senior technical member in the team, you will champion innovation through prototyping, development, experimentation, and seamless integration into production. You will strike the perfect balance between swiftly iterating on features and constructing a cohesive array of platforms and tools, which will empower us to navigate swiftly and decisively into the future

Your Role Accountabilities

  • Own the end-to-end architecture of the data platform, ensuring its efficiency, cost-effectiveness, security, and governance.

  • Collaborate closely with other engineers to design and build an optimal and cost-efficient platform solution.

  • Work in partnership with other engineers and managers to design and develop foundational elements of the platform. Create tools and frameworks that enhance data processing, information retrieval, governance, and data quality in a cost-effective and user-friendly manner.

  • Develop platform tools and frameworks to the same standard as seen in open-source projects. Engage closely with the engineering community and open-source them upon reaching maturity.

  • Implement cutting-edge AI/ML techniques, including Generative AI, to boost the efficiency of the platform and data engineering processes.

  • Take on the responsibility for the platform's 24x7 support availability and oversee budgetary concerns, including cloud expenditure.

  • Promote a culture of experimentation and data-driven innovation. Inspire and motivate through internal and external presentations and other speaking opportunities.

  • Assist in hiring, mentoring, and coaching engineers. Help build an engineering team that prioritizes empathy, diversity, and inclusion.

Qualifications and Experience

  • 15+ years of experience with general-purpose programming (e.g. Python, Java, Go), dealing with a variety of data structures, algorithms, and serialization formats

  • 12+ years of commendable track record of delivering complex software engineering systems and platforms.

  • 12+ years of building and maintaining Tier-1 (require 24*7 uptime and strict SLA) data driven applications.

  • 10+ years of relevant experience in designing and implementing large-scale data processing pipelines

  • 10+ years of proficiency in big data technologies such as Apache Hadoop, Apache Spark and other distributed computing frameworks such as Apache Spark, Kafka, Airflow, Kubernetes, Cassandra, Druid, Snowflake and more

  • 10+ years of experience designing and implementing real-time data processing pipelines and streaming data processing technologies such as Apache Kafka and Apache Flink

  • 10+ years of experience to design and implement data solutions using cloud-based services, including storage, compute, and analytics tools. In-depth knowledge of cloud platforms like AWS, Google Cloud or Azure

  • 5+ years of Cloud (AWS preferred) experience.

  • Experience in building AI/ML driven platform is a huge plus

  • Experience in Analytics Tools and Frameworks (such as Looker, Tableau or similar) or building native web and mobile applications (ReactiveJS or similar ) is a huge plus.

  • Priority will be given to applicants with prior open-source contributions.

Characteristics and Traits

  • Naturally inquisitive, critical thinker, proactive problem-solver, and detail-oriented.

  • Positive attitude and an open mind

  • Strong organizational skills with the ability to act independently and responsibly

  • Self-starter, comfortable initiating projects from design to execution with minimal supervision

  • Ability to manage and balance multiple (and sometimes competing) priorities in a fast-paced, complex business environment and can manage time effectively to consistently meet deadlines

  • Team player and relationship builder

#Li-hybrid

How We Get Things Done…

This last bit is probably the most important! Here at WBD, our guiding principles are the core values by which we operate and are central to how we get things done. You can find them at   along with some insights from the team on what they mean and how they show up in their day to day. We hope they resonate with you and look forward to discussing them during your interview.

Championing Inclusion at WBD

Warner Bros. Discovery embraces the opportunity to build a workforce that reflects the diversity of our society and the world around us. Being an equal opportunity employer means that we take seriously our responsibility to consider qualified candidates on the basis of merit, regardless of sex, gender identity, ethnicity, age, sexual orientation, religion or belief, marital status, pregnancy, parenthood, disability or any other category protected by law.If you’re a qualified candidate and you require adjustments or accommodations to search for a job opening or apply for a position, please contact us at recruitadmin@wbd.com.
View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Warner Bros. Discovery, a premier global media and entertainment company, offers audiences the world’s most differentiated and complete portfolio of content, brands and franchises across television, film, streaming and gaming. The new company combines WarnerMedia’s premium entertainment, sports and news assets with Discovery’s leading non-fiction and international entertainment and sports businesses.

Burbank, California, United States (On-Site)

Hyderabad, Telangana, India (On-Site)

London, England, United Kingdom (On-Site)

Hyderabad, Telangana, India (On-Site)

Masovian Voivodeship, Poland (Hybrid)

Hyderabad, Telangana, India (On-Site)

Atlanta, Georgia, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

Mexico City, Mexico City, Mexico (On-Site)

View All Jobs

Get notified when new jobs are added by Warner Bros. Discovery

Similar Jobs

Inworld AI - Senior Unreal Engine Developer - Canada

Inworld AI, Canada (Hybrid)

PENN Interactive - Staff Data Scientist

PENN Interactive, United States (Hybrid)

Netomi - Data Engineering Manager

Netomi, India (Remote)

ByteDance - Backend Software Engineer, Data Engineering

ByteDance, Singapore (On-Site)

Playrix - Lead Node.js Engineer (Server)

Playrix, Ireland (Remote)

Prodigy Education - Game Full Stack Developer

Prodigy Education, Canada (Hybrid)

Playtika - Senior Java Developer

Playtika, Romania (Hybrid)

Argus Labs - Software Engineer (Junior/Fresh Graduate)

Argus Labs, Indonesia (On-Site)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Rockstar Games - Manager, Data Engineering

Rockstar Games, United States (On-Site)

Dream Game Studios - SDE 2 - Backend

Dream Game Studios, India (On-Site)

The Walt Disney Company - Senior Software Engineer

The Walt Disney Company, United States (On-Site)

Rackspace Technology - Sr Big Data Engineer (GCP)- Airflow and Oozie

Rackspace Technology, India (Remote)

Info Stretch - FORD- Data roles

Info Stretch, United States (On-Site)

Spell Brush - Software Engineer

Spell Brush, United States (On-Site)

Get notifed when new similar jobs are uploaded

Jobs in Hyderabad, Telangana, India

Games2win - Background Artist

Games2win, India (Hybrid)

Intelex Technologies ULC - Staff QA Engineer

Intelex Technologies ULC, India (On-Site)

MSKC GAME STUDIO   - Game Designer

MSKC GAME STUDIO , India (On-Site)

Luxoft - Onboarding Technical Analyst

Luxoft, India (On-Site)

State Street - Security Engineer - Manager

State Street, India (Hybrid)

Assystems - I&C Engineer- Senior.

Assystems, India (On-Site)

Rocket - Information Developer II

Rocket, India (On-Site)

Suki - Mobile Engineer III - IOS

Suki, India (Hybrid)

Get notifed when new similar jobs are uploaded

Backend Development Jobs

CleverTap - Junior Backend Engineer (Java)

CleverTap, India (Hybrid)

Rennsportgg - Senior Backend Engineer (f/m/x)

Rennsportgg, Germany (Remote)

Netflix - Software Engineer (L5) - Consumer Engineering

Netflix, United States (Remote)

Embark Studios - Backend Engineer (Go) - Shared

Embark Studios, Sweden (On-Site)

Google - Software Engineer, Conduit Flume Pipelines

Google, Switzerland (On-Site)

Dream Games - Backend Engineer (Part-time)

Dream Games, Türkiye (On-Site)

Visual Concepts - Senior Server Engineer, NBA 2K

Visual Concepts, United States (On-Site)

Highspot - Sr. Backend Engineer

Highspot, India (Hybrid)

Get notifed when new similar jobs are uploaded