Principal Software Engineer - Large Scale Distributed Systems & Data Platform

2 Weeks ago • 10-15 Years • Backend Development • Full Stack Development

About the job

Summary

Warner Bros. Discovery seeks a Principal Software Engineer to architect and scale the global data platform for their streaming app, Max, and other initiatives. This role involves designing cloud infrastructure, data and analytics tools, data collection and processing technologies, ensuring security and governance, and enabling data access. Responsibilities include owning the platform's architecture, collaborating with engineers, creating user-friendly tools and frameworks, implementing AI/ML techniques, managing 24/7 support and budget, promoting innovation, and mentoring engineers. The ideal candidate has 10+ years' experience in large-scale data processing pipelines, big data technologies (Hadoop, Spark, Kafka, etc.), real-time data processing, cloud services (AWS preferred), and AI/ML.
Must have:
  • 15+ years general-purpose programming experience
  • 12+ years building complex software systems
  • 10+ years experience with big data technologies (Hadoop, Spark)
  • 10+ years real-time data processing experience
  • 10+ years cloud-based data solutions experience (AWS preferred)
Good to have:
  • Experience with AI/ML driven platforms
  • Experience with Analytics Tools (Looker, Tableau)
  • Open-source contributions
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

Welcome to Warner Bros. Discovery… the stuff dreams are made of.

Who We Are…

When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life, the creators bringing them to your living rooms and the dreamers creating what’s next…

From brilliant creatives, to technology trailblazers, across the globe, WBD offers career defining opportunities, thoughtfully curated benefits, and the tools to explore and grow into your best selves. Here you are supported, here you are celebrated, here you can thrive.


Warner Bros. has been entertaining audiences for more than 90 years through the world’s most-loved characters and franchises. Warner Bros. employs people all over the world in a wide variety of disciplines. We're always on the lookout for energetic, creative people to join our team.

Your New Role

We are looking for a passionate Principal Software Engineer (Large Scale Distributed Systems & Data Platform) to help architect and scale the global data platform systems and services for our new global streaming app, Max, as well as any streaming and non-streaming initiatives within the company. This role is truly exceptional, as you will own the technical aspect of a comprehensive, worldwide, multi-tenant, multi-cloud data platform. This encompasses everything from designing a cloud infrastructure, data and analytics tools and frameworks, data collection and processing technologies, ensuring security, upholding governance, maintaining data quality, and enabling data access for all.

As the most senior technical member in the team, you will champion innovation through prototyping, development, experimentation, and seamless integration into production. You will strike the perfect balance between swiftly iterating on features and constructing a cohesive array of platforms and tools, which will empower us to navigate swiftly and decisively into the future

Your Role Accountabilities

  • Own the end-to-end architecture of the data platform, ensuring its efficiency, cost-effectiveness, security, and governance.

  • Collaborate closely with other engineers to design and build an optimal and cost-efficient platform solution.

  • Work in partnership with other engineers and managers to design and develop foundational elements of the platform. Create tools and frameworks that enhance data processing, information retrieval, governance, and data quality in a cost-effective and user-friendly manner.

  • Develop platform tools and frameworks to the same standard as seen in open-source projects. Engage closely with the engineering community and open-source them upon reaching maturity.

  • Implement cutting-edge AI/ML techniques, including Generative AI, to boost the efficiency of the platform and data engineering processes.

  • Take on the responsibility for the platform's 24x7 support availability and oversee budgetary concerns, including cloud expenditure.

  • Promote a culture of experimentation and data-driven innovation. Inspire and motivate through internal and external presentations and other speaking opportunities.

  • Assist in hiring, mentoring, and coaching engineers. Help build an engineering team that prioritizes empathy, diversity, and inclusion.

Qualifications and Experience

  • 15+ years of experience with general-purpose programming (e.g. Python, Java, Go), dealing with a variety of data structures, algorithms, and serialization formats

  • 12+ years of commendable track record of delivering complex software engineering systems and platforms.

  • 12+ years of building and maintaining Tier-1 (require 24*7 uptime and strict SLA) data driven applications.

  • 10+ years of relevant experience in designing and implementing large-scale data processing pipelines

  • 10+ years of proficiency in big data technologies such as Apache Hadoop, Apache Spark and other distributed computing frameworks such as Apache Spark, Kafka, Airflow, Kubernetes, Cassandra, Druid, Snowflake and more

  • 10+ years of experience designing and implementing real-time data processing pipelines and streaming data processing technologies such as Apache Kafka and Apache Flink

  • 10+ years of experience to design and implement data solutions using cloud-based services, including storage, compute, and analytics tools. In-depth knowledge of cloud platforms like AWS, Google Cloud or Azure

  • 5+ years of Cloud (AWS preferred) experience.

  • Experience in building AI/ML driven platform is a huge plus

  • Experience in Analytics Tools and Frameworks (such as Looker, Tableau or similar) or building native web and mobile applications (ReactiveJS or similar ) is a huge plus.

  • Priority will be given to applicants with prior open-source contributions.

Characteristics and Traits

  • Naturally inquisitive, critical thinker, proactive problem-solver, and detail-oriented.

  • Positive attitude and an open mind

  • Strong organizational skills with the ability to act independently and responsibly

  • Self-starter, comfortable initiating projects from design to execution with minimal supervision

  • Ability to manage and balance multiple (and sometimes competing) priorities in a fast-paced, complex business environment and can manage time effectively to consistently meet deadlines

  • Team player and relationship builder

#Li-hybrid

How We Get Things Done…

This last bit is probably the most important! Here at WBD, our guiding principles are the core values by which we operate and are central to how we get things done. You can find them at   along with some insights from the team on what they mean and how they show up in their day to day. We hope they resonate with you and look forward to discussing them during your interview.

Championing Inclusion at WBD

Warner Bros. Discovery embraces the opportunity to build a workforce that reflects the diversity of our society and the world around us. Being an equal opportunity employer means that we take seriously our responsibility to consider qualified candidates on the basis of merit, regardless of sex, gender identity, ethnicity, age, sexual orientation, religion or belief, marital status, pregnancy, parenthood, disability or any other category protected by law.If you’re a qualified candidate and you require adjustments or accommodations to search for a job opening or apply for a position, please contact us at recruitadmin@wbd.com.
View Full Job Description

About The Company

Warner Bros. Discovery, a premier global media and entertainment company, offers audiences the world’s most differentiated and complete portfolio of content, brands and franchises across television, film, streaming and gaming. The new company combines WarnerMedia’s premium entertainment, sports and news assets with Discovery’s leading non-fiction and international entertainment and sports businesses.

Community Of Madrid, Spain (On-Site)

Masovian Voivodeship, Poland (Hybrid)

Masovian Voivodeship, Poland (Hybrid)

England, United Kingdom (Hybrid)

England, United Kingdom (Hybrid)

Masovian Voivodeship, Poland (Hybrid)

California, United States (On-Site)

England, United Kingdom (Hybrid)

Georgia, United States (On-Site)

View All Jobs

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug