Lead Software Engineer

2 Months ago • 7 Years + • Data Analyst • $152,200 PA - $223,600 PA

Job Summary

Job Description

The Data Platforms Team seeks a Lead Software Engineer to contribute to the architecture, design, and growth of data products and pipelines using Scala and Python/Spark. Responsibilities include designing scalable data warehousing solutions, implementing Lakehouse architecture, leading modules, supporting data analysis for stakeholders, collaborating with cross-functional teams, maintaining documentation, ensuring operational efficiency, and advocating for agile practices. The ideal candidate possesses strong experience with cloud technologies (AWS), distributed systems (Spark), data integration tools (Airflow), data modeling, and SQL, along with excellent communication and problem-solving skills.
Must have:
  • 7+ years data engineering experience
  • AWS experience & data pipeline building
  • Strong SQL & Spark skills
  • Python programming expertise
  • Data modeling & analysis skills
Good to have:
  • MPP database experience (Snowflake, etc.)
  • Data warehousing methodologies
  • Software application development experience
  • AWS or cloud provider infrastructure as code
  • Scrum/Agile methodologies

Job Details

Job Summary:

Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

  • Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

About The Role

The Data Platforms Team, a segment under the Disney Entertainment & ESPN Technology (DEET) organization is looking for a Lead Software Engineer to join our Core Media Networks Data Team. Product Performance Data is critical to making product level decisions for the DEET Portfolio whether it’s related to product design, measuring advertising effectiveness, helping users discover new content or building new businesses in emerging markets. This data is deeply valuable and gives us insights into how we can continue improving our service for our users, advertisers and our content partners. Our Core Media Networks Data Engineering team is seeking a highly motivated Lead Data Engineer with a strong technical background who is passionate about designing and building systems to process data at scale to provide business value, create models and features that unlock powerful insights, and work across software and data disciplines to solve difficult unique problems at scale. Our tech stack includes AWS, Databricks, Airflow, Spark, Databricks and languages include Scala and Python.

Responsibilities

  • Contribute to the architecture, design and growth of our Data Products and Data pipelines in Scala and Python / Spark while maintaining uptime SLAs.

  • Design and develop scalable data warehousing solutions, building ETL pipelines in Big Data cloud environments.

  • Implement the Lakehouse architecture, working with key partners to shift towards a Lakehouse-centric data platform.

  • Lead a module and be well versed with the Business functionality to support Data questions and analysis for the Business stakeholders.

  • Able to understand Business Use Cases/ problems and provide relevant Business & technical solutions. 

  • Our tech stack includes AWS, Snowflake, Spark, Databricks, Delta Lake and Airflow and languages include Python, Scala.

  • Collaborate with Data Product Managers, Data Architects and Data Engineers to design, implement, and deliver successful data solutions.

  • Maintain detailed documentation of your work and changes to support data quality and data governance.

  • Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers (Data Science, Data Analytics teams)

  • Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team.

  • Be a problem solver; when presented with new challenges, you are expected to research and network to find solutions.

  • Seek out answers to business problems and look for opportunities to automate processes & optimize Cost.

  • Engage with and understand our customers, forming relationships that allow us to understand and prioritize both innovative new offerings and incremental platform improvements.

Basic Requirements

  • At least 7 years of data engineering experience developing large data pipelines.

  • Strong hands-on Experience with Cloud technologies like AWS (S3, EMR, EC2) and building data pipelines.

  • Strong algorithmic problem-solving expertise

  • Strong SQL skills and ability to create queries to extract data, build performant datasets and perform Data Analysis.

  • Strong Hands-on experience with distributed systems such as Spark, Pyspark to query and process data.

  • Strong fundamental Python programming skills.

  • Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines with Databricks.

  • Demonstrated competency in data modeling and analysis techniques.

  • Strong attention to detail and excellent analytical skills

  • Verbal and written communication skills and ability to collaborate with others effectively.

Preferred Qualifications

  • Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query)

  • Experience in Data Modeling techniques and Data Warehousing standard methodologies and practices

  • Experience with Software Application development.

  • Good data acumen to understand domain /functional knowledge and to be able to articulate analysis of data points in business context for stakeholders.

  • Demonstrated excellent interpersonal skills, communication skills including ability to partner with others and build consensus in a cross-functional team toward a desired outcome.

  • Experience working with a test first mentality.

  • Deep Understanding of AWS or other cloud providers as well as infrastructure as code

  • Familiar with Scrum and Agile methodologies

Required Education

  • Bachelor’s degree in computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience

Additional Information

#DISNEYTECH


The hiring range for this position in Santa Monica, California is $152,200 to $204,100 per year, in Bristol, Connecticut is $152,200 to $204,100 per year, in Seattle, Washington is $159,500 to $213,900 per year. in New York City, NY is $159,500 to $213,900 per year, and in San Francisco, California is $166,800 to $223,600 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Similar Jobs

Warner Bros Discovery - Senior Machine Learning Engineer

Warner Bros Discovery

Bellevue, Washington, United States (On-Site)
2 Months ago
Next Level Business Services - Sr. Big Data Engineer in San Francisco, CA  / McLean, VA

Next Level Business Services

San Francisco, California, United States (On-Site)
4 Months ago
Epic Games - Analytics Lead (Gameplay)

Epic Games

(On-Site)
1 Month ago
N-iX - Senior Fullstack Engineer

N-iX

Ukraine (Remote)
2 Weeks ago
ION - Data Engineer/Analyst - Graduate Development Program

ION

Pisa, Tuscany, Italy (On-Site)
4 Months ago
Dream Sports - Manager - Business Analytics

Dream Sports

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Warner Bros Discovery - Corporate Data Architect

Warner Bros Discovery

Masovian Voivodeship, Poland (Hybrid)
3 Months ago
CloudHire - Data Analyst

CloudHire

Bengaluru, Karnataka, India (Remote)
4 Months ago
Luxoft - Senior Data Ops Engineer

Luxoft

Bengaluru, Karnataka, India (On-Site)
3 Months ago
The Walt Disney Company - Sr Automation & Integration Analyst

The Walt Disney Company

Celebration, Florida, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

SLAY - Senior React Native Engineer

SLAY

Berlin, Berlin, Germany (On-Site)
3 Months ago
Epic Games - Data Analyst - Product Analytics

Epic Games

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
Epic Games - Technical Director, Machine Learning Programmer

Epic Games

(On-Site)
2 Weeks ago
Playrix - Technical Director (Game Project)

Playrix

Georgia (Remote)
4 Months ago
Epic Games - Data Analyst - Product Analytics

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
The Walt Disney Company - Principal Machine Learning Engineer, Research - Ad Platforms

The Walt Disney Company

San Francisco, California, United States (On-Site)
3 Months ago
Duolingo - AI Research, Intern (PhD)

Duolingo

Pittsburgh, Pennsylvania, United States (On-Site)
4 Months ago
Warner Bros Discovery - Senior Data Scientist

Warner Bros Discovery

Bellevue, Washington, United States (On-Site)
2 Months ago
PwC - Junior BI/Data analyst - Technology Consulting

PwC

Prague, Prague, Czechia (On-Site)
4 Months ago
Paypal - Machine Learning Engineer

Paypal

San Jose, California, United States (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Washington, United States

Next Level Business Services - ServiceNow Architect

Next Level Business Services

Cupertino, California, United States (On-Site)
4 Months ago
ByteDance - Research Scientist Graduate (Foundation Model - Generative AI) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
Insomniacs - Senior Gameplay Animator

Insomniacs

United States (Remote)
1 Month ago
Hedra - Frontend Engineer

Hedra

New York, New York, United States (On-Site)
5 Months ago
Riot Games - Senior Visual Design Artist - League of Legends, Summoner's Rift Environment

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
ByteDance - Senior Backend Software Engineer - Global E-Commerce Supply Chain Inventory

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Trackman - Sales Representative - Atlanta

Trackman

Atlanta, Georgia, United States (Hybrid)
1 Month ago
Haptic - Lead Gameplay Software Engineer

Haptic

Dallas, Texas, United States (Remote)
1 Month ago
The Walt Disney Company - Manager, Data Science

The Walt Disney Company

Burbank, California, United States (On-Site)
2 Weeks ago
ByteDance - Shipping Insurance Business Solution and Operations - Global Payment

ByteDance

San Jose, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Thumbtack - Senior Data Scientist, Business Analytics

Thumbtack

United States (Remote)
1 Week ago
Fliff  Inc  - Business Analyst

Fliff Inc

Philadelphia, Pennsylvania, United States (On-Site)
7 Months ago
Eneba Games - Fraud Analyst

Eneba Games

Lithuania (Remote)
3 Weeks ago
Netflix - Product Manager, Data Platform - Data Discovery & Governance

Netflix

United States (Remote)
1 Month ago
Warner Bros Discovery - Senior Analyst, Audience Insights

Warner Bros Discovery

Hong Kong, Hong Kong (On-Site)
3 Months ago
Intel Corporation - Data Architect

Intel Corporation

Hillsboro, Oregon, United States (Hybrid)
2 Months ago
GlobalLogic - Data Scientist IRC241434

GlobalLogic

Hyderabad, Telangana, India (On-Site)
5 Months ago
PwC - IN_Senior Associate_Qlikview_D&A_Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Token Metrics - Senior Crypto Data Engineer (Remote)

Token Metrics

Budapest, Hungary (Remote)
4 Months ago
Lifelancer - Senior Data Scientist

Lifelancer

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

From classic animated features and exhilarating theme park attractions to cutting edge sports coverage, and the hottest shows on television, The Walt Disney Company has been making magic since 1923, creating unforgettable stories that connect with audiences around the world. And we’re just getting started!

The key to our success…. The Cast, Crew, Imagineers and Employees who honor Disney’s rich legacy by stretching the bounds of imagination to create the never-before-seen, bringing unparalleled entertainment experiences to people of all ages. Begin a career that delivers unparalleled creative content and experiences to audiences around the world and just imagine the stories you could be part of…

What is #LifeAtDisney like? It’s a series of magical moments with cast members and employees developing and telling our stories in the most innovative ways. Whether it’s a day spent as a Disney VoluntEAR, or celebrating the release of a new interactive experience, retail product or movie, our days are filled with the knowledge that we are creating entertainment experiences the whole family can enjoy. Follow @DisneyCareers on Facebook, Twitter and Instagram for a peek behind-the-curtain, and discover how you could connect to a world of stories with Disney!

Mumbai, Maharashtra, India (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (Hybrid)

New York, New York, United States (On-Site)

Glendale, California, United States (On-Site)

Burbank, California, United States (On-Site)

Orlando, Florida, United States (On-Site)

California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by The Walt Disney Company

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug