Lead Software Engineer

1 Hour ago • 7 Years + • Data Analyst

About the job

Job Description

The Data Platforms Team seeks a Lead Software Engineer to contribute to the architecture, design, and growth of data products and pipelines using Scala and Python/Spark. Responsibilities include designing scalable data warehousing solutions, implementing Lakehouse architecture, leading modules, supporting data analysis for stakeholders, collaborating with cross-functional teams, maintaining documentation, ensuring operational efficiency, and advocating for agile practices. The ideal candidate possesses strong experience with cloud technologies (AWS), distributed systems (Spark), data integration tools (Airflow), data modeling, and SQL, along with excellent communication and problem-solving skills.
Must have:
  • 7+ years data engineering experience
  • AWS experience & data pipeline building
  • Strong SQL & Spark skills
  • Python programming expertise
  • Data modeling & analysis skills
Good to have:
  • MPP database experience (Snowflake, etc.)
  • Data warehousing methodologies
  • Software application development experience
  • AWS or cloud provider infrastructure as code
  • Scrum/Agile methodologies
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

Job Summary:

Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

  • Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

About The Role

The Data Platforms Team, a segment under the Disney Entertainment & ESPN Technology (DEET) organization is looking for a Lead Software Engineer to join our Core Media Networks Data Team. Product Performance Data is critical to making product level decisions for the DEET Portfolio whether it’s related to product design, measuring advertising effectiveness, helping users discover new content or building new businesses in emerging markets. This data is deeply valuable and gives us insights into how we can continue improving our service for our users, advertisers and our content partners. Our Core Media Networks Data Engineering team is seeking a highly motivated Lead Data Engineer with a strong technical background who is passionate about designing and building systems to process data at scale to provide business value, create models and features that unlock powerful insights, and work across software and data disciplines to solve difficult unique problems at scale. Our tech stack includes AWS, Databricks, Airflow, Spark, Databricks and languages include Scala and Python.

Responsibilities

  • Contribute to the architecture, design and growth of our Data Products and Data pipelines in Scala and Python / Spark while maintaining uptime SLAs.

  • Design and develop scalable data warehousing solutions, building ETL pipelines in Big Data cloud environments.

  • Implement the Lakehouse architecture, working with key partners to shift towards a Lakehouse-centric data platform.

  • Lead a module and be well versed with the Business functionality to support Data questions and analysis for the Business stakeholders.

  • Able to understand Business Use Cases/ problems and provide relevant Business & technical solutions. 

  • Our tech stack includes AWS, Snowflake, Spark, Databricks, Delta Lake and Airflow and languages include Python, Scala.

  • Collaborate with Data Product Managers, Data Architects and Data Engineers to design, implement, and deliver successful data solutions.

  • Maintain detailed documentation of your work and changes to support data quality and data governance.

  • Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers (Data Science, Data Analytics teams)

  • Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team.

  • Be a problem solver; when presented with new challenges, you are expected to research and network to find solutions.

  • Seek out answers to business problems and look for opportunities to automate processes & optimize Cost.

  • Engage with and understand our customers, forming relationships that allow us to understand and prioritize both innovative new offerings and incremental platform improvements.

Basic Requirements

  • At least 7 years of data engineering experience developing large data pipelines.

  • Strong hands-on Experience with Cloud technologies like AWS (S3, EMR, EC2) and building data pipelines.

  • Strong algorithmic problem-solving expertise

  • Strong SQL skills and ability to create queries to extract data, build performant datasets and perform Data Analysis.

  • Strong Hands-on experience with distributed systems such as Spark, Pyspark to query and process data.

  • Strong fundamental Python programming skills.

  • Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines with Databricks.

  • Demonstrated competency in data modeling and analysis techniques.

  • Strong attention to detail and excellent analytical skills

  • Verbal and written communication skills and ability to collaborate with others effectively.

Preferred Qualifications

  • Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query)

  • Experience in Data Modeling techniques and Data Warehousing standard methodologies and practices

  • Experience with Software Application development.

  • Good data acumen to understand domain /functional knowledge and to be able to articulate analysis of data points in business context for stakeholders.

  • Demonstrated excellent interpersonal skills, communication skills including ability to partner with others and build consensus in a cross-functional team toward a desired outcome.

  • Experience working with a test first mentality.

  • Deep Understanding of AWS or other cloud providers as well as infrastructure as code

  • Familiar with Scrum and Agile methodologies

Required Education

  • Bachelor’s degree in computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience

Additional Information

#DISNEYTECH


The hiring range for this position in Santa Monica, California is $152,200 to $204,100 per year, in Bristol, Connecticut is $152,200 to $204,100 per year, in Seattle, Washington is $159,500 to $213,900 per year. in New York City, NY is $159,500 to $213,900 per year, and in San Francisco, California is $166,800 to $223,600 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.
View Full Job Description
$152.2K - $223.6K/yr (Outscal est.)
$187.9K/yr avg.
Washington, United States

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

From classic animated features and exhilarating theme park attractions to cutting edge sports coverage, and the hottest shows on television, The Walt Disney Company has been making magic since 1923, creating unforgettable stories that connect with audiences around the world. And we’re just getting started!

The key to our success…. The Cast, Crew, Imagineers and Employees who honor Disney’s rich legacy by stretching the bounds of imagination to create the never-before-seen, bringing unparalleled entertainment experiences to people of all ages. Begin a career that delivers unparalleled creative content and experiences to audiences around the world and just imagine the stories you could be part of…

What is #LifeAtDisney like? It’s a series of magical moments with cast members and employees developing and telling our stories in the most innovative ways. Whether it’s a day spent as a Disney VoluntEAR, or celebrating the release of a new interactive experience, retail product or movie, our days are filled with the knowledge that we are creating entertainment experiences the whole family can enjoy. Follow @DisneyCareers on Facebook, Twitter and Instagram for a peek behind-the-curtain, and discover how you could connect to a world of stories with Disney!

Minato City, Tokyo, Japan (On-Site)

Minato City, Tokyo, Japan (On-Site)

Minato City, Tokyo, Japan (On-Site)

Washington, United States (On-Site)

Orlando, Florida, United States (On-Site)

Orlando, Florida, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

Santa Monica, California, United States (On-Site)

Santa Monica, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by The Walt Disney Company

Similar Jobs

Paypal - Lead Principal ML Engineer, AI Solutions

Paypal, United States (On-Site)

Evolution - Data Scientist

Evolution, Poland (Hybrid)

The Walt Disney Company - Manager, Software Engineering - Ads Data Infrastructure and Devops

The Walt Disney Company, United States (On-Site)

Wargaming - Game Data Analyst  (World of Warships)

Wargaming, Serbia (Hybrid)

Nielsen Holdings - QC Analyst

Nielsen Holdings, Malaysia (Hybrid)

Bazaar Voice - Senior Data Engineer

Bazaar Voice, United Kingdom (Hybrid)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Sumo Logic - Senior Site Reliability Engineer - Core

Sumo Logic, India (On-Site)

Azira - Engineer, Data Engineering

Azira, India (On-Site)

The Walt Disney Company - Manager, Software Engineering(Scala)

The Walt Disney Company, United States (On-Site)

Evolution - Backend Developer - Distributed Services

Evolution, Sweden (On-Site)

Target - Data Scientist

Target, India (On-Site)

Duolingo - AI Research, Intern (PhD)

Duolingo, United States (On-Site)

InMobiInMobi - Lead Solutions Engineer

InMobiInMobi, United States (On-Site)

Luxoft - Team Lead Devops

Luxoft, Ukraine (Remote)

Get notifed when new similar jobs are uploaded

Jobs in Washington, United States

The Walt Disney Company - Lead Data Scientist

The Walt Disney Company, United States (On-Site)

ByteDance - Backend Software Engineer - Authorization

ByteDance, United States (On-Site)

WebFX - Web Developer Internship

WebFX, United States (On-Site)

Saviynt - Engineering Manager, Software Engineering

Saviynt, United States (Hybrid)

YOOM - Motion Capture Production Specialist

YOOM, United States (On-Site)

Sophic Synergistics LLC - Human Factors Specialist Aerospace Focused

Sophic Synergistics LLC, United States (On-Site)

CAE - Accountant III

CAE, United States (On-Site)

DraftKings - Lead Analyst

DraftKings, United States (On-Site)

Zones - Territory Vice President, Central

Zones, United States (On-Site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

ION - Data Associate - KYC6

ION, Hungary (On-Site)

10times - Data Scientist

10times, India (On-Site)

ARHS - System Analyst

ARHS, Poland (Remote)

Unity - Principal Data Engineer

Unity, United States (On-Site)

PwC - Senior Associate

PwC, India (On-Site)

PwC - Data Engineer

PwC, Czechia (On-Site)

Trendyol - Pricing Data Analyst

Trendyol, Türkiye (Hybrid)

Voodoo - Senior Data Analyst - Growth

Voodoo, France (Hybrid)

Get notifed when new similar jobs are uploaded