As a Lead Data Engineer, you'll be pivotal in the merger of a major European and Canadian online car marketplace. Responsibilities include simplifying existing tools, addressing technical debt, proposing improvements, and actively participating in team discussions. You will work closely with senior engineers, product managers, and engineering managers. The role demands expertise in AWS (Glue, Athena), Python, PySpark, GCP SQL, Airflow, data streaming frameworks (Kafka or Firehose), data pipeline and platform building, and data modeling. The work will be conducted within the Canadian timezone.
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.
About the project:
Our customer is the European online car market with over 30 million monthly users, with a market presence in 18 countries. The company is now merging with a similar company in Canada and needs support on this way. As a Lead Data Engineer, you will play a pivotal role in shaping the future of online car markets and enhancing the user experience for millions of car buyers and sellers.
Requirements:
8+ years of experience in software engineering
English - Upper-Intermediate+
Proven experience leading complex data projects, organizing teams, and architecting and designing new solutions
Extensive expertise in AWS services, especially Glue, Athena
Proficiency in Python, PySpark, GCP
SQL, Airflow, data streaming frameworks (Kafka or Firehose)
Experience in building and maintaining data pipelines
Experience in building data platforms, not just using them
Proficiency in data modeling techniques and best practices
Responsibilities:
Work during the Canadian time zone
Simplify existing tools, make them more modular, work with technical debt
Propose improvements, be actively involved in team discussions and decision-making, drive initiatives
Work closely with a team of Senior Engineers, Product Manager and Engineering Manager
We offer:
Flexible working format - remote, office-based or flexible
A competitive salary and good compensation package
Personalized career growth
Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
Active tech communities with regular knowledge sharing