Technical Lead Data Engineer

53 Minutes ago • 5 Years + • DevOps

Job Summary

Job Description

The Technical Lead Data Engineer will further develop the internal Data Platform for a global investment advisor organization. Responsibilities include designing and building robust and scalable data pipelines, optimizing database performance, managing infrastructure as code, and collaborating with stakeholders. Strong Python development skills (5+ years experience), SQL proficiency, and cloud experience (Azure preferred) are essential. The role requires expertise in data ingestion, modeling, and optimization, as well as familiarity with tools like Airflow and Terraform.
Must have:
  • 5+ years Python development experience (production environments)
  • Advanced SQL proficiency (PostgreSQL, MySQL, MSSQL)
  • Experience with Airflow or similar orchestration tools
  • 3+ years cloud experience (Azure preferred)
  • Experience with Terraform or equivalent
  • Advanced degree in relevant field
Good to have:
  • Data Pipeline Design expertise
  • Experience with Git, CI/CD
  • Excellent communication skills
  • Experience with PySpark, DPT, SQLMesh, PostgreSQL, MySQL, MSSQL
  • Experience with Azure DevOps, JIRA, Confluence
Perks:
  • Flexible working format (remote, office, hybrid)
  • Competitive salary and benefits
  • Personalized career growth
  • Professional development tools
  • Active tech communities
  • Education reimbursement
  • Corporate events

Job Details

Our Client is a global investment advisor organization that utilizes advanced technologies and data analytics to improve the operational performance of their portfolio companies. Key objectives include delivering strong financial returns, offering diverse investment opportunities, enhancing portfolio company operations, and proactively managing risks. They have invested in proprietary technology and data-driven strategies to extract additional value. Currently, they are expanding their data science team in London, seeking a Technical Lead Data Engineer to further develop their internal Data Platform.

Required Skills and Qualifications:

Must have:

  • Python Development: minimum 5 years of professional experience in production environments, emphasising performance optimisation and code quality.
  • Ingestion and modelling: 
    • Experience with Python and orchestration tools like Airflow is beneficial.
  • SQL Proficiency: advanced knowledge of SQL:
    • At least one of PostgreSQL, MySQL, MSSQL
    • Ability to write complex queries and optimise database performance
    • Utilise DPT tools.
  • Infrastructure as Code: experience with Terraform or equivalent tools to facilitate code-controlled infrastructure management.
  • Cloud Experience: over 3 years of hands-on experience with cloud providers, specifically:
    • AWS or GCP is acceptable
    • Azure is highly preferred due to project-specific requirements.
  • English – Upper-Intermediate or Advanced.
  • Ukrainian language Advanced or higher.
  • Education: advanced degree (Master’s or Ph.D.) in Data Science, Statistics, Computer Science, Engineering, or a related field.

Nice to have:

  • Data Pipeline Design: Strong understanding of designing robust and scalable data pipelines for large-scale applications.
  • Version Control and CI/CD: Familiarity with Git-based workflows and continuous integration/deployment practices to ensure seamless code integration and deployment processes.
  • Communication Skills: Ability to articulate complex technical concepts to technical and non-technical stakeholders alike.
  • Experience with programming: Python, PySpark, DPT, SQLMesh (optional), PostgreSQL, MySQL, MSSQL, Terraform
  • Hands on experience with tools and technologies: Git, Azure DevOps, JIRA, Confluence

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Similar Jobs

Activision - Expert Tools Programmer

Activision

Malmö, Skåne County, Sweden (Hybrid)
1 Month ago
The Walt Disney Company - Senior Effects Technical Director

The Walt Disney Company

Sydney, New South Wales, Australia (On-Site)
6 Months ago
Microsoft - Software Engineering Internship

Microsoft

(On-Site)
2 Weeks ago
Toptracer - Data Engineer

Toptracer

Stockholm, Stockholm County, Sweden (Hybrid)
1 Month ago
Ubisoft - Data Operations Specialist

Ubisoft

Saint-Mandé, Île-de-France, France (On-Site)
3 Days ago
Rackspace Technology - Solution Architect - Specialty Domain - OpenStack

Rackspace Technology

Vietnam (Remote)
3 Months ago
NetSPI - Senior Software Engineer

NetSPI

Pune, Maharashtra, India (On-Site)
3 Months ago
Moon Active - DevOps Engineer

Moon Active

Warsaw, Masovian Voivodeship, Poland (Hybrid)
4 Months ago
EXUSIA - Google Cloud Platform Architect/Developer

EXUSIA

Pune, Maharashtra, India (On-Site)
4 Months ago
Microsoft - Software Engineer - Storage

Microsoft

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Unity - Senior ML Engineer

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Playrix - Lead C++ Software Engineer (Gameplay)

Playrix

Armenia (Remote)
3 Months ago
Dambuster Studios - Technical Animator (Tools Developer)

Dambuster Studios

Nottingham, England, United Kingdom (Remote)
3 Months ago
Microsoft - Principal Software Development Engineer

Microsoft

Zürich, Zurich, Switzerland (On-Site)
2 Weeks ago
Trend Micro - Cloud Engineer (Golang/Python, Backend Focus) 雲端開發工程師

Trend Micro

Taipei City, Taiwan (On-Site)
3 Months ago
ION - Cloud Engineer Kubernetes

ION

Milan, Lombardy, Italy (Hybrid)
4 Months ago
Scanline VFX - Senior Pipeline Developer (Houdini)

Scanline VFX

Mumbai, Maharashtra, India (On-Site)
3 Months ago
DNEG - FX TD (DNEG Animation)

DNEG

Mumbai, Maharashtra, India (On-Site)
6 Months ago
VGW - Business Intelligence Analyst

VGW

Sydney, New South Wales, Australia (On-Site)
2 Weeks ago
Visual Concepts - Senior Backend Engineer, NBA 2K

Visual Concepts

Novato, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Ukraine

Playrix - Lead VFX Artist

Playrix

Ukraine (Remote)
3 Months ago
N-iX - Middle Manual QA Engineer (Mobile) (#2597)

N-iX

Lviv, Lviv Oblast, Ukraine (Hybrid)
1 Month ago
N-iX - Senior Java Engineer

N-iX

Ukraine (Remote)
2 Weeks ago
Every matrix - Database Administrator

Every matrix

Lviv, Lviv Oblast, Ukraine (Hybrid)
4 Months ago
N-iX - Middle/Senior Data Engineer (#2397)

N-iX

Ukraine (Remote)
3 Months ago
Playrix - Senior Game UI Developer

Playrix

Ukraine (Remote)
3 Months ago
GoReel - Service Desk Specialist

GoReel

Kyiv, Kyiv City, Ukraine (On-Site)
1 Week ago
Playrix - Technical Director (Game Project)

Playrix

Ukraine (Remote)
3 Months ago
Gunzilla - Lead Frontend Programmer

Gunzilla

Kyiv, Kyiv City, Ukraine (Hybrid)
1 Month ago
Playrix - Development Director

Playrix

Ukraine (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

ByteDance - Backend Software Engineer (BABI) - ByteCloud

ByteDance

Singapore (On-Site)
3 Months ago
GoTo Group - Senior Software Engineer - Event Platform

GoTo Group

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ION - Site Reliability Engineer

ION

Pisa, Tuscany, Italy (Hybrid)
4 Months ago
Sigma Software - Senior Java Developer

Sigma Software

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Months ago
MRI Software - DevOps Engineer

MRI Software

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Hitachi - Azure Infra Consultant

Hitachi

Pune, Maharashtra, India (Remote)
3 Months ago
Riot Games - Systems Engineer II - Infrastructure

Riot Games

Los Angeles, California, United States (On-Site)
2 Weeks ago
Synopsys  Inc  - SRE, Sr. Associate

Synopsys Inc

Hyderabad, Telangana, India (On-Site)
4 Months ago
PwC - AWS DataOps Engineer

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded