Senior Big Data Engineer

3 Months ago • 5 Years + • Data Analyst

Job Summary

Job Description

Playrix, a top mobile game developer, seeks a Senior Data Engineer with 5+ years of experience in Data Engineering, Python development, and experience with popular DE/ML frameworks like PySpark, Airflow, pandas, SQLAlchemy, and MLflow. The role involves automating data extraction, quality control, data transformation, and developing continuous data delivery pipelines in a cloud infrastructure.
Must have:
  • Data Engineering
  • Python Development
  • PySpark, Airflow
  • SQL Query Optimization
Good to have:
  • Data Lake experience
  • AWS Cloud Infrastructure
  • Data Pipeline development
  • Experience with MonteCarlo, DBT
Perks:
  • Flexible Schedule
  • Health Insurance

Job Details

Senior Big Data Engineer (Core Data)

About the company

Playrix is ​​one of the most successful mobile game development companies 
in the world. In terms of mobile application revenue, we rank first in Europe 
and are in the top 3 worldwide. Our games have been installed 2.3 billion times (that's a third of the world's population!) and more than 30 million people around the world play them every day.

Team, about the role

Our data lake contains over 2.5 petabytes of marketing metrics, game events, and operational parameters. We do everything possible to ensure there's no doubt about the completeness, relevance, and reliability of the data we provide. We pay special attention to processing speed and data quality. This allows us to make the right decisions when developing our games.

We want to boost the gaming and marketing event attribution business and are looking for a Senior Data Engineer to join our Data Core team, which is responsible for organizing the storage, transformation and access to gaming and marketing analytics data.

Tasks

  • Automating external source data extraction processes
  • Automating quality control and verification of supplied data, configuring monitoring and regulations
  • Transforming and uploading data for further analysis within game analytics and marketing in the most client-friendly form
  • Developing and maintaining a continuous data delivery pipeline
  • Developing and maintaining the integration services for interaction with partners

Our stack

Python is our main language, and data access is in SQL. Our Data Lake is built on the S3 and Delta Lake format in Databricks. For our DWH, we use Redshift/PostgreSQL. We work in the AWS cloud infrastructure.

We use solutions from mainstream vendors, including MonteCarlo and DBT. We use a serverless approach when working with resources, as well as horizontal scaling and predictive models. We pay close attention to both code and architecture refactoring. For CI/CD, we use TeamCity.

Requirements

  • 5+ years of general experience in Data Engineering

  • 3+ years of development experience in Python: OOP, skills in designing frameworks and libraries, ability to read and analyze code, experience in profiling and performance/scalability optimization

  • Skills in working with popular DE/ML frameworks: PySpark, Airflow, pandas, SQLAlchemy, MLflow

  • Skills in writing and optimizing SQL queries, ability to work with query plans, and experience working with repositories of different architectures: MPP, columnar, relation, Hadoop, in-memory

  • Experience with storage of different architectures like mpp, columnar, relation, hadoop, and in-memory

  • Fluency in Russian  

Our Perks

Flexibility at work

  • For most positions we offer a flexible schedule, and employees can work from anywhere in the world (except for the Russian Federation and the Republic of Belarus). You can do your work however and wherever you like — we only evaluate your results.

Caring for health and well-being
  • We provide voluntary health insurance for employees and their children, and reimburse online sessions with a psychologist.
  • We offer fully paid vacation days and sick leave. In certain circumstances, you can request additional days off.
  • We support leading a healthy lifestyle and reimburse the cost of gym memberships and fitness app subscriptions.
Professional development and education
  • We pay for participation in specialized conferences and courses and hold our own internal conferences.
  • We offer discounts on English language courses and courses for the languages of the countries in which the company operates.
Events and merch
  • We regularly hold offline events like team meetings, big corporate parties, and informal office parties.
  • We also regularly organize fun competitions, quizzes, hackathons, and online fitness challenges.
  • We have a merch store with an internal currency you can use to buy unique gifts. We give out this currency as a gift for significant dates, and you can earn more by participating in events and company activities.

Similar Jobs

Microsoft - Principal Software Engineer - AI Transformation - Microsoft Research

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Synechron - ETL Tester / Test Automation Architect

Synechron

Mulshi, Maharashtra, India (On-Site)
3 Months ago
Go Fund Me - Software Engineer (Integrity)

Go Fund Me

Buenos Aires, Buenos Aires, Argentina (On-Site)
3 Months ago
eBay - Manager, Software Development

eBay

Toronto, Ontario, Canada (Hybrid)
4 Months ago
Info Stretch - Lead Data Engineer

Info Stretch

Chennai, Tamil Nadu, India (On-Site)
3 Months ago
Sigma Software - Senior Data Engineer (Global Business Solutions)

Sigma Software

Kraków, Lesser Poland Voivodeship, Poland (Remote)
3 Months ago
ION - Debt Restructuring Analyst

ION

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Microsoft - Principal Data & Applied Scientist

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Rehlat - Digital Marketing Manager

Rehlat

Hyderabad, Telangana, India (On-Site)
5 Months ago
Intel Corporation - Snowflake Development Engineer

Intel Corporation

Hyderabad, Telangana, India (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NetSPI - Lead DevOps Engineer

NetSPI

Pune, Maharashtra, India (On-Site)
3 Months ago
Buckman - Lead Digital Software Engineer - Front End Mobile

Buckman

Chennai, Tamil Nadu, India (On-Site)
3 Months ago
NowPurchase - React Native Developer

NowPurchase

Gurugram, Haryana, India (Hybrid)
3 Months ago
Cognite - Senior Back-end Engineer

Cognite

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Miniclip - Data Engineer

Miniclip

Lisbon, Lisbon, Portugal (On-Site)
2 Months ago
Polygon Labs - Senior Security Engineer (Rust)

Polygon Labs

(Remote)
1 Month ago
N-iX - Lead .NET Full-Stack Engineer (#2414)

N-iX

Ukraine (Remote)
3 Months ago
Riot Games - Senior Software Engineer, Services - Shanghai Game Studio

Riot Games

Dublin, County Dublin, Ireland (On-Site)
2 Months ago
Progress - Senior Software Engineer

Progress

Sofia, Sofia City Province, Bulgaria (Hybrid)
3 Months ago
Patterned Learning Career - Lead Software Engineer

Patterned Learning Career

(Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Ukraine

N-iX - Senior Data Engineer (#2324)

N-iX

Ukraine (Remote)
3 Months ago
N-iX - Senior Product Analyst (#2094)

N-iX

Ukraine (Remote)
3 Months ago
EvoPlay - Key Account Manager (Chinese)

EvoPlay

Kyiv, Kyiv City, Ukraine (On-Site)
3 Months ago
Playrix - Senior Engineering Manager

Playrix

Ukraine (Remote)
3 Months ago
N-iX - Senior Manual QA Engineer (#2417)

N-iX

Ukraine (Remote)
3 Months ago
N-iX - Senior Business Analyst (#2594)

N-iX

Ukraine (Remote)
2 Months ago
Playrix - Senior C++/Python Software Engineer (Engine)

Playrix

Ukraine (Remote)
3 Months ago
N-iX - Middle Support Data Engineer (#2521)

N-iX

Ukraine (Remote)
2 Months ago
N-iX - Senior Python Software Engineer (#2666)

N-iX

Kyiv, Kyiv City, Ukraine (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Meta - Global Sales Analytics Lead

Meta

Austin, Texas, United States (Remote)
3 Months ago
Whatnot - Director, Data Science (Revenue Analytics)

Whatnot

(Remote)
3 Months ago
Ubisoft - Data Engineer / Production Analyst [Game Intelligence]

Ubisoft

Malmö, Skåne County, Sweden (Hybrid)
3 Months ago
Hashlist - Principal Data Engineer

Hashlist

Chennai, Tamil Nadu, India (Hybrid)
3 Months ago
Riot Games - Staff Data Engineer - League of Legends, Data

Riot Games

Los Angeles, California, United States (On-Site)
5 Months ago
seeking alpha - Senior Data Scientist

seeking alpha

Ukraine (Remote)
1 Month ago
N-iX - Senior/Lead Power BI Engineer (#2507)

N-iX

(Remote)
2 Months ago
Microsoft - Data Governance Lead

Microsoft

Redmond, Washington, United States (Hybrid)
1 Month ago
Aera Technology - Skills Developer (DWH/BI)

Aera Technology

Bucharest, Bucharest, Romania (Hybrid)
3 Months ago
GoTo Group - Senior Data Warehouse Engineer

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded