Senior Big Data Engineer

3 Months ago • 5 Years + • Data Analyst

Job Summary

Job Description

Playrix seeks a Senior Data Engineer to join their Data Core team. You'll be responsible for automating data extraction, quality control, transformation, and delivery pipelines. Experience with Python, SQL, and cloud infrastructure is essential.
Must have:
  • 5+ years Data Engineering
  • 3+ years Python Development
  • SQL Query Optimization
  • Cloud Infrastructure Experience
Good to have:
  • PySpark, Airflow
  • Pandas, SQLAlchemy
  • MLflow, DBT
  • RedShift, PostgreSQL
Perks:
  • Flexible Schedule
  • Health Insurance

Job Details

Senior Big Data Engineer (Core Data)

About the company

Playrix is ​​one of the most successful mobile game development companies 
in the world. In terms of mobile application revenue, we rank first in Europe 
and are in the top 3 worldwide. Our games have been installed 2.3 billion times (that's a third of the world's population!) and more than 30 million people around the world play them every day.

Team, about the role

Our data lake contains over 2.5 petabytes of marketing metrics, game events, and operational parameters. We do everything possible to ensure there's no doubt about the completeness, relevance, and reliability of the data we provide. We pay special attention to processing speed and data quality. This allows us to make the right decisions when developing our games.

We want to boost the gaming and marketing event attribution business and are looking for a Senior Data Engineer to join our Data Core team, which is responsible for organizing the storage, transformation and access to gaming and marketing analytics data.

Tasks

  • Automating external source data extraction processes
  • Automating quality control and verification of supplied data, configuring monitoring and regulations
  • Transforming and uploading data for further analysis within game analytics and marketing in the most client-friendly form
  • Developing and maintaining a continuous data delivery pipeline
  • Developing and maintaining the integration services for interaction with partners

Our stack

Python is our main language, and data access is in SQL. Our Data Lake is built on the S3 and Delta Lake format in Databricks. For our DWH, we use Redshift/PostgreSQL. We work in the AWS cloud infrastructure.

We use solutions from mainstream vendors, including MonteCarlo and DBT. We use a serverless approach when working with resources, as well as horizontal scaling and predictive models. We pay close attention to both code and architecture refactoring. For CI/CD, we use TeamCity.

Requirements

  • 5+ years of general experience in Data Engineering

  • 3+ years of development experience in Python: OOP, skills in designing frameworks and libraries, ability to read and analyze code, experience in profiling and performance/scalability optimization

  • Skills in working with popular DE/ML frameworks: PySpark, Airflow, pandas, SQLAlchemy, MLflow

  • Skills in writing and optimizing SQL queries, ability to work with query plans, and experience working with repositories of different architectures: MPP, columnar, relation, Hadoop, in-memory

  • Experience with storage of different architectures like mpp, columnar, relation, hadoop, and in-memory

  • Fluency in Russian  

Our Perks

Flexibility at work

  • For most positions we offer a flexible schedule, and employees can work from anywhere in the world (except for the Russian Federation and the Republic of Belarus). You can do your work however and wherever you like — we only evaluate your results.

Caring for health and well-being
  • We provide voluntary health insurance for employees and their children, and reimburse online sessions with a psychologist.
  • We offer fully paid vacation days and sick leave. In certain circumstances, you can request additional days off.
  • We support leading a healthy lifestyle and reimburse the cost of gym memberships and fitness app subscriptions.
Professional development and education
  • We pay for participation in specialized conferences and courses and hold our own internal conferences.
  • We offer discounts on English language courses and courses for the languages of the countries in which the company operates.
Events and merch
  • We regularly hold offline events like team meetings, big corporate parties, and informal office parties.
  • We also regularly organize fun competitions, quizzes, hackathons, and online fitness challenges.
  • We have a merch store with an internal currency you can use to buy unique gifts. We give out this currency as a gift for significant dates, and you can earn more by participating in events and company activities.

Similar Jobs

Nagarro - Staff Engineer (QA - API Testing)

Nagarro

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Ajmera Infotech - Senior Native iOS Developer

Ajmera Infotech

Hyderabad, Telangana, India (On-Site)
1 Month ago
Netflix - Systems Engineer L4 - DevOps

Netflix

United States (Remote)
3 Months ago
Luxoft - Data Architect

Luxoft

New Delhi, Delhi, India (Remote)
2 Months ago
Luxoft - Test Automation Engineer - UFT Selenium

Luxoft

(On-Site)
2 Months ago
Trendyol - Digital Marketing Professionals

Trendyol

Maslak, İstanbul, Türkiye (Hybrid)
3 Months ago
Enphase Energy - Staff Data Scientist

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Twitch - Data Scientist - Analytics

Twitch

San Francisco, California, United States (On-Site)
3 Months ago
Kojima Productions - Game Data Analyst

Kojima Productions

Tokyo, Japan (On-Site)
2 Months ago
PwC - IN-Senior Associate_ ETL Databricks _D&A_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Patterned Learning Career - Lead Software Engineer

Patterned Learning Career

(Remote)
1 Month ago
Tilda Research - UI Software Engineer

Tilda Research

Kolkata, West Bengal, India (Remote)
5 Months ago
PwC - Senior Associate _Senior Azure Data Engineer_D&A_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Viasat - Senior Software Engineer – Test Automation - Python, Robot

Viasat

Hyderabad, Telangana, India (On-Site)
4 Months ago
Safe Security - Software Development Engineer in Test III

Safe Security

Delhi, India (On-Site)
6 Months ago
Xsolla - PHP Backend Developer [Payments]

Xsolla

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
6 Months ago
Ness Digital - Sr Technical Application Architect

Ness Digital

India (On-Site)
3 Months ago
Playrix - Lead QA Engineer (Resources Team)

Playrix

Georgia (Remote)
3 Months ago
McAfee - Lead Python SDET

McAfee

Bengaluru, Karnataka, India (Remote)
4 Months ago
Luxoft - Orchestrade - Azure infrastructure cloud Regular engineer

Luxoft

Poland, Ohio, United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Portugal

Playrix - Lead C++ Software Engineer (Gameplay)

Playrix

Portugal (Remote)
3 Months ago
Playrix - Lead Location Designer

Playrix

Portugal (Remote)
3 Months ago
Playrix - Full Stack QA Engineer

Playrix

Portugal (Remote)
3 Months ago
Playrix - Project Manager

Playrix

Portugal (Remote)
3 Months ago
Nasdaq - Senior Java Engineer

Nasdaq

Lisbon, Lisbon, Portugal (Hybrid)
4 Months ago
FRVR - Senior Product Manager (Krunker)

FRVR

Lisbon, Lisbon, Portugal (On-Site)
2 Months ago
Playrix - Support Engineer (Automation)

Playrix

Portugal (Remote)
3 Months ago
Miniclip - Server Developer

Miniclip

Lisbon, Lisbon, Portugal (Hybrid)
3 Months ago
Luxoft - Senior/Lead DevOps Engineer

Luxoft

Coimbra, Coimbra, Portugal (Remote)
2 Months ago
Token Metrics - Crypto Senior Full Stack Developer (Lisbon-Remote)

Token Metrics

Lisbon, Lisbon, Portugal (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

SciPlay - Director of Analytics

SciPlay

Cedar Falls, Iowa, United States (Hybrid)
2 Months ago
Google - Senior Engineering Analyst, Google One

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Oceaneering - Principal Data Scientist

Oceaneering

Chandigarh, Chandigarh, India (Hybrid)
3 Months ago
Luxoft - Senior Data Ops Engineer

Luxoft

Poland, Ohio, United States (Remote)
2 Months ago
VeVe - Data Analyst

VeVe

(Remote)
1 Month ago
Life church - Director of Analytics and Decision Support

Life church

Edmond, Oklahoma, United States (On-Site)
4 Months ago
DEVOTEAM - Data Driven | Data Engineer

DEVOTEAM

(Remote)
3 Months ago
PlayStation Global - Senior Security Analyst-Data Governance

PlayStation Global

Carlsbad, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Explore gaming industy jobs in one of the leading Game Studios.

View All Jobs

Get notified when new jobs are added by Playrix

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug