Senior Data Engineer (#2331)

N-iX is looking for a passionate and motivated Senior Data Engineer to join our team. Our customer is a leading global provider of high-quality licensed images, videos, and music. Our customer helps inspire graphic designers, creative directors, video editors, filmmakers, web developers, and other creative professionals by providing diverse content to businesses, marketing agencies and media organizations around the world. Content creators contribute their work to our client, where end users buy and use it in a diverse array of creative personal and business projects. It's a two-sided marketplace that empowers the world's storytellers. As a Data Engineer you will play a key role in building high volume, customer facing intelligence service across the enterprise. In this role you will be bringing modern data technologies and practices to enable our customers, and internal stakeholders to make effective decisions by providing relevant data products and services. You will work closely with the team and Product Managers to establish clear priorities and milestones.

The day to day responsibilities:


• Build data services in Python with an emphasis on best practices, consistency, performance and scalability.
• Day-to-day operational support of data engineering infrastructure, products and services, including on-call routine.

Requirements:


• 4+ years Python development practice.
• Experience in low latency stream processing technology (Kafka, Spark, Storm, Samza, Flink etc).

• Knowledge of SQL, basic data modelling experience as well as experience with both REST and GraphQL based design patterns.
• Knowledge of and experience with a variety of data stores and an understanding of best practice access patterns and modelling (DynamoDB, RDBMS, columnar data formats etc).
• Exposure to IaC tools like Cloudformation / Terraform.
• CI/CD systems experience (Jenkins, Github Actions, etc).
• AWS cloud experience (EKS, IAM, Lambda, EC2, DynamoDB etc)



Will be a plus:

• 
Hands on experience with Snowflake, DBT, Airflow.
• Sagemaker and MLOps experience.
• Exposure / Experience with Java/Scala or other JVM based language.
• GraphQL experience.
• Exposure to Kubernetes and Helm. 
• Strong expertise/background with Linux