ETL Developer - Python

1 Hour ago • 6 Years + • Data Analyst • DevOps

About the job

Job Description

This role requires a Senior ETL Developer with 6+ years of experience in ETL development, at least 5 years with AWS EMR. Responsibilities include analyzing existing SAS DI pipelines and SQL transformations, translating SAS SQL logic into Python using frameworks like Pyspark, developing and maintaining scalable ETL pipelines on AWS EMR, implementing data transformation, cleansing, and aggregation, designing modular code for distributed data processing, integrating EMR jobs with AWS S3, Snowflake, and Tableau, and developing Tableau reports. The ideal candidate will have proficiency in Python, SQL, and experience with ETL tools (e.g., SAS DI, Informatica), along with hands-on experience with AWS services (EMR, S3, IAM, VPC, Glue), and familiarity with data storage systems like Snowflake or RDS. Excellent communication and problem-solving skills are essential.
Must have:
  • 6+ years ETL development experience (5+ years with AWS EMR)
  • Proficiency in Python for data processing
  • Proficient in SQL and ETL tools (SAS DI, Informatica)
  • AWS experience: EMR, S3, IAM, VPC, Glue
  • Snowflake or RDS familiarity
  • Excellent communication and problem-solving skills
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.
Project description

We are looking for the star Python Developer who is not afraid of work and challenges! Gladly becoming a partner with famous financial institution, we are gathering a team of professionals with wide range of skills to successfully deliver business value to the client.

Responsibilities

Analyse existing SAS DI pipelines and SQL-based transformations.

Translate and optimize SAS SQL logic into Python code using frameworks such as Pyspark.

Develop and maintain scalable ETL pipelines using Python on AWS EMR.

Implement data transformation, cleansing, and aggregation logic to support business requirements.

Design modular and reusable code for distributed data processing tasks on EMR clusters.

Integrate EMR jobs with upstream and downstream systems, including AWS S3, Snowflake, and Tableau.

Develop Tableau reports for business reporting.

Skills

Must have

6+ years of experience in ETL development, with at least 5 years working with AWS EMR.

Bachelor's degree in Computer Science, Data Science, Statistics, or a related field.

Proficiency in Python for data processing and scripting.

Proficient in SQL and experience with one or more ETL tools (e.g., SAS DI, Informatica)/.

Hands-on experience with AWS services: EMR, S3, IAM, VPC, and Glue.

Familiarity with data storage systems such as Snowflake or RDS.

Excellent communication skills and ability to work collaboratively in a team environment.

Strong problem-solving skills and ability to work independently.

Nice to have

N/A

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Bengaluru, Karnataka, India (On-Site)

New Delhi, Delhi, India (Remote)

New Delhi, Delhi, India (Remote)

New Delhi, Delhi, India (Remote)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Brazil, Indiana, United States (Remote)

Mexico City, Mexico City, Mexico (Remote)

View All Jobs

Get notified when new jobs are added by Luxoft

Similar Jobs

Paypal - Sr. Software Machine Learning Engineer

Paypal, United States (Hybrid)

Paytm - Java Backend Developer

Paytm, India (On-Site)

CrashPlan - Senior Software Engineer

CrashPlan, India (On-Site)

Ziff Davis - Site Reliability Engineer II

Ziff Davis, United States (Remote)

Warner Bros Discovery - Data Engineer

Warner Bros Discovery, India (On-Site)

CloudHire - Senior Database Engineer

CloudHire, India (Remote)

Poppulo - Senior Data Scientist

Poppulo, India (Hybrid)

SuperPlay - Business Data Analyst

SuperPlay, Israel (On-Site)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Trend Micro - Inside Regional Account Manager

Trend Micro, Australia (On-Site)

Ajmera Infotech - Sr. Backend Engineer - Node Expert

Ajmera Infotech, India (On-Site)

Sporty Group - Technical Director

Sporty Group, (Remote)

CloudHire - Fullstack Developer - Remote - India

CloudHire, India (On-Site)

Wildlife Studios - IT Cloud Planning Analyst

Wildlife Studios, Brazil (On-Site)

Hedra - Lead Product Engineer

Hedra, United States (On-Site)

Hacksaw Studios - Game Client Framework Developer

Hacksaw Studios, Sweden (Remote)

Zuru - Data Engineer

Zuru, New Zealand (On-Site)

Kenvue - APPLICATION SECURITY MANAGER

Kenvue, India (On-Site)

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Quidich Innovation Labs - Senior Manager - Engineering - Broadcast

Quidich Innovation Labs, India (On-Site)

Nisum - Senior SRE Engineer - W6368

Nisum, India (Hybrid)

Sartorius - Senior Developer Frontend

Sartorius, India (Hybrid)

CAE - Senior Software Engineer

CAE, India (On-Site)

Pronto Networks,  Inc  - Ruby on Rails Developer

Pronto Networks, Inc , India (Hybrid)

Publicis Groupe - Brand Strategy Director

Publicis Groupe, India (On_site)

Signify - Digital Architect (UI/UX)

Signify, India (On-Site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Enphase Energy - Pricing Analyst

Enphase Energy, India (On-Site)

10times - Data Scientist

10times, India (On-Site)

New York Times - Technical Product Manager II, Data Platforms

New York Times, United States (On-Site)

Jam City - Product Manager

Jam City, Uruguay (On-Site)

Dynamics - Business Analyst

Dynamics, United States (On-Site)

Ness Digital - IT Business analyst

Ness Digital, Slovakia (Hybrid)

Barbaricum - Systems Architect

Barbaricum, United States (Hybrid)

Moonbug Entertainment - Digital Media Analyst (4 Month Contract)

Moonbug Entertainment, United States (On-Site)

The Walt Disney Company - Lead Data Scientist

The Walt Disney Company, United States (On-Site)

Get notifed when new similar jobs are uploaded