Community

Home >

Jobs >

Azure Data Engineer

Delhi, India (Remote)

Azure Data Engineer

1 Month ago • All levels • DevOps

About the job

7 skills required for this role

Add these skills to join the top 1% applicants for this job

github-actions

ci-cd

github

spark

azure

python

sql

Job Description

This role requires an experienced Azure Data Engineer to design, develop, and maintain scalable data solutions on the Azure Cloud Platform. Responsibilities include building data pipelines using Azure Databricks, SQL Server, Azure Machine Learning, and Azure Blob Storage; utilizing Python and PySpark for data processing; developing ETL/ELT processes; managing data storage; and building CI/CD pipelines using GitHub Actions. The ideal candidate will have strong data engineering skills and proficiency in software engineering principles.

Must have:

Azure Databricks, SQL Server, Azure ML, Blob Storage
Python & PySpark
Data pipelines, ELT, data modeling
CI/CD, unit testing

Good to have:

Azure or Google Cloud certifications
Machine learning integration
Apache Spark experience

Project description

We are seeking an experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with extensive experience working on the Azure Cloud Platform. You will be responsible for designing, developing, and maintaining scalable data solutions, ensuring the availability, reliability, and performance of our data infrastructure.

Responsibilities

Design, develop, and implement scalable data pipelines using Azure Databricks, SQL Server, Azure Machine Learning, and Azure Blob Storage.

Utilize programming languages like Python and PySpark for data processing and transformation tasks.

Develop and maintain ETL/ELT processes to load data from various sources into Azure-based data storage solutions.

Manage and optimize data storage solutions within Azure, ensuring data is securely stored and efficiently accessible.

Develop and maintain CI/CD pipelines using GitHub Actions for automated deployment of data solutions.

Skills

Must have

Azure Databricks, SQL Server, Azure Machine Learning, and Azure Blob Storage.

Python and PySpark.

Knowledge of data engineering concepts, including data pipelines, ELTs, data modeling, and object storage.

Proficient in software engineering principles, including continuous integration, deployment, and unit testing.

Nice to have

Certifications in Azure or Google Cloud.

Experience with machine learning integration into data pipelines.

Familiarity with other data processing technologies like Apache Spark.

Other

Languages

English: B2 Upper Intermediate

Seniority

Regular

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%

About The Company

Luxoft

1148 Active Jobs

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.