Senior Data Engineer

1 Month ago • 5 Years + • Data Analyst

About the job

Job Description

Senior Azure Data Engineer responsible for designing, implementing, and testing cloud computing solutions using ADF, ADB, ADL, and Snowflake. Key responsibilities include creating, monitoring, and optimizing ETL/ELT processes; migrating on-premises solutions to the cloud; building and optimizing data pipelines; ensuring data integrity and security; and collaborating with BI experts. The role requires strong SQL, data modeling, and cloud technologies expertise, with a focus on performance tuning and scalability. Experience with Hadoop, Spark, and various data warehousing tools is highly desirable.
Must have:
  • 5+ years experience
  • Azure Data Lake, Snowflake, Databricks
  • ETL, ADF, SQL, Data Modeling
  • Performance tuning, scalability
  • Cloud migration expertise
  • Data integration with third-party tools
  • Python, Java, JavaScript
Good to have:
  • Hadoop
  • Oracle
Project description

We are looking for a Senior Azure Data Engineer who can perform the design, implementation, and testing of cloud computing solutions using ADF, ADB, ADL, and Snowflake technology, creating, monitoring, and optimizing ETL/ELT processes, and migrating solutions from on-premises to public cloud platforms.
Should have Knowledge of SQL language and cloud-based technologies, Data warehousing concepts, and data modeling. metadata management. Experience Migration to AWS or Azure Snowflake platform, Azure data factory, and Azure data lake. Performance tuning and setting up resource monitors.

Responsibilities

Create, test, and implement enterprise-level apps with Snowflake, ADF, ADB, ADL etc

Design and implement features for identity and access management

Create authorization frameworks for better access control

Solve performance issues and scalability issues in the system

Transaction management with distributed data processing algorithms

Possess ownership right from start to finish

Build, monitor, and optimize ETL and ELT processes with data models

Migrate solutions from on-premises setup to cloud-based platforms

Understand and implement the latest delivery approaches based on data architecture

Project documentation and tracking based on understanding user requirements

Perform data integration with third-party tools including architecting, designing, coding, and testing phases

Manage documentation of data models, architecture, and maintenance processes

Continually review and audit data models for enhancement

Maintenance of ideal data pipeline based on ETL tools.

Coordination with BI experts and analysts for customized data models and integration

Code updates, new code development, and reverse engineering

Performance tuning, user acceptance training, and application support

Maintain confidentiality of data

Risk assessment, management, and mitigation plans

Regular engagement with teams for status reporting and routine activities

Migration activities from one database to another or on-premises to cloud

Skills

Must have

5+ years of experience Microsoft Azure Data Lake, SnowFlake, Microsoft Azure Databricks, ETL, Microsoft Azure Data Factory, Analytical Skills, SQL, Data Modeling

Snowflake modeling

roles, databases, schemas

SQL performance measuring, query tuning, and database tuning

ETL tools with cloud-driven skills

Integration with third-party tools

Ability to build analytical solutions and models.

Coding in languages like Python, Java, JavaScript

Root cause analysis of models with solutions

Hadoop, Spark, and other warehousing tools

Managing sets of XML, JSON, and CSV from disparate sources

SQL-based databases like Oracle SQL Server, Teradata, etc.

Snowflake warehousing, architecture, processing, administration

Data ingestion into Snowflake

Enterprise-level technical exposure to Snowflake applications

Nice to have

Hadoop, Oracle

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

New Delhi, Delhi, India (Remote)

Iași, Iași County, Romania (On-Site)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Bengaluru, Karnataka, India (On-Site)

Chennai, Tamil Nadu, India (On-Site)

United States (Remote)

View All Jobs

Get notified when new jobs are added by Luxoft

Similar Jobs

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PhonePe - Site Reliability Engineer-NetOps

PhonePe, India (On-Site)

Beghou Consulting - Software Developer – Full Stack

Beghou Consulting, India (Hybrid)

Visa - Staff Site Reliability Engineer - Cloud PRE

Visa, United States (On-Site)

The Walt Disney Company - Principal Online Services Developer

The Walt Disney Company, Sweden (Remote)

ARHS - Tester

ARHS, Sweden (On-Site)

Hitachi - Power Platform Developers-Mar 2024

Hitachi, India (On-Site)

Neostella - Quality Assurance Specialist

Neostella, Colombia (Hybrid)

Hitachi Digital Services - Container Security - Expert (Hyderabad, Bangalore, Pune)

Hitachi Digital Services, India (Hybrid)

Ajmera Infotech - Engineering Lead

Ajmera Infotech, India (On-Site)

Get notifed when new similar jobs are uploaded

Jobs in New Delhi, Delhi, India

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Rockstar Games - Senior Data Scientist, GTA+ Subscriptions

Rockstar Games, United States (On-Site)

Optum - Data Scientist

Optum, India (On-Site)

Career Stone Consultant - Manager - Data Engineer

Career Stone Consultant, India (On-Site)

Assystems - Architecte DATA H/F

Assystems, France (Hybrid)

Trailmix Games - Data and Analytics Engineer

Trailmix Games, United Kingdom (Hybrid)

ComeOn Group - Data Engineering Lead

ComeOn Group, Poland (Hybrid)

PhonePe - PSE - Data Engineering

PhonePe, India (On-Site)

bosh group india - AMS-BI-Consultant-Ban

bosh group india, India (On_site)

Get notifed when new similar jobs are uploaded