Senior Data Engineer

2 Months ago • 5 Years + • Data Analyst

Job Summary

Job Description

Senior Azure Data Engineer needed to design, implement, and test cloud computing solutions using ADF, ADB, ADL, and Snowflake. Responsibilities include creating, monitoring, and optimizing ETL/ELT processes; migrating on-premises solutions to the cloud; designing features for identity and access management; solving performance and scalability issues; building, monitoring, and optimizing ETL/ELT processes; data integration with third-party tools; and managing data models and architecture. Requires 5+ years of experience with Azure Data Lake, Snowflake, Azure Databricks, ETL, Azure Data Factory, SQL, data modeling, and various ETL tools. Experience with Hadoop, Spark, and other warehousing tools is a plus.
Must have:
  • 5+ years experience
  • Azure Data Lake, Snowflake, Databricks, ADF
  • ETL/ELT process optimization
  • SQL, Data Modeling
  • Cloud migration experience
  • Performance tuning
  • Third-party tool integration
Good to have:
  • Hadoop
  • Oracle
  • Python, Java, JavaScript

Job Details

Project description

We are looking for a Senior Azure Data Engineer who can perform the design, implementation, and testing of cloud computing solutions using ADF, ADB, ADL, and Snowflake technology, creating, monitoring, and optimizing ETL/ELT processes, and migrating solutions from on-premises to public cloud platforms.
Should have Knowledge of SQL language and cloud-based technologies, Data warehousing concepts, and data modeling. metadata management. Experience Migration to AWS or Azure Snowflake platform, Azure data factory, and Azure data lake. Performance tuning and setting up resource monitors.

Responsibilities

Create, test, and implement enterprise-level apps with Snowflake, ADF, ADB, ADL etc

Design and implement features for identity and access management

Create authorization frameworks for better access control

Solve performance issues and scalability issues in the system

Transaction management with distributed data processing algorithms

Possess ownership right from start to finish

Build, monitor, and optimize ETL and ELT processes with data models

Migrate solutions from on-premises setup to cloud-based platforms

Understand and implement the latest delivery approaches based on data architecture

Project documentation and tracking based on understanding user requirements

Perform data integration with third-party tools including architecting, designing, coding, and testing phases

Manage documentation of data models, architecture, and maintenance processes

Continually review and audit data models for enhancement

Maintenance of ideal data pipeline based on ETL tools.

Coordination with BI experts and analysts for customized data models and integration

Code updates, new code development, and reverse engineering

Performance tuning, user acceptance training, and application support

Maintain confidentiality of data

Risk assessment, management, and mitigation plans

Regular engagement with teams for status reporting and routine activities

Migration activities from one database to another or on-premises to cloud

Skills

Must have

5+ years of experience Microsoft Azure Data Lake, SnowFlake, Microsoft Azure Databricks, ETL, Microsoft Azure Data Factory, Analytical Skills, SQL, Data Modeling

Snowflake modeling

roles, databases, schemas

SQL performance measuring, query tuning, and database tuning

ETL tools with cloud-driven skills

Integration with third-party tools

Ability to build analytical solutions and models.

Coding in languages like Python, Java, JavaScript

Root cause analysis of models with solutions

Hadoop, Spark, and other warehousing tools

Managing sets of XML, JSON, and CSV from disparate sources

SQL-based databases like Oracle SQL Server, Teradata, etc.

Snowflake warehousing, architecture, processing, administration

Data ingestion into Snowflake

Enterprise-level technical exposure to Snowflake applications

Nice to have

Hadoop, Oracle

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

Sony India Software Centre - MS Dynamics F&O Tech Lead

Sony India Software Centre

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Eneba Games - Data Engineer

Eneba Games

Lithuania (Remote)
1 Week ago
CloudHire - Anaplan Sales Expert (Base + Commision)

CloudHire

Dallas, Texas, United States (On-Site)
3 Months ago
ION - Senior DevSecOps Engineer, Italy

ION

Milan, Lombardy, Italy (On-Site)
3 Months ago
PwC - IN-Associate_Full Stack Developer(Node JS)_MS Engg_Advisory_Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
3 Months ago
Blizzard Entertainment - Senior Data Analyst

Blizzard Entertainment

Barcelona, Catalonia, Spain (On-Site)
2 Months ago
bosh group india - Data Engineer--Scala development

bosh group india

Bengaluru, Karnataka, India (On-Site)
1 Month ago
PwC - Associate

PwC

Pune, Maharashtra, India (On-Site)
4 Months ago
CloudHire - Senior Database Engineer

CloudHire

Delhi, India (Remote)
3 Months ago
Onehouse - Data Infrastructure Engineer (India)

Onehouse

Bengaluru, Karnataka, India (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Microsoft - Software Engineer

Microsoft

Hyderabad, Telangana, India (On-Site)
3 Weeks ago
C3 AI - Solution Engineer

C3 AI

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Tencent - Senior Site Reliability Engineer

Tencent

Shanghai, Shanghai, China (On-Site)
4 Months ago
Riot Games - Principal Technical Product Manager - Data Analytics

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago
Hitachi - Microsoft Dynamics AX Technical Consultant (D365 F&O)

Hitachi

India (Remote)
3 Months ago
Crimson Games LLC - Unity Game Programmer

Crimson Games LLC

India (Remote)
4 Months ago
Rackspace Technology - Cloud - Sales Executive III- Remote- IN (Night Shift)

Rackspace Technology

Gurugram, Haryana, India (Remote)
1 Month ago
Info Stretch - .Net Architect

Info Stretch

Mechanicsburg, Pennsylvania, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in undefined

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analyst Jobs

Animoca Brands - Growth Analyst

Animoca Brands

Hong Kong (Hybrid)
3 Months ago
Tesla - Supply Chain Cost Engineer

Tesla

Berlin, Berlin, Germany (On-Site)
1 Week ago
Thumbtack - Lead Data Scientist, People

Thumbtack

United States (Remote)
1 Month ago
Amgen - Associate Data Scientist

Amgen

Hyderabad, Telangana, India (On-Site)
4 Months ago
ION - Data Associate - Wealthmonitor

ION

Budapest, Hungary (On-Site)
3 Months ago
PwC - IN-Senior Manager_CPG/FMGC_Data &Analytics_Advisory_Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
4 Months ago
ION - Internship - Data Science

ION

Pisa, Tuscany, Italy (On-Site)
3 Months ago
Universal Music - Director, Data Analytics and Research

Universal Music

Nashville, Tennessee, United States (On-Site)
4 Months ago
Tesla - Service and Parts Analytics Manager EMEA

Tesla

North Holland, Netherlands (On-Site)
1 Week ago
Microsoft - Data Science: PhD Internship Opportunities - Mountain View

Microsoft

Mountain View, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Gothenburg, Västra Götaland County, Sweden (On-Site)

New Delhi, Delhi, India (Remote)

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bucharest, Bucharest, Romania (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug