Senior Data Engineer

1 Month ago • 5 Years + • Data Analyst

About the job

Job Description

Senior Azure Data Engineer needed to design, implement, and test cloud computing solutions using ADF, ADB, ADL, and Snowflake. Responsibilities include creating, monitoring, and optimizing ETL/ELT processes; migrating on-premises solutions to the cloud; designing features for identity and access management; solving performance and scalability issues; building, monitoring, and optimizing ETL/ELT processes; data integration with third-party tools; and managing data models and architecture. Requires 5+ years of experience with Azure Data Lake, Snowflake, Azure Databricks, ETL, Azure Data Factory, SQL, data modeling, and various ETL tools. Experience with Hadoop, Spark, and other warehousing tools is a plus.
Must have:
  • 5+ years experience
  • Azure Data Lake, Snowflake, Databricks, ADF
  • ETL/ELT process optimization
  • SQL, Data Modeling
  • Cloud migration experience
  • Performance tuning
  • Third-party tool integration
Good to have:
  • Hadoop
  • Oracle
  • Python, Java, JavaScript
Project description

We are looking for a Senior Azure Data Engineer who can perform the design, implementation, and testing of cloud computing solutions using ADF, ADB, ADL, and Snowflake technology, creating, monitoring, and optimizing ETL/ELT processes, and migrating solutions from on-premises to public cloud platforms.
Should have Knowledge of SQL language and cloud-based technologies, Data warehousing concepts, and data modeling. metadata management. Experience Migration to AWS or Azure Snowflake platform, Azure data factory, and Azure data lake. Performance tuning and setting up resource monitors.

Responsibilities

Create, test, and implement enterprise-level apps with Snowflake, ADF, ADB, ADL etc

Design and implement features for identity and access management

Create authorization frameworks for better access control

Solve performance issues and scalability issues in the system

Transaction management with distributed data processing algorithms

Possess ownership right from start to finish

Build, monitor, and optimize ETL and ELT processes with data models

Migrate solutions from on-premises setup to cloud-based platforms

Understand and implement the latest delivery approaches based on data architecture

Project documentation and tracking based on understanding user requirements

Perform data integration with third-party tools including architecting, designing, coding, and testing phases

Manage documentation of data models, architecture, and maintenance processes

Continually review and audit data models for enhancement

Maintenance of ideal data pipeline based on ETL tools.

Coordination with BI experts and analysts for customized data models and integration

Code updates, new code development, and reverse engineering

Performance tuning, user acceptance training, and application support

Maintain confidentiality of data

Risk assessment, management, and mitigation plans

Regular engagement with teams for status reporting and routine activities

Migration activities from one database to another or on-premises to cloud

Skills

Must have

5+ years of experience Microsoft Azure Data Lake, SnowFlake, Microsoft Azure Databricks, ETL, Microsoft Azure Data Factory, Analytical Skills, SQL, Data Modeling

Snowflake modeling

roles, databases, schemas

SQL performance measuring, query tuning, and database tuning

ETL tools with cloud-driven skills

Integration with third-party tools

Ability to build analytical solutions and models.

Coding in languages like Python, Java, JavaScript

Root cause analysis of models with solutions

Hadoop, Spark, and other warehousing tools

Managing sets of XML, JSON, and CSV from disparate sources

SQL-based databases like Oracle SQL Server, Teradata, etc.

Snowflake warehousing, architecture, processing, administration

Data ingestion into Snowflake

Enterprise-level technical exposure to Snowflake applications

Nice to have

Hadoop, Oracle

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

New Delhi, Delhi, India (Remote)

Iași, Iași County, Romania (On-Site)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Bengaluru, Karnataka, India (On-Site)

Chennai, Tamil Nadu, India (On-Site)

United States (Remote)

View All Jobs

Get notified when new jobs are added by Luxoft

Similar Jobs

Luxoft - AI Copilot Developer

Luxoft, India (Remote)

Info Stretch - Lead Data Engineer

Info Stretch, India (On-Site)

PwC - Senior Associate - MSOFT - GDC

PwC, India (On-Site)

IGT - Network Engineer III

IGT, United States (On-Site)

Zuru - Data Engineer

Zuru, India (On-Site)

Blitz app - Staff Data Scientist II

Blitz app, United States (Hybrid)

Cognite - Senior Data Engineer

Cognite, India (Hybrid)

Meta - Data Center Energy Analyst

Meta, United States (On-Site)

N-iX - Lead Data Engineer (#2528)

N-iX, United States (Remote)

Social Discovery Group - Senior Product analyst (Virtual gifts service)

Social Discovery Group, Georgia (Remote)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Microsoft - Sr. Director Systems Engineering

Microsoft, Taiwan (On-Site)

Arrow Electronics - Senior Cloud AD Engineer

Arrow Electronics, India (On-Site)

Hitachi - Senior UX Designer

Hitachi, France (On-Site)

Rackspace Technology - Senior DataDog Developer

Rackspace Technology, India (Remote)

Nisum - DevOps Engineer - A6651

Nisum, India (Hybrid)

Keywords Studios (Player Support) - AI Engineer (AI-Powered Agents)

Keywords Studios (Player Support), India (On-Site)

Gaming Innovation Group  - Infrastructure Engineer

Gaming Innovation Group , (Hybrid)

Microsoft - Software Engineer II

Microsoft, United States (On-Site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Anko GCC - Data Scientist

Anko GCC, (Hybrid)

Definitive Healthcare - Data Scientist/Sr. Data Scientist-Data Science-AA&I

Definitive Healthcare, India (On-Site)

LeoVegas - Business Data Analyst - Sportsbook

LeoVegas, United States (On-Site)

GoTo Group - Senior Data Warehouse Engineer

GoTo Group, Indonesia (On-Site)

Evolution - Data Scientist

Evolution, Poland (Hybrid)

Luxoft - PoweBI Consultant

Luxoft, India (Remote)

Interactive Brokers - Data Engineer

Interactive Brokers, Hungary (Hybrid)

Zeta Global - BE Analyst

Zeta Global, India (Hybrid)

Get notifed when new similar jobs are uploaded