Senior Data Engineer

2 Months ago • 5 Years + • Data Analyst

Job Summary

Job Description

Senior Azure Data Engineer needed to design, implement, and test cloud computing solutions using ADF, ADB, ADL, and Snowflake. Responsibilities include creating, monitoring, and optimizing ETL/ELT processes; migrating on-premises solutions to the cloud; designing features for identity and access management; solving performance and scalability issues; managing transactions with distributed data processing algorithms; building, monitoring, and optimizing ETL/ELT processes; and performing data integration with third-party tools. The role requires expertise in SQL, data modeling, metadata management, and cloud-based technologies. Experience with Azure Data Factory, Azure Data Lake, and Snowflake is essential.
Must have:
  • 5+ years experience
  • Azure Data Lake, Snowflake, Azure Databricks
  • ETL, Azure Data Factory, SQL
  • Data Modeling, Analytical Skills
  • SQL performance tuning
  • Integration with third-party tools
  • Python, Java, JavaScript
  • Hadoop, Spark
Good to have:
  • Hadoop
  • Oracle

Job Details

Project description

We are looking for a Senior Azure Data Engineer who can perform the design, implementation, and testing of cloud computing solutions using ADF, ADB, ADL, and Snowflake technology, creating, monitoring, and optimizing ETL/ELT processes, and migrating solutions from on-premises to public cloud platforms.
Should have Knowledge of SQL language and cloud-based technologies, Data warehousing concepts, and data modeling. metadata management. Experience Migration to AWS or Azure Snowflake platform, Azure data factory, and Azure data lake. Performance tuning and setting up resource monitors.

Responsibilities

Create, test, and implement enterprise-level apps with Snowflake, ADF, ADB, ADL etc

Design and implement features for identity and access management

Create authorization frameworks for better access control

Solve performance issues and scalability issues in the system

Transaction management with distributed data processing algorithms

Possess ownership right from start to finish

Build, monitor, and optimize ETL and ELT processes with data models

Migrate solutions from on-premises setup to cloud-based platforms

Understand and implement the latest delivery approaches based on data architecture

Project documentation and tracking based on understanding user requirements

Perform data integration with third-party tools including architecting, designing, coding, and testing phases

Manage documentation of data models, architecture, and maintenance processes

Continually review and audit data models for enhancement

Maintenance of ideal data pipeline based on ETL tools.

Coordination with BI experts and analysts for customized data models and integration

Code updates, new code development, and reverse engineering

Performance tuning, user acceptance training, and application support

Maintain confidentiality of data

Risk assessment, management, and mitigation plans

Regular engagement with teams for status reporting and routine activities

Migration activities from one database to another or on-premises to cloud

Skills

Must have

5+ years of experience Microsoft Azure Data Lake, SnowFlake, Microsoft Azure Databricks, ETL, Microsoft Azure Data Factory, Analytical Skills, SQL, Data Modeling

Snowflake modeling

roles, databases, schemas

SQL performance measuring, query tuning, and database tuning

ETL tools with cloud-driven skills

Integration with third-party tools

Ability to build analytical solutions and models.

Coding in languages like Python, Java, JavaScript

Root cause analysis of models with solutions

Hadoop, Spark, and other warehousing tools

Managing sets of XML, JSON, and CSV from disparate sources

SQL-based databases like Oracle SQL Server, Teradata, etc.

Snowflake warehousing, architecture, processing, administration

Data ingestion into Snowflake

Enterprise-level technical exposure to Snowflake applications

Nice to have

Hadoop, Oracle

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

Arrise Solutions (India)   - Data Scientist - Recommender S/m's

Arrise Solutions (India)

Hyderabad, Telangana, India (On-Site)
4 Months ago
Bounteous - Product Manager, B2B

Bounteous

Bernards, New Jersey, United States (Hybrid)
3 Months ago
InMobiInMobi - SDE III - Devops

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Unity - Senior Site Reliability Developer

Unity

Montreal, Quebec, Canada (On-Site)
4 Months ago
Actian - Sustenance Engineer - Actian Data Platform - Bangalore/Pune

Actian

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Beghou Consulting - Lead Digital Marketing Analyst

Beghou Consulting

Pune, Maharashtra, India (On-Site)
3 Months ago
Luxoft - Senior Data Ops Engineer

Luxoft

Delhi, India (On-Site)
2 Months ago
bosh group india - Data Engineer--Scala development

bosh group india

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Equivalent Jobs - SENIOR FINANCIAL DATA SYSTEMS ENGINEER

Equivalent Jobs

(Remote)
2 Months ago
Bally's Interactive - Analyst - People Analytics

Bally's Interactive

London, England, United Kingdom (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

N-iX - Data Engineer (Databricks) (#2168)

N-iX

Romania (Remote)
3 Months ago
CloudLinux - IT Intern for CloudImages Team (remote-only opportunity, location - Europe&CIS)

CloudLinux

Tbilisi, Tbilisi, Georgia (Remote)
2 Months ago
Haptic - Senior DevOps Engineer

Haptic

Paris, Île-de-France, France (Remote)
1 Month ago
Microsoft - Principal Software Engineer Manager

Microsoft

Redmond, Washington, United States (Hybrid)
2 Weeks ago
Zuora - Senior Data Scientist

Zuora

Chennai, Tamil Nadu, India (Hybrid)
3 Months ago
PwC - Senior Associate_Snowflake Developer_Data & Analytics_Advisory_PAN  India

PwC

Kolkata, West Bengal, India (On-Site)
4 Months ago
Skillz - Lead Web Full Stack Engineer (Las Vegas)

Skillz

Las Vegas, Nevada, United States (On-Site)
2 Weeks ago
Microsoft - Software Engineer - Fullstack

Microsoft

Dublin, County Dublin, Ireland (On-Site)
1 Month ago
Enphase Energy - Sr. Staff Engineer - Enlighten Cloud Backend

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Unity - Senior Data Infrastructure Developer

Unity

Montreal, Quebec, Canada (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Poland, Ohio, United States

CD PROJEKT RED - Engineering Director, Network

CD PROJEKT RED

Boston, Massachusetts, United States (On-Site)
6 Months ago
Bally's Interactive - Platform Architect

Bally's Interactive

Malta, New York, United States (On-Site)
1 Month ago
Salesforce - Solution Consultant/Senior Solution Consultant- Public Sector

Salesforce

Virginia, United States (Remote)
2 Months ago
DraftKings - Senior CRM QA Associate

DraftKings

Boston, Massachusetts, United States (On-Site)
1 Week ago
Netflix - Senior Software Engineer (L5) - Client Delivery Platform

Netflix

United States (Remote)
9 Hours ago
The Walt Disney Company - Disney Entertainment Content Analytics Graduate Intern

The Walt Disney Company

Burbank, California, United States (On-Site)
1 Day ago
The Walt Disney Company - Lead Software Engineer, Machine Learning - Ad Platforms

The Walt Disney Company

Seattle, Washington, United States (On-Site)
2 Months ago
Netflix - Senior Manager, Food & Beverage

Netflix

Los Angeles, California, United States (On-Site)
3 Weeks ago
Life church - Product Marketing Strategist

Life church

Edmond, Oklahoma, United States (On-Site)
3 Months ago
Riot Games - Game Designer II - Teamfight Tactics, Events

Riot Games

Los Angeles, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Make - Senior Data Engineer

Make

Prague, Czechia (Hybrid)
1 Month ago
Equivalent Jobs - QUANTITATIVE ANALYST

Equivalent Jobs

(Remote)
2 Months ago
Inxite Out - Senior Data Scientist - NLP

Inxite Out

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Plarium - Business Product Analyst

Plarium

Herzliya, Tel Aviv District, Israel (Hybrid)
1 Day ago
Netflix - Data Engineer (L5) - Data Systems Product

Netflix

United States (Remote)
3 Months ago
InvenioLSI - SAP Analytics SEM

InvenioLSI

New Delhi, Delhi, India (On-Site)
1 Month ago
PlayStation Global - Lead Analyst, Digital Analytics & Monetization

PlayStation Global

Aliso Viejo, California, United States (Hybrid)
5 Days ago
Thumbtack - Senior Data Scientist, Operations

Thumbtack

United States (Remote)
6 Days ago
Easy Brain - Data Scientist

Easy Brain

Limassol, Limassol, Cyprus (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Gothenburg, Västra Götaland County, Sweden (On-Site)

New Delhi, Delhi, India (Remote)

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bucharest, Bucharest, Romania (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug