Jobs

Scholarships

Courses

Companies

Placements

Community

Home >

Jobs >

Senior Data Engineer

Ohio, United States (Remote)

Senior Data Engineer

1 Month ago • 5 Years + • Data Analyst

About the job

15 skills required for this role

Add these skills to join the top 1% applicants for this job

azure

sql

microsoft-azure

hadoop

oracle

java

javascript

algorithms

spark

aws

python

json

xml

scalability

risk-assessment

Job Description

Senior Azure Data Engineer needed to design, implement, and test cloud computing solutions using ADF, ADB, ADL, and Snowflake. Responsibilities include creating, monitoring, and optimizing ETL/ELT processes; migrating on-premises solutions to the cloud; designing features for identity and access management; solving performance and scalability issues; managing transactions with distributed data processing algorithms; building, monitoring, and optimizing ETL/ELT processes; and performing data integration with third-party tools. The role requires expertise in SQL, data modeling, metadata management, and cloud-based technologies. Experience with Azure Data Factory, Azure Data Lake, and Snowflake is essential.

Must have:

5+ years experience
Azure Data Lake, Snowflake, Azure Databricks
ETL, Azure Data Factory, SQL
Data Modeling, Analytical Skills
SQL performance tuning
Integration with third-party tools
Python, Java, JavaScript
Hadoop, Spark

Good to have:

Hadoop
Oracle

Project description

We are looking for a Senior Azure Data Engineer who can perform the design, implementation, and testing of cloud computing solutions using ADF, ADB, ADL, and Snowflake technology, creating, monitoring, and optimizing ETL/ELT processes, and migrating solutions from on-premises to public cloud platforms.
Should have Knowledge of SQL language and cloud-based technologies, Data warehousing concepts, and data modeling. metadata management. Experience Migration to AWS or Azure Snowflake platform, Azure data factory, and Azure data lake. Performance tuning and setting up resource monitors.

Responsibilities

Create, test, and implement enterprise-level apps with Snowflake, ADF, ADB, ADL etc

Design and implement features for identity and access management

Create authorization frameworks for better access control

Solve performance issues and scalability issues in the system

Transaction management with distributed data processing algorithms

Possess ownership right from start to finish

Build, monitor, and optimize ETL and ELT processes with data models

Migrate solutions from on-premises setup to cloud-based platforms

Understand and implement the latest delivery approaches based on data architecture

Project documentation and tracking based on understanding user requirements

Perform data integration with third-party tools including architecting, designing, coding, and testing phases

Manage documentation of data models, architecture, and maintenance processes

Continually review and audit data models for enhancement

Maintenance of ideal data pipeline based on ETL tools.

Coordination with BI experts and analysts for customized data models and integration

Code updates, new code development, and reverse engineering

Performance tuning, user acceptance training, and application support

Maintain confidentiality of data

Risk assessment, management, and mitigation plans

Regular engagement with teams for status reporting and routine activities

Migration activities from one database to another or on-premises to cloud

Skills

Must have

5+ years of experience Microsoft Azure Data Lake, SnowFlake, Microsoft Azure Databricks, ETL, Microsoft Azure Data Factory, Analytical Skills, SQL, Data Modeling

Snowflake modeling

roles, databases, schemas

SQL performance measuring, query tuning, and database tuning

ETL tools with cloud-driven skills

Integration with third-party tools

Ability to build analytical solutions and models.

Coding in languages like Python, Java, JavaScript

Root cause analysis of models with solutions

Hadoop, Spark, and other warehousing tools

Managing sets of XML, JSON, and CSV from disparate sources

SQL-based databases like Oracle SQL Server, Teradata, etc.

Snowflake warehousing, architecture, processing, administration

Data ingestion into Snowflake

Enterprise-level technical exposure to Snowflake applications

Nice to have

Hadoop, Oracle

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%

About The Company

Luxoft

1110 Active Jobs

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.