Senior Big Data Engineer

1 Month ago • 6 Years + • Data Analyst

Job Summary

Job Description

This Senior Big Data Engineer role involves managing analytics support for key initiatives within a large UK-based investment bank's CCIB portfolio. Responsibilities include ensuring timely, high-quality service delivery, continuous productivity improvement, managing data support for various initiatives, collaborating with technology teams to resolve production issues (data quality, security, refresh timeliness), working with business and technology teams on new functionality/technology integrations, providing analytics support across various business areas (customer acquisition, portfolio management, new product development), managing analysis and reporting across retail products/segments, interacting with metrics owners, providing development opportunities for staff, creating and maintaining optimal data pipeline architecture, assembling large datasets, identifying and implementing internal process improvements (automation, optimization, infrastructure redesign), and performing root cause analysis. The role requires strong analytical skills with unstructured datasets and experience with Hadoop, Hive, HBase, Kafka, Spark, SQL, database and data warehouse building and management, data pipelines, and message queuing.
Must have:
  • 6+ years relevant tech experience
  • Hands-on Hadoop & Big Data tech (Hive, HBase, Kafka, Spark)
  • Strong analytical skills with unstructured datasets
  • Strong SQL experience
  • Database & Data Warehouse building/management
  • Experience with data pipelines and datasets
  • Root cause analysis experience
Good to have:
  • Scala
  • Control M or similar scheduling tool

Job Details

Project description

We've been engaged by a large UK Based Investment Bank in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .

Responsibilities

Ensuring quality service output, submitted in a timely manner and communicated effectively

Continuous Improvement in Productivity to the standards prescribed from time to time

Manage data & information support for all the key initiatives across Retail Bank supporting countries & group teams.

Work closely with technology on solutions to resolve identified production issues which are impacting existing infrastructure /solution covering data quality, data assurance, refresh timeliness, data security governance

To work closely with Business & Technology to review the integration of new functionality / technology implementation projects initiated

Extend analytics support spanning across entire gamut of business (Customer Acquisition, Portfolio Management, New Product Development)

Manage analysis & reporting across all Retail products/segments

Interact with metrics owners across various functions and get end to end understanding of the metrics and applicability of the same across various MI dashboards

Provide development opportunities through regular engagement, ensuring that all staff is aware of the opportunities available in order to help them succeed within their role

Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Skills

Must have

6+ years of relevant technology experience

Hands on Hadoop and Bigdata tech. , HIVE, HBase, Kafka, Spark

Strong analytic skills related to working with unstructured datasets.

Strong experience on SQL

Good Experience on Data Base & Data Ware house building and management

Exposure to data pipelines, architectures and data sets

Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Build processes supporting data transformation, data structures, metadata, dependency and workload management.

Working knowledge of message queuing, stream processing and highly scalable 'big data' data stores.

Nice to have

Scala

Good to have experience in Control M or any other scheduling tool

Other

Languages

English: C2 Proficient

Seniority

Senior

Similar Jobs

Grindr - Staff Backend Engineer

Grindr

Chicago, Illinois, United States (Hybrid)
2 Months ago
PwC - Senior AI Developer - Roma [DIG]

PwC

Rome, Lazio, Italy (On-Site)
4 Months ago
Paytm - Data Engineering -Senior Data Engineer (Ingest)

Paytm

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
Nielsen Holdings - SOFTWARE DEVELOPER - (Backend Developer, Java,Scala, Python, GO lang)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
EXUSIA - Lead Data Engineers – Azure/Databricks/Snowflake

EXUSIA

United States (Remote)
1 Week ago
Keywords Studios (Player Support) - Data Insights Lead - Player Engagement (Quality)

Keywords Studios (Player Support)

Pasig, Metro Manila, Philippines (Hybrid)
2 Days ago
Luxoft - Senior Data Engineer

Luxoft

(Remote)
2 Months ago
PwC - Data Strategy & Governance Consultant - Milano [CNS]

PwC

Milan, Lombardy, Italy (On-Site)
4 Months ago
Neostella - Data Engineer

Neostella

Medellín, Antioquia, Colombia (Hybrid)
3 Months ago
Supercell - Head of Data, Analytics, and Insights

Supercell

Helsinki, Uusimaa, Finland (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

GoTo Group - Senior Data Scientist  (Singapore)

GoTo Group

Singapore (On-Site)
3 Months ago
Appier - Software Engineer, Backend Development

Appier

Taipei City, Taiwan (On-Site)
2 Months ago
Nielsen Holdings - Senior Software Engineer - Scala, Spark, Airflow, Python

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
InMobiInMobi - SDE II - Backend Engineer

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Applike Group - Senior Data Scientist (Recommendation Systems Expert) (f/m/d)

Applike Group

Hamburg, Hamburg, Germany (Hybrid)
3 Months ago
Pro5 AI - Senior Data Scientist

Pro5 AI

India (Remote)
4 Months ago
Evolution - Scala Engineer

Evolution

Lisbon, Lisbon, Portugal (On-Site)
8 Months ago
Nielsen Holdings - STAFF SOFTWARE ENGINEER

Nielsen Holdings

Mumbai, Maharashtra, India (Hybrid)
2 Months ago
Microsoft - Software Engineer (Data Engineering)

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Month ago
NinjaVan - Staff Data Engineer

NinjaVan

Hyderabad, Telangana, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Chennai, Tamil Nadu, India

NVIDIA - Verification Engineer, SOC-V

NVIDIA

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Assystems - Site Mechanical Engineer

Assystems

Bagalkote, Karnataka, India (On-Site)
3 Months ago
Nielsen Holdings - C#, .Net

Nielsen Holdings

Mumbai, Maharashtra, India (Hybrid)
2 Months ago
Broadcom - Backend Physical Design Engineer

Broadcom

Bengaluru, Karnataka, India (On-Site)
4 Months ago
United HR Solutions   - Marketing Manager

United HR Solutions

Ahmedabad, Gujarat, India (On-Site)
4 Months ago
SoundHound AI - Language Specialist, Telugu [Contractor]

SoundHound AI

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
PhonePe - Intern, Financial Services Compliance

PhonePe

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Intel Corporation - Software Application Engineering Manager

Intel Corporation

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
PwC - IN_Senior Associate _GCP Developer _Data &Analytics _Advisory  _Ahmedabad

PwC

Ahmedabad, Gujarat, India (On-Site)
4 Months ago
InMobiInMobi - Manager - Procurement

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Netflix - Data Engineer (L5) - Security

Netflix

United States (Remote)
3 Months ago
IGT - Senior Data Engineer (iGaming)

IGT

Belgrade, Serbia (On-Site)
1 Month ago
OKX - Data Architect

OKX

Singapore, Singapore (On-Site)
3 Months ago
PlayStation Global - Manager - Data Engineering

PlayStation Global

Berlin, Berlin, Germany (Remote)
2 Months ago
SciPlay - Business Intelligence Developer

SciPlay

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
PwC - Starszy Konsultant / Starsza Konsultantka | Ryzyko Rynkowe

PwC

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Months ago
Whatnot - Director, Data Science (Revenue Analytics)

Whatnot

Los Angeles, California, United States (Remote)
3 Months ago
TVH - Data Scientist

TVH

Pune, Maharashtra, India (On-Site)
4 Months ago
Epic Games - Principal Data Scientist

Epic Games

Montreal, Quebec, Canada (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Gothenburg, Västra Götaland County, Sweden (On-Site)

New Delhi, Delhi, India (Remote)

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bucharest, Bucharest, Romania (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug