Staff Engineer (Big Data)

3 Months ago • 7 Years + • DevOps

Job Summary

Job Description

We are looking for a Staff Engineer (Big Data) with 7+ years of experience to join our team. You will be responsible for understanding the client’s business use cases and technical requirements, translating them into technical designs, and developing the overall solution for defined functional and non-functional requirements. You will also be responsible for identifying different solutions, narrowing down the best option, defining guidelines and benchmarks, writing and reviewing design documents, and resolving issues that are raised during code/review.
Must have:
  • Experience with Hadoop, Hive, Spark with Scala
  • Performance tuning and debugging
  • Stream processing with Spark/Java Kafka
  • Integration with REST APIs
  • Functional programming and OOP concepts
  • SOLID principles and design patterns
  • Maven
  • ScalaTest for unit and integration tests
  • Version control system - GitHub
  • CI/CD pipeline - Jenkins
  • Shell scripting
  • Oozie
Good to have:
  • Airflow
  • Databricks
  • Azure
  • Splunk

Job Details

Company Description

👋🏼We're Nagarro.

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 36 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That's where you come in!

Job Description

REQUIREMENTS:

  • Experience: 7+ Years
  • Excellent in Hadoop, Hive, Spark with Scala with demonstrable hands-on experience in performance tuning and debugging issues
  • Good knowledge on stream processing Spark/Java Kafka, integration with REST APIs
  • Good knowledge in Functional programming and OOP concepts, SOLID principles, design patterns for developing scalable applications in Data Engineering
  • Familiarity with build tools like Maven
  • Must have experience writing unit and integration tests using ScalaTest
  • Must have experience using any versioning control system - GitHub
  • Must have experience with CI/CD pipeline – Jenkins
  • Shell scripting, Oozie

Good to Have Skills:

  • Airflow, Databricks, Azure, Splunk

 

RESPONSIBILITIES:

  • Understanding the client’s business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements.
  • Mapping decisions with requirements and be able to translate the same to developers.
  • Identifying different solutions and being able to narrow down the best option that meets the client’s requirements.
  • Defining guidelines and benchmarks for NFR considerations during project implementation
  • Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers
  • Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed.
  • Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it
  • Understanding and relating technology integration scenarios and applying these learnings in projects
  • Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.
  • Carrying out POCs to make sure that suggested design/technologies meet the requirements.

Qualifications

Bachelor’s or master’s degree in computer science, Information Technology, or a related field.

Similar Jobs

Playrix - Director of Engineering

Playrix

Almaty, Almaty Region, Kazakhstan (Remote)
3 Months ago
Playrix - Technical Director (Game Project)

Playrix

Almaty, Almaty Region, Kazakhstan (Remote)
3 Months ago
Fluence - Staff Data Engineer

Fluence

Alpharetta, Georgia, United States (Hybrid)
3 Months ago
Microsoft - ROP - Senior Software Engineer (Azure Firewall)

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Month ago
Head Digital Works - Software Development Engineer II

Head Digital Works

Hyderabad, Telangana, India (On-Site)
3 Months ago
Aristocrat Gaming - Senior Systems Reliability Engineer (SRE)

Aristocrat Gaming

Austin, Texas, United States (Hybrid)
2 Weeks ago
SmileGate - SRE Strategy PM

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
3 Weeks ago
Tencent - Version management 游戏版本管理

Tencent

Shenzhen, Guangdong Province, China (On-Site)
3 Months ago
Luxoft - Siebel L2 Support Consultant

Luxoft

New Delhi, Delhi, India (Remote)
2 Months ago
Magna International - Senior Cloud Engineer

Magna International

Bengaluru, Karnataka, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Zoox - Staff/Senior Staff Software Platform Engineer

Zoox

Foster City, California, United States (Hybrid)
3 Months ago
Nintendo - Associate Software Engineer

Nintendo

Redmond, Washington, United States (Hybrid)
2 Weeks ago
ION - Software Developer/Engineer - Graduate Development Program

ION

Milan, Lombardy, Italy (On-Site)
3 Months ago
The Walt Disney Company - Sr. Principal Software Engineer - Identity

The Walt Disney Company

New York, New York, United States (On-Site)
1 Month ago
Nagarro - Senior Staff Engineer, Java Fullstack

Nagarro

India (Remote)
3 Months ago
Netflix - Data Engineer (L5) - Commerce Product Data Engineering

Netflix

United States (Remote)
1 Week ago
Sonar Source - Staff Software Engineer (Java)

Sonar Source

Austin, Texas, United States (Hybrid)
3 Months ago
The Walt Disney Company - Principal Machine Learning Engineer, Research - Ad Platforms

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Months ago
Microsoft - Senior Software Engineer

Microsoft

(On-Site)
1 Month ago
GoTo Group - Senior Software Engineer - Data Science Platform

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Gamut HR Solutions - 2D and 3D Designers

Gamut HR Solutions

Hyderabad, Telangana, India (On-Site)
4 Months ago
FM - Consultant Engineer

FM

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Paytm - Talent Acquisition  Lead  (Volume Hiring )  -  Manager

Paytm

Chennai, Tamil Nadu, India (On-Site)
2 Months ago
Meltwater - Search Backend Software Engineer Lead

Meltwater

Hyderabad, Telangana, India (Hybrid)
4 Months ago
PwC - AES SAP ACM Manager - Operate

PwC

Hyderabad, Telangana, India (On-Site)
3 Months ago
Morning Star - Senior Quant Analyst

Morning Star

Mumbai, Maharashtra, India (Hybrid)
4 Months ago
Western Digital - IN - Technologist, Firmware Engineering

Western Digital

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Scopely - General Manager, Looney Tunes World of Mayhem

Scopely

Bengaluru, Karnataka, India (On-Site)
6 Days ago
PwC - IN-Manager_ Data Modeler _D&A_Advisory_Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
3 Months ago
PwC - IN_Manager -SAP BWHana_Advisory-D&A_Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Warner Bros Discovery - Staff Software Engineer - AWS Architecture (Observability Team),Bangalore

Warner Bros Discovery

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Sigma Software - Senior Java Developer

Sigma Software

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Months ago
Microsoft - Service Engineer

Microsoft

Dublin, County Dublin, Ireland (On-Site)
2 Weeks ago
Nagarro - Associate Principal Engineer, DevOps

Nagarro

India (Remote)
3 Months ago
Nagarro - Senior Staff Engineer - Python Full Stack

Nagarro

Colombia (Remote)
1 Month ago
Microsoft - (Senior) Software Engineer

Microsoft

(On-Site)
1 Month ago
AbZorba Games  - Dev Ops Engineer

AbZorba Games

Attica, Indiana, United States (Remote)
5 Months ago
Next Level Business Services - Sr. Big Data Engineer in San Francisco, CA  / McLean, VA

Next Level Business Services

San Francisco, California, United States (On-Site)
3 Months ago
Qualys - Cloud Security Engineer

Qualys

Pune, Maharashtra, India (On-Site)
3 Months ago
PwC - Manager - Dev Ops lead (Risk Services)

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded