Outscal Logooutscal logo

Big Data Engineer

1 Month ago • 8 Years + • Data Analyst

Job Summary

Job Description

As a Big Data Engineer at Ness, you will design and develop software using cutting-edge technologies like web applications, data pipelines, big data, machine learning, and multi-cloud platforms. Responsibilities include building ingestion pipelines using ELT and schema on read in Databricks Delta Lake, designing data transformations at scale, and working with AWS services (S3, Hive, Databricks). You'll ensure data governance, quality, and lineage, collaborate with data and data science teams, and stay updated on big data and cloud trends. The role requires expertise in Scala, Python, Spark, and experience with high-volume data and computationally intensive systems.
Must have:
  • 8+ years application development experience
  • Experience with AWS (S3, Hive, Databricks)
  • Proficiency in Scala, Python, Spark
  • ELT framework and Delta Lake expertise
  • Data governance and quality implementation
Good to have:
  • Financial industry domain knowledge
  • Experience with Java garbage collection tuning
Perks:
  • Access to trainings and certifications
  • Bonuses and aids
  • Socializing activities
  • Attractive compensation

Job Details

Description

Position at Ness Romania SRL

Why Ness

We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression.

You’ll also benefit from an array of advantages like access to trainings and certifications, bonuses, and aids, socializing activities, and attractive compensation.

Requirements and responsibilities

We are looking for a self-motivated, enthusiastic, and passionate software engineer to develop technology solutions for the Ness marketplace product.

The ideal candidate thrives in a highly technical role and will design and develop software using cutting-edge web applications, data pipelines, big data, machine learning, and multi-cloud technologies.

The development is already underway, so the candidate would be expected to get up to speed quickly and start contributing.

You will enable Ness business to showcase our proprietary Ness data, combine it with “curated” alternative data, further enrich it with value-add services from Kensho and others, and deliver it via the clients’ channel of choice to help them make better investment and business decisions, with confidence.

What you can expect: An unmatched experience in handling huge volumes of data, analytics, visualization, and services over cloud technologies along with appreciation in product development life cycle to convert an idea into revenue generating stream.

What you'll do

  • Design & Build ingestion pipelines using ELT and schema on read in Databricks Delta lake;
  • Design & Develop “Transformations” aspects using ELT framework to modernize the Ingestion pipelines and build data transformations at scale;
  • Provide technical expertise in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark;
  • Build and maintain a data environment for speed, accuracy, consistency, and "up" time;
  • Work closely with other data teams & Data Science team and participate in the development of Ingestion pipelines;
  • Ensure data governance principles are adopted, data quality checks and data lineage are implemented in each hop of the data;
  • Be in tune with emerging trends Big data and cloud technologies and participate in the evaluation of new technologies;
  • Ensure compliance through adopting enterprise standards and promoting best practices/guiding principles aligned with organization standards.

What you'll bring

  • A minimum of 8+ years of significant experience in application development;
  • Previous experience in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark;
  • Development, design, and architecture exposure & the ability to ensure quality across various technology components that are developed by geographically diversified software engineers with superior knowledge of system architecture, object-oriented design, and design patterns;
  • Proficient with software development lifecycle (SDLC) methodologies like Agile and test-driven development;
  • Experience working with high-volume data and computationally intensive systems;
  • Garbage collection friendly programming experience - tuning Java garbage collection & performance is a must;
  • Proficiency in the development environment, including IDE, web & application server, GIT, Continuous Integration, unit-testing tools, and defect management tools Domain knowledge in the Financial Industry and Capital Markets is a plus;
  • Excellent communication skills are essential, with strong verbal and writing proficiencies;
  • Mentor teams, innovate and experiment, give a face to business ideas, and present to key stakeholders.

Not checking every single requirement?

If this role sounds good to you, even if you don’t meet every single bullet point in the job description, we encourage you to apply anyway. For most of the candidates that applied, we found a role that was a very good fit with their skills.

Let’s meet and you may just be the right candidate for one of our roles.

At Ness Digital Engineering we are willing to build a work culture that is based on diversification, inclusion, and authenticity.

Similar Jobs

Blue Yonder - Lead Software Engineer - Performance Engineering

Blue Yonder

Bengaluru, Karnataka, India (On-Site)
5 Months ago
ByteDance - Software Engineer (Payment Network) - Global Payment - Singapore

ByteDance

Singapore (On-Site)
4 Months ago
ByteDance - Relational Database Intern (Data Tech Infra)

ByteDance

San Jose, California, United States (On-Site)
2 Weeks ago
ARHS - Fullstack Developer

ARHS

Liège, Wallonia, Belgium (On-Site)
4 Months ago
N-iX - Senior QA Engineer

N-iX

Poland (Remote)
3 Weeks ago
PwC - IN-Senior Associate_ML Engineer_Data &Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Nielsen Holdings - Sr. Staff Data Engineer

Nielsen Holdings

Gurugram, Haryana, India (Hybrid)
4 Months ago
Peak - Summer Intern, Data Scientist

Peak

(On-Site)
2 Months ago
Mobiloitte - Databricks Certified Data Engineers

Mobiloitte

United States (Remote)
3 Weeks ago
Enphase Energy - Assistant Manager, Business Analytics

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ION - Technical Support Analyst, Chicago - 5849/9555

ION

Chicago, Illinois, United States (On-Site)
5 Months ago
PwC - IN_Manager_ GRC _Risk Analytics _Advisory_Gurugram

PwC

Gurugram, Haryana, India (On-Site)
2 Months ago
The Walt Disney Company - Software Engineer II, Core Media Manufacturing

The Walt Disney Company

New York, New York, United States (On-Site)
3 Months ago
Microsoft - Software Engineer II - Backend

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Month ago
ByteDance - Senior Site Reliability Engineer - Data Infrastructure (Seattle)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
King - Software Engineer Intern

King

Barcelona, Catalonia, Spain (On-Site)
1 Month ago
Rackspace Technology - Google Cloud Engineer IV

Rackspace Technology

Canada (Remote)
1 Month ago
Next Level Business Services - oracle adf developer

Next Level Business Services

Miami, Florida, United States (On-Site)
4 Months ago
Truecaller - Senior Android Engineer

Truecaller

Stockholm, Stockholm County, Sweden (On-Site)
2 Months ago
Luxoft - Senior Java Developer

Luxoft

Zürich, Zurich, Switzerland (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Timișoara, Timiș, Romania

PTW - German Player Support

PTW

Romania (Remote)
3 Months ago
Amazon Games - Software Development Manager, Amazon Games

Amazon Games

Bucharest, Bucharest, Romania (On-Site)
2 Months ago
Ness Digital - Big Data Engineer

Ness Digital

Timișoara, Timiș, Romania (Remote)
6 Days ago
SuperPlay - QA Manual Engineer (Mobile)

SuperPlay

Bucharest, Bucharest, Romania (On-Site)
4 Days ago
Every matrix - Trader Specialist - Lottery

Every matrix

Bucharest, Bucharest, Romania (Hybrid)
18 Hours ago
Amazon Games - Lead Artist, Amazon Games

Amazon Games

Bucharest, Bucharest, Romania (Hybrid)
7 Months ago
Hiporo - Senior Environment Artist, Amazon Games

Hiporo

Romania (Hybrid)
7 Months ago
ASSIST Software - Python Developer

ASSIST Software

Suceava, Suceava County, Romania (Remote)
1 Month ago
Every matrix - Legal Counsel

Every matrix

Bucharest, Bucharest, Romania (Hybrid)
2 Months ago
Ubisoft - Game Designer [Assassin's Creed]

Ubisoft

Bucharest, Bucharest, Romania (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

King - Data Science Intern

King

London, England, United Kingdom (On-Site)
1 Month ago
Fluence - Battery Data Engineer

Fluence

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Wildlife Studios - IT Cloud Planning Analyst

Wildlife Studios

São Paulo, State Of São Paulo, Brazil (On-Site)
2 Months ago
Hawk Eye Innovations - Data Quality Operators

Hawk Eye Innovations

Sofia, Sofia City Province, Bulgaria (On-Site)
1 Month ago
Tencent - Data Engineering Intern

Tencent

(On-Site)
2 Weeks ago
My Fitness Pal - Food Data Curator (Contractor)

My Fitness Pal

United States (Remote)
1 Month ago
PwC - SAP-BODS-Senior Associate-Hyderabad

PwC

Hyderabad, Telangana, India (On-Site)
2 Months ago
Zengame Technology - Advertising Optimization Specialist

Zengame Technology

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
PwC - Data Architect – Technology Consulting

PwC

Prague, Prague, Czechia (On-Site)
5 Months ago
King - Senior Data Scientist

King

Barcelona, Catalonia, Spain (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Iași, Iași County, Romania (Remote)

Timișoara, Timiș, Romania (Remote)

Timișoara, Timiș, Romania (Remote)

Timișoara, Timiș, Romania (Remote)

Iași, Iași County, Romania (Remote)

Pittsburgh, Pennsylvania, United States (Remote)

Iași, Iași County, Romania (Remote)

Timișoara, Timiș, Romania (Remote)

Timișoara, Timiș, Romania (Remote)

Timișoara, Timiș, Romania (Remote)

View All Jobs

Get notified when new jobs are added by Ness Digital

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug