Senior Data Platform Engineer

2 Months ago • 8 Years + • Data Analyst

Job Summary

Job Description

As a Senior Data Platform Engineer at BigID, you'll design, develop, maintain, troubleshoot, and implement the big data architecture. Your expertise in Elastic, Kafka, and Java will be crucial for ensuring scalability and performance. Responsibilities include implementing data processing pipelines using Kafka, optimizing search capabilities with Elastic technologies, collaborating with cross-functional teams to gather requirements, overseeing code reviews, maintaining high-quality standards, staying updated on big data trends, and troubleshooting issues. You will work with both external and internal APIs and SDKs. This role requires a strong understanding of data modeling, ETL processes, data warehousing, and CI/CD principles.
Must have:
  • 8+ years software engineering experience
  • 5+ years big data experience (Elastic, Kafka)
  • Proficiency in Java
  • Data modeling, ETL, data warehousing knowledge
  • CI/CD understanding
  • Problem-solving & analytical skills
Good to have:
  • Docker, Kubernetes experience
  • Cloud platform experience (AWS or Azure)
Perks:
  • Equity participation
  • Flexible work arrangements
  • Dog-friendly office
  • Fully stocked fridge, gym, exercise classes
  • Weekly Happy Hours, free parking, evening meals
  • Knowledge training & career development

Job Details

Who we are:

BigID is an innovative tech startup that focuses on solutions for data security, compliance, privacy, and AI data management. We're leading the market in all things data: helping our customers reduce risk, drive business innovation, achieve compliance, build customer trust, make better decisions, and get more value from their data.

We are building a global team passionate about innovation and next-gen technology. BigID has been recognized for: 

  • BigID Named Hot Company in Artificial Intelligence and Machine Learning at the 2024 Global InfoSec Awards
  • Citizens JMP Cyber 66 List of Hottest Privately Held Cybersecurity Companies
  • CRN 100 list named BIgID as one of the 20 Coolest Identity Access Management And Data Protection Companies Of 2024 (2 years running)
  • DUNS 100 Best Tech Companies to Work For in 2024
  • Top 3 Big Data and AI Vendors to Watch' in the 2023 BigDATAwire Readers and Editors Choice Awards
  • 2024 Inc. 5000 list for the 4th consecutive year!
  • Shortlisted for the 2024 AI Awards in the category of Best Use of AI in Cybersecurity

At BigID, our team is the foundation of our success. Join a people-centric culture that is fast-paced and rewarding: you’ll have the opportunity to work with some of the most talented people in the industry who value innovation, diversity, integrity, and collaboration.

Who we seek:

We’re looking for a Senior Data Platform Engineer to join our Data Platform team. The ideal candidate will have extensive experience with data engineering, specifically with Kafka and Elasticsearch, to design and maintain our data platforms. You will work closely with cross-functional teams to ensure the scalability and reliability of our data solutions.

Job Summary:
As a Senior Data Platform Engineer, you'll be responsible for the design, development, maintenance, troubleshooting, and implementation of our big data architecture. 
Your expertise in Elastic, Kafka, and Java will be critical in ensuring the scalability and performance of our data systems.

What you’ll do:

  • Implement data processing pipelines using Kafka for real-time data streaming.
  • Optimize and manage search capabilities using Elastic technologies.
  • Collaborate with product managers, data analysts, and other stakeholders to gather requirements and translate them into technical specifications.
  • Oversee code reviews, ensure best practices in coding and data handling, and maintain high-quality standards in software development.
  • Stay up-to-date with emerging trends and technologies in big data and recommend improvements to our architecture and processes.
  • Troubleshoot and resolve issues in a timely manner to minimize downtime and ensure system reliability.

What you’ll bring:

  • Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
  • 8+ years of experience in the software engineering field. 
  • 5+ years of experience in big data technologies, with a focus on Elastic and Kafka.
  • Proficiency in Java programming and experience with related frameworks.
  • Strong understanding of data modeling, ETL processes, and data warehousing.
  • Excellent problem-solving abilities and strong analytical skills.
  • A solid understanding of CI/CD principles.
  • Experience working with both external and in-house APIs and SDKs 

Advantages:

  • Experience with Docker, Kubernetes
  • Experience with cloud platforms (e.g., AWS or Azure) 

What’s in it for you?!

Our people are the foundation of our success, and we prioritize offering a wide range of benefits that make our team happier and healthier.

  • Equity participation - everyone shares in our success
  • Flexible work arrangements - for parents, for remote workdays, etc.
  • Office perks: dog-friendly environment, fully stocked fridge, gym, and exercise classes, weekly Happy Hours, free parking, evening meals
  • Knowledge training & Career development tracks

Our Values:

We look for people who embody our values - Care, Do, Try & Shine.

  • Care - We care about our customers and each other
  • Do - We do what it takes to make a positive impact
  • Try- We try our best and we don’t give up
  • Shine- We shine and make it our mission to always stand out

#LI-Hybrid

#LI-AT1

BigDiversity: We’re committed to creating a culture of inclusion, diversity, and equality – across race, gender, sexuality, disability, and neurodiversity – where innovation and growth thrive, every voice is heard, and everybody belongs. Learn more about us here.

CPRA Employee Privacy Notice: CA 

BigID is an E-Verify Participant.

Similar Jobs

Notion - Enterprise Technical Support, German, EMEA

Notion

Dublin, County Dublin, Ireland (On-Site)
4 Months ago
ByteDance - Backend Software Engineer - Global E-Commerce Logistics

ByteDance

San Jose, California, United States (On-Site)
1 Day ago
Trendyol - Backend Developer

Trendyol

Ankara, Ankara, Türkiye (Hybrid)
3 Months ago
Paypal - Senior AI Machine Learning Engineer

Paypal

San Jose, California, United States (On-Site)
4 Months ago
Salesforce - Senior Software Engineer, Search Infrastructure Data Engineering - Slack

Salesforce

Atlanta, Georgia, United States (On-Site)
4 Months ago
Twitch - Senior Data Scientist - ML

Twitch

San Francisco, California, United States (On-Site)
1 Month ago
Wooga - Game Analyst

Wooga

Berlin, Berlin, Germany (Hybrid)
1 Month ago
Unity - Fraud Analyst and Operations manager

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
The Walt Disney Company - Analyst, Sourcing Specialist

The Walt Disney Company

Buenos Aires, Buenos Aires, Argentina (On-Site)
2 Days ago
Netflix - Distributed Systems Engineer (L6) - Data Discovery & Governance

Netflix

Los Gatos, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Netflix - Software Engineer (L5) - Content Engineering

Netflix

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Months ago
Mega Zebra - Software Developer (Unity)

Mega Zebra

Montreal, Quebec, Canada (On-Site)
7 Months ago
Sinch - Senior Full Stack Engineer - Typescript

Sinch

Malmö, Skåne County, Sweden (On-Site)
3 Months ago
Interactive Brokers - Senior Java Developer

Interactive Brokers

Tallinn, Harju County, Estonia (On-Site)
4 Months ago
Google - Software Engineer II, Infrastructure, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ComeOn Group - Senior Frontend Developer

ComeOn Group

Silesian Voivodeship, Poland (Hybrid)
2 Weeks ago
Alpha Sense - Join AlphaSense India Talent Community

Alpha Sense

Pune, Maharashtra, India (On-Site)
3 Months ago
ByteDance - Backend Software Engineer - Global E-Commerce Supply Chain Billing & Settlement

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
PwC - Manager to Risk Assurance (Broader Assurance Services)

PwC

Almaty, Almaty Region, Kazakhstan (On-Site)
3 Months ago
Luxoft - Senior Mobile QA Automation

Luxoft

Pune, Maharashtra, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Tel Aviv-Yafo, Tel Aviv District, Israel

Playtika - Experienced Business Analyst

Playtika

Israel (On-Site)
3 Months ago
SuperPlay - Senior 2D Artist - Disney Solitaire

SuperPlay

Tel Aviv District, Israel (On-Site)
1 Month ago
Playtika - Marketing Strategy Manager (Temporary Position)

Playtika

Israel (On-Site)
2 Months ago
SciPlay - Monetization UX/UI Designer

SciPlay

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Weeks ago
Playtika - Experienced Data Scientist

Playtika

Israel (On-Site)
3 Days ago
Playtika - Growth Ventures-Director of Marketing

Playtika

Israel (On-Site)
2 Months ago
Moon Active - Technical Support Engineer (Tier 3)

Moon Active

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
5 Months ago
Moon Active - Employee Service Representative

Moon Active

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
Plarium - Director of Gen-AI

Plarium

Herzliya, Tel Aviv District, Israel (On-Site)
2 Days ago
Varonis  - Infra Software Engineer

Varonis

Herzliya, Tel Aviv District, Israel (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Zengame Technology - Advertising Optimization Specialist

Zengame Technology

Shenzhen, Guangdong Province, China (On-Site)
3 Weeks ago
Nielsen Holdings - Data Engineer

Nielsen Holdings

Mumbai, Maharashtra, India (Hybrid)
1 Month ago
Push Gaming - Director of Data & Analytics

Push Gaming

Gibraltar, England, United Kingdom (Hybrid)
2 Weeks ago
Playrix - Senior Data Analyst (Attribution)

Playrix

Serbia (Remote)
3 Months ago
prizepicks - Staff Data Analyst - Acquisition Marketing

prizepicks

Atlanta, Georgia, United States (Remote)
3 Weeks ago
ION - Data Engineer/Analyst - Graduate Development Program

ION

Pisa, Tuscany, Italy (On-Site)
4 Months ago
Epic Games - Analyste de données - Analyse produit

Epic Games

Montreal, Quebec, Canada (On-Site)
1 Month ago
The Walt Disney Company - Lead Software Engineer

The Walt Disney Company

Washington, United States (On-Site)
1 Month ago
Acceldata - Staff Support Engineer / Product Specialist : Cloud & Data Management

Acceldata

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Universal Music - Senior BI Engineer

Universal Music

Philadelphia, Pennsylvania, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

BigID is a leader in data security, privacy, compliance, and governance: enabling organizations to proactively discover, manage, protect, and get more value from their data in a single platform for data visibility and control.


Customers use BigID to reduce their data risk, automate security and privacy controls, achieve compliance, and understand their data across their entire data landscape: including multicloud, hybrid cloud, IaaS, PaaS, SaaS, and on-prem data sources

Boston, Massachusetts, United States (Remote)

Sydney, New South Wales, Australia (On-Site)

Atlanta, Georgia, United States (Remote)

London, England, United Kingdom (Remote)

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)

Chicago, Illinois, United States (Remote)

Tel Aviv District, Israel (Hybrid)

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)

Zurich, Ontario, Canada (Remote)

London, England, United Kingdom (Remote)

View All Jobs

Get notified when new jobs are added by BigID

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug