Staff Data Engineer

3 Weeks ago • 10-10 Years • Data Analyst

About the job

SummaryBy Outscal

Must have:
  • Python Experience
  • AWS Expertise
  • Kafka Experience
  • SQL Server
Good to have:
  • Redshift Exp.
  • DynamoDB Exp.
  • RESTful APIs
  • GraphQL APIs
Perks:
  • Inclusive Team
  • Positive Impact
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

About the job

Staff Data Engineer has full accountability to design and develop rich data-driven frameworks, applications and services. This role will be responsible for development of applications on the Cloud platform and migration of existing on-premise data systems and processes to the Cloud, while also engaging with the Teams navigate through Technology stack evaluation and incubation of newer Cloud technologies. Staff Data Engineer is an expert at cloud technologies, specifically AWS tools and resources, and participates in building robust data pipeline frameworks that are configurable and highly re-usable. This role will be responsible for architecting enterprise level data solutions keeping in mind future scale and SLA management with scale.

If you are that person, you'll help us continue to improve and innovate our Data Applications and Services, and we’ll help you grow!

Job Responsibilities

  • Participate in the full software lifecycle (requirements, design, code, unit test, deployment, sustaining) for assigned modules
  • Interact with Product Management to determine Product / Feature requirements and perform technical analysis
  • Interact with Application & Analyst Teams to determine Data dependencies and perform technical analysis
  • Acquire and maintain a clear understanding of the technologies used in Lytx’s products and services and help steer future technology vision
  • Participate in scrum sprints with other developers, business users, and testers
  • Mentor and guide junior members on the team and drive product and features development with the Team
  • Collaborate with the product / program management Teams to define clear requirements
  • Experience breaking down product requirements in manageable software development tasks that could be tracked
  • Experience with architecture design and ability to document, publish, and evangelize architecture design to technology partners
  • Practice and instill design & development best practices, re-usability concepts using frameworks, and Enterprise-wide view while designing and implementing solutions
  • Understand big picture when working on product and features, ability to design enterprise level solutions focused on future growth and SLA requirements
  • Other duties as assigned

Education Requirements

  • Bachelor’s degree in computer science, computer information systems, or equivalent experience

Experience Requirements

  • 10+ years of industry experience developing Data products and/or developing enterprise-scale Big Data solutions
  • 7+ years’ experience in a senior developer role with focus in data Ingest, data processing and data publishing design
  • 6+ years in design/development of high-volume high-throughput Data systems ranging from OLTP to data lake & data warehouse environments
  • 5+ years of solid experience developing software products and/or developing enterprise-scale Data solutions on Cloud Platform

Technical Expertise Requirements

Languages & Tools:

  • 5+ years experience with Python
  • 4+ years of experience with core Java, Java springboot is preferable
  • Knowledge of IAC using terraform & terragrunt

Cloud Platform

  • Experience developing Data solutions on AWS platform is preferable
  • Experience developing frameworks and point solutions for Data ingest, Data processing and Data publishing (AWS platform experience is preferable)
  • Experience with building Streaming data solutions using Apache Kafka, Apache Flink, Apache Airflow or equivalent
  • Experience with ingesting data using Kafka connect (AWS managed and/or confluent open source)
  • Experience developing Data warehouse solutions on Redshift is preferable
  • Experience managing and developing on big data distributed systems such as hadoop is highly preferable

Databases (RDBMS)

  • Experience in SQL Server development, including high proficiency in writing and analyzing SQL/T-SQL, and developing/managing SSIS workloads is preferable
  • SQL Server database performance management background is preferable
  • Experience with alternate RDBMS technologies such as MySQL or PostgreSQL

Databases (no-sql)

  • Experience with DynamoDB or MongoDB or Redis

Data APIs

  • Experience building RESTful interfaces
  • Experience building graphQL API interfaces

Ci & Cd

  • Experience in an environment with continuous deployment, integration, automated testing
  • Experience developing software using agile methodologies delivering solutions within bounded sprints

Production Support

  • Ability to diagnose and decompose problems at the appropriate levels of the stack
  • Ability to quickly resolve the problems, keeping in mind upstream and downstream systems dependencies, to bring systems to acceptable SLA levels
  • Ability to perform root cause analysis (RCA) and suggest & perform system changes ac

cordingly

Innovation Lives Here

You go all in no matter what you do, and so do we. At Lytx, we’re powered by cutting-edge technology and Happy People. You want your work to make a positive impact in the world, and that’s what we do. Join our diverse team of hungry, humble and capable people united to make a difference.

Together, we help save lives on our roadways.

Find out how good it feels to be a part of an inclusive, collaborative team. We’re committed to delivering an environment where everyone feels valued, included and supported to do their best work and share their voices.

Lytx, Inc. is proud to be an equal opportunity/affirmative action employer and maintains a drug-free workplace. We’re committed to attracting, retaining and maximizing the performance of a diverse and inclusive workforce. EOE/M/F/Disabled/Vet.

View Full Job Description

About The Company

Karnataka, India (Hybrid)

Karnataka, India (Hybrid)

Karnataka, India (Hybrid)

Karnataka, India (Hybrid)

Karnataka, India (Hybrid)

Karnataka, India (Hybrid)

Karnataka, India (Hybrid)

Karnataka, India (Hybrid)

Karnataka, India (Hybrid)

Karnataka, India (Hybrid)

View All Jobs

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug