Senior Data Engineer

2 Months ago • 4-8 Years • Data Analyst

Job Summary

Job Description

As a Senior Data Engineer at Auros, you'll be responsible for stewarding and championing the firm's market and trading data archives and internal data products. This involves working with existing data pipelines and databases while designing and implementing next-generation data and analytic capabilities. You'll develop, test, and maintain high-throughput, high-volume distributed data architectures; analyze and automate data quality improvements; build real-time data collectors; and create tools for automating pipeline configuration, deployment, and troubleshooting. You'll collaborate with traders and developers to improve data quality and access. The role demands expertise in Python for data analysis, experience with large-scale data pipelines, and proficiency with SQL and NoSQL databases.
Must have:
  • Extensive Python experience for data analysis
  • Real-time large-scale data pipeline development
  • Distributed, high-performance SQL & NoSQL databases
  • High-throughput, high-volume data architecture development
Good to have:
  • Experience with data lakes (Amazon S3)
  • C++ development on Linux
  • Protocol-level network analysis
  • Terraform, ClickHouse, Hive, Hadoop, Snowflake, Presto

Job Details

We are Auros! 

Auros is a leading algorithmic trading and market-making firm specialising in digital asset liquidity provision. We trade across 10+ global locations, facilitating 3-4% of global daily volumes, and have through connectivity to over 50 venues.

We’re proud of the strong reputation we’ve built by combining our systematic approach, sophisticated pricing models, and state-of-the-art execution capabilities to provide robust, reliable trading performance and bring liquidity to crypto markets worldwide.

What sets us apart, though, is our culture. Our flat structure means you’ll have autonomy and plenty of opportunity to bring your ideas to life and help shape the systems that will power our business into the future.

 

The Role

This is a rare opportunity for an experienced Data Engineer to become both steward and champion for the firm's market and trading data archives and internal data products

You will work with our existing data pipelines and databases while designing and implementing the next generation of Auros data and analytic capabilities. You’ll enjoy taking on responsibilities where you’ll have the opportunity to make a substantial impact on the business outcomes through the work you do every day.

You’ll learn from our experienced trading team and help develop and support systems that execute millions of trades on crypto exchanges across the globe.  

What You'll Do

  • Develop, test and maintain high throughput, high volume distributed data architectures
  • Analyze, define and automate data quality improvements
  • Develop and maintain real time data collectors for time series databases
  • Build and improve trading analytics systems
  • Create tools to automate the configuration, deployment and troubleshooting of the data pipeline
  • Develop strategies to make our data pipeline efficient, timely and robust in a 24/7 trading environment
  • Implement monitoring that measures the completeness and accuracy of captured data
  • Manage the impact that changes to trading systems and upstream protocols have on the data pipeline
  • Back populate and clean historical datasets
  • Collaborate with traders and trading system developers to understand our data analysis requirements, and to continue to improve the quality of our stored data
  • Develop tools, APIs and screens to provide easy access to the archived data

 

What You'll Bring

  • Extensive experience using python for data analysis and other ad hoc tooling to analyse time series data sets and other large sets of data
  • Ideally you’ll have experience with developing real time large scale data pipelines, with petabytes of data
  • Experience with distributed, high performance SQL and NoSQL database systems
  • A bachelor's degree (or above) in Computer Science, Software Engineering or similar, with excellent results.

Highly Desirable Skills

  • Experience with data lakes, Amazon S3 or similar
  • Experience developing in C++ on linux
  • Protocol level network analysis experience
  • Experience with terraform
  • Experience with Clickhouse
  • Experience with technologies such as Hive, Hadoop, Snowflake, Presto or similar.

Similar Jobs

ByteDance - Site Reliability Engineer - AML

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Netflix - Machine Learning Engineer

Netflix

United States (Remote)
1 Month ago
ByteDance - Software Development Engineer, Network Automation - San Jose

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
ByteDance - Senior Software Development Engineer - NoSQL-DocumentDB

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Microsoft - Senior Applied Scientist

Microsoft

Beijing, Beijing, China (On-Site)
2 Weeks ago
Xsolla - Researcher/Analyst

Xsolla

Armenia (Remote)
2 Months ago
Luxoft - Data Engineer for Market Data Projects (with Streamlit Expertise)

Luxoft

Brazil, Indiana, United States (Remote)
2 Months ago
Jellyfish - Senior Analytics Manager (GTM/GA4)

Jellyfish

Melbourne, Victoria, Australia (Hybrid)
3 Months ago
Knuddels - Business/Data Analyst Intern

Knuddels

Baden-Württemberg, Germany (Remote)
18 Hours ago
Twitch - Business Intelligence Engineer (Contract)

Twitch

San Francisco, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Final Strike Games - Gameplay Engineer II

Final Strike Games

Montreal, Quebec, Canada (On-Site)
1 Week ago
ByteDance - Backend Software Engineer, Data Engineering

ByteDance

Singapore (On-Site)
3 Months ago
Blizzard Entertainment - Senior Software Engineer, Gameplay - Diablo IV | Albany, NY

Blizzard Entertainment

Albany, New York, United States (Hybrid)
5 Months ago
Matchtech - Junior Game Developer

Matchtech

Birmingham, England, United Kingdom (On-Site)
6 Months ago
Zoox - Senior/Staff Software Engineer - Simulation C++ Framework

Zoox

Foster City, California, United States (Hybrid)
3 Months ago
Probably Monsters - Principal Player Combat & Gameplay Designer

Probably Monsters

Washington, United States (On-Site)
2 Months ago
ByteDance - Senior Data Engineer, Global Payments

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Activision - Multiplayer Technical Director

Activision

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago
Playrix - Senior QA Automation Engineer (Mobile)

Playrix

Georgia (Remote)
3 Months ago
Unity - Senior Backend Engineer, Data Services

Unity

San Francisco, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United Kingdom

Hitachi - Lead Analytics Consultant

Hitachi

London, England, United Kingdom (On-Site)
3 Months ago
PlayStation Global - Senior Software Engineer in Test (Graphics/ML)

PlayStation Global

London, England, United Kingdom (On-Site)
2 Months ago
Warner Bros Games - Product Manager II

Warner Bros Games

London, England, United Kingdom (Hybrid)
1 Month ago
The Walt Disney Company - Product Design and Development Associate - Food

The Walt Disney Company

London, England, United Kingdom (On-Site)
1 Day ago
Bally's Interactive - Invoicing Administrator

Bally's Interactive

London, England, United Kingdom (On-Site)
1 Week ago
Keywords Studios (Player Support) - MPG Head of Marketing - Maternity Cover - 12mths FTC

Keywords Studios (Player Support)

Nottingham, England, United Kingdom (On-Site)
2 Months ago
The Walt Disney Company - Cast Member - 12 Hours

The Walt Disney Company

London, England, United Kingdom (On-Site)
3 Weeks ago
The Walt Disney Company - Associate Site Merchandiser

The Walt Disney Company

London, England, United Kingdom (Hybrid)
3 Weeks ago
TT Games - Senior Game Programmer

TT Games

Knutsford, England, United Kingdom (Hybrid)
2 Weeks ago
Rank group - Poker Dealer - Zero Hour

Rank group

Newcastle Upon Tyne, England, United Kingdom (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

SoundHound AI - Language Specialist, Telugu [Contractor]

SoundHound AI

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
The Walt Disney Company - Digital Insights Analyst

The Walt Disney Company

Richmond, Victoria, Australia (On-Site)
2 Days ago
Nexters - Marketing Analyst

Nexters

Cyprus (Remote)
2 Hours ago
Playkot - Data Engineer

Playkot

Belgrade, Serbia (Remote)
2 Weeks ago
Ness Digital - Senior Business Analyst

Ness Digital

Iași, Iași County, Romania (Remote)
1 Month ago
Twitch - Data Science Intern (MA/PhD)

Twitch

San Francisco, California, United States (On-Site)
2 Months ago
Nielsen Holdings - Sr. Staff Data Engineer

Nielsen Holdings

Gurugram, Haryana, India (Hybrid)
3 Months ago
Ubisoft - Data Analyst Assistant Internship

Ubisoft

Paris, Île-de-France, France (On-Site)
1 Week ago
The Walt Disney Company - Revenue Management Analyst

The Walt Disney Company

Montévrain, Île-de-France, France (Hybrid)
1 Day ago
Meta - Data Science Director

Meta

New York, New York, United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded