Senior Data Engineer

2 Months ago • 4-8 Years • Data Analyst • Undisclosed

Job Summary

Job Description

As a Senior Data Engineer at Auros, you'll be responsible for stewarding and championing the firm's market and trading data archives and internal data products. You will design and implement next-generation data and analytic capabilities, working with existing pipelines and databases. Responsibilities include developing high-throughput data architectures, automating data quality improvements, building real-time data collectors, creating trading analytics systems, and automating data pipeline configuration and deployment. You'll collaborate with traders and developers to improve data quality and access, ensuring a robust and efficient data pipeline in a 24/7 trading environment. Experience with Python, large-scale data pipelines, and SQL/NoSQL databases is crucial.
Must have:
  • Python for data analysis
  • Real-time large-scale data pipelines
  • SQL and NoSQL databases
  • Develop and maintain data pipelines
  • Data quality improvement and automation
Good to have:
  • Data lakes (Amazon S3)
  • C++ development on Linux
  • Protocol level network analysis
  • Terraform
  • ClickHouse
  • Hive, Hadoop, Snowflake, Presto

Job Details

We are Auros! 

Auros is a leading algorithmic trading and market-making firm specialising in digital asset liquidity provision. We trade across 10+ global locations, facilitating 3-4% of global daily volumes, and have through connectivity to over 50 venues.

We’re proud of the strong reputation we’ve built by combining our systematic approach, sophisticated pricing models, and state-of-the-art execution capabilities to provide robust, reliable trading performance and bring liquidity to crypto markets worldwide.

What sets us apart, though, is our culture. Our flat structure means you’ll have autonomy and plenty of opportunity to bring your ideas to life and help shape the systems that will power our business into the future.

 

The Role

This is a rare opportunity for an experienced Data Engineer to become both steward and champion for the firm's market and trading data archives and internal data products

You will work with our existing data pipelines and databases while designing and implementing the next generation of Auros data and analytic capabilities. You’ll enjoy taking on responsibilities where you’ll have the opportunity to make a substantial impact on the business outcomes through the work you do every day.

You’ll learn from our experienced trading team and help develop and support systems that execute millions of trades on crypto exchanges across the globe.  

What You'll Do

  • Develop, test and maintain high throughput, high volume distributed data architectures
  • Analyze, define and automate data quality improvements
  • Develop and maintain real time data collectors for time series databases
  • Build and improve trading analytics systems
  • Create tools to automate the configuration, deployment and troubleshooting of the data pipeline
  • Develop strategies to make our data pipeline efficient, timely and robust in a 24/7 trading environment
  • Implement monitoring that measures the completeness and accuracy of captured data
  • Manage the impact that changes to trading systems and upstream protocols have on the data pipeline
  • Back populate and clean historical datasets
  • Collaborate with traders and trading system developers to understand our data analysis requirements, and to continue to improve the quality of our stored data
  • Develop tools, APIs and screens to provide easy access to the archived data

 

What You'll Bring

  • Extensive experience using python for data analysis and other ad hoc tooling to analyse time series data sets and other large sets of data
  • Ideally you’ll have experience with developing real time large scale data pipelines, with petabytes of data
  • Experience with distributed, high performance SQL and NoSQL database systems
  • A bachelor's degree (or above) in Computer Science, Software Engineering or similar, with excellent results.

Highly Desirable Skills

  • Experience with data lakes, Amazon S3 or similar
  • Experience developing in C++ on linux
  • Protocol level network analysis experience
  • Experience with terraform
  • Experience with Clickhouse
  • Experience with technologies such as Hive, Hadoop, Snowflake, Presto or similar.

Similar Jobs

Microsoft - Senior Firmware Deployment Engineer

Microsoft

Chandigarh, Chandigarh, India (On-Site)
6 Months ago
Meta - Software Engineer, iOS

Meta

Boston, Massachusetts, United States (On-Site)
2 Months ago
Ubisoft Blue Byte - TECHNICAL ANIMATOR (F/M/D)

Ubisoft Blue Byte

Düsseldorf, North Rhine-Westphalia, Germany (On-Site)
2 Months ago
Activision - Expert Tools Programmer

Activision

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Wind River Systems - Senior Linux Solutions Architect

Wind River Systems

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Canva - Data Scientist  - Revenue Platform

Canva

Sydney, New South Wales, Australia (Hybrid)
2 Months ago
Rackspace Technology - Data Architect (Abinitio)

Rackspace Technology

India (Remote)
3 Months ago
Rec Room - Product Data Scientist

Rec Room

United States (Remote)
2 Months ago
Luxoft - Informatica Technical Lead - ETL

Luxoft

Chennai, Tamil Nadu, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Playrix - Senior Unity Software Engineer (Gameplay)

Playrix

Serbia (Remote)
3 Months ago
The Walt Disney Company - Software Engineer, Platform

The Walt Disney Company

Emeryville, California, United States (On-Site)
2 Months ago
Virtuos - Senior Animation Developer

Virtuos

France (Hybrid)
3 Months ago
CloudLinux - Linux Cryptography Developer (C/C++) (remote-only position)

CloudLinux

Bucharest, Bucharest, Romania (Remote)
2 Months ago
Jobs Malaysia - Two95 HR HUB - Augmented Reality Developer | AR Developer

Jobs Malaysia - Two95 HR HUB

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Adobe - Senior Computer Scientist

Adobe

Noida, Uttar Pradesh, India (On-Site)
2 Months ago
Daybreak Game Company LLC - Software Development Engineer (Cardset)

Daybreak Game Company LLC

Renton, Washington, United States (Remote)
2 Months ago
Zoox - Software Engineer - Planner Motion

Zoox

Foster City, California, United States (On-Site)
3 Months ago
Fabric - Principal Design Verification Engineer

Fabric

Los Angeles, California, United States (On-Site)
3 Months ago
TV2Z - iOS Developer (4-6 years)

TV2Z

Hyderabad, Telangana, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Europe

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analyst Jobs

Twitch - Data Scientist - Analytics

Twitch

San Francisco, California, United States (On-Site)
2 Months ago
Playrix - Senior Data Analyst (Attribution)

Playrix

Montenegro (Remote)
3 Months ago
Ericsson - Data Scientist

Ericsson

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Meetelise - Data Analyst

Meetelise

New York, New York, United States (On-Site)
3 Months ago
PwC - Senior Manager_Data Engineering_D&A_Advisory _Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
4 Months ago
Axinous - Senior/Staff Data Analyst - Costa Rica

Axinous

Costa Rica (Remote)
3 Months ago
Meta - Global Sales Analytics Lead

Meta

Austin, Texas, United States (Remote)
2 Months ago
Next Level Business Services - Data Scientist -  Full Time Only

Next Level Business Services

Redmond, Washington, United States (On-Site)
3 Months ago
Info Stretch - Data Modeler

Info Stretch

Birmingham, England, United Kingdom (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded