Senior Data Engineer

2 Months ago • 4-8 Years • Data Analyst

Job Summary

Job Description

As a Senior Data Engineer at Auros, you'll be responsible for stewarding and championing the firm's market and trading data archives and internal data products. This involves working with existing data pipelines and databases while designing and implementing next-generation data and analytic capabilities. You'll develop, test, and maintain high-throughput, high-volume distributed data architectures; analyze and automate data quality improvements; build real-time data collectors; and create tools for automating pipeline configuration, deployment, and troubleshooting. You'll collaborate with traders and developers to improve data quality and access. The role demands expertise in Python for data analysis, experience with large-scale data pipelines, and proficiency with SQL and NoSQL databases.
Must have:
  • Extensive Python experience for data analysis
  • Real-time large-scale data pipeline development
  • Distributed, high-performance SQL & NoSQL databases
  • High-throughput, high-volume data architecture development
Good to have:
  • Experience with data lakes (Amazon S3)
  • C++ development on Linux
  • Protocol-level network analysis
  • Terraform, ClickHouse, Hive, Hadoop, Snowflake, Presto

Job Details

We are Auros! 

Auros is a leading algorithmic trading and market-making firm specialising in digital asset liquidity provision. We trade across 10+ global locations, facilitating 3-4% of global daily volumes, and have through connectivity to over 50 venues.

We’re proud of the strong reputation we’ve built by combining our systematic approach, sophisticated pricing models, and state-of-the-art execution capabilities to provide robust, reliable trading performance and bring liquidity to crypto markets worldwide.

What sets us apart, though, is our culture. Our flat structure means you’ll have autonomy and plenty of opportunity to bring your ideas to life and help shape the systems that will power our business into the future.

 

The Role

This is a rare opportunity for an experienced Data Engineer to become both steward and champion for the firm's market and trading data archives and internal data products

You will work with our existing data pipelines and databases while designing and implementing the next generation of Auros data and analytic capabilities. You’ll enjoy taking on responsibilities where you’ll have the opportunity to make a substantial impact on the business outcomes through the work you do every day.

You’ll learn from our experienced trading team and help develop and support systems that execute millions of trades on crypto exchanges across the globe.  

What You'll Do

  • Develop, test and maintain high throughput, high volume distributed data architectures
  • Analyze, define and automate data quality improvements
  • Develop and maintain real time data collectors for time series databases
  • Build and improve trading analytics systems
  • Create tools to automate the configuration, deployment and troubleshooting of the data pipeline
  • Develop strategies to make our data pipeline efficient, timely and robust in a 24/7 trading environment
  • Implement monitoring that measures the completeness and accuracy of captured data
  • Manage the impact that changes to trading systems and upstream protocols have on the data pipeline
  • Back populate and clean historical datasets
  • Collaborate with traders and trading system developers to understand our data analysis requirements, and to continue to improve the quality of our stored data
  • Develop tools, APIs and screens to provide easy access to the archived data

 

What You'll Bring

  • Extensive experience using python for data analysis and other ad hoc tooling to analyse time series data sets and other large sets of data
  • Ideally you’ll have experience with developing real time large scale data pipelines, with petabytes of data
  • Experience with distributed, high performance SQL and NoSQL database systems
  • A bachelor's degree (or above) in Computer Science, Software Engineering or similar, with excellent results.

Highly Desirable Skills

  • Experience with data lakes, Amazon S3 or similar
  • Experience developing in C++ on linux
  • Protocol level network analysis experience
  • Experience with terraform
  • Experience with Clickhouse
  • Experience with technologies such as Hive, Hadoop, Snowflake, Presto or similar.

Similar Jobs

Red Point Labs - Unity Game Developer (Remote OK)

Red Point Labs

Argentina (Remote)
8 Months ago
ByteDance - Research Scientist Graduate (Infrastructure System Lab) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Marvell - Senior Product Engineer

Marvell

Singapore (On-Site)
3 Months ago
Epic Games - Lead Engineer - Fortnite Online

Epic Games

Cary, North Carolina, United States (On-Site)
4 Weeks ago
Luxoft - Functional/Senior Functional Developer_remote Poland

Luxoft

Poland, Ohio, United States (Remote)
2 Months ago
PwC - Analityk biznesowy  (freelance)

PwC

Warsaw, Masovian Voivodeship, Poland (On-Site)
4 Months ago
Warner Bros Discovery - Vice President, Engineering

Warner Bros Discovery

Hyderabad, Telangana, India (On-Site)
1 Month ago
Trendyol - Growth, Data Analytics Professionals - Trendyol Ads

Trendyol

Maslak, İstanbul, Türkiye (Hybrid)
3 Months ago
UXBERT Labs - Senior Data Analyst

UXBERT Labs

Riyadh, Riyadh Province, Saudi Arabia (Hybrid)
1 Month ago
Voodoo - Data Analyst - LaunchOps

Voodoo

Paris, Île-de-France, France (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Backend Software Engineer

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Meta - Software Engineer, Product

Meta

New York, New York, United States (Remote)
2 Months ago
PlayStation Global - Lead DevOps Engineer

PlayStation Global

Los Angeles, California, United States (On-Site)
3 Months ago
Kojima Productions - Technical Artist

Kojima Productions

Tokyo, Japan (On-Site)
2 Months ago
Keywords Studios (Player Support) - Software Engineer

Keywords Studios (Player Support)

Tokyo, Japan (Remote)
5 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Seattle, Washington, United States (On-Site)
2 Months ago
Playrix - Senior C++ Software Engineer (Tools)

Playrix

Serbia (Remote)
3 Months ago
Epic Games - Senior Gameplay Systems Programmer, Unreal Engine

Epic Games

Cary, North Carolina, United States (On-Site)
2 Weeks ago
Playrix - Technical Director (Game Project)

Playrix

Almaty, Almaty Region, Kazakhstan (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United Kingdom

Unity - Principal Applied Research Machine Learning Engineer

Unity

London, England, United Kingdom (On-Site)
3 Months ago
Trailer Park Group - Lead Designer

Trailer Park Group

London, England, United Kingdom (Hybrid)
1 Month ago
The Walt Disney Company - Dry Dock Manager of Technical

The Walt Disney Company

London, England, United Kingdom (On-Site)
1 Week ago
Maverick Games - Character Artist (12 Month Contract)

Maverick Games

Warwick, England, United Kingdom (On-Site)
2 Weeks ago
The Pokemon Company International - Director, Chief Product and Experience Officer Office

The Pokemon Company International

London, England, United Kingdom (Hybrid)
3 Months ago
Rockstar Games - Animation R&D Programmer (Mid / Senior Level)

Rockstar Games

Edinburgh, Scotland, United Kingdom (On-Site)
4 Months ago
Rebellion - Design Director

Rebellion

England, United Kingdom (Hybrid)
6 Days ago
ION - Senior Business Consultant - Aspect

ION

London, England, United Kingdom (On-Site)
3 Months ago
Electronic Arts - Software Engineer, C++ - EA Sports FC

Electronic Arts

Southam, England, United Kingdom (Hybrid)
2 Weeks ago
Realtime - Register Your Interest

Realtime

United Kingdom (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

ION - Internship - Data Science

ION

Milan, Lombardy, Italy (On-Site)
3 Months ago
Make - Senior Data Engineer

Make

Prague, Czechia (Hybrid)
4 Weeks ago
Google - Senior Data Insights Lead, People with Disabilities

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
1 Month ago
The Walt Disney Company - Commercial Research Analyst

The Walt Disney Company

London, England, United Kingdom (Hybrid)
2 Weeks ago
Epic Games - Senior Data Analyst, Game Platform

Epic Games

(On-Site)
4 Weeks ago
Netflix - Inclusion Strategy Manager (1 year Maternity Cover)

Netflix

London, England, United Kingdom (On-Site)
1 Week ago
Nagarro - Associate Staff Consultant, Business Analyst

Nagarro

India (Remote)
3 Months ago
Attentive - Senior Data Scientist/Applied Scientist, AI Products

Attentive

San Francisco, California, United States (Hybrid)
3 Months ago
Electronic Arts - BI Engineer, EA Experiences

Electronic Arts

Vancouver, British Columbia, Canada (Hybrid)
1 Month ago
CloudHire - Data Analyst

CloudHire

Bengaluru, Karnataka, India (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded