Senior Data Engineer

2 Months ago • 4-8 Years • Data Analyst

Job Summary

Job Description

As a Senior Data Engineer at Auros, you'll be responsible for stewarding and championing the firm's market and trading data archives and internal data products. This involves working with existing data pipelines and databases while designing and implementing next-generation data and analytic capabilities. You'll develop, test, and maintain high-throughput, high-volume distributed data architectures; analyze and automate data quality improvements; build real-time data collectors; and create tools for automating pipeline configuration, deployment, and troubleshooting. You'll collaborate with traders and developers to improve data quality and access. The role demands expertise in Python for data analysis, experience with large-scale data pipelines, and proficiency with SQL and NoSQL databases.
Must have:
  • Extensive Python experience for data analysis
  • Real-time large-scale data pipeline development
  • Distributed, high-performance SQL & NoSQL databases
  • High-throughput, high-volume data architecture development
Good to have:
  • Experience with data lakes (Amazon S3)
  • C++ development on Linux
  • Protocol-level network analysis
  • Terraform, ClickHouse, Hive, Hadoop, Snowflake, Presto

Job Details

We are Auros! 

Auros is a leading algorithmic trading and market-making firm specialising in digital asset liquidity provision. We trade across 10+ global locations, facilitating 3-4% of global daily volumes, and have through connectivity to over 50 venues.

We’re proud of the strong reputation we’ve built by combining our systematic approach, sophisticated pricing models, and state-of-the-art execution capabilities to provide robust, reliable trading performance and bring liquidity to crypto markets worldwide.

What sets us apart, though, is our culture. Our flat structure means you’ll have autonomy and plenty of opportunity to bring your ideas to life and help shape the systems that will power our business into the future.

 

The Role

This is a rare opportunity for an experienced Data Engineer to become both steward and champion for the firm's market and trading data archives and internal data products

You will work with our existing data pipelines and databases while designing and implementing the next generation of Auros data and analytic capabilities. You’ll enjoy taking on responsibilities where you’ll have the opportunity to make a substantial impact on the business outcomes through the work you do every day.

You’ll learn from our experienced trading team and help develop and support systems that execute millions of trades on crypto exchanges across the globe.  

What You'll Do

  • Develop, test and maintain high throughput, high volume distributed data architectures
  • Analyze, define and automate data quality improvements
  • Develop and maintain real time data collectors for time series databases
  • Build and improve trading analytics systems
  • Create tools to automate the configuration, deployment and troubleshooting of the data pipeline
  • Develop strategies to make our data pipeline efficient, timely and robust in a 24/7 trading environment
  • Implement monitoring that measures the completeness and accuracy of captured data
  • Manage the impact that changes to trading systems and upstream protocols have on the data pipeline
  • Back populate and clean historical datasets
  • Collaborate with traders and trading system developers to understand our data analysis requirements, and to continue to improve the quality of our stored data
  • Develop tools, APIs and screens to provide easy access to the archived data

 

What You'll Bring

  • Extensive experience using python for data analysis and other ad hoc tooling to analyse time series data sets and other large sets of data
  • Ideally you’ll have experience with developing real time large scale data pipelines, with petabytes of data
  • Experience with distributed, high performance SQL and NoSQL database systems
  • A bachelor's degree (or above) in Computer Science, Software Engineering or similar, with excellent results.

Highly Desirable Skills

  • Experience with data lakes, Amazon S3 or similar
  • Experience developing in C++ on linux
  • Protocol level network analysis experience
  • Experience with terraform
  • Experience with Clickhouse
  • Experience with technologies such as Hive, Hadoop, Snowflake, Presto or similar.

Similar Jobs

DNEG - Lead Software Developer, Ziva Realtime

DNEG

Toronto, Ontario, Canada (Hybrid)
4 Months ago
Keen Software House - Senior Gameplay Programmer

Keen Software House

Prague, Prague, Czechia (Remote)
2 Weeks ago
KingsIsle Entertainment - Build and Tools Software Engineer

KingsIsle Entertainment

Texas, United States (Hybrid)
2 Months ago
Blizzard Entertainment - 2025 US Co-Op - Game Engineering

Blizzard Entertainment

Albany, New York, United States (On-Site)
3 Months ago
NVIDIA - Senior Software Engineer - Windows for ARM and Tegra

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
The Walt Disney Company - Sr Machine Learning Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
3 Months ago
Nielsen Holdings - Senior Data Developer

Nielsen Holdings

Mexico City, Mexico City, Mexico (Remote)
1 Week ago
prizepicks - Product Manager, Trading & Data Platform

prizepicks

Atlanta, Georgia, United States (Remote)
1 Month ago
Social Discovery Group - Senior Business Analyst (AI Product)

Social Discovery Group

Poland (Remote)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Senior Onsite Interconnect Product Engineer

NVIDIA

(On-Site)
1 Month ago
Google - Software Engineering Manager (For Women in Tech Candidates)

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
3 Months ago
Velotio Technologies - AI/ML Engineer

Velotio Technologies

India (Remote)
3 Weeks ago
Unity - Développeur(se) de logiciels, WebGL Platform | Software Developer, WebGL Platform

Unity

Montreal, Quebec, Canada (On-Site)
4 Months ago
N-iX - Senior Electronics Engineer

N-iX

Ukraine (Remote)
5 Days ago
Riot Games - Staff Software Engineer, Full-Stack - 2XKO

Riot Games

Dublin, County Dublin, Ireland (On-Site)
3 Months ago
PlayStation Global - Senior Software Development Engineer in Test Contractor (Sr SDET)

PlayStation Global

Aliso Viejo, California, United States (On-Site)
3 Weeks ago
31st Union - Senior Core Engineer

31st Union

Valencia, Valencian Community, Spain (On-Site)
7 Months ago
Thatgamecompany - Technical Game Designer

Thatgamecompany

Canada (Remote)
1 Week ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Sausalito, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United Kingdom

Tesla - Sales Advisor

Tesla

Ferndown, England, United Kingdom (On-Site)
1 Week ago
Red Rover Interactive - Tools Programmer

Red Rover Interactive

Newcastle Upon Tyne, England, United Kingdom (Hybrid)
2 Months ago
Bally's Interactive - Software Engineer - Full Stack

Bally's Interactive

London, England, United Kingdom (On-Site)
1 Month ago
Inspired Entertainment - Amusement Machine Cash Collector

Inspired Entertainment

Stockport, England, United Kingdom (On-Site)
1 Month ago
Unity - Senior Product Manager

Unity

London, England, United Kingdom (On-Site)
6 Months ago
Axon - Director, Commercial Controllership

Axon

London, England, United Kingdom (On-Site)
2 Months ago
Tesla - Tesla Support Advisor - London

Tesla

London, England, United Kingdom (On-Site)
1 Week ago
IGN - Commercial Insights Manager

IGN

London, England, United Kingdom (Hybrid)
1 Month ago
Inspired Entertainment - QA Tester

Inspired Entertainment

Burton Upon Trent, England, United Kingdom (On-Site)
1 Month ago
Hutch - Marketing Artist

Hutch

England, United Kingdom (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Warner Bros Discovery - Customer Data Manager - Digital/Video On Demand

Warner Bros Discovery

Masovian Voivodeship, Poland (Hybrid)
2 Months ago
Optum - Data Scientist

Optum

Noida, Uttar Pradesh, India (On-Site)
5 Months ago
Krafton  - Product Analyst

Krafton

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Universal Music - Manager, Data Science, Bilingual (English/Spanish)

Universal Music

Miami Beach, Florida, United States (On-Site)
3 Months ago
CloudHire - Senior Data Analyst

CloudHire

Mumbai, Maharashtra, India (Remote)
4 Months ago
Rank group - Senior Insight Analyst

Rank group

London, England, United Kingdom (On-Site)
2 Months ago
Playrix - Data QA Engineer

Playrix

Ukraine (Remote)
4 Months ago
SmileGate - CROSSFIRE Data Analyst

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
1 Month ago
Al-Fahad - Content Labelling/ Tagging/ Editing/ Annotation

Al-Fahad

Gurugram, Haryana, India (Hybrid)
4 Months ago
PwC - Manager Actuarieel Advies Schadeverzekeringen

PwC

Amsterdam, North Holland, Netherlands (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded