Senior Data Engineer

4 Months ago • 4-8 Years • Data Analyst

Job Summary

Job Description

As a Senior Data Engineer at Auros, you'll be responsible for stewarding and championing the firm's market and trading data archives and internal data products. This involves working with existing data pipelines and databases while designing and implementing next-generation data and analytic capabilities. You'll develop, test, and maintain high-throughput, high-volume distributed data architectures; analyze and automate data quality improvements; build real-time data collectors; and create tools for automating pipeline configuration, deployment, and troubleshooting. You'll collaborate with traders and developers to improve data quality and access. The role demands expertise in Python for data analysis, experience with large-scale data pipelines, and proficiency with SQL and NoSQL databases.
Must have:
  • Extensive Python experience for data analysis
  • Real-time large-scale data pipeline development
  • Distributed, high-performance SQL & NoSQL databases
  • High-throughput, high-volume data architecture development
Good to have:
  • Experience with data lakes (Amazon S3)
  • C++ development on Linux
  • Protocol-level network analysis
  • Terraform, ClickHouse, Hive, Hadoop, Snowflake, Presto

Job Details

We are Auros! 

Auros is a leading algorithmic trading and market-making firm specialising in digital asset liquidity provision. We trade across 10+ global locations, facilitating 3-4% of global daily volumes, and have through connectivity to over 50 venues.

We’re proud of the strong reputation we’ve built by combining our systematic approach, sophisticated pricing models, and state-of-the-art execution capabilities to provide robust, reliable trading performance and bring liquidity to crypto markets worldwide.

What sets us apart, though, is our culture. Our flat structure means you’ll have autonomy and plenty of opportunity to bring your ideas to life and help shape the systems that will power our business into the future.

 

The Role

This is a rare opportunity for an experienced Data Engineer to become both steward and champion for the firm's market and trading data archives and internal data products

You will work with our existing data pipelines and databases while designing and implementing the next generation of Auros data and analytic capabilities. You’ll enjoy taking on responsibilities where you’ll have the opportunity to make a substantial impact on the business outcomes through the work you do every day.

You’ll learn from our experienced trading team and help develop and support systems that execute millions of trades on crypto exchanges across the globe.  

What You'll Do

  • Develop, test and maintain high throughput, high volume distributed data architectures
  • Analyze, define and automate data quality improvements
  • Develop and maintain real time data collectors for time series databases
  • Build and improve trading analytics systems
  • Create tools to automate the configuration, deployment and troubleshooting of the data pipeline
  • Develop strategies to make our data pipeline efficient, timely and robust in a 24/7 trading environment
  • Implement monitoring that measures the completeness and accuracy of captured data
  • Manage the impact that changes to trading systems and upstream protocols have on the data pipeline
  • Back populate and clean historical datasets
  • Collaborate with traders and trading system developers to understand our data analysis requirements, and to continue to improve the quality of our stored data
  • Develop tools, APIs and screens to provide easy access to the archived data

 

What You'll Bring

  • Extensive experience using python for data analysis and other ad hoc tooling to analyse time series data sets and other large sets of data
  • Ideally you’ll have experience with developing real time large scale data pipelines, with petabytes of data
  • Experience with distributed, high performance SQL and NoSQL database systems
  • A bachelor's degree (or above) in Computer Science, Software Engineering or similar, with excellent results.

Highly Desirable Skills

  • Experience with data lakes, Amazon S3 or similar
  • Experience developing in C++ on linux
  • Protocol level network analysis experience
  • Experience with terraform
  • Experience with Clickhouse
  • Experience with technologies such as Hive, Hadoop, Snowflake, Presto or similar.

Similar Jobs

Tesla - Vision Systems Engineer

Tesla

Brandenburg, Germany (On-Site)
2 Months ago
Meta - Production Engineer

Meta

Warsaw, Masovian Voivodeship, Poland (On-Site)
5 Months ago
Google - Software Engineering Manager, Black Community Inclusion

Google

State Of Minas Gerais, Brazil (On-Site)
4 Months ago
ION - Principal Technical Consultant - Endur

ION

Berlin, Berlin, Germany (On-Site)
6 Months ago
Warner Bros Games - Chef.fe d'équipe, programmation moteur de jeu / Lead Programmer, Engine

Warner Bros Games

Montreal, Quebec, Canada (Hybrid)
9 Months ago
Linden Lab - Director, Strategic Insights

Linden Lab

San Francisco, California, United States (On-Site)
1 Month ago
Tencent - Business Analyst - Level Infinite Pass

Tencent

Shenzhen, Guangdong Province, China (On-Site)
2 Months ago
Epic Games - Technical Director, Machine Learning Programmer

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Months ago
Next Level Business Services - Big data Architect with Azure Experience

Next Level Business Services

Columbus, Indiana, United States (On-Site)
6 Months ago
PlayStation Global - Senior Technical Program Manager

PlayStation Global

San Francisco, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Netflix - Senior Software Engineer, Partner Engineering - APAC

Netflix

Hsinchu, Hsinchu City, Taiwan (On-Site)
5 Months ago
DNEG - Character TD (DNEG ANIMATION)

DNEG

London, England, United Kingdom (On-Site)
11 Months ago
ByteDance - Senior Software Engineer, Global Payment Risk & Compliance

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
CloudLinux - Senior Go Developer

CloudLinux

Masovian Voivodeship, Poland (Remote)
1 Month ago
Amber - Senior Unity Game Engineer (Project Based)

Amber

Brazil (On-Site)
9 Months ago
Escape Velocity Entertainment - Lead Gameplay Engineer | North America | Canada | Europe | Fully Remote

Escape Velocity Entertainment

(Remote)
3 Months ago
CD PROJEKT RED - Intern in Engineering team (3C's Gameplay)

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
ByteDance - Hardware Interaction Industrial Designer

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Wargaming - QA Engineer

Wargaming

Belgrade, Serbia (Hybrid)
2 Months ago
NVIDIA - Senior Manager, SONiC Software

NVIDIA

Ra'anana, Center District, Israel (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United Kingdom

The Walt Disney Company - Senior Analyst, Workforce Technology (12-Month FTC)

The Walt Disney Company

London, England, United Kingdom (On-Site)
3 Months ago
DraftKings - Senior Software Engineer

DraftKings

London, England, United Kingdom (On-Site)
1 Month ago
Every matrix - UX/UI Designer

Every matrix

London, England, United Kingdom (Hybrid)
2 Months ago
version 1 - In-House Counsel

version 1

London, England, United Kingdom (Hybrid)
4 Months ago
Zeta - Chief Operations Officer - Credit Cards

Zeta

United Kingdom (On-Site)
6 Months ago
Twitch - Senior Manager, EMEA Partnerships

Twitch

London, England, United Kingdom (On-Site)
3 Months ago
Rockstar Games - Senior Gameplay Systems Programmer

Rockstar Games

Edinburgh, Scotland, United Kingdom (On-Site)
2 Months ago
Mozilla - Staff Machine Learning Engineer, Gen AI

Mozilla

United Kingdom (Remote)
6 Months ago
ION - Implementation Engineer - 9951

ION

London, England, United Kingdom (On-Site)
6 Months ago
Octopus Deploy - Senior Field Marketing Manager

Octopus Deploy

England, United Kingdom (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Ubisoft - Data Operations Specialist

Ubisoft

Saint-Mandé, Île-de-France, France (Hybrid)
2 Months ago
Rackspace Technology - Trainee Data Scientist

Rackspace Technology

Dubai, Dubai, United Arab Emirates (Remote)
1 Month ago
CloudHire - Database Solution Architect

CloudHire

Gurugram, Haryana, India (Remote)
6 Months ago
Dream Games - Product Specialist

Dream Games

İstanbul, Türkiye (On-Site)
11 Months ago
Funcom - Telemetry QA Tester

Funcom

Bucharest, Bucharest, Romania (Hybrid)
1 Month ago
Spin Master - Business Analyst, Sourcing (Contract)

Spin Master

Kowloon, Hong Kong (On-Site)
2 Months ago
SLAY - Marketing Data Analyst (SKAN Attribution, LTV forecasting)

SLAY

Berlin, Berlin, Germany (On-Site)
1 Month ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
3 Months ago
Balbix - Staff AI Engineer

Balbix

Bengaluru, Karnataka, India (On-Site)
6 Months ago
PwC - IN_Senior Associate_Qlikview_D&A_Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded