Senior Data Engineer

1 Month ago • All levels • Data Analysis

Job Summary

Job Description

This is a rare opportunity for an experienced Data Engineer to become both steward and champion for the firm's market and trading data archives and internal data products. You will work with existing data pipelines and databases while designing and implementing the next generation of Auros data and analytic capabilities. You’ll enjoy taking on responsibilities where you’ll have the opportunity to make a substantial impact on business outcomes. You’ll learn from our experienced trading team and help develop and support systems that execute millions of trades on crypto exchanges across the globe.
Must have:
  • Develop, test and maintain high throughput, high volume distributed data architectures
  • Analyze, define and automate data quality improvements
  • Build and improve trading analytics systems
  • Create tools to automate configuration, deployment, building and troubleshooting of data pipelines
  • Develop strategies to make data pipeline efficient, timely and robust
  • Implement monitoring that measures completeness and accuracy of captured data
  • Manage impact of changes to trading systems and upstream protocols on data pipeline
  • Collaborate with traders and trading system developers to understand data analysis requirements
  • Develop tools, APIs and screens to provide easy access to archived data
Good to have:
  • Experience with data lakes, Amazon S3 or similar
  • Experience developing in C++ on Linux
  • Protocol level network analysis experience
  • Experience with Terraform
  • Experience with Clickhouse
  • Experience with technologies such as Hive, Hadoop, Snowflake, Presto or similar

Job Details

Auros is a leading algorithmic trading and market-making firm specialising in digital asset liquidity provision. We trade across 10+ global locations, facilitating 3-4% of global daily volumes, and have through connectivity to over 50 venues.

We’re proud of the strong reputation we’ve built by combining our systematic approach, sophisticated pricing models, and state-of-the-art execution capabilities to provide robust, reliable trading performance and bring liquidity to crypto markets worldwide.

What sets us apart, though, is our culture. Our flat structure means you’ll have autonomy and plenty of opportunity to bring your ideas to life and help shape the systems that will power our business into the future.

Summary of Position:

This is a rare opportunity for an experienced Data Engineer to become both steward and champion for the firm's market and trading data archives and internal data products

You will work with our existing data pipelines and databases while designing and implementing the next generation of Auros data and analytic capabilities. You’ll enjoy taking on responsibilities where you’ll have the opportunity to make a substantial impact on the business outcomes through the work you do every day.

You’ll learn from our experienced trading team and help develop and support systems that execute millions of trades on crypto exchanges across the globe.

Job responsibilities include:

  • Develop, test and maintain high throughput, high volume distributed data architectures
  • Analyze, define and automate data quality improvements
  • Build and improve trading analytics systems
  • Create tools to automate the configuration, deployment, building and troubleshooting of the data pipelines.
  • Develop strategies to make our data pipeline efficient, timely and robust in a 24/7 trading environment
  • Implement monitoring that measures the completeness and accuracy of captured data
  • Manage the impact that changes to trading systems and upstream protocols have on the data pipeline
  • Collaborate with traders and trading system developers to understand our data analysis requirements, and to continue to improve the quality of our stored data
  • Develop tools, APIs and screens to provide easy access to the archived data

Position Requirements:

  • Experience with Python, Tick databases (ie Clickhouse and/or Vertica) and Amazon S3
  • Experience with developing the collection of  real time large scale data pipelines (with petabytes of data)
  • Experience with computing cluster management in aws (ray, dask, etc)
  • Experience with building research pipelines on these large sets of data
  • Extensive experience conducting data analysis and other ad hoc tooling to analyse time series data sets and other large sets of data
  • A bachelor's degree (or above) in Computer Science, Software Engineering or similar, with excellent results.

And the following are highly desirable:

  • Experience with data lakes, Amazon S3 or similar
  • Experience developing in C++ on linux
  • Protocol level network analysis experience
  • Experience with terraform
  • Experience with Clickhouse
  • Experience with technologies such as Hive, Hadoop, Snowflake, Presto or similar.

Similar Jobs

Apple - Embedded System Software Engineer

Apple

San Diego, California, United States (On-Site)
3 Months ago
Capgemini - Senior OSS Integration Specialist

Capgemini

Bengaluru, Karnataka, India (On-Site)
3 Months ago
HCL Tech - SFDC Apex Technical Lead (LWC, Admin)

HCL Tech

Texas, United States (On-Site)
2 Months ago
LLNL - Electronics Technologist/Sr. Electronics Technologist

LLNL

Livermore, California, United States (On-Site)
1 Month ago
Iron Mountain - Imaging Operations Supervisor

Iron Mountain

Atlanta, Georgia, United States (On-Site)
1 Month ago
Sigma Software - Senior Data Engineer

Sigma Software

Ukraine (Remote)
1 Month ago
Capgemini - Risk and Finance Data Analyst-Python (AWS OR ADB)

Capgemini

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Betson Group - Data & Reporting Analyst

Betson Group

Tbilisi, Tbilisi, Georgia (On-Site)
1 Month ago
Capgemini - Business Analyst

Capgemini

Mumbai, Maharashtra, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Alten Technology - Verification and Validation Engineer

Alten Technology

El Segundo, California, United States (On-Site)
1 Month ago
oni - Customer Service Engineer

oni

Boston, Massachusetts, United States (Remote)
1 Year ago
Open Systems Technologies - Senior Cloud Native Engineer

Open Systems Technologies

Amersfoort, Utrecht, Netherlands (Remote)
1 Month ago
creative assembly - Technical Artist

creative assembly

Horsham, England, United Kingdom (On-Site)
2 Months ago
Jane Street - Machine Learning Performance Engineer

Jane Street

New York, United States (On-Site)
1 Month ago
Abridge - AI Software Engineer Evaluation Platform

Abridge

San Francisco, California, United States (Hybrid)
1 Month ago
Nordson Corporation - Senior Principal Materials Engineer

Nordson Corporation

Salem, New Hampshire, United States (On-Site)
2 Months ago
Varonis  - Security Specialist (Tier 2)

Varonis

United States (Remote)
3 Months ago
Cadence - Software Engineer II

Cadence

Ahmedabad, Gujarat, India (On-Site)
2 Months ago
Interactive Brokers - Network Operations Engineer

Interactive Brokers

India (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United Kingdom

London stock Exchange - Senior Java Engineering Lead - Digital Markets Infrastructure

London stock Exchange

London, England, United Kingdom (On-Site)
1 Year ago
Expedia - Director, Advertising Operations EMEA & APAC

Expedia

London, England, United Kingdom (On-Site)
1 Month ago
deel. - Senior Backend Engineer, Node.js + AWS

deel.

United Kingdom (Remote)
1 Month ago
Tesla - Service Advisor

Tesla

England, United Kingdom (On-Site)
6 Months ago
Thales - Senior Contracts Manager

Thales

Belfast, Northern Ireland, United Kingdom (Hybrid)
1 Year ago
USE Insider - Partnership Director - UK

USE Insider

London, England, United Kingdom (Hybrid)
1 Month ago
Marsh McLennan - Senior Leader - Fiduciary

Marsh McLennan

Norwich, England, United Kingdom (Hybrid)
3 Months ago
hogarth - Prompt Engineer

hogarth

London, England, United Kingdom (Hybrid)
1 Month ago
HCL Tech - Avaloq Consultant

HCL Tech

London, England, United Kingdom (On-Site)
3 Months ago
C3 IoT - Site Reliability Engineer – Field Operations

C3 IoT

London, England, United Kingdom (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Google - Data Center Facilities Engineer, Electrical (English, Japanese)

Google

Inzai, Chiba, Japan (On-Site)
8 Months ago
Moloco - Senior Data Scientist, Growth Analytics

Moloco

Berlin, Berlin, Germany (On-Site)
3 Months ago
Remote - Senior Product Data Analyst

Remote

Netherlands (Remote)
1 Month ago
Morning Star - Senior Data Scientist

Morning Star

Mumbai, Maharashtra, India (Hybrid)
1 Year ago
Oliver Agency - GenAI Creative Optimisation Analyst (Senior Data Analyst)

Oliver Agency

Mumbai, Maharashtra, India (Hybrid)
1 Month ago
Apple - Data Visualization / BI Engineer

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Crunchyroll - Senior Data Engineer - Platform Engineering

Crunchyroll

San Francisco, California, United States (Remote)
8 Months ago
endava - GCP Data Architect

endava

Berlin, Berlin, Germany (Hybrid)
2 Months ago
Fortra - Lead Data Scientist

Fortra

United States (Remote)
1 Month ago
Brillio - Principal Data Engineer

Brillio

San Francisco, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Auros is a leading cryptocurrency market making and high-frequency trading firm operating across all major venues and instruments. A 24/7/365 business, we possess a world-class team of trading and engineering talent across 30 geographies globally, combining remote work and physical offices in Hong Kong and New York. Auros is one of the largest participants in cryptocurrency markets, generating daily notional turnover in the billions of dollars. Our long-standing technological heritage combines a systematic approach with sophisticated pricing models and state-of-the-art execution capabilities, regularly iterating to ensure robust, reliable trading performance.
View All Jobs

Get notified when new jobs are added by Auros Global

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug