Data Engineer

3 Months ago • 3 Years + • Data Analyst

Job Summary

Job Description

This Data Engineer role within Millennium's latency-critical trading group involves building and maintaining a low-latency data platform for systematic portfolio engines. Responsibilities include monitoring and analyzing market data quality, identifying and resolving data gaps, documenting exchange microstructure behavior and message timestamp rules, conducting alpha research, building data acquisition tools, collaborating with vendors and portfolio managers, performing data cleaning and transformation, and developing data analysis and visualization tools. The ideal candidate will possess strong programming skills (Python, C++, SQL), data analysis expertise (R, MatLab, etc.), and a deep understanding of statistical testing methods. The role requires handling large datasets in a hybrid cloud environment and building high-performance analytical systems.
Must have:
  • PhD or Master's in relevant field or equivalent experience
  • 3+ years of financial industry experience
  • Python and C++ programming expertise
  • Data analysis experience (R, MatLab, etc.)
  • SQL programming skills
  • Strong problem-solving skills
Good to have:
  • Experience with systematic investing teams
  • Experience with PCAP, PCAPNG, PTP

Job Details

About the job

Millennium is a global investment management firm, built on a sophisticated operating system at scale. We seek to pursue a diverse array of investment strategies, and we empower our employees to deliver exceptional outcomes and enable our portfolio managers to do what they do best – navigate the markets.

Job Description

We are building a world-class systematic data platform which will power the next generation of our systematic portfolio engines.

The latency critical trading group is looking for a Data Scientist/Engineer to join our growing team. The team consists of low latency linux engineers, network engineers, datacenter engineers, and C++ engineers who are responsible for building our low latency stack.

This is an opportunity for individuals who are passionate about quantitative investing. The role builds individual’s knowledge and skills in four key areas of quantitative investing, namely: data, statistics, technology, and financial markets.

Desirable Candidates

  • Ph.D. or master's in computer science, mathematics, statistics, or other field requiring quantitative analysis or equivalent experience
  • Three years of financial industry experience
  • Experience working with systematic investing teams is a plus
  • Programming expertise in Python and C++
  • Data analysis experience with R, MatLab, scitoolkit, pytorch, or similar
  • Programming skills in SQL
  • Strong problem-solving skills
  • Effective communication skills
  • Strong understanding of modern statistical testing methods

Job Responsibilities

  • Monitoring and Analysis
    • Accessing quality of all captured market data - both live and historical
    • Inventorying all gaps and handling closing gaps via multiple techniques (other internal captures, vendor data, exchange data, etc)
    • Extending parsing and identification of other gaps
    • Understanding and Documenting session times including holiday schedules
    • Comparing day-on-day changes in latency, data rate, bursts, etc
  • Research
    • Documenting history of exchange microstructure behavior changes
    • Understanding and Documenting message timestamp rules for each exchange
    • Documenting history of session schedule changes and protocols
    • Alpha research and presentation to portfolio managers and trading teams
    • Building technology tools to acquire and tag datasets
    • Engaging with vendors, brokers to understand characteristics of datasets
    • Interacting with portfolio managers and quantitative analysts to understand their use cases
    • Building exchange microstructure expertise and helping educate clients as needed
    • Analyzing datasets to generate key descriptive statistics
    • Cleaning historical data
    • Utilizing and maintaining world-class data processing and transformation techniques
  • Tools
    • Building data analysis tools on top of our captured data
    • Improving data visualization tools and capabilities
  • Technical
    • Consolidating several PCAPs in a single PCAPNG with meta-data to represent capture location/time across capture regions
    • Assessing PTP (Precision Time Protocol) quality within a sole source and across multiple Manage large data sets in a hybrid multi-cloud/on-prem sources environment
    • Build performant systems able to analyze terabytes of data quickly
Enhance firm C++ analytics and expose them in a python environment

Similar Jobs

Epic Games - UI Programming Director

Epic Games

Montreal, Quebec, Canada (On-Site)
5 Days ago
NVIDIA - Senior Onsite Interconnect Product Engineer

NVIDIA

(On-Site)
1 Month ago
ByteDance - Research Scientist in Machine Learning for Science (AML - AI-for-Science) - 2024 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
ByteDance - Software Engineer, ML System Architecture

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Supercell - Senior Client Programmer, Project R.I.S.E

Supercell

Shanghai, Shanghai, China (On-Site)
4 Months ago
Discord - Senior Data Engineer

Discord

San Francisco, California, United States (Remote)
2 Months ago
NVIDIA - System Software Engineer Intern, Apache Spark Solutions - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago
Lionsgate Games - Intern, Data Analytics - IT & Business Intelligence

Lionsgate Games

Santa Monica, California, United States (On-Site)
4 Days ago
Luxoft - Senior PL/SQL with ETL experience

Luxoft

Ukrainka, Kyiv Oblast, Ukraine (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

CD PROJEKT RED - Senior Gameplay Programmer

CD PROJEKT RED

Boston, Massachusetts, United States (Hybrid)
1 Week ago
Nintendo - Product Tester I

Nintendo

Redmond, Washington, United States (On-Site)
5 Months ago
CynLr - Software Engineer - GPU performance

CynLr

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ION - Technical Consultant - Endur

ION

New York, New York, United States (On-Site)
4 Months ago
Krafton  - [인조이스튜디오(신규 자회사)] Sr. Technical Artist (8년 이상)

Krafton

Seoul, South Korea (On-Site)
2 Months ago
Playrix - Principal C++ Software Engineer (Tools)

Playrix

Ukraine (Remote)
4 Months ago
Blizzard Entertainment - Principal Designer, Combat - Unannounced Game

Blizzard Entertainment

Irvine, California, United States (Hybrid)
4 Months ago
Milestone - Senior Embedded Software Engineer

Milestone

United States (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Mindtickle - Senior Instructional Designer

Mindtickle

Pune, Maharashtra, India (Hybrid)
4 Months ago
Infogain - User Interface Architect

Infogain

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Nagarro - Senior Engineer

Nagarro

Hyderabad, Telangana, India (On-Site)
4 Months ago
CloudHire - Full Stack Developer - Angular & Node

CloudHire

Mumbai, Maharashtra, India (Remote)
4 Months ago
Shaadi - Senior Software Engineer Node.js

Shaadi

Maharashtra, India (On-Site)
5 Months ago
Zeta - Sr. Associate Process & Compliance

Zeta

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Paytm - Sales Team Lead - Credit Card

Paytm

Mumbai, Maharashtra, India (On-Site)
4 Months ago
The Walt Disney Company - Sr Pipeline Technical Director

The Walt Disney Company

Mumbai, Maharashtra, India (On-Site)
3 Months ago
AMD - SOC Verification Lead ( Cache Coherence datapath Lead )

AMD

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Gunjan App Studios - Game Artist

Gunjan App Studios

Kolkata, West Bengal, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Nielsen Holdings - Junior Modeling Analyst

Nielsen Holdings

Warsaw, Masovian Voivodeship, Poland (Remote)
1 Month ago
Aristocrat Gaming - Data Engineer

Aristocrat Gaming

Kraków, Lesser Poland Voivodeship, Poland (Hybrid)
5 Months ago
Scopely - Analytics Engineering Manager

Scopely

Barcelona, Catalonia, Spain (Hybrid)
2 Weeks ago
Anthology  Inc  - Senior Data Analyst

Anthology Inc

Colombia (Remote)
1 Week ago
Hasbro - Principal Business Analyst

Hasbro

Renton, Washington, United States (On-Site)
3 Months ago
Playrix - Senior Data Analyst (Game)

Playrix

Montenegro (Remote)
4 Months ago
Rockstar Games - Senior Data Scientist, GTA+ Subscriptions

Rockstar Games

New York, New York, United States (On-Site)
5 Months ago
Luxoft - Senior Data Ops Engineer

Luxoft

(Remote)
3 Months ago
Nagarro - Associate Distinguished Engineer - Enterprise Data Architect

Nagarro

Allentown, Pennsylvania, United States (Remote)
4 Months ago
CloudHire - Data Curator/ entry operator

CloudHire

India (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded