Data Engineer

4 Months ago • 3 Years + • Data Analyst

Job Summary

Job Description

This Data Engineer role within Millennium's latency-critical trading group involves building and maintaining a low-latency data platform for systematic portfolio engines. Responsibilities include monitoring and analyzing market data quality, identifying and resolving data gaps, documenting exchange microstructure behavior and message timestamp rules, conducting alpha research, building data acquisition tools, collaborating with vendors and portfolio managers, performing data cleaning and transformation, and developing data analysis and visualization tools. The ideal candidate will possess strong programming skills (Python, C++, SQL), data analysis expertise (R, MatLab, etc.), and a deep understanding of statistical testing methods. The role requires handling large datasets in a hybrid cloud environment and building high-performance analytical systems.
Must have:
  • PhD or Master's in relevant field or equivalent experience
  • 3+ years of financial industry experience
  • Python and C++ programming expertise
  • Data analysis experience (R, MatLab, etc.)
  • SQL programming skills
  • Strong problem-solving skills
Good to have:
  • Experience with systematic investing teams
  • Experience with PCAP, PCAPNG, PTP

Job Details

About the job

Millennium is a global investment management firm, built on a sophisticated operating system at scale. We seek to pursue a diverse array of investment strategies, and we empower our employees to deliver exceptional outcomes and enable our portfolio managers to do what they do best – navigate the markets.

Job Description

We are building a world-class systematic data platform which will power the next generation of our systematic portfolio engines.

The latency critical trading group is looking for a Data Scientist/Engineer to join our growing team. The team consists of low latency linux engineers, network engineers, datacenter engineers, and C++ engineers who are responsible for building our low latency stack.

This is an opportunity for individuals who are passionate about quantitative investing. The role builds individual’s knowledge and skills in four key areas of quantitative investing, namely: data, statistics, technology, and financial markets.

Desirable Candidates

  • Ph.D. or master's in computer science, mathematics, statistics, or other field requiring quantitative analysis or equivalent experience
  • Three years of financial industry experience
  • Experience working with systematic investing teams is a plus
  • Programming expertise in Python and C++
  • Data analysis experience with R, MatLab, scitoolkit, pytorch, or similar
  • Programming skills in SQL
  • Strong problem-solving skills
  • Effective communication skills
  • Strong understanding of modern statistical testing methods

Job Responsibilities

  • Monitoring and Analysis
    • Accessing quality of all captured market data - both live and historical
    • Inventorying all gaps and handling closing gaps via multiple techniques (other internal captures, vendor data, exchange data, etc)
    • Extending parsing and identification of other gaps
    • Understanding and Documenting session times including holiday schedules
    • Comparing day-on-day changes in latency, data rate, bursts, etc
  • Research
    • Documenting history of exchange microstructure behavior changes
    • Understanding and Documenting message timestamp rules for each exchange
    • Documenting history of session schedule changes and protocols
    • Alpha research and presentation to portfolio managers and trading teams
    • Building technology tools to acquire and tag datasets
    • Engaging with vendors, brokers to understand characteristics of datasets
    • Interacting with portfolio managers and quantitative analysts to understand their use cases
    • Building exchange microstructure expertise and helping educate clients as needed
    • Analyzing datasets to generate key descriptive statistics
    • Cleaning historical data
    • Utilizing and maintaining world-class data processing and transformation techniques
  • Tools
    • Building data analysis tools on top of our captured data
    • Improving data visualization tools and capabilities
  • Technical
    • Consolidating several PCAPs in a single PCAPNG with meta-data to represent capture location/time across capture regions
    • Assessing PTP (Precision Time Protocol) quality within a sole source and across multiple Manage large data sets in a hybrid multi-cloud/on-prem sources environment
    • Build performant systems able to analyze terabytes of data quickly
Enhance firm C++ analytics and expose them in a python environment

Similar Jobs

ION - Product Management Analyst

ION

Pune, Maharashtra, India (On-Site)
5 Months ago
Cadence - Lead C++ Software Engineer

Cadence

San Jose, California, United States (On-Site)
6 Months ago
SmileGate - [Next Crossfire] UE5 엔진 클라이언트 담당

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
3 Months ago
Virtuos - Lead Software Engineer

Virtuos

Singapore (On-Site)
1 Week ago
CD PROJEKT RED - Intern in Online Services Team (C++)

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
4 Weeks ago
Hawk Eye Innovations - Data Processing Assistant

Hawk Eye Innovations

Atlanta, Georgia, United States (On-Site)
5 Days ago
Axinous - Associate, Strategic Finance/Investor Relations

Axinous

Hyderabad, Telangana, India (Remote)
1 Week ago
Head Digital Works - Data Scientist

Head Digital Works

Hyderabad, Telangana, India (On-Site)
9 Months ago
Head Digital Works - Business Intelligence Analyst

Head Digital Works

Hyderabad, Telangana, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Interactive Brokers - Senior Software Engineer

Interactive Brokers

Greenwich, Connecticut, United States (On-Site)
5 Months ago
Rockstar Games - Graphics Programmer

Rockstar Games

Oakville, Ontario, Canada (On-Site)
6 Days ago
CD PROJEKT RED - Engineering Intern (Generalist)

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Weeks ago
Playrix - Director of Engineering

Playrix

Serbia (Remote)
5 Months ago
NVIDIA - Senior Developer Relations Manager – Strategic Accounts

NVIDIA

Seoul, South Korea (On-Site)
2 Months ago
Inworld AI - Staff C++ Developer

Inworld AI

Vancouver, British Columbia, Canada (On-Site)
6 Days ago
NVIDIA - Senior Firmware Engineer - Memory Subsystem

NVIDIA

Canada (On-Site)
1 Month ago
Moon Active - Software Developer

Moon Active

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Dream Sports - SDE3 - Full Stack Developer

Dream Sports

Mumbai, Maharashtra, India (On-Site)
5 Months ago
PwC - IN-Associate_Azure Devops_MS Engg_Advisory_Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
5 Months ago
Ajackus - Senior QA Automation Engineer

Ajackus

India (Remote)
7 Months ago
Saama Technologies,  Inc  - Senior Site Reliability Engineer

Saama Technologies, Inc

Chennai, Tamil Nadu, India (On-Site)
5 Months ago
PwC - IN_Director_Procurement_ Supply Chain  _Advisory_Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
6 Months ago
CloudHire - Software Engineer, Backend

CloudHire

India (Remote)
1 Week ago
Dream Sports - Senior Manager - Premium Sales

Dream Sports

Bengaluru, Karnataka, India (On-Site)
6 Days ago
Paytm - City Head - Hyderabad - QR sales

Paytm

Hyderabad, Telangana, India (On-Site)
5 Months ago
PwC - IN-Manager – SAP MDG -Enterprise Apps SAP– Advisory  - Pan India

PwC

Gurugram, Haryana, India (On-Site)
5 Months ago
DNEG - Chartered Accountant (India)

DNEG

Mumbai, Maharashtra, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Electronic Arts - Data Engineer

Electronic Arts

Bucharest, Bucharest, Romania (On-Site)
3 Weeks ago
Sawhorse Productions - Data Analyst

Sawhorse Productions

California, United States (Remote)
1 Week ago
Ubisoft - Fraud & Analyst Assistant - Internship

Ubisoft

Paris, Île-de-France, France (On-Site)
1 Week ago
ByteDance - Senior Data Scientist

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
Trend Micro - (Sr.) Data Engineer/AI Trainer

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago
Voodoo - Senior Data Analyst - Wizz

Voodoo

Paris, Île-de-France, France (Hybrid)
5 Days ago
Corsair - BI Developer

Corsair

Vietnam (On-Site)
1 Week ago
Warner Bros Games - Senior Data Scientist

Warner Bros Games

(Hybrid)
4 Weeks ago
The Workshop - Data Software Engineer

The Workshop

Málaga, Andalusia, Spain (Hybrid)
7 Months ago
PwC - IN-Senior Associate_Power BI_Data & Analytics_Advisory_Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded