Data Engineer

7 Months ago • 3 Years + • Data Analyst

Job Summary

Job Description

This Data Engineer role within Millennium's latency-critical trading group involves building and maintaining a low-latency data platform for systematic portfolio engines. Responsibilities include monitoring and analyzing market data quality, identifying and resolving data gaps, documenting exchange microstructure behavior and message timestamp rules, conducting alpha research, building data acquisition tools, collaborating with vendors and portfolio managers, performing data cleaning and transformation, and developing data analysis and visualization tools. The ideal candidate will possess strong programming skills (Python, C++, SQL), data analysis expertise (R, MatLab, etc.), and a deep understanding of statistical testing methods. The role requires handling large datasets in a hybrid cloud environment and building high-performance analytical systems.
Must have:
  • PhD or Master's in relevant field or equivalent experience
  • 3+ years of financial industry experience
  • Python and C++ programming expertise
  • Data analysis experience (R, MatLab, etc.)
  • SQL programming skills
  • Strong problem-solving skills
Good to have:
  • Experience with systematic investing teams
  • Experience with PCAP, PCAPNG, PTP

Job Details

About the job

Millennium is a global investment management firm, built on a sophisticated operating system at scale. We seek to pursue a diverse array of investment strategies, and we empower our employees to deliver exceptional outcomes and enable our portfolio managers to do what they do best – navigate the markets.

Job Description

We are building a world-class systematic data platform which will power the next generation of our systematic portfolio engines.

The latency critical trading group is looking for a Data Scientist/Engineer to join our growing team. The team consists of low latency linux engineers, network engineers, datacenter engineers, and C++ engineers who are responsible for building our low latency stack.

This is an opportunity for individuals who are passionate about quantitative investing. The role builds individual’s knowledge and skills in four key areas of quantitative investing, namely: data, statistics, technology, and financial markets.

Desirable Candidates

  • Ph.D. or master's in computer science, mathematics, statistics, or other field requiring quantitative analysis or equivalent experience
  • Three years of financial industry experience
  • Experience working with systematic investing teams is a plus
  • Programming expertise in Python and C++
  • Data analysis experience with R, MatLab, scitoolkit, pytorch, or similar
  • Programming skills in SQL
  • Strong problem-solving skills
  • Effective communication skills
  • Strong understanding of modern statistical testing methods

Job Responsibilities

  • Monitoring and Analysis
    • Accessing quality of all captured market data - both live and historical
    • Inventorying all gaps and handling closing gaps via multiple techniques (other internal captures, vendor data, exchange data, etc)
    • Extending parsing and identification of other gaps
    • Understanding and Documenting session times including holiday schedules
    • Comparing day-on-day changes in latency, data rate, bursts, etc
  • Research
    • Documenting history of exchange microstructure behavior changes
    • Understanding and Documenting message timestamp rules for each exchange
    • Documenting history of session schedule changes and protocols
    • Alpha research and presentation to portfolio managers and trading teams
    • Building technology tools to acquire and tag datasets
    • Engaging with vendors, brokers to understand characteristics of datasets
    • Interacting with portfolio managers and quantitative analysts to understand their use cases
    • Building exchange microstructure expertise and helping educate clients as needed
    • Analyzing datasets to generate key descriptive statistics
    • Cleaning historical data
    • Utilizing and maintaining world-class data processing and transformation techniques
  • Tools
    • Building data analysis tools on top of our captured data
    • Improving data visualization tools and capabilities
  • Technical
    • Consolidating several PCAPs in a single PCAPNG with meta-data to represent capture location/time across capture regions
    • Assessing PTP (Precision Time Protocol) quality within a sole source and across multiple Manage large data sets in a hybrid multi-cloud/on-prem sources environment
    • Build performant systems able to analyze terabytes of data quickly
Enhance firm C++ analytics and expose them in a python environment

Similar Jobs

Demandbase - Staff Software Engineer (Data Platform)

Demandbase

Hyderabad, Telangana, India (Remote)
2 Weeks ago
ByteDance - Quality Analyst - ADSEO (Safety)

ByteDance

Gurugram, Haryana, India (On-Site)
1 Month ago
Google - Process Excellence Consultant

Google

Gurugram, Haryana, India (On-Site)
1 Month ago
Zynga - Product Designer

Zynga

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
NCR Voyix - COE Tax Analyst II

NCR Voyix

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Zengame Technology - Advertisement Optimizer

Zengame Technology

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
Epic Games - Third Party Risk Management Analyst

Epic Games

Cary, North Carolina, United States (On-Site)
2 Months ago
GoTo Group - Senior Data Analyst

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
7 Months ago
InMobiInMobi - Intern - Strategic Initiatives

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Playrix - Data QA Engineer

Playrix

Serbia (Remote)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Meta - Hardware Systems Engineer, NPI

Meta

Menlo Park, California, United States (On-Site)
6 Months ago
Gupta - Data Analyst

Gupta

Boston, Massachusetts, United States (On-Site)
1 Month ago
AI Dash - Founder's Office Analyst

AI Dash

Bengaluru, Karnataka, India (Hybrid)
3 Weeks ago
Unity - Performance Manager

Unity

Beijing, China (On-Site)
1 Week ago
Zinnia - Sr Data Engineer I

Zinnia

Gurugram, Haryana, India (On-Site)
3 Weeks ago
Escape Velocity Entertainment - Site Reliability Engineer

Escape Velocity Entertainment

(Remote)
2 Months ago
Philips - Senior Quality Engineer-Data Analytics

Philips

Bothell, Washington, United States (On-Site)
2 Weeks ago
Highspot - Principal Engineer, Interact Analytics Experiences (Platform/Full-Stack/In-App)

Highspot

Seattle, Washington, United States (Hybrid)
1 Month ago
prizepicks - Senior Data Science Engineer

prizepicks

Atlanta, Georgia, United States (Hybrid)
1 Month ago
PwC - Forensics - Threat Intelligence Analyst  - Deals

PwC

Amman, Amman Governorate, Jordan (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Nium - Director - Compliance Operations

Nium

Mumbai, Maharashtra, India (On-Site)
1 Week ago
AI Dash - Technical Writer

AI Dash

Bengaluru, Karnataka, India (Hybrid)
3 Weeks ago
Google - Site Reliability Manager, Platforms and Devices, SRE

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Capgemini - Intellimach Developer

Capgemini

Pune, Maharashtra, India (On-Site)
3 Weeks ago
Dynamic next - Customer Support Executive (Games)

Dynamic next

India (On-Site)
2 Weeks ago
NCR Atleos - DevOps Engineer I

NCR Atleos

Gurugram, Haryana, India (On-Site)
2 Weeks ago
spauldingridge - OneStream Technical Consultant

spauldingridge

Jaipur, Rajasthan, India (On-Site)
1 Month ago
Opendoor - Automation Engineer

Opendoor

Chennai, Tamil Nadu, India (Hybrid)
2 Weeks ago
Haleon - Expert Sales Executive

Haleon

Chinsurah, West Bengal, India (On-Site)
1 Week ago
Enphase Energy - DevOps Engineer

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

ION - Data Operations ( Markets - Shared Services)

ION

Woking, England, United Kingdom (On-Site)
7 Months ago
PwC - IN-Senior Associate_ ETL Databricks _D&A_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
DraftKings - Senior Analyst, Digital Marketing

DraftKings

Boston, Massachusetts, United States (On-Site)
2 Months ago
Rockstar Games - Senior Data Engineer

Rockstar Games

Andover, Massachusetts, United States (On-Site)
3 Months ago
ION - Data Center Architect, Italy

ION

Italy (Hybrid)
7 Months ago
Magna International - Data Scientist

Magna International

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Token Metrics - Senior Crypto Data Engineer (Remote)

Token Metrics

Budapest, Hungary (Remote)
7 Months ago
InMobiInMobi - Intern - Strategic Initiatives

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Rockstar Games - Tech Lead, Analytics Engineering

Rockstar Games

New York, New York, United States (On-Site)
3 Months ago
Electronic Arts - Manager, Market Intelligence & Corporate Strategy

Electronic Arts

Redwood City, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded