Data Engineer

2 Months ago • 3 Years + • Data Analysis

Job Summary

Job Description

As a Data Engineer at Interactive Brokers, you will be responsible for developing and maintaining ETL workflows, processing data from Kafka streams, implementing data transformation logic, creating and optimizing data models, building automated data quality checks, and contributing to architectural decisions. You will be working with cutting-edge technologies, including AWS cloud services and real-time data processing to transform financial transaction data into valuable business intelligence and regulatory reporting. This role requires strong analytical, problem-solving, and communication skills. The job involves designing, developing, and maintaining ETL workflows using AWS services, processing data from Kafka streams and S3 storage to generate insights, implementing data transformation logic using Python, PySpark, and PyAthena, creating and optimizing data models, building automated data quality checks, and troubleshooting data pipeline issues. The team focuses on transforming financial transaction data into valuable business intelligence and regulatory reporting.
Must have:
  • 3+ years of experience in Python, PySpark and PyAthena.
  • Experience with ETL processes and data warehousing concepts.
  • Familiarity with AWS cloud technologies (S3, Glue, Athena, EMR)
  • Experience with ELK Stack (Elasticsearch, Logstash, Kibana)
  • Strong understanding of databases and SQL
  • An analytical mind and business acumen
  • Strong communication skills
Good to have:
  • Experience with financial markets or brokerage industry.
  • Experience with business intelligence tools like Tableau.
  • Experience with version control systems (e.g. Git, BitBucket)
  • Experience with CI/CD Practices and Tools
Perks:
  • Competitive salary, annual performance-based bonus and stock grant
  • Retirement plan 401(k) with company match
  • Excellent health and wellness benefits
  • Paid time off and generous parental leave policy
  • Daily company lunch allowance and fully stocked kitchen
  • Corporate events, including team outings, dinners, and sports teams
  • Education reimbursement and learning opportunities
  • Modern offices with multi-monitor setups

Job Details

Company Overview

Interactive Brokers Group, Inc. (Nasdaq: IBKR) is a global financial services company headquartered in Greenwich, CT, USA, with offices in over 15 countries. We have been at the forefront of financial innovation for over four decades, known for our cutting-edge technology and client commitment.

IBKR affiliates provide global electronic brokerage services around the clock on stocks, options, futures, currencies, bonds, and funds to clients in over 200 countries and territories. We serve individual investors and institutions, including financial advisors, hedge funds and introducing brokers. Our advanced technology, competitive pricing, and global market help our clients to make the most of their investments.

Barron's has recognized Interactive Brokers as the #1 online broker for six consecutive years. Join our dynamic, multi-national team and be a part of a company that simplifies and enhances financial opportunities using state-of-the-art technology.

This is a hybrid role (3 days in the office/2 days remote).

Job Summary: 

Develop our comprehensive data processing pipeline transforming on-premises Kafka streams into both actionable business insights and regulatory compliance reports through AWS cloud services (S3, Glue, Athena, EMR). Design robust ETL processes and build automated, scalable data solutions aligned with our zero-maintenance vision, delivering high-quality outputs for both business decision-making and regulatory requirements.

About your team:

We are the Realtime Order Analytics and Reporting team, a dynamic group focused on transforming financial transaction data into valuable business intelligence and regulatory reporting. Our team:
  • Works with cutting-edge technologies, including AWS cloud services and realtime data processing
  • Operates in a collaborative environment where innovation and ideas are encouraged
  • Maintains a balance between technical excellence and business impact
  • Values automation and efficiency in all our solutions
  • Fosters continuous learning and professional development
  • Plays a critical role in supporting business decision-making and ensuring regulatory compliance
  • Embraces agile methodologies to deliver high-quality solutions efficiently
We're looking for someone who shares our passion for data engineering and wants to make a significant impact by turning complex financial data into actionable insights.

What will be your responsibilities within IBKR: 

  • Designing, developing, and maintaining ETL workflows using AWS services
  • Processing data from Kafka streams and S3 storage to generate insights
  • Implementing data transformation logic using Python, PySpark, and PyAthena
  • Creating and optimizing data models for both analytical and regulatory reporting needs
  • Building automated data quality checks and monitoring systems
  • Developing and maintaining documentation for data pipelines and processes
  • Troubleshooting and resolving data pipeline issues
  • Contributing to architectural decisions for data infrastructure
  • Ensuring data solutions meet performance, security, and compliance requirements
  • Continuously improving our data systems for scalability and reduced maintenance

 Which skills are required:

  • Bachelor's or master's degree in Computer Science or a related field
  • 3+ years of professional software engineering experience in Python, PySpark and PyAthena
  • 3+ years of professional experience in Python as a primary language (non-scripting)
  • Extensive experience in Pandas or NumPy
  • Experience with ETL processes and data warehousing concepts
  • Familiarity with cloud technologies, particularly AWS (S3, Glue, Athena, EMR)
  • Experience using ELK Stack (Elasticsearch, Logstash, Kibana)
  • Thorough understanding of databases and SQL
  • 1+ years of professional experience with Linux operating systems
  • An analytical mind and business acumen
  • Strong communication skills

Good to have: 

  • Experience with financial markets or the brokerage industry
  • Experience with business intelligence tools, especially Tableau
  • Experience with version control systems (e.g., Git, BitBucket)
  • Experience with CI/CD Practices and Tools

 To be successful in this position, you will have the following:

  • Self-motivated and able to handle tasks with minimal supervision.
  • Superb analytical and problem-solving skills.
  • Excellent collaboration and communication (Verbal and written) skills.
  • Outstanding organizational and time management skills.

Company Benefits & Perks

  • Competitive salary, annual performance-based bonus and stock grant
  • Retirement plan 401(k) with competitive company match
  • Excellent health and wellness benefits, including medical, dental, and vision benefits, and a company-paid medical healthcare premium.
  • Wellness screenings and assessments, health coaches and counseling services through an Employee Assistance Program (EAP)
  • Paid time off and a generous parental leave policy
  • Daily company lunch allowance provided, and a fully stocked kitchen with healthy options for breakfast and snacks
  • Corporate events, including team outings, dinners, volunteer activities and company sports teams
  • Education reimbursement and learning opportunities
  • Modern offices with multi-monitor setups

Similar Jobs

Regrello - Consultant - Expert Services

Regrello

United States (Remote)
2 Months ago
The Walt Disney Company - Sr Principal Software Engineer

The Walt Disney Company

Orlando, Florida, United States (On-Site)
4 Months ago
Publicis Groupe - Strategy Director (European Market)

Publicis Groupe

London, England, United Kingdom (Hybrid)
2 Weeks ago
ARVORE Immersive Experiences - Game UX/UI Designer

ARVORE Immersive Experiences

São Paulo, State Of São Paulo, Brazil (Remote)
4 Months ago
Rackspace Technology - Site Reliability Engineer III

Rackspace Technology

India (Remote)
5 Months ago
NetEase Games - Data Scientist

NetEase Games

Singapore (On-Site)
2 Weeks ago
Patreon - Senior Data Scientist

Patreon

New York, United States (Hybrid)
2 Weeks ago
bytedance - Risk Data Analytics Business Partner - E-Commerce - Seattle

bytedance

Seattle, Washington, United States (On-Site)
8 Months ago
Trek - Business Analyst (Mobile)

Trek

Haryana, India (On-Site)
5 Months ago
EXUSIA - Microsoft Azure Fabric - Senior Data Engineer IN

EXUSIA

India (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

USE Insider - Solution Architect - Germany

USE Insider

Berlin, Berlin, Germany (Hybrid)
9 Months ago
Safe security - FAIR Enablement Specialist

Safe security

New York, United States (On-Site)
3 Weeks ago
Eleventh Hour Games - UI Artist

Eleventh Hour Games

Austin, Texas, United States (Remote)
2 Years ago
Nice - Senior Advanced Support Engineer (L2 Support)

Nice

Pune, Maharashtra, India (Hybrid)
1 Month ago
Oliver Agency - GenAI Motion Graphic Designer

Oliver Agency

Ho Chi Minh City, Vietnam (Hybrid)
3 Months ago
PwC - Manager Digital Transformation - SAP Technology

PwC

Amsterdam, North Holland, Netherlands (Hybrid)
10 Months ago
Spyke Games - Game Developer

Spyke Games

İstanbul, Türkiye (On-Site)
1 Year ago
Diligent Corporation - Product Marketing Manager

Diligent Corporation

London, England, United Kingdom (Hybrid)
2 Weeks ago
Tide - Reconciliations Analyst

Tide

Bulgaria (On-Site)
4 Weeks ago
Reddit - Engineering Manager - Ads Experimentation Platform

Reddit

United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Greenwich, Connecticut, United States

Meow Wolf - Technical Director

Meow Wolf

Santa Fe, New Mexico, United States (On-Site)
2 Weeks ago
Shield AI - Senior Systems Administrator (R3668)

Shield AI

Dallas, Texas, United States (On-Site)
1 Week ago
Nice - Lead Software Engineer

Nice

Richardson, Texas, United States (Hybrid)
4 Weeks ago
Genies.io - Senior Machine Learning Engineer: 3D Generative AI

Genies.io

Los Angeles, California, United States (On-Site)
4 Weeks ago
beghou consulting - Sr. Consultant

beghou consulting

Boston, Massachusetts, United States (Hybrid)
9 Months ago
bounteous - Murex Functional Analyst (Front Office)

bounteous

New York, United States (On-Site)
1 Month ago
Open Systems Technologies - Named Account Manager - SLED

Open Systems Technologies

Oklahoma City, Oklahoma, United States (Remote)
2 Weeks ago
Brillio - Lead Data Engineer

Brillio

Phoenix, Arizona, United States (Remote)
1 Week ago
Kavalirio - Business Process Analyst

Kavalirio

Irving, Texas, United States (Remote)
2 Weeks ago
bytedance - Research Scientist, Vision Foundation Model

bytedance

San Jose, California, United States (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Yodlee - Senior Data Engineer

Yodlee

Thiruvananthapuram, Kerala, India (On-Site)
2 Months ago
Apple - AIML - Sr Backend Engineer, Data and ML Innovation

Apple

Seattle, Washington, United States (On-Site)
1 Week ago
undefined - Senior Data Engineer

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
2 Months ago
Epic Games - Principal Data Analyst

Epic Games

New York, New York, United States (On-Site)
3 Months ago
PayPal - Screening Platform & Filter Sr Data Scientist

PayPal

Scottsdale, Arizona, United States (Hybrid)
1 Week ago
Apple - AIML - Data Scientist, Data Operations

Apple

Seattle, Washington, United States (On-Site)
1 Month ago
Gameopedia - Data Scientist

Gameopedia

Norway (Hybrid)
4 Months ago
Adyen - Senior Data Engineer

Adyen

Amsterdam, North Holland, Netherlands (On-Site)
4 Weeks ago
quience - Data Scientist, ML - Storefront

quience

Palo Alto, California, United States (On-Site)
3 Months ago
zeta - Data Scientist II

zeta

Bengaluru, Karnataka, India (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Interactive Brokers Group, Inc. (NASDAQ: "IBKR") is a direct access electronic broker catering to the needs of professional and frequent traders, institutional investors, financial advisers, and introducing brokers. For over 40 years, Interactive Brokers has been the pioneer of the electronic trading revolution. We rapidly scaled from a small U.S. options market-maker into a sizable global trading firm by leveraging the power of technology and automation. We are committed to delivering value through technological innovation and providing our clients with unprecedented access to global markets at the lowest cost.

Dublin, County Dublin, Ireland (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Budapest, Hungary (Hybrid)

Mumbai, Maharashtra, India (Hybrid)

Mumbai, Maharashtra, India (Hybrid)

Chicago, Illinois, United States (Hybrid)

Tokyo, Japan (On-Site)

Fort Lauderdale, Florida, United States (Hybrid)

Greenwich, Connecticut, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Interactive Brokers

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug