Data Engineer for Market Data Projects (with Streamlit Expertise)

8 Months ago • 3-5 Years • Data Analysis

Job Summary

Job Description

Develop a scalable data platform for market data from various sources (vendors, research providers, exchanges, PBs, web scraping). Make data accessible to portfolio managers, and enterprise functions (Ops, Risk, Trading, Compliance). Build internal data products and analytics. Responsibilities include web scraping, maintaining a Snowflake/AWS platform, onboarding new data providers, and data migration projects. Enhance existing pipelines and develop new ones to meet evolving requirements. Strong DevOps skills (K8s, Docker, Jenkins) are essential.
Must have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • Good communication
  • DevOps (K8s, Docker, Jenkins)
Good to have:
  • Market Data Projects/Capital markets exp
  • Snowflake
  • Airflow
  • Streamlit

Job Details

Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

Sonar Source - Product Marketing Manager (Go-To-Market, Content Creation, & Partnerships)

Sonar Source

Austin, Texas, United States (On-Site)
2 Months ago
Yahoo - Sr. Business Development Lead

Yahoo

Singapore (Hybrid)
1 Month ago
2K - Director, Game Operations

2K

Los Angeles, California, United States (Remote)
1 Month ago
fluence - Operations Manager - Battery Energy Storage Enclosure Fabrication and Integration

fluence

Phoenix, Arizona, United States (On-Site)
1 Month ago
Razer - Senior Product Operations (Mobile Game Customer Support)

Razer

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
1 Month ago
Nice - Senior Sales, Compensation, Financial and Data Analyst

Nice

United States (Remote)
1 Month ago
blend - Senior Data Engineer

blend

Montevideo, Montevideo Department, Uruguay (Remote)
1 Month ago
endava - Senior Data Engineer - GCP

endava

Melbourne, Victoria, Australia (On-Site)
1 Month ago
Roof Stacks - Data Architect

Roof Stacks

Istanbul, İstanbul, Türkiye (Remote)
7 Months ago
EXUSIA - Microsoft Azure Fabric - Senior Data Engineer IN

EXUSIA

India (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Axon - Revenue Accountant

Axon

Scottsdale, Arizona, United States (Hybrid)
2 Months ago
zeta - Associate - Credit Card Operations

zeta

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Critical mass - Copy Lead

Critical mass

Vancouver, British Columbia, Canada (On-Site)
3 Weeks ago
CAE - EHS Coordinator

CAE

Sydney, New South Wales, Australia (Hybrid)
1 Month ago
Studio Image Works - Motion Graphic Artist

Studio Image Works

Gurugram, Haryana, India (On-Site)
1 Year ago
Power Integrations - Principal Product Definition Engineer

Power Integrations

San Jose, California, United States (On-Site)
5 Months ago
eBay - Senior Manager, Corporate Communications

eBay

Washington, District Of Columbia, United States (Hybrid)
1 Week ago
TVH - Legal Counsel

TVH

Waregem, Flanders, Belgium (Hybrid)
6 Days ago
Philips - Compliance Investigator

Philips

Shanghai, China (On-Site)
1 Month ago
Critical mass - Freelance Product Designer

Critical mass

Vancouver, British Columbia, Canada (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Ukrainka, Kyiv Oblast, Ukraine

N-ix - Head of Payroll Accounting

N-ix

Ukraine (Remote)
3 Months ago
Wargaming - Senior MLOps/Backend Developer

Wargaming

Kyiv, Kyiv City, Ukraine (Remote)
1 Week ago
N-ix - Middle Compliance Specialist / Data Privacy

N-ix

Ukraine (On-Site)
1 Month ago
SIFT - Senior Data Scientist

SIFT

Kyiv, Kyiv City, Ukraine (Remote)
3 Weeks ago
BetterMe - Product Marketing Manager

BetterMe

Kyiv, Kyiv City, Ukraine (Remote)
1 Month ago
GT HQ - Senior Full-stack Developer (Python+React.js)

GT HQ

Ukraine (Remote)
3 Months ago
BetterMe - Product Manager (Mobile)

BetterMe

Kyiv, Kyiv City, Ukraine (Remote)
2 Months ago
Magic Media - Business Development Manager

Magic Media

Kyiv, Kyiv City, Ukraine (Remote)
3 Weeks ago
Square - Sales Consultant/Department Manager JYSK, Silpo Shopping Center

Square

Kam'yanets'-Podil's'kyi, Khmelnytskyi Oblast, Ukraine (On-Site)
6 Days ago
D-market - Product Manager

D-market

Ukraine (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

dbt Labs - Senior Data Engineer

dbt Labs

United States (Remote)
2 Weeks ago
Varonis  - Data Analytics Engineering

Varonis

Herzliya, Tel Aviv District, Israel (Hybrid)
5 Months ago
quience - Software Development Engineer - 2 : Data Engineering

quience

Bengaluru, Karnataka, India (On-Site)
6 Days ago
GoTo Group - Senior Growth Data Analyst

GoTo Group

Jakarta, Indonesia (On-Site)
1 Month ago
Next Level Business Services - Data Architect

Next Level Business Services

Sunnyvale, California, United States (On-Site)
9 Months ago
Riot Games - Senior Software Engineer - Data Foundations: Data Experiences and Automation

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago
Capgemini - GCP DATA ENGINEER

Capgemini

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Lambda - Data Center Operations Engineer

Lambda

Kansas City, Missouri, United States (On-Site)
1 Month ago
Saxo Bank - Senior Payments Business Analyst

Saxo Bank

Copenhagen, Denmark (On-Site)
2 Months ago
HCL Tech - Senior Reporting & Data Analyst

HCL Tech

Madurai, Tamil Nadu, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug