Data Engineer for Market Data Projects (with Streamlit Expertise)

4 Months ago • 3-5 Years • Data Analyst

Job Summary

Job Description

Develop a scalable data platform for market data from various sources (vendors, research providers, exchanges, PBs, web scraping). Make data accessible to portfolio managers, and enterprise functions (Ops, Risk, Trading, Compliance). Build internal data products and analytics. Responsibilities include web scraping, maintaining a Snowflake/AWS platform, onboarding new data providers, and data migration projects. Enhance existing pipelines and develop new ones to meet evolving requirements. Strong DevOps skills (K8s, Docker, Jenkins) are essential.
Must have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • Good communication
  • DevOps (K8s, Docker, Jenkins)
Good to have:
  • Market Data Projects/Capital markets exp
  • Snowflake
  • Airflow
  • Streamlit

Job Details

Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

EXUSIA - Ab Initio CoE Administrator

EXUSIA

India (Remote)
5 Months ago
NVIDIA - GPU Verification Architect

NVIDIA

Canada (On-Site)
1 Month ago
The Walt Disney Company - Software Engineer, Test

The Walt Disney Company

California, United States (On-Site)
1 Week ago
Mattel  Inc  - Live Games Infrastructure Manager - Digital Gaming

Mattel Inc

El Segundo, California, United States (On-Site)
5 Months ago
Wargaming - QA Engineer (World of Tanks)

Wargaming

Kyiv, Kyiv City, Ukraine (Hybrid)
2 Weeks ago
PwC - Senior Associate - Python Data Engineer - GDC

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Ubisoft - Fraud & Analyst Assistant Intern

Ubisoft

Paris, Île-de-France, France (On-Site)
1 Week ago
Go Fund Me - Senior Data Scientist

Go Fund Me

Buenos Aires, Buenos Aires, Argentina (Remote)
4 Months ago
Playtika - Compensation & Benefits Analyst

Playtika

Israel (On-Site)
5 Months ago
VGW - Customer Research Team Lead

VGW

Sydney, New South Wales, Australia (On-Site)
6 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Visa - Senior Consultant Software Engineer - Full Stack

Visa

Warsaw, Masovian Voivodeship, Poland (Hybrid)
5 Months ago
Onward Search - Project/Program Coordinator I

Onward Search

Draper, Utah, United States (On-Site)
2 Months ago
Luxoft - Senior Data Ops Engineer

Luxoft

Delhi, India (On-Site)
4 Months ago
King - Senior Staff Developer, Mobile SDK

King

California, United States (Hybrid)
1 Week ago
Sitetracker - Salesforce Engineer (EDS)

Sitetracker

Montclair, New Jersey, United States (Remote)
5 Months ago
Evolution - Unreal Engine/C++ Engineer

Evolution

Riga, Latvia (Hybrid)
2 Weeks ago
Luxoft - Senior DevOps Engineer

Luxoft

Toronto, Ontario, Canada (On-Site)
3 Months ago
UXBERT Labs - Senior Backend Developer (Node.js)

UXBERT Labs

Riyadh, Riyadh Province, Saudi Arabia (Hybrid)
2 Months ago
CloudLinux - Senior Python Developer for KernelCare

CloudLinux

Tbilisi, Tbilisi, Georgia (Remote)
5 Days ago
Starkflow - Principal Full Stack Developer

Starkflow

Bengaluru, Karnataka, India (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Ukrainka, Kyiv Oblast, Ukraine

Playtika - Product Owner

Playtika

Ukraine (On-Site)
4 Months ago
Wargaming - Frontend Developer (World of Tanks)

Wargaming

Kyiv, Kyiv City, Ukraine (Hybrid)
6 Days ago
N-iX - Senior Java Engineer (#2596)

N-iX

Ukraine (Remote)
3 Months ago
N-iX - Senior Python Engineer

N-iX

Ukraine (Remote)
1 Week ago
N-iX - Senior Power BI Engineer

N-iX

Ukraine (Remote)
1 Week ago
Playrix - Senior Unity Software Engineer (Gameplay)

Playrix

Ukraine (Remote)
5 Months ago
N-iX - Middle React Engineer

N-iX

Ukraine (Remote)
1 Week ago
N-iX - Senior DevOps Engineer

N-iX

Ukraine (Remote)
1 Month ago
N-iX - Trainee Manual QC Engineer

N-iX

Ukraine (Remote)
1 Week ago
Playrix - Senior Data Analyst (Game)

Playrix

Ukraine (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Warner Bros Games - Senior Data Engineer

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
1 Week ago
ByteDance - Data Analyst - Global Payment

ByteDance

Singapore (On-Site)
6 Days ago
Meta - Data Engineer, Product Analytics

Meta

Los Angeles, California, United States (On-Site)
4 Months ago
Ubisoft - Financial Analyst Assistant Internship

Ubisoft

Paris, Île-de-France, France (On-Site)
5 Days ago
SciPlay - Business Intelligence Developer

SciPlay

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Epic Games - Principal Data Analyst, Ecosystem Economy & UGC

Epic Games

Cary, North Carolina, United States (On-Site)
2 Months ago
Trendyol - Data Science Professionals - Trendyol GO

Trendyol

İzmir, İzmir, Türkiye (Hybrid)
4 Months ago
CloudHire - Power BI Expert

CloudHire

Maharashtra, India (Remote)
6 Days ago
Warner Bros Games - Senior Analytics Engineer

Warner Bros Games

(Hybrid)
1 Month ago
Rackspace Technology - Senior Power BI Developer

Rackspace Technology

Vietnam (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Bengaluru, Karnataka, India (On-Site)

Mississauga, Ontario, Canada (On-Site)

Toronto, Ontario, Canada (On-Site)

Poland, Ohio, United States (Remote)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug