Data Engineer for Market Data Projects (with Streamlit Expertise)

5 Months ago • 3-5 Years • Data Analyst

Job Summary

Job Description

Develop a scalable data platform for market data from various sources (vendors, research providers, exchanges, PBs, web scraping). Make this data accessible to portfolio managers (systematic & fundamental), and enterprise functions (Ops, Risk, Trading, Compliance). Responsibilities include web scraping, building and maintaining the Snowflake and AWS-based platform, onboarding new data providers, managing data migration projects, and enhancing existing pipelines. The ideal candidate will have strong DevOps skills (K8s, Docker, Jenkins), experience with SQL and Python, and excellent communication skills. Streamlit expertise is a plus.
Must have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • DevOps (K8s, Docker, Jenkins)
  • Good communication
Good to have:
  • Market Data Projects/Capital markets exp
  • Snowflake
  • Airflow
  • Streamlit

Job Details

Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

Lead venture - Lead Software Engineer

Lead venture

Gurugram, Haryana, India (On-Site)
6 Months ago
N-iX - Junior QA Engineer (with Python)

N-iX

Poland (Remote)
2 Months ago
Ness Digital - Software Implementation Engineer

Ness Digital

Iași, Iași County, Romania (Remote)
2 Months ago
The Walt Disney Company - Senior Software Engineer (Roku Engineer)

The Walt Disney Company

Santa Monica, California, United States (On-Site)
3 Months ago
CData Software - Quality Assurance Automation Engineer

CData Software

Bengaluru, Karnataka, India (On-Site)
6 Months ago
DraftKings - Market Researcher

DraftKings

Boston, Massachusetts, United States (On-Site)
1 Month ago
SEGA - Senior Commercial Analyst

SEGA

(Hybrid)
1 Month ago
PwC - IN_Senior Associate_React Developer_Data & Analytics_Advisory_PAN India

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Microsoft - Senior Data Analyst

Microsoft

Vancouver, British Columbia, Canada (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Blue Yonder - Staff Software Engineer I-Python, Microservices, API

Blue Yonder

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Sporty Group - Software Engineering Team Lead- LatAm

Sporty Group

(Remote)
5 Months ago
Aristocrat Gaming - Integrations Manager

Aristocrat Gaming

Sofia, Sofia City Province, Bulgaria (Hybrid)
4 Months ago
NVIDIA - Senior Cloud Test Developer Architect

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Playrix - Senior Release Support Engineer

Playrix

Ireland (Remote)
6 Months ago
Gaming Innovation Group  - Head of Quality Assurance

Gaming Innovation Group

St. Julian's, Malta (Hybrid)
3 Months ago
AppZen - Senior DevOps Engineer

AppZen

San Jose, California, United States (Hybrid)
6 Months ago
Ness Digital - Java & React Senior Engineers II (T17)

Ness Digital

Timișoara, Timiș, Romania (Remote)
3 Months ago
ION - Senior Full-Stack Developer, New York

ION

New York, New York, United States (Hybrid)
6 Months ago
ION - Senior Java Developer - Italy

ION

Milan, Lombardy, Italy (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Delhi, India

Extreme Network - Customer Lifecycle Manager – India (German and English Speaker)

Extreme Network

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Microsoft - Sr. Solution Area Specialist - Data & AI

Microsoft

Gurugram, Haryana, India (On-Site)
4 Months ago
Xentrix Studios - Visual FX – Artist

Xentrix Studios

India (On-Site)
5 Months ago
Assystems - Project Manager

Assystems

Hyderabad, Telangana, India (On-Site)
6 Months ago
NCR Atleos - Lead developer for Monitoring & Scheduling Tools

NCR Atleos

Gurugram, Haryana, India (On-Site)
7 Months ago
Ethos - Software Engineer, Test

Ethos

Bengaluru, Karnataka, India (On-Site)
8 Months ago
PwC - IN_Associate_Implementation of Compliance_Contract and Compliance_TRS_Bengaluru

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Qt Group - Account Manager, QA

Qt Group

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Balbix - Director Platform/Backend Engineering

Balbix

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Blissclub - Garment Technologist

Blissclub

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

PwC - Associate - Python Data Engineer - GDC

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Social Discovery Group - Chief Data Officer

Social Discovery Group

Belgrade, Serbia (Remote)
2 Months ago
HoYoverse - Data Analyst - Honkai: Star Rail - Fresh Grad

HoYoverse

Singapore (On-Site)
5 Months ago
Tripledot Studios - Product Data Analyst

Tripledot Studios

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Months ago
PwC - IGP_CP&F - Data Governance  - Senior Associate - Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Evolution - Business Intelligence Data Analyst

Evolution

Riga, Latvia (On-Site)
3 Months ago
PwC - Data Architect – Technology Consulting

PwC

Prague, Prague, Czechia (On-Site)
6 Months ago
Blazesoft - Senior Data Analyst

Blazesoft

Vaughan, Ontario, Canada (On-Site)
5 Months ago
Kojima Productions - Game Data Analyst

Kojima Productions

Tokyo, Japan (On-Site)
5 Months ago
DraftKings - Senior Manager of Data Engineering, Regulatory

DraftKings

Boston, Massachusetts, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Bengaluru, Karnataka, India (On-Site)

Mississauga, Ontario, Canada (On-Site)

Toronto, Ontario, Canada (On-Site)

Poland, Ohio, United States (Remote)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug