Data Engineer for Market Data Projects (with Streamlit Expertise)

6 Months ago • 3-5 Years • Data Analyst

Job Summary

Job Description

Develop a scalable data platform for market data from various sources (vendors, research providers, exchanges, PBs, web scraping). Make data accessible to portfolio managers, and enterprise functions (Ops, Risk, Trading, Compliance). Build internal data products and analytics. Responsibilities include web scraping, maintaining a Snowflake/AWS platform, onboarding new data providers, and data migration projects. Enhance existing pipelines and develop new ones to meet evolving requirements. Strong DevOps skills (K8s, Docker, Jenkins) are essential.
Must have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • Good communication
  • DevOps (K8s, Docker, Jenkins)
Good to have:
  • Market Data Projects/Capital markets exp
  • Snowflake
  • Airflow
  • Streamlit

Job Details

Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

Cerence - Research Engineer

Cerence

Ulm, Baden-Württemberg, Germany (On-Site)
2 Weeks ago
luxsoft - Senior Datamart Developer

luxsoft

Bengaluru, Karnataka, India (On-Site)
1 Week ago
The Walt Disney Company - Senior Real Time Pipeline Engineer (PH)

The Walt Disney Company

Glendale, California, United States (On-Site)
6 Months ago
balbex - Sr Staff/Principal Devops Engineer

balbex

Gurugram, India (On-Site)
10 Months ago
Zazz - Java Developer

Zazz

(Remote)
3 Months ago
Sawhorse Productions - Data Analyst

Sawhorse Productions

Los Angeles, California, United States (Remote)
2 Months ago
Hitachi - Data Scientist

Hitachi

Pune, Maharashtra, India (Remote)
7 Months ago
N-ix - Senior/Lead Data Engineer

N-ix

Ukraine (Remote)
1 Month ago
Wargaming - BI Analyst (World of Tanks)

Wargaming

Belgrade, Serbia (Hybrid)
1 Month ago
Jam City - DATA ENGINEER

Jam City

Montevideo, Montevideo Department, Uruguay (On-Site)
10 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Rockstar Games - Senior Software Development Engineer In Test (C#)

Rockstar Games

New York, United States (On-Site)
1 Week ago
Next Level Business Services - Adobe CQ5/AEM Architect (Full Time)

Next Level Business Services

Sunnyvale, California, United States (On-Site)
7 Months ago
Ion - Senior DevSecOps Engineer, Italy

Ion

Pisa, Tuscany, Italy (On-Site)
7 Months ago
Excel Hr solutions - Solution Architect - IT Project Manager

Excel Hr solutions

Mumbai, Maharashtra, India (On-Site)
1 Year ago
Gunzilla - Lead Technical Artist

Gunzilla

Kyiv, Kyiv City, Ukraine (On-Site)
1 Month ago
Riot Games - Senior Software Engineer, Services - Esports Platform & Experiences

Riot Games

Dublin, County Dublin, Ireland (On-Site)
6 Months ago
ARHS - Java Jee Developer

ARHS

Luxembourg (On-Site)
7 Months ago
Experian - Software Engineering Coordinator - Delivery

Experian

Blumenau, State Of Santa Catarina, Brazil (Hybrid)
1 Month ago
version 1 - Full Stack Developer

version 1

Birmingham, England, United Kingdom (On-Site)
3 Months ago
fortanix - SDET Engineer

fortanix

Bengaluru, Karnataka, India (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Ukrainka, Kyiv Oblast, Ukraine

Better ME - Automation QA Engineer (iOS)

Better ME

Ukraine (Remote)
2 Weeks ago
N-ix - Senior DevOps Engineer

N-ix

Ukraine (Remote)
1 Month ago
N-ix - Head of Payroll Accounting

N-ix

Ukraine (Remote)
4 Months ago
playrix  - Lead Recruiter

playrix

Ukraine (Remote)
7 Months ago
Gunzilla - Manual QA Intern

Gunzilla

Kyiv, Kyiv City, Ukraine (Remote)
2 Months ago
Pushka Studios - Technical Artist (Unreal Engine)

Pushka Studios

Dnipro, Dnipropetrovsk Oblast, Ukraine (On-Site)
4 Weeks ago
luxsoft - Regular/Senior Web Graphics Developer

luxsoft

Ukraine (Remote)
3 Weeks ago
D-market - Product Manager

D-market

Ukraine (Remote)
1 Month ago
luxsoft - Senior Java Developer

luxsoft

Ukrainka, Kyiv Oblast, Ukraine (Remote)
4 Weeks ago
Gunzilla - Senior Hard Surface Artist

Gunzilla

Kyiv, Kyiv City, Ukraine (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

PwC - Senior Associate_Snowflake Developer_Data & Analytics_Advisory_PAN  India

PwC

Kolkata, West Bengal, India (On-Site)
8 Months ago
Antarctica Global - Research & Sustainability Analyst

Antarctica Global

Maharashtra, India (Remote)
2 Months ago
plarium - Marketing Business Analyst

plarium

Herzliya, Tel Aviv District, Israel (On-Site)
2 Months ago
PwC - IN_Senior Associate_Qlikview_D&A_Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
PwC - Associate - D&A - GDC

PwC

Kolkata, West Bengal, India (On-Site)
8 Months ago
Balbix - Staff AI Engineer

Balbix

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Tap nation  - Product Manager Data Platform

Tap nation

(Hybrid)
1 Month ago
playrix  - Senior Data Analyst (Game)

playrix

Cyprus (Remote)
7 Months ago
GoTo Group - Senior Data Scientist (India)

GoTo Group

Bengaluru, Karnataka, India (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Bengaluru, Karnataka, India (On-Site)

Mississauga, Ontario, Canada (On-Site)

Toronto, Ontario, Canada (On-Site)

Poland, Ohio, United States (Remote)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug