Outscal Logooutscal logo

Data Engineer for Market Data Projects (with Streamlit Expertise)

4 Months ago • 3-5 Years • Data Analyst

Job Summary

Job Description

Develop a scalable data platform for market data from various sources (vendors, research providers, exchanges, PBs, web scraping). Make this data accessible to portfolio managers, operations, risk, trading, and compliance teams. Responsibilities include web scraping, building and maintaining a Snowflake/AWS-based platform, enhancing existing pipelines, onboarding new data providers, and managing data migration projects. Strong DevOps skills (Kubernetes, Docker, Jenkins) are crucial. Experience with Streamlit is a plus.
Must have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • DevOps (K8s, Docker, Jenkins)
  • Good communication
Good to have:
  • Market Data Projects/Capital markets exp
  • Snowflake
  • Airflow

Job Details

Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

Bragg - Java Developer - Platform

Bragg

Ljubljana, Ljubljana, Slovenia (Hybrid)
3 Weeks ago
The Walt Disney Company - Software Engineer II

The Walt Disney Company

Morrisville, North Carolina, United States (On-Site)
1 Month ago
PwC - Consultant Cloud Technologies Architecture & Migration | CDI | H/F

PwC

Neuilly-sur-Seine, Île-de-France, France (On-Site)
5 Months ago
Activision - Staff Backend Engineer - Activision Blizzard Media

Activision

California, United States (On-Site)
3 Months ago
The Walt Disney Company - Lead Full Stack Developer

The Walt Disney Company

Burbank, California, United States (On-Site)
3 Months ago
Zazz - Senior Data Engineer - Snowflake

Zazz

(Remote)
1 Month ago
InvenioLSI - SAP Analytics SEM

InvenioLSI

New Delhi, Delhi, India (On-Site)
3 Months ago
SciPlay - Business Intelligence Developer

SciPlay

Austin, Texas, United States (Hybrid)
1 Month ago
PlayStation Global - Senior Security Analyst-Data Governance

PlayStation Global

Carlsbad, California, United States (On-Site)
2 Months ago
Rank group - Senior Insight & Player Protection Analyst

Rank group

London, England, United Kingdom (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Warner Bros Games - Manager, Software Engineering - Development & Testing

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Interface AI - Sr. Implementation Engineer

Interface AI

United States (Remote)
3 Months ago
NVIDIA - Validation and Verification Interconnect Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
Omnissa - Staff Engineer (C++ Windows Internals)

Omnissa

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Playtika - Senior Data/AI SRE Engineer

Playtika

Ukraine (On-Site)
4 Months ago
Lucky VR - Senior Unity Developer

Lucky VR

(Remote)
2 Months ago
Epic Games - Senior Software Development Engineer in Test (SDET)

Epic Games

Montreal, Quebec, Canada (On-Site)
1 Month ago
EXUSIA - Ab Initio Data Engineer

EXUSIA

United States (On-Site)
5 Months ago
Evolution - Scala Engineer

Evolution

Lisbon, Lisbon, Portugal (On-Site)
10 Months ago
The Walt Disney Company - Software Engineer II

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in New Delhi, Delhi, India

Krafton  - Manager - Mergers & Acquisitions

Krafton

Bengaluru, Karnataka, India (On-Site)
4 Months ago
PwC - IN_Senior Associate_Qlikview_D&A_Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Simple Viral Games - iOS Developer

Simple Viral Games

Bengaluru, Karnataka, India (On-Site)
7 Months ago
NVIDIA - Senior Site Reliability Engineer

NVIDIA

Pune, Maharashtra, India (On-Site)
1 Month ago
Starkflow - Accounts Intern

Starkflow

Gurugram, Haryana, India (On-Site)
4 Weeks ago
Paytm - Growth Management - Assistant General Manager - Oil & Gas

Paytm

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
Joyride Games - VP Marketing

Joyride Games

India (Remote)
1 Year ago
Cadence - Principal Solutions Engineer - AE

Cadence

Noida, Uttar Pradesh, India (On-Site)
6 Months ago
PwC - IN- Associates_SAP Opentext_Enterprise Apps SAP_Advisory_PAN India

PwC

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Paytm - Accounting - Junior (CA Inter)

Paytm

Noida, Uttar Pradesh, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Warner Bros Discovery - Customer Data Manager - Digital/Video On Demand

Warner Bros Discovery

Masovian Voivodeship, Poland (Hybrid)
3 Months ago
The Walt Disney Company - Sr Data Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Month ago
GoMotive - Senior Manager, Strategic Analytics

GoMotive

United States (Remote)
1 Month ago
ION - UK Holdings - India - 859

ION

Mumbai, Maharashtra, India (On-Site)
5 Months ago
PwC - Senior Associate_Hadoop Developer_Advisory Corporate_Advisory_Bangalore Millenia

PwC

Bengaluru, Karnataka, India (On-Site)
5 Months ago
ByteDance - Data Analyst - Global Payment

ByteDance

Singapore (On-Site)
1 Month ago
PwC - IN_Senior Associate _Revenue Protection_Utility Transformation_Advisory_Jaipur

PwC

Jaipur, Rajasthan, India (On-Site)
3 Months ago
GOLF+ - Product Insights Analyst

GOLF+

Austin, Texas, United States (Remote)
2 Months ago
Tesla - Data Engineer

Tesla

North Holland, Netherlands (On-Site)
1 Month ago
Matific - Senior Data Engineer

Matific

Colombo, Western Province, Sri Lanka (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Bengaluru, Karnataka, India (On-Site)

Mississauga, Ontario, Canada (On-Site)

Toronto, Ontario, Canada (On-Site)

Poland, Ohio, United States (Remote)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug