Outscal Logooutscal logo

Data Engineer for Market Data Projects (with Streamlit Expertise)

4 Months ago • 3-5 Years • Data Analyst

Job Summary

Job Description

Develop a scalable data platform for market data from various sources (vendors, research providers, exchanges, PBs, web scraping). Make data accessible to portfolio managers, and enterprise functions (Ops, Risk, Trading, Compliance). Build internal data products and analytics. Responsibilities include web scraping, maintaining a Snowflake/AWS platform, onboarding new data providers, and data migration projects. Enhance existing pipelines and develop new ones to meet evolving requirements. Strong DevOps skills (K8s, Docker, Jenkins) are essential.
Must have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • Good communication
  • DevOps (K8s, Docker, Jenkins)
Good to have:
  • Market Data Projects/Capital markets exp
  • Snowflake
  • Airflow
  • Streamlit

Job Details

Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

ION - Senior Full-Stack Developer, New York

ION

New York, New York, United States (Hybrid)
5 Months ago
Nagarro - Associate Principal Engineer, .Net Fullstack

Nagarro

India (Remote)
5 Months ago
AGS - American Gaming Systems - Lead DevSecOps Engineer

AGS - American Gaming Systems

Georgia (On-Site)
5 Days ago
CData Software - Quality Assurance Automation Engineer

CData Software

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Saviynt - Senior Engineer SDET, Quality Engineering

Saviynt

El Segundo, California, United States (Hybrid)
5 Months ago
Nagarro - Associate Principal Engineer, Big Data

Nagarro

(On-Site)
4 Months ago
Attentive - Senior Data Scientist/Applied Scientist, AI Products

Attentive

San Francisco, California, United States (Hybrid)
5 Months ago
Google - Open Career Opportunities, Verily Life Sciences

Google

South San Francisco, California, United States (On-Site)
4 Months ago
Nagarro - Senior Analyst

Nagarro

Cebu City, Central Visayas, Philippines (On-Site)
5 Months ago
PwC - IN_Senior Manager_ Business Analyst_D&A_Advisory_Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

The Walt Disney Company - Senior Analyst, Software Engineer

The Walt Disney Company

Rio De Janeiro, Brazil (Remote)
2 Months ago
Nagarro - Principal Engineer, Java Fullstack

Nagarro

India (Remote)
5 Months ago
Playtech - Dev Ops Engineer

Playtech

London, England, United Kingdom (On-Site)
3 Months ago
Axinous - Sr. Staff ML Engineer

Axinous

San Jose, California, United States (Hybrid)
2 Months ago
Sitetracker - Salesforce Engineer (EDS)

Sitetracker

Montclair, New Jersey, United States (Remote)
5 Months ago
PlayStation Global - Senior Technical Program Manager

PlayStation Global

San Francisco, California, United States (On-Site)
1 Month ago
Next Level Business Services - JavaScript Developer with Full stack Experience

Next Level Business Services

Dallas, Texas, United States (On-Site)
5 Months ago
Xsolla - Senior DevOps Engineer

Xsolla

Los Angeles, California, United States (Hybrid)
3 Months ago
Evolution - JavaScript / TypeScript Engineer (React)

Evolution

Tallinn, Harju County, Estonia (On-Site)
1 Month ago
Assystems - Développeur Junior - H/F

Assystems

Lyon, Auvergne-Rhône-Alpes, France (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Ukrainka, Kyiv Oblast, Ukraine

Plarium - Outsourcing Coordinator

Plarium

Lviv, Lviv Oblast, Ukraine (Remote)
20 Hours ago
PwC - Senior Associate - Accounting Advisory Services

PwC

Kyiv, Kyiv City, Ukraine (On-Site)
5 Months ago
N-iX - Senior Power BI Engineer

N-iX

Ukraine (Remote)
23 Hours ago
N-iX - Senior Full-Stack Engineer (React, Node.js)

N-iX

Ukraine (Remote)
22 Hours ago
N-iX - Senior Technical Artist

N-iX

Ukraine (Flexible)
1 Month ago
Arrible - Middle Unity Developer (remote)

Arrible

Odesa, Odesa Oblast, Ukraine (Remote)
8 Months ago
Playtika - Senior Data/AI SRE Engineer

Playtika

Ukraine (On-Site)
4 Months ago
Playrix - Senior HR Generalist

Playrix

Ukraine (Remote)
5 Months ago
Playrix - Lead SDET

Playrix

Ukraine (Remote)
5 Months ago
N-iX - Middle Technical Consultant

N-iX

Ukraine (Remote)
23 Hours ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Meta - Data Engineer, Product Analytics

Meta

Menlo Park, California, United States (On-Site)
4 Months ago
Axinous - Associate, Strategic Finance/Investor Relations

Axinous

Hyderabad, Telangana, India (Remote)
6 Days ago
Spyke Games - Data Scientist

Spyke Games

İstanbul, Türkiye (On-Site)
5 Months ago
ByteDance - Data Engineer - Global Payment - Singapore

ByteDance

Singapore (On-Site)
4 Months ago
N-iX - Data Engineer

N-iX

Ukraine (Remote)
1 Month ago
The Walt Disney Company - HRIS Developer Project Hire

The Walt Disney Company

Lake Buena Vista, Florida, United States (On-Site)
1 Month ago
Arrise Solutions (India)   - Data Scientist - Recommender S/m's

Arrise Solutions (India)

Hyderabad, Telangana, India (On-Site)
5 Months ago
Go Fund Me - Senior Data Scientist

Go Fund Me

Buenos Aires, Buenos Aires, Argentina (Remote)
4 Months ago
prizepicks - Data Science Internship

prizepicks

(Remote)
5 Days ago
Next Level Business Services - Markit EDM

Next Level Business Services

Pittsburgh, Pennsylvania, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Bengaluru, Karnataka, India (On-Site)

Mississauga, Ontario, Canada (On-Site)

Toronto, Ontario, Canada (On-Site)

Poland, Ohio, United States (Remote)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug