Data Engineer for Market Data Projects (with Streamlit Expertise)

1 Month ago • 3-5 Years • Data Analyst

About the job

Job Description

Develop a scalable data platform for market data from various sources (vendors, research providers, exchanges, PBs, web scraping). Make data accessible to portfolio managers, and enterprise functions (Ops, Risk, Trading, Compliance). Build internal data products and analytics. Responsibilities include web scraping, maintaining a Snowflake/AWS platform, onboarding new data providers, and data migration projects. Enhance existing pipelines and develop new ones to meet evolving requirements. Strong DevOps skills (K8s, Docker, Jenkins) are essential.
Must have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • Good communication
  • DevOps (K8s, Docker, Jenkins)
Good to have:
  • Market Data Projects/Capital markets exp
  • Snowflake
  • Airflow
  • Streamlit
Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

New Delhi, Delhi, India (Remote)

Iași, Iași County, Romania (On-Site)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Bengaluru, Karnataka, India (On-Site)

Chennai, Tamil Nadu, India (On-Site)

United States (Remote)

View All Jobs

Get notified when new jobs are added by Luxoft

Similar Jobs

ION - Lead Software Engineer, Italy

ION, Italy (On-Site)

Sporty Group - iOS Engineer

Sporty Group, Spain (Remote)

Addepar - Sr. Software Engineer in Test

Addepar, India (On-Site)

Crazy games  - [REMOTE] Product Analyst

Crazy games , Belgium (Remote)

STAGE - Product Analyst

STAGE, India (On-Site)

Flip Fit - Data Scientist

Flip Fit, United States (On-Site)

PhonePe - MIS Analyst

PhonePe, India (On-Site)

Playrix - Senior Data Analyst (Attribution)

Playrix, Ireland (Remote)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Nagarro - Associate Staff Engineer, .Net Fullstack

Nagarro, United States (On-Site)

The Walt Disney Company - Manager, Infrastructure & DevOps Engineering - Ad Technology

The Walt Disney Company, United States (On-Site)

The Walt Disney Company - Sr Software Engineer (Front End/JavaScript)

The Walt Disney Company, United States (On-Site)

Playrix - Senior QA Engineer (Render Team)

Playrix, Serbia (Remote)

CleverTap - Senior Automation QA Engineer

CleverTap, India (Hybrid)

The Walt Disney Company - Lead Software Engineer (Roku/BrightScript/SceneGraph)

The Walt Disney Company, United States (On-Site)

InvenioLSI - MuleSoft Managing Consultant

InvenioLSI, United Arab Emirates (On-Site)

ION - Senior C++ Developer, Italy

ION, Italy (On-Site)

Get notifed when new similar jobs are uploaded

Jobs in Ukrainka, Kyiv Oblast, Ukraine

N-iX - Senior iOS Engineer (#2492)

N-iX, Ukraine (Remote)

N-iX - Senior Data Modeler (#2471)

N-iX, Ukraine (Remote)

seeking alpha - Senior Data Analyst

seeking alpha, Ukraine (Remote)

Keywords Studios (Player Support) - Expert - Subtitle Translator/QCer: English to Ukrainian

Keywords Studios (Player Support), Ukraine (Remote)

N-iX - Senior Android Engineer (#2369)

N-iX, Ukraine (Remote)

Playrix - Principal Golang Engineer

Playrix, Ukraine (Remote)

Playtika - Java Developer /Kyiv

Playtika, Ukraine (On-Site)

Playtech - Junior Java Developer

Playtech, Ukraine (On_site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Get notifed when new similar jobs are uploaded