Senior Data Ops Engineer

8 Months ago • 3-5 Years • Data Analysis

Job Summary

Job Description

Develop a scalable data platform to manage data from various sources (vendors, research providers, exchanges, PBs, web scraping) and make it accessible to systematic & fundamental PMs, and enterprise functions (Ops, Risk, Trading, Compliance). Responsibilities include web scraping using scripts/APIs/tools, building and maintaining a greenfield data platform on Snowflake and AWS, enhancing existing pipelines, onboarding new data providers, and managing data migration projects. The role requires strong DevOps skills (Kubernetes, Docker, Jenkins) and proficiency in SQL and Python.
Must have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • DevOps (K8s, Docker, Jenkins)
  • Good communication
Good to have:
  • Market Data Projects
  • Capital markets experience
  • Snowflake
  • Airflow

Job Details

Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

zeta - Talent Acquisition Associate

zeta

Bengaluru, Karnataka, India (On-Site)
1 Month ago
onwards Search - Senior Software Engineer (UiPath)

onwards Search

Rochester, Minnesota, United States (Remote)
2 Weeks ago
Apple - System Product Design Engineering Program Manager Lead/Manager

Apple

Sunnyvale, California, United States (On-Site)
3 Weeks ago
Addepar - Platform Product Analyst

Addepar

United Kingdom (Remote)
2 Weeks ago
Inveniolsi - SAP TRM Consultant

Inveniolsi

India (On-Site)
6 Days ago
Jane Street - Data Engineer

Jane Street

Hong Kong (On-Site)
2 Months ago
endava - Senior Technical Business Analyst

endava

Ho Chi Minh City, Vietnam (On-Site)
2 Months ago
Apple - Data Infrastructure Engineer for Lakehouse

Apple

Seattle, Washington, United States (On-Site)
2 Months ago
Simcorp - Lead Financial Data Analyst

Simcorp

Noida, Uttar Pradesh, India (Hybrid)
1 Month ago
Ramboll3 - Project Engineer / Civil Engineer — Data Center Site Planning & Development

Ramboll3

Syracuse, New York, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Evolution  - Online Game Presenter 11pm-7am Shift/Full Time Benefits/(Restaurant Alternative) $20-$25/hr.

Evolution

Atlantic City, New Jersey, United States (On-Site)
9 Months ago
The Walt Disney Company - Director & GM, Consumer Products, Korea

The Walt Disney Company

Seoul, South Korea (On-Site)
4 Months ago
Flexra Software - Renewals Account Manager

Flexra Software

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Wind River - Senior Engineer - Technical Support

Wind River

Galați, Județul Galați, Romania (On-Site)
2 Weeks ago
Xsolla - Software Architect

Xsolla

Los Angeles, California, United States (Hybrid)
2 Months ago
N-ix - Senior Data Science/ AI Engineer (with Databricks)

N-ix

Poland (On-Site)
1 Month ago
pixodust - Senior Data Analyst

pixodust

(Remote)
2 Months ago
Caramel tech studios - Software QA Engineer

Caramel tech studios

Lahore, Punjab, Pakistan (On-Site)
1 Month ago
Universal Music Group - Quality Audit Coordinator

Universal Music Group

Philadelphia, Pennsylvania, United States (On-Site)
1 Year ago
Tesla - Service Technician / Automotive Mechanic

Tesla

London, England, United Kingdom (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Trend Micro - Sales Engineer, Cloud Business

Trend Micro

Bengaluru, Karnataka, India (On-Site)
10 Months ago
Paytm - IT Procurement (Software) - Manager

Paytm

Noida, Uttar Pradesh, India (On-Site)
1 Month ago
Grab - Senior Software Engineer, iOS

Grab

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
T systems - ServiceNow Scrum Master

T systems

Pune, Maharashtra, India (On-Site)
2 Weeks ago
Pluto7 - Data Scientist

Pluto7

Bengaluru, Karnataka, India (On-Site)
11 Months ago
GHX - Contract Operations Business Analyst

GHX

Hyderabad, Telangana, India (On-Site)
1 Week ago
Qualcomm - CPU Physical Design Methodology Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Capgemini - Product Owner

Capgemini

Kolkata, West Bengal, India (On-Site)
2 Months ago
Toppan MErril - Senior Product Manager

Toppan MErril

Chennai, Tamil Nadu, India (On-Site)
1 Week ago
Capgemini - Azure Cloud SRE

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Nexters - Lead Data & ML Analyst (Tech lead)

Nexters

Limassol, Limassol, Cyprus (Remote)
2 Months ago
Addepar - Associate Software Engineer - Data Intelligence

Addepar

United States (Remote)
1 Month ago
Apple - Senior Product Data Scientist, Media Services

Apple

Culver City, California, United States (On-Site)
2 Weeks ago
Playstation - Lead Data Scientist

Playstation

Canada (Remote)
1 Week ago
kooapps - Data Analyst

kooapps

Makati City, Metro Manila, Philippines (On-Site)
5 Months ago
luxsoft - Senior Commodities Business Analyst

luxsoft

Spain (Remote)
1 Month ago
Playtika - Experienced Business Analyst

Playtika

Israel (On-Site)
9 Months ago
N-ix - Senior Data Architect

N-ix

Poland (Hybrid)
1 Month ago
Jam City - Senior Data Analyst

Jam City

Toronto, Ontario, Canada (On-Site)
1 Year ago
CyberArk - Data Scientist Team Leader

CyberArk

Israel (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Poland, Ohio, United States (Remote)

New Delhi, Delhi, India (Remote)

Toronto, Ontario, Canada (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Gurugram, Haryana, India (On-Site)

Gurugram, Haryana, India (On-Site)

Gurugram, Haryana, India (On-Site)

Gurugram, Haryana, India (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug