Senior Data Ops Engineer

6 Months ago • 3-5 Years • Data Analyst

Job Summary

Job Description

Develop a scalable data platform to manage data from various sources (vendors, research providers, exchanges, PBs, web scraping) and make it accessible to systematic & fundamental PMs, and enterprise functions (Ops, Risk, Trading, Compliance). Responsibilities include web scraping using scripts/APIs/tools, building and maintaining a greenfield data platform on Snowflake and AWS, enhancing existing pipelines, onboarding new data providers, and managing data migration projects. The role requires strong DevOps skills (Kubernetes, Docker, Jenkins) and proficiency in SQL and Python.
Must have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • DevOps (K8s, Docker, Jenkins)
  • Good communication
Good to have:
  • Market Data Projects
  • Capital markets experience
  • Snowflake
  • Airflow

Job Details

Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

Boomi  - Software Quality Engineer 2 - APIM

Boomi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
The Walt Disney Company - Sr Software Engineer, Android

The Walt Disney Company

Seattle, Washington, United States (On-Site)
2 Months ago
N-ix - Senior DevOps Engineer

N-ix

Ukraine (Remote)
3 Months ago
Epic Games - Senior SDET

Epic Games

Cary, North Carolina, United States (On-Site)
2 Months ago
luxsoft - Senior Python Developer with Networking

luxsoft

Romania (Remote)
2 Weeks ago
Next Level Business Services - BI Tech Project Manager - Full Time

Next Level Business Services

Redmond, Washington, United States (On-Site)
7 Months ago
PwC - IN_Manager_ Data Governance, D&A_Advisory_Manager

PwC

Mumbai, Maharashtra, India (On-Site)
8 Months ago
PwC - Data Architect – Technology Consulting

PwC

Prague, Prague, Czechia (On-Site)
7 Months ago
Epic Games - Analytics Lead (Gameplay)

Epic Games

Montreal, Quebec, Canada (On-Site)
4 Months ago
Smilegate - Management Strategy Planning

Smilegate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Luxoft - Senior DevOps Engineer

Luxoft

Toronto, Ontario, Canada (On-Site)
5 Months ago
Playtika - Senior Manual QA Engineer

Playtika

Ukraine (On-Site)
2 Months ago
Luxoft - Test Automation Engineer - UFT Selenium

Luxoft

Hyderabad, Telangana, India (On-Site)
6 Months ago
AI Dash - Software Development Engineer in Test II Platform

AI Dash

Gurugram, India (Hybrid)
1 Week ago
Nagarro - Principal Engineer

Nagarro

Boston, Massachusetts, United States (On-Site)
3 Months ago
Enphase Energy - Sr Engg Tool builder Engg

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
4 Months ago
N-ix - Senior DevOps Engineer

N-ix

Ukraine (Remote)
1 Month ago
N-ix - Senior DevOps Engineer

N-ix

Ukraine (Remote)
3 Months ago
Zapak Digital Entertainment Limited -  Software Engineer - Backend (Java, AI, and ML Tools)

Zapak Digital Entertainment Limited

Pune, Maharashtra, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Sportskeeda - Content Writer - Baseball (MLB)

Sportskeeda

India (Remote)
4 Months ago
DevRev - Member of Product Management

DevRev

Bengaluru, Karnataka, India (On-Site)
1 Month ago
PwC - Manager- Kolkata DN 57 - Technology Consulting

PwC

Kolkata, West Bengal, India (On-Site)
8 Months ago
Qube Cinema - Legal Consultant

Qube Cinema

Chennai, Tamil Nadu, India (On-Site)
2 Weeks ago
Ansys - Lead R&D Engineer

Ansys

Noida, Uttar Pradesh, India (On-Site)
2 Weeks ago
Expedia - Data Engineer III

Expedia

Bengaluru, Karnataka, India (On-Site)
3 Days ago
Capgemini - C2C Collections Process Expert

Capgemini

Kolkata, West Bengal, India (On-Site)
5 Days ago
Ion - LCM Data Analyst

Ion

Mumbai, Maharashtra, India (On-Site)
7 Months ago
Keywords Studios - Product Manager II

Keywords Studios

Maharashtra, India (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

bytedance - Asset Manager, Datacenter Infrastructure and Services

bytedance

Singapore (On-Site)
2 Months ago
Antarctica Global - Research & Sustainability Analyst

Antarctica Global

Maharashtra, India (Remote)
2 Months ago
Meta - Data Science Director

Meta

New York, New York, United States (Remote)
6 Months ago
Epic Games - Data Engineer

Epic Games

London, England, United Kingdom (On-Site)
4 Months ago
Sony Interactive Entertainment - Production Planning Analyst, Global Packaging Operations

Sony Interactive Entertainment

Tokyo, Japan (On-Site)
1 Month ago
Krafton - Data Analyst (7+ years experience)

Krafton

Seoul, South Korea (On-Site)
1 Month ago
Meta - Data Engineer, Product Analytics

Meta

San Francisco, California, United States (On-Site)
6 Months ago
PwC - Analityk biznesowy z językiem niemieckim (freelance)

PwC

Warsaw, Masovian Voivodeship, Poland (On-Site)
8 Months ago
Enterprise Bot - Data Scientist

Enterprise Bot

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Bengaluru, Karnataka, India (On-Site)

Mississauga, Ontario, Canada (On-Site)

Toronto, Ontario, Canada (On-Site)

Poland, Ohio, United States (Remote)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug