Outscal Logooutscal logo

Senior Data Ops Engineer

4 Months ago • 3-5 Years • Data Analyst

Job Summary

Job Description

Develop a scalable data platform to manage data from various sources (vendors, research providers, exchanges, PBs, web scraping) and make it accessible to systematic & fundamental PMs, and enterprise functions (Ops, Risk, Trading, Compliance). Responsibilities include web scraping using scripts/APIs/tools, building and maintaining a greenfield data platform on Snowflake and AWS, enhancing existing pipelines, onboarding new data providers, and managing data migration projects. The role requires strong DevOps skills (Kubernetes, Docker, Jenkins) and proficiency in SQL and Python.
Must have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • DevOps (K8s, Docker, Jenkins)
  • Good communication
Good to have:
  • Market Data Projects
  • Capital markets experience
  • Snowflake
  • Airflow

Job Details

Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

KBG Blockchain Game Studios - DevOps (Blockchain Gaming)

KBG Blockchain Game Studios

Thành Phố Hồ Chí Minh, Vietnam (On-Site)
8 Months ago
CLO Virtual Fashion  Inc  - DevOps Engineer

CLO Virtual Fashion Inc

Bengaluru, Karnataka, India (On-Site)
5 Months ago
The Walt Disney Company - Senior Pipeline Engineer

The Walt Disney Company

Glendale, California, United States (On-Site)
20 Hours ago
Hogarth - Software Development Engineer, Test

Hogarth

Hyderabad, Telangana, India (Hybrid)
6 Months ago
Info Stretch - Senior Engineer

Info Stretch

Bengaluru, Karnataka, India (On-Site)
4 Months ago
PwC - IN_Manager_Telecom Consulting_TMT_Advisory_Gurugram

PwC

Gurugram, Haryana, India (On-Site)
3 Months ago
PwC - Senior Associate -Oracle EPM EPBCS_Advisory-D&A_Gurugram

PwC

Gurugram, Haryana, India (On-Site)
5 Months ago
N-iX - Data Engineer (with Databricks)

N-iX

Poland (Remote)
22 Hours ago
Ness Digital - Sr. Data Engineer

Ness Digital

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Logitech - Data Governance Technical Lead

Logitech

Chennai, Tamil Nadu, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Onward Search - DevOps/Automation Engineer

Onward Search

(Remote)
4 Hours ago
The Walt Disney Company - Sr Software Engineer (Roku/BrightScript/SceneGraph)

The Walt Disney Company

New York, New York, United States (On-Site)
4 Months ago
Brillio - Java Full Stack Architect - R01536819

Brillio

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Epic Games - Senior SDET

Epic Games

Cary, North Carolina, United States (On-Site)
21 Hours ago
Bytro - Game Developer - Javascript / HTML5 (f/m/x)

Bytro

Hamburg, Hamburg, Germany (Hybrid)
7 Months ago
IGT - Systems Engineer

IGT

Las Vegas, Nevada, United States (Remote)
4 Months ago
MPOWER Financing - Senior Quality Assurance Automation Engineer

MPOWER Financing

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Epic Games - Senior Software Development Engineer in Test (SDET)

Epic Games

Montreal, Quebec, Canada (On-Site)
1 Month ago
SmileGate - [AI센터] DevOps, 인프라 엔지니어

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
3 Months ago
Truecaller - Data Engineer

Truecaller

Stockholm, Stockholm County, Sweden (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Imagineio - Lead QA Engineer

Imagineio

Delhi, India (Hybrid)
1 Week ago
Metyis - Lead Devops Engineer

Metyis

Bengaluru, Karnataka, India (On-Site)
4 Months ago
C1X  Inc  - Senior QA Engineer

C1X Inc

Chennai, Tamil Nadu, India (On-Site)
5 Months ago
GoMotive - Associate Enterprise Systems Product Manager

GoMotive

Bengaluru, Karnataka, India (Remote)
1 Week ago
PwC - Senior Associate_ GCP Data Engineer_D&A_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
5 Months ago
STOXX - Data Engineer

STOXX

Maharashtra, India (Hybrid)
5 Months ago
India International University of Legal Education and Research - Social Media Manager

India International University of Legal Education and Research

Mormugao, Goa, India (On-Site)
4 Months ago
CleverTap - Solutions Engineer

CleverTap

Gurugram, Haryana, India (Hybrid)
5 Months ago
Wipro - ITIL Release Manager

Wipro

Bengaluru, Karnataka, India (On-Site)
4 Months ago
PwC - IN-Senior Associate_ESG sustainability_Climate & Energy_Advisory_Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

PwC - IN_Senior Associate_ Oracle EPM FCCS _D&A_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
prizepicks - Data Scientist - Simulation/Sports Modeling

prizepicks

Atlanta, Georgia, United States (Remote)
5 Days ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
2 Months ago
ASSIST Software - Data Engineer

ASSIST Software

Suceava, Suceava County, Romania (Remote)
1 Month ago
WebMD - Senior Data Analyst, Tableau Reporting

WebMD

Maharashtra, India (Remote)
1 Month ago
PwC - IN-Senior Associate_Big Data Engineer_Data & Analytics_Advisory_ PAN India

PwC

Gurugram, Haryana, India (On-Site)
5 Months ago
The Walt Disney Company - Internship - Assistant Reporting Analyst - Big Data

The Walt Disney Company

Serris, Île-de-France, France (On-Site)
2 Hours ago
Beghou Consulting - Sr. Consultant

Beghou Consulting

Boston, Massachusetts, United States (Hybrid)
5 Months ago
Meta - Marketing Science Partner (Financial Services)

Meta

San Francisco, California, United States (On-Site)
4 Months ago
Rovio Entertainment Corporation - Senior Data Analyst

Rovio Entertainment Corporation

Uusimaa, Finland (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Bengaluru, Karnataka, India (On-Site)

Mississauga, Ontario, Canada (On-Site)

Toronto, Ontario, Canada (On-Site)

Poland, Ohio, United States (Remote)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug