Senior Data Ops Engineer

10 Months ago • 3-5 Years
Data Analysis

Job Description

Develop a scalable data platform to manage data from various sources (vendors, research providers, exchanges, PBs, web scraping) and make it accessible to systematic & fundamental PMs, and enterprise functions (Ops, Risk, Trading, Compliance). Responsibilities include web scraping using scripts/APIs/tools, building and maintaining a greenfield data platform on Snowflake and AWS, enhancing existing pipelines, onboarding new data providers, and managing data migration projects. The role requires strong DevOps skills (Kubernetes, Docker, Jenkins) and proficiency in SQL and Python.
Good To Have:
  • Market Data Projects
  • Capital markets experience
  • Snowflake
  • Airflow
Must Have:
  • SQL
  • Python
  • Linux
  • Containerization (Docker, Kubernetes)
  • AWS
  • DevOps (K8s, Docker, Jenkins)
  • Good communication

Add these skills to join the top 1% applicants for this job

communication
talent-acquisition
linux
aws
docker
kubernetes
python
sql
jenkins

Project description

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

Web scraping using scripts/APIs/Tools

Help build and maintain greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance pipelines for the new requirements.

Onboarding new data providers

Data migration projects

Skills

Must have

SQL

Python

Linux

Containerization(Docker, Kubernetes)

Good communication skills

AWS

Strong on Dev ops side of things(K8s, Docker, Jenkins)

Nice to have

Market Data Projects/ Capital markets exp

Snowflake is a big plus

Airflow

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Set alerts for more jobs like Senior Data Ops Engineer
Set alerts for new jobs by Luxoft
Set alerts for new Data Analysis jobs in India
Set alerts for new jobs in India
Set alerts for Data Analysis (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙