Outscal Logooutscal logo

Technical Lead Data Engineer

1 Month ago • 5 Years + • DevOps

Job Summary

Job Description

The Technical Lead Data Engineer will further develop the internal Data Platform for a global investment advisor organization. Responsibilities include designing and building robust and scalable data pipelines, optimizing database performance, managing infrastructure as code, and collaborating with stakeholders. Strong Python development skills (5+ years experience), SQL proficiency, and cloud experience (Azure preferred) are essential. The role requires expertise in data ingestion, modeling, and optimization, as well as familiarity with tools like Airflow and Terraform.
Must have:
  • 5+ years Python development experience (production environments)
  • Advanced SQL proficiency (PostgreSQL, MySQL, MSSQL)
  • Experience with Airflow or similar orchestration tools
  • 3+ years cloud experience (Azure preferred)
  • Experience with Terraform or equivalent
  • Advanced degree in relevant field
Good to have:
  • Data Pipeline Design expertise
  • Experience with Git, CI/CD
  • Excellent communication skills
  • Experience with PySpark, DPT, SQLMesh, PostgreSQL, MySQL, MSSQL
  • Experience with Azure DevOps, JIRA, Confluence
Perks:
  • Flexible working format (remote, office, hybrid)
  • Competitive salary and benefits
  • Personalized career growth
  • Professional development tools
  • Active tech communities
  • Education reimbursement
  • Corporate events

Job Details

Our Client is a global investment advisor organization that utilizes advanced technologies and data analytics to improve the operational performance of their portfolio companies. Key objectives include delivering strong financial returns, offering diverse investment opportunities, enhancing portfolio company operations, and proactively managing risks. They have invested in proprietary technology and data-driven strategies to extract additional value. Currently, they are expanding their data science team in London, seeking a Technical Lead Data Engineer to further develop their internal Data Platform.

Required Skills and Qualifications:

Must have:

  • Python Development: minimum 5 years of professional experience in production environments, emphasising performance optimisation and code quality.
  • Ingestion and modelling: 
    • Experience with Python and orchestration tools like Airflow is beneficial.
  • SQL Proficiency: advanced knowledge of SQL:
    • At least one of PostgreSQL, MySQL, MSSQL
    • Ability to write complex queries and optimise database performance
    • Utilise DPT tools.
  • Infrastructure as Code: experience with Terraform or equivalent tools to facilitate code-controlled infrastructure management.
  • Cloud Experience: over 3 years of hands-on experience with cloud providers, specifically:
    • AWS or GCP is acceptable
    • Azure is highly preferred due to project-specific requirements.
  • English – Upper-Intermediate or Advanced.
  • Ukrainian language Advanced or higher.
  • Education: advanced degree (Master’s or Ph.D.) in Data Science, Statistics, Computer Science, Engineering, or a related field.

Nice to have:

  • Data Pipeline Design: Strong understanding of designing robust and scalable data pipelines for large-scale applications.
  • Version Control and CI/CD: Familiarity with Git-based workflows and continuous integration/deployment practices to ensure seamless code integration and deployment processes.
  • Communication Skills: Ability to articulate complex technical concepts to technical and non-technical stakeholders alike.
  • Experience with programming: Python, PySpark, DPT, SQLMesh (optional), PostgreSQL, MySQL, MSSQL, Terraform
  • Hands on experience with tools and technologies: Git, Azure DevOps, JIRA, Confluence

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Similar Jobs

Velotio Technologies - Lead DevOps Engineer

Velotio Technologies

Maharashtra, India (Remote)
1 Week ago
NVIDIA - Principal Software Engineer - Enterprise AI Platform

NVIDIA

Santa Clara, California, United States (Hybrid)
2 Months ago
ByteDance - Senior Machine Learning Ops Engineer, ML System - Foundation Model

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Tesla - Senior Business Planning Coordinator

Tesla

Zug, Zug, Switzerland (On-Site)
1 Month ago
Big Ant Studios - Senior Programmer

Big Ant Studios

Melbourne, Victoria, Australia (On-Site)
4 Months ago
PwC - ETIC, OCI Technical Support Engineer - Senior Associate

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
4 Months ago
OneLocal - Senior DevOps Engineer

OneLocal

(Remote)
1 Week ago
Flexera - Member Technical Staff - Site Reliability Engineer

Flexera

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Epic Games - Senior DevOps Programmer

Epic Games

Porto Alegre, State Of Rio Grande Do Sul, Brazil (On-Site)
18 Hours ago
Sonar Source - Solutions Engineer

Sonar Source

Austin, Texas, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

The Walt Disney Company - Senior Systems Engineer, Data Services [Database Administration]

The Walt Disney Company

Burbank, California, United States (On-Site)
2 Months ago
ByteDance - Video Analysis and Quality Algorithm Intern 2023 Summer/Fall (MS)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
Morning Star - Technical Team Lead

Morning Star

Bucharest, Bucharest, Romania (Hybrid)
5 Months ago
NOVOMATIC - QA Engineer (Embedded Systems)

NOVOMATIC

Lesser Poland Voivodeship, Poland (Hybrid)
6 Days ago
PwC - Financial Risk Management Consultant - Senior Associate

PwC

Bangkok, Bangkok, Thailand (On-Site)
5 Months ago
PwC - IN-Senior Associate_PySpark Developer_Data & Analytics_Advisory_ PAN India

PwC

Gurugram, Haryana, India (On-Site)
5 Months ago
Zazz - Machine Learning Engineer

Zazz

(Remote)
1 Month ago
NVIDIA - Software Engineering Manager, Distributed Task-based Runtimes

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
ByteDance - Network Software Development Engineer, SDN

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Ukraine

N-iX - Senior Java Engineer (#2596)

N-iX

Ukraine (Remote)
3 Months ago
PwC - Senior Associate - Accounting Advisory Services

PwC

Kyiv, Kyiv City, Ukraine (On-Site)
5 Months ago
Nordcurrent - QA

Nordcurrent

Dnipro, Dnipropetrovsk Oblast, Ukraine (On-Site)
4 Months ago
N-iX - Middle Technical Consultant

N-iX

Ukraine (Remote)
20 Hours ago
Playrix - Senior Technical Designer

Playrix

Ukraine (Remote)
5 Months ago
Gunzilla - Lead Technical Designer

Gunzilla

Kyiv, Kyiv City, Ukraine (On-Site)
20 Hours ago
N-iX - Trainee Manual Mobile QA Engineer

N-iX

Lviv, Lviv Oblast, Ukraine (Remote)
20 Hours ago
Playtech - Release Engineer

Playtech

Kyiv, Kyiv City, Ukraine (On-Site)
2 Weeks ago
Playtech - Software Developer – Backend Content

Playtech

Kyiv, Kyiv City, Ukraine (On-Site)
1 Month ago
Playrix - Lead Technical Designer

Playrix

Ukraine (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Hitachi - Azure Infra Consultant

Hitachi

Pune, Maharashtra, India (Remote)
5 Months ago
NVIDIA - Senior DevOps Engineer, Deep Learning Frameworks

NVIDIA

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
GoTo Group - Principal SRE Engineer (SE5)

GoTo Group

Bengaluru, Karnataka, India (On-Site)
5 Months ago
SSC Technologies - Principal SRE

SSC Technologies

New York, New York, United States (On-Site)
5 Months ago
OneLocal - Senior DevOps Engineer

OneLocal

(Remote)
1 Week ago
Trend Micro - Cloud Engineer (Golang/Python, Backend Focus) 雲端開發工程師

Trend Micro

Taipei City, Taiwan (On-Site)
5 Months ago
Ajmera Infotech - Site Reliability Engineer - Kubernetes

Ajmera Infotech

San Jose, California, United States (On-Site)
1 Month ago
Magna International - Senior Cloud Engineer

Magna International

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Ajmera Infotech - Senior DevOps Engineer - AWS

Ajmera Infotech

Austin, Texas, United States (On-Site)
4 Months ago
The Walt Disney Company - Senior Software Engineer

The Walt Disney Company

New York, New York, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded