Technical Lead Data Engineer

2 Months ago • 5 Years + • DevOps

Job Summary

Job Description

The Technical Lead Data Engineer will further develop the internal Data Platform for a global investment advisor organization. Responsibilities include designing and building robust and scalable data pipelines, optimizing database performance, managing infrastructure as code, and collaborating with stakeholders. Strong Python development skills (5+ years experience), SQL proficiency, and cloud experience (Azure preferred) are essential. The role requires expertise in data ingestion, modeling, and optimization, as well as familiarity with tools like Airflow and Terraform.
Must have:
  • 5+ years Python development experience (production environments)
  • Advanced SQL proficiency (PostgreSQL, MySQL, MSSQL)
  • Experience with Airflow or similar orchestration tools
  • 3+ years cloud experience (Azure preferred)
  • Experience with Terraform or equivalent
  • Advanced degree in relevant field
Good to have:
  • Data Pipeline Design expertise
  • Experience with Git, CI/CD
  • Excellent communication skills
  • Experience with PySpark, DPT, SQLMesh, PostgreSQL, MySQL, MSSQL
  • Experience with Azure DevOps, JIRA, Confluence
Perks:
  • Flexible working format (remote, office, hybrid)
  • Competitive salary and benefits
  • Personalized career growth
  • Professional development tools
  • Active tech communities
  • Education reimbursement
  • Corporate events

Job Details

Our Client is a global investment advisor organization that utilizes advanced technologies and data analytics to improve the operational performance of their portfolio companies. Key objectives include delivering strong financial returns, offering diverse investment opportunities, enhancing portfolio company operations, and proactively managing risks. They have invested in proprietary technology and data-driven strategies to extract additional value. Currently, they are expanding their data science team in London, seeking a Technical Lead Data Engineer to further develop their internal Data Platform.

Required Skills and Qualifications:

Must have:

  • Python Development: minimum 5 years of professional experience in production environments, emphasising performance optimisation and code quality.
  • Ingestion and modelling: 
    • Experience with Python and orchestration tools like Airflow is beneficial.
  • SQL Proficiency: advanced knowledge of SQL:
    • At least one of PostgreSQL, MySQL, MSSQL
    • Ability to write complex queries and optimise database performance
    • Utilise DPT tools.
  • Infrastructure as Code: experience with Terraform or equivalent tools to facilitate code-controlled infrastructure management.
  • Cloud Experience: over 3 years of hands-on experience with cloud providers, specifically:
    • AWS or GCP is acceptable
    • Azure is highly preferred due to project-specific requirements.
  • English – Upper-Intermediate or Advanced.
  • Ukrainian language Advanced or higher.
  • Education: advanced degree (Master’s or Ph.D.) in Data Science, Statistics, Computer Science, Engineering, or a related field.

Nice to have:

  • Data Pipeline Design: Strong understanding of designing robust and scalable data pipelines for large-scale applications.
  • Version Control and CI/CD: Familiarity with Git-based workflows and continuous integration/deployment practices to ensure seamless code integration and deployment processes.
  • Communication Skills: Ability to articulate complex technical concepts to technical and non-technical stakeholders alike.
  • Experience with programming: Python, PySpark, DPT, SQLMesh (optional), PostgreSQL, MySQL, MSSQL, Terraform
  • Hands on experience with tools and technologies: Git, Azure DevOps, JIRA, Confluence

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Similar Jobs

Mashgin - Senior Technical Product Manager

Mashgin

Palo Alto, California, United States (Hybrid)
6 Months ago
Google - Staff Software Engineer, GenAI, Data Quality

Google

Mountain View, California, United States (On-Site)
1 Week ago
N-iX - Senior Golang Software Engineer

N-iX

(Remote)
1 Week ago
Google - Software Engineer, Storage Everywhere

Google

Durham, North Carolina, United States (On-Site)
6 Days ago
Providence India - Lead Software Engineer

Providence India

Hyderabad, Telangana, India (Hybrid)
7 Months ago
Magna International - Senior Cloud Engineer

Magna International

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - Technical Account Manager, Google Cloud Consulting

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
4 Days ago
Google - Software Engineer III, Shopping Build Site Reliability Engineer

Google

Zürich, Zurich, Switzerland (On-Site)
1 Week ago
Velotio Technologies - Senior DevOps Engineer (GCP)

Velotio Technologies

Maharashtra, India (Remote)
1 Month ago
Google - Customer Engineer III, Navy

Google

San Diego, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Samsung Semiconductor - Performance Analysis Engineer (Contractor)

Samsung Semiconductor

San Jose, California, United States (Hybrid)
4 Months ago
Playrix - Senior Technical Designer

Playrix

Almaty, Almaty Region, Kazakhstan (Remote)
6 Months ago
NVIDIA - Senior ASIC Design Engineer

NVIDIA

Washington, District Of Columbia, United States (Remote)
1 Month ago
NVIDIA - Software Configuration Management Engineer – Hardware

NVIDIA

Santa Clara, California, United States (On-Site)
1 Week ago
High Voltage Software - Lead Technical Artist

High Voltage Software

Illinois, United States (Remote)
2 Weeks ago
Trend Micro - (Sr.) Cloud Backend Engineer

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago
Google - CPU Functional Verification Engineer, Silicon

Google

Mountain View, California, United States (On-Site)
1 Week ago
Netflix - Software Engineer (L5) - Developer Enablement Tooling

Netflix

Warsaw, Masovian Voivodeship, Poland (Hybrid)
5 Months ago
Google - Software Engineer III, Research

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
Patreon - Site Reliability Engineer

Patreon

United States (Remote)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Ukraine

Playrix - Lead VFX Artist

Playrix

Ukraine (Remote)
6 Months ago
N-iX - Senior Manual QA (With Data Experience)

N-iX

Ukraine (Remote)
1 Week ago
Playtika - TypeScript Technical Lead /Kyiv

Playtika

Ukraine (On-Site)
5 Months ago
Plarium - HR Generalist

Plarium

Kyiv, Kyiv City, Ukraine (Remote)
2 Months ago
Playrix - Principal C++ Software Engineer (Tools)

Playrix

Ukraine (Remote)
6 Months ago
N-iX - Middle/Senior SAP BW Engineer

N-iX

Ukraine (Remote)
1 Week ago
Playrix - UA Marketing Producer

Playrix

Ukraine (Remote)
6 Months ago
Playrix - Director of Engineering

Playrix

Ukraine (Remote)
6 Months ago
Playtika - JavaScript Developer/Vinnytsia

Playtika

Ukraine (On-Site)
5 Months ago
Nordcurrent - 2D Artist

Nordcurrent

Dnipro, Dnipropetrovsk Oblast, Ukraine (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

IO Interactive - Build Engineer

IO Interactive

Malmö, Skåne County, Sweden (Hybrid)
3 Weeks ago
Google - Senior Engineering Manager, Google Distributed Cloud

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
Google - Customer Engineer III, Application Modernization, Google Cloud

Google

San Francisco, California, United States (On-Site)
1 Week ago
Tencent - SRE Intern

Tencent

(On-Site)
1 Month ago
ION - Microsoft System Engineer, Italy

ION

Italy (Hybrid)
6 Months ago
Granicus - Sr. DevOps Engineer

Granicus

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Social Discovery Group - ML Ops Engineer (AI Product)

Social Discovery Group

(Remote)
3 Months ago
Nagarro - Senior Staff Engineer - Prompt Engineer

Nagarro

Colombia (Remote)
1 Month ago
Egnyte - Senior DevOps Engineer - Azure

Egnyte

India (Remote)
2 Months ago
Google - Software Engineer, Site Reliability Engineering

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded