Technical Lead Data Engineer
Job Summary
Job Description
The Technical Lead Data Engineer will further develop the internal Data Platform for a global investment advisor organization. Responsibilities include designing and building robust and scalable data pipelines, optimizing database performance, managing infrastructure as code, and collaborating with stakeholders. Strong Python development skills (5+ years experience), SQL proficiency, and cloud experience (Azure preferred) are essential. The role requires expertise in data ingestion, modeling, and optimization, as well as familiarity with tools like Airflow and Terraform.
Must have:
- 5+ years Python development experience (production environments)
- Advanced SQL proficiency (PostgreSQL, MySQL, MSSQL)
- Experience with Airflow or similar orchestration tools
- 3+ years cloud experience (Azure preferred)
- Experience with Terraform or equivalent
- Advanced degree in relevant field
Good to have:
- Data Pipeline Design expertise
- Experience with Git, CI/CD
- Excellent communication skills
- Experience with PySpark, DPT, SQLMesh, PostgreSQL, MySQL, MSSQL
- Experience with Azure DevOps, JIRA, Confluence
Perks:
- Flexible working format (remote, office, hybrid)
- Competitive salary and benefits
- Personalized career growth
- Professional development tools
- Active tech communities
- Education reimbursement
- Corporate events
15 skills required
Job Details
Our Client is a global investment advisor organization that utilizes advanced technologies and data analytics to improve the operational performance of their portfolio companies. Key objectives include delivering strong financial returns, offering diverse investment opportunities, enhancing portfolio company operations, and proactively managing risks. They have invested in proprietary technology and data-driven strategies to extract additional value. Currently, they are expanding their data science team in London, seeking a Technical Lead Data Engineer to further develop their internal Data Platform.
Required Skills and Qualifications:
Must have:
- Python Development: minimum 5 years of professional experience in production environments, emphasising performance optimisation and code quality.
- Ingestion and modelling:
- Experience with Python and orchestration tools like Airflow is beneficial.
- SQL Proficiency: advanced knowledge of SQL:
- At least one of PostgreSQL, MySQL, MSSQL
- Ability to write complex queries and optimise database performance
- Utilise DPT tools.
- Infrastructure as Code: experience with Terraform or equivalent tools to facilitate code-controlled infrastructure management.
- Cloud Experience: over 3 years of hands-on experience with cloud providers, specifically:
- AWS or GCP is acceptable
- Azure is highly preferred due to project-specific requirements.
- English – Upper-Intermediate or Advanced.
- Ukrainian language Advanced or higher.
- Education: advanced degree (Master’s or Ph.D.) in Data Science, Statistics, Computer Science, Engineering, or a related field.
Nice to have:
- Data Pipeline Design: Strong understanding of designing robust and scalable data pipelines for large-scale applications.
- Version Control and CI/CD: Familiarity with Git-based workflows and continuous integration/deployment practices to ensure seamless code integration and deployment processes.
- Communication Skills: Ability to articulate complex technical concepts to technical and non-technical stakeholders alike.
- Experience with programming: Python, PySpark, DPT, SQLMesh (optional), PostgreSQL, MySQL, MSSQL, Terraform
- Hands on experience with tools and technologies: Git, Azure DevOps, JIRA, Confluence
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
Similar Jobs
brightmachines
San Francisco, California, United States (On-Site)
• 2 Months ago
ByteDance
Dubai, Dubai, United Arab Emirates (On-Site)
• 7 Months ago
New York, New York, United States (On-Site)
• 1 Month ago
Wind River Systems
Bengaluru, Karnataka, India (On-Site)
• 7 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
ByteDance
San Jose, California, United States (On-Site)
• 3 Months ago
Taipei City, Taiwan (On-Site)
• 1 Month ago
New Taipei, New Taipei City, Taiwan (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Jobs in Ukraine
luxsoft
Odesa, Odesa Oblast, Ukraine (On-Site)
• 2 Weeks ago
Get notifed when new similar jobs are uploaded
DevOps Jobs
GoTo Group
Bengaluru, Karnataka, India (On-Site)
• 6 Months ago
Luxoft
Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
• 6 Months ago
NVIDIA
Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
• 3 Months ago
Get notifed when new similar jobs are uploaded
