Technical Lead Data Engineer (Python)

Our Client is a global investment advisor organization that utilizes advanced technologies and data analytics to improve the operational performance of their portfolio companies. Key objectives include delivering strong financial returns, offering diverse investment opportunities, enhancing portfolio company operations, and proactively managing risks. They have invested in proprietary technology and data-driven strategies to extract additional value. 

Currently, they are expanding their data science team in London, seeking a Technical Lead Data Engineer to further develop their internal Data Platform.

Required Skills and Qualifications:

Must have:

• Python Development: Minimum 5 years of professional experience in production environments, emphasising performance optimisation and code quality.
• Ingestion and modelling: 
  • Experience with Python and orchestration tools like Airflow is beneficial.
• SQL Proficiency: Advanced knowledge of SQL:
  • At least one of PostgreSQL, MySQL, MSSQL
  • Ability to write complex queries and optimise database performance
  • Utilise DBT tools.
• Infrastructure as Code: Experience with Terraform or equivalent tools to facilitate code-controlled infrastructure management.
• Cloud Experience: Over 3 years of hands-on experience with cloud providers, specifically:
  • AWS or GCP is acceptable
  • Azure is highly preferred due to project-specific requirements
• English – Upper-Intermediate or Advanced

• Education

  • Advanced degree (Master’s or Ph.D.) in Data Science, Statistics, Computer Science, Engineering, or a related field.

Nice to have:

• Data Pipeline Design: Strong understanding of designing robust and scalable data pipelines for large-scale applications.
• Version Control and CI/CD: Familiarity with Git-based workflows and continuous integration/deployment practices to ensure seamless code integration and deployment processes.
• Communication Skills: Ability to articulate complex technical concepts to technical and non-technical stakeholders alike.

Programming Languages

• Python
• PySpark
• DPT, SQLMesh (optional)
• PostgreSQL, MySQL, MSSQL
• Terraform

Tools and Technologies

• Git
• Azure DevOps
• JIRA
• Confluence