Lead Data Engineer (#2527)

2 Months ago • 8 Years + • Data Analyst

Job Summary

Job Description

As a Lead Data Engineer, you'll be pivotal in the merger of a major European and Canadian online car marketplace. Responsibilities include simplifying existing tools, addressing technical debt, proposing improvements, and actively participating in team discussions. You will work closely with senior engineers, product managers, and engineering managers. The role demands expertise in AWS (Glue, Athena), Python, PySpark, GCP SQL, Airflow, data streaming frameworks (Kafka or Firehose), data pipeline and platform building, and data modeling. The work will be conducted within the Canadian timezone.
Must have:
  • 8+ years software engineering experience
  • Lead complex data projects
  • AWS (Glue, Athena), Python, PySpark expertise
  • Data pipeline & platform building
  • Data modeling best practices
Perks:
  • Flexible working format
  • Competitive salary & compensation
  • Personalized career growth
  • Professional development tools
  • Education reimbursement
  • Corporate events

Job Details

About the project:

Our customer is the European online car market with over 30 million monthly users, with a market presence in 18 countries. The company is now merging with a similar company in Canada and needs support on this way. As a Lead Data Engineer, you will play a pivotal role in shaping the future of online car markets and enhancing the user experience for millions of car buyers and sellers.

Requirements:

  • 8+ years of experience in software engineering
  • English - Upper-Intermediate+
  • Proven experience leading complex data projects, organizing teams, and architecting and designing new solutions
  • Extensive expertise in AWS services, especially Glue, Athena
  • Proficiency in Python, PySpark, GCP
  • SQL, Airflow, data streaming frameworks (Kafka or Firehose)
  • Experience in building and maintaining data pipelines
  • Experience in building data platforms, not just using them
  • Proficiency in data modeling techniques and best practices

Responsibilities:

  • Work during the Canadian time zone
  • Simplify existing tools, make them more modular, work with technical debt
  • Propose improvements, be actively involved in team discussions and decision-making, drive initiatives
  • Work closely with a team of Senior Engineers, Product Manager and Engineering Manager

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Similar Jobs

Zuora - Sr Software Developer Engineer in Test

Zuora

Chennai, Tamil Nadu, India (Hybrid)
4 Months ago
The Walt Disney Company - Manager, Software Engineering(Scala)

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Months ago
King - Senior Staff Backend Engineer - Activision Blizzard Media

King

San Francisco, California, United States (On-Site)
2 Months ago
Wargaming - Senior Infrastructure Engineer (Python) (Game Engine Development Team)

Wargaming

Belgrade, Serbia (Hybrid)
2 Months ago
Zynga - Senior Software Engineer 1

Zynga

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Paypal - Database Marketing Manager

Paypal

Shanghai, Shanghai, China (On-Site)
4 Months ago
Blinkhealth - Senior Manager Data Analytics

Blinkhealth

India (On-Site)
2 Months ago
Paytm - Product Analyst - Deputy Manager - Lending

Paytm

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
Netflix - Data Engineer (L5) - Data Systems Product

Netflix

United States (Remote)
3 Months ago
CloudHire - Senior Database Engineer

CloudHire

Mumbai, Maharashtra, India (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - IN_Senior Associate_ AWS Data Engineer_D&A_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Lightcast - Senior Software Engineer

Lightcast

Chennai, Tamil Nadu, India (On-Site)
4 Months ago
ClanX - Senior Software Engineer Contract

ClanX

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Ajmera Infotech - Senior Azure DevOps Engineer (IaaS)

Ajmera Infotech

Hyderabad, Telangana, India (On-Site)
7 Months ago
Fliff  Inc  - Software Engineer II

Fliff Inc

Sofia, Sofia City Province, Bulgaria (On-Site)
8 Months ago
Malabar Gold & Diamonds - Executive - Cloud Engineer

Malabar Gold & Diamonds

Sri Vijaya Puram, Andaman And Nicobar Islands, India (On-Site)
7 Months ago
Microsoft - Senior Software Engineering Manager

Microsoft

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Aristocrat Gaming - Manager - Infrastructure Support

Aristocrat Gaming

Noida, Uttar Pradesh, India (Hybrid)
1 Month ago
CAE - Team Lead Software Engineering

CAE

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Europe

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analyst Jobs

Flipkart - Data Engineer II

Flipkart

Bengaluru, Karnataka, India (On-Site)
6 Months ago
SciPlay - Senior Analyst

SciPlay

Cedar Falls, Iowa, United States (Hybrid)
2 Months ago
Easybrain - Senior Data Engineer

Easybrain

Cyprus (On-Site)
7 Months ago
RoofStack - Data Architect

RoofStack

İstanbul, İstanbul, Türkiye (Remote)
1 Month ago
PlayStation Global - Staff Marketing Data Scientist

PlayStation Global

Aliso Viejo, California, United States (Hybrid)
7 Months ago
Social Discovery Group - Senior Web Analyst

Social Discovery Group

Belgrade, Serbia (Remote)
2 Months ago
ByteDance - Data Analyst-Workplace Service-Information System

ByteDance

Dubai, Dubai, United Arab Emirates (On-Site)
3 Months ago
PlayStation Global - Commercial Services Analyst

PlayStation Global

London, England, United Kingdom (On-Site)
1 Month ago
Intel Corporation - Data Architect

Intel Corporation

Phoenix, Arizona, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded