Sr. Director, Data Engineering

1 Month ago • 12 Years +

Job Summary

Job Description

The Senior Director of Data Engineering will lead the data platform team at Vimeo in building scalable, high-performance infrastructure on the Databricks stack. This role involves managing a team of Senior Engineers and Data Engineering Managers, driving technical excellence, and fostering innovation. Responsibilities include leading and mentoring the team, developing data platforms, architecting data models, integrating data platform services, establishing monitoring and alerting systems, translating business requirements into technical solutions, and optimizing resource allocation. They will also set performance expectations and mitigate risks. The role requires expertise in full-stack development, automation-first engineering, and cloud-native data platforms.
Must have:
  • 12+ years experience in building and operating data platforms.
  • 5+ years experience in managing and leading data engineering teams.
  • Expertise in cloud-native data architectures (AWS, GCP, or Azure).
  • Expertise in Python, Spark/PySpark, and modern data platform technologies.
  • Understanding of Business Intelligence applications (Looker).
Good to have:
  • Experience with SQL databases, data visualization tools, and large-scale data analytics platforms.
  • Hands-on experience (professional certification preferred) with cloud-based data platforms.
  • Basic Linux/Unix system administration skills and shell scripting.
  • Familiarity with machine learning pipelines, including MLOps practices and model deployment.
  • Experience with real-time analytics tools and data streaming technologies.

Job Details

Vimeo is seeking a visionary Senior Director of Data Engineering to lead our data platform team in building scalable, high-performance infrastructure on the Databricks stack. This role requires a hands-on leader with expertise in full-stack development, automation-first engineering, and cloud-native data platforms. You will manage a team of Senior Engineers and Data Engineering Managers, driving technical excellence and fostering a culture of innovation.

 What you'll do:

  • Lead, mentor, and inspire a team of Data Engineers working in cross-functional squads alongside analysts in building robust, high-performance data platforms leveraging modern technologies like Python, Spark/PySpark, and cloud-native services, emphasizing scalability, automation, and resilience.
  • Drive the development of real-time streaming data platforms and batch processing systems using modern tools such as Spark Streaming, Apache Airflow, and data transformation frameworks.
  • Architect data models within a medallion architecture to create reusable, maintainable, and stable data infrastructure that are easily consumed by Business Intelligence applications (Looker)
  • Lead the seamless integration of data platform services with application development, contributing to full-stack solutions that effectively bridge data infrastructure and business intelligence applications.
  • Establish and maintain comprehensive monitoring, logging, and alerting systems for data platform services, utilizing DevOps tools to ensure high availability and scalability.
  • Partner with cross-functional teams to translate complex business requirements into robust technical platform solutions, prioritizing automation-friendly approaches for new builds
  • Lead migration efforts of legacy infrastructure to target-state modern data stacks
  • Optimize resource allocation, ensuring the acquisition and deployment of top-tier talent and essential tools to meet project and operational needs
  • Set clear performance expectations, conduct regular reviews, and provide constructive feedback to foster a culture of high performance.
  • Proactively identify and mitigate potential risks to the data platform's reliability and performance, developing robust contingency plans.
  • Own the strategic architecture and hands-on implementation of comprehensive data platform solutions, from data ingestion and processing to platform service deployment, with a strong focus on automation and CI/CD best practices.

Skills and knowledge you should possess:

  • BS/MS in Computer Science, Software Engineering, or a related discipline.
  • 12+ years of experience in building and operating production-grade data platforms, with a strong emphasis on full-stack development and automation.
  • 5+ years of experience in managing and leading data engineering teams.
  • Deep understanding of software engineering best practices, including version control (Git), CI/CD pipelines, testing frameworks, and code reviews.
  • Extensive expertise in cloud-native data architectures (AWS, GCP, or Azure), Spark/PySpark, Python, and modern data platform technologies.
  • Understanding of Business Intelligence applications (Looker) and best practices for building sustainable underpinning data infrastructure
  • Ability to automate data quality monitoring, data governance, and master data management processes.
  • Proven track record of delivering impactful data platform products, including data APIs, automated reporting tools, and self-service data platforms.
  • Familiarity with event-driven architectures and streaming data platforms (Kafka, Kinesis, or similar technologies).
  • Expertise in Python, Spark/PySpark, and cloud-based data processing for large-scale data manipulation and automation.
  • Proficiency in data platform automation using Apache Airflow, data transformation tools, and workflow orchestration systems.
  • Experience in building and integrating RESTful APIs and event-driven services.
  • Solid understanding of software development methodologies, including Agile, DevOps, and DataOps.

Nice-to-haves/Bonus Points:

  • Experience with SQL databases, data visualization tools, and large-scale data analytics platforms.
  • Hands-on experience (professional certification preferred) with cloud-based data platforms (AWS, Google Cloud Platform, Azure).
  • Basic Linux/Unix system administration skills and shell scripting.
  • Familiarity with machine learning pipelines, including MLOps practices and model deployment.
  • Experience with real-time analytics tools and data streaming technologies.
  • Strong understanding of DevOps practices, including CI/CD, infrastructure as code (Terraform, Pulumi), and monitoring tools (Prometheus, Grafana).
  • Proficiency in containerization and orchestration technologies, such as Docker and Kubernetes, for building scalable data platform services.
  • Experience in developing and deploying microservices and serverless applications.

About us:

Vimeo is the world’s leading all-in-one video software solution. Our platform enables any professional, team, and organization to unlock the power of video to create, collaborate and communicate. We proudly serve our growing community of over 200 million users — from creatives to entrepreneurs to the world’s largest companies.

Vimeo is headquartered in New York City with offices around the world. At Vimeo, we believe our impact is greatest when our workforce of passionate, dedicated people, represents our diverse and global community. We’re proud to be an equal opportunity employer where diversity, equity, and inclusion are championed in how we build our products, develop our leaders, and strengthen our culture.

About Us:

Vimeo (NASDAQ: VMEO) is the world's most innovative video experience platform. We enable anyone to create high-quality video experiences to better connect and bring ideas to life. We proudly serve our community of millions of users – from creative storytellers to globally distributed teams at the world's largest companies – whose videos receive billions of views each month. Learn more at www.vimeo.com.
 
Vimeo is headquartered in New York City with offices around the world. At Vimeo, we believe our impact is greatest when our workforce of passionate, dedicated people, represents our diverse and global community. We’re proud to be an equal opportunity employer where diversity, equity, and inclusion is championed in how we build our products, develop our leaders, and strengthen our culture.

Similar Jobs

Inworld AI - Forward Deployed Engineer (AI Gameplay Engineer)

Inworld AI

Vancouver, British Columbia, Canada (On-Site)
2 Months ago
Inworld AI - Senior Software Development Engineer in Test (SDET)

Inworld AI

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
InMobiInMobi - Staff Data Scientist I

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Thousand Eyes - Lead Software Engineer I, Internet Insights

Thousand Eyes

Austin, Texas, United States (On-Site)
2 Weeks ago
NVIDIA - Senior System Software Engineer - QNX BSP and IO Virtualization

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

HCL Tech - Test Specialist

HCL Tech

North Carolina, United States (On-Site)
2 Weeks ago
Trend Micro - Data Scientist

Trend Micro

Manila, Metro Manila, Philippines (On-Site)
16 Years ago
Playtika - Data Infrastructure Director

Playtika

Israel (On-Site)
7 Months ago
Cognite - Solution Architect

Cognite

Tokyo, Japan (On-Site)
7 Months ago
Funcom - VFX Artist - Internship

Funcom

Bucharest, Bucharest, Romania (On-Site)
2 Months ago
London stock Exchange - Senior AWS Data Engineer

London stock Exchange

Bengaluru, Karnataka, India (Hybrid)
2 Weeks ago
N-iX - Data Engineer (with Databricks)

N-iX

Poland (Remote)
2 Months ago
Egnyte - Junior Software Engineer - Nodejs, Python

Egnyte

India (Remote)
1 Month ago
sitecore - Data Engineer

sitecore

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
1 Month ago
The Walt Disney Company - Senior Software Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Tel Aviv-Yafo, Tel Aviv District, Israel

Playtika - Senior Level Designer - Solitaire Grand Harvest

Playtika

Israel (On-Site)
4 Months ago
Google - Senior CPU Design Verification Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
NVIDIA - Senior Chip Design Verification Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
NVIDIA - SDK Ethernet Software Team Manager

NVIDIA

Ra'anana, Center District, Israel (On-Site)
4 Months ago
Google - Junior CPU Formal Verification Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Play Perfect - Senior BI Data Engineer

Play Perfect

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Weeks ago
Google - Technical Account Manager, Play Partnerships, Global Business Consulting

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
BigID - Software Engineer Team Lead

BigID

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
1 Month ago
Google - IP Design Group Lead, Networking, Google Cloud

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
CyberArk - Senior Legal Counsel, Employment & Compensation

CyberArk

Israel (Hybrid)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

New York, United States (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (Remote)

New York, United States (Remote)

New York, United States (On-Site)

Bengaluru, Karnataka, India (Remote)

New York, United States (Hybrid)

United States (On-Site)

View All Jobs

Get notified when new jobs are added by Vimeo

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug