Engineering Manager - Data Platform

3 Months ago • 8 Years + • Data Analyst

Job Summary

Job Description

As Engineering Manager - Data Platform at BigID, you'll lead a team of back-end and full-stack engineers, architecting and implementing big data solutions using Kafka and Elastic. Responsibilities include designing data processing pipelines, optimizing search capabilities, collaborating with cross-functional teams, overseeing code reviews, ensuring quality standards, staying updated on big data trends, troubleshooting issues, contributing to strategic planning, and collecting team KPIs. You'll work with teams across multiple global locations and engage directly with customers. The role requires strong leadership, technical expertise in Java and big data technologies, and excellent communication skills.
Must have:
  • Lead data engineering teams
  • Design big data solutions (Kafka, Elastic)
  • Proficiency in Java
  • Data modeling & ETL expertise
  • Strong communication skills
Good to have:
  • Experience with Docker, Kubernetes
  • Cloud platform experience (AWS/Azure)
  • Direct customer interaction
Perks:
  • Equity participation
  • Flexible work arrangements
  • Office perks (dog-friendly, gym, etc.)
  • Knowledge training & Career development

Job Details

Who we are:

BigID is an innovative tech startup that focuses on solutions for data security, compliance, privacy, and AI data management. We're leading the market in all things data: helping our customers reduce risk, drive business innovation, achieve compliance, build customer trust, make better decisions, and get more value from their data.

We are building a global team passionate about innovation and next-gen technology. BigID has been recognized for: 

  • BigID Named Hot Company in Artificial Intelligence and Machine Learning at the 2024 Global InfoSec Awards
  • Citizens JMP Cyber 66 List of Hottest Privately Held Cybersecurity Companies
  • CRN 100 list named BIgID as one of the 20 Coolest Identity Access Management And Data Protection Companies Of 2024 (2 years running)
  • DUNS 100 Best Tech Companies to Work For in 2024
  • Top 3 Big Data and AI Vendors to Watch' in the 2023 BigDATAwire Readers and Editors Choice Awards
  • 2024 Inc. 5000 list for the 4th consecutive year!
  • Shortlisted for the 2024 AI Awards in the category of Best Use of AI in Cybersecurity

At BigID, our team is the foundation of our success. Join a people-centric culture that is fast-paced and rewarding: you’ll have the opportunity to work with some of the most talented people in the industry who value innovation, diversity, integrity, and collaboration.

Who we seek:

We’re looking for an Engineering Manager to join our data platform team and report to the Director of Engineering. As a Software Team Lead, you’ll lead a team of back-end and full-stack engineers, working closely with the Product Manager to plan, kickoff, and execute new product and feature development projects. Our ideal candidate is someone who values excellence, is hungry for success, and thrives when working with the best.

As the Data Platform Manager, you'll be responsible for overseeing the design, development, and implementation of our big data architecture. You'll lead a team of data engineers and collaborate with cross-functional teams to drive data initiatives that support business objectives. Your expertise in Elastic, Kafka, and Java will be critical in ensuring the scalability and performance of our data systems.

What you’ll do:

  • Lead and mentor a team of data engineers in the design and development of big data solutions.
  • Architect and implement data processing pipelines using Kafka for real-time data streaming.
  • Optimize and manage search capabilities using Elastic technologies.
  • Collaborate with product managers, data analysts, and other stakeholders to gather requirements and translate them into technical specifications.
  • Oversee code reviews, ensure best practices in coding and data handling, and maintain high-quality standards in software development.
  • Stay up-to-date with emerging trends and technologies in big data and recommend improvements to our architecture and processes.
  • Troubleshoot and resolve issues in a timely manner to minimize downtime and ensure system reliability.
  • Contribute to strategic planning and decision-making regarding data architecture and tools.
  • Collect and analyze your team’s KPIs.
  • Participate in customer calls, understand their use cases, and solve their problems.
  • Collaborate with software teams from Israel, Portugal, Ukraine, Poland, and India.

What you’ll bring:

  • Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred
  • 3+ years of experience leading software teams
  • 8+ years of experience in the software engineering field
  • 5+ years of experience in big data technologies, with a focus on Elastic and Kafka
  • Proficiency in Java programming and experience with related frameworks
  • Strong understanding of data modeling, ETL processes, and data warehousing
  • Proven leadership skills with the ability to motivate and guide a team
  • Excellent problem-solving abilities and strong analytical skills
  • Strong communication skills, with the ability to convey technical concepts to non-technical stakeholders
  • A solid understanding of CI/CD principles
  • Experience working with both external and in-house APIs and SDKs 

Advantages:

  • Experience working directly with customers
  • Experience with Docker, Kubernetes
  • Experience with cloud platforms (e.g., AWS or Azure) 

What’s in it for you?!

Our people are the foundation of our success, and we prioritize offering a wide range of benefits that make our team happier and healthier.

  • Equity participation - everyone shares in our success
  • Flexible work arrangements - for parents, for remote workdays, etc.
  • Office perks: dog-friendly environment, fully stocked fridge, gym, and exercise classes, weekly Happy Hours, free parking, evening meals
  • Knowledge training & Career development tracks

Our Values:

We look for people who embody our values - Care, Do, Try & Shine.

  • Care - We care about our customers and each other
  • Do - We do what it takes to make a positive impact
  • Try- We try our best and we don’t give up
  • Shine- We shine and make it our mission to always stand out

#LI-Hybrid

#LI-AT1

BigDiversity: We’re committed to creating a culture of inclusion, diversity, and equality – across race, gender, sexuality, disability, and neurodiversity – where innovation and growth thrive, every voice is heard, and everybody belongs. Learn more about us here.

CPRA Employee Privacy Notice: CA 

BigID is an E-Verify Participant.

Similar Jobs

Anthology  Inc  - Support Analyst

Anthology Inc

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Microsoft - Software Engineer

Microsoft

Reston, Virginia, United States (On-Site)
1 Month ago
Evolution - QA Automation Engineer (Back-end team)

Evolution

Sofia, Sofia City Province, Bulgaria (On-Site)
5 Days ago
Luxoft - PL-SQL Developer

Luxoft

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Epic Games - Backend Engineer

Epic Games

(On-Site)
1 Month ago
Xsolla - Researcher/Analyst

Xsolla

Baku, Azerbaijan (Remote)
3 Months ago
Trek - Master Data Analyst

Trek

Haryana, India (On-Site)
4 Weeks ago
Google - Open Career Opportunities, Verily Life Sciences

Google

(On-Site)
2 Months ago
CloudHire - Data Curator/ entry operator

CloudHire

India (Remote)
4 Months ago
MiQ - Manager Data Science

MiQ

Bengaluru, Karnataka, India (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Next Level Business Services - Android Developer

Next Level Business Services

Holtsville, New York, United States (On-Site)
4 Months ago
Netflix - Distributed Systems Engineer (L5) - Compute Runtime

Netflix

United States (Remote)
3 Months ago
ION - Senior Software Engineer - Full Stack

ION

Pune, Maharashtra, India (On-Site)
4 Months ago
Luxoft - Infrastructure Engineer with AWS

Luxoft

Poland, Ohio, United States (Remote)
3 Months ago
Google - Research Intern, PhD, Summer 2025

Google

Toronto, Ontario, Canada (On-Site)
3 Months ago
Zuora - Senior ML Engineer

Zuora

Chennai, Tamil Nadu, India (Hybrid)
3 Months ago
King - Senior Staff Backend Engineer - Activision Blizzard Media

King

San Francisco, California, United States (On-Site)
2 Months ago
Epic Games - Software Development Engineer in Test (SDET)

Epic Games

(On-Site)
2 Weeks ago
PhonePe - Firmware Engineer (Exp. Bucket 7-10 Yrs)

PhonePe

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Nagarro - Senior Engineer, QA Automation

Nagarro

Philippines (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Tel Aviv-Yafo, Tel Aviv District, Israel

NVIDIA - Senior Engineering Build Manager

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Day ago
NVIDIA - Senior Network Algorithms Architect

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Month ago
Unity - Product Marketing Manager

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago
SuperPlay - Bookkeeper

SuperPlay

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
6 Days ago
Intel Corporation - Linux Kernel Developer

Intel Corporation

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
1 Month ago
Salesforce - Backend Software Engineer - Lead/Principal

Salesforce

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
4 Months ago
PAPAYA - Analytics Principal

PAPAYA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
6 Months ago
Aristocrat Gaming - .NET Developer

Aristocrat Gaming

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
5 Months ago
NVIDIA - Senior System Power and Performance Validation Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Month ago
Intel Corporation - SW Embedded (Kernel) Team Leader

Intel Corporation

Haifa District, Israel (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Canva - Software Engineer (Python) - Data Platform (Open to remote across ANZ)

Canva

Sydney, New South Wales, Australia (Remote)
1 Month ago
SmileGate - Data Analyst (Contract)

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
1 Day ago
Thumbtack - Risk Analyst II

Thumbtack

Philippines (Remote)
1 Month ago
PwC - IN_Senior Associate _Java Developer _Data & Analytics _Advisory _PAN India

PwC

Kolkata, West Bengal, India (On-Site)
4 Months ago
10times - Data Scientist

10times

Bengaluru, Karnataka, India (On-Site)
4 Months ago
SoundHound AI - Language Specialist, Telugu [Contractor]

SoundHound AI

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Playrix - Senior Data Analyst (Attribution)

Playrix

Cyprus (Remote)
4 Months ago
Scopely - Technical Lead of Analytics Engineering

Scopely

Barcelona, Catalonia, Spain (Hybrid)
2 Months ago
Zynga - Data Analyst - Gram Games

Zynga

İstanbul, Türkiye (Hybrid)
2 Months ago
Zocdoc - Analyst

Zocdoc

Pune, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

BigID is a leader in data security, privacy, compliance, and governance: enabling organizations to proactively discover, manage, protect, and get more value from their data in a single platform for data visibility and control.


Customers use BigID to reduce their data risk, automate security and privacy controls, achieve compliance, and understand their data across their entire data landscape: including multicloud, hybrid cloud, IaaS, PaaS, SaaS, and on-prem data sources

Boston, Massachusetts, United States (Remote)

Sydney, New South Wales, Australia (On-Site)

Atlanta, Georgia, United States (Remote)

London, England, United Kingdom (Remote)

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)

Chicago, Illinois, United States (Remote)

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)

Zurich, Ontario, Canada (Remote)

London, England, United Kingdom (Remote)

View All Jobs

Get notified when new jobs are added by BigID

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug