Lead Data Engineer

1 Day ago • 8 Years + • Full Stack Development • DevOps • $136,317 PA - $195,427 PA

Job Summary

Job Description

Milestone seeks a Lead Data Engineer to architect, design, and build highly scalable distributed data systems for cloud-based video surveillance and IoT control systems. Responsibilities include working with product managers, employing advanced data structures and modeling, articulating design trade-offs, driving implementation based on best practices, providing project estimates, managing delivery velocity, mentoring engineers, and championing good software engineering habits. The role also involves resolving complex system issues, collaborating with engineering leadership, identifying automation opportunities, and driving a culture of technical excellence. This fully remote position requires at least 8 years of software development experience and expertise in areas such as Go/C++ programming, ETL/ELT pipelines, real-time data processing, and distributed databases.
Must have:
  • 8+ years software development experience
  • Experience with Go, C++, or equivalent
  • ETL/ELT pipeline experience
  • Real-time data processing (Kafka, etc.)
  • Distributed columnar databases and Time Series
  • Modern CI/CD and Git workflows
Good to have:
  • Data lake experience
  • Singlestore experience
  • TDD/BDD development practices
  • Public cloud experience (GCP, AWS, Azure)
Perks:
  • Flexible work environment
  • Opportunities for further education
  • Medical/dental benefits
  • 401k with employer match
  • Paid parental leave
  • Generous PTO
  • Disability and Life Insurance

Job Details

Job Description

Be the key in unlocking business opportunities in the convergent world of Open Platform IP Video Management Systems! Join Milestone, a global market leader!

Milestone seeks a Lead Data Engineer to join our fast-moving, innovative VSaaS engineering team. In this role, you will architect, design, and build highly scalable distributed data systems to enable new and innovative solutions in cloud-based video surveillance and IoT control systems. To be successful, you must have proven experience in driving critical engineering and architectural decisions for the development team. You will provide sound technical directions and dive into solving complex system design and implementation challenges. You will learn and share knowledge with the best and help us architect and build modern cloud-native applications. You will drive decisions on technology and processes to maximize our products' performance, scalability, and reliability.

This is a fully remote role that can be located anywhere in the US. 

As a Milestone Employee, YOU are the key to our success. Come join our dynamic international team and be a part of our rapidly growing, successful business.

Responsibilities 

  • Work with product managers and technology teams to understand roadmap priorities and shape product features that address customers' needs.
  • Employ advanced knowledge of data structures, data modeling and design, and common software design patterns focusing on microservice architecture.
  • Articulate design and architecture trade-offs and apply software design patterns to solve complex engineering problems efficiently.
  • Drive design and implementation based on sound engineering principles and best practices, focusing on testability, maintainability, and scalability.
  • Provide overall project design and estimates for business and technology strategy needs during project scoping phases.
  • Manage the velocity of delivery without compromising the quality of product releases.
  • Mentor other engineers to make sound technical decisions and help build effective software engineering practices, especially in adopting formal testing as part of the software development process.
  • Embrace the “you build it, you run it” engineering principle.
  • Champion good software engineering habits, such as: clean code principles, security, tech debt balance, TDD, and “going end-to-end early”.
  • Own, diagnose, and resolve complex system technical issues and code defects.
  • Collaborate with engineering leadership to help establish the technical roadmap to facilitate innovation and enhancement of product capabilities.
  • Provide leadership with a point of view on "what’s next" in technology, coding tools, applications, and concepts.
  • Drive a culture of technical excellence, continuous improvement, and lifelong learning.
  • Identify and work with SRE to implement automation opportunities to enhance efficiency in the software delivery cycle and the reliability of Milestone’s VSaaS product.

Professional Qualifications:

  • Minimum of 8 years of software development experience with a distinguished track record of delivering complex enterprise services (or equivalent experience).
  • Minimum of 5 years of experience with programming in Go, C++, or an equivalent compiled language
  • Experience building and maintaining ETL/ELT pipelines
  • Experience with real-time data processing (Kafka, Google Pub/Sub, and similar)
  • Experience with multiple database technologies, especially distributed columnar databases and Time Series
  • Strong understanding of modern CI/CD methodologies and Git-based workflows
  • Clear and persuasive written and oral communication skills to lead or persuade fellow engineers and non-technical audience 
  • A breadth of technology and engineering skills, knowledge, and experience -comfortable with topics spanning programming languages, AI/ML, advanced networking, compute and data platforms, as well as automation and big data

Preferred Qualifications:

  • Experience working on data lakes preferred
  • Experience with Singlestore preferred
  • Familiarity with testing methodologies and fully comfortable with TDD/BDD development practices
  • Familiarity with developing applications deployed on public cloud infrastructure such as GCP, AWS, or Azure

Why Milestone?

Ranked among the 100 Best Companies to Work for in Oregon, Milestone offers great benefits and a great culture. Employees here have flexible work environments, opportunities for further education, and the ability to directly effect change in our Organization. 

This position's annual salary ranges from $136,317 to $195,427, with most candidates falling in the $154,733 to $172,436 range. Pay is based on the level, location, complexity, responsibility, and job duties of the specific position and is just one component of Milestone’s total compensation package. Additionally, we offer an attractive benefits package that includes medical/dental benefits, FSA or HSA, 401k with 6% Safe Harbor employer match, paid parental leave, generous PTO (20 days' vacation, 10 days paid sick time, and 12 company holidays), fully paid Short Term disability policy, fully paid Long Term disability policy, and Life Insurance. If you are selected for an interview, please feel welcome to speak to our Talent Partner about our compensation philosophy.

Milestone is committed to creating a diverse and inclusive workplace and is proud to be an equal opportunity employer.

Contact and application

Please apply at our website:

If you have any questions, you are very welcome to contact Kristi Mark, Contract Recruiter, at

We are excited to receive your application. 

Similar Jobs

Aristocrat Gaming - Mobile Developer

Aristocrat Gaming

Montreal, Quebec, Canada (Hybrid)
1 Week ago
Intrepid Studios,  Inc  - Senior Anti-Cheat Engineer

Intrepid Studios, Inc

San Diego, California, United States (On-Site)
8 Months ago
Tesla - Manufacturing Development Engineer Battery Cell Assembly

Tesla

Brandenburg, Germany (On-Site)
2 Months ago
Intrepid Studios,  Inc  - Senior Network Engineer

Intrepid Studios, Inc

San Diego, California, United States (On-Site)
2 Months ago
Aristocrat Gaming - Senior Solutions Architect

Aristocrat Gaming

London, England, United Kingdom (Hybrid)
1 Month ago
Google - Customer Solutions Engineer

Google

New York, New York, United States (On-Site)
1 Week ago
Warner Bros Games - Staff Software Engineer

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
1 Month ago
Entrata - Senior Software Engineer

Entrata

Pune, Maharashtra, India (Hybrid)
6 Months ago
Google - Software Engineer, Runtime, AICore, Platforms and Devices

Google

Taipei City, Taiwan (On-Site)
1 Day ago
The Walt Disney Company - Lead Software Engineer (Roku Engineer)

The Walt Disney Company

Santa Monica, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Icon Group  gmbh - Senior 3D Motion Designer

Icon Group gmbh

Stuttgart, Baden-Württemberg, Germany (On-Site)
4 Weeks ago
HP - Manufacturing Technician

HP

Penang, Malaysia (On-Site)
3 Months ago
ByteDance - Technical Program Manager, Public Cloud

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
Electronic Arts - Development Director II - Core Gameplay

Electronic Arts

Kirkland, Washington, United States (On-Site)
3 Months ago
Easy Brain - Senior UX/UI Designer

Easy Brain

Limassol, Limassol, Cyprus (Hybrid)
3 Months ago
Visa - Visa Consulting and Analytics Director

Visa

Tbilisi, Tbilisi, Georgia (On-Site)
6 Months ago
Icon Group  gmbh - Senior UI Designer

Icon Group gmbh

Stuttgart, Baden-Württemberg, Germany (On-Site)
4 Weeks ago
PwC - Penetration Tester

PwC

Rome, Lazio, Italy (On-Site)
7 Months ago
Tesla - Cell Test Engineer, Powertrain Engineering

Tesla

Brandenburg, Germany (On-Site)
2 Months ago
Intrepid Studios,  Inc  - Principal Economy Designer

Intrepid Studios, Inc

San Diego, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United States

PlayStation Global - Accountant (Contract)

PlayStation Global

Aliso Viejo, California, United States (Hybrid)
1 Month ago
ByteDance - Software Engineer — Data Security

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Google - Senior CPU RTL Designer

Google

Austin, Texas, United States (On-Site)
1 Week ago
Scientific Games  - Advanced Solutions Architect

Scientific Games

Georgia, United States (Remote)
2 Weeks ago
NVIDIA - Senior Developer Technology Engineer, Compute

NVIDIA

Santa Clara, California, United States (On-Site)
5 Days ago
Zoox - Manager - Robot Platform Safety, Trajectory Generation

Zoox

Foster City, California, United States (Hybrid)
6 Months ago
ByteDance - Software Engineer, SRE - Platform Services

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
AGS - American Gaming Systems - Senior Regulatory Compliance Specialist

AGS - American Gaming Systems

United States (Remote)
1 Month ago
Google - Senior Software Engineer, Machine Learning (Recommendations, Rankings, and Predictions)

Google

Mountain View, California, United States (On-Site)
1 Week ago
Google - Senior Hardware Engineer, Display Metrology

Google

Fremont, California, United States (On-Site)
1 Day ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Ubisoft - Senior C++ Programmer

Ubisoft

Malmö, Skåne County, Sweden (Hybrid)
1 Month ago
Luxoft - Senior Java Developer

Luxoft

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
4 Months ago
Trackman - Booking & Payment Lead Developer & People Manager

Trackman

Denmark (On-Site)
3 Months ago
IManage - Full Stack Senior Developer (ReactJS, NodeJS)

IManage

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
CData Software - Software Development Engineer III

CData Software

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Google - Software Engineer III, Google Cloud Global Networking

Google

Atlanta, Georgia, United States (On-Site)
4 Months ago
Nielsen Holdings - C#, .Net + Datascience

Nielsen Holdings

Gurugram, Haryana, India (Hybrid)
6 Months ago
ByteDance - Senior Software Engineer, Edge Cloud Platform

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
Google - Software Engineer III, Infrastructure, Google Cloud Networking

Google

Dublin, County Dublin, Ireland (On-Site)
1 Week ago
Keywords Studios - MPG | Lead Software Engineer

Keywords Studios

United Kingdom (Remote)
5 Days ago

Get notifed when new similar jobs are uploaded

About The Company

We are driven by passion and the ambition to grow and give our players a unique experience. With excellent organisation, careers paths, training, smart working, benefits and company parties, at Milestone you can combine professional growth, personal wealth and lots of fun!

United States (Remote)

New South Wales, Australia (Remote)

Sofia, Sofia City Province, Bulgaria (Hybrid)

Copenhagen, Denmark (Hybrid)

Sofia, Sofia City Province, Bulgaria (Hybrid)

United States (Remote)

Portland, Oregon, United States (Hybrid)

Portland, Oregon, United States (Remote)

United States (Remote)

View All Jobs

Get notified when new jobs are added by Milestone

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug