Lead Data Engineer

18 Minutes ago • 8 Years + • Full Stack Development • DevOps • Research & Development • $136,317 PA - $195,427 PA

Job Summary

Job Description

Milestone seeks a Lead Data Engineer to architect, design, and build highly scalable distributed data systems for cloud-based video surveillance and IoT control systems. Responsibilities include working with product managers and technology teams, employing advanced knowledge of data structures and design patterns, driving design and implementation, providing project estimates, managing delivery velocity, mentoring engineers, and championing good software engineering habits. The role involves resolving complex system issues, collaborating with engineering leadership, driving technological innovation, and identifying automation opportunities. This is a fully remote role within the US.
Must have:
  • 8+ years software development experience
  • 5+ years experience with Go, C++, or equivalent
  • ETL/ELT pipeline building & maintenance
  • Real-time data processing (Kafka etc.)
  • Multiple database technologies expertise
  • Experience with distributed columnar databases and Time Series
  • TDD/BDD development practices
  • Public cloud experience (GCP, AWS, Azure)
Good to have:
  • Experience with data lakes
  • Experience with Singlestore
Perks:
  • Flexible work environment
  • Opportunities for further education
  • Medical/dental benefits
  • 401k with employer match
  • Paid parental leave
  • Generous PTO
  • Disability and Life Insurance

Job Details

Job Description

Be the key in unlocking business opportunities in the convergent world of Open Platform IP Video Management Systems! Join Milestone, a global market leader!

Milestone seeks a Lead Data Engineer to join our fast-moving, innovative VSaaS engineering team. In this role, you will architect, design, and build highly scalable distributed data systems to enable new and innovative solutions in cloud-based video surveillance and IoT control systems. To be successful, you must have proven experience in driving critical engineering and architectural decisions for the development team. You will provide sound technical directions and dive into solving complex system design and implementation challenges. You will learn and share knowledge with the best and help us architect and build modern cloud-native applications. You will drive decisions on technology and processes to maximize our products' performance, scalability, and reliability.

This is a fully remote role that can be located anywhere in the US. 

As a Milestone Employee, YOU are the key to our success. Come join our dynamic international team and be a part of our rapidly growing, successful business.

Responsibilities 

  • Work with product managers and technology teams to understand roadmap priorities and shape product features that address customers' needs.
  • Employ advanced knowledge of data structures, data modeling and design, and common software design patterns focusing on microservice architecture.
  • Articulate design and architecture trade-offs and apply software design patterns to solve complex engineering problems efficiently.
  • Drive design and implementation based on sound engineering principles and best practices, focusing on testability, maintainability, and scalability.
  • Provide overall project design and estimates for business and technology strategy needs during project scoping phases.
  • Manage the velocity of delivery without compromising the quality of product releases.
  • Mentor other engineers to make sound technical decisions and help build effective software engineering practices, especially in adopting formal testing as part of the software development process.
  • Embrace the “you build it, you run it” engineering principle.
  • Champion good software engineering habits, such as: clean code principles, security, tech debt balance, TDD, and “going end-to-end early”.
  • Own, diagnose, and resolve complex system technical issues and code defects.
  • Collaborate with engineering leadership to help establish the technical roadmap to facilitate innovation and enhancement of product capabilities.
  • Provide leadership with a point of view on "what’s next" in technology, coding tools, applications, and concepts.
  • Drive a culture of technical excellence, continuous improvement, and lifelong learning.
  • Identify and work with SRE to implement automation opportunities to enhance efficiency in the software delivery cycle and the reliability of Milestone’s VSaaS product.

Professional Qualifications:

  • Minimum of 8 years of software development experience with a distinguished track record of delivering complex enterprise services (or equivalent experience). 
  • Minimum of 5 years of experience with programming in Go, C++, or an equivalent compiled language 
  • Experience building and maintaining ETL/ELT pipelines
  • Experience with real-time data processing (Kafka, Google Pub/Sub, and similar)
  • Experience with multiple database technologies, especially distributed columnar databases and Time Series
  • Experience working on data lakes preferred
  • Experience with Singlestore preferred
  • Familiarity with testing methodologies and fully comfortable with TDD/BDD development practices
  • Familiarity with developing applications deployed on public cloud infrastructure such as GCP, AWS, or Azure
  • Strong understanding of modern CI/CD methodologies and Git-based workflows
  • Clear and persuasive written and oral communication skills to lead or persuade fellow engineers and non-technical audience 
  • A breadth of technology and engineering skills, knowledge, and experience -comfortable with topics spanning programming languages, AI/ML, advanced networking, compute and data platforms, as well as automation and big data

Why Milestone?

Ranked among the 100 Best Companies to Work for in Oregon, Milestone offers great benefits and a great culture. Employees here have flexible work environments, opportunities for further education, and the ability to directly effect change in our Organization. 

This position's annual salary ranges from $136,317 to $195,427, with most candidates falling in the $154,733 to $172,436 range. Pay is based on the level, location, complexity, responsibility, and job duties of the specific position and is just one component of Milestone’s total compensation package. Additionally, we offer an attractive benefits package that includes medical/dental benefits, FSA or HSA, 401k with 6% Safe Harbor employer match, paid parental leave, generous PTO (20 days' vacation, 10 days paid sick time, and 12 company holidays), fully paid Short Term disability policy, fully paid Long Term disability policy, and Life Insurance. If you are selected for an interview, please feel welcome to speak to our Talent Partner about our compensation philosophy.

Milestone is committed to creating a diverse and inclusive workplace and is proud to be an equal opportunity employer.

Contact and application

Please apply at our website:

If you have any questions, you are very welcome to contact Cindy Phillips, Talent Acquisition Partner at

We are excited to receive your application. 

Similar Jobs

Easy Brain - 2D Unity Animator

Easy Brain

Limassol, Limassol, Cyprus (Hybrid)
4 Months ago
Tripledot Studios - Senior UI Artist

Tripledot Studios

Jakarta, Jakarta, Indonesia (Hybrid)
2 Weeks ago
Tripledot Studios - Senior Unity Software Engineer

Tripledot Studios

Jakarta, Jakarta, Indonesia (Hybrid)
2 Months ago
Tencent - Security Operation Engineer II

Tencent

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
3 Months ago
Google - Staff Software Engineer, Infrastructure, Google Cloud Compute

Google

Seattle, Washington, United States (On-Site)
1 Month ago
Prodigal - Senior Software Engineer

Prodigal

Bengaluru, Karnataka, India (On-Site)
4 Months ago
The Walt Disney Company - Sr Software Engineer (webOS/Tizen)

The Walt Disney Company

Glendale, California, United States (On-Site)
3 Months ago
ShopBack - Staff Software Engineer

ShopBack

Bengaluru, Karnataka, India (Remote)
4 Months ago
Accurate - Senior Engineering Manager - Java

Accurate

Hyderabad, Telangana, India (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Dream Sports - ML Engineer

Dream Sports

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Intrepid Studios,  Inc  - Human Resources Manager

Intrepid Studios, Inc

San Diego, California, United States (On-Site)
3 Months ago
Growe - Access Engineer

Growe

(Remote)
1 Month ago
HP - College Intern - Category Management

HP

Singapore, Singapore (On-Site)
4 Months ago
FanCode - ML Engineer

FanCode

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Aspyr Media - Product Manager

Aspyr Media

Austin, Texas, United States (On-Site)
8 Months ago
Tripledot Studios - Lead Level Designer

Tripledot Studios

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago
Omnissa - Staff Engineer (Data Science)

Omnissa

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Visa - Head of Risk Consulting, Visa Consulting & Analytics, CISSEE

Visa

Almaty, Almaty Region, Kazakhstan (On-Site)
3 Months ago
Discord - Engineering Manager, Ads

Discord

San Francisco, California, United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in United States

Verizon - Accessibility Tester

Verizon

Alpharetta, Georgia, United States (Hybrid)
7 Months ago
Onward Search - User Interface Software Engineer

Onward Search

New York, New York, United States (Remote)
1 Week ago
Forescout Technologies  Inc  - Professional Services Engineer - DoD

Forescout Technologies Inc

California, United States (On-Site)
1 Month ago
The Walt Disney Company - Master Control Operator

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
2 Weeks ago
Company3 Method Studios - Sr. Systems Engineer

Company3 Method Studios

New York, New York, United States (On-Site)
3 Weeks ago
Nagarro - Staff Consultant ,SAP Sales Service

Nagarro

Atlanta, Georgia, United States (On-Site)
3 Months ago
Google - Senior Product Manager, Ads

Google

New York, New York, United States (On-Site)
3 Months ago
Ziff Davis - Business Development Manager

Ziff Davis

Los Angeles, California, United States (Remote)
1 Week ago
Meta - Product Manager, Machine Learning

Meta

Menlo Park, California, United States (Remote)
3 Months ago
CD PROJEKT RED - IT Helpdesk Specialist

CD PROJEKT RED

Boston, Massachusetts, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Electronic Arts - Software Engineer, C++ - EA Sports FC

Electronic Arts

Southam, England, United Kingdom (Hybrid)
1 Month ago
Google - Software Engineer, Early Career, Cloud AI

Google

(On-Site)
2 Months ago
Ajmera Infotech - Senior ASP.NET Developer with Azure Expertise

Ajmera Infotech

Hyderabad, Telangana, India (On-Site)
2 Months ago
Nagarro - Engineer, Frontend

Nagarro

India (Remote)
3 Months ago
SSC Technologies - UI Technical Lead (Angular) – Product and Innovation Team

SSC Technologies

Bucharest, Bucharest, Romania (On-Site)
4 Months ago
Nagarro - Principal Engineer, Java Fullstack

Nagarro

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Fairmatic - Senior Full Stack Engineer

Fairmatic

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
4 Months ago
CloudHire - Senior Web Developer

CloudHire

Karnataka, India (Remote)
1 Month ago
Super - Software Architect

Super

United States (Remote)
3 Months ago
GameChanger  - Full-Stack Engineer, Computer Vision

GameChanger

United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded