Principal Data Engineer

4 Months ago • 10 Years + • Data Analyst

Job Summary

Job Description

Hashlist seeks a Principal Data Engineer to design and build a scalable data platform for ingesting, storing, managing, and streaming massive datasets. Responsibilities include defining data engineering guidelines, ensuring data quality, privacy, and security across pipelines, collaborating with cross-functional teams, implementing data governance policies (GDPR, CCPA), developing data APIs, leading an experimentation platform, improving platform performance, mentoring a team, and providing on-call support. The role requires 10+ years of software engineering experience, expertise in cloud platforms (AWS, Azure, GCP), and proficiency in streaming/batch pipelines, NoSQL databases, and DevSecOps.
Must have:
  • 10+ years software engineering experience
  • 5+ years architecting data products on public cloud
  • Expertise in streaming & batch pipelines (Kafka, Spark)
  • Strong data security & SQL optimization experience
  • Proficiency in NoSQL databases (DynamoDB, Cassandra)
  • Experience with DevSecOps and data governance

Job Details

About the job

Hashlist is a platform for projects within the automotive industry.


We establish supplier relationships with automotive companies and provide a one-stop shop for candidates interested in working in the industry.


Are you ready to embark on this journey?


Our client is seeking a Principal Data Engineer. By applying, you gain access to the Hashlist network, unlocking opportunities in automotive projects across the industry.


Available locations: This position is open to candidates in Brazil and India (Bengaluru, Chennai & Pune).


Responsibilities:

  • Design and build a scalable data platform to ingest, store, manage, and stream massive amounts of data for high-quality data products and services.
  • Define and maintain data engineering design, security, and privacy guidelines.
  • Develop frameworks to ensure data availability, correctness, privacy, and security in all data pipelines.
  • Collaborate with data science, UX, and software engineering teams to optimize data pipelines and ensure low-latency access to data products.
  • Implement data governance policies to ensure GDPR and CCPA compliance for third-party data management.
  • Partner with software engineering teams to design data request/delivery APIs and standardize metering for data products.
  • Lead the implementation of an experimentation platform for testing data products.
  • Continuously improve reliability, performance, scalability, and quality, and own associated KPIs.
  • Build and mentor a world-class team of data engineers.
  • Provide on-call support for the platform and troubleshoot issues.


Qualifications:

  • 10+ years of software engineering experience with a proven track record of delivering successful software products.
  • 5+ years of experience architecting and building data products on public cloud platforms (AWS, Azure, GCP).
  • Expertise in streaming and batch pipelines (Kinesis, Apache Kafka, Apache Spark).
  • Strong experience with data security, preventive controls, and SQL optimization in AWS.
  • Proficiency in NoSQL databases like DynamoDB and Cassandra.
  • Experience with DevSecOps in data pipelines and operational excellence practices.
  • Advanced degree in Computer Science/Engineering or related fields (lower experience level accepted).


Next Steps:

  • Click "Apply."
  • We will review your application.
  • If qualified, you’ll be accepted into the Hashlist network and considered for this and other relevant projects.

Similar Jobs

Ciklum - Senior Data Scientist

Ciklum

Pune, Maharashtra, India (Hybrid)
5 Months ago
Nielsen Holdings - Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Trend Micro - Backend Engineer

Trend Micro

Manila, Metro Manila, Philippines (On-Site)
15 Years ago
Sinch - Site Reliability Engineer

Sinch

France (Remote)
1 Week ago
Dream Sports - Director - Engineering (Platform)

Dream Sports

Mumbai, Maharashtra, India (On-Site)
3 Days ago
Tripledot Studios - Product Analyst

Tripledot Studios

Jakarta, Jakarta, Indonesia (Hybrid)
2 Months ago
Netflix - Distributed Systems Engineer (L5) - Data Platform

Netflix

United States (Remote)
5 Months ago
CloudHire - Data Labeler

CloudHire

Karnataka, India (Remote)
1 Week ago
Axinous - Associate, Strategic Finance/Investor Relations

Axinous

Hyderabad, Telangana, India (Remote)
1 Week ago
InMobiInMobi - Senior Analyst – Business Analytics & Insights

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Dream Sports - SDE 1 - Backend

Dream Sports

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Scopely - Senior Software Engineer (PHP)

Scopely

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Dream Sports - Director - DevOps

Dream Sports

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Dream Sports - SDE 2 - React Native

Dream Sports

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Paytm - Data Engineering - Data Engineer

Paytm

Noida, Uttar Pradesh, India (On-Site)
4 Months ago
Evolution - Scala Engineer

Evolution

Amsterdam, North Holland, Netherlands (On-Site)
9 Months ago
Enphase Energy - Data Engineer

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Nielsen Holdings - Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Nielsen Holdings

Gurugram, Haryana, India (Hybrid)
5 Months ago
Ciklum - Expert Data Scientist

Ciklum

Pune, Maharashtra, India (Hybrid)
5 Months ago
The Walt Disney Company - Sr Software Engineer

The Walt Disney Company

Glendale, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Chennai, Tamil Nadu, India

Ethos - Software Engineer, Test

Ethos

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Krafton  - Manager - Workplace Experience

Krafton

Bengaluru, Karnataka, India (On-Site)
6 Days ago
Sumo Logic - Senior Staff Engineer

Sumo Logic

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Trend Micro - Sales Engineer, Cloud Business

Trend Micro

Bengaluru, Karnataka, India (On-Site)
6 Months ago
ION - Client Data Analyst - ECM Alpha

ION

Mumbai, Maharashtra, India (On-Site)
5 Months ago
Anthology  Inc  - Associate Test Automation Engineer II

Anthology Inc

Chennai, Tamil Nadu, India (Hybrid)
4 Days ago
Gametion Technologies   - Senior Unity Game Developer

Gametion Technologies

Navi Mumbai, Maharashtra, India (On-Site)
1 Month ago
PwC - Manager- Kolkata DN 57 - Technology Consulting

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Glean - Solutions Architect ( EMEA/US East Customer hours )

Glean

Bengaluru, Karnataka, India (On-Site)
4 Months ago
STAGE - Social Media Executive

STAGE

Noida, Uttar Pradesh, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Velotio Technologies - Software Engineer (Data Engineering)

Velotio Technologies

Maharashtra, India (Remote)
2 Weeks ago
CloudHire - Database Architect

CloudHire

Gurugram, Haryana, India (Remote)
6 Days ago
Next Level Business Services - Sr. Informatica Designer

Next Level Business Services

Pleasanton, California, United States (On-Site)
5 Months ago
Mattel  Inc  - Director, Consumer Data & Analytics - Ecommerce

Mattel Inc

El Segundo, California, United States (On-Site)
5 Months ago
CloudHire - Senior Database Engineer

CloudHire

Hyderabad, Telangana, India (Remote)
6 Days ago
Samsung Semiconductor - Data Science Intern

Samsung Semiconductor

San Jose, California, United States (Hybrid)
2 Months ago
Digital Extremes - Senior Data Scientist

Digital Extremes

Ontario, Canada (Remote)
2 Months ago
Voodoo - Senior Data Engineer (Ad networks - Core)

Voodoo

Paris, Île-de-France, France (Hybrid)
1 Month ago
Tencent - Data Analytics Intern

Tencent

Quebec, Canada (On-Site)
4 Weeks ago
Peak - Data Scientist

Peak

(On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Tamil Nadu, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

View All Jobs

Get notified when new jobs are added by Hashlist

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug