Principal Data Engineer

6 Months ago • 10 Years + • Data Analyst

Job Summary

Job Description

Hashlist seeks a Principal Data Engineer to design and build a scalable data platform for ingesting, storing, managing, and streaming massive datasets. Responsibilities include defining data engineering guidelines, ensuring data quality, privacy, and security across pipelines, collaborating with cross-functional teams, implementing data governance policies (GDPR, CCPA), developing data APIs, leading an experimentation platform, improving platform performance, mentoring a team, and providing on-call support. The role requires 10+ years of software engineering experience, expertise in cloud platforms (AWS, Azure, GCP), and proficiency in streaming/batch pipelines, NoSQL databases, and DevSecOps.
Must have:
  • 10+ years software engineering experience
  • 5+ years architecting data products on public cloud
  • Expertise in streaming & batch pipelines (Kafka, Spark)
  • Strong data security & SQL optimization experience
  • Proficiency in NoSQL databases (DynamoDB, Cassandra)
  • Experience with DevSecOps and data governance

Job Details

About the job

Hashlist is a platform for projects within the automotive industry.


We establish supplier relationships with automotive companies and provide a one-stop shop for candidates interested in working in the industry.


Are you ready to embark on this journey?


Our client is seeking a Principal Data Engineer. By applying, you gain access to the Hashlist network, unlocking opportunities in automotive projects across the industry.


Available locations: This position is open to candidates in Brazil and India (Bengaluru, Chennai & Pune).


Responsibilities:

  • Design and build a scalable data platform to ingest, store, manage, and stream massive amounts of data for high-quality data products and services.
  • Define and maintain data engineering design, security, and privacy guidelines.
  • Develop frameworks to ensure data availability, correctness, privacy, and security in all data pipelines.
  • Collaborate with data science, UX, and software engineering teams to optimize data pipelines and ensure low-latency access to data products.
  • Implement data governance policies to ensure GDPR and CCPA compliance for third-party data management.
  • Partner with software engineering teams to design data request/delivery APIs and standardize metering for data products.
  • Lead the implementation of an experimentation platform for testing data products.
  • Continuously improve reliability, performance, scalability, and quality, and own associated KPIs.
  • Build and mentor a world-class team of data engineers.
  • Provide on-call support for the platform and troubleshoot issues.


Qualifications:

  • 10+ years of software engineering experience with a proven track record of delivering successful software products.
  • 5+ years of experience architecting and building data products on public cloud platforms (AWS, Azure, GCP).
  • Expertise in streaming and batch pipelines (Kinesis, Apache Kafka, Apache Spark).
  • Strong experience with data security, preventive controls, and SQL optimization in AWS.
  • Proficiency in NoSQL databases like DynamoDB and Cassandra.
  • Experience with DevSecOps in data pipelines and operational excellence practices.
  • Advanced degree in Computer Science/Engineering or related fields (lower experience level accepted).


Next Steps:

  • Click "Apply."
  • We will review your application.
  • If qualified, you’ll be accepted into the Hashlist network and considered for this and other relevant projects.

Similar Jobs

truecaller - Backend Engineer - Golang

truecaller

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Games 24x7 - Engineering Manager

Games 24x7

Bengaluru, Karnataka, India (On-Site)
5 Days ago
appier - Software Engineer, Site Reliability Engineering

appier

Tokyo, Japan (On-Site)
2 Weeks ago
Zazz - Data Engineer

Zazz

(Remote)
4 Months ago
Brillio - DB Migration Engineer - R01531207

Brillio

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
MURKA - Marketing Data Analyst

MURKA

Poland (On-Site)
4 Months ago
bytedance - Risk Data Analytics Business Partner

bytedance

Singapore (On-Site)
2 Months ago
Ubisoft - Financial Analyst Assistant Internship

Ubisoft

Paris, Île-de-France, France (On-Site)
3 Months ago
Epic Games - Principal Data Analyst

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
Bandai Namco - Ratings and Compliance Analyst

Bandai Namco

Santa Clara, California, United States (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Next Level Business Services - Java - Scala Architect

Next Level Business Services

San Diego, California, United States (On-Site)
7 Months ago
DataVisor - Software Engineer - Infrastructure team

DataVisor

Japan (Remote)
2 Weeks ago
IION - Lead Backend Engineer

IION

India (Remote)
3 Weeks ago
Zazz - Data Engineer (6–8 Years) Adhoc

Zazz

India (On-Site)
5 Months ago
Coupa - Senior Technical Architect

Coupa

Tokyo, Japan (Hybrid)
1 Month ago
Zazz - Data Engineer

Zazz

(Remote)
4 Months ago
Crowd Strick - Sr. Engineer - Sensor SDET

Crowd Strick

India (Remote)
1 Year ago
CrowdStrike - Sr. Engineer -Cloud- IoT

CrowdStrike

Pune, Maharashtra, India (On-Site)
3 Weeks ago
Coupa - Principal Software Engineer (ROR)

Coupa

India (Hybrid)
4 Months ago
IMC - Data Engineer

IMC

Mumbai, Maharashtra, India (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Chennai, Tamil Nadu, India

Accenture - Customer Contact Communications Associate

Accenture

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
caliogo - Staff DevOps Engineer

caliogo

Hyderabad, Telangana, India (On-Site)
11 Months ago
Zelis  - Senior DevOps Engineer

Zelis

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
CyberArk - Team Leader, Engineering

CyberArk

India (On-Site)
3 Weeks ago
Maersk Careers - Software Engineer- BRIM CI

Maersk Careers

Bengaluru, Karnataka, India (On-Site)
196 Years ago
Nagarro - Staff Engineer, QA Manual

Nagarro

India (Remote)
7 Months ago
SingleStore - Senior/Staff Product Manager, Cloud Security

SingleStore

Hyderabad, Telangana, India (On-Site)
1 Month ago
AlphaSense - Join AlphaSense India Talent Community

AlphaSense

Delhi, India (On-Site)
6 Days ago
PwC - Senior Manager_Kinaxis_ Supply Chain  _Advisory_Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
8 Months ago
Ubisoft - UI Technical Artist

Ubisoft

Pune, Maharashtra, India (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Animoca Brands - Tokenomics Analyst

Animoca Brands

(On-Site)
2 Months ago
MURKA - Marketing Data Analyst

MURKA

Poland (On-Site)
4 Months ago
bytedance - Senior Software Engineer, Database Acceleration

bytedance

Seattle, Washington, United States (On-Site)
1 Month ago
Ubisoft - Internal Controls IT Auditor

Ubisoft

Carentoir, Brittany, France (Hybrid)
1 Month ago
Luxoft - Data Engineer (financial/investment domain)

Luxoft

Singapore, Singapore (On-Site)
6 Months ago
PwC - IN-Senior Associate_Big Data Engineer_Data & Analytics_Advisory_ PAN India

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago
The Walt Disney Company - Principal Software Engineer - Ad Platform

The Walt Disney Company

Glendale, California, United States (On-Site)
4 Months ago
playrix  - Senior Data Analyst (Attribution)

playrix

Portugal (Remote)
7 Months ago
Fanatee - Product Business Analyst

Fanatee

São Paulo, State Of São Paulo, Brazil (Hybrid)
3 Months ago
Patreon - Staff Data Scientist

Patreon

San Francisco, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Chennai, Tamil Nadu, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

View All Jobs

Get notified when new jobs are added by Hashlist

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug