Principal Data Engineer

9 Months ago • 10 Years + • Data Analysis

Job Summary

Job Description

Hashlist seeks a Principal Data Engineer to design and build a scalable data platform for ingesting, storing, managing, and streaming massive datasets. Responsibilities include defining data engineering guidelines, ensuring data quality, privacy, and security across pipelines, collaborating with cross-functional teams, implementing data governance policies (GDPR, CCPA), developing data APIs, leading an experimentation platform, improving platform performance, mentoring a team, and providing on-call support. The role requires 10+ years of software engineering experience, expertise in cloud platforms (AWS, Azure, GCP), and proficiency in streaming/batch pipelines, NoSQL databases, and DevSecOps.
Must have:
  • 10+ years software engineering experience
  • 5+ years architecting data products on public cloud
  • Expertise in streaming & batch pipelines (Kafka, Spark)
  • Strong data security & SQL optimization experience
  • Proficiency in NoSQL databases (DynamoDB, Cassandra)
  • Experience with DevSecOps and data governance

Job Details

About the job

Hashlist is a platform for projects within the automotive industry.


We establish supplier relationships with automotive companies and provide a one-stop shop for candidates interested in working in the industry.


Are you ready to embark on this journey?


Our client is seeking a Principal Data Engineer. By applying, you gain access to the Hashlist network, unlocking opportunities in automotive projects across the industry.


Available locations: This position is open to candidates in Brazil and India (Bengaluru, Chennai & Pune).


Responsibilities:

  • Design and build a scalable data platform to ingest, store, manage, and stream massive amounts of data for high-quality data products and services.
  • Define and maintain data engineering design, security, and privacy guidelines.
  • Develop frameworks to ensure data availability, correctness, privacy, and security in all data pipelines.
  • Collaborate with data science, UX, and software engineering teams to optimize data pipelines and ensure low-latency access to data products.
  • Implement data governance policies to ensure GDPR and CCPA compliance for third-party data management.
  • Partner with software engineering teams to design data request/delivery APIs and standardize metering for data products.
  • Lead the implementation of an experimentation platform for testing data products.
  • Continuously improve reliability, performance, scalability, and quality, and own associated KPIs.
  • Build and mentor a world-class team of data engineers.
  • Provide on-call support for the platform and troubleshoot issues.


Qualifications:

  • 10+ years of software engineering experience with a proven track record of delivering successful software products.
  • 5+ years of experience architecting and building data products on public cloud platforms (AWS, Azure, GCP).
  • Expertise in streaming and batch pipelines (Kinesis, Apache Kafka, Apache Spark).
  • Strong experience with data security, preventive controls, and SQL optimization in AWS.
  • Proficiency in NoSQL databases like DynamoDB and Cassandra.
  • Experience with DevSecOps in data pipelines and operational excellence practices.
  • Advanced degree in Computer Science/Engineering or related fields (lower experience level accepted).


Next Steps:

  • Click "Apply."
  • We will review your application.
  • If qualified, you’ll be accepted into the Hashlist network and considered for this and other relevant projects.

Similar Jobs

Sagecor - Software Engineer 3

Sagecor

Annapolis Junction, Maryland, United States (On-Site)
3 Weeks ago
Scout - Technical Specialist, Drive System

Scout

Columbia, South Carolina, United States (On-Site)
1 Month ago
Cognite - Full Stack Engineer

Cognite

Phoenix, Arizona, United States (Hybrid)
1 Month ago
BioFire - Research Associate II

BioFire

Salt Lake City, Utah, United States (On-Site)
1 Week ago
Precisly - Mainframe Senior Software Engineer

Precisly

United Kingdom (On-Site)
3 Weeks ago
HoYoverse - Data Analyst - Honkai: Star Rail - Fresh Grad

HoYoverse

Singapore (On-Site)
8 Months ago
IMC - Data Quality Engineer

IMC

Amsterdam, North Holland, Netherlands (On-Site)
4 Weeks ago
Marsh McLennan - Senior Analyst - Data Science

Marsh McLennan

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago
Minecast - Principal Data Engineer

Minecast

London, England, United Kingdom (Hybrid)
1 Week ago
NVIDIA - Solutions Architect, Data Science

NVIDIA

Taipei City, Taiwan (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Reltio - Intern - DevOps

Reltio

Lisbon, Lisbon, Portugal (On-Site)
2 Months ago
Moloco - Agency Senior Growth Manager

Moloco

London, England, United Kingdom (On-Site)
2 Months ago
Applike - Data Analyst (Gaming)

Applike

Hamburg, Hamburg, Germany (Hybrid)
3 Months ago
Tencent - Senior Researcher, Natural Language Processing

Tencent

(On-Site)
5 Months ago
AVER LLC - Ten- Print Examiner- Internship

AVER LLC

United States (On-Site)
9 Months ago
NBC Universal - Senior Collections Analyst

NBC Universal

Amsterdam, North Holland, Netherlands (On-Site)
3 Weeks ago
GoTo Group - Lead Product Manager - Buy Now Pay Later

GoTo Group

Jakarta, Indonesia (On-Site)
3 Months ago
Postman - Senior Data Analyst

Postman

San Francisco, California, United States (Hybrid)
2 Months ago
Fandom  - Sr Analyst, Revenue Analytics

Fandom

United States (Remote)
1 Week ago
GOAT Group - Junior Authentication Training Specialist

GOAT Group

Atlanta, Georgia, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Chennai, Tamil Nadu, India

Capgemini - Storage Administration

Capgemini

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Zynga - Senior Motion Designer

Zynga

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Hitachi - Japanese Certification Req. - JBU

Hitachi

Chennai, Tamil Nadu, India (On-Site)
9 Months ago
LTI Mindtree - Specialist - Software Engineering

LTI Mindtree

India (On-Site)
3 Months ago
Ceragon Networks - Verification and Validation Engineer

Ceragon Networks

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
PropReturns - Senior Data Scientist

PropReturns

Maharashtra, India (On-Site)
11 Months ago
Wolters Kluwer - Automation Testing Engineer (Selenium with Java) 3+ Years

Wolters Kluwer

Chennai, Tamil Nadu, India (Hybrid)
1 Week ago
Alphawave Semi - Principal Engineer - STA

Alphawave Semi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Ciklum - Senior Android Developer

Ciklum

Chennai, Tamil Nadu, India (Hybrid)
10 Months ago
HP - Compliance & Control Lead - AMS Region

HP

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Trailmix - Senior Data Engineer

Trailmix

London, England, United Kingdom (Hybrid)
3 Weeks ago
Apple - AI Data Scientist

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Make - Senior Data Engineer

Make

Prague, Prague, Czechia (On-Site)
2 Months ago
Highspot - Sr. Data Analyst

Highspot

Hyderabad, Telangana, India (Hybrid)
5 Months ago
Aristocrat - Business Analyst

Aristocrat

Las Vegas, Nevada, United States (Hybrid)
2 Months ago
Illumina - Sr Financial Business Systems Analyst

Illumina

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Apple - Senior Marketing Data Scientist

Apple

Cupertino, California, United States (On-Site)
2 Months ago
PayPal - Sr. Analyst, Data Management Oversight

PayPal

Luxembourg, Luxembourg, Luxembourg (Hybrid)
1 Week ago
Roblox - Data Scientist / Senior Data Scientist - Social Communities

Roblox

San Mateo, California, United States (On-Site)
1 Month ago
truecaller - Senior Staff Data Engineer II

truecaller

Stockholm, Stockholm County, Sweden (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Chennai, Tamil Nadu, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

View All Jobs

Get notified when new jobs are added by Hashlist

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug