Principal Data Engineer

5 Months ago • 10 Years + • Data Analyst

Job Summary

Job Description

Hashlist seeks a Principal Data Engineer to design and build a scalable data platform for ingesting, storing, managing, and streaming massive datasets. Responsibilities include defining data engineering guidelines, ensuring data quality, privacy, and security across pipelines, collaborating with cross-functional teams, implementing data governance policies (GDPR, CCPA), developing data APIs, leading an experimentation platform, improving platform performance, mentoring a team, and providing on-call support. The role requires 10+ years of software engineering experience, expertise in cloud platforms (AWS, Azure, GCP), and proficiency in streaming/batch pipelines, NoSQL databases, and DevSecOps.
Must have:
  • 10+ years software engineering experience
  • 5+ years architecting data products on public cloud
  • Expertise in streaming & batch pipelines (Kafka, Spark)
  • Strong data security & SQL optimization experience
  • Proficiency in NoSQL databases (DynamoDB, Cassandra)
  • Experience with DevSecOps and data governance

Job Details

About the job

Hashlist is a platform for projects within the automotive industry.


We establish supplier relationships with automotive companies and provide a one-stop shop for candidates interested in working in the industry.


Are you ready to embark on this journey?


Our client is seeking a Principal Data Engineer. By applying, you gain access to the Hashlist network, unlocking opportunities in automotive projects across the industry.


Available locations: This position is open to candidates in Brazil and India (Bengaluru, Chennai & Pune).


Responsibilities:

  • Design and build a scalable data platform to ingest, store, manage, and stream massive amounts of data for high-quality data products and services.
  • Define and maintain data engineering design, security, and privacy guidelines.
  • Develop frameworks to ensure data availability, correctness, privacy, and security in all data pipelines.
  • Collaborate with data science, UX, and software engineering teams to optimize data pipelines and ensure low-latency access to data products.
  • Implement data governance policies to ensure GDPR and CCPA compliance for third-party data management.
  • Partner with software engineering teams to design data request/delivery APIs and standardize metering for data products.
  • Lead the implementation of an experimentation platform for testing data products.
  • Continuously improve reliability, performance, scalability, and quality, and own associated KPIs.
  • Build and mentor a world-class team of data engineers.
  • Provide on-call support for the platform and troubleshoot issues.


Qualifications:

  • 10+ years of software engineering experience with a proven track record of delivering successful software products.
  • 5+ years of experience architecting and building data products on public cloud platforms (AWS, Azure, GCP).
  • Expertise in streaming and batch pipelines (Kinesis, Apache Kafka, Apache Spark).
  • Strong experience with data security, preventive controls, and SQL optimization in AWS.
  • Proficiency in NoSQL databases like DynamoDB and Cassandra.
  • Experience with DevSecOps in data pipelines and operational excellence practices.
  • Advanced degree in Computer Science/Engineering or related fields (lower experience level accepted).


Next Steps:

  • Click "Apply."
  • We will review your application.
  • If qualified, you’ll be accepted into the Hashlist network and considered for this and other relevant projects.

Similar Jobs

Ubisoft - Scientifique principal en données ML _ Groupe Technologique Content Creation

Ubisoft

Montreal, Quebec, Canada (On-Site)
3 Months ago
Bohemia Interactive - Node.js Developer

Bohemia Interactive

Prague, Prague, Czechia (On-Site)
1 Week ago
NVIDIA - Senior Software Engineer - Backend

NVIDIA

Ra'anana, Center District, Israel (On-Site)
3 Months ago
Dream Sports - Manager - Business Analytics

Dream Sports

Mumbai, Maharashtra, India (On-Site)
5 Months ago
Netflix - Distributed Systems Engineer (L4) - Data Platform

Netflix

United States (Remote)
5 Months ago
The Walt Disney Company - Statistics Analyst II

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
1 Week ago
Playtika - Expert Business Analyst

Playtika

Israel (On-Site)
4 Weeks ago
Tencent - WeChat Tech Intern (Data Scientist - Safety Strategies)

Tencent

Singapore (On-Site)
7 Months ago
Ziff Davis - Sr. Data Engineer

Ziff Davis

Malaga, Western Australia, Australia (Remote)
4 Months ago
Rackspace Technology - Data Engineer II

Rackspace Technology

Vietnam (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Trend Micro - Backend Engineer

Trend Micro

Manila, Metro Manila, Philippines (On-Site)
16 Years ago
Talentica Software - Data Scientist

Talentica Software

India (Remote)
6 Months ago
PwC - Associate

PwC

Pune, Maharashtra, India (On-Site)
6 Months ago
Dream Sports - Senior Manager - Business Analytics

Dream Sports

Mumbai, Maharashtra, India (On-Site)
7 Months ago
Stonewall Collision & Auto Painting - Senior Data Scientist

Stonewall Collision & Auto Painting

Vijayawada, Andhra Pradesh, India (On-Site)
7 Months ago
GoMotive - Senior Software Engineer, Backend

GoMotive

Pakistan (Remote)
1 Month ago
Ciklum - Senior Data Scientist

Ciklum

Chennai, Tamil Nadu, India (Hybrid)
6 Months ago
Sleeper - Backend Engineer

Sleeper

Los Angeles, California, United States (Remote)
3 Weeks ago
Zazz - Data Engineer (6–8 Years) Adhoc

Zazz

India (On-Site)
4 Months ago
Microsoft - Principal Software Engineer

Microsoft

Bengaluru, Karnataka, India (On-Site)
5 Days ago

Get notifed when new similar jobs are uploaded

Jobs in Chennai, Tamil Nadu, India

Velotio Technologies - Senior GenAI Engineer - Java

Velotio Technologies

Maharashtra, India (Remote)
4 Days ago
Xentrix Studios - Compositing – Artist

Xentrix Studios

India (On-Site)
5 Months ago
Microsoft - Principal Software Engineer - C/C++ (Embedded)

Microsoft

Hyderabad, Telangana, India (On-Site)
5 Days ago
Microsoft - Software Engineering IC3

Microsoft

Hyderabad, Telangana, India (On-Site)
51 Minutes ago
Google - Operations Excellence Manager, Global Vendor Operations, YouTube

Google

Hyderabad, Telangana, India (On-Site)
4 Days ago
Nagarro - Associate Staff Engineer, PHP Magento

Nagarro

India (Remote)
6 Months ago
PwC - IN-Director_Oil & Gas_Fuels & Resources_Advisory_Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Zones - Azure Backend Developer

Zones

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Google - Business Intelligence Analyst, Finance

Google

Bengaluru, Karnataka, India (On-Site)
4 Days ago
Pegasystems - Cloud Security Engineer

Pegasystems

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Tap Nation - Product Manager Data Platform

Tap Nation

(Hybrid)
1 Week ago
N-iX - Senior/Lead Data Engineer

N-iX

Ukraine (Remote)
1 Week ago
Google - Infrastructure Partner Data Engineer

Google

Bengaluru, Karnataka, India (On-Site)
4 Days ago
Bally's Interactive - Insight Analyst

Bally's Interactive

London, England, United Kingdom (On-Site)
4 Weeks ago
Google - Scaled Abuse Analyst, Trust & Safety, YouTube

Google

Hyderabad, Telangana, India (On-Site)
4 Days ago
CloudHire - Senior Database Engineer

CloudHire

Hyderabad, Telangana, India (Remote)
3 Weeks ago
Xsolla - Anti-Fraud Analyst

Xsolla

France (Hybrid)
3 Weeks ago
Google - Payment Assurance Specialist

Google

San Bruno, California, United States (On-Site)
3 Days ago
Salesforce - Associate Data Analytics - Business Intelligence

Salesforce

Dallas, Texas, United States (On-Site)
2 Weeks ago
Krafton  - Insights Manager

Krafton

Seoul, South Korea (On-Site)
4 Days ago

Get notifed when new similar jobs are uploaded

About The Company

Chennai, Tamil Nadu, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

View All Jobs

Get notified when new jobs are added by Hashlist

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug