Principal Data Engineer

We establish supplier relationships with automotive companies and provide a one-stop shop for candidates interested in working in the industry.

Are you ready to embark on this journey?

Our client is seeking a Principal Data Engineer. By applying, you gain access to the Hashlist network, unlocking opportunities in automotive projects across the industry.

Available locations: This position is open to candidates in Brazil and India (Bengaluru, Chennai & Pune).

Responsibilities:

• Design and build a scalable data platform to ingest, store, manage, and stream massive amounts of data for high-quality data products and services.
• Define and maintain data engineering design, security, and privacy guidelines.
• Develop frameworks to ensure data availability, correctness, privacy, and security in all data pipelines.
• Collaborate with data science, UX, and software engineering teams to optimize data pipelines and ensure low-latency access to data products.
• Implement data governance policies to ensure GDPR and CCPA compliance for third-party data management.
• Partner with software engineering teams to design data request/delivery APIs and standardize metering for data products.
• Lead the implementation of an experimentation platform for testing data products.
• Continuously improve reliability, performance, scalability, and quality, and own associated KPIs.
• Build and mentor a world-class team of data engineers.
• Provide on-call support for the platform and troubleshoot issues.

Qualifications:

• 10+ years of software engineering experience with a proven track record of delivering successful software products.
• 5+ years of experience architecting and building data products on public cloud platforms (AWS, Azure, GCP).
• Expertise in streaming and batch pipelines (Kinesis, Apache Kafka, Apache Spark).
• Strong experience with data security, preventive controls, and SQL optimization in AWS.
• Proficiency in NoSQL databases like DynamoDB and Cassandra.
• Experience with DevSecOps in data pipelines and operational excellence practices.
• Advanced degree in Computer Science/Engineering or related fields (lower experience level accepted).

Next Steps:

• Click "Apply."
• We will review your application.
• If qualified, you’ll be accepted into the Hashlist network and considered for this and other relevant projects.