Principal Engineer, Enterprise Data Platform

6 Minutes ago • 15 Years + • Data Analysis

Job Summary

Job Description

Western Digital is a global technology company focused on powering innovation and solving problems through data. They offer a broad portfolio of storage technologies and solutions for businesses and consumers. This role, Principal Engineer, Enterprise Data Platform, involves providing strategic direction and technical oversight for modernizing data warehouse infrastructure. Key responsibilities include designing and implementing data pipelines, enforcing data governance, maintaining data flows and assets, and ensuring best practices for data democratization. The position requires deep knowledge of data engineering principles and a commitment to continuous improvement.
Must have:
  • Provide strategic direction and technical oversight for rebuilding and modernizing data warehouse infrastructure.
  • Possess deep knowledge of data engineering principles, tools, and technologies.
  • Provide direction and guidance on data architecture, solution design, and implementation strategies.
  • Design and implement data pipelines, data warehouse, and data lake using modern technology components.
  • Implement and enforce data governance policies, including data security controls and privacy regulations.
  • Define and maintain end-to-end data flows, Data Lineage, Data Catalog for various data marts.
  • Liaise between solution architects, BSAs, and data engineers to ensure compliance to standards.
  • Maintain inventory and roadmap of data assets across the Data Platform.
  • Ensure best practices for data democratization architecture & data virtualization.
  • Offer insight, guidance, prototype, and direction on the usage of latest trends and technical capabilities.
  • Stay updated with the latest industry trends and best practices.
  • Bachelor’s degree or higher in Computer Science or Engineering or related field.
  • Minimum 15+ years of experience working with Data Management.
  • Minimum of 7+ years of experience focused on Delivery or Solution Architecture of large complex data management programs.
  • Strong data modeling expertise in supporting both classic and modern data Lakehouse architectures.
  • Strong understanding and experience building ELT/ETL solutions.
  • Experience on various data Quality tools.
  • Demonstrable experience working with data structures from variety of ERP, CRM and other data sources.
  • Experience working with at least one major cloud data platform.
  • Experience working with at least one modern Lakehouse platform.
  • Experience working with Tableau, Power BI, or other Data visualization tools.
  • Develop Entity Relationship Diagrams using and data modeling tools.
  • Guide technical team to tune complex solutions, monitor system performance, and provide recommendations.
  • Prototype new technologies and implement innovative solutions.
  • Responsible for metadata management of data domain.
  • Partner with Data Governance analyst and Business Data Stewards.
  • Maintain in-depth understanding of business functions, processes, and relationships.
Good to have:
  • Knowledge of advanced analytics GenAI platforms

Job Details

Company Description

At Western Digital, our vision is to power global innovation and push the boundaries of technology to make what you thought was once impossible, possible.

At our core, Western Digital is a company of problem solvers. People achieve extraordinary things given the right technology. For decades, we’ve been doing just that. Our technology helped people put a man on the moon.

We are a key partner to some of the largest and highest growth organizations in the world. From energizing the most competitive gaming platforms, to enabling systems to make cities safer and cars smarter and more connected, to powering the data centers behind many of the world’s biggest companies and public cloud, Western Digital is fueling a brighter, smarter future.

Binge-watch any shows, use social media or shop online lately? You’ll find Western Digital supporting the storage infrastructure behind many of these platforms. And, that flash memory card that captures and preserves your most precious moments? That’s us, too.

We offer an expansive portfolio of technologies, storage devices and platforms for business and consumers alike. Our data-centric solutions are comprised of the Western Digital®, G-Technology™, SanDisk® and WD® brands.

Today’s exceptional challenges require your unique skills. It’s You & Western Digital. Together, we’re the next BIG thing in data.

Job Description

ESSENTIAL DUTIES AND RESPONSIBILITIES

  • Provide strategic direction and technical oversight for a significant greenfield initiative focused on rebuilding and modernizing our data warehouse infrastructure.
  • Possessing deep knowledge of data engineering principles, tools, and technologies.
  • Providing direction and guidance on data architecture, solution design, and implementation strategies.
  • Designing and implementing data pipelines, data warehouse, and data lake using modern technology components like Spark, Iceberg, Delta Lake, Scala, Python etc.
  • Implementing and enforcing data governance policies, including data security controls and privacy regulations.
  • Define and maintain end to end data flows, Data Lineage, Data Catalog for various data marts
  • Be a liaison between solution architects, BSA’s and data engineers to ensure compliance to standards of Data integrations, data management and review the data solutions
  • Maintain inventory and roadmap of data assets across the Data Platform
  • Ensure best practices for data democratization architecture & data virtualization
  • Offer insight, guidance, prototype, and direction on the usage of latest trends and technical capabilities for Enterprise Data Management
  • Stay updated with the latest industry trends and best practices, sharing knowledge and encourage team to continuously improve their skill’s

Qualifications

REQUIRED

  • Bachelor’s degree or higher in Computer Science or Engineering or related field
  • Minimum 15+ years of experience working with Data Management including Data Integration/ETL (Informatica, Talend, Fivetran etc.), Data Warehouse/Lakes (Oracle, Snowflake, Databricks, Google Big Query, Redshift), Master Data Management, Data Quality, Data Modeling, Data Analytics/BI, Data Enrichment, Security and Governance.
  • Minimum of 7+ years of experience focused specifically on Delivery or Solution Architecture of large complex data management programs
  • Strong data modeling expertise in supporting both classic and modern data Lakehouse architectures.
  • Strong understanding and experience building ELT/ETL solutions
  • Experience on various data Quality tools like Informatica Data Quality, Atlan, Collibra, etc.
  • Demonstrable experience working with data structures coming from variety of ERP, CRM and other data sources
  • Experience working with at least one major cloud data platforms like AWS, Azure, Google, etc.
  • Experience working with at least one modern Lakehouse platforms like Databricks, Snowflake, etc.
  • Experience working with Tableau, Power BI, or other Data visualization tools. Knowledge of advanced analytics GenAI platforms is a plus.
  • Develop Entity Relationship Diagrams using and data modeling tools.
  • Guide technical team to tunes complex solutions, monitor system performance, and provide recommendations and means for improvement
  • Prototype new technologies and implement innovative solutions to enable teams to consume and understand data faster
  • Responsible for metadata management of data domain, inclusive of data definitions, data catalog, data lineage and documentation of data flow for critical processes, Sox compliance
  • Partner with Data Governance analyst and Business Data Stewards
  • Maintain in-depth understanding of business functions, processes, and relationships as it relates to data

SKILLS

  • A solid understanding of data modeling, modern data architecture, master data management, data profiling and data cleansing techniques.
  • Experience with REST APIs, GraphQL / OData and Event-Driven Architecture Expertise in SQL with modern data warehousing solutions (e.g., GBQ, Fabric, Snowflake, Databricks).
  • Proficiency in Python and open-source data processing tools (Spark, Parquet, dbt, dataform, etc.)
  • Familiarity with essential DevOps practices, including version control, automated CI/CD, etc.
  • Ability to analyze, communicate and solve complex problems

Additional Information

Western Digital is committed to providing equal opportunities to all applicants and employees and will not discriminate based on their race, color, ancestry, religion (including religious dress and grooming standards), sex (including pregnancy, childbirth or related medical conditions, breastfeeding or related medical conditions), gender (including a person’s gender identity, gender expression, and gender-related appearance and behavior, whether or not stereotypically associated with the person’s assigned sex at birth), age, national origin, sexual orientation, medical condition, marital status (including domestic partnership status), physical disability, mental disability, medical condition, genetic information, protected medical and family care leave, Civil Air Patrol status, military and veteran status, or other legally protected characteristics. We also prohibit harassment of any individual on any of the characteristics listed above. Our non-discrimination policy applies to all aspects of employment. We comply with the laws and regulations set forth in the Equal Employment Opportunity is the Law poster.

Western Digital thrives on the power and potential of diversity. As a global company, we believe the most effective way to embrace the diversity of our customers and communities is to mirror it from within. We believe the fusion of various perspectives results in the best outcomes for our employees, our company, our customers, and the world around us. We are committed to an inclusive environment where every individual can thrive through a sense of belonging, respect and contribution.

Western Digital is committed to offering opportunities to applicants with disabilities and ensuring all candidates can successfully navigate our careers website and our hiring process. Please contact us at jobs.accommodations@wdc.com to advise us of your accommodation request. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.

#LI-RR1

Based on our experience, we anticipate that the application deadline will be 10/25/2024, although we reserve the right to close the application process sooner if we hire an applicant for this position before the application deadline. If we are not able to hire someone from this role before the application deadline, we will update this posting with a new anticipated application deadline.

Similar Jobs

GoTo Group - Data Analyst - Driver Risk

GoTo Group

Jakarta, Indonesia (On-Site)
4 Weeks ago
Go Fund Me - Senior Site Reliability Engineer

Go Fund Me

San Diego, California, United States (Hybrid)
1 Month ago
nubank - Senior Product Manager

nubank

United States (Hybrid)
1 Week ago
Nintendo - Brand Manager (m/f/d)

Nintendo

Nieuwegein, Utrecht, Netherlands (On-Site)
10 Months ago
PwC - Senior Associate - Credit Control

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
9 Months ago
luxsoft - Technical Lead / Senior Data Engineer

luxsoft

Mexico City, Mexico (Remote)
1 Month ago
Insignia consultancy services - Senior Business Analyst

Insignia consultancy services

(Remote)
11 Months ago
Corsair gaming - IT MarTech Data Solutions Architect

Corsair gaming

Milpitas, California, United States (Remote)
1 Month ago
Fortra - Senior Data Scientist

Fortra

United States (Remote)
3 Weeks ago
Apple - Data Analyst - SWE Infrastructure

Apple

Cupertino, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

MURKA - Monetization Manager

MURKA

(Remote)
6 Months ago
Google - Software Engineer III, Infrastructure, Google Cloud Compute Infrastructure

Google

Sunnyvale, California, United States (On-Site)
3 Months ago
warner bros games - Staff Software Engineer - Data Platform

warner bros games

Hyderabad, Telangana, India (Hybrid)
3 Months ago
London stock Exchange - Manager Infrastructure Data

London stock Exchange

Bucharest, Bucharest, Romania (On-Site)
1 Month ago
Marsh McLennan - Junior Consultant Trainee

Marsh McLennan

Lisbon, Lisbon, Portugal (Hybrid)
1 Month ago
Remote - HCM Onboarding Analyst

Remote

United States (Remote)
1 Week ago
Mixpanel - Director, Financial Planning & Analysis

Mixpanel

San Francisco, California, United States (Hybrid)
1 Week ago
Reddit - Growth Builder (Contract) - DACH

Reddit

Germany (Remote)
3 Weeks ago
Epic Games - Senior Data Analyst

Epic Games

Cary, North Carolina, United States (On-Site)
5 Months ago
Trend Micro - (Sr.) Data Engineer/AI Trainer

Trend Micro

Taipei City, Taiwan (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Zenoti - Sr. Site Reliability Engineer (Security)

Zenoti

Hyderabad, Telangana, India (On-Site)
2 Months ago
ISS Stoxx - Software Engineer in Test (SDET)

ISS Stoxx

Mumbai, Maharashtra, India (On-Site)
3 Weeks ago
Capgemini - Aircraft

Capgemini

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Accenture - Application Designer

Accenture

Pune, Maharashtra, India (On-Site)
1 Week ago
Axi - Backend Developer

Axi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Tech dome - Project Manager

Tech dome

Indore, Madhya Pradesh, India (On-Site)
2 Months ago
Capgemini - Finance Reporting Officer

Capgemini

Kolkata, West Bengal, India (On-Site)
2 Months ago
Capgemini - PMO

Capgemini

Chennai, Tamil Nadu, India (On-Site)
1 Month ago
Nagarro - Staff Engineer, DevOps

Nagarro

India (Remote)
9 Months ago
luxsoft - Senior Murex MxML Consultant

luxsoft

New Delhi, Delhi, India (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Match Group - Sr. Software Engineer, Data

Match Group

Palo Alto, California, United States (Hybrid)
9 Months ago
PwC - Senior Manager, Azure Data Architect, Data Analytics, Advisory

PwC

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Lambda - Data Center Operations Engineer

Lambda

Salt Lake City, Utah, United States (On-Site)
1 Week ago
Reddit - Senior Data Science Manager, Ads Marketplace

Reddit

United States (Remote)
2 Months ago
Marsh McLennan - Data Engineering Analyst

Marsh McLennan

Mexico City, Mexico (Hybrid)
1 Month ago
GameJobs - Senior Data Scientist

GameJobs

São Paulo, State Of São Paulo, Brazil (On-Site)
1 Year ago
Epic Games - Data Analyst

Epic Games

Cary, North Carolina, United States (On-Site)
5 Months ago
Mapbox - Senior/Lead Software Data Engineer (Roads Team)

Mapbox

Poland (Remote)
9 Months ago
Jane Street - Data Center Mechanical Engineer

Jane Street

New York, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Bengaluru, Karnataka, India (On-Site)

Phra Nakhon Si Ayutthaya, Thailand (On-Site)

Fujisawa, Kanagawa, Japan (Remote)

Biñan, Calabarzon, Philippines (On-Site)

Bayan Lepas, Penang, Malaysia (On-Site)

Phra Nakhon Si Ayutthaya, Thailand (On-Site)

Phra Nakhon Si Ayutthaya, Thailand (On-Site)

Prachin Buri, Thailand (On-Site)

View All Jobs

Get notified when new jobs are added by Western Digital

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug