Senior Data Engineer
Job Summary
Job Description
This Senior Data Engineer role in Dublin, Ireland involves designing, building, and optimizing data pipelines for batch and real-time processing. Responsibilities include developing data models for data warehouses and lakes, implementing data quality checks, collaborating with engineers to optimize data storage and retrieval, and working with data scientists and stakeholders to meet their data needs. The role requires expertise in data warehousing, SQL, Python, and various data processing tools (e.g., Flume, DataFlow, Spark). Strong experience in data modeling, pipeline development, and stakeholder management is essential. The candidate will also ensure data security and compliance.
Must have:
- 5+ years experience in data pipeline design
- Proficiency in SQL and Python
- Experience with data warehousing and modeling
- Data quality and monitoring expertise
- Collaboration with stakeholders
Good to have:
- Experience with statistical methodology
- Business intelligence tool experience (Tableau, Power BI)
- Project planning and delivery experience
- Machine learning experience
- Experience with DataFlow and Spark
10 skills required
Job Details
Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 5 years of experience designing data pipelines, and dimensional data modeling for synch and asynch system integration and implementation using internal (e.g., Flume, etc.) and external stacks (DataFlow, Spark, etc.).
- 5 years of experience coding in one or more programming languages (e.g., SQL, Python).
- 5 years of experience working with data infrastructure and data models by performing exploratory queries and scripts.
Preferred qualifications:
- 5 years of experience with statistical methodology and data consumption tools such as business intelligence tools, collabs, jupyter notebooks, Tableau, Power BI, Data Studio, and business intelligence platforms.
- 3 years of experience developing project plans and delivering projects on time within budget and scope.
- 3 years of experience partnering with stakeholders (e.g., users, partners, customer), and managing stakeholders/customers.
- Experience with Machine Learning for production workflows.
About the job
The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.Responsibilities
- Design, build, optimize, and maintain batch and real-time pipelines to ingest, process, and transform data sources.
- Develop and manage logical and physical data models within data warehouses or data lakes, ensuring data is structured efficiently, reporting, machine learning model training, and operational use.
- Implement robust monitoring and data quality checks with accuracy with completeness.
- Collaborate with platform engineers to optimize data storage, retrieval, and processing performance, delivering effective growing data volumes and query complexity.
- Work closely with data scientists, analysts, product managers, and policy specialists to understand their data requirements and deliver effective data solutions. Provide support for data access and tooling. Implement and adhere to data security best practices and privacy regulations ensuring data infrastructure is secure and compliant.
Similar Jobs
Chicago, Illinois, United States (On-Site)
• 2 Days ago
Mexico City, Mexico City, Mexico (On-Site)
• 2 Weeks ago
Inworld AI
Vancouver, British Columbia, Canada (Remote)
• 1 Month ago
Austin, Texas, United States (On-Site)
• 1 Week ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
ByteDance
Seattle, Washington, United States (On-Site)
• 6 Months ago
Varonis
Morrisville, North Carolina, United States (On-Site)
• 3 Months ago
Prophecy
San Francisco, California, United States (Hybrid)
• 1 Day ago
Inworld AI
Vancouver, British Columbia, Canada (Remote)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Jobs in Dublin, County Dublin, Ireland
PwC
Dublin, County Dublin, Ireland (On-Site)
• 6 Months ago
Dublin, County Dublin, Ireland (On-Site)
• 1 Week ago
Interactive Brokers
Dublin, County Dublin, Ireland (On-Site)
• 9 Hours ago
Dublin, County Dublin, Ireland (On-Site)
• 2 Days ago
PwC
Kilkenny, County Kilkenny, Ireland (On-Site)
• 6 Months ago
Microsoft
Dublin, County Dublin, Ireland (Hybrid)
• 2 Weeks ago
Get notifed when new similar jobs are uploaded
Data Analyst Jobs
Paytm
Noida, Uttar Pradesh, India (On-Site)
• 4 Months ago
Nielsen Holdings
Bengaluru, Karnataka, India (Hybrid)
• 6 Months ago
Washington, District Of Columbia, United States (On-Site)
• 1 Week ago
Netflix
Mumbai, Maharashtra, India (On-Site)
• 2 Weeks ago
DraftKings
Boston, Massachusetts, United States (On-Site)
• 7 Months ago
PwC
Kolkata, West Bengal, India (On-Site)
• 6 Months ago
Get notifed when new similar jobs are uploaded
About The Company
A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.
Get notified when new jobs are added by Google
