Senior Data Engineer
Job Summary
Job Description
This Senior Data Engineer role in Dublin, Ireland involves designing, building, and optimizing data pipelines for batch and real-time processing. Responsibilities include developing data models for data warehouses and lakes, implementing data quality checks, collaborating with engineers to optimize data storage and retrieval, and working with data scientists and stakeholders to meet their data needs. The role requires expertise in data warehousing, SQL, Python, and various data processing tools (e.g., Flume, DataFlow, Spark). Strong experience in data modeling, pipeline development, and stakeholder management is essential. The candidate will also ensure data security and compliance.
Must have:
- 5+ years experience in data pipeline design
- Proficiency in SQL and Python
- Experience with data warehousing and modeling
- Data quality and monitoring expertise
- Collaboration with stakeholders
Good to have:
- Experience with statistical methodology
- Business intelligence tool experience (Tableau, Power BI)
- Project planning and delivery experience
- Machine learning experience
- Experience with DataFlow and Spark
10 skills required
Job Details
Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 5 years of experience designing data pipelines, and dimensional data modeling for synch and asynch system integration and implementation using internal (e.g., Flume, etc.) and external stacks (DataFlow, Spark, etc.).
- 5 years of experience coding in one or more programming languages (e.g., SQL, Python).
- 5 years of experience working with data infrastructure and data models by performing exploratory queries and scripts.
Preferred qualifications:
- 5 years of experience with statistical methodology and data consumption tools such as business intelligence tools, collabs, jupyter notebooks, Tableau, Power BI, Data Studio, and business intelligence platforms.
- 3 years of experience developing project plans and delivering projects on time within budget and scope.
- 3 years of experience partnering with stakeholders (e.g., users, partners, customer), and managing stakeholders/customers.
- Experience with Machine Learning for production workflows.
About the job
The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.Responsibilities
- Design, build, optimize, and maintain batch and real-time pipelines to ingest, process, and transform data sources.
- Develop and manage logical and physical data models within data warehouses or data lakes, ensuring data is structured efficiently, reporting, machine learning model training, and operational use.
- Implement robust monitoring and data quality checks with accuracy with completeness.
- Collaborate with platform engineers to optimize data storage, retrieval, and processing performance, delivering effective growing data volumes and query complexity.
- Work closely with data scientists, analysts, product managers, and policy specialists to understand their data requirements and deliver effective data solutions. Provide support for data access and tooling. Implement and adhere to data security best practices and privacy regulations ensuring data infrastructure is secure and compliant.
Similar Jobs
Kwalee
Royal Leamington Spa, England, United Kingdom (On-Site)
• 2 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Get notifed when new similar jobs are uploaded
Jobs in Dublin, County Dublin, Ireland
PlayStation
Dublin, County Dublin, Ireland (On-Site)
• 3 Weeks ago
Riot Games
Dublin, County Dublin, Ireland (On-Site)
• 6 Months ago
Salesforce
Dublin, County Dublin, Ireland (On-Site)
• 7 Months ago
sitecore
Dublin, County Dublin, Ireland (Hybrid)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Data Analyst Jobs
PwC
Hyderabad, Telangana, India (On-Site)
• 5 Months ago
PwC
Kolkata, West Bengal, India (On-Site)
• 8 Months ago
PwC
Kolkata, West Bengal, India (On-Site)
• 8 Months ago
Next Level Business Services
Sunnyvale, California, United States (On-Site)
• 7 Months ago
Beyond Sports
Alkmaar, North Holland, Netherlands (On-Site)
• 1 Month ago
PwC
Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
• 8 Months ago
Get notifed when new similar jobs are uploaded
