Job Summary
Job Description
As a Data Engineer, you will be part of a dynamic team responsible for designing, building, and maintaining scalable data pipelines and infrastructure. Your responsibilities will include creating and managing data pipelines using Apache Spark and Microsoft Fabric, integrating data from various sources, optimizing workflows for performance and scalability, collaborating with data scientists and analysts, implementing data governance practices, resolving data-related issues, and maintaining documentation. You will work with the team to ensure data quality and reliability.
Must have:
- 5 years in data engineering or related fields
- Proficiency in Databrick, Apache Spark or Microsoft Fabric
- Strong programming skills in Python, Scala, or Java
- Experience with cloud platforms (e.g., Azure, AWS, GCP)
- Knowledge of SQL and NoSQL databases
- Familiarity with data warehousing and ETL processes
- Strong problem-solving and analytical skills
- Excellent communication and collaboration skills
Good to have:
- Experience with big data technologies and frameworks
- Knowledge of machine learning and data science concepts
- Certification in relevant technologies
13 skills required
Job Details
Data Engineer
About Us:
Sitecore’s mission is to provide cutting-edge DXP solutions that enable the world’s greatest brands to craft truly unforgettable experiences for their customers. A highly decorated industry leader, Sitecore brings content, commerce, and data into one connected platform that delivers millions of digital experiences every day. Thousands of blue-chip companies, including American Express, Porsche, Starbucks, L’Oréal, and Volvo Cars, rely on Sitecore to provide more engaging, more personalized experiences for their customers. Under the leadership of our new product-centric CEO, we are poised to continue to push the boundaries of marketing technology and shape the future of customer engagement. Learn more at Sitecore.com.
About the Role:
We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have a solid background in data engineering, with at least 5 years of experience, and expertise in Apache Spark and Microsoft Fabric. This role will involve designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives.
What You’ll Do:
- Design and Develop Data Pipelines: Create and manage robust data pipelines using Apache Spark and Microsoft Fabric to process large volumes of data efficiently.
- Data Integration: Integrate data from various sources, ensuring data quality, consistency, and reliability.
- Performance Optimization: Optimize data processing workflows for performance and scalability.
- Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Data Governance: Implement and maintain data governance practices to ensure data security, privacy, and compliance.
- Troubleshooting: Identify and resolve data-related issues and bottlenecks.
- Documentation: Maintain comprehensive documentation of data engineering processes and workflows.
What You Need to Succeed:
- Experience: 5 years in data engineering or related fields.
- Technical Skills:
- Proficiency in Databrick, Apache Spark or Microsoft Fabric.
- Strong programming skills in languages such as Python, Scala, or Java.
- Experience with cloud platforms (e.g., Azure, AWS, GCP).
- Knowledge of SQL and NoSQL databases.
- Familiarity with data warehousing solutions and ETL processes.
- Analytical Skills: Strong problem-solving and analytical skills.
- Communication: Excellent communication and collaboration skills.
- Education: Bachelor’s degree in computer science, engineering, or a related field.
Additional Skills That Could Set You Apart:
- Experience with big data technologies and frameworks.
- Knowledge of machine learning and data science concepts.
- Certification in relevant technologies (e.g., Apache Spark, Azure Data Engineer).
Similar Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Skill Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Jobs in Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Category Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
