Senior Data Engineer
Job Summary
Job Description
The Senior Data Engineer will be responsible for designing and implementing data pipelines to extract, transform, and load (ETL) data from various internal business applications into Microsoft Fabric, following a medallion framework. The role involves ensuring data quality, consistency, and accuracy, preparing data for advanced use cases. Additionally, the engineer will create data models and schemas, develop semantic models, and create interactive dashboards and visualizations using Microsoft Power BI. The role also includes establishing and maintaining data governance policies and promoting data literacy. The engineer must have experience in data engineering or data science.
Must have:
- Bachelor's degree in Computer Science or related field.
- Data Engineering or Data Science Experience.
- Proficiency in PySpark and/or SparkSQL.
- Experience with extracting data from various APIs.
- Knowledge of data warehousing and data modeling concepts.
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills.
- Ability to work independently and as part of a team.
Good to have:
- Master's degree in Data Science or a related field.
- Experience with Microsoft Fabric (Data Factory, Synapse Engineering, Power BI).
- Experience with cloud-based data platforms (Azure, AWS, GCP).
- Certifications in Microsoft Certified: Fabric Analytics Engineer Associate, Microsoft Azure Data Engineering or Microsoft Certified: Azure Data Scientist Associate.
7 skills required
Job Details
Responsibilities
Data Ingestion and Transformation.
- Design and implement data pipelines to extract, transform, and load (ETL) data from various internal business applications into Microsoft Fabric following a medallion framework.
- Ensure data quality, consistency, and accuracy throughout the ingestion
process. - Prepare data for more advanced use cases, like AI and application
integration.
Data Modeling and Analysis:
- Create data models and schemas that effectively represent the underlying
business processes and data relationships. - Create semantic models for different use cases to optimize data access
and performance.
Data Visualization and Reporting:
- Collaborate with business stakeholders to understand their reporting needs and support them in creating interactive dashboards and visualizations using Microsoft Power BI.
- Develop self-service reporting capabilities to empower users to explore
data independently.
Data Governance and Stewardship:
- Establish and maintain data governance policies and standards to ensure
data quality, security, and compliance. - Promote data literacy and awareness within the organization.
Qualifications
• Bachelor's degree in Computer Science, Statistics, Mathematics, or a related field.
• Data Engineering or Data Science Experience
• Strong proficiency in PySpark and/or SparkSQL.
• Experience with extracting data from various APIs.
• Knowledge of data warehousing and data modeling concepts.
• Excellent problem-solving and analytical skills.
• Strong communication and interpersonal skills.
• Ability to work independently and as part of a team.
Preferred Qualifications
• Master's degree in Data Science or a related field.
• Experience with Microsoft Fabric (specifically Data Factory, Synapse Engineering,
and Power BI).
• Experience with cloud-based data platforms (e.g., Azure, AWS, GCP).
• Certifications in Microsoft Certified: Fabric Analytics Engineer Associate, Microsoft
Azure Data Engineering or Microsoft Certified: Azure Data Scientist Associate.
• Master's degree in Data Science or a related field.
• Experience with Microsoft Fabric (specifically Data Factory, Synapse Engineering,
and Power BI).
• Experience with cloud-based data platforms (e.g., Azure, AWS, GCP).
• Certifications in Microsoft Certified: Fabric Analytics Engineer Associate, Microsoft
Azure Data Engineering or Microsoft Certified: Azure Data Scientist Associate.
If you are passionate about data analytics/data science, have a strong understanding of
the Microsoft Fabric tool set, and are eager to make a significant impact on our
organization, we encourage you to apply.
the Microsoft Fabric tool set, and are eager to make a significant impact on our
organization, we encourage you to apply.
Similar Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Skill Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Jobs in Thiruvananthapuram, Kerala, India
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Category Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
