Data Engineer
Job Summary
Job Description
As a Data Engineer, you will be the first point of contact for data issues within the Master Data Management (MDM) system. You will investigate and resolve data-related problems, ensuring timely and accurate updates while coordinating with product managers, QA leads, and technology leads. You will build and optimize data models, write SQL queries, and collaborate with other teams to fix complex issues. Additionally, you'll utilize AWS resources, maintain the knowledge base, and monitor system logs. Your responsibilities also include maintaining documentation and participating in team meetings. This role involves hands-on problem-solving and a commitment to data integrity.
Must have:
- 3+ years of data engineering experience.
- Expertise in SQL and database query languages.
- Experience with data warehousing solutions.
- Proficiency in ETL tools.
- Familiarity with AWS services.
- Excellent programming skills in Python.
- Understanding of data privacy regulations.
8 skills required
Job Details
Position Overview
We are looking for an experienced Data Engineer to join our dynamic team. If you are passionate about building scalable software solutions, have expertise in system design and data structures, and are familiar with various databases, we would love to hear from you.
ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries, by focusing on creating value through innovation.
Job Responsibilities:
- Act as the first point of contact for data issues in the Master Data Management (MDM) system.
- Investigate and resolve data-related issues, such as duplicate data or missing records, ensuring timely and accurate updates.
- Coordinate with the Product Manager, QA Lead, and Technology Lead to prioritize and address tickets effectively.
- Work on Data related issues, ensuring compliance with regulations.
- Build and optimize data models to ensure efficient storage and query performance, including work with Snowflake tables.
- Write complex SQL queries for data manipulation and retrieval.
- Collaborate with other teams to diagnose and fix more complex issues that may require code changes or system updates.
- Utilize AWS resources like CloudWatch, Lambda, SQS, and Kinesis Streams for data storage, transformation, and analysis.
- Update and maintain the knowledge base to document common issues and their solutions.
- Monitor system logs and alerts to proactively identify potential issues before they affect customers.
- Participate in team meetings to provide updates on ongoing issues and contribute to process improvements.
- Maintain documentation of data engineering processes, data models, and system configurations.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Minimum of 3 years of experience in data engineering, preferably related to MDM systems.
- Strong expertise in SQL and other database query languages.
- Hands-on experience with data warehousing solutions and relational database management systems (RDBMS).
- Proficiency in ETL tools and data pipeline construction.
- Familiarity with AWS services.
- Excellent programming skills, preferably in Python.
- Strong understanding of data privacy regulations like DSAR and CCPA.
- Good communication skills, both written and verbal, with the ability to articulate complex data concepts to non-technical stakeholders.
- Strong problem-solving skills and attention to detail.
Similar Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Skill Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Jobs in Noida, Uttar Pradesh, India
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Category Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
