Data Engineer - Snowflake
Job Summary
Job Description
This role involves migrating Datastage jobs to Snowpark, including reverse engineering existing logic and translating it into Snowpark code. Thorough unit testing and parallel run testing (comparing migrated Snowpark jobs with original Datastage jobs using production data) are crucial. Airflow will be used for orchestration. The position requires documenting code and processes, and working effectively in a remote team within the India Time Zone. Responsibilities include ensuring functionality and data quality throughout the migration process.
Must have:
- 5+ years experience in Snowflake, 2 years in Snowpark
- Experience with Airflow and Snowflake on Azure
- ETL/ELT tool experience (Datastage a plus)
- Strong SQL, data warehousing knowledge
- Python scripting, problem-solving skills
4 skills required
Job Details
Responsibilities
· Participate in the migration of Datastage jobs to Snowpark. Reverse engineer the logic of existing Datastage jobs and translate them accurately into Snowpark.
· Perform thorough unit testing of developed Snowpark code to ensure functionality and data quality.
· Use airflow for orchestration of Snowpark jobs
· Perform unit testing and parallel run testing, comparing the output of migrated Snowpark jobs with the original Datastage jobs using production data in the development environment.
· Document developed code and processes as required.
· Work remotely and effectively within the India Time Zone.
Qualifications
Required Skills and Experience
· Bachelor's degree in Computer Science, Engineering, or a related field.
· 5 yrs of experience in Snowflake and 24 months experience in Snowpark
· Experience in Airflow
· Experience with Snowflake on Azure
· Experience with at least one ETL/ELT tool (Datastage experience is a significant plus).
· Solid understanding of SQL and data warehousing concepts.
· Familiarity with scripting languages such as Python.
· Ability to understand and translate existing data processing logic.
· Strong problem-solving and analytical skills.
· Excellent communication and collaboration skills, comfortable working in a remote team environment.
· Ability to work independently and manage tasks effectively within deadlines.
Similar Jobs
IManage
Bengaluru, Karnataka, India (Hybrid)
• 6 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Alphasense
Bengaluru, Karnataka, India (On-Site)
• 7 Hours ago
Next Level Business Services
Sammamish, Washington, United States (On-Site)
• 6 Months ago
sitecore
Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
• 2 Weeks ago
Workato
Hyderabad, Telangana, India (On-Site)
• 7 Hours ago
Get notifed when new similar jobs are uploaded
Jobs in India
Bengaluru, Karnataka, India (On-Site)
• 2 Weeks ago
Ajmera Infotech
Ahmedabad, Gujarat, India (On-Site)
• 3 Months ago
Get notifed when new similar jobs are uploaded
Data Analyst Jobs
Dublin, County Dublin, Ireland (On-Site)
• 2 Weeks ago
Reality Games
Kraków, Lesser Poland Voivodeship, Poland (On-Site)
• 1 Month ago
Microsoft
Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
• 2 Weeks ago
Tonies
Düsseldorf, North Rhine-Westphalia, Germany (Remote)
• 1 Month ago
Get notifed when new similar jobs are uploaded
