Data Engineer - Snowflake
Job Summary
Job Description
This role involves migrating Datastage jobs to Snowpark, including reverse engineering existing logic and translating it into Snowpark code. Thorough unit testing and parallel run testing (comparing migrated Snowpark jobs with original Datastage jobs using production data) are crucial. Airflow will be used for orchestration. The position requires documenting code and processes, and working effectively in a remote team within the India Time Zone. Responsibilities include ensuring functionality and data quality throughout the migration process.
Must have:
- 5+ years experience in Snowflake, 2 years in Snowpark
- Experience with Airflow and Snowflake on Azure
- ETL/ELT tool experience (Datastage a plus)
- Strong SQL, data warehousing knowledge
- Python scripting, problem-solving skills
4 skills required
Job Details
Responsibilities
· Participate in the migration of Datastage jobs to Snowpark. Reverse engineer the logic of existing Datastage jobs and translate them accurately into Snowpark.
· Perform thorough unit testing of developed Snowpark code to ensure functionality and data quality.
· Use airflow for orchestration of Snowpark jobs
· Perform unit testing and parallel run testing, comparing the output of migrated Snowpark jobs with the original Datastage jobs using production data in the development environment.
· Document developed code and processes as required.
· Work remotely and effectively within the India Time Zone.
Qualifications
Required Skills and Experience
· Bachelor's degree in Computer Science, Engineering, or a related field.
· 5 yrs of experience in Snowflake and 24 months experience in Snowpark
· Experience in Airflow
· Experience with Snowflake on Azure
· Experience with at least one ETL/ELT tool (Datastage experience is a significant plus).
· Solid understanding of SQL and data warehousing concepts.
· Familiarity with scripting languages such as Python.
· Ability to understand and translate existing data processing logic.
· Strong problem-solving and analytical skills.
· Excellent communication and collaboration skills, comfortable working in a remote team environment.
· Ability to work independently and manage tasks effectively within deadlines.
Similar Jobs
Crunchyroll
San Francisco, California, United States (Remote)
• 4 Months ago
PwC
Gurugram, Haryana, India (On-Site)
• 5 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Hasura
Bengaluru, Karnataka, India (Hybrid)
• 5 Months ago
The Walt Disney Company
Burbank, California, United States (On-Site)
• 1 Day ago
IO Interactive
Brighton And Hove, England, United Kingdom (Hybrid)
• 3 Months ago
Get notifed when new similar jobs are uploaded
Jobs in India
Rackspace Technology
Gurugram, Haryana, India (Remote)
• 3 Weeks ago
Get notifed when new similar jobs are uploaded
Data Analyst Jobs
Tesla
Brandenburg, Germany (On-Site)
• 2 Months ago
PwC
Mumbai, Maharashtra, India (On-Site)
• 6 Months ago
Amanotes
Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
• 10 Months ago
Ubisoft
Paris, Île-de-France, France (On-Site)
• 3 Weeks ago
Netflix
Mumbai, Maharashtra, India (On-Site)
• 1 Day ago
Get notifed when new similar jobs are uploaded
