Data Engineer - Snowflake
Job Summary
Job Description
This role involves migrating Datastage jobs to Snowpark, including reverse engineering existing logic and translating it into Snowpark code. Thorough unit testing and parallel run testing (comparing migrated Snowpark jobs with original Datastage jobs using production data) are crucial. Airflow will be used for orchestration. The position requires documenting code and processes, and working effectively in a remote team within the India Time Zone. Responsibilities include ensuring functionality and data quality throughout the migration process.
Must have:
- 5+ years experience in Snowflake, 2 years in Snowpark
- Experience with Airflow and Snowflake on Azure
- ETL/ELT tool experience (Datastage a plus)
- Strong SQL, data warehousing knowledge
- Python scripting, problem-solving skills
4 skills required
Job Details
Responsibilities
· Participate in the migration of Datastage jobs to Snowpark. Reverse engineer the logic of existing Datastage jobs and translate them accurately into Snowpark.
· Perform thorough unit testing of developed Snowpark code to ensure functionality and data quality.
· Use airflow for orchestration of Snowpark jobs
· Perform unit testing and parallel run testing, comparing the output of migrated Snowpark jobs with the original Datastage jobs using production data in the development environment.
· Document developed code and processes as required.
· Work remotely and effectively within the India Time Zone.
Qualifications
Required Skills and Experience
· Bachelor's degree in Computer Science, Engineering, or a related field.
· 5 yrs of experience in Snowflake and 24 months experience in Snowpark
· Experience in Airflow
· Experience with Snowflake on Azure
· Experience with at least one ETL/ELT tool (Datastage experience is a significant plus).
· Solid understanding of SQL and data warehousing concepts.
· Familiarity with scripting languages such as Python.
· Ability to understand and translate existing data processing logic.
· Strong problem-solving and analytical skills.
· Excellent communication and collaboration skills, comfortable working in a remote team environment.
· Ability to work independently and manage tasks effectively within deadlines.
Similar Jobs
Glean
Bengaluru, Karnataka, India (On-Site)
• 5 Months ago
ByteDance
Dubai, Dubai, United Arab Emirates (On-Site)
• 7 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
The Walt Disney Company
Santa Monica, California, United States (On-Site)
• 1 Month ago
sony global (Games)
Dalian, Liaoning, China (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Jobs in India
UNSW
Bengaluru, Karnataka, India (On-Site)
• 8 Months ago
Warner Bros Games
Pune, Maharashtra, India (Hybrid)
• 3 Months ago
Get notifed when new similar jobs are uploaded
Data Analyst Jobs
The Walt Disney Company
Buenos Aires, Buenos Aires, Argentina (On-Site)
• 1 Month ago
PwC
Bengaluru, Karnataka, India (On-Site)
• 6 Months ago
Crunchyroll
Los Angeles, California, United States (On-Site)
• 2 Months ago
Attentive
San Francisco, California, United States (Hybrid)
• 7 Months ago
Meta
San Francisco, California, United States (On-Site)
• 6 Months ago
New York, New York, United States (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
