Job Description
- 6+ years ETL development experience
- 5+ years AWS EMR experience
- Proficient in Python & SQL
- Experience with ETL tools (SAS DI, Informatica)
- AWS Services (EMR, S3, IAM, VPC, Glue)
- Data storage (Snowflake or RDS)
- Excellent communication skills
Project description
We are looking for the star Python Developer who is not afraid of work and challenges! Gladly becoming a partner with famous financial institution, we are gathering a team of professionals with wide range of skills to successfully deliver business value to the client.
Responsibilities
Analyse existing SAS DI pipelines and SQL-based transformations.
Translate and optimize SAS SQL logic into Python code using frameworks such as Pyspark.
Develop and maintain scalable ETL pipelines using Python on AWS EMR.
Implement data transformation, cleansing, and aggregation logic to support business requirements.
Design modular and reusable code for distributed data processing tasks on EMR clusters.
Integrate EMR jobs with upstream and downstream systems, including AWS S3, Snowflake, and Tableau.
Develop Tableau reports for business reporting.
Skills
Must have
6+ years of experience in ETL development, with at least 5 years working with AWS EMR.
Bachelor's degree in Computer Science, Data Science, Statistics, or a related field.
Proficiency in Python for data processing and scripting.
Proficient in SQL and experience with one or more ETL tools (e.g., SAS DI, Informatica)/.
Hands-on experience with AWS services: EMR, S3, IAM, VPC, and Glue.
Familiarity with data storage systems such as Snowflake or RDS.
Excellent communication skills and ability to work collaboratively in a team environment.
Strong problem-solving skills and ability to work independently.
Nice to have
N/A
Other
Languages
English: B2 Upper Intermediate
Seniority
Senior
