ETL Developer - Python
Job Summary
Job Description
- 6+ years ETL development experience (5+ years with AWS EMR)
- Proficiency in Python for data processing
- Proficient in SQL and ETL tools (SAS DI, Informatica)
- AWS experience: EMR, S3, IAM, VPC, Glue
- Snowflake or RDS familiarity
- Excellent communication and problem-solving skills
6 skills required
Job Details
Project description
We are looking for the star Python Developer who is not afraid of work and challenges! Gladly becoming a partner with famous financial institution, we are gathering a team of professionals with wide range of skills to successfully deliver business value to the client.
Responsibilities
Analyse existing SAS DI pipelines and SQL-based transformations.
Translate and optimize SAS SQL logic into Python code using frameworks such as Pyspark.
Develop and maintain scalable ETL pipelines using Python on AWS EMR.
Implement data transformation, cleansing, and aggregation logic to support business requirements.
Design modular and reusable code for distributed data processing tasks on EMR clusters.
Integrate EMR jobs with upstream and downstream systems, including AWS S3, Snowflake, and Tableau.
Develop Tableau reports for business reporting.
Skills
Must have
6+ years of experience in ETL development, with at least 5 years working with AWS EMR.
Bachelor's degree in Computer Science, Data Science, Statistics, or a related field.
Proficiency in Python for data processing and scripting.
Proficient in SQL and experience with one or more ETL tools (e.g., SAS DI, Informatica)/.
Hands-on experience with AWS services: EMR, S3, IAM, VPC, and Glue.
Familiarity with data storage systems such as Snowflake or RDS.
Excellent communication skills and ability to work collaboratively in a team environment.
Strong problem-solving skills and ability to work independently.
Nice to have
N/A
Other
Languages
English: B2 Upper Intermediate
Seniority
Senior
Similar Jobs
Easygo
PwC
PwC
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
The Walt Disney Company
DEVOTEAM
![Evernorth Health Services - Software Engineering Advisor [T500-10128]](/_next/image?url=https%3A%2F%2Foutscal-lms-data.s3.ap-south-1.amazonaws.com%2Fcompany-image%2Fproduction%2Fevernorth-health-services%2Fevernorth-health-services_logo_10_08_2024__10_42_03.jpg&w=256&q=50){kind=logo}
Evernorth Health Services
Get notifed when new similar jobs are uploaded
Jobs in Bengaluru, Karnataka, India
PwC
PhonePe
Nielsen Holdings
Hapag-Lloyd AG
Get notifed when new similar jobs are uploaded
Data Analyst Jobs
Warner Bros Discovery
PwC
Focus Entertainment
Netflix
Get notifed when new similar jobs are uploaded
About The Company
Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.
DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.
Get notified when new jobs are added by Luxoft
