ETL Developer - Python

1 Month ago • 6 Years + • Data Analyst • DevOps • Undisclosed

About the job

Job Description

This role requires a Senior ETL Developer with 6+ years of experience in ETL development, at least 5 years with AWS EMR. Responsibilities include analyzing existing SAS DI pipelines and SQL transformations, translating SAS SQL logic into Python using frameworks like Pyspark, developing and maintaining scalable ETL pipelines on AWS EMR, implementing data transformation, cleansing, and aggregation, designing modular code for distributed data processing, integrating EMR jobs with AWS S3, Snowflake, and Tableau, and developing Tableau reports. The ideal candidate will have proficiency in Python, SQL, and experience with ETL tools (e.g., SAS DI, Informatica), along with hands-on experience with AWS services (EMR, S3, IAM, VPC, Glue), and familiarity with data storage systems like Snowflake or RDS. Excellent communication and problem-solving skills are essential.
Must have:
  • 6+ years ETL development experience (5+ years with AWS EMR)
  • Proficiency in Python for data processing
  • Proficient in SQL and ETL tools (SAS DI, Informatica)
  • AWS experience: EMR, S3, IAM, VPC, Glue
  • Snowflake or RDS familiarity
  • Excellent communication and problem-solving skills
Project description

We are looking for the star Python Developer who is not afraid of work and challenges! Gladly becoming a partner with famous financial institution, we are gathering a team of professionals with wide range of skills to successfully deliver business value to the client.

Responsibilities

Analyse existing SAS DI pipelines and SQL-based transformations.

Translate and optimize SAS SQL logic into Python code using frameworks such as Pyspark.

Develop and maintain scalable ETL pipelines using Python on AWS EMR.

Implement data transformation, cleansing, and aggregation logic to support business requirements.

Design modular and reusable code for distributed data processing tasks on EMR clusters.

Integrate EMR jobs with upstream and downstream systems, including AWS S3, Snowflake, and Tableau.

Develop Tableau reports for business reporting.

Skills

Must have

6+ years of experience in ETL development, with at least 5 years working with AWS EMR.

Bachelor's degree in Computer Science, Data Science, Statistics, or a related field.

Proficiency in Python for data processing and scripting.

Proficient in SQL and experience with one or more ETL tools (e.g., SAS DI, Informatica)/.

Hands-on experience with AWS services: EMR, S3, IAM, VPC, and Glue.

Familiarity with data storage systems such as Snowflake or RDS.

Excellent communication skills and ability to work collaboratively in a team environment.

Strong problem-solving skills and ability to work independently.

Nice to have

N/A

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Gothenburg, Västra Götaland County, Sweden (On-Site)

United States (Remote)

New Delhi, Delhi, India (Remote)

Poland, Ohio, United States (Remote)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

View All Jobs

Get notified when new jobs are added by Luxoft

Similar Jobs

Attentive - Staff Security Engineer

Attentive, United States (On-Site)

Hudl - Software Engineer II - Hudl Focus

Hudl, Netherlands (Hybrid)

Sumo Logic - Staff Software Engineer

Sumo Logic, India (On-Site)

Canva - Data Lead - Print

Canva, New Zealand (Hybrid)

bosh group india - SAP SD + BPMD - PUNE LOCATION

bosh group india, India (On-Site)

Aristocrat Gaming - Senior Global Marketing Research Analyst

Aristocrat Gaming, United States (Hybrid)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Surge Technology Solutions  Inc  - DevOps Engineer with AWS

Surge Technology Solutions Inc , India (On-Site)

Rackspace Technology - Practice Head - Cloud Application Services

Rackspace Technology, United States (Remote)

version 1 - Senior Outsystems Developer

version 1, United Kingdom (On-Site)

Sinch - Senior Machine Learning Engineer

Sinch, Belgium (Hybrid)

Thatgamecompany - Senior Software Engineer - Golang

Thatgamecompany, United States (Remote)

version 1 - Outsystems Technical Lead

version 1, United Kingdom (On-Site)

Ajmera Infotech - Senior ASP.NET Developer with Azure Expertise

Ajmera Infotech, India (On-Site)

Infoblox - Senior Staff Product Manager

Infoblox, United States (Hybrid)

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Nagarro - Staff Engineer (Big Data)

Nagarro, India (On-Site)

Infinera - Staff Software QA Engineer

Infinera, India (Hybrid)

Ascella InfoSec - 3D Artist Intern

Ascella InfoSec, India (Remote)

PhonePe - Product Security Engineer

PhonePe, India (On-Site)

Consonant One - Proofreader

Consonant One, India (On-Site)

Keywords Studios (Player Support) - DevSecOps Engineer II

Keywords Studios (Player Support), India (On-Site)

Hardcoded - Lead Product/UX Designer

Hardcoded, India (Hybrid)

Zeta - Specialist  Process & Compliance

Zeta, India (On-Site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Poppulo - Senior Data Engineer

Poppulo, India (Hybrid)

Moon Active - Data Scientist

Moon Active, Israel (Hybrid)

Vi - Business Analyst

Vi, Israel (On-Site)

AiDash - Senior Data Scientist

AiDash, India (On-Site)

Optum - Data Scientist

Optum, India (On-Site)

Fluence - Staff Data Engineer

Fluence, United States (Hybrid)

Playrix - Data QA Engineer

Playrix, Georgia (Remote)

Unity - Program Manager Customer Success Analytics

Unity, United Kingdom (On-Site)

Paypal - Sr. Software Engineer, Data Governance

Paypal, United States (Hybrid)

Get notifed when new similar jobs are uploaded