ETL Developer - Python

1 Month ago • 6 Years + • Data Analyst • DevOps • Undisclosed

About the job

Job Description

This role involves migrating existing SAS DI pipelines and SQL transformations to Python using frameworks like Pyspark on AWS EMR. Responsibilities include developing and maintaining scalable ETL pipelines, implementing data transformation and cleansing logic, designing reusable code for distributed data processing, integrating with AWS services (S3, Snowflake, Tableau), and developing Tableau reports. The ideal candidate will have 6+ years of ETL development experience, at least 5 years with AWS EMR, proficiency in Python and SQL, and experience with ETL tools. The position requires strong problem-solving and communication skills, and the ability to work both independently and collaboratively within a team.
Must have:
  • 6+ years ETL development experience
  • 5+ years AWS EMR experience
  • Proficient in Python & SQL
  • Experience with ETL tools (SAS DI, Informatica)
  • AWS Services (EMR, S3, IAM, VPC, Glue)
  • Snowflake or RDS familiarity
  • Excellent communication & collaboration skills
Project description

We are looking for the star Python Developer who is not afraid of work and challenges! Gladly becoming a partner with famous financial institution, we are gathering a team of professionals with wide range of skills to successfully deliver business value to the client.

Responsibilities

Analyse existing SAS DI pipelines and SQL-based transformations.

Translate and optimize SAS SQL logic into Python code using frameworks such as Pyspark.

Develop and maintain scalable ETL pipelines using Python on AWS EMR.

Implement data transformation, cleansing, and aggregation logic to support business requirements.

Design modular and reusable code for distributed data processing tasks on EMR clusters.

Integrate EMR jobs with upstream and downstream systems, including AWS S3, Snowflake, and Tableau.

Develop Tableau reports for business reporting.

Skills

Must have

6+ years of experience in ETL development, with at least 5 years working with AWS EMR.

Bachelor's degree in Computer Science, Data Science, Statistics, or a related field.

Proficiency in Python for data processing and scripting.

Proficient in SQL and experience with one or more ETL tools (e.g., SAS DI, Informatica)/.

Hands-on experience with AWS services: EMR, S3, IAM, VPC, and Glue.

Familiarity with data storage systems such as Snowflake or RDS.

Excellent communication skills and ability to work collaboratively in a team environment.

Strong problem-solving skills and ability to work independently.

Nice to have

N/A

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Gothenburg, Västra Götaland County, Sweden (On-Site)

New Delhi, Delhi, India (Remote)

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Bengaluru, Karnataka, India (On-Site)

Chennai, Tamil Nadu, India (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Similar Jobs

Ness Digital - QA Engineer (T17)

Ness Digital, Romania (Remote)

BigID - Manager, Technical Client Support - EMEA/APJ

BigID, United Kingdom (Remote)

Postman - Senior Platform Engineer, Observability Agent

Postman, United States (On-Site)

Nielsen Holdings - Senior System Administrator (Atlassian Tool)

Nielsen Holdings, India (Hybrid)

Hudl - Lead Software Engineer

Hudl, India (On-Site)

Thumbtack - Lead Data Scientist, Business Analytics

Thumbtack, Canada (Remote)

ESL FACEIT Group - EFG - Data Analyst (Analytics Engineer)

ESL FACEIT Group - EFG, (On-Site)

GoTo Group - Data Platform Engineer

GoTo Group, India (On-Site)

Easygo - Data and Analytics Manager

Easygo, Australia (On-Site)

Xsolla - Data Warehouse Architect

Xsolla, Canada (Hybrid)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

DraftKings - Lead Machine Learning Platform Engineer

DraftKings, United States (On-Site)

Thatgamecompany - Senior Backend Engineer - China

Thatgamecompany, China (On-Site)

Aristocrat Gaming - Manager - Infrastructure Support

Aristocrat Gaming, India (Hybrid)

bosh group india - PreSales/ Solution Architect- Enterprise

bosh group india, India (On-Site)

N-iX - Senior Fullstack Engineer

N-iX, Poland (Hybrid)

Seedify - Engineering Lead (Remote)

Seedify, (Remote)

DEVOTEAM - SysOps Engineer H/F

DEVOTEAM, France (Remote)

Nagarro - Associate Principal Engineer, .Net Fullstack

Nagarro, South Africa (On-Site)

Get notifed when new similar jobs are uploaded

Jobs in Chennai, Tamil Nadu, India

Warner Bros Games - Software Engineer II

Warner Bros Games, India (Hybrid)

Elevation Capital - Data Scientist

Elevation Capital, India (On-Site)

Skyhigh Security - Marketing Automation Manager

Skyhigh Security, India (Hybrid)

Velotio Technologies - Lead Engineer (DevOps)

Velotio Technologies, India (Hybrid)

Nagarro - Staff Consultant ,SAP Sales Service

Nagarro, India (On-Site)

Netradyne - Staff Data Scientist

Netradyne, India (On-Site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Carry1st - Marketing Data Analyst

Carry1st, Türkiye (Remote)

Scorewarrior - Lead Product Analyst

Scorewarrior, Cyprus (On-Site)

Blinkhealth - Senior Data Engineer

Blinkhealth, India (On-Site)

Garena - Data Analyst

Garena, India (On-Site)

Next Level Business Services - Data Modeler

Next Level Business Services, United States (On-Site)

Pluto7 - Data Scientist

Pluto7, India (On-Site)

ION - Internship - Data Science

ION, United Kingdom (On-Site)

Captions - Data Scientist, Product

Captions, United States (On-Site)

Paypal - Database Marketing Manager

Paypal, China (On-Site)

Get notifed when new similar jobs are uploaded