ETL Developer - Python

2 Months ago • 6 Years + • Data Analyst • DevOps

Job Summary

Job Description

This role involves migrating existing SAS DI pipelines and SQL transformations to Python using frameworks like Pyspark on AWS EMR. Responsibilities include developing and maintaining scalable ETL pipelines, implementing data transformation and cleansing logic, designing reusable code for distributed data processing, integrating with AWS services (S3, Snowflake, Tableau), and developing Tableau reports. The ideal candidate will have 6+ years of ETL development experience, at least 5 years with AWS EMR, proficiency in Python and SQL, and experience with ETL tools. The position requires strong problem-solving and communication skills, and the ability to work both independently and collaboratively within a team.
Must have:
  • 6+ years ETL development experience
  • 5+ years AWS EMR experience
  • Proficient in Python & SQL
  • Experience with ETL tools (SAS DI, Informatica)
  • AWS Services (EMR, S3, IAM, VPC, Glue)
  • Snowflake or RDS familiarity
  • Excellent communication & collaboration skills

Job Details

Project description

We are looking for the star Python Developer who is not afraid of work and challenges! Gladly becoming a partner with famous financial institution, we are gathering a team of professionals with wide range of skills to successfully deliver business value to the client.

Responsibilities

Analyse existing SAS DI pipelines and SQL-based transformations.

Translate and optimize SAS SQL logic into Python code using frameworks such as Pyspark.

Develop and maintain scalable ETL pipelines using Python on AWS EMR.

Implement data transformation, cleansing, and aggregation logic to support business requirements.

Design modular and reusable code for distributed data processing tasks on EMR clusters.

Integrate EMR jobs with upstream and downstream systems, including AWS S3, Snowflake, and Tableau.

Develop Tableau reports for business reporting.

Skills

Must have

6+ years of experience in ETL development, with at least 5 years working with AWS EMR.

Bachelor's degree in Computer Science, Data Science, Statistics, or a related field.

Proficiency in Python for data processing and scripting.

Proficient in SQL and experience with one or more ETL tools (e.g., SAS DI, Informatica)/.

Hands-on experience with AWS services: EMR, S3, IAM, VPC, and Glue.

Familiarity with data storage systems such as Snowflake or RDS.

Excellent communication skills and ability to work collaboratively in a team environment.

Strong problem-solving skills and ability to work independently.

Nice to have

N/A

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Similar Jobs

Ness Digital - QA Engineer (T17)

Ness Digital

Timișoara, Timiș, Romania (Remote)
1 Month ago
BigID - Manager, Technical Client Support - EMEA/APJ

BigID

London, England, United Kingdom (Remote)
2 Months ago
Postman - Senior Platform Engineer, Observability Agent

Postman

San Francisco, California, United States (On-Site)
4 Months ago
Nielsen Holdings - Senior System Administrator (Atlassian Tool)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Hudl - Lead Software Engineer

Hudl

Mumbai, Maharashtra, India (On-Site)
5 Months ago
Thumbtack - Lead Data Scientist, Business Analytics

Thumbtack

Ontario, Canada (Remote)
1 Month ago
ESL FACEIT Group - EFG - Data Analyst (Analytics Engineer)

ESL FACEIT Group - EFG

(On-Site)
3 Months ago
GoTo Group - Data Platform Engineer

GoTo Group

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Easygo - Data and Analytics Manager

Easygo

Melbourne, Victoria, Australia (On-Site)
5 Months ago
Xsolla - Data Warehouse Architect

Xsolla

Montreal, Quebec, Canada (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

DraftKings - Lead Machine Learning Platform Engineer

DraftKings

Boston, Massachusetts, United States (On-Site)
1 Month ago
Thatgamecompany - Senior Backend Engineer - China

Thatgamecompany

Shanghai, Shanghai, China (On-Site)
5 Months ago
PwC - IN_Manager_Delivery Manager_Data & Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Aristocrat Gaming - Manager - Infrastructure Support

Aristocrat Gaming

Noida, Uttar Pradesh, India (Hybrid)
1 Month ago
bosh group india - PreSales/ Solution Architect- Enterprise

bosh group india

Karnataka, India (On-Site)
2 Months ago
N-iX - Senior Fullstack Engineer

N-iX

Poland (Hybrid)
1 Month ago
Seedify - Engineering Lead (Remote)

Seedify

(Remote)
7 Months ago
Zynga - Senior Software Engineer (Server) - Game Of Thrones

Zynga

Austin, Texas, United States (On-Site)
2 Months ago
DEVOTEAM - SysOps Engineer H/F

DEVOTEAM

Levallois-Perret, Île-de-France, France (Remote)
4 Months ago
Nagarro - Associate Principal Engineer, .Net Fullstack

Nagarro

South Africa (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Chennai, Tamil Nadu, India

Warner Bros Games - Software Engineer II

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
1 Month ago
Elevation Capital - Data Scientist

Elevation Capital

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Marvell - Senior Staff Software Engineer (Linux Kernel device drivers, Network drivers)

Marvell

Hyderabad, Telangana, India (On-Site)
6578 Years ago
Skyhigh Security - Marketing Automation Manager

Skyhigh Security

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Velotio Technologies - Lead Engineer (DevOps)

Velotio Technologies

Maharashtra, India (Hybrid)
2 Months ago
PwC - IN_Senior Associate_Agile PM_Advisory Corporate_Advisory_Pune

PwC

Pune, Maharashtra, India (On-Site)
4 Months ago
Nagarro - Staff Consultant ,SAP Sales Service

Nagarro

Pune, Maharashtra, India (On-Site)
4 Months ago
Paytm - Kolkata-Key Account Manager/Sr. Key Account Manager

Paytm

Kolkata, West Bengal, India (On-Site)
2 Months ago
Netradyne - Staff Data Scientist

Netradyne

Bengaluru, Karnataka, India (On-Site)
5 Months ago
PwC - IN_Senior Associate _Data  Migration_Enterprise_Apps_SAP_Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Carry1st - Marketing Data Analyst

Carry1st

Türkiye (Remote)
1 Month ago
Scorewarrior - Lead Product Analyst

Scorewarrior

Limassol, Limassol, Cyprus (On-Site)
8 Months ago
Blinkhealth - Senior Data Engineer

Blinkhealth

India (On-Site)
2 Months ago
Garena - Data Analyst

Garena

Pune, Maharashtra, India (On-Site)
2 Months ago
Next Level Business Services - Data Modeler

Next Level Business Services

Madison, Wisconsin, United States (On-Site)
4 Months ago
Pluto7 - Data Scientist

Pluto7

Bengaluru, Karnataka, India (On-Site)
6 Months ago
ION - Internship - Data Science

ION

London, England, United Kingdom (On-Site)
4 Months ago
Captions - Data Scientist, Product

Captions

San Francisco, California, United States (On-Site)
4 Months ago
On Location - Director of Sales Operations - Data, Analytics & Insights - FIFA World Cup 26™

On Location

Raleigh, North Carolina, United States (On-Site)
66 Years ago
Paypal - Database Marketing Manager

Paypal

Shanghai, Shanghai, China (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Gothenburg, Västra Götaland County, Sweden (On-Site)

New Delhi, Delhi, India (Remote)

Poland, Ohio, United States (Remote)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mississauga, Ontario, Canada (On-Site)

View All Jobs

Get notified when new jobs are added by Luxoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug