Senior AWS Data Engineer

1 Month ago • All levels

Job Summary

Job Description

The Senior AWS Data Engineer will be part of a team building new data platforms in AWS, using Python and Spark. This role involves designing, implementing, and optimizing ETL workflows, and building a robust data Lakehouse architecture on AWS. The engineer will also be involved in migrating existing data processing workflows to the Lakehouse architecture. They will collaborate with architects, product owners, and the development team to break down solutions and contribute to the design and planning of components. The role requires a senior data engineer with strong technical expertise and problem-solving abilities.
Must have:
  • Experience as a senior data engineer.
  • Expert in Python and Spark for ETL.
  • Experience with data pipelines using EMR, AWS Glue, etc.
  • Experience with data services in a Lakehouse architecture.
Good to have:
  • Experience in solution architecture and technical design.
  • Master’s degree or relevant certifications (e.g., AWS Certified Solutions Architect).
Perks:
  • Tailored benefits and support, including healthcare, retirement planning, paid volunteering days and wellbeing initiatives.

Job Details

Senior AWS Data Engineer GG13 - Bengaluru, India

Company Overview:

FTSE Russell, part of the London Stock Exchange Group, is an essential index partner for a changing world, providing category-defining indices across asset classes and investment objectives to create new possibilities for the global investment community. FTSE Russell’s expertise and products are used extensively by institutional and retail investors globally.

Job Summary:

Contribute to building brand new data platforms in AWS, demonstrating Python and Spark. Be part of a dynamic team, building data solutions in a supportive and hybrid work environment. This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with pioneering technologies. You will design, implement, and optimize ETL workflows using Python and Spark, build robust data Lakehouse architecture on AWS. Success in this role requires technical expertise, strong problem-solving skills, and the ability to collaborate effectively within an agile team.

Must Have Tech Skills:

  • Demonstrable experience as a senior data engineer.
  • Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices.
  • Experience of implementing data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena
  • Experience with data services in a Lakehouse architecture.

Nice To Have Tech Skills:

  • Experience in solution architecture and technical design, allowing for the creation of scalable, reliable data architectures that meet both technical and business requirements
  • A master’s degree or equivalent experience or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous

Key Accountabilities:

  • Provides guidance on standard methodologies in design, development, and implementation, ensuring solutions meet business requirements and technical standards.
  • Works closely with architects, Product Owners, and Dev team members to decompose solutions into Epics, leading design and planning of these components.
  • Drive the migration of existing data processing workflows to the Lakehouse architecture, using Iceberg capabilities.
  • Communicates complex technical information clearly, tailoring messages to the appropriate audience to ensure alignment.

Key Skills:

  • Deep technical knowledge of data engineering solutions and practices. Implementation of data pipelines using AWS data services and Lakehouse capabilities.
  • Highly proficient in Python, Spark and familiar with a variety of development technologies. This knowledge enables the Senior Data Engineer to adapt solutions to project-specific needs.
  • Skilled in decomposing solutions into components (Epics, tasks) to streamline development.
  • Proficient in creating clear, comprehensive documentation. Ensures that documentation supports broader technical teams and compliance, making it accessible and valuable for future reference
  • Proficient in quality assurance practices, including code reviews, automated testing, and standard methodologies for data validation.
  • Experience in using automation tools and Continuous Integration/Continuous Deployment (CI/CD) pipelines to streamline development, testing, and deployment.

Educational Background:

  • Bachelor’s degree or equivalent experience in computer science, Software Engineering, or related field essential.

Bonus Skills:

  • Financial Services expertise preferred, working with Equity and Fixed Income asset classes and a working knowledge of Indices.

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.

Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence and Change underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions.

Working with us means that you will be part of a dynamic organisation of 25,000 people across 65 countries. However, we will value your individuality and enable you to bring your true self to work so you can help enrich our diverse workforce. You will be part of a collaborative and creative culture where we encourage new ideas and are committed to sustainability across our global business. You will experience the critical role we have in helping to re-engineer the financial ecosystem to support and drive sustainable economic growth. Together, we are aiming to achieve this growth by accelerating the just transition to net zero, enabling growth of the green economy and creating inclusive economic opportunity.

LSEG offers a range of tailored benefits and support, including healthcare, retirement planning, paid volunteering days and wellbeing initiatives.

We are proud to be an equal opportunities employer. This means that we do not discriminate on the basis of anyone’s race, religion, colour, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law. Conforming with applicable law, we can reasonably accommodate applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.

Please take a moment to read this privacy notice carefully, as it describes what personal information London Stock Exchange Group (LSEG) (we) may hold about you, what it’s used for, and how it’s obtained, your rights and how to contact us as a data subject.

If you are submitting as a Recruitment Agency Partner, it is essential and your responsibility to ensure that candidates applying to LSEG are aware of this privacy notice.

Similar Jobs

Trackman - Senior iOS Developer - Mobile Golf

Trackman

Hørsholm, Denmark (On-Site)
2 Months ago
Games 24x7 - SDET-1 (Backend Tester)

Games 24x7

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Playrix - Senior C++ Software Engineer (Gameplay)

Playrix

Ukraine (Remote)
7 Months ago
Drive mode - Software Development Engineer in Test

Drive mode

Mountain View, California, United States (Hybrid)
1 Month ago
Barracuda Networks  Inc  - Cloud Site Reliability Staff Engineer

Barracuda Networks Inc

Ottawa, Ontario, Canada (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Anthology - Software Engineer I

Anthology

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Thatgamecompany - Senior Backend Engineer - China

Thatgamecompany

Shanghai, Shanghai, China (On-Site)
2 Months ago
GoMotive - Senior Software Engineer

GoMotive

(Remote)
1 Month ago
Arrise Solutions (India)   - Lead ML Engineer

Arrise Solutions (India)

Hyderabad, Telangana, India (On-Site)
8 Months ago
ARHS - SIEM Architect

ARHS

Brussels, Brussels, Belgium (On-Site)
1 Month ago
G5 Games - Monitoring Engineer

G5 Games

Astana, Astana, Kazakhstan (Remote)
2 Months ago
Version1 - Senior Full Stack Java Developer

Version1

London, England, United Kingdom (On-Site)
1 Month ago
Tesla - Senior Fullstack Software Engineer, Energy Software

Tesla

North Holland, Netherlands (On-Site)
4 Months ago
Minecast - Senior Software Development Engineer in Test

Minecast

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Addepar - Sr. Staff Enterprise Architect

Addepar

Edinburgh, Scotland, United Kingdom (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Ethos Life - Software Engineer, Test

Ethos Life

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Jellyfish - Senior Design Manager

Jellyfish

Mumbai, Maharashtra, India (Hybrid)
1 Month ago
Capgemini - SAP Tosca

Capgemini

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Keywords Studios - Research Associate - Fresher

Keywords Studios

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Nagarro - Associate Staff Engineer, Frontend React

Nagarro

India (Remote)
8 Months ago
Fi - Security Engineer

Fi

Bengaluru, Karnataka, India (On-Site)
5 Years ago
Paytm - Key Account Manager / Senior Key Account Manager - Pune

Paytm

Pune, Maharashtra, India (On-Site)
6 Months ago
Zscaler - Senior Devops Engineer (Terraform/Security Solutions)

Zscaler

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
GoTo Group - Lead Software Engineer - Engineering Platforms

GoTo Group

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Digital Jalebi - Manager/Senior Manager- Business Development/ Business Development Lead

Digital Jalebi

Noida, Uttar Pradesh, India (On-Site)
2 Years ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

LSEG (London Stock Exchange Group) isa leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our culture of connecting, creating opportunity and delivering excellence shapes how we think, how we do things and how we help our people fulfil their potential.

Heredia, Costa Rica (Hybrid)

Bangkok, Thailand (On-Site)

Gdynia, Pomeranian Voivodeship, Poland (On-Site)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (Hybrid)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Gdynia, Pomeranian Voivodeship, Poland (Hybrid)

View All Jobs

Get notified when new jobs are added by London stock Exchange

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug