Lead AWS Data Engineer

LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across financial markets, we enable businesses and economies around the world to fund innovation, manage risk and create jobs. It’s how we’ve contributed to supporting the financial stability and growth of communities and economies globally for more than 300 years.

FTSE Russell, part of the London Stock Exchange Group, is an essential index partner for a changing world, providing category-defining indices across asset classes and investment objectives to create new possibilities for the global investment community. FTSE Russell’s expertise and products are used extensively by institutional and retail investors globally.

Job Summary:

Contribute to building brand new data platforms in AWS, using Python and Spark. Be part of a dynamic team, building data solutions in a supportive and hybrid work environment. This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with innovative technologies. You will design, implement, and optimize ETL workflows using Python and Spark, contributing to our robust data Lakehouse architecture on AWS. Success in this role requires technical expertise, strong problem-solving skills, and the ability to collaborate effectively within an agile team.

Must Have Tech Skills:

• Demonstrable experience as a senior data engineer.
• Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices.
• Experience of implementing data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena
• Experience with data services in a Lakehouse architecture.

Nice To Have Tech Skills:

• Experience in solution architecture and technical design, allowing for the creation of scalable, reliable data architectures that meet both technical and business requirements
• A master’s degree or equivalent experience or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous

Key Accountabilities:

• Provides guidance on standard methodologies in design, development, and implementation, ensuring solutions meet business requirements and technical standards.
• Works closely with architects, Product Owners, and Dev team members to decompose solutions into Epics, leading design and planning of these components.
• Drive the migration of existing data processing workflows to the Lakehouse architecture, using Iceberg capabilities.
• Communicates complex technical information clearly, tailoring messages to the appropriate audience to ensure alignment.

Key Skills:

Deep technical knowledge of data engineering solutions and practices. Implementation of data pipelines using AWS data services and Lakehouse capabilities.

Highly proficient in Python, Spark and familiar with a variety of development technologies. This knowledge enables the Senior Data Engineer to adapt solutions to project-specific needs.

Skilled in decomposing solutions into components (Epics, stories) to streamline development.

Proficient in creating clear, comprehensive documentation. Ensures that documentation supports technical teams' knowledge and compliance, making it accessible and valuable for future reference

Proficient in quality assurance practices, including code reviews, automated testing, and standard methodologies for data validation.

Experience in using automation tools and Continuous Integration/Continuous Deployment (CI/CD) pipelines to streamline development, testing, and deployment.

Educational Background:

Bachelor’s degree or equivalent experience in computer science, Software Engineering, or related field essential.

At least 9+ years of relevant experience

Preferred Skills:

Financial Services expertise preferred, working with Equity and Fixed Income asset classes and a working knowledge of Indices.

Join us and be part of a team that values innovation, quality, and continuous improvement. If you're ready to take your career to the next level and make a significant impact, we'd love to hear from you.

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.

Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence and Change underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions.

Working with us means that you will be part of a dynamic organisation of 25,000 people across 65 countries. However, we will value your individuality and enable you to bring your true self to work so you can help enrich our diverse workforce.

We are proud to be an equal opportunities employer. This means that we do not discriminate on the basis of anyone’s race, religion, colour, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law. Conforming with applicable law, we can reasonably accommodate applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.

You will be part of a collaborative and creative culture where we encourage new ideas. We are committed to sustainability across our global business and we are proud to partner with our customers to help them meet their sustainability objectives. Our charity, the LSEG Foundation provides charitable grants to community groups that help people access economic opportunities and build a secure future with financial independence. Colleagues can get involved through fundraising and volunteering.

LSEG offers a range of tailored benefits and support, including healthcare, retirement planning, paid volunteering days and wellbeing initiatives.

Please take a moment to read this privacy notice carefully, as it describes what personal information London Stock Exchange Group (LSEG) (we) may hold about you, what it’s used for, and how it’s obtained, your rights and how to contact us as a data subject.

If you are submitting as a Recruitment Agency Partner, it is essential and your responsibility to ensure that candidates applying to LSEG are aware of this privacy notice.