Data Lineage Engineer

1 Month ago • 3-2 Years • Data Analysis

Job Summary

Job Description

As a Data Lineage Engineer within the Data Governance Execution team, you will work closely with the Data Trust team and divisional stakeholders to develop data pipeline models and workflows to improve data governance and deliver data trust objectives. You will be responsible for capturing requirements, delivering automation, and creating sustainable lineage models for D&A datasets. This includes developing, constructing, testing, and maintaining metadata repositories and data lineage models. Designing and implementing efficient ETL processes for loading metadata into Data Governance tools, and integrating different data storage solutions. You will also identify and implement process improvements, assist with data-related technical issues, and build/maintain reliable data pipelines.
Must have:
  • 3+ years experience in a similar role.
  • Strong in Java and Python programming languages.
  • Strong understanding of XML and JSON data formats.
  • Knowledge of relational SQL and NoSQL databases.
  • Experience with cloud services (AWS, Azure).
  • Strong analytical and problem-solving skills.
  • Excellent communication and teamwork abilities.
Good to have:
  • Exposure to NLP and LLM technologies.
  • Experience with machine learning techniques.
  • Familiarity with data security and privacy concerns.
  • Knowledge of data warehousing concepts.
  • Advanced degree in Computer Science, Engineering, or a related field.

Job Details

LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across financial markets, we enable businesses and economies around the world to fund innovation, manage risk and create jobs. It’s how we’ve contributed to supporting the financial stability and growth of communities and economies globally for more than 300 years. Through a comprehensive suite of trusted financial market infrastructure services – and our open-access model – we provide the flexibility, stability and trust that enable our customers to pursue their ambitions with confidence and clarity. LSEG is headquartered in the United Kingdom, with significant operations in 65 countries across EMEA, North America, Latin America and Asia Pacific. We employ 25,000 people globally, more than half located in Asia Pacific. LSEG’s ticker symbol is LSEG. OUR PEOPLE: People are at the heart of what we do and drive the success of our business. Our values of Integrity, Partnership, Excellence and Change shape how we think, how we do things and how we help our people fulfil their potential. We embrace diversity and actively seek to attract individuals with unique backgrounds and perspectives. We break down barriers and encourage teamwork, enabling innovation and rapid development of solutions that make a difference. Our workplace generates an enriching and rewarding experience for our people and customers alike. Our vision is to build an inclusive culture in which everyone feels encouraged to fulfil their potential. We know that real personal growth cannot be achieved by simply climbing a career ladder – which is why we encourage and enable a wealth of avenues and interesting opportunities for everyone to broaden and deepen their skills and expertise. As a global organisation spanning 65 countries and one rooted in a culture of growth, opportunity, diversity and innovation, LSEG is a place where everyone can grow, develop and fulfil your potential with meaningful careers. ROLE PROFILE: This role is critical for the effective execution and delivery of the data governance programme named Data Trust within LSEG. The Data Lineage Engineer, as a member of the Data Governance Execution Team, is responsible for building and maintaining end-to-end data element level data lineage models that are central to the team’s function. This is to ensure that execution of the data governance conformance activities can be automated and supported in a sustainable way through connecting to, and scanning, the physical data pipelines and relevant reference models. The role will need to work closely with Key internal stakeholders and with architects of Data Bases of Records and tooling development teams to be able to successfully architect governance process and automate for sustainability. ROLE SUMMARY: As a Data Lineage Engineer within the Data Governance Execution team, you will collaborate closely with the wider Data Trust team and key divisional stakeholders to develop the data pipeline models and workflows that will improve overall data governance process and deliver data trust objectives. You will be responsible for capturing requirements, delivering automation, and create a sustainable set of complex lineage models for D&A datasets. To be successful in the role you will require a strong background and understanding in building and optimizing data pipelines, architectures, and data sets. WHAT YOU'LL BE DOING: • Develop, construct, test, and maintain metadata repositories and data lineage models. • Design and implement efficient ETL processes for loading metadata into Data Governance tools. • Integrate different data storage solutions. • Identify, design, and implement internal process improvements. • Work with various stakeholders to assist with data-related technical issues. • Build and maintain reliable data pipelines to move data across systems WHAT YOU'LL BRING: • Minimum of 3 years of experience in a similar role • Strong in Java and Python programming languages • Strong understanding of XML and JSON data formats • Knowledge of relational SQL and NoSQL databases(Oracle, MSSQL, Snowflake) • Experience with cloud services (AWS, Azure) • Familiarity with data visualization tools (Tableau, Power BI, etc.) • Strong analytical and problem-solving skills • Excellent communication and teamwork abilities Education: - Bachelor’s degree in Computer Science, Engineering, or a related field Preferred Qualifications: • Exposure to NLP and LLM technologies and approaches • Experience with machine learning and data mining techniques • Familiarity with data security and privacy concerns • Knowledge of data warehousing and business intelligence concepts • Advanced degree in Computer Science, Engineering, or a related field

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.

Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence and Change underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions.

Working with us means that you will be part of a dynamic organisation of 25,000 people across 65 countries. However, we will value your individuality and enable you to bring your true self to work so you can help enrich our diverse workforce. You will be part of a collaborative and creative culture where we encourage new ideas and are committed to sustainability across our global business. You will experience the critical role we have in helping to re-engineer the financial ecosystem to support and drive sustainable economic growth. Together, we are aiming to achieve this growth by accelerating the just transition to net zero, enabling growth of the green economy and creating inclusive economic opportunity.

LSEG offers a range of tailored benefits and support, including healthcare, retirement planning, paid volunteering days and wellbeing initiatives.

We are proud to be an equal opportunities employer. This means that we do not discriminate on the basis of anyone’s race, religion, colour, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law. Conforming with applicable law, we can reasonably accommodate applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.

Please take a moment to read this privacy notice carefully, as it describes what personal information London Stock Exchange Group (LSEG) (we) may hold about you, what it’s used for, and how it’s obtained, your rights and how to contact us as a data subject.

If you are submitting as a Recruitment Agency Partner, it is essential and your responsibility to ensure that candidates applying to LSEG are aware of this privacy notice.

Similar Jobs

Roof Stacks - Senior iOS Developer

Roof Stacks

Istanbul, İstanbul, Türkiye (On-Site)
2 Days ago
Amber - 3D Animator (Project Based)

Amber

(Remote)
3 Months ago
Apple - AIML - Machine Learning Educator

Apple

New York, New York, United States (On-Site)
1 Month ago
Monzo - Group Product Manager, Business Banking

Monzo

London, England, United Kingdom (Remote)
1 Month ago
miniclip - SuccessFactors System Specialist

miniclip

Lisbon, Lisbon, Portugal (On-Site)
1 Month ago
Paytm - Business Analyst - Deputy Manager - UPI

Paytm

Noida, Uttar Pradesh, India (On-Site)
1 Month ago
BetterMe - Business Analyst (Web)

BetterMe

Kyiv, Kyiv City, Ukraine (On-Site)
1 Month ago
Apple - Software Engineer (Data Solutions), AI & Data Platforms

Apple

Austin, Texas, United States (On-Site)
3 Days ago
cyara - Sr. Manager, Data Analytics

cyara

Hyderabad, Telangana, India (Hybrid)
3 Months ago
Rippling - Staff Data Software Engineer

Rippling

San Francisco, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Alpha Sense - Director, Executive Producer

Alpha Sense

New York, United States (Remote)
2 Days ago
Revenera - Technical Consultant

Revenera

India (On-Site)
2 Months ago
Toast - Territory Account Executive

Toast

Jacksonville, Florida, United States (On-Site)
3 Weeks ago
Netflix - Researcher, Japan

Netflix

Tokyo, Japan (On-Site)
8 Months ago
Yodlee - Retail Banking Analytics Product Director

Yodlee

Raleigh, North Carolina, United States (Remote)
2 Months ago
Nice - Network Systems Engineer

Nice

Ra'anana, Center District, Israel (Hybrid)
3 Days ago
Betson Group - Director of Operations

Betson Group

Tbilisi, Tbilisi, Georgia (On-Site)
3 Weeks ago
Aristocrat - Director of Advanced Insights

Aristocrat

Las Vegas, Nevada, United States (Hybrid)
5 Months ago
gamefam - Executive Producer

gamefam

United States (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Nagarro - Staff Engineer, Java

Nagarro

India (Remote)
8 Months ago
Deutsche Bank - Confirmations Analyst

Deutsche Bank

Bengaluru, Karnataka, India (Hybrid)
9 Months ago
ShyftLabs - Lead Oracle Engineer PIM

ShyftLabs

Noida, Uttar Pradesh, India (Hybrid)
1 Week ago
Interactive Brokers - Client Services Representative: Funds & Banking

Interactive Brokers

Mumbai, Maharashtra, India (On-Site)
9 Months ago
velotio technologies  - Senior DevOps Engineer (GCP)

velotio technologies

Maharashtra, India (Remote)
3 Months ago
PwC - IN_Manager_ Adobe Campaign_Application Technology_Advisory

PwC

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Ethos Life - Customer Experience Associate

Ethos Life

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Sprinkler - Senior Technical Support Engineer - CCaaS

Sprinkler

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Alphawave Semi - Senior Staff Engineer II - Analog Design

Alphawave Semi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Scopely - Software Engineer

Scopely

Bengaluru, Karnataka, India (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

version 1 - Pre Sales Data Architect

version 1

London, England, United Kingdom (On-Site)
1 Month ago
Addepar - Sr. Software Engineer - Data Intelligence

Addepar

Edinburgh, Scotland, United Kingdom (On-Site)
1 Month ago
Reality Games - Data Analyst - Monopoly World

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
3 Months ago
London stock Exchange - Technical Business Analyst & Project Manager

London stock Exchange

Bucharest, Bucharest, Romania (On-Site)
1 Month ago
Moloco - Senior Software Engineer, Ads (Data SWE)

Moloco

Seattle, Washington, United States (On-Site)
1 Month ago
gitlab - Senior Data Analyst

gitlab

United States (Remote)
2 Days ago
Go Fund Me - Senior Data Scientist

Go Fund Me

San Francisco, California, United States (On-Site)
1 Month ago
miniclip - Data Engineer

miniclip

Lisbon, Lisbon, Portugal (On-Site)
1 Month ago
P99 soft - Senior Data Engineer (Snowflake and Python)

P99 soft

Hyderabad, Telangana, India (On-Site)
2 Months ago
luxsoft - Data Engineer

luxsoft

Poland (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

LSEG (London Stock Exchange Group) isa leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our culture of connecting, creating opportunity and delivering excellence shapes how we think, how we do things and how we help our people fulfil their potential.

Colombo, Western Province, Sri Lanka (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

London, England, United Kingdom (On-Site)

Bucharest, Bucharest, Romania (On-Site)

Bengaluru, Karnataka, India (On-Site)

Buffalo, New York, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

London, England, United Kingdom (On-Site)

Gdynia, Pomeranian Voivodeship, Poland (On-Site)

Bangkok, Thailand (On-Site)

View All Jobs

Get notified when new jobs are added by London stock Exchange

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug