Data Engineering Lead

undefined ago • 8-10 Years • Software Development & Engineering

Job Summary

Job Description

At PwC, Data Engineering Leads leverage advanced technologies to design and develop robust data solutions, transforming raw data into actionable insights. This role involves designing and building data infrastructure, developing data pipelines, and implementing integration and transformation solutions. The Technical Lead is responsible for delivering Cloud technical data solutions, ensuring they align with best practices and support firm regulatory and business enablement requirements, especially for AI and ML. They coordinate technical solution delivery, engage stakeholders, and foster a dynamic, innovative team culture. Key responsibilities include technical data strategy, data modelling, setting technical standards, solutions design, operational management, and continuous improvement, including championing AI tools.
Must have:
  • Leverage advanced technologies to design and develop robust data solutions.
  • Transform raw data into actionable insights.
  • Design and build data infrastructure and systems.
  • Develop and implement data pipelines, integration, and transformation solutions.
  • Motivate, develop, and inspire others to deliver quality.
  • Coach and manage performance to deliver on client expectations.
  • Identify opportunities contributing to the Firm's success.
  • Lead with integrity and authenticity.
  • Embrace technology and innovation.
  • Analyse linkages and interactions between system components.
  • Take ownership of projects, ensuring successful planning and execution.
  • Partner with team leadership for collective ownership of quality.
  • Develop skills outside comfort zone and encourage others.
  • Effectively mentor others.
  • Use work review to deepen team expertise.
  • Address conflicts or issues, engaging in difficult conversations.
  • Uphold professional and technical standards and code of conduct.
  • Responsible for development and delivery of Cloud technical data solutions.
  • Ensure technical data services are designed according to best practices.
  • Enable robust use of Artificial Intelligence and Machine Learning.
  • Coordinate delivery across Data Engineering and Data Infrastructure.
  • Engage with stakeholders to meet business strategy and requirements.
  • Implement technology aligning with business strategy.
  • Engage with internal and LoS technical teams for alignment.
  • Forecast technology trends and identify technology pivots.
  • Evaluate new approaches, technologies, and services.
  • Implement data solutions in line with data modelling best practices.
  • Provide cost-effective and efficient technical data services.
  • Implement data solutions promoting ethical and responsible data use.
  • Engage with SMEs to ensure adherence to standards.
  • Develop technical standards for SDLC pillars.
  • Collaborate with internal and LoS teams on technical standards.
  • Provide input on technical data requirements in product design.
  • Assist with defining technical delivery plans.
  • Evaluate data solution delivery against strategic goals.
  • Act as a mentor to technical staff.
  • Assist with technical training curriculums.
  • Provide technical support to data communities.
  • Assist with internal and LoS data training programmes.
  • Identify opportunities to enhance data quality processes.
  • Contribute to ongoing assessments of data quality practices.
  • Drive the optimisation and automation of redundant processes.
  • Master and champion the use of AI tools in Data Governance.
Good to have:
  • Databricks experience
  • MS Fabric experience
  • Excellent communication and interpersonal skills
  • Analytical and detail-oriented mindset
  • Proactive approach to problem solving and decision making

Job Details

Management Level

Manager

Job Description & Summary

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

Enhancing your leadership style, you motivate, develop and inspire others to deliver quality. You are responsible for coaching, leveraging team member’s unique strengths, and managing performance to deliver on client expectations. With your growing knowledge of how business works, you play an important role in identifying opportunities that contribute to the success of our Firm. You are expected to lead with integrity and authenticity, articulating our purpose and values in a meaningful way. You embrace technology and innovation to enhance your delivery and encourage others to do the same.

Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:

  • Analyse and identify the linkages and interactions between the component parts of an entire system.
  • Take ownership of projects, ensuring their successful planning, budgeting, execution, and completion.
  • Partner with team leadership to ensure collective ownership of quality, timelines, and deliverables.
  • Develop skills outside your comfort zone, and encourage others to do the same.
  • Effectively mentor others.
  • Use the review of work as an opportunity to deepen the expertise of team members.
  • Address conflicts or issues, engaging in difficult conversations with clients, team members and other stakeholders, escalating where appropriate.
  • Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence requirements.

Position Overview:

The Technical Lead is responsible for the development and delivery of Cloud technical data solutions that support enterprise data management and data usage requirements. The Lead ensures that all technical data services and solutions are designed and implemented according to best practices and support firm regulatory, business enablement requirements. The Cloud data solutions should enable robust use of Artificial Intelligence and Machine Learning. The Technical Lead coordinates delivery of technical solutions across Data Engineering and Data Infrastructure services and engages with stakeholders to ensure that deliverables meet the business strategy and requirements within the agreed timelines.

Culture Vision Statement:

Our Africa Tech and Digital team is a dynamic community of self-starters and innovators who embrace change and the constant evolution of technology. We are committed to fostering an environment where curiosity thrives and creativity is celebrated. By leveraging AI-assisted tools and respecting diverse perspectives, we drive collaborative success while enhancing our collective knowledge and skills. We believe in the power of technology to transform and improve our processes, always seeking to challenge the status quo. Together, we work with urgency and empathy, united in our mission to create impactful solutions that benefit our firm and our clients.

Key Responsibilities:

1. Technical Data Strategy:

  • Implement technology that aligns with the business strategy and fulfills business and network requirements for data services.
  • Engagement and collaboration with internal and LoS technical teams to ensure alignment, awareness and adoption of technical data solutions and services in support of business requirements.
  • Forecast technology trends be able to proactively Identify technology pivots and roadmap. Evaluate new approaches, technologies, and services to ensure that Data solutions and services meet changing business demand and enable innovative solutions that can be implemented with agility, urgency and agency.

2. Data Modelling:

  • Implement data solutions that are in line with data modelling best practices.
  • Provide technical data services that meet the ongoing requirements of the business in a cost effective and efficient manner.
  • Implement data solutions and services promote ethical and responsible use of data within the firm.
  • Engage with local and global SMEs and teams to ensure that the technical data solutions and services adhere to standards, assist the firm in meeting regulatory requirements and align to the network roadmap.

3. Technical Standards:

  • Develop technical standards for each pillar of the Software Development Lfe0cycle (SDLC) in collaboration with other SMEs across AfricaTech.
  • Collaborate with, and assist, internal and LoS teams with understanding and implementing technical standards requirements of the firm and advise on best practices.

4. Solutions Design

  • Collaborate in product design sessions to provide input on technical data requirements and approaches that support the data requirements of the desired business product outcomes.
  • Assist with defining technical delivery plans that will meet the requirements for data-driven solutions.
  • Evaluate the delivery of data solutions to ensure that they support strategic deliver, meet business requirements and adhere to technical standards.

5. Operational Management

  • Act as a mentor to technical staff within the team.
  • Assist with the development of technical training curriculums.
  • Provide technical support and input into data communities of interest and practice.
  • Assist with internal and LoS data training programmes.

7. Continuous Improvement:

  • Identify opportunities to enhance data quality processes, tools, and techniques, leveraging innovative approaches to improve overall data governance and quality strategies.
  • Contribute to ongoing assessments of the effectiveness of data quality practices, proposing adjustments based on industry trends and organizational needs.
  • Drive the optimisation and automation of redundant and obsolete processes
  • Master and champion, the use of AI tools in the delivery of Data Governance and Quality processes.

Qualifications and Skills:

Education:

  • Any Bachelor Degree in Computer Science or equivalent relevant work experience.
  • Certifications in Microsoft Databricks.
  • Experience: Minimum of 8 - 10 years of experience in cloud data engineering or related roles within a complex organizational environment.

Technical Skills:

  • Experience in designing and managing data warehouses.
  • Experience in ensuring data security and compliance with regulations, including encryption and privacy laws.
  • Data quality analysis skills.
  • Strong analytical and problem-solving abilities to interpret complex data and translate business requirements into technical specifications.
  • Proficiency in data mining, predictive modelling, and working with large datasets to uncover insights.
  • Designing and implementing enterprise data management frameworks.
  • Knowledge of data governance and data quality principles.
  • Large-scale technical data project implementation experience.
  • Ability to formulate and drive a technical data strategy and budget.
  • Ability to mentor and develop technical data teams.
  • Ability to facilitate broader staff training.
  • Ability to explain technical concepts at all levels.
  • Stakeholder engagement and strong communication skills at all levels.
  • Data modelling and identification and linking of Gloden Sources
  • Metadata Management
  • Azure cloud data services architecture (Synapse, Purview).
  • Understanding of API development (REST, SOAP, APIM).
  • DevOps experience (task management, code deployment, pipeline management).
  • Terraform experience.
  • SQL experience.
  • Python experience.
  • Power BI experience.
  • Alteryx experience.
  • Databricks experience (ideal).
  • MS Fabric experience (ideal).
  • Data modeling experience.
  • Phython
  • Use of AI and ML within Databricks and Synapse

Soft Skills:

  • Excellent communication and interpersonal skills, with the ability to engage effectively with diverse stakeholders.
  • Analytical and detail-oriented mindset, with a proactive approach to problem solving and decision making.

Conclusion

At PwC, our purpose is to build trust in society and solve important problems. As we navigate an increasingly complex world, we are dedicated to ensuring that the systems on which communities and economies depend can adapt and thrive. Each role within our organization contributes to this mission, reinforcing our commitment to high ethical standards and the importance of trust.

Our five core values guide our actions and define who we are. They emphasize building trust through professionalism, ethical behavior, and a commitment to quality in all our interactions, whether with clients, colleagues, or the broader community. We respect privacy and confidentiality, and we strive for transparency in our operations, demonstrating care and integrity in our relationships.

As part of our human-led, tech-powered approach, we empower our people through technology and foster an environment were speaking up is encouraged, and diverse perspectives are celebrated. By embodying these principles in our daily work, we can collectively drive impactful outcomes that resonate with our clients and society as a whole. Together, let's embrace our purpose and values to create meaningful change.

The Data Governance and Quality Manager plays a critical role in establishing data governance frameworks that will build trust in our data, open revenues for data monetization and upholding the quality and integrity of the organization’s data assets. Your expertise in data governance and management practices and commitment to fostering a culture of accountability will significantly enhance the effectiveness of data governance initiatives within PwC Africa. You need to be passionate about data governance and PwC’s purpose needs to resonate with you.

Travel Requirements

Up to 20%

Available for Work Visa Sponsorship?

No

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Johannesburg, Gauteng, South Africa

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Software Development & Engineering Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

At PwC, our purpose is to build trust in society and solve important problems. We’re a network of firms in 152 countries with over 327,000 people who are committed to delivering quality in assurance, advisory and tax services. Find out more and tell us what matters to you by visiting us at www.pwc.com. PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity.


Content on this page has been prepared for general information only and is not intended to be relied upon as accounting, tax or professional advice. Please reach out to your advisors for specific advice.

Johannesburg, Gauteng, South Africa (On-Site)

Barueri, São Paulo, Brazil (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Bengaluru, Karnataka, India (On-Site)

Montreal, Quebec, Canada (On-Site)

Bengaluru, Karnataka, India (On-Site)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

View All Jobs

Get notified when new jobs are added by PwC

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug