Line of Service
AdvisoryIndustry/Sector
Not ApplicableSpecialism
Data, Analytics & AIManagement Level
Senior AssociateJob Description & Summary
A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.Responsibilities: Job Description:
Analyses current business practices, processes, and
procedures as well as identifying future business
opportunities for leveraging Microsoft Azure Data &
Analytics Services.
Provide technical leadership and thought leadership as
a senior member of the Analytics Practice in areas such
as data access & ingestion, data processing, data
integration, data modeling, database design &
implementation, data visualization, and advanced
analytics.
Engage and collaborate with customers to understand
business requirements/use cases and translate them
into detailed technical specifications.
Develop best practices including reusable code,
libraries, patterns, and consumable frameworks for
cloud-based data warehousing and ETL.
Maintain best practice standards for the development or
cloud-based data warehouse solutioning including
naming standards.
Designing and implementing highly performant data
pipelines from multiple sources using Apache Spark
and/or Azure Databricks
Integrating the end-to-end data pipeline to take data
from source systems to target data repositories
ensuring the quality and consistency of data is always
maintained
Working with other members of the project team to
support delivery of additional project components (API
interfaces)
Evaluating the performance and applicability of
multiple tools against customer requirements
Working within an Agile delivery / DevOps
methodology to deliver proof of concept and production
implementation in iterative sprints.
Integrate Databricks with other technologies (Ingestion
tools, Visualization tools).
Proven experience working as a data engineer
Highly proficient in using the spark framework (python
and/or Scala)
Extensive knowledge of Data Warehousing concepts,
strategies, methodologies.
Direct experience of building data pipelines using Azure
Data Factory and Apache Spark (preferably in
Databricks).
Hands on experience designing and delivering solutions
using Azure including Azure Storage, Azure SQL Data
Warehouse, Azure Data Lake, Azure Cosmos DB, Azure
Stream Analytics
Experience in designing and hands-on development in
cloud-based analytics solutions.
Expert level understanding on Azure Data Factory,
Azure Synapse, Azure SQL, Azure Data Lake, and Azure
App Service is required.
Designing and building of data pipelines using API
ingestion and Streaming ingestion methods.
Knowledge of Dev-Ops processes (including CI/CD) and
Infrastructure as code is essential.
Thorough understanding of Azure Cloud Infrastructure
offerings.
Strong experience in common data warehouse
modelling principles including Kimball.
Working knowledge of Python is desirable
Experience developing security models.
Databricks & Azure Big Data Architecture Certification
would be plus
Must be team oriented with strong collaboration,
prioritization, and adaptability skills required
Mandatory skill sets:
Azure Databricks
Preferred skill sets:
Azure Databricks
Years of experience required:
3-10 Years
Education qualification:
BE, B.Tech, MCA, M.Tech
Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required: Bachelor of Engineering, Master of Business AdministrationDegrees/Field of Study preferred:Certifications (if blank, certifications not specified)
Required Skills
Microsoft Azure DatabricksOptional Skills
Desired Languages (If blank, desired languages not specified)
Travel Requirements
Available for Work Visa Sponsorship?
Government Clearance Required?
Job Posting End Date
At PwC, our purpose is to build trust in society and solve important problems. We’re a network of firms in 152 countries with over 327,000 people who are committed to delivering quality in assurance, advisory and tax services. Find out more and tell us what matters to you by visiting us at www.pwc.com. PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity.
Content on this page has been prepared for general information only and is not intended to be relied upon as accounting, tax or professional advice. Please reach out to your advisors for specific advice.