Data Engineer-AWS SQL - Senior Associate

11 Months ago • 4-8 Years

Devops

Job Description

Data Engineer with 4-8 years' experience in architecting and delivering scalable cloud-based data solutions on AWS. Strong expertise in data lake, data hub implementation, Lambda/Kappa Architectures, and Data Management concepts. Proficient in AWS services (EMR, Glue, S3, Redshift, DynamoDB, Kinesis, SQS, MSK) and Big Data frameworks (Hadoop, Spark).

Good To Have:

DBT ELT Tool
Application DevOps
AWS Security
Cloud Data Migration

Must Have:

AWS Data Solutions
Data Lake/Hub
AWS Services
Big Data Frameworks

Add these skills to join the top 1% applicants for this job

jenkins

scala

ci-cd

github

spark

aws

python

sql

git

gitlab

hadoop

communication

presentation-skills

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Data, Analytics & AI

Management Level

Senior Associate

Job Description & Summary

A career in our Advisory Acceleration Centre is the natural extension of PwC’s leading class global delivery capabilities. We provide premium, cost effective, high quality services that support process quality and delivery capability in support for client engagements.

Years of Experience: Candidates with 4-8 years of hands on experience

Position Requirements:

Must Have:

Experience in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions
Strong expertise in end-to-end implementation of Cloud data engineering solutions like Enterprise Data lake, Data hub in AWS
Proficient in Lambda or Kappa Architectures

Should be aware of Data Management concepts and Data Modelling
Strong AWS hands-on expertise with a programming background preferably Python/Scala

Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory
Strong experience in AWS compute services like AWS EMR, Glue and storage services like S3, Redshift & Dynamodb
Good experience with any one of the AWS Streaming Services like AWS Kinesis, AWS SQS and AWS MSK
Troubleshooting and Performance tuning experience in Spark framework - Spark core, Sql and Spark Streaming
Strong understanding of DBT ELT Tool, and usage of DBT macros etc
Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit
Experience with AWS CloudWatch, AWS Cloud Trail, AWS Account Config, AWS Config Rules
Good knowledge in AWS Security and AWS Key management
Strong understanding of Cloud data migration processes, methods and project lifecycle
Good analytical & problem-solving skills
Good communication and presentation skills