Line of Service
AdvisoryIndustry/Sector
Not ApplicableSpecialism
OperationsManagement Level
SpecialistJob Description & Summary
At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals.Responsibilities:
Job Description:
We are seeking skilled and dynamic Data Engineers.The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS, Azure, Databricks, and GCP.
- Implement data ingestion and transformation processes to facilitate efficient data warehousing.
- Optimize Spark job performance to ensure high efficiency and reliability.
- Stay proactive in learning and implementing new technologies to improve data processing frameworks.
- Collaborate with cross-functional teams to deliver robust data solutions.
- Work on Spark Streaming for real-time data processing as necessary.
Qualifications:
- 0-1 years of experience in data engineering with a strong focus on cloud environments.
- Proficiency in PySpark or Spark.
- Proven experience with data ingestion, transformation, and data warehousing.
- In-depth knowledge and hands-on experience with cloud services(AWS/Azure/GCP):
- Demonstrated ability in performance optimization of Spark jobs.
- Strong problem-solving skills and the ability to work independently as well as in a team.
- Cloud Certification (AWS, Azure, or GCP) is a plus.
- Familiarity with Spark Streaming is a bonus.
Mandatory skill sets:
Python, Pyspark, SQL
Preferred skill sets:
Python, Pyspark, SQL
Years of experience required:
0-1 years
Education qualification:
BCA
Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required: Bachelor of TechnologyDegrees/Field of Study preferred:Certifications (if blank, certifications not specified)
Required Skills
Python Software DevelopmentOptional Skills
Accepting Feedback, Accepting Feedback, Active Listening, Business Case Development, Business Data Analytics, Business Intelligence and Reporting Tools (BIRT), Business Intelligence Development Studio, Communication, Competitive Advantage, Continuous Process Improvement, Data Analysis and Interpretation, Data Architecture, Database Management System (DBMS), Data Collection, Data Pipeline, Data Quality, Data Science, Data Visualization, Emotional Regulation, Empathy, Inclusion, Industry Trend Analysis, Intellectual Curiosity, Java (Programming Language), Market Development {+ 7 more}Desired Languages (If blank, desired languages not specified)
Travel Requirements
Not SpecifiedAvailable for Work Visa Sponsorship?
NoGovernment Clearance Required?
NoJob Posting End Date