Line of Service
AdvisoryIndustry/Sector
Not ApplicableSpecialism
OperationsManagement Level
SpecialistJob Description & Summary
At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals.Responsibilities:
Job Description:
We are seeking skilled and dynamic Data Engineers.The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS, Azure, Databricks, and GCP.
- Implement data ingestion and transformation processes to facilitate efficient data warehousing.
- Optimize Spark job performance to ensure high efficiency and reliability.
- Stay proactive in learning and implementing new technologies to improve data processing frameworks.
- Collaborate with cross-functional teams to deliver robust data solutions.
- Work on Spark Streaming for real-time data processing as necessary.
Qualifications:
- 0-1 years of experience in data engineering with a strong focus on cloud environments.
- Proficiency in PySpark or Spark.
- Proven experience with data ingestion, transformation, and data warehousing.
- In-depth knowledge and hands-on experience with cloud services(AWS/Azure/GCP):
- Demonstrated ability in performance optimization of Spark jobs.
- Strong problem-solving skills and the ability to work independently as well as in a team.
- Cloud Certification (AWS, Azure, or GCP) is a plus.
- Familiarity with Spark Streaming is a bonus.
Mandatory skill sets:
Python, Pyspark, SQL
Preferred skill sets:
Python, Pyspark, SQL
Years of experience required:
0-1 years
Education qualification:
BCA
Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required: Bachelor of TechnologyDegrees/Field of Study preferred:Certifications (if blank, certifications not specified)
Required Skills
Python Software DevelopmentOptional Skills
Accepting Feedback, Accepting Feedback, Active Listening, Business Case Development, Business Data Analytics, Business Intelligence and Reporting Tools (BIRT), Business Intelligence Development Studio, Communication, Competitive Advantage, Continuous Process Improvement, Data Analysis and Interpretation, Data Architecture, Database Management System (DBMS), Data Collection, Data Pipeline, Data Quality, Data Science, Data Visualization, Emotional Regulation, Empathy, Inclusion, Industry Trend Analysis, Intellectual Curiosity, Java (Programming Language), Market Development {+ 7 more}Desired Languages (If blank, desired languages not specified)
Travel Requirements
Not SpecifiedAvailable for Work Visa Sponsorship?
NoGovernment Clearance Required?
NoJob Posting End Date
Get notifed when new similar jobs are uploaded
Get notifed when new similar jobs are uploaded
At PwC, our purpose is to build trust in society and solve important problems. We’re a network of firms in 152 countries with over 327,000 people who are committed to delivering quality in assurance, advisory and tax services. Find out more and tell us what matters to you by visiting us at www.pwc.com. PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity.
Content on this page has been prepared for general information only and is not intended to be relied upon as accounting, tax or professional advice. Please reach out to your advisors for specific advice.
Get notified when new jobs are added by PWC