Azure Data Engineer (Software Engineer/ Lead)
Job Summary
Job Description
The role involves working in Software Engineering, focusing on the development, maintenance, and optimization of software solutions and applications. This includes applying scientific methods to analyze and solve software engineering problems, developing and applying software engineering practices, and using original thought and judgment. The engineer will build skills in their discipline, collaborate with other engineers and stakeholders, and leverage knowledge in Cloud Computing using Spark, Azure Databricks, and Azure Data Factory. Proficiency in Python/Scala, Spark/PySpark (Core and Streaming) for real-time or batch ingestion and transformation pipelines is required. The role also includes analyzing existing queries for performance improvements, developing procedures and scripts for data migration, providing scheduled management reporting, and investigating exceptions regarding asset movements. Working experience and strong knowledge in Databricks is a plus.
Must have:
- Knowledge in Cloud Computing using Spark, Azure Databricks, Azure Data Factory
- Knowledge in programming language Python/Scala
- Knowledge in Spark/PySpark (Core and Streaming)
- Knowledge building real time or batch ingestion and transformation pipelines
Good to have:
- Working experience and strong knowledge in Databricks
- Analyze existing queries for performance improvements
- Develop procedures and scripts for data migration
- Provide timely scheduled management reporting
- Investigate exceptions regarding asset movements
5 skills required
Job Details
Your role
- Knowledge in Cloud Computing by using Spark, Azure Databricks, Azure Data Factory
- Knowledge in programming language Python/Scala.
- Knowledge in Spark/PySpark (Core and Streaming) and hands-on to transform using Streaming.
- Knowledge building real time or batch ingestion and transformation pipelines.
Works in the area of Software Engineering, which encompasses the development, maintenance and optimization of software solutions/applications.1. Applies scientific methods to analyse and solve software engineering problems.2. He/she is responsible for the development and application of software engineering practice and knowledge, in research, design, development and maintenance.3. His/her work requires the exercise of original thought and judgement and the ability to supervise the technical and administrative work of other software engineers.4. The software engineer builds skills and expertise of his/her software engineering discipline to reach standard software engineer skills expectations for the applicable role, as defined in Professional Communities.5. The software engineer collaborates and acts as team player with other software engineers and stakeholders.
Your Profile
- Working experience and strong knowledge in Databricks is a plus.
- Analyse existing queries for performance improvements.
- Develop procedures and scripts for data migration.
- Provide timely scheduled management reporting.
- Investigate exceptions regarding asset movements.
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
Similar Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Skill Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Jobs in Bengaluru, Karnataka, India
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Data Analysis Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
About The Company
We are a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. Capgemini is a global leader in partnering with companies to transform and manage their business. Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology.
Get notified when new jobs are added by Capgemini
