Data Engineer
Job Summary
Job Description
The Data Engineer will design, implement, and maintain data pipelines within the Azure environment. This includes the ingestion, processing, and transformation of data. Collaboration with data scientists and analysts to understand data needs and create efficient workflows is crucial. Responsibilities include the creation and maintenance of data storage solutions like Azure SQL Database and Azure Data Lake. ETL processes using Azure Data Factory or similar technologies will be developed and maintained. Data validation and cleansing procedures will be implemented to ensure data quality and reliability. The role also involves improving the scalability, efficiency, and cost-effectiveness of data pipelines, as well as monitoring and resolving pipeline issues to ensure data consistency and availability. This role is within Software Engineering, focusing on developing, maintaining, and optimizing software solutions and applications.
Must have:
- Design and maintain data pipelines in Azure.
- Collaborate with data scientists and analysts.
- Create and maintain data storage solutions.
- Develop and maintain ETL operations.
- Implement data validation and cleansing.
- Improve pipeline scalability and efficiency.
- Monitor and resolve data pipeline issues.
3 skills required
Job Details
Job Description
- Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
- Work together with data scientists and analysts to understand the needs for data and create effective data workflows.
- Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
- Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.
- Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
- Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
- Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.
Similar Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Skill Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Jobs in Hyderabad, Telangana, India
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Category Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
About The Company
We are a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. Capgemini is a global leader in partnering with companies to transform and manage their business. Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology.
Get notified when new jobs are added by Capgemini
