Azure Data Engineer
Job Summary
Job Description
- Azure Databricks, SQL Server, Azure ML, Blob Storage
- Python & PySpark
- Data pipelines, ELT, data modeling
- CI/CD, unit testing
- Azure or Google Cloud certifications
- Machine learning integration
- Apache Spark experience
7 skills required
Job Details
Project description
We are seeking an experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with extensive experience working on the Azure Cloud Platform. You will be responsible for designing, developing, and maintaining scalable data solutions, ensuring the availability, reliability, and performance of our data infrastructure.
Responsibilities
Design, develop, and implement scalable data pipelines using Azure Databricks, SQL Server, Azure Machine Learning, and Azure Blob Storage.
Utilize programming languages like Python and PySpark for data processing and transformation tasks.
Develop and maintain ETL/ELT processes to load data from various sources into Azure-based data storage solutions.
Manage and optimize data storage solutions within Azure, ensuring data is securely stored and efficiently accessible.
Develop and maintain CI/CD pipelines using GitHub Actions for automated deployment of data solutions.
Skills
Must have
Azure Databricks, SQL Server, Azure Machine Learning, and Azure Blob Storage.
Python and PySpark.
Knowledge of data engineering concepts, including data pipelines, ELTs, data modeling, and object storage.
Proficient in software engineering principles, including continuous integration, deployment, and unit testing.
Nice to have
Certifications in Azure or Google Cloud.
Experience with machine learning integration into data pipelines.
Familiarity with other data processing technologies like Apache Spark.
Other
Languages
English: B2 Upper Intermediate
Seniority
Regular
Similar Jobs
Warner Bros. Discovery
Flow
Nielsen Holdings
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Warner Bros. Games
PwC
Get notifed when new similar jobs are uploaded
Jobs in New Delhi, Delhi, India
HRS Group
Paytm
Extreme Network
Get notifed when new similar jobs are uploaded
DevOps Jobs
The Walt Disney Company
Blue Yonder
Get notifed when new similar jobs are uploaded
About The Company
Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.
DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.
Get notified when new jobs are added by Luxoft
