Big Data Engineer (Azure Databricks)

3 Months ago • 4-4 Years • Data Analyst

Job Summary

Job Description

As a Big Data Engineer (Azure Databricks) at Nagarro, you'll be part of the Business Analytics & Insights (BAI) team, working on data solutions for various departments like Supply Chain, Finance, Operations, and more. Your responsibilities will include designing and implementing data pipelines using Azure Databricks, ensuring data quality and integrity, and working with event-based technologies for real-time data processing. You'll also be responsible for providing technical support, staying up-to-date with industry advancements, and recommending best practices for data lake solutions.
Must have:
  • 4+ years IT experience
  • 4+ years working with Azure Databricks
  • Proficiency in Data Modeling and Source System Analysis
  • Strong knowledge of PySpark and SQL
  • Experience with Azure Data Factory, Data Lake, SQL Data Warehouse (DW), and Azure SQL
  • Experience with Python for data engineering purposes
  • Ability to conduct data profiling, cataloging, and mapping
Good to have:
  • Familiarity with data visualization/exploration tools

Job Details

Company Description

👋🏼 We're Nagarro.

We are a digital product engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18,500+ experts across 36 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in!

By this point in your career, it is not just about the tech you know or how well you can code. It is about what more you want to do with that knowledge. Can you help your teammates proceed in the right direction? Can you tackle the challenges our clients face while always looking to take our solutions one step further to succeed at an even higher level? Yes? You may be ready to join us.

Job Description

In this role, you will work with our Business Analytics & Insights (BAI) team, collaborating with cross-functional teams to deliver high-quality data solutions in areas such as Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.

Responsibilities:

  • Lead the technical planning for data migration, including data ingestion, transformation, storage, and access control within Azure Data Factory and Azure Data Lake.
  •  Design and implement scalable, efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks.
  •  Develop reusable frameworks for the ingestion of large datasets.
  •  Ensure data quality and integrity by implementing robust validation and cleansing mechanisms throughout the data pipeline.
  •  Work with event-based/streaming technologies to ingest and process data in real-time.
  •  Provide technical support to the team, resolving challenges during the migration and post-migration phases.
  •  Stay current with the latest advancements in cloud computing, data engineering, and analytics technologies; recommend best practices and industry standards for data lake solutions.

Qualifications

  • 4+ years of IT experience.
  •  Minimum of 4 years working with Azure Databricks.
  •  Proficiency in Data Modeling and Source System Analysis.
  •  Strong knowledge of PySpark and SQL.
  •  Experience with Azure components: Data Factory, Data Lake, SQL Data Warehouse (DW), and Azure SQL.
  •  Experience with Python for data engineering purposes.
  •  Ability to conduct data profiling, cataloging, and mapping for technical design and construction of data flows.
  • Familiarity with data visualization/exploration tools.

Additional Information

  • Technical leadership skills with the ability to guide and mentor teams.
  • Strong problem-solving capabilities, able to translate business requirements into data science solutions.
  •  Excellent communication skills, with the ability to explain complex concepts to both technical and non-technical stakeholders.
  • Strong team player with excellent interpersonal and collaboration skills.
  • Ability to deliver high-quality results within specified timelines.

Similar Jobs

Infogain - iOS Developer (Senior)

Infogain

Pune, Maharashtra, India (On-Site)
4 Months ago
DEVOTEAM - Tech Lead Java

DEVOTEAM

Casablanca, Casablanca-Settat, Morocco (Remote)
4 Months ago
PwC - Senior Associate _ Automation Tester_ Emerging  Technologies_ Advisory_ Bengaluru

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
ARHS - AWS or Azure Cloud Architect

ARHS

Luxembourg (On-Site)
4 Months ago
Ness Digital - Sr. Data Engineer

Ness Digital

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Logitech - Senior Manager - Sustainability Data & Insights

Logitech

Cork, County Cork, Ireland (Hybrid)
2 Months ago
DraftKings - Senior Data Science Engineer

DraftKings

London, England, United Kingdom (On-Site)
3 Months ago
Epic Games - Principal Data Scientist

Epic Games

Montreal, Quebec, Canada (On-Site)
1 Month ago
Meta - Engenheiro de Dados Junior

Meta

Brazil (On-Site)
6 Months ago
IGT - Senior Data Engineer (iGaming)

IGT

Belgrade, Serbia (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Arrow Electronics - Architect - SecOps

Arrow Electronics

Karnataka, India (On-Site)
3 Months ago
C3 AI - Solution Engineer

C3 AI

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Microsoft - Technical Support Engineer - Kubernetes

Microsoft

Sydney, New South Wales, Australia (Remote)
1 Month ago
Stonewall Collision & Auto Painting - Data Scientist

Stonewall Collision & Auto Painting

Hyderabad, Telangana, India (On-Site)
5 Months ago
Microsoft - Senior Data Scientist

Microsoft

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Rackspace Technology - Senior Manager, PMO (Hybrid San Antonio)

Rackspace Technology

San Antonio, Texas, United States (Hybrid)
1 Month ago
Ajmera Infotech - SENIOR ASP.NET DEVELOPER

Ajmera Infotech

Bengaluru, Karnataka, India (On-Site)
7 Months ago
CAE - Infrastructure Engineer

CAE

Arlington, Texas, United States (On-Site)
4 Months ago
PwC - IN-Manager – D365 Scm -Ms Dynamics– Advisory  - Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Romania

Playtech - Shuffler

Playtech

Bucharest, Bucharest, Romania (On-Site)
4 Months ago
Nagarro - SAP eWM Consultant

Nagarro

Romania (On-Site)
3 Months ago
PwC - Sustainability Senior Consultant – ESG Financial Services

PwC

Bucharest, Bucharest, Romania (On-Site)
4 Months ago
PwC - Senior Actuarial Consultant

PwC

Bucharest, Bucharest, Romania (Hybrid)
2 Months ago
Every matrix - Legal Counsel

Every matrix

Bucharest, Bucharest, Romania (Hybrid)
1 Month ago
Nagarro - Senior Staff Consultant ,SAP Govern Risk Compliance

Nagarro

Romania (On-Site)
3 Months ago
Ubisoft - IT Application Specialist [1 year Fixed term contract]

Ubisoft

Bucharest, Bucharest, Romania (On-Site)
2 Months ago
Ubisoft - Live Producer [Tom Clancy’s The Division 2]

Ubisoft

Bucharest, Bucharest, Romania (On-Site)
1 Month ago
CloudLinux - C Developer (worldwide remote, work anywhere)

CloudLinux

Bucharest, Bucharest, Romania (Remote)
3 Months ago
PwC - Senior Tax Consultant

PwC

Bucharest, Bucharest, Romania (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Infraveo Technologies - Jr. Data Scientist

Infraveo Technologies

Gurugram, Haryana, India (Remote)
4 Months ago
OUTFIT7 - Analytics Engineer

OUTFIT7

Ljubljana, Ljubljana, Slovenia (On-Site)
5 Months ago
Intel Corporation - SMG Data Quality Specialist

Intel Corporation

Penang, Malaysia (Hybrid)
2 Months ago
Barracuda Networks  Inc  - Principal Enterprise Data Architect

Barracuda Networks Inc

Ontario, Canada (On-Site)
4 Months ago
Sony India Software Centre - BW, BPC skilled resource -8~10 years of experience-4

Sony India Software Centre

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Billigence - Senior Data Engineer

Billigence

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Luxoft - Senior Data Engineer

Luxoft

(Remote)
3 Months ago
Voodoo - Senior Data Analyst - Growth

Voodoo

Paris, Île-de-France, France (Hybrid)
3 Months ago
PlayStation Global - Staff Marketing Data Scientist

PlayStation Global

Aliso Viejo, California, United States (Hybrid)
7 Months ago
Truecaller - Data Engineer

Truecaller

Stockholm, Stockholm County, Sweden (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded