Big Data Engineer

1 Day ago • 8 Years +

About the job

SummaryBy Outscal

Company Description

👋🏼 We're Nagarro.

We are a digital product engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18,500+ experts across 36 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in!

By this point in your career, it is not just about the tech you know or how well you can code. It is about what more you want to do with that knowledge. Can you help your teammates proceed in the right direction? Can you tackle the challenges our clients face while always looking to take our solutions one step further to succeed at an even higher level? Yes? You may be ready to join us.

Job Description

In this role, you will work with our Business Analytics & Insights (BAI) team, collaborating with cross-functional teams to deliver high-quality data solutions in areas such as Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.

Responsibilities:

  • Lead the technical planning for data migration, including data ingestion, transformation, storage, and access control within Azure Data Factory and Azure Data Lake.
  •  Design and implement scalable, efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks.
  •  Develop reusable frameworks for the ingestion of large datasets.
  •  Ensure data quality and integrity by implementing robust validation and cleansing mechanisms throughout the data pipeline.
  •  Work with event-based/streaming technologies to ingest and process data in real-time.
  •  Provide technical support to the team, resolving challenges during the migration and post-migration phases.
  •  Stay current with the latest advancements in cloud computing, data engineering, and analytics technologies; recommend best practices and industry standards for data lake solutions.

Qualifications

  • 8+ years of IT experience.
  •  Minimum of 4 years working with Azure Databricks.
  • Experience with Python for data engineering purposes.
  •  Proficiency in Data Modeling and Source System Analysis.
  •  Strong knowledge of PySpark and SQL.
  •  Experience with Azure components: Data Factory, Data Lake, SQL Data Warehouse (DW), and Azure SQL.
  •  Ability to conduct data profiling, cataloging, and mapping for technical design and construction of data flows.
  • Familiarity with data visualization/exploration tools.

Similar Jobs

GameChanger  - Senior Data Engineer

Gamechanger Remote Us (Remote)

Moon Active - Data Engineer

Tel Aviv District, Israel (Hybrid)

sigma software - Senior Data Engineer (Global Business Solutions)

Lesser Poland Voivodeship, Poland (Remote)

sigma software - Senior Data Engineer (Scala)

Federal District, Brazil (Remote)

ARHS - Stream Processing Data Engineer (SPDE)

Masovian Voivodeship, Poland (Remote)

ARHS - NIFI Data Engineer (NDE)

Masovian Voivodeship, Poland (Remote)

Similar Skill Jobs

GameChanger  - Senior Product Manager, Trust & Safety

Gamechanger Remote Us (Remote)

GameChanger  - Senior Mobile Engineer, Reliability

Gamechanger Remote Us (Remote)

GameChanger  - iOS Software Engineer, Gameday

Gamechanger Remote Us (Remote)

GameChanger  - Senior Analytics Engineer

Gamechanger Remote Us (Remote)

GameChanger  - Computer Vision Engineer

Gamechanger Remote Us (Remote)

GameChanger  - Senior Data Engineer

Gamechanger Remote Us (Remote)

Windranger Labs - Business Development Lead, APAC

Remote Apac (Remote)

Homa games - Mobile Game QA Tester

France Spain Poland Turkey (Remote)

Playtech - Legal Counsel

Derech Menachem Begin 121, Tel Aviv Yafo, Israel (On-Site)

Playtech - Senior Technical Project Manager

Vanemuise Tn 7, Estonia (On-Site)

Software Engineering Jobs

GameChanger  - Senior Mobile Engineer, Reliability

Gamechanger Remote Us (Remote)

GameChanger  - iOS Software Engineer, Gameday

Gamechanger Remote Us (Remote)

GameChanger  - Computer Vision Engineer

Gamechanger Remote Us (Remote)

GameChanger  - Senior Data Engineer

Gamechanger Remote Us (Remote)

Windranger Labs - Node.js Engineer

Remote Apac (Remote)

PlayStation Global - Software Engineer II

United States, Madison, Wi (On-Site)

Evolution - Full time - Online Casino Card Inspector/ Shuffler

British Columbia, Canada (On-Site)

Playtech - IT Tech Support [021825]

West Street, St 1200, Wilmington (On-Site)

Playtech - Senior Application Security Engineer

Diefenbachgasse 35, Wien, Austria (On-Site)

Playtech - Integration Manager

Vanemuise 7/ Lõõtsa 5, Tartu/ Tallinn, Estonia (On-Site)

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug