Azure Databricks / Python / Pyspark Senior Data Engineer

14 Minutes ago • 6-10 Years • Data Analysis

Job Summary

Job Description

This is a full-time Senior Data Engineer and Tech Lead role at Exusia, focusing on Python, Pyspark, and Databricks. The role involves designing, developing, and maintaining large-scale data engineering solutions for clients, with opportunities to work across Data Governance and Metadata Management. Candidates will collaborate with client stakeholders to capture requirements, design, and implement analytical reporting, compliance, and data governance solutions.
Must have:
  • Work with business stakeholders to gather and analyze business requirements.
  • Document, discuss and resolve business, data and reporting issues.
  • Work independently and come up with solution design.
  • Build optimized data processing and data governance solutions.
  • Provide hands on technical leadership and work on multiple projects.
  • Collaborate with delivery leadership to deliver projects on time.
  • Contribute to talent recruitment, competency building and mentorship.
  • Strong Data Warehousing / Data Engineering background.
  • Strong conceptual understanding of Data Management & Data Governance principles.
  • Experience working with multiple databases like Oracle/SQL Server/Other DBs.
  • Exposure to Microsoft Azure storage and compute services.
  • Hands-on experience with Databricks on Azure.
  • Hands-on experience using Python and Pyspark (min 2 projects).
  • Fluent with Pyspark & Spark SQL.
  • Exposure to Delta lake.
Good to have:
  • Exposure to BFSI domain and Data Governance.
  • Exposure to Java & Scala.
  • Understanding of data governance tools like ASG & Collibra.
  • Exposure to cloud platforms like AWS, Azure & GCP.

Job Details

Description

Exusia, a cutting-edge digital transformation consultancy, and is looking for top talent in Data Engineering space with specific skills in Python/Pyspark/Databricks to join our global delivery team's Industry Analytics practice in India.

What’s the Role?

Full-time job to work with Exusia's clients to design, develop and maintain large scale data engineering solutions. The right candidates will also get a chance to work across the entire data landscape including Data Governance, Metadata Management and will work closely with client stakeholders to capture the requirements, design and implement Analytical reporting, Compliance and Data Governance solutions.

Criteria for the Role!

  • Have a minimum of 6 years’ experience in Data Management, Data Engineering & Data Governance space with hands on project experience using Python, Pyspark & Databricks
  • Should have worked on large data initiatives and should have exposure to different flavours of Spark including Pyspark/Spark SQL/Scala/Java
  • Education Qualification – Bachelor of Science (preferably in Computer and Information Sciences or Business Information Technology) or an Engineering degree in the above areas

Key Responsibilities:

  • Work with business stakeholders to gather and analyze business requirements, building a solid understanding of the Data Analytics and Data Governance domain
  • Document, discuss and resolve business, data and reporting issues within the team, across functional teams, and with business stakeholders
  • Should be able to work independently and come up with solution design
  • Build optimized data processing and data governance solutions using the given toolset
  • Provide hands on technical leadership and work on multiple projects if required
  • Collaborate with delivery leadership to deliver projects on time adhering to the quality standards
  • Contribute to talent recruitment, competency building and providing mentor-ship to junior resources for these skills

Requirements

Mandatory Skills:

  • Must have strong Data Warehousing / Data Engineering background
  • Strong conceptual understanding of Data Management & Data Governance principles
  • Experience working with multiple databases like Oracle/SQL Server/Other DBs
  • Exposure to Microsoft Azure storage and compute services and should have hands on experience with Databricks on Azure
  • Hands-on experience using Python and Pyspark and should have completed min 2 projects
  • Hands-on experience using Databricks and should be fluent with Pyspark & Spark SQL
  • Exposure to Delta lake

Nice-to-Have Skills

  • Exposure to BFSI domain and Data Governance is a big plus
  • Exposure to Java & Scala
  • Understanding of data governance tools like ASG & Collibra is an added advantage
  • Exposure to cloud platforms like AWS, Azure & GCP

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in India

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Exusia (ex-OO-see-ah), A Globant Division has the mission of transforming the world through the innovative use of information. Exusia is an ISO 27001 certified technology solutions company that empowers its clients to gain a competitive edge by accelerating business objectives and providing solutions in artificial intelligence, cloud computing, data engineering and digital transformation. Exusia is a leader in end-to-end data strategy, execution and managed services offerings, leveraging its team of business strategy, analytics and data engineering experts along with cutting edge hosted software as a service accelerators to deliver to clients. Exusia was founded in 2012 and now provides services in IT Strategy, AI Enablement, Data Governance, Data Engineering, Cloud Migration and Mainframe Modernization to the Globant client base as apart of the Data & Artificial Intelligence Studio. Globant has over 30,000 employees providing services to clients in 34 countries across world.
View All Jobs

Get notified when new jobs are added by EXUSIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug