Azure Databricks / Python / PySpark Senior Data Engineer

1 Month ago • 6-10 Years • Data Analyst

Job Summary

Job Description

This role involves designing, developing, and maintaining large-scale data engineering solutions for Exusia's clients. Responsibilities include gathering and analyzing business requirements, documenting and resolving data issues, designing and building optimized data processing and governance solutions using Python, PySpark, and Databricks on Azure. The candidate will work with stakeholders, provide technical leadership, and contribute to project delivery. Experience with data warehousing, data governance principles, and various databases is crucial. The role requires hands-on experience with Databricks, PySpark, and Spark SQL, along with a strong understanding of data management and governance.
Must have:
  • Strong Data Warehousing/Engineering background
  • Data Management & Governance understanding
  • Experience with multiple databases (Oracle, SQL Server)
  • Azure, Databricks, Python, PySpark experience
  • Minimum 2 projects using Python and PySpark
  • Fluent in PySpark & Spark SQL
  • Delta Lake exposure
Good to have:
  • BFSI domain and Data Governance experience
  • Java & Scala exposure
  • ASG & Collibra knowledge
  • AWS, Azure, GCP experience

Job Details

Description

Sr Data Engineers & Tech Leads – Python/Pyspark/Databricks

Department:                          Sales and Delivery Team - Empower

Industry:                                 Information Technology & Services, Computer Software, Management Consulting

Location:                                 WFH/ India Remote

Experience Range:                6 - 10 years

Basic Qualification:               Bachelor of Engineering or Equivalent

Travel Requirements:           Not required

Website:                                 www.exusia.com

 

Exusia, a cutting-edge digital transformation consultancy, and is looking for top talent in Data Engineering space with specific skills in Python/Pyspark/Databricks to join our global delivery team's Industry Analytics practice in India.


What’s the Role?


Full-time job to work with Exusia's clients to design, develop and maintain large scale data engineering solutions. The right candidates will also get a chance to work across the entire data landscape including Data Governance, Metadata Management and will work closely with client stakeholders to capture the requirements, design and implement Analytical reporting, Compliance and Data Governance solutions.


Criteria for the Role!



·       Have a minimum of 6 years’ experience in Data Management, Data Engineering & Data Governance space with hands on project experience using Python, Pyspark & Databricks

·       Should have worked on large data initiatives and should have exposure to different flavours of Spark including Pyspark/Spark SQL/Scala/Java

·       Education Qualification – Bachelor of Science (preferably in Computer and Information Sciences or Business Information Technology) or an Engineering degree in the above areas  


Key Responsibilities:


·       Work with business stakeholders to gather and analyze business requirements, building a solid understanding of the Data Analytics and Data Governance domain

·       Document, discuss and resolve business, data and reporting issues within the team, across functional teams, and with business stakeholders

·       Should be able to work independently and come up with solution design

·       Build optimized data processing and data governance solutions using the given toolset 

·       Provide hands on technical leadership and work on multiple projects if required

·       Collaborate with delivery leadership to deliver projects on time adhering to the quality standards

·       Contribute to talent recruitment, competency building and providing mentor-ship to junior resources for these skills



Requirements

Mandatory Skills:

·        Must have strong Data Warehousing / Data Engineering background

·        Strong conceptual understanding of Data Management & Data Governance principles

·        Experience working with multiple databases like Oracle/SQL Server/Other DBs

·        Exposure to Microsoft Azure storage and compute services and should have hands on experience with Databricks on Azure

·        Hands-on experience using Python and Pyspark and should have completed min 2 projects

·        Hands-on experience using Databricks and should be fluent with Pyspark & Spark SQL

·        Exposure to Delta lake

 

Nice-to-Have Skills

 

·        Exposure to BFSI domain and Data Governance is a big plus

·        Exposure to Java & Scala

·        Understanding of data governance tools like ASG & Collibra is an added advantage

·        Exposure to cloud platforms like AWS, Azure & GCP


Exusia (http://www.exusia.com/) is a global technology consulting company that empowers its clients to gain a competitive edge by accelerating business outcomes and providing strategy and execution capabilities around digital, analytics and cloud solutions. The company has established its leadership position by solving some of the world's largest and most complex data engineering and analytical problems in the healthcare, financial, telecommunications, consumer products and high technology industries. 


Exusia’s mission is to transform the world through the innovative use of information. 

 

Over the past 3 years, Exusia was recognized by Inc. 5000 and by Crain’s publications as one of the fastest growing privately held companies in the world. Since the company’s founding in 2012, Exusia has experienced an impressive seven years of revenue growth and has expanded its operations in the Americas, Asia and Africa. Exusia has recently also been recognized by publications such as the CIO Review, Industry Era, Insight Success and the CIO Bulletin for the company’s innovation in IT Services, the Telecommunications and Healthcare industries and it's entrepreneurship. The company is headquartered in Miami, Florida, United States with development centers in India. 


Interested applicants should apply by forwarding their CV to: elevate@exusia.com 

Similar Jobs

The Walt Disney Company - Lead Software Engineer, Machine Learning - Ad Platforms

The Walt Disney Company

Seattle, Washington, United States (On-Site)
6 Months ago
Tamatem Games - Software Engineer

Tamatem Games

Amman, Amman Governorate, Jordan (On-Site)
1 Month ago
Playrix - Senior Engineering Manager

Playrix

Georgia (Remote)
7 Months ago
Match Group - 機械学習エンジニア(Machine Learning Engineer)

Match Group

Tokyo, Japan (Hybrid)
7 Months ago
ByteDance - Software Engineer, SRE - Platform Services

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
DMarket - Analytics Engineer (Looker)

DMarket

Kyiv, Kyiv City, Ukraine (On-Site)
2 Months ago
Trek - Marketing Data Analyst

Trek

Haryana, India (On-Site)
3 Months ago
Salesforce - Solution Architect - Tableau

Salesforce

Tokyo, Japan (Remote)
2 Months ago
InvenioLSI - SAP Analytics SEM

InvenioLSI

New Delhi, Delhi, India (On-Site)
5 Months ago
ByteDance - Data Analyst - Corporate Information System

ByteDance

Singapore (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer III, Data Infrastructure, Chrome OS

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Month ago
PwC - ETIC, OutSystems Architect-Senior Associate

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
7 Months ago
Netflix - Full-Stack Engineer (L5)

Netflix

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Months ago
Google - Software Engineering Manager, Core Data Query

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Nagarro - Senior Staff Engineer, QA Automation

Nagarro

Mexico (Remote)
7 Months ago
Google - Advertising Solutions Architect

Google

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
1 Month ago
Next Level Business Services - Technical Lead – Java

Next Level Business Services

Jersey City, New Jersey, United States (On-Site)
7 Months ago
DEVOTEAM - Data engineer -Apache NIFI

DEVOTEAM

Casablanca, Casablanca-Settat, Morocco (Remote)
7 Months ago
Google - Senior Staff Software Engineer, Full Stack, Google Ads

Google

Mountain View, California, United States (On-Site)
1 Month ago
Google - Senior Partner Engineer, Device Platform Operations, YouTube

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Hyderabad, Telangana, India

CleverTap - Senior Backend Engineer - Platform

CleverTap

Mumbai, Maharashtra, India (Hybrid)
7 Months ago
Trustana - Senior Data Engineer

Trustana

Gurugram, Haryana, India (Hybrid)
7 Months ago
Trek - IT Procurement Analyst - Level I

Trek

Haryana, India (On-Site)
3 Months ago
Openhouse - Category Associate- Robotics

Openhouse

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Quizizz - Account Executive

Quizizz

Bengaluru, Karnataka, India (On-Site)
2 Months ago
PwC - Senior Manager

PwC

Hyderabad, Telangana, India (On-Site)
7 Months ago
Sporty Group - Creative Designer

Sporty Group

India (Remote)
4 Months ago
ByteDance - Human Resources Apprenticeship Program, ByteDance – Trust & Safety India - 2025 Start

ByteDance

Gurugram, Haryana, India (On-Site)
2 Months ago
Assystems - Ecology & Biodiversity (EB) Expert

Assystems

Hyderabad, Telangana, India (On-Site)
6 Months ago
PwC - Senior Associate _SAP BTP Engineering _Advisory corporate _ Advisory_ Bengaluru

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Starbreeze Studios - Data Analyst

Starbreeze Studios

Stockholm, Stockholm County, Sweden (Hybrid)
1 Month ago
Zeta - Lead - Business Intelligence Engineer

Zeta

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Netflix - Technical Program Manager, PDP Ops (Data Analyst)

Netflix

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Wildlife Studios - IT Cloud Planning Analyst

Wildlife Studios

São Paulo, State Of São Paulo, Brazil (On-Site)
5 Months ago
Gameforge - Customer Support Representative - German

Gameforge

Karlsruhe, Baden-Württemberg, Germany (Hybrid)
5 Months ago
The Walt Disney Company - Senior Manager, Data Analytics, DTC ANZ

The Walt Disney Company

Richmond, Victoria, Australia (On-Site)
1 Month ago
Lifelancer - Senior Data Scientist

Lifelancer

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Playrix - Data QA Engineer

Playrix

Montenegro (Remote)
7 Months ago
Gaming Innovation Group  - Big Data Engineer

Gaming Innovation Group

Manchester, England, United Kingdom (Hybrid)
1 Month ago
PwC - Senior Associate

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Exusia (ex-OO-see-ah), A Globant Division has the mission of transforming the world through the innovative use of information. Exusia is an ISO 27001 certified technology solutions company that empowers its clients to gain a competitive edge by accelerating business objectives and providing solutions in artificial intelligence, cloud computing, data engineering and digital transformation. Exusia is a leader in end-to-end data strategy, execution and managed services offerings, leveraging its team of business strategy, analytics and data engineering experts along with cutting edge hosted software as a service accelerators to deliver to clients. Exusia was founded in 2012 and now provides services in IT Strategy, AI Enablement, Data Governance, Data Engineering, Cloud Migration and Mainframe Modernization to the Globant client base as apart of the Data & Artificial Intelligence Studio.

Get notified when new jobs are added by EXUSIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug