Azure Databricks / Python / PySpark Senior Data Engineer (Developer)

2 Months ago • 6-10 Years • Data Analyst

Job Summary

Job Description

This role involves designing, developing, and maintaining large-scale data engineering solutions for Exusia's clients. Responsibilities include working with stakeholders to gather requirements, designing analytical reporting and data governance solutions, building optimized data processing solutions using Python, PySpark, and Databricks, providing technical leadership, and collaborating on project delivery. The ideal candidate will have strong data warehousing and data governance experience, proficiency in Python and PySpark, and experience with Databricks on Azure. The position requires working across the entire data landscape, including data governance and metadata management.
Must have:
  • Strong Data Warehousing/Engineering background
  • Python, PySpark, Databricks experience (min 2 projects)
  • Data Governance principles understanding
  • Experience with multiple databases (Oracle/SQL Server)
  • Azure storage & compute services experience
Good to have:
  • BFSI domain and Data Governance experience
  • Java & Scala exposure
  • ASG & Collibra knowledge
  • AWS, Azure, GCP experience

Job Details

Description

Sr Data Engineers & Tech Leads – Python/Pyspark/Databricks

Department:                          Sales and Delivery Team - Empower

Industry:                                 Information Technology & Services, Computer Software, Management Consulting

Location:                                 WFH/ India Remote

Experience Range:                6 - 10 years

Basic Qualification:               Bachelor of Engineering or Equivalent

Travel Requirements:           Not required

Website:                                 www.exusia.com

 

Exusia, a cutting-edge digital transformation consultancy, and is looking for top talent in Data Engineering space with specific skills in Python/Pyspark/Databricks to join our global delivery team's Industry Analytics practice in India.


What’s the Role?


Full-time job to work with Exusia's clients to design, develop and maintain large scale data engineering solutions. The right candidates will also get a chance to work across the entire data landscape including Data Governance, Metadata Management and will work closely with client stakeholders to capture the requirements, design and implement Analytical reporting, Compliance and Data Governance solutions.


Criteria for the Role!



·       Have a minimum of 6 years’ experience in Data Management, Data Engineering & Data Governance space with hands on project experience using Python, Pyspark & Databricks

·       Should have worked on large data initiatives and should have exposure to different flavours of Spark including Pyspark/Spark SQL/Scala/Java

·       Education Qualification – Bachelor of Science (preferably in Computer and Information Sciences or Business Information Technology) or an Engineering degree in the above areas  


Key Responsibilities:


·       Work with business stakeholders to gather and analyze business requirements, building a solid understanding of the Data Analytics and Data Governance domain

·       Document, discuss and resolve business, data and reporting issues within the team, across functional teams, and with business stakeholders

·       Should be able to work independently and come up with solution design

·       Build optimized data processing and data governance solutions using the given toolset 

·       Provide hands on technical leadership and work on multiple projects if required

·       Collaborate with delivery leadership to deliver projects on time adhering to the quality standards

·       Contribute to talent recruitment, competency building and providing mentor-ship to junior resources for these skills



Requirements

Mandatory Skills:

·        Must have strong Data Warehousing / Data Engineering background

·        Strong conceptual understanding of Data Management & Data Governance principles

·        Experience working with multiple databases like Oracle/SQL Server/Other DBs

·        Exposure to Microsoft Azure storage and compute services and should have hands on experience with Databricks on Azure

·        Hands-on experience using Python and Pyspark and should have completed min 2 projects

·        Hands-on experience using Databricks and should be fluent with Pyspark & Spark SQL

·        Exposure to Delta lake

 

Nice-to-Have Skills

 

·        Exposure to BFSI domain and Data Governance is a big plus

·        Exposure to Java & Scala

·        Understanding of data governance tools like ASG & Collibra is an added advantage

·        Exposure to cloud platforms like AWS, Azure & GCP


Exusia (http://www.exusia.com/) is a global technology consulting company that empowers its clients to gain a competitive edge by accelerating business outcomes and providing strategy and execution capabilities around digital, analytics and cloud solutions. The company has established its leadership position by solving some of the world's largest and most complex data engineering and analytical problems in the healthcare, financial, telecommunications, consumer products and high technology industries. 


Exusia’s mission is to transform the world through the innovative use of information. 

 

Over the past 3 years, Exusia was recognized by Inc. 5000 and by Crain’s publications as one of the fastest growing privately held companies in the world. Since the company’s founding in 2012, Exusia has experienced an impressive seven years of revenue growth and has expanded its operations in the Americas, Asia and Africa. Exusia has recently also been recognized by publications such as the CIO Review, Industry Era, Insight Success and the CIO Bulletin for the company’s innovation in IT Services, the Telecommunications and Healthcare industries and it's entrepreneurship. The company is headquartered in Miami, Florida, United States with development centers in India. 


Interested applicants should apply by forwarding their CV to: elevate@exusia.com 

Similar Jobs

NVIDIA - Senior SRE Software Engineer, Storage and Data

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
PwC - Consultant junior SAP Architecture – Cloud - BTP | CDI | H/F

PwC

Neuilly-sur-Seine, Île-de-France, France (On-Site)
5 Months ago
ByteDance - Test Development Engineer - Global Payment - San Jose

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
Crunchyroll - Senior Engineering Manager, Membership

Crunchyroll

San Francisco, California, United States (Hybrid)
4 Months ago
Zazz - Java Developer

Zazz

(Remote)
1 Month ago
Ubisoft - Financial Analyst Assistant - Internship

Ubisoft

Paris, Île-de-France, France (On-Site)
6 Days ago
Rockstar Games - Senior Data Engineer

Rockstar Games

New York, New York, United States (On-Site)
1 Month ago
ION - Freelance Financial Journalist - United States

ION

New York, New York, United States (Remote)
5 Months ago
N-iX - VP of Data Consulting

N-iX

Canada (Remote)
1 Month ago
Nagarro - Associate Staff Consultant, Business Analyst

Nagarro

India (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Sony Interactive Entertainment - Senior Mobile Software Engineer

Sony Interactive Entertainment

Tokyo, Japan (Hybrid)
2 Months ago
Push Gaming - Game Mathematician

Push Gaming

(Hybrid)
6 Days ago
ByteDance - Software Architect, Lark No-code / Low-code Platform

ByteDance

Mountain View, California, United States (On-Site)
5 Months ago
Zoox - Senior Software Engineer - High Performance Computing

Zoox

Seattle, Washington, United States (Hybrid)
5 Months ago
Nagarro - Senior Staff Engineer, Mobile Android

Nagarro

United Arab Emirates (Remote)
5 Months ago
ION - Senior Software Engineer - Full Stack

ION

Pune, Maharashtra, India (On-Site)
5 Months ago
Suki - Staff SDET

Suki

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Riot Games - Principal Software Engineer, Product Tech-Lead - Unpublished R&D Product

Riot Games

Dublin, County Dublin, Ireland (On-Site)
4 Months ago
Social Discovery Group - AQA Engineer (Java)

Social Discovery Group

Poland (Remote)
3 Months ago
Netflix - Software Engineer L4, GenAI Platform

Netflix

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Hyderabad, Telangana, India

Rudra Research and Analytics - Social Media Manager

Rudra Research and Analytics

Pune, Maharashtra, India (On-Site)
7 Months ago
PwC - IN-Manager_ Advanced Analytics & ML _D&A_Advisory_Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
5 Months ago
Google - Software Engineer III, AI/ML, Google Cloud

Google

Gurugram, Haryana, India (On-Site)
3 Months ago
Rackspace Technology - VMWare Cloud Engineer II - IN R-20497

Rackspace Technology

Gurugram, Haryana, India (Hybrid)
3 Months ago
CloudHire - Scala API Architect

CloudHire

India (Remote)
1 Week ago
PwC - IN_Associate_CA Fresher _FE_Advisory _Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
2 Months ago
DNEG - Pipeline Assistant Technical Director (Feature Animation)

DNEG

Mumbai, Maharashtra, India (On-Site)
1 Week ago
PwC - IN-Manager_ Agro forestry _ Agriculture_ Advisory_ Gurugram

PwC

Gurugram, Haryana, India (On-Site)
5 Months ago
InMobiInMobi - User Researcher

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
2 Months ago
PwC - IN-Senior Associate__SAP GRC_ITRA_Advisory_  Gurgaon/Mumbai/Bangalore

PwC

Gurugram, Haryana, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Playkot - SENIOR PRODUCT ANALYST

Playkot

(Remote)
3 Months ago
Voodoo - Senior Data Scientist - Ad network

Voodoo

Paris, Île-de-France, France (Hybrid)
1 Month ago
Aristocrat Gaming - Intern - Health, Safety, and Environmental Associate

Aristocrat Gaming

Las Vegas, Nevada, United States (On-Site)
2 Weeks ago
SmileGate - Data Analyst (Contract)

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
1 Month ago
Haptic - Lead Data Scientist and User Researcher

Haptic

Germany (On-Site)
2 Months ago
Bungie - Senior Product Security Analyst

Bungie

(Hybrid)
3 Months ago
EXUSIA - Azure Databricks / Python / PySpark Senior Data Engineer

EXUSIA

Hyderabad, Telangana, India (Remote)
5 Days ago
Equivalent Jobs - ML ENGINEER

Equivalent Jobs

(Remote)
4 Months ago
CloudHire - Data Labeler

CloudHire

Pune, Maharashtra, India (Remote)
6 Days ago
Xsolla - Data Analyst (Web)

Xsolla

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (Hybrid)
6 Days ago

Get notifed when new similar jobs are uploaded

About The Company

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

View All Jobs

Get notified when new jobs are added by EXUSIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug