Lead Data Engineers – Azure/Databricks/Snowflake

2 Months ago • 6-14 Years • Data Analyst • DevOps

Job Summary

Job Description

Lead Data Engineers will design, develop, and maintain data pipelines and ETL processes using Azure Data Factory and Azure Databricks. Responsibilities include building and optimizing data storage solutions using Azure Data Lake, Azure SQL Database, and Azure Cosmos DB. Collaboration with data scientists and stakeholders is crucial to understand data requirements and deliver solutions. The role also involves implementing data quality checks, data governance, and security best practices. This position requires extensive experience in Azure Databricks, ETL/ELT pipelines, Python development, and Snowflake or SQL. Experience with Agile methodologies and CI/CD pipelines is essential. The successful candidate will monitor, troubleshoot, and optimize data workflows for performance and scalability.
Must have:
  • 6+ years Azure Databricks experience
  • ETL/ELT pipeline design & implementation
  • Azure services expertise (ADLS, ADF, DevOps)
  • Python development (library creation)
  • Snowflake/SQL experience
  • Data processing system design & maintenance
  • Agile methodology knowledge
Good to have:
  • Azure AKS, Cosmos DB experience
  • Cloud streaming techniques (GCP, Snowpipe)
  • API development and React JS integration
  • AI/ML experience
  • Strong DWH and ETL basics
  • Cloud storage and compute knowledge

Job Details

Description

Lead Data Engineers – Azure/ Databricks/ Snowflake

Department:                          Sales and Delivery Team - Empower

Industry:                                 Information Technology & Services, Computer Software, Management Consulting

Location:                                 US Remote (US citizens, Candidates based in US with Valid Visa will be preferred)

Experience Range:                6 - 14 years

Basic Qualification:               Bachelor of Engineering or Equivalent

Travel Requirements:           Not required

Website:                                 www.exusia.com

 

 

Exusia, a cutting-edge digital transformation consultancy, and is looking for top Talent in Azure, Databricks Snowflake Data Warehouse Application Developers to join our global delivery team's Industry Analytics practice in India.


What’s the Role?

Full-time job to work with Exusia's clients to design and develop the system components for the extract and transform or conversion of data from various source systems to the target applications; Create data structures or data models that support data across all stages of the extract, transform and load process. Should have good hands on experience in implementing the parallel and sequence jobs using Snowflake and or or Azure or Databricks or Spark or Scala. Analyzing, developing, monitoring and administration of the ETL process using any tool. Experience working with on-shore/off-shore delivery model is a big plus.


The Lead Data Engineer will implement monitoring solutions, optimize ETL jobs for performance, and provide comprehensive support from data ingestion to final output. With in-depth knowledge of the Databricks platform and strong analytical skills, this position will significantly enhance the department's ability to deliver high quality, data-driven insights and solutions.


Criteria for the Role!


Have a minimum of 6+ years’ experience working as a Azure Databricks Developer in to a data analytics domain 

 

Azure Databricks Specific

•   4+ years of experience in Azure services and in Databricks (ADLS, ADF, DevOps, etc.)

•   10+ years of experience in designing and implementing ETL/ELT pipelines using ADF, integrating with other Azure services.

•   7+ years of Python development experience. Should have capability of developing own libraries

•   4+ years of experience in Snowflake or SQL experience (No-SQL experience is a plus)

•   Experience designing, building, and maintaining data processing systems

•   Experience with or knowledge of Agile Software Development methodologies

•   Education Qualification – Bachelor of Science (preferably in Computer and Information Sciences or Business Information Technology) or an Engineering degree in the above areas


Responsibilities:

·    Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory, Azure Databricks

·    Build and optimize data storage solutions using Azure Data Lake, Azure SQL Database, and Azure Cosmos DB or Vector DB

 ·    Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.

·    Implement data quality checks, data governance, and security best practices across data platforms.

·    Monitor, troubleshoot, and optimize data workflows for performance and scalability.

·    Automate data integration and transformation processes using Azure DevOps and CI/CD pipelines.

·    Stay up-to-date with emerging Azure technologies and data engineering trends.

·    Deep understanding of data management, data governance, cloud and AI technologies, and their application in a business context.

·    Excellent problem solving and troubleshooting skills

•   Excellent oral and written communication skills

·    Strong analytical and problem-solving skills

·    Data experience working with multiple, large datasets / big data

·    Demonstrated experience in effectively working with multiple projects and activities in a timely, organized manner

·    Demonstrated experience in organizing and prioritizing work, meeting deadlines and working independently as well as collaboratively with others

·    Experience with Excel and PowerPoint.


Requirements

Nice – to – have Skills:

·       2+ years of experience with Azure stack example Azure Kubernetes Service (AKS), Cosmos DB

·       Understanding on cloud streaming technique GCP, Snowpipe

·       Experience in designing API development and integrating with React JS within cloud platform

·       Leverage modern technologies, such as AI and ML

·       Must have strong DWH and ETL basics

·       Should have basic loud knowledge - Storage and Compute

·       Work with business stakeholders to gather and analyze business requirements, building a solid understanding of the Data Analytics domain

·       Document, discuss and resolve business, data and reporting issues within the team, across functional teams, and with business stakeholders

·       Support all phases of the software development lifecycle (SDLC)

·       Present written and verbal data analysis findings, to both the project team and business stakeholders

·       Manage changing priorities and work on multiple projects concurrently

·       Be self-motivated and proactive in a fast-paced environment and flexible to work


 

About Exusia


Exusia (http://exusia.com/) is a global technology consulting company that empowers its clients to gain a competitive edge by accelerating business objectives and providing strategy and solutions in data management and analytics. The company has established its leadership position by solving some of the world's largest and most complex data problems in the financial, healthcare, telecommunications and high technology industries.

 

Exusia’s mission is to transform the world through the innovative use of information.

 

Exusia was recognized by Inc. 5000 and by Crain’s publications as one of the fastest growing privately held companies in the world. Since the company’s founding in 2012, Exusia has experienced an impressive seven years of revenue growth and has expanded its operations in the Americas, Asia, Africa and UK. Exusia has recently also been recognized by publications such as the CIO Review, Industry Era, Insight Success and the CIO Bulletin for the company’s innovation in IT Services, the Telecommunications and Healthcare industries and its entrepreneurship. The company is headquartered in Miami city of Florida, United States with development centers in Pune, Hyderabad, Bengaluru and Gurugram, India.

 

Interested applicants should apply by forwarding their CV to: elevate@exusia.com


Similar Jobs

PwC - IN_Senior Associate_ Dot Net Developer Engineer_D&A_Advisory_Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Rush Street Interactive - Full-Stack Automation Engineer

Rush Street Interactive

Serbia (On-Site)
2 Months ago
N-iX - Middle .NET Fullstack Engineer

N-iX

Poland (Hybrid)
1 Month ago
Ajmera Infotech - Senior Azure DevOps Engineer (IaaS)

Ajmera Infotech

Ahmedabad, Gujarat, India (On-Site)
1 Week ago
NinjaVan - Senior Full Stack Engineer

NinjaVan

Hyderabad, Telangana, India (On-Site)
5 Months ago
ByteDance - LLM Global Data - LLM Coding Trainer Intern - 2025 Start

ByteDance

Singapore (On-Site)
2 Months ago
CloudHire - Database Solution Architect

CloudHire

India (Remote)
1 Week ago
prizepicks - Senior Quantitative UX Researcher

prizepicks

Atlanta, Georgia, United States (Remote)
1 Week ago
Netflix - Senior Data Engineer, Commerce Insights and Data Products Engineering

Netflix

Mexico City, Mexico City, Mexico (On-Site)
1 Month ago
PLAYSTUDIOS - Marketing Data Analyst

PLAYSTUDIOS

Tel Aviv District, Israel (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Gaming Innovation Group  - DevOps Engineer

Gaming Innovation Group

Community Of Madrid, Spain (Hybrid)
5 Days ago
Hashone Careers - Cloud Engineer

Hashone Careers

Gurugram, Haryana, India (Remote)
4 Months ago
PwC - Manager in Document Automation - Implementation and IT delivery

PwC

Prague, Prague, Czechia (On-Site)
5 Months ago
N-iX - Senior Data Engineer

N-iX

Ukraine (Remote)
2 Months ago
PwC - D365 Manufacturing/Production

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
CrazyLabs - Generative AI Specialist

CrazyLabs

Tel Aviv District, Israel (On-Site)
1 Month ago
Illuvium - Senior C# Engineer

Illuvium

Copenhagen, Denmark (Remote)
6 Months ago
Brillio - .NET Azure Architect - R01525011

Brillio

Pune, Maharashtra, India (Hybrid)
5 Months ago
ARHS - Application Engineer/Administrator

ARHS

The Hague, South Holland, Netherlands (On-Site)
5 Months ago
Everyday Health Group - Senior Software Engineer, Backend - Lose It!

Everyday Health Group

United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United States

Interactive Brokers - Senior Internal Auditor

Interactive Brokers

Greenwich, Connecticut, United States (On-Site)
5 Months ago
Zoox - Systems Engineer - Functional Safety

Zoox

Foster City, California, United States (Hybrid)
5 Months ago
Tencent - Senior Strategic Sales Executive

Tencent

Los Angeles, California, United States (On-Site)
2 Months ago
undefined - Mid-Market Account Executive, East

United States (Remote)
5 Months ago
Survios - Gameplay Animator

Survios

California, United States (Remote)
2 Months ago
Sphere Entertainment Co - Custodian - Overnight (Part-Time)

Sphere Entertainment Co

Las Vegas, Nevada, United States (On-Site)
1 Week ago
Meta - Software Engineer, Intern/Co-op

Meta

New York, New York, United States (On-Site)
4 Months ago
Electronic Arts - Technical Director - Dynamic Experiences

Electronic Arts

Redwood City, California, United States (On-Site)
3 Weeks ago
ByteDance - Senior Software Engineer - Virtualization

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
Crunchyroll - Staff Software Engineer, Account Services

Crunchyroll

San Francisco, California, United States (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Ubisoft - Data Analyst, Marketing Analytics

Ubisoft

San Francisco, California, United States (On-Site)
14 Hours ago
NVIDIA - Senior C++ Software Engineer - Apache Spark Solution

NVIDIA

Beijing, Beijing, China (On-Site)
1 Month ago
Hutch - Business Analyst

Hutch

England, United Kingdom (Hybrid)
1 Week ago
Ubisoft - Legal Counsel Data Protection Assistant - Internship

Ubisoft

Paris, Île-de-France, France (On-Site)
5 Days ago
THE GAME - Data & Insights Analyst

THE GAME

London, England, United Kingdom (Hybrid)
5 Days ago
Playtika - Expert Business Analyst

Playtika

Israel (On-Site)
1 Week ago
Carry1st - Senior Games Analyst - RMG

Carry1st

(Remote)
1 Week ago
PwC - Senior Associate

PwC

Gurugram, Haryana, India (On-Site)
5 Months ago
Attentive - Senior Data Scientist/Applied Scientist, AI Products

Attentive

San Francisco, California, United States (Hybrid)
5 Months ago
CloudHire - Power BI Expert

CloudHire

Telangana, India (Remote)
6 Days ago

Get notifed when new similar jobs are uploaded

About The Company

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

Hyderabad, Telangana, India (Remote)

View All Jobs

Get notified when new jobs are added by EXUSIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug