Senior Data Engineer – Azure

1 Month ago • 3-7 Years • Data Analysis

Job Summary

Job Description

This is a hands-on data platform engineering role that emphasizes consultative data engineering engagements with various customer stakeholders, including business owners, analytics teams, and development teams. Responsibilities include designing and building resilient data pipelines for batch and real-time streaming, architecting cloud data infrastructure using Infrastructure-as-Code, and collaborating with product managers, software engineers, and data scientists to build scalable data-driven platforms. The role also involves providing technical product expertise, advising on deployment architectures, and handling in-depth technical questions related to data infrastructure and design patterns. Collaboration with enterprise and data architects, ETL developers, and information designers is crucial for defining data structures, pipelines, and workload orchestration. Key areas to address include data privacy, security, ingestion, processing, storage, consumption, modeling, and AI enablement. The engineer will lead a team to deliver impactful results, execute projects using an Agile mindset, and build software frameworks for large-scale data problems.
Must have:
  • 7+ years data engineering experience
  • 3+ years architecting data pipelines
  • Extensive Azure data services experience
  • Strong SQL and Python/Spark skills
  • Strong Data Modeling
  • Agile development experience
Good to have:
  • Databricks, Snowflake, or Synapse experience
  • DBT and PowerBI experience
  • Knowledge of Git, Jenkins, TFS

Job Details

Senior Data Engineer – Azure  
 
This is a hands on data platform engineering role that places significant emphasis on consultative data engineering engagements with a wide range of customer stakeholders; Business Owners, Business Analytics, Data Engineering teams, Application Development, End Users and Management teams. 
  

You Will:

  • Design and build resilient and efficient data pipelines for batch and real-time streaming 
  • Architect and design data infrastructure on cloud using Infrastructure-as-Code tools.  
  • Collaborate with product managers, software engineers, data analysts, and data scientists to build scalable and data-driven platforms and tools. 
  • Provide technical product expertise, advise on deployment architectures, and handle in-depth technical questions around data infrastructure, PaaS services, design patterns and implementation approaches.  
  • Collaborate with enterprise architects, data architects, ETL developers & engineers, data scientists, and information designers to lead the identification and definition of required data structures, formats, pipelines, metadata, and workload orchestration capabilities  
  • Address aspects such as data privacy & security, data ingestion & processing, data storage & compute, analytical & operational consumption, data modeling, data virtualization, self-service data preparation & analytics, AI enablement, and API integrations. 
  • Lead a team of engineers to deliver impactful results at scale. 
  • Execute projects with an Agile mindset. 
  • Build software frameworks to solve data problems at scale. 

Technical Requirements:

  • 7+ years of data engineering experience leading implementations of large-scale lakehouses on Databricks, Snowflake, or Synapse. Prior experience using DBT and PowerBI will be a plus.  
  • 3+ years' experience architecting solutions for developing data pipelines from structured, unstructured sources for batch and realtime workloads.  
  • Extensive experience with Azure data services (Databricks, Synapse, ADF) and related azure infrastructure services like firewall, storage, key vault etc. is required.  
  • Strong programming / scripting experience using SQL and python and Spark. 
  • Strong Data Modeling, Data lakehouse concepts.  
  • Knowledge of software configuration management environments and tools such as JIRA, Git, Jenkins, TFS, Shell, PowerShell, Bitbucket. 
  • Experience with Agile development methods in data-oriented projects 

Other Requirements:

  • Highly motivated self-starter and team player and demonstrated success in prior roles. 
  • Track record of success working through technical challenges within enterprise organizations 
  • Ability to prioritize deals, training, and initiatives through highly effective time management 
  • Excellent problem solving, analytical, presentation, and whiteboarding skills 
  • Track record of success dealing with ambiguity (internal and external) and working collaboratively with other departments and organizations to solve challenging problems 
  • Strong knowledge of technology and industry trends that affect data analytics decisions for enterprise organizations 
  • Certifications on Azure Data Engineering and related technologies.

Similar Jobs

Rippling - PEO Operations Analyst

Rippling

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Leapwork - Event Marketing Manager - EMEA / Global

Leapwork

London, England, United Kingdom (On-Site)
3 Days ago
Capgemini - SAP SuccessFactors Employee Central - Manager

Capgemini

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Ansys - Technical Support Engineer II

Ansys

Tokyo, Japan (On-Site)
1 Month ago
Starkflow - Principal Full Stack Developer

Starkflow

Karnataka, India (Hybrid)
4 Months ago
Haleon - Senior Data Scientist

Haleon

England, United Kingdom (On-Site)
2 Weeks ago
onwards Search - Senior Data Analyst, Marketing

onwards Search

Memphis, Tennessee, United States (Remote)
4 Days ago
luxsoft - Data Architect

luxsoft

Milton Keynes, England, United Kingdom (On-Site)
1 Month ago
Tide - Senior Data Analytics Engineer - Marketing

Tide

Belgrade, Serbia (Remote)
1 Month ago
ARHS - Mid IT Business Analyst (EU Projects)

ARHS

Athens, Greece (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Zones - QA Engineer, Insights & Analytics

Zones

Islamabad, Islamabad Capital Territory, Pakistan (On-Site)
1 Month ago
Square - Program Specialist II

Square

Mississauga, Ontario, Canada (On-Site)
1 Day ago
Playtika - Human Resources Partner - Temporary

Playtika

United States (On-Site)
1 Week ago
Internet Brands - Dealer Relations Account Manager

Internet Brands

El Segundo, California, United States (On-Site)
3 Months ago
Spyke Games - Customer Support Specialist (Disabled)

Spyke Games

İstanbul, Türkiye (On-Site)
8 Months ago
Apple - Executive Administrative Assistant

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Morning Star - Infrastructure Engineer

Morning Star

Mumbai, Maharashtra, India (Hybrid)
1 Year ago
Enphase Energy - Field Service Technician

Enphase Energy

South Carolina, United States (On-Site)
1 Week ago
Sawhorse Productions - Executive Assistant

Sawhorse Productions

Los Angeles, California, United States (On-Site)
1 Week ago
160over90 - Account Director - Partnerships

160over90

New York, New York, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Gurugram, Haryana, India

Sabre India - Manager Sales & Account Management

Sabre India

New Delhi, Delhi, India (On-Site)
1 Month ago
Accenture - Customer Service Analyst

Accenture

Gurugram, India (On-Site)
2 Weeks ago
luxsoft - Senior/Lead QA Automation Engineer

luxsoft

Indore, Madhya Pradesh, India (On-Site)
1 Month ago
Grab - Engineering Manager II, Backend

Grab

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Liquid Asia - Executive- Brand Management

Liquid Asia

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Arrise Solutions (India)   - Senior Data Scientist (Remote)

Arrise Solutions (India)

Hyderabad, Telangana, India (Remote)
9 Months ago
Sabre India - Software Engineer IV

Sabre India

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Capgemini - Automation Architect

Capgemini

Chennai, Tamil Nadu, India (On-Site)
1 Month ago
zeta - Payroll Lead

zeta

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
KPIT - CTO_ML/DL Data scientist

KPIT

Pune, Maharashtra, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

C3 IoT - Data Scientist (Federal)

C3 IoT

Tysons, Virginia, United States (On-Site)
1 Week ago
Trek - Marketing Data Analyst

Trek

Haryana, India (On-Site)
5 Months ago
Gallagher - Data Scientist

Gallagher

Bengaluru, Karnataka, India (On-Site)
8 Months ago
PwC - Manager / Senior Manager - Cloud, Data & AI (CD&AI) – Platform Architect

PwC

Zürich, Zurich, Switzerland (On-Site)
1 Month ago
Head Digital Works - Data Scientist

Head Digital Works

Hyderabad, Telangana, India (On-Site)
11 Months ago
Publicis Groupe - Senior Data Engineer

Publicis Groupe

London, England, United Kingdom (Hybrid)
1 Day ago
Apple - Data Engineer, PART DataOps

Apple

Cupertino, California, United States (On-Site)
2 Weeks ago
Apple - Machine Learning Engineer, Ai & Data Platform

Apple

Sunnyvale, California, United States (On-Site)
1 Month ago
Ion - Data Engineer

Ion

Budapest, Hungary (On-Site)
9 Months ago
MiQ - Lead Data Scientist

MiQ

Bengaluru, Karnataka, India (Hybrid)
22 Hours ago

Get notifed when new similar jobs are uploaded

About The Company

Gurugram, Haryana, India (Hybrid)

Columbus, Ohio, United States (Remote)

San Antonio, Texas, United States (Hybrid)

Gurugram, Haryana, India (Hybrid)

Giza, Giza Governorate, Egypt (Hybrid)

Riyadh, Riyadh Province, Saudi Arabia (On-Site)

Toronto, Ontario, Canada (Remote)

Giza, Giza Governorate, Egypt (Hybrid)

Gurugram, Haryana, India (Remote)

View All Jobs

Get notified when new jobs are added by Rackspace Technology

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug