Senior Data Engineer – Azure

2 Months ago • 3-7 Years • Data Analysis

Job Summary

Job Description

This is a hands-on data platform engineering role that emphasizes consultative data engineering engagements with various customer stakeholders, including business owners, analytics teams, and development teams. Responsibilities include designing and building resilient data pipelines for batch and real-time streaming, architecting cloud data infrastructure using Infrastructure-as-Code, and collaborating with product managers, software engineers, and data scientists to build scalable data-driven platforms. The role also involves providing technical product expertise, advising on deployment architectures, and handling in-depth technical questions related to data infrastructure and design patterns. Collaboration with enterprise and data architects, ETL developers, and information designers is crucial for defining data structures, pipelines, and workload orchestration. Key areas to address include data privacy, security, ingestion, processing, storage, consumption, modeling, and AI enablement. The engineer will lead a team to deliver impactful results, execute projects using an Agile mindset, and build software frameworks for large-scale data problems.
Must have:
  • 7+ years data engineering experience
  • 3+ years architecting data pipelines
  • Extensive Azure data services experience
  • Strong SQL and Python/Spark skills
  • Strong Data Modeling
  • Agile development experience
Good to have:
  • Databricks, Snowflake, or Synapse experience
  • DBT and PowerBI experience
  • Knowledge of Git, Jenkins, TFS

Job Details

Senior Data Engineer – Azure  
 
This is a hands on data platform engineering role that places significant emphasis on consultative data engineering engagements with a wide range of customer stakeholders; Business Owners, Business Analytics, Data Engineering teams, Application Development, End Users and Management teams. 
  

You Will:

  • Design and build resilient and efficient data pipelines for batch and real-time streaming 
  • Architect and design data infrastructure on cloud using Infrastructure-as-Code tools.  
  • Collaborate with product managers, software engineers, data analysts, and data scientists to build scalable and data-driven platforms and tools. 
  • Provide technical product expertise, advise on deployment architectures, and handle in-depth technical questions around data infrastructure, PaaS services, design patterns and implementation approaches.  
  • Collaborate with enterprise architects, data architects, ETL developers & engineers, data scientists, and information designers to lead the identification and definition of required data structures, formats, pipelines, metadata, and workload orchestration capabilities  
  • Address aspects such as data privacy & security, data ingestion & processing, data storage & compute, analytical & operational consumption, data modeling, data virtualization, self-service data preparation & analytics, AI enablement, and API integrations. 
  • Lead a team of engineers to deliver impactful results at scale. 
  • Execute projects with an Agile mindset. 
  • Build software frameworks to solve data problems at scale. 

Technical Requirements:

  • 7+ years of data engineering experience leading implementations of large-scale lakehouses on Databricks, Snowflake, or Synapse. Prior experience using DBT and PowerBI will be a plus.  
  • 3+ years' experience architecting solutions for developing data pipelines from structured, unstructured sources for batch and realtime workloads.  
  • Extensive experience with Azure data services (Databricks, Synapse, ADF) and related azure infrastructure services like firewall, storage, key vault etc. is required.  
  • Strong programming / scripting experience using SQL and python and Spark. 
  • Strong Data Modeling, Data lakehouse concepts.  
  • Knowledge of software configuration management environments and tools such as JIRA, Git, Jenkins, TFS, Shell, PowerShell, Bitbucket. 
  • Experience with Agile development methods in data-oriented projects 

Other Requirements:

  • Highly motivated self-starter and team player and demonstrated success in prior roles. 
  • Track record of success working through technical challenges within enterprise organizations 
  • Ability to prioritize deals, training, and initiatives through highly effective time management 
  • Excellent problem solving, analytical, presentation, and whiteboarding skills 
  • Track record of success dealing with ambiguity (internal and external) and working collaboratively with other departments and organizations to solve challenging problems 
  • Strong knowledge of technology and industry trends that affect data analytics decisions for enterprise organizations 
  • Certifications on Azure Data Engineering and related technologies.

Similar Jobs

Xsolla - Senior Product Manager - Xsolla Advertising & Rewards

Xsolla

Los Angeles, California, United States (Remote)
3 Weeks ago
Ciklum - Senior Data Scientist

Ciklum

Pune, Maharashtra, India (Hybrid)
10 Months ago
Fugo Games - Marketing Operations Specialist

Fugo Games

Istanbul, İstanbul, Türkiye (On-Site)
2 Months ago
Plug power - Field Service Technician

Plug power

Olney, Illinois, United States (On-Site)
1 Year ago
Hawkeye Innovations - Match Day Technician

Hawkeye Innovations

Tripoli, Greece (On-Site)
2 Months ago
Apple - Data Scientist, AppleCare Business Insights

Apple

Sunnyvale, California, United States (On-Site)
1 Month ago
Cognite - Senior Data Engineer

Cognite

Pau, Nouvelle-Aquitaine, France (Remote)
11 Months ago
Lambda - Data Center Operations Engineer

Lambda

Salt Lake City, Utah, United States (On-Site)
1 Month ago
Mapbox - Software Data Engineer II, Basemap

Mapbox

Finland (Hybrid)
3 Months ago
GOAT Group - Staff Data Scientist

GOAT Group

United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Interactive Brokers - Bilingual Client Technical Support

Interactive Brokers

Chicago, Illinois, United States (Hybrid)
3 Months ago
Scopely - Principal Animator - Unannounced Project

Scopely

Barcelona, Catalonia, Spain (Hybrid)
6 Months ago
Shield AI - Director, Direct Commercial Sales (DCS) Program Management (R3625)

Shield AI

Dallas, Texas, United States (On-Site)
3 Weeks ago
Postman - Senior Field Marketing Manager

Postman

San Francisco, California, United States (Hybrid)
2 Months ago
Interactive Brokers - Senior Java Developer

Interactive Brokers

Budapest, Hungary (Hybrid)
10 Months ago
Diligent Corporation - Advisory Specialist II

Diligent Corporation

Sydney, New South Wales, Australia (Hybrid)
4 Weeks ago
SEGA - Senior Audio QA Technician

SEGA

Sofia, Sofia City Province, Bulgaria (On-Site)
3 Months ago
Hawkeye Innovations - VAR Replay Operator

Hawkeye Innovations

Vienna, Vienna, Austria (Hybrid)
4 Months ago
Kgroup - Marketing Manager

Kgroup

Thành Phố Hồ Chí Minh, Vietnam (On-Site)
1 Year ago
WebFX - Web Project Coordinator Internship

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
10 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Gurugram, Haryana, India

Britive - Technical Program Manager

Britive

Bengaluru, Karnataka, India (Remote)
9 Months ago
Ruselle Investments - Operations Technology Analyst

Ruselle Investments

Mumbai, Maharashtra, India (On-Site)
1 Year ago
Interactive Brokers - New Accounts Associate - Application Support Group

Interactive Brokers

Mumbai, Maharashtra, India (Hybrid)
1 Month ago
entrata - DevOps Engineer

entrata

Pune, Maharashtra, India (Hybrid)
4 Months ago
Interactive Brokers - Quality Assurance Engineer (Manual Testing)

Interactive Brokers

Mumbai, Maharashtra, India (Hybrid)
3 Months ago
Clearwater Analytics - Core Data Product Analyst

Clearwater Analytics

Noida, Uttar Pradesh, India (On-Site)
3 Weeks ago
Saviynt - Senior Engineer - Java

Saviynt

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
zeta - Sr. Program Manager

zeta

Hyderabad, Telangana, India (On-Site)
3 Weeks ago
Accenture - Record to Report Ops Associate

Accenture

Jaipur, Rajasthan, India (On-Site)
3 Months ago
OG Healthcare - Software Test Engineer

OG Healthcare

Bengaluru, Karnataka, India (On-Site)
10 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Veeam Software - Principal Software Engineer, Data

Veeam Software

Connecticut, United States (Remote)
3 Months ago
CRB workforce  - Senior Business Analyst

CRB workforce

El Segundo, California, United States (Remote)
3 Months ago
luxsoft - Data Engineer

luxsoft

Toronto, Ontario, Canada (On-Site)
1 Month ago
Scopely - Senior Data Analyst, Marketing Analytics

Scopely

Mexico City, Mexico (Hybrid)
3 Months ago
London stock Exchange - Senior Data Engineer

London stock Exchange

London, England, United Kingdom (On-Site)
1 Month ago
Ambient.ai - Staff Software Engineer - Data Platform

Ambient.ai

Redwood City, California, United States (Hybrid)
9 Months ago
miniclip - Senior Data Analyst

miniclip

London, England, United Kingdom (On-Site)
3 Months ago
Apple - Mechanical Critical Facilities Engineer, Data Center

Apple

Sparks, Nevada, United States (On-Site)
3 Months ago
Ion - Internship - Data Science

Ion

Milan, Lombardy, Italy (On-Site)
10 Months ago
luxsoft - Avaloq Software Engineer (Data)

luxsoft

London, England, United Kingdom (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded