Principal Data Engineer

3 Months ago • 5-8 Years • DevOps • Data Analyst

Job Summary

Job Description

The Principal Data Engineer will support a custom data analytics and visualizations platform, focusing on data engineering pillars of compliance, data management, transformation, and modeling. This role contributes directly to Azure-level projects using data-driven approaches. Responsibilities include analyzing large-scale Azure data, designing and developing production-level code for data engineering efforts, working with multiple Azure Services on complex solutions, and collaborating with various teams (BI, Data Science, Software Engineering, Program Management, HW Engineering).
Must have:
  • 5+ years Data Engineering experience (Azure, SQL, PySpark, C#)
  • Experience querying large datasets in SQL or Kusto
  • Experience in analytics (IoT, telemetry, etc.) or project analytics
  • 3+ years managing data pipelines, capacity analytics, Azure subscriptions
  • Strong C#, SQL, and Python skills
  • Excellent communication skills
Good to have:
  • 3+ years with ADO Repo & CI/CD Pipelines
  • Experience with data visualization tools
Perks:
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Job Details

Overview

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft’s expanding Cloud Infrastructure and responsible for powering Microsoft’s “Intelligent Cloud” mission. SCHIE delivers the core infrastructure and foundational technologies for Microsoft's over 200 online businesses including Bing, MSN, Office 365, Xbox Live, Teams, OneDrive and the Microsoft Azure platform globally with our server and data center infrastructure, security and compliance, operations, globalization, and manageability solutions. Our focus is on smart growth, high efficiency, and delivering a trusted experience to customers and partners worldwide and we are looking for passionate, high energy engineers to help achieve that mission. 

 

The Cloud Hardware Analytics & Tools (CHAT) Team within SCHIE develops advanced analytical and tooling solutions to support and improve the quality of Microsoft Azure. We collect and analyze data across the full Azure stack, HW & SW components, Silicon development processes, and much more. CHAT Data Science, a branch of CHAT, provides data science support, machine learning and artificial intelligence solutions, and advanced visualizations to cloud engineering and management partners.  

We are looking for a Prinicpal Data Engineer to support our custom data analytics and visualizations platform. This high-impact role focuses on the pillars of data engineering of compliance, data management and transformation as well as modeling, and will have direct contributions to Azure-level projects, including working with highly visible platforms through data-driven approaches. This role closely collaborates with BI and Data Science, Software Engineers, other Data Engineers, Program Managers, and HW Engineering teams. 

Qualifications

Required/Minimum Qualifications 

  • 5 years of engineering experience in Data Engineering (Azure, SQL, PySpark, C#). 
  • 5 years of experience with querying large volumes of data in SQL or Kusto databases 
  • Experience in analytics for one of the technical domains (IoT, telemetry, fleet/inventory management, repairs & reliability analysis) or project/program analytics is preferred 
  • 3 years of experience in monitoring & managing  data pipelines, capacity & usage analytics, Azure subscriptions or similar technical infrastructures 
  • Strong C#, SQL and Python language skills for scripting and automation 
  • CS Degree or equivalent experience  
  • Excellent communications skills, both verbal and written 

 

#SCHIEINDIA

Additional or Preferred Qualifications 

  • 3 years of experience with ADO Repo & CI/CD Pipelines management and automation 

Responsibilities

  • Analyze large-scale Azure data to address critical business problems 
  • Work on complex, mission-critical solutions that involve multiple Azure Services 
  • Design and develop production-level code for data engineering efforts 
  • Work in collaborative environment 
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Similar Jobs

The Workshop - Product Owner - DevOps

The Workshop

Málaga, Andalusia, Spain (Hybrid)
2 Months ago
GT - QE Automation Engineer | Feeld, UK

GT

(Remote)
3 Months ago
GameChanger  - Staff Backend Engineer, Video Enablement

GameChanger

United States (Remote)
2 Months ago
Aera Technology - Senior Performance Engineer

Aera Technology

Pune, Maharashtra, India (On-Site)
6 Months ago
Velotio Technologies - Lead QA Engineer (ETL Testing)

Velotio Technologies

India (Remote)
4 Months ago
PwC - D365 Azure Integration Developer-Manager

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Nielsen Holdings - Software Engineer - Bigdata (Java/Scala and SQL)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Next Level Business Services - Windows Azure Build Engineer

Next Level Business Services

Redmond, Washington, United States (On-Site)
6 Months ago
PwC - Power Platform Developer Associate

PwC

Milan, Lombardy, Italy (On-Site)
2 Months ago
Armada - Infrastructure Engineer (Edge)

Armada

Thiruvananthapuram, Kerala, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - ETIC, GCP Technical Support Engineer - Senior Associate

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
6 Months ago
Haven Studios  Inc  - Programmer (Automated Testing)

Haven Studios Inc

Montreal, Quebec, Canada (On-Site)
1 Month ago
Info Stretch - Senior Engineer

Info Stretch

Bengaluru, Karnataka, India (On-Site)
5 Months ago
N-iX - Middle/Senior Automation QA (Python) Engineer

N-iX

Ukraine (Remote)
1 Month ago
CloudHire - Sr. Developer Backend - Remote

CloudHire

Mumbai, Maharashtra, India (Remote)
6 Months ago
PwC - R&R FS - Python Full Stack -Senior Associate

PwC

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Flutter Entertainment - Lead Data Scientist

Flutter Entertainment

Hyderabad, Telangana, India (Hybrid)
5 Months ago
PwC - IN_Senior Associate_Full Stack Developer_Data & Analytics_Advisory_PAN India

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Warner Bros Games - Senior Data Engineer

Warner Bros Games

Atlanta, Georgia, United States (Hybrid)
2 Months ago
Fortis Games - Staff Security Architect

Fortis Games

Canada (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Hyderabad, Telangana, India

PwC - Manager|Oracle fusion Finance| Oracle|Advisory|Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Keywords Studios (Player Support) - Software Engineer I

Keywords Studios (Player Support)

Maharashtra, India (Hybrid)
3 Months ago
Rivos - Silicon RTL Integration Engineer - Full time

Rivos

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
PhonePe - Banking Business Operation

PhonePe

Bengaluru, Karnataka, India (On-Site)
5 Months ago
PwC - IN-Associate_Full Stack Developer(Node JS)_MS Engg_Advisory_Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Assystems - Full Stack React and Java Developer

Assystems

Gurugram, Haryana, India (On-Site)
5 Months ago
Smiths Group plc - IT Controls Manager

Smiths Group plc

Pune, Maharashtra, India (Hybrid)
6 Months ago
PwC - Specialist 3

PwC

Gurugram, Haryana, India (On-Site)
6 Months ago
Nagarro - Associate Staff Engineer, Tech support

Nagarro

Hyderabad, Telangana, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Egnyte - Database Administrator

Egnyte

India (Remote)
2 Months ago
Varonis  - Cloud Security Architect - SME Azure

Varonis

United States (Remote)
2 Months ago
ION - Site Reliability Engineer

ION

London, England, United Kingdom (Hybrid)
6 Months ago
ARHS - Solution Architect (Data Migration)

ARHS

Stockholm, Stockholm County, Sweden (Remote)
6 Months ago
Hashlist - Senior Data Engineer

Hashlist

Pune, Maharashtra, India (Hybrid)
5 Months ago
Zoox - IT Platform Manager

Zoox

Foster City, California, United States (On-Site)
6 Months ago
prizepicks - Database Reliability Engineer

prizepicks

Atlanta, Georgia, United States (Remote)
2 Months ago
Match Group - Senior Platform Engineer

Match Group

New York, New York, United States (Hybrid)
6 Months ago
Netflix - Solutions Support Engineer (L5) - Observability

Netflix

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Months ago
Electronic Arts - Software Engineer

Electronic Arts

Bucharest, Bucharest, Romania (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.
View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug