Lead Azure Data Engineer (Tech Lead)

4 Months ago • 10 Years + • DevOps • $116,100 PA - $180,400 PA

Job Summary

Job Description

This Lead Azure Data Engineer (Tech Lead) role in New York requires 10+ years of experience and is based in the New York office (four days on-site mandatory). Responsibilities include leading a team of data engineers, managing the end-to-end lifecycle of modern data platforms on Azure, serving as a technical liaison between clients and offshore 24x7 teams, designing and developing data pipelines using Azure Data Factory, Azure Databricks, Snowflake, and Pyramid Analytics, overseeing database migrations, developing SOPs, providing troubleshooting, and mentoring junior engineers. The role demands expertise in Azure Data services, Snowflake, Pyramid Analytics, DataOps, cloud migrations, and strong leadership and communication skills. 24/7 on-call support is required.
Must have:
  • 10+ years Azure Data Engineering experience
  • Lead and mentor data engineering teams
  • Azure Data Factory, Databricks, Snowflake, Pyramid expertise
  • DataOps experience and cloud migration expertise
  • Strong leadership and communication skills

Job Details

This position is based in New York office, where you will work closely with cross-functional teams and clients. Working from the office four days a week is mandatory to ensure seamless communication and delivery. Fully remote work is not an option for this role, as we value the collaborative environment and face-to-face interactions that drive innovation and success.

Overview 

We are seeking a highly skilled Lead Azure Data Engineer (Tech Lead) with 10+ years of experience to join our dynamic team of technology professionals. In this role, you will be at the forefront of helping our clients manage modern Data Solutions at scale. As a seasoned technologist, you will leverage your deep technical expertise and strong leadership abilities to guide internal teams and clients in achieving their business goals through robust database engineering and cloud migration strategies.

You will be responsible for overseeing the end-to-end lifecycle of modern Data platform on Azure, from initial design and planning to ongoing optimization and support. A critical aspect of your role , You will serve as a key technical liaison, ensuring seamless collaboration and effective delivery between our clients and offshore 24x7 teams for Dataops. Your ability to take ownership of delivery, manage cross-functional collaboration, and maintain open lines of communication across time zones is essential to the success of our projects.

This version emphasizes the importance of collaboration and delivery ownership with offshore teams, highlighting it as a key component of the role.

Key Responsibilities:

    • Lead and manage a team of data engineers, providing guidance and mentorship in implementing Azure data solutions. Set technical direction, define architectural standards, and drive the adoption of best practices for data engineering on Azure. Ensure that project timelines and deliverables are met while maintaining high-quality standards. 
    • Lead and mentor a team of offshore data engineers to meet program requirements.
    • Serve as the technical liaison between customers and offshore 24x7 teams.
    • Design and develop robust, scalable, and secure data pipelines and data integration solutions using Azure Data Factory, Azure Databricks, Snowflake, pyramid Analytics.
    • Oversee the design, configuration, monitoring, and automation of Cloud Data Platfrom
    • Lead database migrations, including planning, execution, and optimization for Azure Cloud.
    • Develop and maintain Standard Operating Procedures (SOPs) and ensure the technical viability of production deployments.
    • Provide advanced troubleshooting and resolution of day to day Data operations.
    • Creating & maintaining documentation, on-boarding procedures & conduct training sessions on DataOps process
    • Monitor pipelines for failures and diagnose/resolve problems.
    • Mentoring and Training: Provide guidance and support to Level 1 and Level 2 Data Engineers, sharing knowledge and expertise to foster their professional growth.
    • Engage, Consult and Deliver based on interactive customer communications in streamlining project deliverables and scope of work.
    • Automate repetitive tasks to enhance efficiency and reduce human error.
    • Participate in 24x7 production support for Cloud Data Platform.

Required Skills:-

    • Expertise in Azure Data services, Snowflake, and Pyramid Analytics.
    • Experience in DataOps
    • Extensive experience in cloud-enabled data migrations and administration (On-prem to cloud, Cloud to cloud).
    • Strong leadership and communication skills, with the ability to guide and influence both technical and business stakeholders.
    • Proficient in traditional Datawarehousing , ETL along with modern Cloud Data Stack
    • Strong written and verbal communication skills with the ability to effectively convey technical information to non-technical stakeholders.
    • Ability to communicate technical info and ideas so others will understand.
    • Ability to apply varying leadership skills and traits that create solutions and results to unexpected situations.
    • Familiarity with industry best practices for Azure Data, Snowflake, and Pyramid Analytics, including development,  configuration settings, maintenance tasks, and disaster recovery strategies.
    • Ability to manage multiple demands with a sense of urgency and lead change successfully
    • Should be able to establish end to end continuous integration and continuous deployment and guide the team on best practices and help them release product/application fast.· Provide 24x7 support as required for releases & maintenance
The following information is required by pay transparency legislation in the following states: CA, CO, HI, NY, and WA. This information applies only to individuals working in these states.
 
·       The anticipated starting pay range for Colorado is: $116,100 - $154,800
·       The anticipated starting pay range for the states of Hawaii and New York (not including NYC) is: $123,600 - $164,800
·       The anticipated starting pay range for California, New York City and Washington is: $135,300 - $180,400
 
Unless already included in the posted pay range and based on eligibility, the role may include variable compensation in the form of bonus, commissions, or other discretionary payments. These discretionary payments are based on company and/or individual performance and may change at any time. Actual compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location.

Information on benefits offered is here.

#LI-VM1
#LI-USA
#rackspace

About Rackspace Technology
We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.
 
More on Rackspace Technology
Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.
 

Similar Jobs

Barracuda Networks  Inc  - Senior Security Engineer

Barracuda Networks Inc

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Aristocrat Gaming - DevOps Engineer

Aristocrat Gaming

Kraków, Lesser Poland Voivodeship, Poland (Hybrid)
4 Months ago
The Walt Disney Company - Principal Software Engineer - Ad Platform

The Walt Disney Company

Glendale, California, United States (On-Site)
3 Months ago
PwC - Manager– Oracle – Oracle DBA – Advisory  - Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
NVIDIA - Senior Software Engineer - Distributed Inference

NVIDIA

California, United States (Remote)
1 Month ago
DraftKings - Manager, System DBA Operations

DraftKings

Plovdiv, Plovdiv Province, Bulgaria (On-Site)
2 Months ago
CloudLinux - Senior Python Developer

CloudLinux

Tbilisi, Tbilisi, Georgia (Remote)
1 Month ago
Google - Software Engineering Manager II, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Razer - Lead Site Reliability Engineer

Razer

Shanghai, Shanghai, China (On-Site)
7 Months ago
Rackspace Technology - Cloud Business Consultant

Rackspace Technology

Mexico City, Mexico City, Mexico (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - Senior Associate - Gurgaon - Technology Consulting

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago
Social Discovery Group - CTO (Moto)

Social Discovery Group

Poland (Remote)
3 Months ago
PwC - ETIC, Cloud Solution Architect - Manager

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
6 Months ago
Avalanche Studios Group - Senior DevOps Engineer

Avalanche Studios Group

Stockholm, Stockholm County, Sweden (On-Site)
2 Months ago
Alphasense - Lead AI Platform Engineer

Alphasense

New York, New York, United States (On-Site)
4 Months ago
ION - Cloud Engineer Kubernetes

ION

Collecchio, Emilia-Romagna, Italy (Hybrid)
6 Months ago
Epic Games - Build Engineer, Fortnite

Epic Games

Cary, North Carolina, United States (On-Site)
2 Months ago
Jagex - IT Infrastructure Lead

Jagex

Cambridge, England, United Kingdom (Hybrid)
1 Month ago
Brillio - Azure Kubernetes Architect - R01530963

Brillio

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Buckman - Lead Digital Software Engineer – Front End

Buckman

Chennai, Tamil Nadu, India (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New York, New York, United States

Trackman - Trackman Baseball System Operator

Trackman

Los Angeles, California, United States (On-Site)
3 Months ago
Scopely - Lead UI Artist- Monopoly GO!

Scopely

Culver City, California, United States (On-Site)
6 Months ago
Twitch - Software Engineer

Twitch

Seattle, Washington, United States (On-Site)
4 Weeks ago
The Walt Disney Company - Pruner - Full Time

The Walt Disney Company

Anaheim, California, United States (On-Site)
4 Months ago
Scientific Games  - Retail In-Store Content Manager

Scientific Games

Alpharetta, Georgia, United States (On-Site)
1 Month ago
Maximum Games - Head of Publishing

Maximum Games

Walnut Creek, California, United States (On-Site)
3 Months ago
Feld Entertainment - Warehouse Associate

Feld Entertainment

Jessup, Maryland, United States (On-Site)
6 Months ago
Life church - Associate LifeGroups/LifeMissions Pastor

Life church

United States (On-Site)
6 Months ago
Inworld AI - Staff Cloud DevOps/Site Reliability Engineer (SRE) - USA

Inworld AI

Mountain View, California, United States (On-Site)
9 Months ago
IGT - SAP ABAP Developer

IGT

Reno, Nevada, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

ION - Cloud Engineer Kubernetes

ION

Collecchio, Emilia-Romagna, Italy (Hybrid)
6 Months ago
ION - Cloud Engineer Kubernetes

ION

Milan, Lombardy, Italy (Hybrid)
6 Months ago
Rackspace Technology - Lead Platform Enterprise Architect

Rackspace Technology

United States (Remote)
5 Months ago
NVIDIA - Senior Software Engineer – AI Infrastructure and Tooling

NVIDIA

California, United States (Remote)
1 Month ago
PlayStation Global - Sr. Software Engineer - ML/AI DevOps

PlayStation Global

San Mateo, California, United States (On-Site)
1 Month ago
SmileGate - Game Data Engineer

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
1 Month ago
Auros Global - Senior Site Reliability Engineer

Auros Global

United Kingdom (Remote)
1 Month ago
Rockstar Games - DevOps Engineer

Rockstar Games

Edinburgh, Scotland, United Kingdom (On-Site)
11 Months ago
Tencent - Tencent Cloud - Senior Cloud Architect (R&D & Solution Design)

Tencent

Jakarta, Jakarta, Indonesia (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded