Lead Azure Data Engineer (Tech Lead)

3 Months ago • 10 Years + • DevOps • $116,100 PA - $180,400 PA

Job Summary

Job Description

This Lead Azure Data Engineer (Tech Lead) role in New York requires 10+ years of experience and is based in the New York office (four days on-site mandatory). Responsibilities include leading a team of data engineers, managing the end-to-end lifecycle of modern data platforms on Azure, serving as a technical liaison between clients and offshore 24x7 teams, designing and developing data pipelines using Azure Data Factory, Azure Databricks, Snowflake, and Pyramid Analytics, overseeing database migrations, developing SOPs, providing troubleshooting, and mentoring junior engineers. The role demands expertise in Azure Data services, Snowflake, Pyramid Analytics, DataOps, cloud migrations, and strong leadership and communication skills. 24/7 on-call support is required.
Must have:
  • 10+ years Azure Data Engineering experience
  • Lead and mentor data engineering teams
  • Azure Data Factory, Databricks, Snowflake, Pyramid expertise
  • DataOps experience and cloud migration expertise
  • Strong leadership and communication skills

Job Details

This position is based in New York office, where you will work closely with cross-functional teams and clients. Working from the office four days a week is mandatory to ensure seamless communication and delivery. Fully remote work is not an option for this role, as we value the collaborative environment and face-to-face interactions that drive innovation and success.

Overview 

We are seeking a highly skilled Lead Azure Data Engineer (Tech Lead) with 10+ years of experience to join our dynamic team of technology professionals. In this role, you will be at the forefront of helping our clients manage modern Data Solutions at scale. As a seasoned technologist, you will leverage your deep technical expertise and strong leadership abilities to guide internal teams and clients in achieving their business goals through robust database engineering and cloud migration strategies.

You will be responsible for overseeing the end-to-end lifecycle of modern Data platform on Azure, from initial design and planning to ongoing optimization and support. A critical aspect of your role , You will serve as a key technical liaison, ensuring seamless collaboration and effective delivery between our clients and offshore 24x7 teams for Dataops. Your ability to take ownership of delivery, manage cross-functional collaboration, and maintain open lines of communication across time zones is essential to the success of our projects.

This version emphasizes the importance of collaboration and delivery ownership with offshore teams, highlighting it as a key component of the role.

Key Responsibilities:

    • Lead and manage a team of data engineers, providing guidance and mentorship in implementing Azure data solutions. Set technical direction, define architectural standards, and drive the adoption of best practices for data engineering on Azure. Ensure that project timelines and deliverables are met while maintaining high-quality standards. 
    • Lead and mentor a team of offshore data engineers to meet program requirements.
    • Serve as the technical liaison between customers and offshore 24x7 teams.
    • Design and develop robust, scalable, and secure data pipelines and data integration solutions using Azure Data Factory, Azure Databricks, Snowflake, pyramid Analytics.
    • Oversee the design, configuration, monitoring, and automation of Cloud Data Platfrom
    • Lead database migrations, including planning, execution, and optimization for Azure Cloud.
    • Develop and maintain Standard Operating Procedures (SOPs) and ensure the technical viability of production deployments.
    • Provide advanced troubleshooting and resolution of day to day Data operations.
    • Creating & maintaining documentation, on-boarding procedures & conduct training sessions on DataOps process
    • Monitor pipelines for failures and diagnose/resolve problems.
    • Mentoring and Training: Provide guidance and support to Level 1 and Level 2 Data Engineers, sharing knowledge and expertise to foster their professional growth.
    • Engage, Consult and Deliver based on interactive customer communications in streamlining project deliverables and scope of work.
    • Automate repetitive tasks to enhance efficiency and reduce human error.
    • Participate in 24x7 production support for Cloud Data Platform.

Required Skills:-

    • Expertise in Azure Data services, Snowflake, and Pyramid Analytics.
    • Experience in DataOps
    • Extensive experience in cloud-enabled data migrations and administration (On-prem to cloud, Cloud to cloud).
    • Strong leadership and communication skills, with the ability to guide and influence both technical and business stakeholders.
    • Proficient in traditional Datawarehousing , ETL along with modern Cloud Data Stack
    • Strong written and verbal communication skills with the ability to effectively convey technical information to non-technical stakeholders.
    • Ability to communicate technical info and ideas so others will understand.
    • Ability to apply varying leadership skills and traits that create solutions and results to unexpected situations.
    • Familiarity with industry best practices for Azure Data, Snowflake, and Pyramid Analytics, including development,  configuration settings, maintenance tasks, and disaster recovery strategies.
    • Ability to manage multiple demands with a sense of urgency and lead change successfully
    • Should be able to establish end to end continuous integration and continuous deployment and guide the team on best practices and help them release product/application fast.· Provide 24x7 support as required for releases & maintenance
The following information is required by pay transparency legislation in the following states: CA, CO, HI, NY, and WA. This information applies only to individuals working in these states.
 
·       The anticipated starting pay range for Colorado is: $116,100 - $154,800
·       The anticipated starting pay range for the states of Hawaii and New York (not including NYC) is: $123,600 - $164,800
·       The anticipated starting pay range for California, New York City and Washington is: $135,300 - $180,400
 
Unless already included in the posted pay range and based on eligibility, the role may include variable compensation in the form of bonus, commissions, or other discretionary payments. These discretionary payments are based on company and/or individual performance and may change at any time. Actual compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location.

Information on benefits offered is here.

#LI-VM1
#LI-USA
#rackspace

About Rackspace Technology
We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.
 
More on Rackspace Technology
Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.
 

Similar Jobs

PwC - IN_Associate – Crm Technical -Ms Dynamics– Advisory -Hyderabad

PwC

Hyderabad, Telangana, India (On-Site)
4 Months ago
ION - Cloud Engineer/Architect (DevOps)

ION

Pisa, Tuscany, Italy (On-Site)
5 Months ago
Blue Yonder - Staff Software Engineer I-Python, Microservices, API

Blue Yonder

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Rackspace Technology - Sr Cloud Architect

Rackspace Technology

India (Remote)
3 Months ago
The Walt Disney Company - Lead Software Engineer (Identity)

The Walt Disney Company

Seattle, Washington, United States (On-Site)
4 Months ago
Info Stretch - Senior Engineer

Info Stretch

Pune, Maharashtra, India (On-Site)
5 Months ago
Larian Studios - Senior Automation Engineer

Larian Studios

Guildford, England, United Kingdom (On-Site)
1 Month ago
Easygo - Senior DevOps Engineer

Easygo

Belgrade, Serbia (On-Site)
6 Days ago
Escape Velocity Entertainment - Site Reliability Engineer

Escape Velocity Entertainment

(Remote)
6 Days ago
Wildlife Studios - Associate Site Reliability Engineer

Wildlife Studios

São Paulo, State Of São Paulo, Brazil (On-Site)
5 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Electronic Arts - Build Software Engineer - Development & Release Engineering

Electronic Arts

Vancouver, British Columbia, Canada (Hybrid)
2 Weeks ago
Hitachi - MS Dynamics 365 AX Finance Functional

Hitachi

Hyderabad, Telangana, India (Remote)
5 Months ago
Barracuda Networks  Inc  - Principal Application Security Engineer

Barracuda Networks Inc

Ontario, Canada (Remote)
1 Week ago
Hitachi - Data Engineer + Power BI Developer

Hitachi

Pune, Maharashtra, India (Remote)
5 Months ago
Sporty Group - LatAM Site Reliability Engineer

Sporty Group

(On-Site)
10 Months ago
Buckman - Lead Digital Software Engineer – Front End

Buckman

Chennai, Tamil Nadu, India (On-Site)
6 Months ago
Inworld AI - Staff Platform Engineer - USA

Inworld AI

Mountain View, California, United States (On-Site)
4 Months ago
PwC - Manager in Document Automation - Implementation and IT delivery

PwC

Prague, Prague, Czechia (On-Site)
5 Months ago
Hashone Careers - Cloud Engineer

Hashone Careers

Gurugram, Haryana, India (Remote)
4 Months ago
PwC - IN-Associate – D365 Retail Functional -Ms Dynamics– Advisory  - Noida

PwC

Noida, Uttar Pradesh, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New York, New York, United States

HoYoverse - Brand Marketing Specialist - Fresh Grad

HoYoverse

United States (On-Site)
1 Month ago
Meta - Network Production Engineer, Network Infrastructure

Meta

Bellevue, Washington, United States (On-Site)
4 Months ago
Samsung Semiconductor - Senior Staff Engineer, TCAD

Samsung Semiconductor

San Jose, California, United States (On-Site)
1 Week ago
Penumbra - Sr Manager Cybersecurity

Penumbra

Alameda, California, United States (On-Site)
5 Months ago
The Walt Disney Company - KABC Freelance Maintenance Engineer

The Walt Disney Company

Glendale, California, United States (On-Site)
4 Months ago
Epic Games - Business Development Manager

Epic Games

Cary, North Carolina, United States (On-Site)
2 Months ago
Hawk Eye Innovations - College Sports Systems Technician

Hawk Eye Innovations

Nebraska, United States (On-Site)
6 Days ago
Feld Entertainment - Warehouse Associate

Feld Entertainment

Jessup, Maryland, United States (On-Site)
5 Months ago
ByteDance - Facilities Lead, AMS

ByteDance

Los Angeles, California, United States (On-Site)
6 Days ago
Nintendo - Sr UX Writer

Nintendo

Redmond, Washington, United States (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

ION - Senior DevSecOps Engineer, Italy

ION

London, England, United Kingdom (On-Site)
5 Months ago
Offworld - DevOps Engineer

Offworld

New Westminster, British Columbia, Canada (On-Site)
6 Days ago
Nintendo - CONTRACT - Sr Engineer (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
4 Months ago
Rackspace Technology - Presales Enterprise Architect - Multi Service Line

Rackspace Technology

San Antonio, Texas, United States (Remote)
6 Days ago
IO Interactive - Senior Build Engineer

IO Interactive

Malmö, Skåne County, Sweden (Hybrid)
6 Days ago
bosh group india - PreSales/ Solution Architect- Hybrid Cloud

bosh group india

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Nagarro - Cloud Pricing Architect

Nagarro

Germany (Remote)
6 Days ago
Rackspace Technology - DevOps Engineer (AWS Terraform)

Rackspace Technology

India (Remote)
1 Month ago
Rackspace Technology - DEVOP Engineer (AWS Terraform)-PSDE III

Rackspace Technology

India (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

England, United Kingdom (Remote)

United States (Remote)

Vietnam (Remote)

Vietnam (Remote)

Sacramento, California, United States (Remote)

New York, New York, United States (Remote)

Los Angeles, California, United States (Remote)

Gurugram, Haryana, India (Remote)

View All Jobs

Get notified when new jobs are added by Rackspace Technology

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug