Lead Azure Data Engineer (Tech Lead)
Job Summary
Job Description
This Lead Azure Data Engineer (Tech Lead) role in New York requires 10+ years of experience and is based in the New York office (four days on-site mandatory). Responsibilities include leading a team of data engineers, managing the end-to-end lifecycle of modern data platforms on Azure, serving as a technical liaison between clients and offshore 24x7 teams, designing and developing data pipelines using Azure Data Factory, Azure Databricks, Snowflake, and Pyramid Analytics, overseeing database migrations, developing SOPs, providing troubleshooting, and mentoring junior engineers. The role demands expertise in Azure Data services, Snowflake, Pyramid Analytics, DataOps, cloud migrations, and strong leadership and communication skills. 24/7 on-call support is required.
Must have:
- 10+ years Azure Data Engineering experience
- Lead and mentor data engineering teams
- Azure Data Factory, Databricks, Snowflake, Pyramid expertise
- DataOps experience and cloud migration expertise
- Strong leadership and communication skills
6 skills required
Job Details
This position is based in New York office, where you will work closely with cross-functional teams and clients. Working from the office four days a week is mandatory to ensure seamless communication and delivery. Fully remote work is not an option for this role, as we value the collaborative environment and face-to-face interactions that drive innovation and success.
Overview
We are seeking a highly skilled Lead Azure Data Engineer (Tech Lead) with 10+ years of experience to join our dynamic team of technology professionals. In this role, you will be at the forefront of helping our clients manage modern Data Solutions at scale. As a seasoned technologist, you will leverage your deep technical expertise and strong leadership abilities to guide internal teams and clients in achieving their business goals through robust database engineering and cloud migration strategies.
You will be responsible for overseeing the end-to-end lifecycle of modern Data platform on Azure, from initial design and planning to ongoing optimization and support. A critical aspect of your role , You will serve as a key technical liaison, ensuring seamless collaboration and effective delivery between our clients and offshore 24x7 teams for Dataops. Your ability to take ownership of delivery, manage cross-functional collaboration, and maintain open lines of communication across time zones is essential to the success of our projects.
This version emphasizes the importance of collaboration and delivery ownership with offshore teams, highlighting it as a key component of the role.
Key Responsibilities:
- Lead and manage a team of data engineers, providing guidance and mentorship in implementing Azure data solutions. Set technical direction, define architectural standards, and drive the adoption of best practices for data engineering on Azure. Ensure that project timelines and deliverables are met while maintaining high-quality standards.
- Lead and mentor a team of offshore data engineers to meet program requirements.
- Serve as the technical liaison between customers and offshore 24x7 teams.
- Design and develop robust, scalable, and secure data pipelines and data integration solutions using Azure Data Factory, Azure Databricks, Snowflake, pyramid Analytics.
- Oversee the design, configuration, monitoring, and automation of Cloud Data Platfrom
- Lead database migrations, including planning, execution, and optimization for Azure Cloud.
- Develop and maintain Standard Operating Procedures (SOPs) and ensure the technical viability of production deployments.
- Provide advanced troubleshooting and resolution of day to day Data operations.
- Creating & maintaining documentation, on-boarding procedures & conduct training sessions on DataOps process
- Monitor pipelines for failures and diagnose/resolve problems.
- Mentoring and Training: Provide guidance and support to Level 1 and Level 2 Data Engineers, sharing knowledge and expertise to foster their professional growth.
- Engage, Consult and Deliver based on interactive customer communications in streamlining project deliverables and scope of work.
- Automate repetitive tasks to enhance efficiency and reduce human error.
- Participate in 24x7 production support for Cloud Data Platform.
Required Skills:-
- Expertise in Azure Data services, Snowflake, and Pyramid Analytics.
- Experience in DataOps
- Extensive experience in cloud-enabled data migrations and administration (On-prem to cloud, Cloud to cloud).
- Strong leadership and communication skills, with the ability to guide and influence both technical and business stakeholders.
- Proficient in traditional Datawarehousing , ETL along with modern Cloud Data Stack
- Strong written and verbal communication skills with the ability to effectively convey technical information to non-technical stakeholders.
- Ability to communicate technical info and ideas so others will understand.
- Ability to apply varying leadership skills and traits that create solutions and results to unexpected situations.
- Familiarity with industry best practices for Azure Data, Snowflake, and Pyramid Analytics, including development, configuration settings, maintenance tasks, and disaster recovery strategies.
- Ability to manage multiple demands with a sense of urgency and lead change successfully
- Should be able to establish end to end continuous integration and continuous deployment and guide the team on best practices and help them release product/application fast.· Provide 24x7 support as required for releases & maintenance
The following information is required by pay transparency legislation in the following states: CA, CO, HI, NY, and WA. This information applies only to individuals working in these states.
· The anticipated starting pay range for Colorado is: $116,100 - $154,800
· The anticipated starting pay range for the states of Hawaii and New York (not including NYC) is: $123,600 - $164,800
· The anticipated starting pay range for California, New York City and Washington is: $135,300 - $180,400
Unless already included in the posted pay range and based on eligibility, the role may include variable compensation in the form of bonus, commissions, or other discretionary payments. These discretionary payments are based on company and/or individual performance and may change at any time. Actual compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location.
#LI-VM1
#LI-USA
#rackspace
About Rackspace Technology
We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.
More on Rackspace Technology
Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.
Similar Jobs
PwC
Kolkata, West Bengal, India (On-Site)
• 4 Months ago
Inworld AI
Mountain View, California, United States (On-Site)
• 2 Months ago
Globalization Partners
Northern Ireland, United Kingdom (Remote)
• 1 Week ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
PwC
Brno, South Moravian Region, Czechia (On-Site)
• 4 Months ago
Microsoft
Redmond, Washington, United States (On-Site)
• 1 Month ago
CloudLinux
Tbilisi, Tbilisi, Georgia (Remote)
• 2 Months ago
Unity
Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
• 8 Months ago
Paypal
San Jose, California, United States (On-Site)
• 4 Months ago
Get notifed when new similar jobs are uploaded
Jobs in New York, New York, United States
Games For Love
Lynnwood, Washington, United States (Remote)
• 7 Months ago
NVIDIA
Santa Clara, California, United States (On-Site)
• 1 Month ago
Meta
Fremont, California, United States (Remote)
• 3 Months ago
Future Colossal
New York, New York, United States (On-Site)
• 6 Months ago
Next Level Business Services
Sunnyvale, California, United States (On-Site)
• 3 Months ago
Get notifed when new similar jobs are uploaded
DevOps Jobs
ByteDance
Singapore (On-Site)
• 3 Months ago
The Walt Disney Company
Seattle, Washington, United States (On-Site)
• 1 Month ago
Ajmera Infotech
Austin, Texas, United States (On-Site)
• 3 Months ago
Get notifed when new similar jobs are uploaded
