Senior Data Engineer

1 Month ago • 7 Years + • Data Analysis

Job Summary

Job Description

This is a hands-on data platform engineering role focusing on consultative data engineering engagements with various stakeholders, including Business Owners, Business Analytics, Data Engineering teams, Application Development, End Users, and Management teams. The role involves designing and building resilient and efficient data pipelines for batch and real-time streaming, architecting data infrastructure on the cloud using Infrastructure-as-Code tools, and collaborating with product managers, software engineers, data analysts, and data scientists. You will provide technical product expertise, advise on deployment architectures, and handle in-depth technical questions related to data infrastructure, PaaS services, design patterns, and implementation approaches. Collaboration with enterprise architects, data architects, ETL developers & engineers, data scientists, and information designers is key for identifying and defining required data structures, formats, pipelines, metadata, and workload orchestration capabilities. The role also covers aspects like data privacy & security, data ingestion & processing, data storage & compute, analytical & operational consumption, data modeling, data virtualization, self-service data preparation & analytics, AI enablement, and API integrations. You will lead a team of engineers, execute projects with an Agile mindset, and build software frameworks to solve data problems at scale.
Must have:
  • 7+ years of data engineering experience
  • 3+ years architecting data pipelines
  • Extensive Azure data services experience
  • Strong SQL, Python, and Spark programming
  • Strong Data Modeling and Data lakehouse concepts
  • Knowledge of software configuration management tools
  • Experience with Agile development methods
Good to have:
  • Prior experience using DBT
  • Prior experience using PowerBI
  • Azure certifications

Job Details

Senior Data Engineer – Azure
 
This is a hands on data platform engineering role that places significant emphasis on consultative data engineering engagements with a wide range of customer stakeholders; Business Owners, Business Analytics, Data Engineering teams, Application Development, End Users and Management teams.
 
 

You will

    • Design and build resilient and efficient data pipelines for batch and real-time streaming
    • Architect and design data infrastructure on cloud using Infrastructure-as-Code tools.
    • Collaborate with product managers, software engineers, data analysts, and data scientists to build scalable and data-driven platforms and tools.
    • Provide technical product expertise, advise on deployment architectures, and handle in-depth technical questions around data infrastructure, PaaS services, design patterns and implementation approaches.
    • Collaborate with enterprise architects, data architects, ETL developers & engineers, data scientists, and information designers to lead the identification and definition of required data structures, formats, pipelines, metadata, and workload orchestration capabilities
    • Address aspects such as data privacy & security, data ingestion & processing, data storage & compute, analytical & operational consumption, data modeling, data virtualization, self-service data preparation & analytics, AI enablement, and API integrations.
    • Lead a team of engineers to deliver impactful results at scale.
    • Execute projects with an Agile mindset.
    • Build software frameworks to solve data problems at scale.

Technical Requirements:

    • 7+ years of data engineering experience leading implementations of large-scale lakehouses on Databricks, Snowflake, or Synapse. Prior experience using DBT and PowerBI will be a plus.
    • 3+ years' experience architecting solutions for developing data pipelines from structured, unstructured sources for batch and realtime workloads.
    • Extensive experience with Azure data services (Databricks, Synapse, ADF) and related azure infrastructure services like firewall, storage, key vault etc. is required.
    • Strong programming / scripting experience using SQL and python and Spark.
    • Strong Data Modeling, Data lakehouse concepts.
    • Knowledge of software configuration management environments and tools such as JIRA, Git, Jenkins, TFS, Shell, PowerShell, Bitbucket.
    • Experience with Agile development methods in data-oriented projects 

Other Requirements:

    • Highly motivated self-starter and team player and demonstrated success in prior roles.
    • Track record of success working through technical challenges within enterprise organizations
    • Ability to prioritize deals, training, and initiatives through highly effective time management
    • Excellent problem solving, analytical, presentation, and whiteboarding skills
    • Track record of success dealing with ambiguity (internal and external) and working collaboratively with other departments and organizations to solve challenging problems
    • Strong knowledge of technology and industry trends that affect data analytics decisions for enterprise organizations
    • Certifications on Azure Data Engineering and related technologies.
"Remote postings are limited to candidates residing within the country specified in the posting location"

About Rackspace Technology
We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.
 
 
More on Rackspace Technology
Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.

Similar Jobs

Nine - Graphic Designer

Nine

North Sydney, New South Wales, Australia (On-Site)
1 Month ago
WebFX - Lead Sales Development Representative (SDR) (Open to Remote or On-Site)

WebFX

Harrisburg, Pennsylvania, United States (Remote)
9 Months ago
beghou consulting - Consultant

beghou consulting

Pune, Maharashtra, India (Hybrid)
8 Months ago
Qualcomm - GPU Engineering Program Manager

Qualcomm

San Diego, California, United States (On-Site)
2 Months ago
Tesla - Training Coordinator - Parts Operations

Tesla

Fuenlabrada, Community Of Madrid, Spain (On-Site)
5 Months ago
Reality Games - Data Analyst - Monopoly World

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
4 Months ago
Notion - Data Scientist, GTM

Notion

San Francisco, California, United States (On-Site)
2 Months ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
6 Months ago
ShyftLabs - Data Engineer (Data Modernization)

ShyftLabs

Toronto, Ontario, Canada (Hybrid)
1 Month ago
Apple - Cellular 4G/5G Firmware Data & Automation Engineer

Apple

San Diego, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Marsh McLennan - Health & Benefits Associate

Marsh McLennan

Québec City, Quebec, Canada (Hybrid)
1 Month ago
Veeam Software - Customer Technical Onboarding Manager

Veeam Software

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Weeks ago
disbielief - Senior Producer

disbielief

Cambridge, Massachusetts, United States (Hybrid)
2 Months ago
Hawkeye Innovations - IT Support Coordinator

Hawkeye Innovations

Atlanta, Georgia, United States (Hybrid)
3 Months ago
Assystems - General Administration Officer (Saudi only)

Assystems

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
9 Months ago
Synthesia - Technical Associate to the CTO

Synthesia

London, England, United Kingdom (On-Site)
2 Weeks ago
Toast - Analyst II, Payments Pricing and Operations

Toast

Boston, Massachusetts, United States (On-Site)
1 Month ago
Plug power - Lead Field Service Technician

Plug power

Kansas City, Kansas, United States (On-Site)
1 Year ago
Blockville - Senior 3D Artist

Blockville

İstanbul, Türkiye (On-Site)
1 Year ago
Light Speed Studios - Senior Technical Artist

Light Speed Studios

Tokyo, Japan (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Gurugram, Haryana, India

Hike - ML Engineer Intern

Hike

Delhi, India (Remote)
2 Weeks ago
Highspot - Director - IT, Enterprise Apps & Workplace Strategy

Highspot

Hyderabad, Telangana, India (Hybrid)
2 Months ago
Clearwater Analytics - Finance Integration & Automation Leader

Clearwater Analytics

Noida, Uttar Pradesh, India (On-Site)
1 Year ago
Tide - Workplace Enablement Engineer - IT Network

Tide

Hyderabad, Telangana, India (On-Site)
3 Weeks ago
seedify - Backend Engineer

seedify

India (Remote)
9 Months ago
Abnormal Security - Software Engineer - II, Backend

Abnormal Security

Bengaluru, Karnataka, India (Hybrid)
10 Months ago
Accenture - Data Platform Engineer

Accenture

Indore, Madhya Pradesh, India (On-Site)
1 Month ago
Cred - Senior Campaign Operations

Cred

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Capgemini - Talent Acquisition Partner

Capgemini

Pune, Maharashtra, India (On-Site)
2 Months ago
Silicon Labs - Staff Engineer - Verification

Silicon Labs

Hyderabad, Telangana, India (On-Site)
1 Year ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Epic Games - Principal Data Analyst

Epic Games

New York, New York, United States (On-Site)
3 Months ago
Addepar - Market Data Analyst

Addepar

Pune, Maharashtra, India (Hybrid)
2 Months ago
Apple - Data Engineer, PART DataOps

Apple

Cupertino, California, United States (On-Site)
3 Weeks ago
Rackspace Technology - Data Engineer III

Rackspace Technology

Gurugram, Haryana, India (Remote)
1 Month ago
Gallagher - Data Scientist

Gallagher

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Scopely - Data Analyst, Marketing Analytics

Scopely

Mexico City, Mexico City, Mexico (Hybrid)
5 Months ago
TransUnion - Advisor, Data Science and Analytics

TransUnion

(Remote)
2 Months ago
miniclip - Senior Data Analyst

miniclip

Lisbon, Lisbon, Portugal (On-Site)
1 Week ago
Luxoft - IT Business Analyst

Luxoft

New Delhi, Delhi, India (Remote)
7 Months ago
Adyen - Data Engineer

Adyen

Amsterdam, North Holland, Netherlands (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded