Data Architect (Azure and Databricks)

3 Months ago • All levels • Data Analysis

Job Summary

Job Description

We are seeking an experienced Data Architect with extensive expertise in designing and implementing modern data architectures. This role requires strong software engineering principles, hands-on coding abilities, and experience building data engineering frameworks. The ideal candidate will have a proven track record of implementing Databricks-based solutions, with expertise in data catalog implementation and governance frameworks. As a Data Architect, you will be responsible for designing and implementing scalable, secure, and efficient data architectures on the Databricks platform. You will lead the technical design of data migration initiatives from legacy systems to modern Lakehouse architecture, ensuring alignment with business requirements, industry best practices, and regulatory compliance.
Must have:
  • Design and implement modern data architectures using Databricks
  • Lead data migration from legacy systems
  • Develop data engineering frameworks
  • Implement CI/CD pipelines
  • Implement data catalog and governance frameworks
  • Create technical specifications
  • Provide technical leadership
  • Collaborate with cross-functional teams
  • Evaluate and recommend technologies
  • Ensure security, compliance, and performance
  • Mentor junior team members
  • Stay current with emerging technologies
  • Python or Scala expertise
  • Experience with Databricks platform
  • Migrate workloads from legacy systems
  • Experience with cloud platforms (AWS, Azure, GCP)
  • Bachelor's degree in computer science or related field
Good to have:
  • Infrastructure-as-code (Terraform, CloudFormation, Pulumi)
  • Healthcare data standards (HL7, FHIR)
  • Clinical and operational data models
  • Healthcare interoperability requirements
  • Healthcare analytics use cases
  • Advanced degree

Job Details

Overview 
We are seeking an experienced Data Architect with extensive expertise in designing and implementing modern data architectures. This role requires strong software engineering principles, hands-on coding abilities, and experience building data engineering frameworks. The ideal candidate will have a proven track record of implementing Databricks-based solutions in the healthcare industry, with expertise in data catalog implementation and governance frameworks. 
 
About the Role 
As a Data Architect, you will be responsible for designing and implementing scalable, secure, and efficient data architectures on the Databricks platform. You will lead the technical design of data migration initiatives from legacy systems to modern Lakehouse architecture, ensuring alignment with business requirements, industry best practices, and regulatory compliance. 
 

Key Responsibilities

    • Design and implement modern data architectures using Databricks Lakehouse platform 
    • Lead the technical design of Data Warehouse/Data Lake migration initiatives from legacy systems 
    • Develop data engineering frameworks and reusable components to accelerate delivery 
    • Establish CI/CD pipelines and infrastructure-as-code practices for data solutions 
    • Implement data catalog solutions and governance frameworks 
    • Create technical specifications and architecture documentation 
    • Provide technical leadership to data engineering teams 
    • Collaborate with cross-functional teams to ensure alignment of data solutions 
    • Evaluate and recommend technologies, tools, and approaches for data initiatives 
    • Ensure data architectures meet security, compliance, and performance requirements 
    • Mentor junior team members on data architecture best practices 
    • Stay current with emerging technologies and industry trends 

Qualifications

    • Extensive experience in data architecture design and implementation 
    • Strong software engineering background with expertise in Python or Scala 
    • Proven experience building data engineering frameworks and reusable components 
    • Experience implementing CI/CD pipelines for data solutions 
    • Expertise in infrastructure-as-code and automation 
    • Experience implementing data catalog solutions and governance frameworks 
    • Deep understanding of Databricks platform and Lakehouse architecture 
    • Experience migrating workloads from legacy systems to modern data platforms 
    • Strong knowledge of healthcare data requirements and regulations 
    • Experience with cloud platforms (AWS, Azure, GCP) and their data services 
    • Bachelor's degree in computer science, Information Systems, or related field; advanced degree preferred 

Technical Skills

    • Programming languages: Python and/or Scala (required) 
    • Data processing frameworks: Apache Spark, Delta Lake 
    • CI/CD tools: Jenkins, GitHub Actions, Azure DevOps 
    • Infrastructure-as-code (optional): Terraform, CloudFormation, Pulumi 
    • Data catalog tools: Databricks Unity Catalog, Collibra, Alation 
    • Data governance frameworks and methodologies 
    • Data modeling and design patterns 
    • API design and development 
    • Cloud platforms: AWS, Azure, GCP 
    • Container technologies: Docker, Kubernetes 
    • Version control systems: Git 
    • SQL and NoSQL databases 
    • Data quality and testing frameworks

Optional - Healthcare Industry Knowledge

    • Healthcare data standards (HL7, FHIR, etc.) 
    • Clinical and operational data models 
    • Healthcare interoperability requirements 
    • Healthcare analytics use cases 

Similar Jobs

Clearwater Analytics - Sales Operations Lead - Hedge Funds

Clearwater Analytics

New York, United States (On-Site)
3 Weeks ago
Riot Games - Business Operations Manager, China Studio

Riot Games

Shanghai, China (On-Site)
2 Months ago
Notion - Product Counsel

Notion

San Francisco, California, United States (On-Site)
1 Month ago
Barracuda - Manager, Technical Support

Barracuda

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Tekion Corp - Senior Automation QA Engineer

Tekion Corp

Bengaluru, Karnataka, India (On-Site)
4 Days ago
Toast - Software Engineer II - Data Platform Team

Toast

Dublin, County Dublin, Ireland (Hybrid)
3 Weeks ago
Intel  - Senior Data Engineer

Intel

Penang, Malaysia (On-Site)
1 Week ago
Penn Interactive - Senior Data Analyst, Product

Penn Interactive

Toronto, Ontario, Canada (Remote)
18 Hours ago
Extreme Inc. - Data Analysis Engineer

Extreme Inc.

Tokyo, Japan (Hybrid)
2 Months ago
Anavation - Modeling Data Engineer - Ontologist

Anavation

Lorton, Virginia, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

zeta - Senior Software Development Engineer - Frontend

zeta

Hyderabad, Telangana, India (On-Site)
3 Days ago
Axon - Senior Accountant, Revenue Policy & Enablement

Axon

Atlanta, Georgia, United States (Hybrid)
3 Weeks ago
CharacterAI - Lead Growth Product Manager

CharacterAI

Menlo Park, California, United States (On-Site)
4 Months ago
JDA - Senior Analyst - Retail Solutions

JDA

London, England, United Kingdom (Remote)
1 Week ago
Playtika - Marketing Creative Manager

Playtika

Israel (On-Site)
4 Months ago
Apple - Senior Machine Learning Research Engineer (Computer Vision)

Apple

Seattle, Washington, United States (On-Site)
2 Months ago
deel. - Senior Backend Engineer, Node.js + AWS

deel.

United Kingdom (Remote)
1 Day ago
Roblox - Senior Product Manager, Profile

Roblox

San Mateo, California, United States (Hybrid)
1 Month ago
zoox - Senior Manager, Supply Chain Operations

zoox

Foster City, California, United States (Hybrid)
1 Year ago
Sprinkler - Senior Product Engineer (Backend)

Sprinkler

Gurugram, Haryana, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in India

Alpha Sense - Content Analyst

Alpha Sense

Mumbai, Maharashtra, India (On-Site)
14 Hours ago
Capgemini - Selenium + API Testing

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Adobe - Engineering Manager

Adobe

Noida, Uttar Pradesh, India (On-Site)
2 Months ago
Ethos Life - Customer Engagement Associate

Ethos Life

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Aristocrat - Lead Game Mathematician

Aristocrat

Gurugram, Haryana, India (Hybrid)
3 Months ago
Bluevine India - Sr. ML Engineer (Python developer)

Bluevine India

Bengaluru, Karnataka, India (Hybrid)
4 Days ago
CyberArk - Senior SDET

CyberArk

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
PhonePe - Specialist - Benefits Administration

PhonePe

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Ruselle Investments - Senior Business Analyst I

Ruselle Investments

Mumbai, Maharashtra, India (On-Site)
1 Year ago
Nagarro - Staff Consultant ,SAP Analytics Data Manageme

Nagarro

Gurugram, Haryana, India (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Cognite - Senior Data Engineer

Cognite

Pau, Nouvelle-Aquitaine, France (Hybrid)
2 Months ago
Discord - Data Scientist, Analytics - Safety Response

Discord

San Francisco, California, United States (On-Site)
3 Weeks ago
Demandbase - Senior Data Engineer - DSP

Demandbase

United States (Remote)
18 Hours ago
Penn Interactive - Senior Data Analyst, Product

Penn Interactive

Philadelphia, Pennsylvania, United States (Remote)
18 Hours ago
The Walt Disney Company - Associate Business Systems Analyst

The Walt Disney Company

Hong Kong (On-Site)
6 Months ago
Crunchyroll - Senior Data Analyst

Crunchyroll

Hyderabad, Telangana, India (On-Site)
4 Months ago
Playstation - Senior Data Scientist

Playstation

San Diego, California, United States (Hybrid)
3 Weeks ago
PwC - Senior Associate_Azure Data Engineer-- Data and Analytics_Advisory_Gurugram

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago
TransUnion - Data Scientist

TransUnion

White Plains, New York, United States (Hybrid)
16 Hours ago
Unity - Senior Data Scientist

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded