Data Architect (Azure and Databricks)
Job Summary
Job Description
We are seeking an experienced Data Architect with extensive expertise in designing and implementing modern data architectures. This role requires strong software engineering principles, hands-on coding abilities, and experience building data engineering frameworks. The ideal candidate will have a proven track record of implementing Databricks-based solutions, with expertise in data catalog implementation and governance frameworks. As a Data Architect, you will be responsible for designing and implementing scalable, secure, and efficient data architectures on the Databricks platform. You will lead the technical design of data migration initiatives from legacy systems to modern Lakehouse architecture, ensuring alignment with business requirements, industry best practices, and regulatory compliance.
Must have:
- Design and implement modern data architectures using Databricks
- Lead data migration from legacy systems
- Develop data engineering frameworks
- Implement CI/CD pipelines
- Implement data catalog and governance frameworks
- Create technical specifications
- Provide technical leadership
- Collaborate with cross-functional teams
- Evaluate and recommend technologies
- Ensure security, compliance, and performance
- Mentor junior team members
- Stay current with emerging technologies
- Python or Scala expertise
- Experience with Databricks platform
- Migrate workloads from legacy systems
- Experience with cloud platforms (AWS, Azure, GCP)
- Bachelor's degree in computer science or related field
Good to have:
- Infrastructure-as-code (Terraform, CloudFormation, Pulumi)
- Healthcare data standards (HL7, FHIR)
- Clinical and operational data models
- Healthcare interoperability requirements
- Healthcare analytics use cases
- Advanced degree
19 skills required
Job Details
Overview
We are seeking an experienced Data Architect with extensive expertise in designing and implementing modern data architectures. This role requires strong software engineering principles, hands-on coding abilities, and experience building data engineering frameworks. The ideal candidate will have a proven track record of implementing Databricks-based solutions in the healthcare industry, with expertise in data catalog implementation and governance frameworks.
About the Role
As a Data Architect, you will be responsible for designing and implementing scalable, secure, and efficient data architectures on the Databricks platform. You will lead the technical design of data migration initiatives from legacy systems to modern Lakehouse architecture, ensuring alignment with business requirements, industry best practices, and regulatory compliance.
Key Responsibilities
- Design and implement modern data architectures using Databricks Lakehouse platform
- Lead the technical design of Data Warehouse/Data Lake migration initiatives from legacy systems
- Develop data engineering frameworks and reusable components to accelerate delivery
- Establish CI/CD pipelines and infrastructure-as-code practices for data solutions
- Implement data catalog solutions and governance frameworks
- Create technical specifications and architecture documentation
- Provide technical leadership to data engineering teams
- Collaborate with cross-functional teams to ensure alignment of data solutions
- Evaluate and recommend technologies, tools, and approaches for data initiatives
- Ensure data architectures meet security, compliance, and performance requirements
- Mentor junior team members on data architecture best practices
- Stay current with emerging technologies and industry trends
Qualifications
- Extensive experience in data architecture design and implementation
- Strong software engineering background with expertise in Python or Scala
- Proven experience building data engineering frameworks and reusable components
- Experience implementing CI/CD pipelines for data solutions
- Expertise in infrastructure-as-code and automation
- Experience implementing data catalog solutions and governance frameworks
- Deep understanding of Databricks platform and Lakehouse architecture
- Experience migrating workloads from legacy systems to modern data platforms
- Strong knowledge of healthcare data requirements and regulations
- Experience with cloud platforms (AWS, Azure, GCP) and their data services
- Bachelor's degree in computer science, Information Systems, or related field; advanced degree preferred
Technical Skills
- Programming languages: Python and/or Scala (required)
- Data processing frameworks: Apache Spark, Delta Lake
- CI/CD tools: Jenkins, GitHub Actions, Azure DevOps
- Infrastructure-as-code (optional): Terraform, CloudFormation, Pulumi
- Data catalog tools: Databricks Unity Catalog, Collibra, Alation
- Data governance frameworks and methodologies
- Data modeling and design patterns
- API design and development
- Cloud platforms: AWS, Azure, GCP
- Container technologies: Docker, Kubernetes
- Version control systems: Git
- SQL and NoSQL databases
- Data quality and testing frameworks
Optional - Healthcare Industry Knowledge
- Healthcare data standards (HL7, FHIR, etc.)
- Clinical and operational data models
- Healthcare interoperability requirements
- Healthcare analytics use cases
Similar Jobs
Netflix
Los Angeles, California, United States (On-Site)
• 4 Months ago
Scale AI
Washington, District Of Columbia, United States (On-Site)
• 1 Month ago
Philips
Best, North Brabant, Netherlands (On-Site)
• 1 Month ago
Scopely
Mexico City, Mexico City, Mexico (Hybrid)
• 4 Months ago
ISS Stoxx
Makati City, Metro Manila, Philippines (Hybrid)
• 1 Month ago
zeta
Bengaluru, Karnataka, India (On-Site)
• 5 Days ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Scale AI
San Francisco, California, United States (Hybrid)
• 1 Month ago
Blinkhealth
Pittsburgh, Pennsylvania, United States (On-Site)
• 2 Weeks ago
.png%3F1644437644&w=256&q=50){kind=icon}
Get notifed when new similar jobs are uploaded
Jobs in India
Get notifed when new similar jobs are uploaded
Data Analysis Jobs
Apple
Sunnyvale, California, United States (On-Site)
• 1 Month ago
Apple
San Francisco, California, United States (On-Site)
• 3 Weeks ago
Get notifed when new similar jobs are uploaded
