Data Architect

2 Months ago • All levels • DevOps

Job Summary

Job Description

This role involves designing, implementing, and optimizing infrastructure, tools, and the environment for a Finance Data Repository (FDR) for a Rackspace client. Responsibilities include configuring and maintaining Databricks clusters and workspaces, implementing access controls and security policies, providing technical support, collaborating with data engineers on integrations, and optimizing cluster configurations for performance and cost-effectiveness. The position also involves managing auto-scaling, monitoring performance, performing configuration management using Terraform, defining a DevSecOps strategy, evaluating and improving CI/CD pipelines, and setting up a highly automated DevSecOps pipeline for data workloads. The ideal candidate will have strong Databricks implementation experience, experience delivering complex data projects, experience with Agile and DevSecOps, cloud technologies, and tools like Jira, Confluence, Github, and Bitbucket.
Must have:
  • Strong Databricks experience
  • Experience architecting complex data systems
  • Agile & DevSecOps experience
  • Cloud technologies expertise
  • Terraform experience
  • CI/CD pipeline experience

Job Details

This role will be working on a staffing project for Rackspace's client

The SRE will be responsible for designing, implementing, and optimizing the infra-structure, tools and environment for Finance Data Repository (FDR). The position will involve working closely with Architects and Engineers on a day-to-day basis.
 
JOB DESCRIPTION
 
Role and Responsibilities
·        Configure, and maintain Databricks clusters and workspaces
·        Implement and manage access controls and security policies to protect data
·        Provide technical support to Databricks engineers & other users, including troubleshooting and issue resolution
·        Collaborate with data engineers to integrate Databricks with other data sources, distribution points
·        Implement and enforce security policies, access controls, and encryption mechanisms
·        Optimize cluster configurations for performance and cost-effectiveness
·        Monitor and manage auto-scaling to ensure resources are allocated efficiently
·        Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance
·        Perform configuration management, operations using Terraform (Infra As Code)
·        Define DevSecOps strategy for Platform and application
·        Evaluate the deployment CICD pipelines and apply techniques to eliminate failed attempts and troubleshoot problems
·        Set up a highly automated, easy-to-use DevSecOps pipeline for data workload to meet the necessary enterprise and industry standards
 
Requirements
·        Strong background in Databricks implementation, with experience architecting complex data systems in large-scale environments
·        Experience in successful delivery of complex data related projects end to end.
·        Experience in Agile and DevSecOps delivery, quality practices, techniques and tools required data platforms
·        Experience with cloud-based technologies
·        Experience with JIRA, Confluence, Github, Bitbucket and other similar tools
 
 
 
 
About Rackspace Technology
We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.
 
 
More on Rackspace Technology
Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.
About Rackspace Technology
We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.
 
 
More on Rackspace Technology
Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.
undefined

Similar Jobs

PlayStation Global - Technical Program Manager

PlayStation Global

Bristol, England, United Kingdom (On-Site)
4 Hours ago
Nintendo - Localization Specialist (Japanese)

Nintendo

Redmond, Washington, United States (Hybrid)
5 Months ago
Hologate gmbh - Senior UX/UI Designer

Hologate gmbh

Munich, Bavaria, Germany (On-Site)
3 Weeks ago
DraftKings - Manager, Delivery Management

DraftKings

United States (Remote)
2 Months ago
Nintendo - Associate Localization Specialist – Portuguese

Nintendo

Redmond, Washington, United States (Hybrid)
10 Months ago
Visa - Sr. Site Reliability Engineer, Product Reliability Engineering - Middleware

Visa

Austin, Texas, United States (Hybrid)
4 Months ago
Revolgy - Customer Support Engineer—AWS, Kubernetes (remote Europe)

Revolgy

United Kingdom (Remote)
3 Weeks ago
Crunchyroll - Staff Software Engineer

Crunchyroll

Hyderabad, Telangana, India (On-Site)
7 Months ago
NVIDIA - Senior Staff Site Reliability Engineer - CDN

NVIDIA

California, United States (Hybrid)
3 Weeks ago
Google - Customer Engineer, Data and AI

Google

Melbourne, Victoria, Australia (On-Site)
4 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Luxoft - Scrum Master

Luxoft

Gurugram, Haryana, India (On-Site)
4 Months ago
Altair - QA Engineer

Altair

Bengaluru, Karnataka, India (On-Site)
7 Months ago
PlayStation Global - Senior Producer

PlayStation Global

Guildford, England, United Kingdom (Hybrid)
3 Weeks ago
Daybreak Game Company LLC - QA Analyst (Temp)

Daybreak Game Company LLC

San Diego, California, United States (On-Site)
9 Months ago
Evolution - QA Automation Engineer

Evolution

Riga, Latvia (Hybrid)
11 Months ago
Xsolla - Software Engineer (Site Builder)

Xsolla

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (Hybrid)
3 Weeks ago
Larian Studios - RPG DESIGNER

Larian Studios

Quebec, Canada (On-Site)
3 Months ago
Xsolla - Product Manager

Xsolla

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
2 Months ago
G5 Games - Narrative Director

G5 Games

Astana, Astana, Kazakhstan (Remote)
5 Months ago
Super - Senior Product Designer, Core App Experiences

Super

(Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Vietnam

Garena - AI Image Creation Collaborator

Garena

Hanoi, Hanoi, Vietnam (On-Site)
1 Week ago
Garena - Senior Product Specialist

Garena

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
1 Week ago
Google - Industry Manager, Gaming, Large Customer Sales

Google

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
4 Days ago
PwC - Senior Associate - Risk Assurance Services (Business Solution)

PwC

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
5 Months ago
Token Metrics - Financial Analyst Intern (Vietnam-Remote)

Token Metrics

Ho Chi Minh City, Ho Chi Minh City, Vietnam (Remote)
6 Months ago
ByteDance - Customer Success Manager, Vietnam, Lark APAC

ByteDance

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
2 Months ago
Amanotes - 2D Game Artist - Part-time

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (Remote)
3 Weeks ago
Amanotes - Product Data Analyst

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
1 Month ago
Amanotes - Ads Monetization Specialist

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
2 Months ago
Garena - Collaborator, Creative Marketing

Garena

Hanoi, Hanoi, Vietnam (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Revolgy - Senior Cloud Operations Engineer

Revolgy

United Kingdom (Remote)
3 Weeks ago
Starkflow - Oracle Integration Cloud Consultant

Starkflow

(Remote)
5 Days ago
UXBERT Labs - Senior Solution Architect

UXBERT Labs

Riyadh, Riyadh Province, Saudi Arabia (Hybrid)
3 Weeks ago
Google - Cloud Program Manager, Google Cloud Professional Services

Google

Taipei City, Taiwan (On-Site)
3 Days ago
NVIDIA - Senior Site Reliability Engineer - Infrastructure

NVIDIA

Austin, Texas, United States (On-Site)
1 Month ago
Ubisoft - Monitoring Specialist - Golang Developer

Ubisoft

Saint-Mandé, Île-de-France, France (Hybrid)
3 Weeks ago
Google - Customer Engineer, SAP, Google Cloud

Google

Austin, Texas, United States (On-Site)
4 Days ago
Google - Customer Engineer, Application Modernization, Google Cloud

Google

Tokyo, Japan (On-Site)
3 Days ago
Fractal - DevOps - Lead

Fractal

Mumbai, Maharashtra, India (On-Site)
5 Months ago
Rackspace Technology - Senior Machine Learning Engineer

Rackspace Technology

Vietnam (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded