Job Description
This role involves designing, implementing, and optimizing infrastructure, tools, and the environment for a Finance Data Repository (FDR) for a Rackspace client. Responsibilities include configuring and maintaining Databricks clusters and workspaces, implementing access controls and security policies, providing technical support, collaborating with data engineers on integrations, and optimizing cluster configurations for performance and cost-effectiveness. The position also involves managing auto-scaling, monitoring performance, performing configuration management using Terraform, defining a DevSecOps strategy, evaluating and improving CI/CD pipelines, and setting up a highly automated DevSecOps pipeline for data workloads. The ideal candidate will have strong Databricks implementation experience, experience delivering complex data projects, experience with Agile and DevSecOps, cloud technologies, and tools like Jira, Confluence, Github, and Bitbucket.
Must Have:
- Strong Databricks experience
- Experience architecting complex data systems
- Agile & DevSecOps experience
- Cloud technologies expertise
- Terraform experience
- CI/CD pipeline experience
This role will be working on a staffing project for Rackspace's client
The SRE will be responsible for designing, implementing, and optimizing the infra-structure, tools and environment for Finance Data Repository (FDR). The position will involve working closely with Architects and Engineers on a day-to-day basis.
JOB DESCRIPTION
Role and Responsibilities
· Configure, and maintain Databricks clusters and workspaces
· Implement and manage access controls and security policies to protect data
· Provide technical support to Databricks engineers & other users, including troubleshooting and issue resolution
· Collaborate with data engineers to integrate Databricks with other data sources, distribution points
· Implement and enforce security policies, access controls, and encryption mechanisms
· Optimize cluster configurations for performance and cost-effectiveness
· Monitor and manage auto-scaling to ensure resources are allocated efficiently
· Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance
· Perform configuration management, operations using Terraform (Infra As Code)
· Define DevSecOps strategy for Platform and application
· Evaluate the deployment CICD pipelines and apply techniques to eliminate failed attempts and troubleshoot problems
· Set up a highly automated, easy-to-use DevSecOps pipeline for data workload to meet the necessary enterprise and industry standards
Requirements
· Strong background in Databricks implementation, with experience architecting complex data systems in large-scale environments
· Experience in successful delivery of complex data related projects end to end.
· Experience in Agile and DevSecOps delivery, quality practices, techniques and tools required data platforms
· Experience with cloud-based technologies
· Experience with JIRA, Confluence, Github, Bitbucket and other similar tools
About Rackspace Technology
We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.
More on Rackspace Technology
Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.
About Rackspace Technology
We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.
More on Rackspace Technology
Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.
Set alerts for more jobs like Data Architect
Set alerts for new jobs by Rackspace Technology
Set alerts for new Data Analysis jobs in Vietnam
Set alerts for new jobs in Vietnam
Set alerts for Data Analysis (Remote) jobs
