What if the work you did every day could impact the lives of people you know? Or all of humanity?
At Illumina, we are expanding access to genomic technology to realize health equity for billions of people around the world. Our efforts enable life-changing discoveries that are transforming human health through the early detection and diagnosis of diseases and new treatment options for patients.
Working at Illumina means being part of something bigger than yourself. Every person, in every role, has the opportunity to make a difference. Surrounded by extraordinary people, inspiring leaders, and world changing projects, you will do more and become more than you ever thought possible.
Position Summary
We are seeking a Sr. DevOps Engineer focusing on optimizing the deployment and management of Illumina’s global hybrid enterprise infrastructure and creating automation as it pertains to Illumina’s critical IT systems. This resource will bring subject matter expertise and focus on building infrastructure automation to reduce deployment times, optimize existing manual processes, generate dashboards/reports, etc. while following industry best practices and change management procedures.
The Sr. DevOps Engineer will be responsible for maintaining our global hybrid environment and IT enterprise infrastructure as part of the Global Enterprise Storage & Compute team. This role involves proactive collaboration with Global IT teams and other internal business units to ensure continuous service and security. Additionally, candidates must handle break/fix and enhancement tickets through ServiceNow and Jira.
Responsibilities
Infrastructure Management:
- Design, build, and maintain scalable and secure infrastructure environments, including cloud platforms (e.g., Azure, AWS) and on-premises virtual systems such as VMware vCenter.
- Implement infrastructure as code (IaC) concepts by automating resource provisioning and setup with technologies like Terraform, Azure Resource Manager, or Cloud Formation.
- Collaborate with the Global Enterprise Storage & Compute team to ensure adequate monitoring, logging, performance, and cost optimization of infrastructure components.
- Manage development, testing, and production environments, ensuring consistency and dependability.
Configuration Management And Automation
- Build and maintain configuration management tools like Cloud Formation, Azure Resource Manager, Terraform, Ansible, and Helm to automate the provisioning and management of containerized systems and infrastructure configurations.
- Maintain version control of configuration files and ensure consistency across environments.
- Automate repetitive tasks and workflows using scripting languages such as PowerShell, Bash, and Python.
Site / Product Reliability
- Improve reliability, quality, and reduce deployment times of infrastructure, through effective hosting, monitoring, operations, and automation.
- Proactively deliver on SLOs identifying and remediating issues keeping production performance within service SLAs
- Responsible for establishing end-to-end monitoring and alerting on all critical products, application, infrastructure components to ensure SLAs and get proactive notifications of issues for all systems.
- Participate in 24x7 an On-Call rotation as needed.
- Partake in quarterly maintenance activities.
Logging, Monitoring And Performance Optimization
- Implement and configure monitoring tools (e.g., Grafana, Prometheus, Azure Monitor, AWS/Azure Cost Monitoring) to track/report system health, performance, and availability.
- Analyze system and application logs to identify and resolve performance bottlenecks, errors, and security vulnerabilities.
- Collaborate with Global Enterprise Storage and Compute team with internal business units to implement logging and monitoring for cloud/hybrid infrastructure, enterprise applications, and micro-services.
- Collaborate with Global Enterprise Storage and Compute team and Security engineering to implement security logging for infrastructure and enterprise applications.
Security And Compliance
- The DevOps Engineer will ensure that the enterprise applications and infrastructure meet all necessary security and compliance requirements.
- This may involve implementing best practices for network security, encryption at transit/rest, data protection, SSL, infrastructure patch/vulnerability management, and access control.
- The DevOps Engineer will also work to ensure that the applications and infrastructure are compliant with industry standard compliance (e.g., SOX, HIPAA, ISO) and will be responsible for maintaining the necessary documentation to demonstrate compliance to Auditors and stakeholders.
Documentation Of DevOps Processes And Procedures
- The DevOps Engineer will create and maintain documentation that outlines the processes and procedures used to orchestrate global cloud and on-premises infrastructure and deploy, maintain the cloud and enterprise applications.
- This documentation may include architecture diagrams, deployment guides, runbooks, work instructions, and other relevant materials. This documentation will help ensure that the project can be maintained and scaled by other team members, and it will serve as a reference for future projects.
Collaboration And Communication
- Foster collaboration and effective communication between Manufacturing, Global IT operations, Finance, Legal, and other cross-functional teams.
- Participate in core team meetings, project/planning meetings, provide technical insights, provide process enhancement strategies, and contribute to the successful product delivery of critical infrastructure components.
- Work closely with stakeholders and vendors/VARs to gather requirements, assess requirements, create cost models, and provide technical guidance on DevOps/Infrastructure best practices and solutions.
Requirements
- Infrastructure as code (Iac), specifically using Terraform / Ansible / CloudFormation / Azure Resource Manager
- Experience in enterprise compute and storage design and administration, physical hardware such as rack mount and chassis/blade servers; block and file storage technologies such as Pure Storage, Dell, etc.
- Design, build and maintain infrastructure automated processes and tools (Rundeck, Jenkins, Azure DevOps, GitHub Actions, GitHub)
- Cloud Engineering experience with multi-cloud, preferably Azure and AWS.
- Networking (VPC, VNETs, security groups, ALB/NLB, NAT, Route53, VPNs, WAF) and Network Architecture (ELB, NGINX, SSL, DNS, DHCP, IPsec)
- Programming/Language skills – bash scripting, PowerShell, Python, GO, SQL, NoSQL, log query languages, and the utilization of APIs.
- Advanced Experience in Windows Server and Linux OS
- Experience in the management of Windows Server OS, VMWare vCenter, SAN storage, HPE Server Hardware, HPE OneView, Windows Failover Clustering, Microsoft SQL Server, Postgres, SMB, NFS, Widows Server Patching, etc.
- Docker experience with the orchestration tools, especially Kubernetes/EKS/AKS, Rancher, or other container management solution
- In-depth experience with the YAML config management, especially Helm, Terraform & Ansible
- Experience with Agile processes, testing, and code/peer review
- High Availability, Disaster Recovery, Capacity, Performance and Cost management
- Logging, Monitoring and Alerting (On-Call) – Grafana, Datadog, New Relic, Azure Monitor, PagerDuty, ELK, CloudWatch etc.,
- Change control process and DevOps/SRE standard best practices
- Atlassian JIRA and Confluence Experience
- ServiceNow ticket and change management experience
- Advanced knowledge of Disaster Recovery strategies, controls, and mitigations
- Experience in patch and vulnerability management
Preferred Experience/Education/Skills
- Candidate must meet Responsibilities and Requirements
- A minimum of 6 years of related experience with a bachelor’s degree in computer science, Information Services, or Information Technology.
- Minimum of 5 years of experience in scripting or coding in PowerShell, Python, Bash, or similar languages.
- Minimum of 5 years of experience in FinOps and Cloud Cost Management
- Minimum of 6 years of advanced experience in Windows and Linux Server administration and management
- Experience using software development tools / IDEs such as MS Visual Studio Code, Postman, etc.
- Experience using centralized automation platforms such as Ansible, Rundeck, etc.
- General experience with database technologies and programming such as MS SQL Server, Postgres, etc.
- Experience in software development or in test automation of REST APIs
- Experience in Java or similar Object-Oriented Programming language required
- Experience working with GitHub, Git, and Jira, ServiceNow preferred
- Working experience in Agile SDLC and Continuous Integration
- Experience working on a high-performing global team in fast-paced, regulated environments (SOX, FDA, HIPAA, etc.).
- Currently has or obtaining certification for VMware Certified Professional Data Center Virtualization, Azure Solution Architect, and/or AWS Solutions Architect.
Illumina believes that everyone has the ability to make an impact, and we are proud to be an equal opportunity employer committed to providing employment opportunity regardless of sex, race, creed, color, gender, religion, marital status, domestic partner status, age, national origin or ancestry, physical or mental disability, medical condition, sexual orientation, pregnancy, military or veteran status, citizenship status, and genetic information.
