Senior Engineer (Development Operations)

Job Overview:

As a Senior/Staff DevOps Engineer at Lytx, you will play a crucial role in driving our platform's scalability, reliability, and efficiency. This role emphasizes a middleware-first approach, focusing on building the tools and processes that enable seamless infrastructure management while improving developer experience. You’ll work closely with cutting-edge technologies like GitHub Actions, Crossplane, and ArgoCD to enhance automation, streamline workflows, and simplify the adoption of best practices for our development teams. Your deep expertise in managing multi-EKS clusters, service mesh environments, and AWS-native tools will enable you to drive innovation across the organization, improving how developers interact with the infrastructure and how middleware components are integrated and scaled.

You’ll Get To:

• Lead the implementation of innovative middleware solutions that improve the reliability, performance, and scalability of the Lytx infrastructure. You will design processes and frameworks that streamline service integration, from API management to message brokering using tools like Kafka, MQTT, and AWS App Mesh.
• Focus on delivering tools and processes that simplify the developer experience, such as creating automated workflows using GitHub Actions, enhancing deployment processes with ArgoCD, and introducing infrastructure automation with Crossplane.
• Implement and scale frameworks that support our global IoT platform, improving both backend middleware services and front-facing developer productivity systems.
• Design and implement robust MLOps practices and data pipelines that enable the seamless transformation of data into machine learning models, ensuring high-quality, automated deployments for AI/ML use cases.
• Lead efforts in managing and optimizing multi-EKS clusters, enhancing system resilience, load distribution, and high availability across regions.
• Build and manage CI/CD pipelines with a focus on automation using GitHub Actions, integrated with ArgoCD and Crossplane for seamless, declarative management of cloud-native infrastructure.
• Improve middleware services like API Gateway, AWS App Mesh, and messaging systems like Kafka and MQTT, ensuring these core components scale to meet growing business needs.
• Provide mentorship and training for less experienced team members, instilling best practices for managing and scaling middleware infrastructure and improving developer workflows.
• Support additional initiatives as assigned, contributing to the continuous improvement of both the infrastructure and the developer experience.

What You Need:

• A bachelor’s or master’s degree in a technical field, or equivalent experience.
• 9+ years of experience in designing, building, and supporting infrastructure architecture and middleware systems, with a focus on developer experience and CI/CD pipelines.
• Expertise in working with middleware solutions like Kafka, MQTT, and service meshes such as AWS App Mesh, Istio, or Linkerd, with a focus on integration, scaling, and automation.
• Mastery of DevOps principles and practices, including GitOps, GitHub Actions, and ArgoCD, along with experience with Crossplane for infrastructure automation and management.
• Proficiency in building and managing CI/CD pipelines with a developer-centric mindset, ensuring ease of use, automation, and continuous improvement of workflows.
• Strong experience managing and optimizing multi-EKS clusters, ensuring efficient service operation, high availability, and streamlined deployments across multiple regions.
• Proven experience with security best practices, including identity and access management, encryption, and vulnerability assessments for middleware and infrastructure components.
• Hands-on experience with AWS services including API Gateway, App Mesh, EKS, ECS, MSK, Lambda, Redshift, and Kinesis, particularly focusing on middleware integration.
• Expertise in scripting/automation using PowerShell, BASH, Python, Perl, Ansible, and Terraform.
• Solid understanding of networking concepts like routing, load balancing, DNS, and content delivery.
• Exceptional documentation and communication skills, with the ability to present technical concepts to both technical and non-technical audiences, advocating for best practices and improving developer experience.

Preferred:

• AWS Certifications: Advanced and Specialty level AWS certifications.
• MLOps & Data Platforms: Experience with MLOps practices and designing data pipelines to facilitate efficient machine learning operations.
• Service Mesh & Middleware Expertise: Experience in managing middleware systems - Service Mesh, API Gateway, Kafka, and MQTT.