Senior Software Engineer, AI Infra

NVIDIA is seeking a Senior Software Engineer for its AI Infrastructure Group in Tel Aviv, Israel. This role involves innovating AI technology by composing and evolving core systems for thousands of GPUs and nodes. The engineer will focus on crafting scalable, reliable, and high-performance enterprise-grade systems, optimizing microservices with Kubernetes, and developing advanced identity management and multi-tenant solutions to secure NVIDIA’s AI and GPU cloud platforms. The ideal candidate is passionate about distributed systems, cloud-native infrastructure, and AI performance optimization.

Must Have

• Craft and develop enterprise-grade systems with a strong focus on scalability, reliability, and performance.
• Build and optimize microservices-based architectures using Kubernetes and cloud-native technologies.
• Collaborate closely with backend engineers, product managers, and other partners to deliver impactful solutions.
• Write clean, maintainable, and testable code in Go, contributing to CI/CD pipelines.
• Conduct code and build reviews to uphold high-quality standards.
• Lead the development and implementation of advanced identity management systems.
• Develop scalable multi-tenant solutions.
• Collaborate with cross-functional teams to integrate identity and access management features.
• B.Sc. in Computer Science or a related field (or equivalent experience).
• 5+ years of experience in backend software development, including system design and architecture.
• Proficiency in at least one backend programming language (Go preferred).
• Strong knowledge in microservices architecture, RESTful APIs, and relational databases.
• Proficient knowledge of security guidelines and experience applying them in large-scale systems.

Good to Have

• Expertise in Kubernetes internals and advanced cloud-native technologies.
• Experience working in Linux environments with knowledge of networking, security, and virtualization.
• Contributions to open-source projects or active participation in tech communities.
• Agile approach and familiarity with standard methodologies.

Run:AI has improved AI infrastructure by merging GPU virtualization with Kubernetes-native tech to power innovative AI factories. We aim to speed up enterprise AI projects with smart orchestration, and scalability for AI workloads. Seeking a skilled Senior Software Engineer for our Infrastructure Group to innovate AI technology. The Infrastructure Group is tasked with composing and evolving the core systems responsible for thousands of GPUs and nodes driving enterprise AI. We invent the foundation that facilitates elastic, secure, and observable AI operations at extensive scale. We are seeking engineers who are passionate about distributed systems, modern cloud-native infrastructure, and AI performance optimization.

What you’ll be doing:

• Crafting and developing enterprise-grade systems with a strong focus on scalability, reliability, and performance.
• Building and optimizing microservices-based architectures using Kubernetes and cloud-native technologies.
• Collaborating closely with backend engineers, product managers, and other partners to deliver impactful solutions.
• Writing clean, maintainable, and testable code in Go, contributing to our CI/CD pipelines.
• Conducting code and build reviews to uphold high-quality standards and mentor team members.
• Leading the development and implementation of advanced identity management systems that secure NVIDIA’s innovative AI and GPU cloud.
• Developing scalable multi-tenant solutions that allow our diverse clientele to harness the power of NVIDIA’s platforms securely and efficiently.
• Collaborating with multi-functional teams to integrate identity and access management features seamlessly into our products, from cloud services to edge computing devices.

What we need to see:

• B.Sc. in Computer Science or a related field (or equivalent experience).
• 5+ years of experience
• Experience in backend software development, including system design and architecture.
• Proficiency in at least one backend programming language (Go preferred).
• Strong knowledge in microservices architecture, RESTful APIs, and relational databases.
• Proficient knowledge of security guidelines and experience applying them in large-scale systems.
• Expertise in implementing OAuth, OIDC, SAML, and other modern authentication protocols - Advantage

Ways to stand out from the crowd:

• Expertise in Kubernetes internals and advanced cloud-native technologies.
• Experience working in Linux environments with knowledge of networking, security, and virtualization.
• Contributions to open-source projects or active participation in tech communities.
• Agile approach and familiarity with standard methodologies.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you! NVIDIA is dedicated to encouraging diversity and is an equal opportunity employer, valuing all aspects of diversity.