Senior Networking Test Engineer
NVIDIA
Job Summary
Join NVIDIA's End-to-End Verification team as a Senior Networking Test Engineer to test High Performance Ethernet AI networks. You will design, build, and verify large-scale performance platforms, collaborating with cross-functional teams. Responsibilities include design review, test automation mentorship, comprehensive testing (regression, performance, functional, scale), and profiling Deep Learning models to optimize networking aspects for AI workloads.
Must Have
- Contribute to design review and product features requirements under the whole Ethernet/ NIC/DPU/Switch portfolio
- Design and build setup topologies with an emphasis on an emulation of customer large scale / complex environments
- Collaborate closely with multi-functional teams, including hardware engineers, software developers, and domain experts
- Design, mentorship for testing automation team to implement tests
- Generate comprehensive test reports during release execution procedure
- Assist with reproduction and debug complex customer use cases, with determination of the issue root cause
- Complete end-to-end test scenarios in different scopes: Regression, Performance, Functional and Scale
- Report the progress of testing and provide summary reports of testing activity
- Profile, benchmark, and analyze Deep Learning models to identify areas for optimization and improvement
- Provide insights and recommendations based on the analysis of large-scale training results
- B.A./B.Sc. in Computer Science or Electrical Engineering or equivalent experience as IT/Network Engineer
- 3+ years of practical experience
- Very Strong Hands-on experience in Linux based platform
- Expertise in the Linux host side NIC validation and debugging
- Strong hands-on debugging experience in Linux based platform
- Expertise in AI networking libraries (such as NCCL) and protocols (such as RoCE and RDMA)
- Ability to profile and optimize deep learning workflows
- Exceptional analytical and problem-solving skills, with a keen attention to detail
- Fast and self-learner with outstanding technical skills
- Independent, responsible worker, able to plan and complete
- Team player with good English communication and interpersonal skills
- Scripts skills and experience: Bash / Python / Ansible
Good to Have
- Experience in the Collective Communications Library testing (e.g.: NCCL) or Large Language Model testing (LLM) testing
- Experience in the large scaling cluster testing
- Expertise in optimizing networking parameters, such as bandwidth, latency, or congestion control (such as DCQCN), for AI workloads
- Familiarity with NVIDIA's networking technologies, such as Mellanox BF3, CX NIC, and their integration with AI workflows
- Strong understanding of high-performance networking protocols and standards and their application to AI
Job Description
We are looking for an outstanding networking test engineer to join our End-to-End Verification team. You are going to be part of the E2E Verification team with the main goal of testing the most exciting High Performance Ethernet AI network. You will interact with NIC, OS, Switch, HCA, CPU and GPU compute, and systems specialist to architect, develop and bring up large scale performance platforms.
What you'll be doing:
- Contribute to design review and product features requirements under the whole Ethernet/ NIC/DPU/Switch portfolio. Design and build setup topologies with an emphasis on an emulation of customer large scale / complex environments.
- Collaborating closely with multi-functional teams, including hardware engineers, software developers, and domain experts, to deliver optimized solutions that meet the demanding requirements of AI workloads.
- Design, mentorship for testing automation team to implement tests. Generate comprehensive test reports during release execution procedure, assist with reproduction and debugs complex customer use cases, with determination of the issue root cause, be an engineering PIC for the full verification cycles of the customer use cases.
- Complete end-to-end test scenarios in different scopes: Regression, Performance, Functional and Scale; Report the progress of testing and provide summary reports of testing activity.
- Profiling, Benchmarking, and Analyzing Deep Learning models to identify areas for optimization and improvement in terms of performance, efficiency, and accuracy, with a strong emphasis on networking aspects.
- Providing insights and recommendations based on the analysis of large-scale training results, specifically focusing on networking bottlenecks and optimizations, to improve model outcomes and achieve business objectives.
What we need to see:
- B.A./B.Sc. in Computer Science or Electrical Engineering or equivalent experience as IT/Network Engineer.
- 3+ years of practical experience.
- Very Strong Hands-on experience in Linux based platform.
- Expertise in the Linux host side NIC validation and debugging.
- Strong hands-on debugging experience in Linux based platform.
- Expertise in AI networking libraries (such as NCCL) and protocols (such as RoCE and RDMA).
- Ability to profile and optimize deep learning workflows, focusing on networking-related bottlenecks and optimizations, to improve overall performance and efficiency.
- Exceptional analytical and problem-solving skills, with a keen attention to detail, particularly in identifying and resolving networking performance issues.
- Fast and self-learner with outstanding technical skills.
- Independent, responsible worker, able to plan and complete.
- Standout teammate with good English communication and interpersonal skills.
- Scripts skills and experience: Bash / Python / Ansible
Ways to stand out from the crowd:
- Experience in the Collective Communications Library testing(e.g.: NCCL) or Large Language Model testing(LLM) testing.
- Experience in the large scaling cluster testing.
- Expertise in optimizing networking parameters, such as bandwidth, latency, or congestion control (such as DCQCN), for AI workloads.
- Familiarity with NVIDIA's networking technologies, such as Mellanox BF3, CX NIC, and their integration with AI workflows.
- Strong understanding of high-performance networking protocols and standards and their application to AI.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you! NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.