NIM Solution Architect

NVIDIA is leading company of AI computing. At NVIDIA, our employees are passionate about AI, HPC , VISUAL, GAMING. Our Solution Architect team is more focusing to bring NVIDIA new technology into difference industries. We help to design the architecture of AI computing platform, analysis the AI and HPC applications to deliver our value to customers. This role will be instrumental in leveraging NVIDIA's cutting-edge technologies to optimize open-source and proprietary large models, create AI workflows, and support our customers in implementing advanced AI solutions. 

What you’ll be doing:

• Drive the implementation and deployment of NVIDIA Inference Microservice (NIM) solutions 

• Use NVIDIA NIM Factory Pipeline to package optimized models (including LLM, VLM, Retriever, CV, OCR, etc.) into containers providing standardized API access for on-prem or cloud deployment 

• Refine NIM tools for the community, help the community to build their performant NIMs 

• Design and implement agentic AI tailored to customer business scenarios using NIMs

• Deliver technical projects, demos and client support tasks as directed by the Solution Architecture Leadership 

• Provide technical support and guidance to customers, facilitating the adoption and implementation of NVIDIA technologies and products 

• Collaborate with cross-functional teams to enhance and expand our AI solutions portfolio

• Be an internal champion for NVIDIA software and total solutions in technical community 

• Be an industry thought leader on integrating NVIDIA technology especially inference services into LHA, business partners and whole community 

• Assist in supporting NVAIE team and driving NVAIE business in China 

What we need to see:

• 3+ years working experience with Bachelor's or Master's degree in Computer Science, Artificial Intelligence, or a related field 

• Proven experience in deploying and optimizing large language models 

• Proficiency in at least one inference framework (e.g., TensorRT, ONNX Runtime, PyTorch) 

• Strong programming skills in Python or C++ 

• Familiarity with main stream inference engines (e.g., vLLM, SGLang) 

• Experience with DevOps/MLOps such as Docker, Git, and CI/CD practices 

• Excellent problem-solving skills and ability to troubleshoot complex technical issues 

• Demonstrated ability to collaborate effectively across diverse, global teams, adapting communication styles while maintaining clear, constructive professional interactions 

Ways to stand out from the crowd:

• Experience in architectural design for field LLM projects 

• Expertise in model optimization techniques, particularly using TensorRT 

• Knowledge of AI workflow design and implementation, experience on cluster resource management tools. Familiarity with agile development methodologies 

• CUDA optimization experience, extensive experience designing and deploying large scale HPC and enterprise computing systems