Senior/Staff/Principal Engineer – Edge AI LLM 9291
Job Summary
Job Description
Senior/Staff/Principal Engineer role specializing in Edge AI with focus on GPU/TPU acceleration for local Large Language Model (LLM) inference. Requires expertise in embedded GPU/TPU architectures, AI inference model optimization, low-latency model inference pipelines, and experience with edge computing platforms and applications.
Must have:
- GPU/TPU Acceleration
- Edge AI Inference
- LLM Optimization
- Low-Latency Pipelines
Good to have:
- Micro-architecture Development
- GPU Hardware Design
- Edge Computing Platforms
- AI Frameworks
Perks:
- Team Leadership
- Project Management
3 skills required
Job Details
Senior/Staff/Principal Engineer – Edge AI LLM 9291
We are seeking a talented Senior/Staff/Principal Engineer with specialized expertise in GPU/TPU acceleration to join our team. The ideal candidate will have extensive hands-on experience in local Large Language Models (LLM) inference with embedded GPU/TPU architectures. As Principal Engineer specializing in Edge AI, you will play a crucial role in shaping the future Edge AI solution, leveraging the power of GPU/TPU acceleration and enterprise grade, large scale edge compute.
The successful candidate will combine technical excellence with effective leadership, creating a positive impact on both projects and team dynamics.
Key Responsibilities:
- High-Level Design and Architecture
- Influence the Edge AI strategy by providing expert advice on design and architecture.
- Make critical decisions regarding technical directions, scalability, and system performance.
- Develop and optimize AI inference models for deployment on edge devices with embedded GPU/TPU accelerators, focusing on local Low Latency Model (LLM) inference.
- Implement and fine-tune low-latency model inference pipelines to meet real-time performance requirements.
- Collaborate with cross-functional teams to integrate AI inference solutions into edge computing platforms and applications.
- Collaborate with the GPU Hardware Design Team to design and optimize GPUs that power next-generation devices.
- Conduct performance profiling and optimization to maximize the efficiency of GPU/TPU acceleration for local LLM inference.
- Work on micro-architecture development, ensuring efficient execution of graphics, compute, and AI workloads within energy and area constraints.
- Stay current with advancements in GPU/TPU technologies and edge AI frameworks, incorporating them into solution designs as appropriate.
- Provide technical expertise and support to project teams, ensuring successful implementation and deployment of edge AI solutions.
Team Leadership:
- Lead and inspire a team of engineers, providing guidance, setting goals, and ensuring collaboration.
- Oversee project planning, execution, and delivery, ensuring alignment with business objectives.
- Manage all phases of technical projects, from conception to completion.
- Develop project specifications, track progress, and control costs.
- Foster a positive work environment, encouraging professional growth and knowledge sharing.
Similar Jobs
Samsung Semiconductor
San Jose, California, United States (Hybrid)
• 3 Months ago
Marvell
Yokne'am Illit, North District, Israel (On-Site)
• 3 Months ago
Nagarro
Riyadh, Riyadh Province, Saudi Arabia (On-Site)
• 3 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
![Ubisoft - Level Designer [AAA Project]](/_next/image?url=https%3A%2F%2Foutscal-assets.s3.ap-south-1.amazonaws.com%2Fcompany%2Fproduction%2F28-08-2023%2F303ecd07-edd0-411c-bd8a-7aaaff53aa62.png&w=256&q=50)
Activision
Santa Monica, California, United States (On-Site)
• 3 Months ago
DraftKings
Boston, Massachusetts, United States (On-Site)
• 3 Months ago
Tencent
Shenzhen, Guangdong Province, China (On-Site)
• 3 Months ago
Avalanche Studios Group
Stockholm, Stockholm County, Sweden (Hybrid)
• 3 Months ago
Get notifed when new similar jobs are uploaded
Jobs in Toronto, Ontario, Canada
Frima
Québec City, Quebec, Canada (Hybrid)
• 3 Months ago
Behaviour Interactive
Montreal, Quebec, Canada (Hybrid)
• 3 Months ago
IGG
Vancouver, British Columbia, Canada (On-Site)
• 3 Months ago
Get notifed when new similar jobs are uploaded
Similar Category Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
