Principal Engineer, AI System Architect

2 Months ago • 15 Years + • Systems Design • $214,060 PA - $341,940 PA

Job Summary

Job Description

The Architecture Research Lab (ARL) at Samsung Semiconductor seeks an AI System Architect to design next-generation AI systems addressing memory bandwidth and communication bottlenecks. Responsibilities include architecting AI systems for state-of-the-art performance, providing technical leadership in compute, memory, and network topologies, developing and validating system models, and collaborating with HW/SW architects and application experts. The role involves leveraging modeling for design space exploration and optimization, addressing modern AI challenges using Samsung's memory technologies, and working on hardware/software co-design. Occasional travel is required.
Must have:
  • PhD in CS/EE or related field
  • 15+ years experience in system architecture
  • Deep expertise in AI system design (LLMs, DLRMs)
  • Understanding of compute, memory, networking bottlenecks
  • AI hardware architecture experience
  • Hardware/software co-design for AI
  • Analytical & simulation model development
  • Strong leadership and communication skills
Good to have:
  • Experience in ML compilers and runtime optimization
  • Familiarity with AI software stacks and frameworks
Perks:
  • 4+ weeks paid time off
  • Medical/Dental/Vision/401k
  • Fertility care/adoption stipend
  • Medical travel support
  • Paid therapy sessions
  • Onsite gym and café
  • Flexible work environment
  • Charitable giving match

Job Details

Please Note:

To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. 

Advancing the World’s Technology Together
Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future. 

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities.

What You’ll Do

The Architecture Research Lab (ARL) is tackling two of the biggest challenges in AI today—memory bandwidth and communication bottlenecks. By leveraging Samsung’s world-leading memory technologies, we are developing next-generation AI systems that break through these limitations while improving developer productivity.

This effort spans:

  • Hardware: Memory, networking, compute, and power optimization.
  • Software: System software, frameworks, and runtime optimization.
  • Application & Performance Modeling: Developing tools to guide architectural decisions.

We are seeking an AI System Architect to help shape the future of AI systems through innovative system-level hardware design, performance modeling, and hardware/software co-design.

Location: Hybrid, working onsite at our San Jose  office/headquarters 3 days per week  with the flexibility to work remotely the remainder of your time

Job ID: 42536

Key Responsibilities

  • Architect next-generation AI systems to address modern AI challenges and achieve state-of-the-art system-level performance
  • Provide technical leadership, driving system component direction and selection in the area of the compute, memory and network topologies; analyze bottlenecks and come up with innovative solutions
  • Supervise the development and validation of analytical and simulation-based system models to project AI system performance.
  • Leverage modeling infrastructure for design space exploration and system-level optimization.
  • Collaborate effectively with other HW/SW architects, application experts, and performance modeling experts across sites and time zones  
  • Occasional domestic and international travel (<10%).

 What You Bring

  • PhD in Computer Science, Electrical Engineering, or a related field with 15+ years of experience in system architecture for large-scale computing, with specific AI focus preferred. 
  • Deep expertise in AI system design, and knowledges in LLMs, DLRMs, and other representative AI workloads.
  • Strong understanding of compute, memory, and networking bottlenecks in AI systems.
  • Proven experience in AI hardware architecture at both system and component levels.
  • Background in hardware/software co-design for AI systems.
  • Hands-on experience in developing analytical and event-driven simulation models.
  • Experience in ML compilers and runtime optimization preferred.
  • Familiarity with AI software stacks and frameworks preferred.
  • Strong leadership skills with a track record of setting technical direction and guiding teams.
  • Excellent verbal, presentation, and written communication skills.
  • A collaborative mindset, curiosity, and resilience in solving complex challenges.

#LI-SF1

What We Offer
The pay range below is for all roles at this level across all US locations and functions. Individual pay rates depend on a number of factors—including the role’s function and location, as well as the individual’s knowledge, skills, experience, education, and training. We also offer incentive opportunities that reward employees based on individual and company performance. 

This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision/401k, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours.

Give Back With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community.
Enjoy Time Away You’ll start with 4+ weeks of paid time off a year, plus holidays and sick leave, to rest and recharge.
Care for Family Whatever family means to you, we want to support you along the way—including a stipend for fertility care or adoption, medical travel support, and an errand service.
Prioritize Emotional Wellness With on-demand apps and paid therapy sessions, you’ll have support no matter where you are.
Stay Fit Eating well and being active are important parts of a healthy life. Our onsite Café and gym, plus virtual classes, make it easier.
Embrace Flexibility Benefits are best when you have the space to use them. That’s why we facilitate a flexible environment so you can find the right balance for you.

Base Pay Range

$214,060 - $341,940 USD

Equal Opportunity Employment Policy 

Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.

When selecting team members, we prioritize talent and qualities such as humility, kindness, and dedication. We extend comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long-term conditions, neurodivergent individuals, or those requiring pregnancy-related support. All candidates scheduled for an interview will receive guidance on requesting accommodations.

Recruiting Agency Policy

We do not accept unsolicited resumes. Only authorized recruitment agencies that have a current and valid agreement with Samsung Semiconductor, Inc. are permitted to submit resumes for any job openings.

Covid-19 Policy

To help keep our employees, customers, and communities safe, we've developed guidelines for our team. Currently, we encourage vaccination for all employees and may require it depending on job functions (e.g., traveling for business, meeting with customers). While visiting our offices or attending team events, we ask employees to complete a daily health questionnaire and complete a weekly COVID test. Our COVID policies are subject to change depending on public health, regulatory, and business circumstances. 

Applicant Privacy Policy
https://semiconductor.samsung.com/us/careers/privacy

 

Similar Jobs

Kolibri Games - Creative Marketing Lead

Kolibri Games

Berlin, Berlin, Germany (Hybrid)
2 Months ago
NielsenIQ - Client Service Delivery Executive

NielsenIQ

Almaty, Almaty Region, Kazakhstan (On-Site)
3 Weeks ago
Daybreak - Creative Director

Daybreak

San Diego, California, United States (Hybrid)
1 Month ago
Skillz - Lead Cloud Engineer

Skillz

San Francisco, California, United States (On-Site)
2 Months ago
INTEL - AI Frameworks Engineer

INTEL

Phoenix, Arizona, United States (Hybrid)
3 Weeks ago
Meta - Research Scientist Intern, Systems ML - SW/HW Co-Design - CHIPs

Meta

Menlo Park, California, United States (On-Site)
6 Months ago
SmileGate - System Planner, LOST ARK Mobile

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
2 Months ago
Google - Senior Hardware Engineer, Control Electronics, Quantum AI

Google

Goleta, California, United States (On-Site)
1 Month ago
Assystems - I&C Engineer- Senior.

Assystems

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Epic Games - Senior Gameplay Systems Developer, Developer Relations

Epic Games

Montreal, Quebec, Canada (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Triple Dot Studios - Senior Game Designer

Triple Dot Studios

Minsk, Minsk Region, Belarus (Hybrid)
3 Months ago
Falcon X - Institutional Coverage

Falcon X

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Stake Logic - Middle Manual QA Engineer

Stake Logic

(Remote)
1 Week ago
Arcadia - Lead Engineer - Connector Engineering

Arcadia

Chennai, Tamil Nadu, India (Hybrid)
2 Weeks ago
Pixle Pool - Senior/Staff Software Engineer

Pixle Pool

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (Hybrid)
3 Years ago
Samsung Semiconductor - Associate Manager, Accounts Payable

Samsung Semiconductor

San Jose, California, United States (On-Site)
2 Months ago
CD PROJEKT RED - Game Capture Lead

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago
Applike Group - DevOps Engineer

Applike Group

Hamburg, Hamburg, Germany (Hybrid)
2 Years ago
CD PROJEKT RED - Lead PCG/Tools Engineer

CD PROJEKT RED

Boston, Massachusetts, United States (Hybrid)
1 Month ago
ION - Technical Support Analyst, Toronto - 4363

ION

Toronto, Ontario, Canada (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

Veeam Software - Customer Success, Architect (Kasten)

Veeam Software

Georgia, United States (Remote)
2 Months ago
TFL Group - Customer Experience Coordinator

TFL Group

Overland Park, Kansas, United States (On-Site)
2 Weeks ago
The EW. Scripps Company - Multimedia Journalist

The EW. Scripps Company

Grand Rapids, Michigan, United States (On-Site)
2 Weeks ago
lifechruh - Generosity Impact Manager

lifechruh

Edmond, Oklahoma, United States (On-Site)
1 Month ago
ByteDance - Mobile App Engineering Intern (Product RD and Infrastructure - Global E- Commerce) - 2025 Summer (BS/MS)

ByteDance

San Jose, California, United States (On-Site)
7 Months ago
KingsIsle Entertainment - Build and Tools Software Engineer

KingsIsle Entertainment

Texas, United States (Hybrid)
2 Months ago
UPF Industries  - Moffett Truck Driver

UPF Industries

Athens, Alabama, United States (On-Site)
1 Week ago
Bright Machines - Research Perception Scientist, Computer Vision and Machine Learning

Bright Machines

San Francisco, California, United States (On-Site)
7 Months ago
Linden Lab - Trust & Safety Specialist

Linden Lab

Atlanta, Georgia, United States (On-Site)
3 Months ago
Doola - Director of Influencer Marketing

Doola

New York, New York, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Systems Design Jobs

Fuse Games - Systems Engineer

Fuse Games

Guildford, England, United Kingdom (Hybrid)
2 Months ago
NVIDIA - Software Engineering Intern - OpenBMC

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
Samsung Semiconductor - Senior Staff Engineer, ASIC Design

Samsung Semiconductor

San Jose, California, United States (Hybrid)
2 Months ago
Tesla - Mechanical Engineer, Technical Service, Vehicle Manufacturing

Tesla

Brandenburg, Germany (On-Site)
3 Months ago
Tesla - Senior Project Engineer - BESS, EMEA

Tesla

North Holland, Netherlands (On-Site)
3 Months ago
Tesla - Control Room Operator - Technical Service

Tesla

Brandenburg, Germany (On-Site)
3 Months ago
Epic Games - Senior Designer, Cosmetic Ecosystem

Epic Games

London, England, United Kingdom (On-Site)
1 Month ago
Epic Games - Narrative Systems Designer

Epic Games

Montreal, Quebec, Canada (On-Site)
4 Months ago
Epic Games - Senior Gameplay Systems Programmer, Fortnite

Epic Games

Canada (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (Hybrid)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Samsung Semiconductor

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug