Principal Engineer, AI System Architect

6 Days ago • 15 Years + • Systems Design • $214,060 PA - $341,940 PA

Job Summary

Job Description

The Architecture Research Lab (ARL) at Samsung Semiconductor seeks an AI System Architect to design next-generation AI systems addressing memory bandwidth and communication bottlenecks. Responsibilities include architecting AI systems for state-of-the-art performance, providing technical leadership in compute, memory, and network topologies, developing and validating system models, and collaborating with HW/SW architects and application experts. The role involves leveraging modeling for design space exploration and optimization, addressing modern AI challenges using Samsung's memory technologies, and working on hardware/software co-design. Occasional travel is required.
Must have:
  • PhD in CS/EE or related field
  • 15+ years experience in system architecture
  • Deep expertise in AI system design (LLMs, DLRMs)
  • Understanding of compute, memory, networking bottlenecks
  • AI hardware architecture experience
  • Hardware/software co-design for AI
  • Analytical & simulation model development
  • Strong leadership and communication skills
Good to have:
  • Experience in ML compilers and runtime optimization
  • Familiarity with AI software stacks and frameworks
Perks:
  • 4+ weeks paid time off
  • Medical/Dental/Vision/401k
  • Fertility care/adoption stipend
  • Medical travel support
  • Paid therapy sessions
  • Onsite gym and café
  • Flexible work environment
  • Charitable giving match

Job Details

Please Note:

To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. 

Advancing the World’s Technology Together
Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future. 

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities.

What You’ll Do

The Architecture Research Lab (ARL) is tackling two of the biggest challenges in AI today—memory bandwidth and communication bottlenecks. By leveraging Samsung’s world-leading memory technologies, we are developing next-generation AI systems that break through these limitations while improving developer productivity.

This effort spans:

  • Hardware: Memory, networking, compute, and power optimization.
  • Software: System software, frameworks, and runtime optimization.
  • Application & Performance Modeling: Developing tools to guide architectural decisions.

We are seeking an AI System Architect to help shape the future of AI systems through innovative system-level hardware design, performance modeling, and hardware/software co-design.

Location: Hybrid, working onsite at our San Jose  office/headquarters 3 days per week  with the flexibility to work remotely the remainder of your time

Job ID: 42536

Key Responsibilities

  • Architect next-generation AI systems to address modern AI challenges and achieve state-of-the-art system-level performance
  • Provide technical leadership, driving system component direction and selection in the area of the compute, memory and network topologies; analyze bottlenecks and come up with innovative solutions
  • Supervise the development and validation of analytical and simulation-based system models to project AI system performance.
  • Leverage modeling infrastructure for design space exploration and system-level optimization.
  • Collaborate effectively with other HW/SW architects, application experts, and performance modeling experts across sites and time zones  
  • Occasional domestic and international travel (<10%).

 What You Bring

  • PhD in Computer Science, Electrical Engineering, or a related field with 15+ years of experience in system architecture for large-scale computing, with specific AI focus preferred. 
  • Deep expertise in AI system design, and knowledges in LLMs, DLRMs, and other representative AI workloads.
  • Strong understanding of compute, memory, and networking bottlenecks in AI systems.
  • Proven experience in AI hardware architecture at both system and component levels.
  • Background in hardware/software co-design for AI systems.
  • Hands-on experience in developing analytical and event-driven simulation models.
  • Experience in ML compilers and runtime optimization preferred.
  • Familiarity with AI software stacks and frameworks preferred.
  • Strong leadership skills with a track record of setting technical direction and guiding teams.
  • Excellent verbal, presentation, and written communication skills.
  • A collaborative mindset, curiosity, and resilience in solving complex challenges.

#LI-SF1

What We Offer
The pay range below is for all roles at this level across all US locations and functions. Individual pay rates depend on a number of factors—including the role’s function and location, as well as the individual’s knowledge, skills, experience, education, and training. We also offer incentive opportunities that reward employees based on individual and company performance. 

This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision/401k, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours.

Give Back With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community.
Enjoy Time Away You’ll start with 4+ weeks of paid time off a year, plus holidays and sick leave, to rest and recharge.
Care for Family Whatever family means to you, we want to support you along the way—including a stipend for fertility care or adoption, medical travel support, and an errand service.
Prioritize Emotional Wellness With on-demand apps and paid therapy sessions, you’ll have support no matter where you are.
Stay Fit Eating well and being active are important parts of a healthy life. Our onsite Café and gym, plus virtual classes, make it easier.
Embrace Flexibility Benefits are best when you have the space to use them. That’s why we facilitate a flexible environment so you can find the right balance for you.

Base Pay Range

$214,060 - $341,940 USD

Equal Opportunity Employment Policy 

Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.

When selecting team members, we prioritize talent and qualities such as humility, kindness, and dedication. We extend comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long-term conditions, neurodivergent individuals, or those requiring pregnancy-related support. All candidates scheduled for an interview will receive guidance on requesting accommodations.

Recruiting Agency Policy

We do not accept unsolicited resumes. Only authorized recruitment agencies that have a current and valid agreement with Samsung Semiconductor, Inc. are permitted to submit resumes for any job openings.

Covid-19 Policy

To help keep our employees, customers, and communities safe, we've developed guidelines for our team. Currently, we encourage vaccination for all employees and may require it depending on job functions (e.g., traveling for business, meeting with customers). While visiting our offices or attending team events, we ask employees to complete a daily health questionnaire and complete a weekly COVID test. Our COVID policies are subject to change depending on public health, regulatory, and business circumstances. 

Applicant Privacy Policy
https://semiconductor.samsung.com/us/careers/privacy

 

Similar Jobs

CloudHire - Salesforce Developer L5/6 (Vlocity)

CloudHire

Karnataka, India (Remote)
2 Weeks ago
Virtuos - 3D Vehicle Artist

Virtuos

Vietnam (On-Site)
1 Week ago
Techland - Senior Cinematic Artist

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
1 Month ago
Playgendary - Lead Motion Designer

Playgendary

Limassol, Limassol, Cyprus (Remote)
1 Month ago
Universal Music - Senior Vice President, eCommerce & Artist Services

Universal Music

New York, New York, United States (On-Site)
4 Weeks ago
IGT - Senior Director, System Design

IGT

Las Vegas, Nevada, United States (Hybrid)
3 Months ago
Epic Games - Principal Platform Engineer

Epic Games

(On-Site)
2 Months ago
Tesla - Mechanical Engineer, Technical Service, Vehicle Manufacturing

Tesla

Brandenburg, Germany (On-Site)
1 Month ago
NVIDIA - Chip Architect

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
Epic Games - Senior Gameplay Systems Developer, Developer Relations

Epic Games

Vancouver, British Columbia, Canada (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Techland - UE5 Game Programmer

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
3 Weeks ago
InMobiInMobi - Senior Analyst - Business Insights

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
People Can Fly - Corporate Securities Legal Counsel

People Can Fly

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Weeks ago
TRAGsoft - Game Systems Designer (Coromon: Rogue Planet)

TRAGsoft

(Remote)
6 Months ago
Moon Active - Team Manager, Game Design Tools

Moon Active

Warsaw, Masovian Voivodeship, Poland (On-Site)
4 Months ago
Techland - Rendering Programmer

Techland

Poland (On-Site)
9 Months ago
CD PROJEKT RED - Engineer, Physics

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago
Abstraction games - IT Systems Administrator

Abstraction games

Eindhoven, North Brabant, Netherlands (On-Site)
1 Week ago
CD PROJEKT RED - Intern in Online Services Team (C++)

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
4 Weeks ago
Nielsen Holdings - Senior Software Engineer - Windows\C++\.Net -AM-TECH-DA-85

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

Epic Games - Principal Cloud Engineer

Epic Games

Cary, North Carolina, United States (On-Site)
2 Months ago
Next Level Business Services - Microstrategy Lead

Next Level Business Services

San Francisco, California, United States (On-Site)
5 Months ago
ION - Junior Private Credit Reporter - Debtwire North America

ION

New York, New York, United States (On-Site)
5 Months ago
NVIDIA - Senior System Software Engineer, Deep Learning Accelerator

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
Visual Concepts - Senior Software Engineer (Gameplay) - WWE 2K

Visual Concepts

Agoura Hills, California, United States (On-Site)
4 Days ago
ZeniMax Media - Build Programmer

ZeniMax Media

Rockville, Maryland, United States (On-Site)
6 Months ago
Next Level Business Services - Software Design Engineer

Next Level Business Services

Santa Clara, California, United States (On-Site)
5 Months ago
Next Level Business Services - Java Developer

Next Level Business Services

Dallas, Texas, United States (On-Site)
5 Months ago
AGBO - Visual Development/Universe Intern - Summer 2025

AGBO

Los Angeles, California, United States (On-Site)
5 Days ago
The Walt Disney Company - Software Engineer, Tools Internals (Core)

The Walt Disney Company

Emeryville, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Systems Design Jobs

Epic Games - Senior SDET, Gameplay

Epic Games

Cary, North Carolina, United States (On-Site)
6 Months ago
Rolls Royce - Field Service Engineer

Rolls Royce

Saudi Arabia (On-Site)
6 Months ago
Epic Games - Senior Engine Programmer, Fortnite Tech

Epic Games

(On-Site)
1 Week ago
Tesla - Control Room Operator - Technical Service

Tesla

Brandenburg, Germany (On-Site)
1 Month ago
Epic Games - Senior Server Programmer

Epic Games

London, England, United Kingdom (On-Site)
1 Week ago
Regent Craft - Systems Safety Engineering Intern

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
5 Months ago
31st Union - Senior Gameplay Engineer

31st Union

San Mateo, California, United States (On-Site)
1 Week ago
The Walt Disney Company - Controls Engineer

The Walt Disney Company

Hong Kong (On-Site)
1 Week ago
Google - Software Engineer, PhD, Early Career, Campus, Embedded Systems and Firmware, 2025 start

Google

Mountain View, California, United States (On-Site)
4 Months ago
Fluence - Senior Elektroingenieur (m/w/d) - Batteriespeicher Projekte

Fluence

Berlin, Berlin, Germany (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Jose, California, United States (On-Site)

San Jose, California, United States (Remote)

San Jose, California, United States (Hybrid)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (Hybrid)

Austin, Texas, United States (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Samsung Semiconductor

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug