Principal Engineer, AI System Architect

1 Month ago • 15 Years + • Systems Design • $214,060 PA - $341,940 PA

Job Summary

Job Description

The Architecture Research Lab (ARL) at Samsung Semiconductor seeks an AI System Architect to design next-generation AI systems addressing memory bandwidth and communication bottlenecks. Responsibilities include architecting AI systems for state-of-the-art performance, providing technical leadership in compute, memory, and network topologies, developing and validating system models, and collaborating with HW/SW architects and application experts. The role involves leveraging modeling for design space exploration and optimization, addressing modern AI challenges using Samsung's memory technologies, and working on hardware/software co-design. Occasional travel is required.
Must have:
  • PhD in CS/EE or related field
  • 15+ years experience in system architecture
  • Deep expertise in AI system design (LLMs, DLRMs)
  • Understanding of compute, memory, networking bottlenecks
  • AI hardware architecture experience
  • Hardware/software co-design for AI
  • Analytical & simulation model development
  • Strong leadership and communication skills
Good to have:
  • Experience in ML compilers and runtime optimization
  • Familiarity with AI software stacks and frameworks
Perks:
  • 4+ weeks paid time off
  • Medical/Dental/Vision/401k
  • Fertility care/adoption stipend
  • Medical travel support
  • Paid therapy sessions
  • Onsite gym and café
  • Flexible work environment
  • Charitable giving match

Job Details

Please Note:

To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. 

Advancing the World’s Technology Together
Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future. 

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities.

What You’ll Do

The Architecture Research Lab (ARL) is tackling two of the biggest challenges in AI today—memory bandwidth and communication bottlenecks. By leveraging Samsung’s world-leading memory technologies, we are developing next-generation AI systems that break through these limitations while improving developer productivity.

This effort spans:

  • Hardware: Memory, networking, compute, and power optimization.
  • Software: System software, frameworks, and runtime optimization.
  • Application & Performance Modeling: Developing tools to guide architectural decisions.

We are seeking an AI System Architect to help shape the future of AI systems through innovative system-level hardware design, performance modeling, and hardware/software co-design.

Location: Hybrid, working onsite at our San Jose  office/headquarters 3 days per week  with the flexibility to work remotely the remainder of your time

Job ID: 42536

Key Responsibilities

  • Architect next-generation AI systems to address modern AI challenges and achieve state-of-the-art system-level performance
  • Provide technical leadership, driving system component direction and selection in the area of the compute, memory and network topologies; analyze bottlenecks and come up with innovative solutions
  • Supervise the development and validation of analytical and simulation-based system models to project AI system performance.
  • Leverage modeling infrastructure for design space exploration and system-level optimization.
  • Collaborate effectively with other HW/SW architects, application experts, and performance modeling experts across sites and time zones  
  • Occasional domestic and international travel (<10%).

 What You Bring

  • PhD in Computer Science, Electrical Engineering, or a related field with 15+ years of experience in system architecture for large-scale computing, with specific AI focus preferred. 
  • Deep expertise in AI system design, and knowledges in LLMs, DLRMs, and other representative AI workloads.
  • Strong understanding of compute, memory, and networking bottlenecks in AI systems.
  • Proven experience in AI hardware architecture at both system and component levels.
  • Background in hardware/software co-design for AI systems.
  • Hands-on experience in developing analytical and event-driven simulation models.
  • Experience in ML compilers and runtime optimization preferred.
  • Familiarity with AI software stacks and frameworks preferred.
  • Strong leadership skills with a track record of setting technical direction and guiding teams.
  • Excellent verbal, presentation, and written communication skills.
  • A collaborative mindset, curiosity, and resilience in solving complex challenges.

#LI-SF1

What We Offer
The pay range below is for all roles at this level across all US locations and functions. Individual pay rates depend on a number of factors—including the role’s function and location, as well as the individual’s knowledge, skills, experience, education, and training. We also offer incentive opportunities that reward employees based on individual and company performance. 

This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision/401k, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours.

Give Back With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community.
Enjoy Time Away You’ll start with 4+ weeks of paid time off a year, plus holidays and sick leave, to rest and recharge.
Care for Family Whatever family means to you, we want to support you along the way—including a stipend for fertility care or adoption, medical travel support, and an errand service.
Prioritize Emotional Wellness With on-demand apps and paid therapy sessions, you’ll have support no matter where you are.
Stay Fit Eating well and being active are important parts of a healthy life. Our onsite Café and gym, plus virtual classes, make it easier.
Embrace Flexibility Benefits are best when you have the space to use them. That’s why we facilitate a flexible environment so you can find the right balance for you.

Base Pay Range

$214,060 - $341,940 USD

Equal Opportunity Employment Policy 

Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.

When selecting team members, we prioritize talent and qualities such as humility, kindness, and dedication. We extend comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long-term conditions, neurodivergent individuals, or those requiring pregnancy-related support. All candidates scheduled for an interview will receive guidance on requesting accommodations.

Recruiting Agency Policy

We do not accept unsolicited resumes. Only authorized recruitment agencies that have a current and valid agreement with Samsung Semiconductor, Inc. are permitted to submit resumes for any job openings.

Covid-19 Policy

To help keep our employees, customers, and communities safe, we've developed guidelines for our team. Currently, we encourage vaccination for all employees and may require it depending on job functions (e.g., traveling for business, meeting with customers). While visiting our offices or attending team events, we ask employees to complete a daily health questionnaire and complete a weekly COVID test. Our COVID policies are subject to change depending on public health, regulatory, and business circumstances. 

Applicant Privacy Policy
https://semiconductor.samsung.com/us/careers/privacy

 

Similar Jobs

Take-Two Interactive - Systems Administrator I

Take-Two Interactive

İstanbul, İstanbul, Türkiye (On-Site)
1 Day ago
Samsung Semiconductor - Staff Engineer, DRAM

Samsung Semiconductor

San Jose, California, United States (Hybrid)
1 Month ago
Playtika - JavaScript Developer

Playtika

Ukraine (On-Site)
5 Months ago
Blitre Rewards - Back End Engineer

Blitre Rewards

New York, New York, United States (On-Site)
1 Day ago
Techland - Animator

Techland

Poland (On-Site)
8 Months ago
Epic Games - Gameplay Systems Programmer, Fortnite

Epic Games

Cary, North Carolina, United States (On-Site)
2 Months ago
CharacterAI - Engineering Manager, Safety

CharacterAI

Menlo Park, California, United States (On-Site)
1 Month ago
Meta - Optical Engineer

Meta

Redmond, Washington, United States (On-Site)
2 Weeks ago
Epic Games - Senior Designer

Epic Games

United States (On-Site)
2 Months ago
Epic Games - Principal Engine Programmer, Verse Framework

Epic Games

Cary, North Carolina, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Universal Music - Senior Coordinator, Finance

Universal Music

Los Angeles, California, United States (On-Site)
1 Month ago
Coda - Senior/Staff Software Engineer, Custom Commerce

Coda

Bangkok, Thailand (Hybrid)
1 Year ago
Arcadia - Senior Data Scientist

Arcadia

(Remote)
7 Hours ago
PwC - Senior ESG consulting expert

PwC

Kyiv, Kyiv City, Ukraine (On-Site)
7 Months ago
NielsenIQ - Retail Customer Success Leader BENELUX (FMCG and T&D)

NielsenIQ

Amstelveen, North Holland, Netherlands (On-Site)
1 Week ago
Triple Dot Studios - Senior Game Designer

Triple Dot Studios

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Months ago
Universal Music - Director of Creative Strategy, eCommerce

Universal Music

New York, New York, United States (On-Site)
2 Months ago
NVIDIA - CAD Engineer

NVIDIA

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Techland - IT Administrator

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Daybreak Game Company LLC - Associate Character Artist

Daybreak Game Company LLC

San Diego, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

Scientific Games  - Data Center Technician II

Scientific Games

Middletown, Pennsylvania, United States (On-Site)
2 Months ago
NVIDIA - Senior Timing Methodology Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
PENN Interactive - Regional Director of Player Development

PENN Interactive

Philadelphia, Pennsylvania, United States (Hybrid)
1 Month ago
Biofire DX - Senior Project Manager - R&D Data/IT

Biofire DX

Salt Lake City, Utah, United States (On-Site)
1 Month ago
Scale AI - Staff Product Designer

Scale AI

San Francisco, California, United States (On-Site)
1 Day ago
Scanline VFX - Research Intern (Summer 2025)

Scanline VFX

Los Angeles, California, United States (Hybrid)
5 Months ago
Goat Group - Sales Associate I

Goat Group

New York, New York, United States (On-Site)
7 Hours ago
Riot Games - Art Outsourcing II (Weapons Concept)

Riot Games

Los Angeles, California, United States (On-Site)
2 Weeks ago
lifechruh - Giver Specialist

lifechruh

Edmond, Oklahoma, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Systems Design Jobs

Tesla - Mechanical Engineer, Technical Service, Vehicle Manufacturing

Tesla

Brandenburg, Germany (On-Site)
2 Months ago
Epic Games - Lead Gameplay Programmer

Epic Games

Montreal, Quebec, Canada (On-Site)
11 Months ago
Epic Games - Senior Gameplay Systems Programmer

Epic Games

Porto Alegre, State Of Rio Grande Do Sul, Brazil (On-Site)
2 Months ago
Assystems - I&C Engineer- Senior.

Assystems

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Tesla - Senior Project Engineer - BESS, EMEA

Tesla

Madrid, Community Of Madrid, Spain (On-Site)
2 Months ago
Epic Games - Technical Account Manager

Epic Games

London, England, United Kingdom (On-Site)
3 Months ago
High Moon Studios - Gameplay Engineer

High Moon Studios

California, United States (Hybrid)
3 Days ago
Epic Games - Senior Tools Programmer, UEFN

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
NVIDIA - Senior System Power Validation and Applications Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Fuse Games - Systems Engineer

Fuse Games

Guildford, England, United Kingdom (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (Hybrid)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Samsung Semiconductor

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug