Outscal Logooutscal logo

Principal Engineer, AI System Architect

11 Hours ago • 15 Years + • Systems Design • $214,060 PA - $341,940 PA

Job Summary

Job Description

The Architecture Research Lab (ARL) at Samsung Semiconductor seeks an AI System Architect to design next-generation AI systems addressing memory bandwidth and communication bottlenecks. Responsibilities include architecting AI systems for state-of-the-art performance, providing technical leadership in compute, memory, and network topologies, developing and validating system models, and collaborating with HW/SW architects and application experts. The role involves leveraging modeling for design space exploration and optimization, addressing modern AI challenges using Samsung's memory technologies, and working on hardware/software co-design. Occasional travel is required.
Must have:
  • PhD in CS/EE or related field
  • 15+ years experience in system architecture
  • Deep expertise in AI system design (LLMs, DLRMs)
  • Understanding of compute, memory, networking bottlenecks
  • AI hardware architecture experience
  • Hardware/software co-design for AI
  • Analytical & simulation model development
  • Strong leadership and communication skills
Good to have:
  • Experience in ML compilers and runtime optimization
  • Familiarity with AI software stacks and frameworks
Perks:
  • 4+ weeks paid time off
  • Medical/Dental/Vision/401k
  • Fertility care/adoption stipend
  • Medical travel support
  • Paid therapy sessions
  • Onsite gym and café
  • Flexible work environment
  • Charitable giving match

Job Details

Please Note:

To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. 

Advancing the World’s Technology Together
Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future. 

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities.

What You’ll Do

The Architecture Research Lab (ARL) is tackling two of the biggest challenges in AI today—memory bandwidth and communication bottlenecks. By leveraging Samsung’s world-leading memory technologies, we are developing next-generation AI systems that break through these limitations while improving developer productivity.

This effort spans:

  • Hardware: Memory, networking, compute, and power optimization.
  • Software: System software, frameworks, and runtime optimization.
  • Application & Performance Modeling: Developing tools to guide architectural decisions.

We are seeking an AI System Architect to help shape the future of AI systems through innovative system-level hardware design, performance modeling, and hardware/software co-design.

Location: Hybrid, working onsite at our San Jose  office/headquarters 3 days per week  with the flexibility to work remotely the remainder of your time

Job ID: 42536

Key Responsibilities

  • Architect next-generation AI systems to address modern AI challenges and achieve state-of-the-art system-level performance
  • Provide technical leadership, driving system component direction and selection in the area of the compute, memory and network topologies; analyze bottlenecks and come up with innovative solutions
  • Supervise the development and validation of analytical and simulation-based system models to project AI system performance.
  • Leverage modeling infrastructure for design space exploration and system-level optimization.
  • Collaborate effectively with other HW/SW architects, application experts, and performance modeling experts across sites and time zones  
  • Occasional domestic and international travel (<10%).

 What You Bring

  • PhD in Computer Science, Electrical Engineering, or a related field with 15+ years of experience in system architecture for large-scale computing, with specific AI focus preferred. 
  • Deep expertise in AI system design, and knowledges in LLMs, DLRMs, and other representative AI workloads.
  • Strong understanding of compute, memory, and networking bottlenecks in AI systems.
  • Proven experience in AI hardware architecture at both system and component levels.
  • Background in hardware/software co-design for AI systems.
  • Hands-on experience in developing analytical and event-driven simulation models.
  • Experience in ML compilers and runtime optimization preferred.
  • Familiarity with AI software stacks and frameworks preferred.
  • Strong leadership skills with a track record of setting technical direction and guiding teams.
  • Excellent verbal, presentation, and written communication skills.
  • A collaborative mindset, curiosity, and resilience in solving complex challenges.

#LI-SF1

What We Offer
The pay range below is for all roles at this level across all US locations and functions. Individual pay rates depend on a number of factors—including the role’s function and location, as well as the individual’s knowledge, skills, experience, education, and training. We also offer incentive opportunities that reward employees based on individual and company performance. 

This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision/401k, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours.

Give Back With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community.
Enjoy Time Away You’ll start with 4+ weeks of paid time off a year, plus holidays and sick leave, to rest and recharge.
Care for Family Whatever family means to you, we want to support you along the way—including a stipend for fertility care or adoption, medical travel support, and an errand service.
Prioritize Emotional Wellness With on-demand apps and paid therapy sessions, you’ll have support no matter where you are.
Stay Fit Eating well and being active are important parts of a healthy life. Our onsite Café and gym, plus virtual classes, make it easier.
Embrace Flexibility Benefits are best when you have the space to use them. That’s why we facilitate a flexible environment so you can find the right balance for you.

Base Pay Range

$214,060 - $341,940 USD

Equal Opportunity Employment Policy 

Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.

When selecting team members, we prioritize talent and qualities such as humility, kindness, and dedication. We extend comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long-term conditions, neurodivergent individuals, or those requiring pregnancy-related support. All candidates scheduled for an interview will receive guidance on requesting accommodations.

Recruiting Agency Policy

We do not accept unsolicited resumes. Only authorized recruitment agencies that have a current and valid agreement with Samsung Semiconductor, Inc. are permitted to submit resumes for any job openings.

Covid-19 Policy

To help keep our employees, customers, and communities safe, we've developed guidelines for our team. Currently, we encourage vaccination for all employees and may require it depending on job functions (e.g., traveling for business, meeting with customers). While visiting our offices or attending team events, we ask employees to complete a daily health questionnaire and complete a weekly COVID test. Our COVID policies are subject to change depending on public health, regulatory, and business circumstances. 

Applicant Privacy Policy
https://semiconductor.samsung.com/us/careers/privacy

 

Similar Jobs

ION - Software Engineer - Java

ION

Pune, Maharashtra, India (On-Site)
5 Months ago
Daybreak Game Company LLC - Business Intelligence Engineer

Daybreak Game Company LLC

San Diego, California, United States (Hybrid)
1 Month ago
Lingo Kids LLC - Interactive Producer

Lingo Kids LLC

Madrid, Community Of Madrid, Spain (On-Site)
11 Hours ago
Techland - UE5 Level Artist

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
3 Months ago
Ness Digital - DevOps Engineer

Ness Digital

Timișoara, Timiș, Romania (Hybrid)
2 Months ago
Epic Games - Senior Designer

Epic Games

United States (On-Site)
1 Month ago
High Moon Studios - Senior Gameplay Engineer

High Moon Studios

California, United States (Hybrid)
1 Day ago
Epic Games - Senior Gameplay Systems Developer, Developer Relations

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Universal Music - Full Stack Engineer

Universal Music

Philadelphia, Pennsylvania, United States (On-Site)
2 Months ago
Techland - Animation Director

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
3 Months ago
Playtika - JavaScript Developer/Vinnytsia

Playtika

Ukraine (On-Site)
4 Months ago
CLO Virtual Fashion  Inc  - C++ Developer

CLO Virtual Fashion Inc

Bengaluru, Karnataka, India (On-Site)
6 Months ago
CD PROJEKT RED - Intern in Legalization Team

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Weeks ago
Luxoft - Lead Java Developer (for Trading Application)

Luxoft

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (Remote)
3 Months ago
CD PROJEKT RED - Physics Engineer

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
5 Days ago
ASSIST Software - Unity Tech Artist

ASSIST Software

Suceava, Suceava County, Romania (Remote)
4 Months ago
Morning Star - Associate Director, Fixed Income and Currency (Global Credit)

Morning Star

Chicago, Illinois, United States (Hybrid)
6 Months ago
CD PROJEKT RED - Expert VFX Artist

CD PROJEKT RED

Boston, Massachusetts, United States (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

King - Sales Associate Director

King

California, United States (Hybrid)
23 Hours ago
GameChanger  - Director of Business Development

GameChanger

United States (Remote)
5 Days ago
Onward Search - Business Development Specialist (Real Estate)

Onward Search

North Carolina, United States (On-Site)
3 Months ago
Skillz - Social Media Content Co-Op - Summer & Fall 2025

Skillz

Las Vegas, Nevada, United States (On-Site)
1 Month ago
WebFX - Digital Marketing Specialist - Account Manager

WebFX

York, Pennsylvania, United States (On-Site)
5 Months ago
PENN Interactive - Senior Technical Product Manager, Data

PENN Interactive

Philadelphia, Pennsylvania, United States (Hybrid)
1 Month ago
Meetelise - Associate Solutions Engineer

Meetelise

New York, New York, United States (On-Site)
4 Months ago
GungHo Online Entertainment America,  Inc  - Associate Producer (Japanese Bilingual)

GungHo Online Entertainment America, Inc

California, United States (Hybrid)
5 Months ago
Scale AI - Senior Software Engineer, GenAI Model Evaluation

Scale AI

San Francisco, California, United States (On-Site)
5 Months ago
Nagarro - Associate Staff Engineer, Mainframe

Nagarro

Atlanta, Georgia, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Systems Design Jobs

IGT - Senior Director, System Design

IGT

Las Vegas, Nevada, United States (Hybrid)
3 Months ago
SmileGate - Battle System Planner [Next Crossfire]

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
19 Hours ago
Ourpalm - SLG System Planner

Ourpalm

Beijing, Beijing, China (On-Site)
1 Day ago
Tesla - Senior Mechanical Engineer, Technical Service

Tesla

Brandenburg, Germany (On-Site)
1 Month ago
Fuse Games - Systems Engineer

Fuse Games

Guildford, England, United Kingdom (Hybrid)
19 Hours ago
Ourpalm - System Planner

Ourpalm

Guangzhou, Guangdong Province, China (On-Site)
1 Day ago
Thales - Technical Lead - Digital Design

Thales

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Epic Games - Senior Gameplay Systems Programmer, Fortnite

Epic Games

United States (On-Site)
1 Month ago
Wargaming - Senior Game Designer, Meta (World of Tanks Blitz)

Wargaming

Vilnius, Vilnius County, Lithuania (Hybrid)
3 Weeks ago
Epic Games - Lead Engine Programmer, Verse Framework

Epic Games

Bellevue, Washington, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

San Jose, California, United States (On-Site)

San Diego, California, United States (On-Site)

San Jose, California, United States (Hybrid)

Austin, Texas, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (Hybrid)

California, United States (Hybrid)

San Jose, California, United States (On-Site)

San Jose, California, United States (Hybrid)

Folsom, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Samsung Semiconductor

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug