Intern, AI/ML Software Engineer

3 Months ago • Upto 3 Years • Artificial Intelligence • $28,000 PA - $62,000 PA

Job Summary

Job Description

This summer internship focuses on creating an efficient AI inference system for large-scale pre-trained LLMs. The system will leverage data compression and AI accelerator hardware. The intern will design the system, build it using a device emulator, integrate data compression algorithms, measure and optimize performance, and work with AI accelerator logic simulation and data transfer patterns between storage and hardware. Responsibilities include designing an efficient AI inference system, selecting effective data compression for pre-trained LLMs, building the system with a device emulator, integrating data compression algorithms, measuring and optimizing performance, and completing other assigned tasks. The internship requires working onsite at least 4 days a week in San Jose.
Must have:
  • Pursuing PhD in Computer Science
  • NLP/LLM, LLM model compression knowledge
  • PyTorch, Python/C++ skills
  • Design and build AI inference systems
  • Data compression algorithm integration
  • Performance measurement and optimization
Perks:
  • Relocation Support
  • Housing Stipend
  • Charitable Giving Match
  • Paid Therapy Sessions
  • Onsite Café and Gym
  • Virtual Fitness Classes
  • Flexible Work Environment

Job Details

Please Note:

To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. 

Advancing the World’s Technology Together
Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future. 

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities.

What You’ll Learn

  • Project Overview:
    • Efficient AI inference system with data compression and AI accelerator hardware for large-scaled pre-trained large language models.
  • Skills You’ll Learn:
    • Inference for large language models
    • AI storage systems
    • Hardware-based AI Inference

What You’ll Do

This summer internship aims to create new efficient AI inference system for large-scaled pre-trained LLMs, which leverages data compression and AI accelerator hardware. AI accelerator logic is implemented on simulation environment. Data compression logic is implemented into device emulator, which considers data transfer pattern between storage and AI accelerator hardware. This position requires to design highly efficient AI inference system to choose most effective data compression for pre-trained LLMs.

Location: Working onsite at our San Jose headquarters at least 4 days per week on Monday - Thursday, with the flexibility to work remotely the remainder of your time

Reports to: Director of AI/ML Software Engineering

  • Design AI inference system with data compression
  • Build AI inference system with device emulator
  • Integrate data compression algorithm into AI inference system
  • Measure performance of AI inference system
  • Optimize performance of AI inference system
  • Complete other responsibilities as assigned.

What You Bring

  • Pursuing PhD with 3+ years in Computer Science preferred.
  • Must have at least 1 academic quarter/semester remaining
  • Required knowledge: NLP/LLM, LLM model compression
  • Required skillsets: PyTorch, Python/C++
  • You’re inclusive, adapting your style to the situation and diverse global norms of our people.
  • An avid learner, you approach challenges with curiosity and resilience, seeking data to help build understanding.
  • You’re collaborative, building relationships, humbly offering support and openly welcoming approaches.
  • Innovative and creative, you proactively explore new ideas and adapt quickly to change

What We Offer
The pay range below is for all roles at this level across all US locations and functions. Individual pay rates depend on a number of factors—including the role’s function and location, as well as the individual’s knowledge, skills, experience, education, and training. 

This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours.

Relocation Support Live 50+ miles away from your new office? No worries! We'll provide a stipend to help support your move.
Housing Stipend
Signing a lease on a new place for your summer internship? We'll help you pay your way with a monthly stipend.
Give Back
With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community.
Prioritize Emotional Wellness
With on-demand apps and paid therapy sessions, you’ll have support no matter where you are.
Stay Fit
Eating well and being active are important parts of a healthy life. Our onsite Café and gym, plus virtual classes, make it easier.
Embrace Flexibility
Benefits are best when you have the space to use them. That’s why we facilitate a flexible environment so you can find the right balance for you.

Hourly Base Pay Rate

$28 - $62 USD

Equal Opportunity Employment Policy 

Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.

When selecting team members, we prioritize talent and qualities such as humility, kindness, and dedication. We extend comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long-term conditions, neurodivergent individuals, or those requiring pregnancy-related support. All candidates scheduled for an interview will receive guidance on requesting accommodations.

Recruiting Agency Policy

We do not accept unsolicited resumes. Only authorized recruitment agencies that have a current and valid agreement with Samsung Semiconductor, Inc. are permitted to submit resumes for any job openings.

Covid-19 Policy
To help keep our employees, customers, and communities safe, we’ve developed guidelines for our teams. Currently, we encourage vaccination for all employees and may require it depending on job functions (e.g., traveling for business, meeting with customers). While visiting our offices or attending team events, we ask employees to complete a daily health questionnaire and complete a weekly COVID test. Our COVID policies are subject to change depending on public health, regulatory and business circumstances. 

Applicant Privacy Policy
https://semiconductor.samsung.com/us/careers/privacy

 

Similar Jobs

Playrix - Senior C++ Software Engineer (Build System)

Playrix

Ukraine (Remote)
5 Months ago
ByteDance - Software Engineer, Multi Cloud CDN - San Jose / Seattle / Boston

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
Gearbox Entertainment - Senior Technical Artist

Gearbox Entertainment

Frisco, Texas, United States (On-Site)
5 Months ago
Gearbox Software - Technical Director, SDK

Gearbox Software

Frisco, Texas, United States (On-Site)
4 Months ago
Microsoft - Software Engineer

Microsoft

Redmond, Washington, United States (On-Site)
3 Months ago
Dolby Laboratories - Senior Foundational AI Researcher

Dolby Laboratories

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
NetEase Games - Senior AI Engineer (Asset Creation)

NetEase Games

(Remote)
3 Months ago
NVIDIA - Solution Architect, DGX Cloud

NVIDIA

Tokyo, Japan (On-Site)
3 Months ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Pittsburgh, Pennsylvania, United States (On-Site)
5 Months ago
NVIDIA - Senior Infrastructure Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Guru Studio - Unreal Engine Developer

Guru Studio

Ontario, Canada (Hybrid)
3 Months ago
Playtika - TypeScript Technical Lead /Kyiv

Playtika

Ukraine (On-Site)
5 Months ago
ZeniMax Media - Senior Backend Programmer

ZeniMax Media

Rockville, Maryland, United States (On-Site)
7 Months ago
Rockstar Games - Senior Software Engineer (C#)

Rockstar Games

New York, New York, United States (On-Site)
7 Months ago
Playrix - Senior C++/Python Software Engineer (Engine)

Playrix

Armenia (Remote)
6 Months ago
Playrix - Senior C++ Software Engineer (Build System)

Playrix

Georgia (Remote)
5 Months ago
Framestore - FREELANCE: CG - LOS ANGELES

Framestore

Los Angeles, California, United States (On-Site)
9 Months ago
Genies - Lead Machine Learning Engineer, 3D Gen AI & Graphics

Genies

Los Angeles, California, United States (On-Site)
2 Months ago
ByteDance - Research Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
ByteDance - Senior Software Engineer, Global Payment Risk & Compliance

ByteDance

San Jose, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

SKYDANCE - Internship - Television Development (Summer 2025)

SKYDANCE

Santa Monica, California, United States (Hybrid)
2 Months ago
ByteDance - Senior Backend Software Engineer - Global E-Commerce Supply Chain Operation Platform

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
NVIDIA - Senior ASIC Verification Engineer, Coherent High Speed Interconnect

NVIDIA

Santa Clara, California, United States (Remote)
2 Months ago
WebFX - Jr. Inside Sales Strategist

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
6 Months ago
Naughty Dog - IT Helpdesk Technician

Naughty Dog

Los Angeles, California, United States (On-Site)
3 Months ago
Blizzard Entertainment - Senior Technical Project Manager, Partner Success

Blizzard Entertainment

Irvine, California, United States (Hybrid)
5 Months ago
Canva - Revenue Operations Manager

Canva

Los Angeles, California, United States (Remote)
2 Months ago
Nintendo - Senior Bilingual Communications Coordinator - Japanese

Nintendo

Redmond, Washington, United States (Hybrid)
4 Months ago
PlayStation Global - Corporate Counsel, Commercial Litigation

PlayStation Global

Aliso Viejo, California, United States (Hybrid)
2 Months ago
Netflix - Software Engineer (L4) - Ads Measurement

Netflix

New York, New York, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

OKX - Senior Product Manager, AI Growth

OKX

Singapore, Singapore (On-Site)
6 Months ago
Meta - Research Scientist Intern, Language and Multimodal Research for MetaAI (PhD)

Meta

Seattle, Washington, United States (On-Site)
5 Months ago
Patterned Learning Career - Machine Learning Engineer

Patterned Learning Career

(Remote)
2 Months ago
NVIDIA - AI Computing Architect Intern - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
Social Discovery Group - Senior Product Analyst (AI Product)

Social Discovery Group

Belgrade, Serbia (Remote)
3 Months ago
DNEG - Head of Machine Learning

DNEG

London, England, United Kingdom (Remote)
2 Months ago
NVIDIA - Senior Software Engineer - Robot Learning Platform

NVIDIA

Toronto, Ontario, Canada (On-Site)
2 Months ago
Zoox - Senior/Staff Software Engineer - Operational Tools

Zoox

Foster City, California, United States (On-Site)
6 Months ago
Canva - Head of AI Research

Canva

San Francisco, California, United States (Remote)
3 Months ago
Microsoft - Member of Technical Staff – Machine Learning Engineer

Microsoft

New York, New York, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (Hybrid)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Samsung Semiconductor

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug