Software Engineer, Speed

2 Days ago • 2 Years + • Research & Development

Job Summary

Job Description

Google Research seeks a Software Engineer specializing in speed optimization for Large Language Models (LLMs). Responsibilities include developing fast inference algorithms, improving decoding and prefill efficiency, analyzing execution using profiling tools, developing compute-efficient models (pre-training, tail/torso patching), introducing architectural changes for efficiency/quality, and collaborating with the Gemini team to meet product needs. The role requires experience in software development, data structures, algorithms, NLP, and ML infrastructure. The ideal candidate will possess a strong understanding of LLM architectures and optimization techniques.
Must have:
  • 2+ years software development experience
  • 2+ years data structures/algorithms experience
  • 1+ year NLP experience
  • 1+ year ML infrastructure experience
  • Develop optimized inference algorithms
  • Improve decoding/prefill efficiency
Good to have:
  • Master's/PhD in CS
  • Experience with accessible technologies

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
  • 2 years of experience with data structures or algorithms.
  • 1 year of experience with Natural Language Processing (NLP) concepts or techniques.
  • 1 year of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical fields.
  • Experience developing accessible technologies.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Google Research addresses challenges that define the technology of today and tomorrow. From conducting fundamental research to influencing product development, our research teams have the opportunity to impact technology used by billions of people every day.

Our teams aspire to make discoveries that impact everyone, and core to our approach is sharing our research and tools to fuel progress in the field -- we publish regularly in academic journals, release projects as open source, and apply research to Google products.

Responsibilities

  • Develop optimized fast inference algorithms in Google's Large Language Model (LLM) codebases.
  • Improve decoding efficiency/latency and prefillI efficiency/latency.
  • Analyze and profile execution via xprof and other tools.
  • Develop pre-training, tail-patching and torso-patching compute-efficient and token-efficient models.
  • Introduce modeling architectural changes to improve efficiency or quality. Work closely with the Gemini Development and Modeling (GDM), the Gemini team and Product Areas to address the product needs in those areas.

Similar Jobs

Super - Data Scientist

Super

(Remote)
1 Day ago
ByteDance - Software Engineer Graduate (Applied Machine Learning - Engine) - 2025 Start (BS/MS)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
NVIDIA - Senior Software Engineer, Hardware Tools and Methodology Development

NVIDIA

Santa Clara, California, United States (Hybrid)
1 Month ago
Archipelago - Graduate Software Engineer

Archipelago

Noida, Uttar Pradesh, India (On-Site)
1 Day ago
Google - Software Engineer III, Site Reliability Engineering, Network Management

Google

Dublin, County Dublin, Ireland (On-Site)
2 Weeks ago
GEA Group - HMI Software Engineer

GEA Group

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Krafton  - HR Planning Manager (5+ years experience)

Krafton

Seoul, South Korea (On-Site)
3 Months ago
Trackman - Team Lead - Radar & High-Speed Electronics

Trackman

Denmark (On-Site)
2 Months ago
Samsung Semiconductor - Principal Engineer, Device Modeling

Samsung Semiconductor

San Jose, California, United States (On-Site)
3 Weeks ago
NVIDIA - Senior ASIC Verification Engineer - GPU Memory Subsystem

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Search Operation Quality Assurance - Ads

ByteDance

Pasig, Metro Manila, Philippines (On-Site)
6 Months ago
Google - Site Reliability Engineer, Home and Assistant

Google

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Google - Software Engineer II, CoreOS Infrastructure

Google

Bucharest, Bucharest, Romania (On-Site)
2 Days ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - MultiModal Generative Model)

ByteDance

San Jose, California, United States (On-Site)
2 Weeks ago
Trendyol - Data Science Professionals

Trendyol

İstanbul, İstanbul, Türkiye (Hybrid)
3 Years ago
Velotio Technologies - Senior Engineer (ROR)

Velotio Technologies

Pune, Maharashtra, India (Remote)
1 Month ago
ByteDance - Software Development Engineer - Distributed NoSQL Database Systems

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Snyk - Staff Software Engineer

Snyk

Boston, Massachusetts, United States (Hybrid)
7 Hours ago
Mistplay - Principal Product Manager - Growth Product

Mistplay

Toronto, Ontario, Canada (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Tel Aviv-Yafo, Tel Aviv District, Israel

Vimeo - Principal Product Designer, Marketing Solutions

Vimeo

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago
Unity - Mobile Automation Engineer

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
NVIDIA - Senior Software Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
NVIDIA - Physical Design CAD Team Manager

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Weeks ago
Playtika - Corporate Counsel

Playtika

Israel (On-Site)
6 Months ago
Meta - Software Engineer, Infrastructure

Meta

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
5 Months ago
Snyk - Staff Software Engineer

Snyk

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
7 Hours ago
NVIDIA - Senior Financial Analyst

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Month ago
NVIDIA - Senior Chip Design Methodologies Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
Microsoft - Senior Data Engineer - MSTIC RnD

Microsoft

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Senior Digital Circuit Design Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Samsung Semiconductor - Senior Staff Engineer, DRAM

Samsung Semiconductor

San Jose, California, United States (Hybrid)
4 Months ago
NVIDIA - STA Backend Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Assystems - Design Engineer – Substation (Civil & Structural)

Assystems

Gurugram, Haryana, India (On-Site)
6 Months ago
Rivos - Accelerator Design Verification - Full Time

Rivos

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Wind River Systems - Software Architect – Real Time Operating Systems

Wind River Systems

Galați, Județul Galați, Romania (On-Site)
6 Months ago
NVIDIA - Manager, Software Engineering

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
NVIDIA - Senior Malware Research Architect

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
Samsung Semiconductor - Staff Engineer, Pre-Silicon Emulation

Samsung Semiconductor

San Jose, California, United States (On-Site)
1 Month ago
Actian - C Engineer - Bangalore/Pune

Actian

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug