Software Engineer, Speed

1 Week ago • 2 Years + • Research & Development

Job Summary

Job Description

This Software Engineer role at Google Research in Tel Aviv, Israel focuses on optimizing speed and efficiency within Google's Large Language Models (LLMs). Responsibilities include developing fast inference algorithms, improving decoding and prefill latency, analyzing execution via profiling tools, developing efficient pre-training models, and introducing architectural changes for improved efficiency and quality. Close collaboration with the Gemini Development and Modeling team and product areas is required to address product needs. The ideal candidate will have experience in software development, data structures, algorithms, NLP, and ML infrastructure.
Must have:
  • 2+ years software development experience
  • 2+ years experience with data structures/algorithms
  • 1+ year NLP experience
  • 1+ year ML infrastructure experience
  • Develop optimized fast inference algorithms
  • Improve decoding/prefill efficiency/latency
Good to have:
  • Master's/PhD in CS or related field
  • Experience with accessible technologies

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
  • 2 years of experience with data structures or algorithms.
  • 1 year of experience with Natural Language Processing (NLP) concepts or techniques.
  • 1 year of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical fields.
  • Experience developing accessible technologies.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Google Research addresses challenges that define the technology of today and tomorrow. From conducting fundamental research to influencing product development, our research teams have the opportunity to impact technology used by billions of people every day.

Our teams aspire to make discoveries that impact everyone, and core to our approach is sharing our research and tools to fuel progress in the field -- we publish regularly in academic journals, release projects as open source, and apply research to Google products.

Responsibilities

  • Develop optimized fast inference algorithms in Google's Large Language Model (LLM) codebases.
  • Improve decoding efficiency/latency and prefillI efficiency/latency.
  • Analyze and profile execution via xprof and other tools.
  • Develop pre-training, tail-patching and torso-patching compute-efficient and token-efficient models.
  • Introduce modeling architectural changes to improve efficiency or quality. Work closely with the Gemini Development and Modeling (GDM), the Gemini team and Product Areas to address the product needs in those areas.

Similar Jobs

Meetelise - Senior Research Scientist

Meetelise

(Remote)
6 Months ago
ByteDance - Research Scientist Graduate (Foundation Model - Generative AI) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
Netflix - Software Engineer - Procedural Geometry & Simulation

Netflix

Vancouver, British Columbia, Canada (Hybrid)
2 Weeks ago
Google - Software Engineer II, BigQuery Governance

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago
Onehouse - Software Engineer, Distributed Data Systems

Onehouse

Sunnyvale, California, United States (Hybrid)
3 Years ago
Netflix - Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

Netflix

Los Gatos, California, United States (Remote)
3 Months ago
NVIDIA - System Design Power Validation Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Weeks ago
Microsoft - Applied Scientist

Microsoft

Redmond, Washington, United States (On-Site)
1 Week ago
NVIDIA - Solution Architect - CSP Cloud

NVIDIA

Beijing, Beijing, China (On-Site)
3 Months ago
Tesla - Electrical Assembly Supervisor

Tesla

Rhineland-Palatinate, Germany (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Prophecy - Senior Backend Engineer

Prophecy

Bengaluru, Karnataka, India (On-Site)
1 Day ago
Playrix - UA Marketing Producer

Playrix

Portugal (Remote)
6 Months ago
GameJobs - Principal Geometry Engineer

GameJobs

Cary, North Carolina, United States (On-Site)
1 Day ago
ByteDance - Machine Learning Engineer Intern (Global E-commerce Risk Control)

ByteDance

San Jose, California, United States (On-Site)
3 Days ago
Stake Logic - Java Back-end Developer

Stake Logic

(Remote)
2 Months ago
Google - Staff Software Engineer, Core, Dagger

Google

Mexico City, Mexico City, Mexico (On-Site)
1 Week ago
ByteDance - Senior Research Engineer / Scientist - AI for Databases

ByteDance

Seattle, Washington, United States (On-Site)
3 Days ago
Fictiv - Manufacturing Data Analysis Intern

Fictiv

Monterrey, Nuevo Leon, Mexico (On-Site)
8 Hours ago
Google - Senior Software Engineer, Distributed Machine Learning

Google

Mountain View, California, United States (On-Site)
1 Week ago
Google - Software Engineer III, Google Ads

Google

Kirkland, Washington, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Tel Aviv-Yafo, Tel Aviv District, Israel

Google - SoC and IP Design Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Weeks ago
Aristocrat Gaming - Data Owner & Analyst - ERP D365

Aristocrat Gaming

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
3 Weeks ago
Plarium - Senior Program Manager - Temporary Position

Plarium

Herzliya, Tel Aviv District, Israel (On-Site)
2 Months ago
NVIDIA - Senior Software QA Automation Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
NVIDIA - Senior Chip Architect

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
Vimeo - Software Engineer, AI

Vimeo

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago
NVIDIA - Senior PCB Design Layout Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
3 Months ago
TabTale - Creative Producer

TabTale

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Google - Software Engineer III, Research

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Weeks ago
Tesla - Service Technician

Tesla

Netanya, Center District, Israel (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Microsoft - Critical Environment Energy Marshall

Microsoft

Busan, Busan, South Korea (On-Site)
2 Weeks ago
Meta - Software Engineer, Machine Learning

Meta

Los Angeles, California, United States (On-Site)
5 Months ago
Tesla - Duales Studium Automation Engineering (B.Eng.)

Tesla

Brandenburg, Germany (On-Site)
2 Months ago
NVIDIA - Solutions Architect, Networking - Cloud Service Providers

NVIDIA

Redmond, Washington, United States (Hybrid)
4 Weeks ago
Krafton  - [Publishing] Lead of Game PR (5~10년)

Krafton

Seoul, South Korea (On-Site)
3 Months ago
NVIDIA - Silicon Reliability Engineer

NVIDIA

Santa Clara, California, United States (Hybrid)
2 Months ago
Google - Student Researcher, PhD, Winter/Summer 2025

Google

Montreal, Quebec, Canada (On-Site)
5 Months ago
Google - Software Engineering Manager, Wearables and Health Data Privacy

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Weeks ago
Rivos - Silicon Microarchitecture & Logic Design - Intern

Rivos

Santa Clara, California, United States (On-Site)
6 Months ago
NVIDIA - Senior Silicon Photonics Test Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug