Staff Software Engineer (ML)

9 Hours ago • 6 Years + • $122,500 PA - $175,000 PA

Job Summary

Job Description

As a Staff Software Engineer (ML) at Zscaler, you will be responsible for integrating and managing distributed ML models and inference services, optimizing performance across hybrid environments. You will architect and optimize APIs and microservices for seamless interaction between cloud-based and on-premise ML models and proxy software. Ensuring security and compliance is a key responsibility, including implementing robust authentication, authorization, and encryption mechanisms for sensitive AI and customer data. Collaboration with ML engineers, DevOps, and security teams is crucial for streamlining deployment, monitoring, and updates of system components across multiple cloud environments and customer premises. You will also enhance observability by building logging, monitoring, and tracing systems to ensure reliability across cloud and on-premise installations.
Must have:
  • 6+ years of Backend Engineer experience
  • Deep understanding of optimizing AI workloads
  • Strong knowledge of data structures and algorithms
  • Proficiency in Java
  • Familiarity with cloud services (AWS, Azure, GCP)
Good to have:
  • Bachelor's or Master's degree in Computer Science
  • Experience with ML workloads
Perks:
  • Various health plans
  • Time off plans
  • Parental leave options
  • Retirement options
  • Education reimbursement
  • In-office perks

Job Details

About Zscaler

Serving thousands of enterprise customers around the world including 40% of Fortune 500 companies, Zscaler (NASDAQ: ZS) was founded in 2007 with a mission to make the cloud a safe place to do business and a more enjoyable experience for enterprise users. As the operator of the world’s largest security cloud, Zscaler accelerates digital transformation so enterprises can be more agile, efficient, resilient, and secure. The pioneering, AI-powered Zscaler Zero Trust Exchange™ platform, which is found in our SASE and SSE offerings, protects thousands of enterprise customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location.

Named a Best Workplace in Technology by Fortune and others, Zscaler fosters an inclusive and supportive culture that is home to some of the brightest minds in the industry. If you thrive in an environment that is fast-paced and collaborative, and you are passionate about building and innovating for the greater good, come make your next move with Zscaler. 

Our Engineering team built the world’s largest cloud security platform from the ground up, and we keep building. With more than 100 patents and big plans for enhancing services and increasing our global footprint, the team has made us and our multitenant architecture today's cloud security leader, with more than 15 million users in 185 countries. Bring your vision and passion to our team of cloud architects, software engineers, security experts, and more who are enabling organizations worldwide to harness speed and agility with a cloud-first strategy.

We're looking for an experienced Staff Backend Engineer to join our team. This role is based in our San Jose, CA office (hybrid, 3 days a week in office). Reporting to the VP, you will:

  • Integrate & manage distributed ML models and inference services while optimizing performance across hybrid environments.
  • Architect & optimize APIs and micro services to enable seamless interaction between cloud-based and on-premise ML models and proxy software.
  • Ensure security & compliance by implementing robust authentication, authorization, and encryption mechanisms for sensitive AI and customer data.
  • Collaborate with ML engineers, DevOps, and security teams to streamline deployment, monitoring, and updates of system components deployed across multiple cloud environments and customer premises.
  • Enhance Observability by building logging, monitoring, and tracing systems to ensure reliability across cloud and on-premise installations.

What We're Looking for (Minimum Qualifications):

  • 6+ years experience as a Backend Engineer or similar role, with a focus on designing, building, and scaling systems using distributed ML model inference.
  • Deep understanding of optimizing latency, throughput, and resource utilization for AI workloads in distributed systems.
  • Strong knowledge of data structures, algorithms, and software engineering principles.
  • Proficiency in Java.
  • Familiarity with cloud services (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes).

What Will Make You Stand Out (Preferred Qualifications):

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Experience with ML workloads 

#LI-hybrid

#LI-AZ2

Zscaler’s salary ranges are benchmarked and are determined by role and level. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations and could be higher or lower based on a multitude of factors, including job-related skills, experience, and relevant education or training.

The base salary range listed for this full-time position excludes commission/ bonus/ equity (if applicable) + benefits.

Base Pay Range

$122,500 - $175,000 USD

At Zscaler, we are committed to building a team that reflects the communities we serve and the customers we work with. We foster an inclusive environment that values all backgrounds and perspectives, emphasizing collaboration and belonging. Join us in our mission to make doing business seamless and secure.

Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages, including:

  • Various health plans
  • Time off plans for vacation and sick time
  • Parental leave options
  • Retirement options
  • Education reimbursement
  • In-office perks, and more!

By applying for this role, you adhere to applicable laws, regulations, and Zscaler policies, including those related to security and privacy standards and guidelines.

Zscaler is committed to providing equal employment opportunities to all individuals. We strive to create a workplace where employees are treated with respect and have the chance to succeed. All qualified applicants will be considered for employment without regard to race, color, religion, sex (including pregnancy or related medical conditions), age, national origin, sexual orientation, gender identity or expression, genetic information, disability status, protected veteran status, or any other characteristic protected by federal, state, or local laws.

See more information by clicking on the Know Your Rights: Workplace Discrimination is Illegal link.

Pay Transparency

Zscaler complies with all applicable federal, state, and local pay transparency rules.

Zscaler is committed to providing reasonable support (called accommodations or adjustments) in our recruiting processes for candidates who are differently abled, have long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support.

Similar Jobs

Meta - Software Engineer, Product

Meta

Austin, Texas, United States (Remote)
5 Months ago
Playtika - Unity Developer

Playtika

Romania (Hybrid)
4 Months ago
Microsoft - Security Software Engineer II

Microsoft

Redmond, Washington, United States (On-Site)
2 Weeks ago
ION - Technical Support Analyst, Jersey City - 9781

ION

Jersey City, New Jersey, United States (On-Site)
6 Months ago
CData - Software Development Engineer III

CData

Bengaluru, Karnataka, India (On-Site)
6 Hours ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Powerintegration - IT System Software Development Manager (Semiconductor)

Powerintegration

Pasig, Metro Manila, Philippines (On-Site)
7 Months ago
PwC - IN_Manager – Crm Technical -Ms Dynamics– Advisory  -Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
ByteDance - Machine Learning Engineer Intern (Knowledge Graph) - 2024 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
N-iX - Junior Automation QA (With Python)

N-iX

Poland (Remote)
2 Weeks ago
Caramel tech studios - Machine Learning Engineer

Caramel tech studios

Lahore, Punjab, Pakistan (On-Site)
1 Day ago
sound cloud - Senior Data Engineer

sound cloud

Berlin, Berlin, Germany (Hybrid)
1 Day ago
ByteDance - Network Data Operations Engineer

ByteDance

Singapore (On-Site)
6 Months ago
Meta - Software Engineer, Intern/Co-op

Meta

Menlo Park, California, United States (On-Site)
5 Months ago
Google - Wearable Telemetry Tech Lead

Google

Bucharest, Bucharest, Romania (On-Site)
2 Weeks ago
Zscaler - Principal Site Reliability Engineer

Zscaler

San Jose, California, United States (Hybrid)
9 Hours ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

Riot Games - Senior Technical Producer, League Studios - Build Test Ship

Riot Games

Los Angeles, California, United States (On-Site)
6 Months ago
Revolgy - L2 Cloud Operations Engineer

Revolgy

Georgia, United States (Remote)
1 Month ago
Egnyte - Business Development Representative

Egnyte

Raleigh, North Carolina, United States (Hybrid)
5 Months ago
Google - Field Sales Representative, Greenfield, Startups, Google Cloud

Google

Atlanta, Georgia, United States (On-Site)
2 Days ago
Nintendo - Physical Security Specialist

Nintendo

Redmond, Washington, United States (On-Site)
11 Months ago
Glean - Sales Development Representative

Glean

Nashville, Tennessee, United States (Hybrid)
8 Hours ago
Netflix - Sr. Manager, Indirect Demand Management (UCAN/LATAM)

Netflix

New York, New York, United States (On-Site)
2 Weeks ago
Trek - Bicycle Service Technician

Trek

Madison, Wisconsin, United States (On-Site)
2 Months ago
Epoch Games - 3D Creature Artist

Epoch Games

Winston-Salem, North Carolina, United States (Remote)
10 Months ago
NVIDIA - Product Manager- Data Center Ecosystem

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Zscaler enables the world’s leading organizations to securely transform their networks and applications for a mobile and cloud first world. Its flagship services, Zscaler Internet Access and Zscaler Private Access, create fast, secure connections between users and applications, regardless of device, location, or network. Zscaler services are 100% cloud-delivered and offer the simplicity, enhanced security, and improved user experience that traditional appliances or hybrid solutions are unable to match. Used in more than 185 countries, Zscaler operates the world’s largest cloud security platform, protecting thousands of enterprises and government agencies from cyberattacks and data loss.



Stay Connected:

LinkedIn: https://www.linkedin.com/company/zscaler

Twitter: https://www.twitter.com/zscaler

Facebook: https://www.facebook.com/Zscaler/

Sahibzada Ajit Singh Nagar, Punjab, India (Hybrid)

Tokyo, Japan (Hybrid)

Tokyo, Japan (Hybrid)

New York, New York, United States (Hybrid)

New York, New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Zscaler

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug