Software Engineer, Search and Discovery Platform

2 Months ago • 5 Years + • Devops • $215,000 PA - $245,000 PA

Job Summary

Job Description

This role is for a Software Engineer to join the Discovery Platform team at Whatnot. The engineer will be involved in shaping the technical direction, designing a scalable Discovery system, building services and infrastructure for recommendation systems, and partnering with other teams. They should have experience in building discovery backend and data systems at scale. The responsibilities include building services and infrastructure for advanced recommendation systems, creating a scalable discovery experience, utilizing models to solve discovery problems, and contributing scalable solutions across various layers.
Must have:
  • Industry experience in handling high throughput applications
  • Ability to work autonomously and lead initiatives
  • Experience in machine learning fields
  • Expert at designing and building scalable systems
  • Familiarity with cloud computing platforms
  • Experience with concurrent programming patterns
  • Experience managing cloud technologies
  • Proficiency in server-side programming language
  • Exceptional interpersonal and communication skills
Good to have:
  • Experience with AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Kafka, Flink/Spark, OpenSearch, ElasticSearch, Lucene, SOLR.
  • Experience with cloud computing platforms
  • Comfort with infrastructure-as-code approaches (e.g. Terraform).
Perks:
  • Flexible Time off Policy and Company-wide Holidays
  • Health Insurance options including Medical, Dental, Vision
  • Home office setup allowance and monthly allowance for cell phone and internet
  • Monthly allowance for wellness and annual allowance towards Childcare
  • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement; 401k offering for Traditional and Roth accounts in the US and Pension plans internationally
  • Monthly allowance to dogfood the app
  • 16 weeks of paid parental leave + one month gradual return to work

Job Details

🚀 Join the Future of Commerce with Whatnot! 

Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. We’re re-defining e-commerce by blending community, shopping, and entertainment into a community just for you. As a remote co-located team, we’re inspired by innovation and anchored in our values. With hubs in the US, UK, Ireland, Poland, and Germany, we’re building the future of online marketplaces—together.

From fashion, beauty, and electronics to rare collectibles like trading cards, comic books, and even live plants, our live auctions have something for everyone.

And we’re just getting started! As one of the fastest growing marketplaces, we’re looking for bold, forward-thinking problem solvers across all functional areas. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business, and bring people together through commerce.

💻 Role

We are looking for intellectually curious, highly motivated individuals to be foundational members in shaping the Discovery Platform. You will play a critical role in defining the technical direction and designing a world-class scalable Discovery system that is scalable enough to keep pace with our business growth to power feed, browse, search and taxonomy systems while catering to the unique challenges of operating a marketplace for live shopping! 

Working in a highly cross functional role, you’ll make key decisions about how we integrate retrieval, ranking through machine learning, real-time and stream processing, content understanding, materialization into a highly personalized discovery experience that unlocks product iterations while providing strong reliability. 

An ideal candidate will have experience building discovery backend and data systems at scale, with a knack for working closely with product engineers to solve immediate problems for our users while making right tradeoffs towards building a platform. We’ll often prototype new ideas quickly, and then need to build them for extreme scale while coordinating closely with other teams - the ideal person for this role is an expert at both of these approaches. 

Learn more about the Discovery systems at Whatnot from our blog posts on Whatamix, LLMs for Search.

 What you'll do:

  • Build the services and infrastructure to enable advanced recommendation systems solutions for real-time, dynamic feeds
  • Build a scalable, stable, low latency discovery experience
  • Partner closely across the machine learning, platform, and product engineering teams to utilize models to solve discovery problems
  • Contribute scalable solutions across various serving stacks at the feed, search, machine learning service, and Discovery application layers.
  • Define and advance our technical approach to scalable recommendation systems.

US Based:

Team members in this role are required to be within commuting distance of our San Francisco, Los Angeles, Seattle, and New York hubs. 

👋 You

Curious about who thrives at Whatnot? We’ve found that embodying a low ego, growth mindset, and high-impact drive goes a long way here.

As our next Software Engineer you should have 5+ years of experience, a Bachelor’s degree in Computer Science, Statistics, Mathematics, Software Engineering, a related technical field, or equivalent work experience, and ideally deep experience with several of the following:

  • Industry experience in building and scaling a platform to handle high volume / throughput applications 
  • Ability to work autonomously and lead initiatives across multiple product areas and communicate findings with leadership and product teams. You can mentor others and prioritize building inclusive, supportive teams.
  • Experience in machine learning fields (e.g. Recommendations, Content Understanding and Search).
  • Expert at designing and building scalable and maintainable backend systems.
  • Firm grasp of visualization tools for monitoring and logging e.g. DataDog, Grafana
  • Familiarity with cloud computing platforms and managed services such as AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Kafka, Flink/Spark, OpenSearch, ElasticSearch, Lucene, SOLR.
  • Experience with concurrent programming patterns across distributed systems (AsyncIO python preferred), and optimizations / profiling / observability associated with them. 
  • Experience managing cloud technologies (AWS or Google Cloud) and comfort with infrastructure-as-code approaches (e.g. Terraform).

In addition to these role-specific qualifications, all engineering team members are expected to have:

  • Proficiency in at least one server-side programming language (preferably Python), common algorithms and data structures, and software design principles.
  • Self-starter ethic, thriving under a high level of autonomy.
  • Exceptional interpersonal and communication skills.

💰Compensation

$215,000/year to $245,000/year + benefits + equity

The salary range may be inclusive of several levels that would be applicable to the position. Final salary will be based on a number of factors including, level, relevant prior experience, skills, and expertise. This range is only inclusive of base salary, not benefits (more details below) or equity.

🎁 Benefits 

  • Flexible Time off Policy and Company-wide Holidays (including a spring and winter break)
  • Health Insurance options including Medical, Dental, Vision
  • Work From Home Support
    • Home office setup allowance
    • Monthly allowance for cell phone and internet
  • Care benefits
    • Monthly allowance for wellness
    • Annual allowance towards Childcare
    • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
  • Monthly allowance to dogfood the app
    • We expect all employees to actively use the product!
  • Parental Leave
    • 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.

💛 EOE 

Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce.

Similar Jobs

Playground Games - Character Artist (All Levels)

Playground Games

England, United Kingdom (Hybrid)
5 Months ago
Epic Games - Test Lead

Epic Games

Cary, North Carolina, United States (On-Site)
6 Months ago
Mistplay - Senior User Acquisition Manager I

Mistplay

London, England, United Kingdom (Remote)
1 Week ago
Ethernovia - Senior Embedded Software Engineer

Ethernovia

Pune, Maharashtra, India (On-Site)
2 Months ago
Qualcomm - Platform Associate Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Palo Alto Networks - Principal DevOps Engineer

Palo Alto Networks

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Regent craft - Senior Software Engineer (Platform, Operations, & DevOps)

Regent craft

North Kingstown, Rhode Island, United States (On-Site)
5 Months ago
AiDash - Backend Software Development Engineer III Platform

AiDash

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Qualcomm - Platform Associate Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Saronic Technologies - Machine Shop Supervisor (First and Second Shift)

Saronic Technologies

Austin, Texas, United States (On-Site)
1 Week ago
velotio technologies  - Senior Engineer (Data Engineer)

velotio technologies

Maharashtra, India (Remote)
4 Months ago
NXP - New Graduate Hiring Safe Launch Process Engineer

NXP

Kaohsiung, Kaohsiung City, Taiwan (On-Site)
1 Year ago
hogarth - Creative Editor

hogarth

Detroit, Michigan, United States (Hybrid)
2 Months ago
Epic Games - Gameplay Systems Engineer

Epic Games

(On-Site)
3 Months ago
tic toe games - Game Producer

tic toe games

Philippines (Remote)
3 Months ago
Propel - Head of Sales and Business Development

Propel

New York, United States (Remote)
2 Weeks ago
FlockSafety - Regional Operations Manager - Crentral

FlockSafety

United States (On-Site)
1 Week ago
PayPal - Sr Legal Counsel

PayPal

Singapore (Hybrid)
1 Month ago
Figma - Executive Assistant, Product Support

Figma

San Francisco, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Epic Games - Lead Counsel (Regulatory)

Epic Games

Cary, North Carolina, United States (On-Site)
5 Months ago
Apple - SAP Order to Cash Operations Lead

Apple

Austin, Texas, United States (On-Site)
2 Months ago
Lambda - Software Engineer

Lambda

San Francisco, California, United States (Hybrid)
5 Months ago
eBay - Strategic Insights Analyst

eBay

Austin, Texas, United States (Remote)
2 Weeks ago
Apple - Senior Engineering Program Manager, Cloud Infrastructure, Apple Services Engineering

Apple

Seattle, Washington, United States (On-Site)
2 Months ago
Nice - Sales Development Representative

Nice

Sandy, Utah, United States (Hybrid)
1 Month ago
Canva - Implementation Manager

Canva

Austin, Texas, United States (On-Site)
2 Weeks ago
Instawork - ML Engineer

Instawork

San Francisco, California, United States (On-Site)
2 Weeks ago
GoMotive - Principal Data Platform Engineer

GoMotive

United States (Remote)
1 Month ago
Qualcomm - GPU Performance Verification Engineer

Qualcomm

San Diego, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Devops Jobs

Motorola solutions - Lead DevOps/Platform Engineer

Motorola solutions

Kraków, Lesser Poland Voivodeship, Poland (Remote)
1 Week ago
Visa - Site Reliability Engineer

Visa

Ashburn, Virginia, United States (Hybrid)
2 Months ago
bytedance - Site Reliability Engineer - AML

bytedance

San Jose, California, United States (On-Site)
9 Months ago
bytedance - Research Engineer Graduate (Vision AI Platform)

bytedance

San Jose, California, United States (On-Site)
4 Months ago
WebMD - Senior Site Reliability Engineer

WebMD

Mumbai, Maharashtra, India (On-Site)
4 Months ago
GameChanger - Senior Full Stack Software Engineer, Video Platform

GameChanger

New York, United States (Remote)
1 Month ago
bytedance - Global Head of Solution Architect, SealSuite

bytedance

Singapore (On-Site)
6 Months ago
Scopely - Lead DevOps/SRE - Unannounced Project

Scopely

Dublin, County Dublin, Ireland (Hybrid)
6 Months ago
Google - Senior Software Engineer, Infrastructure, Google Cloud AI

Google

Kirkland, Washington, United States (On-Site)
3 Months ago
e2 open - Senior Solution Architect

e2 open

United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded