Software Engineer, Search and Discovery Platform

1 Month ago • 5 Years + • Devops • $215,000 PA - $245,000 PA

Job Summary

Job Description

This role is for a Software Engineer to join the Discovery Platform team at Whatnot. The engineer will be involved in shaping the technical direction, designing a scalable Discovery system, building services and infrastructure for recommendation systems, and partnering with other teams. They should have experience in building discovery backend and data systems at scale. The responsibilities include building services and infrastructure for advanced recommendation systems, creating a scalable discovery experience, utilizing models to solve discovery problems, and contributing scalable solutions across various layers.
Must have:
  • Industry experience in handling high throughput applications
  • Ability to work autonomously and lead initiatives
  • Experience in machine learning fields
  • Expert at designing and building scalable systems
  • Familiarity with cloud computing platforms
  • Experience with concurrent programming patterns
  • Experience managing cloud technologies
  • Proficiency in server-side programming language
  • Exceptional interpersonal and communication skills
Good to have:
  • Experience with AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Kafka, Flink/Spark, OpenSearch, ElasticSearch, Lucene, SOLR.
  • Experience with cloud computing platforms
  • Comfort with infrastructure-as-code approaches (e.g. Terraform).
Perks:
  • Flexible Time off Policy and Company-wide Holidays
  • Health Insurance options including Medical, Dental, Vision
  • Home office setup allowance and monthly allowance for cell phone and internet
  • Monthly allowance for wellness and annual allowance towards Childcare
  • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement; 401k offering for Traditional and Roth accounts in the US and Pension plans internationally
  • Monthly allowance to dogfood the app
  • 16 weeks of paid parental leave + one month gradual return to work

Job Details

šŸš€ Join the Future of Commerce with Whatnot! 

Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. We’re re-defining e-commerce by blending community, shopping, and entertainment into a community just for you. As a remote co-located team, we’re inspired by innovation and anchored in our values. With hubs in the US, UK, Ireland, Poland, and Germany, we’re building the future of online marketplaces—together.

From fashion, beauty, and electronics to rare collectibles like trading cards, comic books, and even live plants, our live auctions have something for everyone.

And we’re just getting started! As one of the fastest growing marketplaces, we’re looking for bold, forward-thinking problem solvers across all functional areas. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business, and bring people together through commerce.

šŸ’» Role

We are looking for intellectually curious, highly motivated individuals to be foundational members in shaping the Discovery Platform. You will play a critical role in defining the technical direction and designing a world-class scalable Discovery system that is scalable enough to keep pace with our business growth to power feed, browse, search and taxonomy systems while catering to the unique challenges of operating a marketplace for live shopping! 

Working in a highly cross functional role, you’ll make key decisions about how we integrate retrieval, ranking through machine learning, real-time and stream processing, content understanding, materialization into a highly personalized discovery experience that unlocks product iterations while providing strong reliability. 

An ideal candidate will have experience building discovery backend and data systems at scale, with a knack for working closely with product engineers to solve immediate problems for our users while making right tradeoffs towards building a platform. We’ll often prototype new ideas quickly, and then need to build them for extreme scale while coordinating closely with other teams - the ideal person for this role is an expert at both of these approaches. 

Learn more about the Discovery systems at Whatnot from our blog posts on Whatamix, LLMs for Search.

 What you'll do:

  • Build the services and infrastructure to enable advanced recommendation systems solutions for real-time, dynamic feeds
  • Build a scalable, stable, low latency discovery experience
  • Partner closely across the machine learning, platform, and product engineering teams to utilize models to solve discovery problems
  • Contribute scalable solutions across various serving stacks at the feed, search, machine learning service, and Discovery application layers.
  • Define and advance our technical approach to scalable recommendation systems.

US Based:

Team members in this role are required to be within commuting distance of our San Francisco, Los Angeles, Seattle, and New York hubs. 

šŸ‘‹ You

Curious about who thrives at Whatnot? We’ve found that embodying a low ego, growth mindset, and high-impact drive goes a long way here.

As our next Software Engineer you should have 5+ years of experience, a Bachelor’s degree in Computer Science, Statistics, Mathematics, Software Engineering, a related technical field, or equivalent work experience, and ideally deep experience with several of the following:

  • Industry experience in building and scaling a platform to handle high volume / throughput applications 
  • Ability to work autonomously and lead initiatives across multiple product areas and communicate findings with leadership and product teams. You can mentor others and prioritize building inclusive, supportive teams.
  • Experience in machine learning fields (e.g. Recommendations, Content Understanding and Search).
  • Expert at designing and building scalable and maintainable backend systems.
  • Firm grasp of visualization tools for monitoring and logging e.g. DataDog, Grafana
  • Familiarity with cloud computing platforms and managed services such as AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Kafka, Flink/Spark, OpenSearch, ElasticSearch, Lucene, SOLR.
  • Experience with concurrent programming patterns across distributed systems (AsyncIO python preferred), and optimizations / profiling / observability associated with them. 
  • Experience managing cloud technologies (AWS or Google Cloud) and comfort with infrastructure-as-code approaches (e.g. Terraform).

In addition to these role-specific qualifications, all engineering team members are expected to have:

  • Proficiency in at least one server-side programming language (preferably Python), common algorithms and data structures, and software design principles.
  • Self-starter ethic, thriving under a high level of autonomy.
  • Exceptional interpersonal and communication skills.

šŸ’°Compensation

$215,000/year to $245,000/year + benefits + equity

The salary range may be inclusive of several levels that would be applicable to the position. Final salary will be based on a number of factors including, level, relevant prior experience, skills, and expertise. This range is only inclusive of base salary, not benefits (more details below) or equity.

šŸŽ Benefits 

  • Flexible Time off Policy and Company-wide Holidays (including a spring and winter break)
  • Health Insurance options including Medical, Dental, Vision
  • Work From Home Support
    • Home office setup allowance
    • Monthly allowance for cell phone and internet
  • Care benefits
    • Monthly allowance for wellness
    • Annual allowance towards Childcare
    • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
  • Monthly allowance to dogfood the app
    • We expect all employees to actively use the product!
  • Parental Leave
    • 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.

šŸ’› EOE 

Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce.

Similar Jobs

Vendavo - Senior Data Scientist

Vendavo

Prague, Prague, Czechia (Hybrid)
• 2 Weeks ago
Collective Ace - Investment Executive

Collective Ace

Berlin, Berlin, Germany (Remote)
• 3 Months ago
Zinnia - Executive Assistant to CFO

Zinnia

Greenwich, Connecticut, United States (On-Site)
• 1 Month ago
Zuru - Licensing Executive

Zuru

Auckland, Auckland, New Zealand (On-Site)
• 4 Weeks ago
PayPal - Sr Lead Product Manager

PayPal

New York, New York, United States (Hybrid)
• 4 Weeks ago
Aristocrat - DevOps Lead

Aristocrat

Montreal, Quebec, Canada (Hybrid)
• 4 Months ago
Google - Staff Software Engineer, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
• 6 Months ago
Ansys - DevOps Engineer II

Ansys

Athens, Greece (Hybrid)
• 2 Months ago
Workato - Senior AI Solutions Engineer

Workato

Bengaluru, Karnataka, India (On-Site)
• 1 Month ago
bytedance - Software Engineer, Cloud Native Platform

bytedance

San Jose, California, United States (On-Site)
• 8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

SparkCognition - Software Engineer (Backend)

SparkCognition

Bengaluru, Karnataka, India (On-Site)
• 9 Months ago
Netflix - DSP Partner Operations Manager

Netflix

New York, New York, United States (On-Site)
• 2 Months ago
bytedance - Software Engineer Intern (On-Device AI - Intelligent Creation-AI Platform)

bytedance

San Jose, California, United States (On-Site)
• 2 Months ago
Eleventh Hour Games - Art Manager

Eleventh Hour Games

Dallas, Texas, United States (Remote)
• 4 Months ago
HCL Tech - Enterprise solution architect

HCL Tech

New Jersey, United States (On-Site)
• 1 Month ago
CME Group - Manager, Global Account Management

CME Group

Tokyo, Japan (On-Site)
• 1 Year ago
Nium - Manager - Revenue Operations Lead ( FP&A)

Nium

Mumbai, Maharashtra, India (Hybrid)
• 3 Weeks ago
Blue wire software - Delivery Driver

Blue wire software

Selma, California, United States (On-Site)
• 1 Week ago
Scout - Chassis Function Calibration Engineer

Scout

Novi, Michigan, United States (On-Site)
• 1 Week ago
Philips - Assistant Commercial Excellence Manager

Philips

Shanghai, China (On-Site)
• 4 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Nintendo - Cinematic Technical Animator (Retro Studios)

Nintendo

United States (Remote)
• 11 Months ago
Apple - Growth Marketer, Communications for Advertiser Journey

Apple

Cupertino, California, United States (On-Site)
• 3 Weeks ago
UPF Industries  - Deckorators Field Specialist

UPF Industries

Des Moines, Iowa, United States (Remote)
• 1 Month ago
bytedance - Research Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

bytedance

Seattle, Washington, United States (On-Site)
• 8 Months ago
PeopleFun - Senior Software Engineer

PeopleFun

United States (Remote)
• 1 Month ago
HCL Tech - Sr tech support spec - database support

HCL Tech

Massachusetts, United States (On-Site)
• 1 Month ago
Hawkeye Innovations - Broadcast Systems Technician, B1G Replay (CHI)

Hawkeye Innovations

Rosemont, Illinois, United States (On-Site)
• 3 Months ago
The E.W. Scripps Company - Multimedia Journalist

The E.W. Scripps Company

Grand Rapids, Michigan, United States (On-Site)
• 1 Month ago
ISG - Public Sector Consulting Manager

ISG

United States (Remote)
• 1 Month ago
Kavalirio - Manufacturing Engineer Level 4

Kavalirio

Los Angeles, California, United States (On-Site)
• 2 Months ago

Get notifed when new similar jobs are uploaded

Devops Jobs

Autodesk - Software Architect(Java, AWS)

Autodesk

Pune, Maharashtra, India (On-Site)
• 1 Month ago
bytedance - Senior Software Engineer, Cloud Infrastructure

bytedance

San Jose, California, United States (On-Site)
• 6 Months ago
Britive - Senior Software Engineer (Cloud)

Britive

Bengaluru, Karnataka, India (Remote)
• 1 Month ago
London stock Exchange - Tech Lead -Database SRE

London stock Exchange

Bengaluru, Karnataka, India (On-Site)
• 3 Weeks ago
velotio technologies  - Senior DevOps Engineer

velotio technologies

Pune, Maharashtra, India (Remote)
• 1 Month ago
bytedance - Software Engineer, SRE - Platform Services

bytedance

Seattle, Washington, United States (On-Site)
• 2 Months ago
zoox - Software Engineer, Analytics Platform

zoox

Foster City, California, United States (Hybrid)
• 2 Weeks ago
Applied materials  - DevOps Support Engineer

Applied materials

Bengaluru, Karnataka, India (On-Site)
• 1 Month ago
Google - Advertising Solutions Architect

Google

Beijing, Beijing, China (On-Site)
• 2 Months ago
Boomi  - Software Engineer 2 – DevSecOps

Boomi

India (On-Site)
• 1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Los Angeles, California, United States (On-Site)

London, England, United Kingdom (On-Site)

San Francisco, California, United States (On-Site)

Kraków, Lesser Poland Voivodeship, Poland (Remote)

New York, United States (On-Site)

San Francisco, California, United States (On-Site)

Berlin, Berlin, Germany (On-Site)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Dublin, County Dublin, Ireland (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Whatnot

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug