Senior Software Engineer, Ads Experimentation Platform

2 Months ago • 5 Years + • Devops

Job Summary

Job Description

As a Senior Software Engineer on the Ads Experimentation Platform team, you will collaborate with data science partners and product leaders to enhance the capacity and efficiency of existing experimentation tools. Your responsibilities will include building A/B testing tools customized for the Ads marketplace, creating tools for measuring infrastructure costs by ad product, developing advertiser-facing tools, and constructing a scalable ad pacing platform. You will work on tools to test new products and verify ideas in the ads marketplace focusing on budget cannibalization, user-split A/B testing, and handling sparse samples. The role involves significant code contribution, experience with ads-serving related systems, and building A/B testing frameworks. You will be working on building tools to connect advertisers to the target audience because of our passionate and engaged communities.
Must have:
  • Experience in backend programming languages (Go or Scala preferred).
  • Experience with API development and service frameworks (Thrift, Protobuf).
  • Experience with data processing frameworks (Spark, Flink, Kafka, etc.).
  • Experience with cloud service providers like AWS or GCP.
  • Experience with tools like Kubernetes, Drone, CircleCI, etc.
  • Experience with datastores like ElasticSearch, Redis, Postgres, etc.
  • Degree in a quantitative discipline.
  • 5+ years of contributing high-quality code.
Perks:
  • Comprehensive Health benefits
  • Registered Retirement Savings plan with matching contributions
  • Income Replacement Programs
  • Family Planning Support
  • Gender-Affirming Care
  • Mental Health & Coaching Benefits
  • Flexible Vacation & Reddit Global Days Off

Job Details

Reddit is a community of communities. It’s built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 101M+ daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit redditinc.com.

As a company, Reddit primarily generates revenue through advertising, and we're working towards building a massive business to fund our mission. We distinguish ourselves from other digital ad platforms by attracting advertisers who want to connect with a specific target audience because of our passionate and engaged communities.

 

Reddit ads marketplace is a dynamic and complicated environment where millions of engagements among Reddit users, advertisers and the platform occur every second. It’s critical for us to extract useful and statistically significant signals from the massive volume of events to guide the product developments and decisions in a scientific way. 

 

The Ads Experimentation Platform (AEXP) team builds tools for our engineers and scientists to accurately test new products and efficiently verify new ideas in the ads marketplace. Have you heard about Budget Cannibalization? Have you wondered why a user-split A/B testing is insufficient in testing products in the Ads marketplace? How can we make the most out of rare and sparse samples (e.g. conversion events)? How can I explore 100 algorithmic candidates at the same time? These are the typical problems we are dealing with on a daily basis.

 

Meanwhile, Ads Pacing plays a crucial role in both supporting the dynamism of the marketplace and accommodating the budget-aware A/B experiments, therefore our team is also committed to building scalable and flexible pacing infrastructures that improves the market efficiency and budget-aware testing capacity.

 

Some of the project highlights include:

  • An A/B testing framework that split both users and ad budgets to create parallel and mutually exclusive control/treatment sub ads marketplaces,
  • An exploration tool that can run multiple (hundreds of) A/B testing pairs of campaigns over multiple algorithmic candidates for pacing,
  • Partitioning the pacing and budgeting systems to accommodate the growing number of advertisers and maintain the refreshing rate above once per minute,

 

As a senior software engineer in the Ads Experimentation Platform team, you will work closely with data science partners and product leaders to improve the capacity and efficiency of existing experimentation tools, research and build new testing methodologies and tools, and lead the experimentation practices across the Ads marketplace teams. You will collaborate with cross-functional engineering, product, and data science teams to ensure that our customers’ voices are represented in your work..

Responsibilities:

  • Building A/B testing tools customized for Ads marketplace,
  • Building A/B testing tools for measuring infra cost by each ad product,
  • Building advertiser-facing tools for exploring through Reddit Ads products and optimizing for the best performances,
  • Building scalable and reliable ad pacing platform to enable efficient experimentation and research on the control algorithms,

Who You Might Be:

  • Degree in a quantitative discipline: engineering, statistics, operations research, computer science, informatics, applied mathematics, economics, etc.
  • 5+ years of contributing high-quality code to production systems that operate at scale.
  • 3+ years of experience building ads-serving related systems, including but not limited to ads targeting, ads ranking, ads pacing.
  • Experience building A/B testing frameworks for multiparty marketplace scenarios, e.g. food delivery service, ride sharing, ads marketplace.
  • Experience leading large engineering teams and collaborating with cross-functional partners is required, especially with data science partners.

Required qualifications:

  • Significant experience in one or more backend programming languages, experience with Go or Scala is preferable.
  • Significant experience with API development and service frameworks, e.g. Thrift and Protobuf.
  • Data processing frameworks like Spark, Flink, Kafka, Druid, etc.
  • A cloud service provider like AWS or GCP
  • Tools: Kubernetes, Drone, CircleCI, Spinnaker, Argo, Airflow, Docker.
  • Datastores: ElasticSearch / Amazon OpenSearch, Redis, Postgres, Cassandra, BigQuery

Benefits:

  • Comprehensive Health benefits
  • Registered Retirement Savings plan with matching contributions
  • Income Replacement Programs
  • Family Planning Support
  • Gender-Affirming Care
  • Mental Health & Coaching Benefits
  • Flexible Vacation & Reddit Global Days Off


#li-remote

Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve.  Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.

Similar Jobs

Anavation - Modeling Data Engineer - Ontologist

Anavation

Lorton, Virginia, United States (Hybrid)
2 Months ago
Cognite - Senior Data Engineer

Cognite

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (Remote)
2 Months ago
Backbone - Lead Electrical Engineer

Backbone

Atherton, California, United States (Hybrid)
1 Year ago
Salesforce - Director, Product Marketing, IT Service

Salesforce

San Francisco, California, United States (On-Site)
1 Week ago
Axon - Manager, Go-to-Market Readiness

Axon

Seattle, Washington, United States (On-Site)
2 Months ago
ansira - Site Reliability Engineer

ansira

Noida, Uttar Pradesh, India (On-Site)
3 Weeks ago
Ajmera Infotech - Senior .NET Developer with Cloud Expertise

Ajmera Infotech

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
truecaller - Senior Site Reliability Engineer

truecaller

Bengaluru, Karnataka, India (Hybrid)
6 Days ago
luxsoft - Regular Build System Engineer w/ DevOps on Linux

luxsoft

Poland (Remote)
1 Month ago
Palo Alto Networks - Senior Consulting Director, Cloud Security, Proactive Services (Unit 42)

Palo Alto Networks

Santa Clara, California, United States (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Stage - Analytics Engineer

Stage

Noida, Uttar Pradesh, India (On-Site)
2 Months ago
DraftKings - Product Designer

DraftKings

Boston, Massachusetts, United States (On-Site)
1 Month ago
AeroSpike - Staff Site Reliability Engineer

AeroSpike

United States (Remote)
3 Weeks ago
Mozilla - Manager, Data Science

Mozilla

Canada (Remote)
3 Weeks ago
Linden lab - Business Operations Director

Linden lab

San Francisco, California, United States (Hybrid)
2 Months ago
GOAT Group - Staff Data Scientist

GOAT Group

United States (Remote)
1 Month ago
Mixpanel - Senior Sales Manager, Enterprise

Mixpanel

San Francisco, California, United States (Hybrid)
1 Week ago
Capgemini - AZURE SOLUTION ARCHITECT

Capgemini

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Riot Games - Sr. Manager, Game Production - Unpublished R&D Product

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Scout - Senior Staff Software Engineer - Mobile (Android)

Scout

Fremont, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Ontario, Canada

Penn Interactive - Technical Advisor to the CTO

Penn Interactive

Toronto, Ontario, Canada (Remote)
2 Days ago
deel. - Payroll Compliance Analyst

deel.

Canada (Remote)
2 Days ago
Cineplex - Part-Time Cast Member

Cineplex

Truro, Nova Scotia, Canada (On-Site)
1 Month ago
gitlab - Senior Marketing Campaigns Manager

gitlab

Canada (Remote)
3 Weeks ago
Critical mass - Freelance Associate Creative Director, Art

Critical mass

Calgary, Alberta, Canada (On-Site)
2 Weeks ago
quience - French Copywriter

quience

Toronto, Ontario, Canada (On-Site)
2 Days ago
GoMotive - People Analytics Partner

GoMotive

Canada (Remote)
2 Weeks ago
Epic Games - Senior Tools Programmer, UI Systems

Epic Games

Montreal, Quebec, Canada (On-Site)
3 Months ago
Voldex - Art Lead

Voldex

Montreal, Quebec, Canada (Remote)
2 Months ago
Alpha Sense - Cloud Support Engineer

Alpha Sense

Vancouver, British Columbia, Canada (On-Site)
3 Days ago

Get notifed when new similar jobs are uploaded

Devops Jobs

Apple - iOS Engineer - Apple Cloud - Subscriptions

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Rush street interactive  - Senior Full-Stack Automation Engineer

Rush street interactive

Estonia (Hybrid)
4 Months ago
extreme network - Solutions Architect

extreme network

Texas, United States (Remote)
3 Weeks ago
Sun Studio - Senior Backend and DevOps Engineer

Sun Studio

Ho Chi Minh City, Vietnam (On-Site)
4 Months ago
Electronic Arts - Build Software Developer - Development Release Engineering (DRE)

Electronic Arts

Vancouver, British Columbia, Canada (Hybrid)
3 Weeks ago
Capgemini - Build Engineer

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Motorola solutions - Site Reliability Engineer

Motorola solutions

Gatineau, Quebec, Canada (On-Site)
2 Weeks ago
Roblox - Senior/Principal AI Platform Engineer

Roblox

San Mateo, California, United States (On-Site)
1 Month ago
Next Level Business Services - DevOps Consultant

Next Level Business Services

San Diego, California, United States (On-Site)
9 Months ago
Palo Alto Networks - Principal DevOps Engineer

Palo Alto Networks

Santa Clara, California, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded