Lead Software Engineer - AI Data Systems

1 Month ago • All levels • Data Analysis • $151,500 PA - $215,500 PA

Job Summary

Job Description

Upwork is seeking a Lead Software Engineer specializing in AI Data Systems to join their growing AI team. The role involves building critical infrastructure for intelligent, agent-driven systems, focusing on collecting high-quality training data, developing scalable featurization pipelines, and delivering performant systems for AI model training and inference. This position is ideal for "Explorers" and "T-shaped engineers" with a strong software engineering background, Python proficiency, and experience in dynamic or AI/ML research environments. The engineer will be instrumental in shaping the technology and team, driving the development of AI infrastructure for agentic systems.
Must have:
  • Strong software engineering background
  • Experience building data pipelines at scale
  • Proficiency in Python
  • Familiarity with ML workflows
  • Experience deploying AI systems in cloud environments
  • Proven success in ambiguous environments
  • Growth mindset and strong communication skills
Good to have:
  • Experience with data-centric frameworks (Pandas, Spark, Apache Beam)
  • Experience with dataset versioning and experiment tracking
  • Experience working with high-caliber peers
Perks:
  • Comprehensive medical coverage
  • Unlimited PTO
  • 401(k) plan with matching
  • 12 weeks paid parental leave
  • Employee Stock Purchase Plan

Job Details

Upwork ($UPWK) is the world’s largest work marketplace, connecting businesses with highly skilled professionals worldwide. From entrepreneurs to Fortune 100 enterprises, companies trust Upwork’s platform to access expert talent, leverage AI-powered work solutions, and drive meaningful business outcomes.

Upwork’s AI-powered platform has facilitated over $20 billion in economic opportunity for professionals worldwide. With professionals spanning 10,000+ skills, including AI and machine learning, software development, sales and marketing, customer support, finance and accounting, and more, Upwork empowers businesses of all sizes to scale, innovate, and build agile teams.


We’re looking for a Lead Software Engineer (AI Data Systems) to join our growing AI team and help build the critical infrastructure that powers the future of intelligent, agent-driven systems at Upwork. You’ll be responsible for collecting high-quality training data, building scalable featurization pipelines, and delivering performant systems to support model training and inference at scale.

This role is built for Explorers, engineers who thrive in ambiguity, move fast with instinct, and are energized by greenfield challenges. Instead of narrowly scoped specialists, we’re hiring T-shaped engineers: individuals with a breadth of skills across the stack and deep expertise in at least one technical area. You’ll be one of our foundational hires, pushing past the known, building fast in Python, and helping us shape our technology and our team. Experience in startups, AI/ML research environments, or similarly dynamic settings is essential, as we’re solving problems that demand speed, curiosity, and adaptability.

If you’re passionate about AI infrastructure, thrive in early-stage environments, and want to help us set the standard for how agentic systems are built and deployed at scale, this is your opportunity.

Responsibilities

  • Design and implement systems to collect and curate high-quality training datasets for supervised, unsupervised, and reinforcement learning use cases.
  • Build scalable featurization and preprocessing pipelines to transform raw data into structured inputs for AI/ML model development.
  • Partner with ML engineers and researchers to define data requirements and production workflows that support LLM-based agents and autonomous AI systems.
  • Lead the development of infrastructure that enables experimentation, evaluation, and deployment of machine learning models in production environments.
  • Support orchestration and real-time inference pipelines using Python and modern cloud-native tools, ensuring low-latency and high availability.
  • Mentor engineers and foster a high-performance, collaborative engineering culture grounded in technical excellence and curiosity.
  • Drive cross-functional alignment with product, infrastructure, and research stakeholders, ensuring clarity on progress, goals, and architecture.

What it takes to catch our eye

  • Strong software engineering background with deep experience in building data collection, transformation, and featurization pipelines at scale.
  • Proficiency in Python, including async programming and concurrency tools, as well as data-centric frameworks such as Pandas, Spark, or Apache Beam.
  • Familiarity with ML model development workflows and infrastructure, including dataset versioning, experiment tracking, and model evaluation.
  • Experience deploying and scaling AI systems in cloud environments such as AWS, GCP, or Azure.
  • Proven success operating in highly ambiguous environments such as research labs, startups, or fast-paced product teams.
  • A track record of working with or alongside high-caliber peers in top engineering teams, research groups, or startup ecosystems.
  • Growth mindset, strong communication skills, and a commitment to inclusive collaboration and continuous learning.

Come change how the world works.

At Upwork, you’ll shape the future of work for a global, remote-first workforce, creating economic opportunities for professionals worldwide. While we have a physical office in Palo Alto, we currently hire full-time employees in 21 U.S. states, making it easier than ever to join our mission from wherever you call home.

Our culture is built on trust, risk-taking, customer focus, and excellence, all in service of our core mission: to create economic opportunities so people have better lives. We embrace authenticity and inclusion, encouraging everyone to bring their whole selves to work. Personal and professional growth is a priority here, supported through development programs, mentorship, and our Upwork Belonging Communities.

We’re proud to offer benefits that go beyond the basics, including comprehensive medical coverage for you and your family, unlimited PTO, a 401(k) plan with matching, 12 weeks of paid parental leave, and an Employee Stock Purchase Plan. Visit our Life at Upwork page to learn more about our values, working principles, and the overall employee experience.

Ready to help shape the future of work? Check out our Careers page and follow us on LinkedIn, Facebook, Instagram, TikTok, and X to learn more about life at Upwork.

Upwork is an Equal Opportunity Employer committed to recruiting and retaining a diverse and inclusive workforce. We do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, or other legally protected characteristics under federal, state, or local law.

Please note that a criminal background check may be required once a conditional job offer is made. Qualified applicants with arrest or conviction records will be considered in accordance with applicable law, including the California Fair Chance Act and local Fair Chance ordinances.

Similar Jobs

Scout - Senior Software Engineer, Infotainment (Android)

Scout

Fremont, California, United States (On-Site)
1 Month ago
Apple - Sports Business Optimization & League Relations

Apple

New York, New York, United States (On-Site)
2 Months ago
Rippling - Senior Program Manager, Talent Management

Rippling

San Francisco, California, United States (On-Site)
2 Months ago
Nice - AI Architect

Nice

Pune, Maharashtra, India (Hybrid)
1 Month ago
Abridge - Backend Engineer

Abridge

San Francisco, California, United States (Hybrid)
11 Months ago
TALA - Senior Data Scientist

TALA

Mexico City, Mexico (Remote)
1 Month ago
Nagarro - Associate Staff Consultant, Business Analyst

Nagarro

Chicago, Illinois, United States (On-Site)
8 Months ago
endava - Senior Data Engineer - GCP

endava

Melbourne, Victoria, Australia (On-Site)
1 Month ago
GoMotive - Senior Data Analyst

GoMotive

United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

The Walt Disney Company - Technical Director Principal

The Walt Disney Company

Hong Kong (On-Site)
8 Months ago
CyberArk - Director, Content & Editorial Strategy

CyberArk

United States (On-Site)
1 Month ago
Workato - Senior Automation Engineer

Workato

Chennai, Tamil Nadu, India (On-Site)
3 Weeks ago
Nahc.io - Customer Success Manager

Nahc.io

Hong Kong (On-Site)
2 Weeks ago
Capgemini - HR Operational Excellence Analyst

Capgemini

Kolkata, West Bengal, India (On-Site)
2 Weeks ago
zoox - Senior/Staff Technical Program Manager - Electrical Architecture

zoox

Foster City, California, United States (Hybrid)
3 Weeks ago
Apple - Clinical Producer - Health

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Capgemini - Process Lead-B1

Capgemini

Chennai, Tamil Nadu, India (On-Site)
1 Month ago
bounteous - Senior Director, Product Management - Crypto Payments

bounteous

United States (Remote)
1 Month ago
Capgemini - Data Engineer

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United States

Vertx Inc. - Principal Cloud Architect

Vertx Inc.

United States (Remote)
2 Months ago
Genies.io - Head of Product

Genies.io

Los Angeles, California, United States (On-Site)
1 Month ago
Motorola solutions - Key Account Manager

Motorola solutions

Chicago, Illinois, United States (On-Site)
2 Weeks ago
lifechruh - Contracts Paralegal

lifechruh

Edmond, Oklahoma, United States (On-Site)
3 Months ago
Rippling - Product Lead, Risk and Compliance

Rippling

San Francisco, California, United States (On-Site)
1 Month ago
Mark43 - Product Manager - Cybersecurity

Mark43

United States (Remote)
2 Weeks ago
Snap Mobile INC - Account Executive

Snap Mobile INC

Ithaca, New York, United States (On-Site)
3 Months ago
Kin. - Staff Data Engineer

Kin.

United States (Remote)
1 Month ago
Nice - Lead Business Analyst, Actimize

Nice

Hoboken, New Jersey, United States (Hybrid)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Amanotes - Product Data Analyst

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
4 Months ago
PwC - Senior Manager - Azure/ETL, Data and Analytics Advisory

PwC

Gurugram, India (On-Site)
1 Week ago
miniclip - Data Engineer

miniclip

Lisbon, Lisbon, Portugal (On-Site)
2 Months ago
Apple - Software Engineer (Master Data Management), Partner Solutions and Technology

Apple

Sunnyvale, California, United States (On-Site)
2 Months ago
Qualcomm - VLSI Design Engineer for Server / Data Center Products

Qualcomm

San Diego, California, United States (On-Site)
1 Month ago
luxsoft - Senior/Lead Data Engineer

luxsoft

Türkiye (Remote)
2 Months ago
Interface AI - Staff Backend Engineer - Data

Interface AI

San Francisco, California, United States (On-Site)
1 Month ago
eBay - Data Science Manager, Knowledge Management

eBay

Bengaluru, Karnataka, India (On-Site)
1 Year ago
endava - Senior Data Engineer - GCP

endava

Sydney, New South Wales, Australia (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded