Lead Software Engineer, Data

3 Months ago • 10 Years + • Data Analysis

Job Summary

Job Description

The Lead Software Engineer – Data at Coupa will be responsible for leading the architecture, design, and optimization of the data infrastructure. They will collaborate with Data Scientists, Product Managers, and Software Engineers to build and maintain scalable, high-performance data solutions. This role involves driving the development of robust data architectures for large datasets, ensuring data integrity, security, and governance. Additionally, they will provide technical leadership, mentor engineers, and define best practices to ensure the efficiency and scalability of data systems. This role will also contribute to the overall success and growth of Coupa, solidifying its position as a leader in cloud-based spend management solutions. They will also lead and drive the development and optimization of scalable data architectures and pipelines and collaborate with stakeholders to support data-driven decision-making.
Must have:
  • Advanced working SQL knowledge and experience with relational databases.
  • Expertise in processing large workloads and complex code on Spark clusters.
  • Experience in designing and implementing scalable Data Warehouse solutions.
  • Experience with API development and design with REST or GraphQL.
  • Experience building and optimizing 'big data' data pipelines.
Good to have:
  • Experience performing root cause analysis on data and processes.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

Job Details

Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins.

Why join Coupa?

🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend.
🔹 Collaborative Culture: We value collaboration and teamwork, and our culture is driven by transparency, openness, and a shared commitment to excellence.
🔹 Global Impact: Join a company where your work has a global, measurable impact on our clients, the business, and each other. 

Learn more on Life at Coupa blog and hear from our employees about their experiences working at Coupa. 

The Impact of a Lead Software Engineer – Data to Coupa:

The Lead Software Engineer – Data is a pivotal role at Coupa, responsible for leading the architecture, design, and optimization of the data infrastructure that powers our business. This individual will collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to build and maintain scalable, high-performance data solutions.

The Lead Software Engineer – Data will drive the development of robust data architectures, capable of handling large and complex datasets, while ensuring data integrity, security, and governance. Additionally, this role will provide technical leadership, mentoring engineers, and defining best practices to ensure the efficiency and scalability of our data systems.

Suitable candidates will have a strong background in data engineering, with experience in data modeling, ETL development, and data pipeline optimization. They will also have deep expertise in programming languages such as Python, Java, or Scala, along with hands-on experience in cloud-based data storage and processing technologies such as AWS, Azure, or GCP.

The impact of a skilled Lead Software Engineer – Data at Coupa will be significant, ensuring that our platform is powered by scalable, reliable, and high-quality data solutions. This role will enable the company to deliver innovative, data-driven solutions to our customers and partners. Their work will contribute to the overall success and growth of Coupa, solidifying its position as a leader in cloud-based spend management solutions.

What You’ll Do:

    • Lead and drive the development and optimization of scalable data architectures and pipelines.
    • Design and implement best-in-class ETL/ELT solutions for real-time and batch data processing.
    • Optimize Spark clusters for performance, reliability, and cost efficiency, implementing monitoring solutions to identify bottlenecks.
    • Architect and maintain cloud-based data infrastructure leveraging AWS, Azure, or GCP services.
    • Ensure data security and governance, enforcing compliance with industry standards and regulations.
    • Develop and promote best practices for data modeling, processing, and analytics.
    • Mentor and guide a team of data engineers, fostering a culture of innovation and technical excellence.
    • Collaborate with stakeholders, including Product, Engineering, and Data Science teams, to support data-driven decision-making.
    • Automate and streamline data ingestion, transformation, and analytics processes to enhance efficiency.
    • Develop real-time and batch data processing solutions, integrating structured and unstructured data sources.

What you will bring to Coupa:

    • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
    • Expertise in processing large workloads and complex code on Spark clusters.
    • Expertise in setting up monitoring for Spark clusters and driving optimization based on insights and findings.
    • Experience in designing and implementing scalable Data Warehouse solutions to support analytical and reporting needs.
    • Experience with API development and design with REST or GraphQL. Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
    • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
    • Strong analytic skills related to working with unstructured datasets.
    • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
    • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
    • Strong project management and organizational skills.
    • Experience supporting and working with cross-functional teams in a dynamic environment.
    • We are looking for a candidate with 10+ years of experience in a in Data Engineering with at least 3+ years in a Technical Lead role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field. They should also have experience using the following software/tools: Experience with object-oriented/object function scripting languages: Python, Java, C++, .net, etc. Expertise in Python is a must.
    • Experience with big data tools: Spark, Kafka, etc.
    • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
    • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
    • Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
    • Working knowledge of stream-processing systems: Storm, Spark-Streaming, etc.

Coupa complies with relevant laws and regulations regarding equal opportunity and offers a welcoming and inclusive work environment. Decisions related to hiring, compensation, training, or evaluating performance are made fairly, and we provide equal employment opportunities to all qualified candidates and employees. 

Please be advised that inquiries or resumes from recruiters will not be accepted.

By submitting your application, you acknowledge that you have read Coupa’s Privacy Policy and understand that Coupa receives/collects your application, including your personal data, for the purposes of managing Coupa's ongoing recruitment and placement activities, including for employment purposes in the event of a successful application and for notification of future job opportunities if you did not succeed the first time. You will find more details about how your application is processed, the purposes of processing, and how long we retain your application in our Privacy Policy.

Similar Jobs

Oliver Plus - GenAI Art Director

Oliver Plus

South Africa (Remote)
3 Weeks ago
Semgrep - Head of Customer Success

Semgrep

San Francisco, California, United States (Hybrid)
3 Weeks ago
WongDoody - PRODUCT SERVICE DESIGNER, TAIWAN

WongDoody

Taipei City, Taiwan (On-Site)
8 Months ago
arrowhead games - Chief Technology Officer

arrowhead games

Stockholm, Stockholm County, Sweden (Hybrid)
6 Months ago
Apple - Sales Operations Lead, Apple Ads – AMR

Apple

San Francisco, California, United States (On-Site)
3 Weeks ago
Rovio  - Principal Data Analyst, Team Manager

Rovio

Uusimaa, Finland (Hybrid)
1 Month ago
Cognite - Senior/Principal Data Scientist

Cognite

Oslo, Oslo, Norway (Hybrid)
2 Months ago
Playtika - Experienced Data Scientist

Playtika

Israel (On-Site)
6 Months ago
The Walt Disney Company - Business Systems Analyst

The Walt Disney Company

Hong Kong (On-Site)
3 Months ago
PwC - Senior Associate AI Engineer - Data and Analytics - Advisory

PwC

Hyderabad, Telangana, India (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Unity - Android Team Lead

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
7 Months ago
Alphawave Semi - Senior Production and NPI Planner (Data Analytics Focus)

Alphawave Semi

Hsinchu County, Taiwan (Hybrid)
2 Months ago
Drive mode - Product Operations Manager

Drive mode

Mountain View, California, United States (Hybrid)
3 Weeks ago
London stock Exchange - Lead Database Engineer - Devops

London stock Exchange

Bengaluru, Karnataka, India (On-Site)
2 Months ago
OKX - Head of FinCrime, Internal Audit

OKX

San Jose, California, United States (On-Site)
2 Months ago
Hudl - Senior Marketing Manager

Hudl

Lincoln, Nebraska, United States (On-Site)
1 Month ago
WRI - Senior Communication Specialist for Cities

WRI

Jakarta, Indonesia (On-Site)
9 Months ago
Square - Purchasing Manager

Square

Hounslow, England, United Kingdom (On-Site)
3 Weeks ago
DataVisor - Director of Strategic Accounts - US Eastern Region

DataVisor

United States (Remote)
1 Month ago
nubank - Market & Liquidity Risk Senior Analyst

nubank

Bogotá, Bogota, Colombia (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Pune, Maharashtra, India

Zscaler - Senior Manager - Software Development Engineering

Zscaler

Bengaluru, Karnataka, India (On-Site)
1 Month ago
zeta - Manager - Security Operations Centre

zeta

Hyderabad, Telangana, India (On-Site)
4 Months ago
Nagarro - Staff Engineer, Java

Nagarro

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Sprinkler - HR Intern

Sprinkler

Gurugram, Haryana, India (On-Site)
2 Weeks ago
beghou consulting - Consultant – Data Warehouse (ARMADA Delivery)

beghou consulting

Pune, Maharashtra, India (Hybrid)
2 Months ago
GoTo Group - Principal SRE Engineer (SE5)

GoTo Group

Gurugram, Haryana, India (On-Site)
9 Months ago
Xentrix studios - Finance – Senior Executive

Xentrix studios

India (On-Site)
9 Months ago
Digital Jalebi - UI/UX Designer

Digital Jalebi

Noida, Uttar Pradesh, India (Remote)
2 Years ago
P99 soft - IT Recruiter / Senior IT Recruiter / Lead IT Recruiter

P99 soft

Hyderabad, Telangana, India (Hybrid)
1 Month ago
Ethernovia - Firmware Engineer

Ethernovia

Pune, Maharashtra, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Go Fund Me - Staff Data Scientist

Go Fund Me

San Francisco, California, United States (On-Site)
3 Weeks ago
Zuora - Senior Data Scientist

Zuora

Bengaluru, Karnataka, India (Remote)
1 Month ago
Synechron - Data Engineer

Synechron

Jersey City, New Jersey, United States (On-Site)
3 Weeks ago
Next Level Business Services - Data Scientist -  Full Time Only

Next Level Business Services

Redmond, Washington, United States (On-Site)
9 Months ago
GoTo Group - Senior Growth Data Analyst

GoTo Group

Jakarta, Indonesia (On-Site)
1 Month ago
GameJobs - Senior Data Scientist

GameJobs

São Paulo, State Of São Paulo, Brazil (On-Site)
1 Year ago
Match Group - Data Analyst (Azar)

Match Group

Seoul, South Korea (Hybrid)
2 Months ago
Nagarro - Associate Principal Consultant, Business Analyst

Nagarro

India (Remote)
9 Months ago
InMobiInMobi - Data Scientist III

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
OKX - Data Analyst & Business Strategy Director

OKX

Singapore (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Indianapolis, Indiana, United States (Remote)

Salt Lake City, Utah, United States (Remote)

Austin, Texas, United States (Remote)

Oklahoma City, Oklahoma, United States (Remote)

Pune, Maharashtra, India (On-Site)

Ann Arbor, Michigan, United States (Remote)

Austin, Texas, United States (Remote)

View All Jobs

Get notified when new jobs are added by Coupa

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug