Lead Software Engineer, Data
Job Summary
Job Description
The Lead Software Engineer – Data at Coupa will be responsible for leading the architecture, design, and optimization of the data infrastructure. They will collaborate with Data Scientists, Product Managers, and Software Engineers to build and maintain scalable, high-performance data solutions. This role involves driving the development of robust data architectures for large datasets, ensuring data integrity, security, and governance. Additionally, they will provide technical leadership, mentor engineers, and define best practices to ensure the efficiency and scalability of data systems. This role will also contribute to the overall success and growth of Coupa, solidifying its position as a leader in cloud-based spend management solutions. They will also lead and drive the development and optimization of scalable data architectures and pipelines and collaborate with stakeholders to support data-driven decision-making.
Must have:
- Advanced working SQL knowledge and experience with relational databases.
- Expertise in processing large workloads and complex code on Spark clusters.
- Experience in designing and implementing scalable Data Warehouse solutions.
- Experience with API development and design with REST or GraphQL.
- Experience building and optimizing 'big data' data pipelines.
Good to have:
- Experience performing root cause analysis on data and processes.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
15 skills required
Job Details
Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins.
Why join Coupa?
🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend.
🔹 Collaborative Culture: We value collaboration and teamwork, and our culture is driven by transparency, openness, and a shared commitment to excellence.
🔹 Global Impact: Join a company where your work has a global, measurable impact on our clients, the business, and each other.
Learn more on Life at Coupa blog and hear from our employees about their experiences working at Coupa.
The Impact of a Lead Software Engineer – Data to Coupa:
The Lead Software Engineer – Data is a pivotal role at Coupa, responsible for leading the architecture, design, and optimization of the data infrastructure that powers our business. This individual will collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to build and maintain scalable, high-performance data solutions.
The Lead Software Engineer – Data will drive the development of robust data architectures, capable of handling large and complex datasets, while ensuring data integrity, security, and governance. Additionally, this role will provide technical leadership, mentoring engineers, and defining best practices to ensure the efficiency and scalability of our data systems.
Suitable candidates will have a strong background in data engineering, with experience in data modeling, ETL development, and data pipeline optimization. They will also have deep expertise in programming languages such as Python, Java, or Scala, along with hands-on experience in cloud-based data storage and processing technologies such as AWS, Azure, or GCP.
The impact of a skilled Lead Software Engineer – Data at Coupa will be significant, ensuring that our platform is powered by scalable, reliable, and high-quality data solutions. This role will enable the company to deliver innovative, data-driven solutions to our customers and partners. Their work will contribute to the overall success and growth of Coupa, solidifying its position as a leader in cloud-based spend management solutions.
What You’ll Do:
- Lead and drive the development and optimization of scalable data architectures and pipelines.
- Design and implement best-in-class ETL/ELT solutions for real-time and batch data processing.
- Optimize Spark clusters for performance, reliability, and cost efficiency, implementing monitoring solutions to identify bottlenecks.
- Architect and maintain cloud-based data infrastructure leveraging AWS, Azure, or GCP services.
- Ensure data security and governance, enforcing compliance with industry standards and regulations.
- Develop and promote best practices for data modeling, processing, and analytics.
- Mentor and guide a team of data engineers, fostering a culture of innovation and technical excellence.
- Collaborate with stakeholders, including Product, Engineering, and Data Science teams, to support data-driven decision-making.
- Automate and streamline data ingestion, transformation, and analytics processes to enhance efficiency.
- Develop real-time and batch data processing solutions, integrating structured and unstructured data sources.
What you will bring to Coupa:
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Expertise in processing large workloads and complex code on Spark clusters.
- Expertise in setting up monitoring for Spark clusters and driving optimization based on insights and findings.
- Experience in designing and implementing scalable Data Warehouse solutions to support analytical and reporting needs.
- Experience with API development and design with REST or GraphQL. Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Strong project management and organizational skills.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- We are looking for a candidate with 10+ years of experience in a in Data Engineering with at least 3+ years in a Technical Lead role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field. They should also have experience using the following software/tools: Experience with object-oriented/object function scripting languages: Python, Java, C++, .net, etc. Expertise in Python is a must.
- Experience with big data tools: Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
- Working knowledge of stream-processing systems: Storm, Spark-Streaming, etc.
Coupa complies with relevant laws and regulations regarding equal opportunity and offers a welcoming and inclusive work environment. Decisions related to hiring, compensation, training, or evaluating performance are made fairly, and we provide equal employment opportunities to all qualified candidates and employees.
Please be advised that inquiries or resumes from recruiters will not be accepted.
By submitting your application, you acknowledge that you have read Coupa’s Privacy Policy and understand that Coupa receives/collects your application, including your personal data, for the purposes of managing Coupa's ongoing recruitment and placement activities, including for employment purposes in the event of a successful application and for notification of future job opportunities if you did not succeed the first time. You will find more details about how your application is processed, the purposes of processing, and how long we retain your application in our Privacy Policy.
Similar Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Skill Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Jobs in Pune, Maharashtra, India
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Category Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
