Senior Data Engineer, Compliance

1 Hour ago • 4-7 Years • Data Analysis

Job Summary

Job Description

Autodesk is seeking experienced engineering candidates for its Compliance team, which focuses on detecting and addressing non-compliant users of Autodesk software. As a Senior Data Engineer, you will be responsible for enhancing critical data processing and analytics pipelines, improving platform reliability, resilience, and scalability. You will also develop dashboards for business stakeholders to facilitate data viewing and analysis. The role requires a product-focused mindset, the ability to break down complex problems, document solutions, and implement iterative improvements. You will build and scale data infrastructure for processing billions of records, automate cloud infrastructure, services, and observability, and develop CI/CD pipelines with testing automation. Collaboration with data engineers, data scientists, product managers, and stakeholders is key to understanding needs and promoting best practices. You will leverage data analysis and data mining to identify business challenges and opportunities, providing strategic recommendations. Responsibilities include supporting analytics, delivering insights on product usage, campaign performance, and revenue growth, building ad-hoc analyses, long-term projects, reports, and dashboards, and working with business stakeholders to define critical metrics and KPIs.
Must have:
  • 4-7 years of industry experience in big data, data processing, and SQL
  • 3+ years coding experience in Spark data frames, Spark SQL, PySpark
  • 3+ years programming in Python and SQL
  • Strong SQL, dimensional modeling, and big data warehouse knowledge (Hive, Snowflake)
  • Experience with ETL workflow tools (e.g., Airflow)
  • 2+ years building reports/dashboards with BI tools
  • Experience with version control and CI/CD (Git, Jenkins CI)
  • Experience analyzing data on notebook solutions (Jupyter, EMR, Zeppelin)
  • Experience with dashboarding tools (PowerBI, Qlik, Tableau)
  • Bachelor's degree in Computer Science, Engineering, or equivalent experience
Good to have:
  • Knowledge of Looker is a plus

Job Details

Job Requisition ID #

25WD90435

Position Overview

Autodesk is looking for diverse engineering candidates to join Compliance team, a collection of systems and teams focused on detecting and exposing non-compliant users of Autodesk software. This is a key strategic initiative for the company. As a Senior Data Engineer, you will work to rapidly improve critical data processing & analytics pipelines. You will tackle hard problems to improve the platform’s reliability, resiliency, and scalability. You will build dashboards that business stakeholders can leverage on for viewing data, performing data analysis and viewing outcomes.

We are looking for someone who thrives on autonomy and has experience driving long-term projects to completion. You are detail and quality oriented, and excited about the prospects of having a big impact with data at Autodesk. Our tech stack includes Hive, Spark, Presto, Jenkins, Snowflake, PowerBI, Looker and various AWS services.

Responsibilities

  • You will need a product-focused mindset. It is essential for you to understand business requirements and architect systems that will scale and extend to accommodate those needs

  • Break down complex problems, document technical solutions and sequence work to make fast, iterative improvements

  • Build and scale data infrastructure that powers batch and real-time data processing of billions of records

  • Automate cloud infrastructure, services, and observability

  • Develop CI/CD pipelines and testing automation

  • Interface with data engineers, data scientists, product managers and all data stakeholders to understand their needs and promote best practices

  • You have a growth mindset. You will identify business challenges and opportunities for improvement and solve for them using data analysis and data mining to make strategic or tactical recommendations

  • You will support analytics and provide critical insights around product usage, campaign performance, funnel metrics, segmentation, conversion, and revenue growth

  • You will build ad-hoc analysis, long-term projects, reports and dashboards to find new insights and to measure progress in key initiatives

  • You will work closely with business stakeholders to understand and maintain focus on their analytical needs, including identifying critical metrics and KPIs

  • You will partner with different teams within the organization to understand business needs and requirements

  • You will deliver presentations that will distil complex problems into clear insights

  • You will create dashboards that allow stakeholders to interact with the data and perform analysis.

Minimum Qualifications

  • 4-7 years of relevant industry experience in big data systems, data processing and SQL databases

  • 3+ years of coding experience in Spark data frames, Spark SQL, PySpark

  • 3+ years of hands on programming skills, able to write modular, maintainable code, preferably Python & SQL

  • Good understanding of SQL, dimensional modeling, and analytical big data warehouses like Hive and Snowflake

  • Familiar with ETL workflow management tools like Airflow

  • 2+ years of building reports and dashboards BI tools. Knowledge of Looker a plus

  • Experience with version control and CICD tools like Git and Jenkins CI

  • Experience in working and analyzing data on notebook solutions like Jupyter, EMR Notebooks, Apache Zeppelin

  • Experience in dashboarding tools like PowerBI, Qlik and Tableau

  • Bachelor’s degree in computer science, Engineering or related field, or equivalent training, fellowship, or work experience

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.

When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!

Salary transparency

Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

Diversity & Belonging
We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Toronto, Ontario, Canada

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Autodesk is changing how the world is designed and made. Our technology spans architecture, engineering, construction, product design, manufacturing, media, and entertainment, empowering innovators everywhere to solve challenges big and small. From greener buildings to smarter products to more mesmerizing blockbusters, Autodesk software helps our customers to design and make a better world for all. Over 100 million people use Autodesk software like AutoCAD, Revit, Maya, 3ds Max, Fusion 360, SketchBook, and more to unlock their creativity and solve important design, business and environmental challenges. Our software runs on both personal computers and mobile devices and taps the infinite computing power of the cloud to help teams around the world collaborate, design, simulate and fabricate their ideas in 3D. We provide exceptional compensation/benefit packages and we’d love for you to join us. We’re proud to be an equal opportunity employer and we consider all qualified applicants without regard to race, gender, disability, veteran status or other protected category. To see our culture in action, check out #AutodeskLife. We are headquartered in the San Francisco Bay Area and have more than 10,000 employees worldwide.

Toronto, Ontario, Canada (On-Site)

United States (Remote)

Denver, Colorado, United States (Hybrid)

Texas, United States (Remote)

Atlanta, Georgia, United States (Hybrid)

Florida, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Autodesk

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug