Senior Data Engineer

Position Overview 

Data Engineers will be responsible for designing, building, maintaining, monitoring, integrating, and testing scalable data pipelines in production. You will partner with multi-disciplinary teams such as Machine Learning Engineering, Platform Engineering, Data Analysts on coordinating delivery of pipelines for specific business needs. Your work will contribute to strategic initiatives such as optimization of digital conversion metrics and development of Autodesk Assistant, an LLM-driven chatbot intended to answer customer inquiries. Our team culture is built on collaboration, mutual support, and continuous learning. We emphasise an agile, hands-on, and technical approach at all levels of the team. As a group, we want to continuously improve our work as well as our knowledge of trends and techniques relevant to our areas. We encourage personal development and knowledge sharing. 

Responsibilities 

• Data Pipeline Construction: Design, build, and maintain scalable data pipelines to support continuous data flow and analytics

• Data Modeling: Develop and implement effective data models and schemas to ensure data integrity and accessibility

• Database Management: Oversee and optimize database systems (SQL, NoSQL) ensuring high performance and availability

• Data Integration: Integrate data from various sources, ensuring consistency, quality, and reliability

• ETL Processes: Design and manage Extract, Transform, Load (ETL) processes to move data between systems

• Data Governance: Implement and enforce data governance policies to ensure data security, privacy, and compliance

• Collaboration: Work closely with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions

• Performance Tuning: Enhance and tune database performance for efficient processing and querying of large datasets

• Documentation: Maintain comprehensive documentation for data processes, models, and architecture

• Platform Mindset: Partner with internal platform team on the following tasks

• Provide technical leadership and mentorship for less-experienced members of the team

• Demonstrate experience working in cross-functional teams to deliver data engineering solutions in production

Minimum Qualifications 

Technical Skills: 

• 5 to 8 years of experience in Data Engineering

• Proficiency in programming languages such as Python or Scala

• Strong knowledge of SQL and experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra)

• Knowledge of big data technologies and frameworks (e.g., Kafka, Flink, Parquet, Iceberg, etc) 

• ETL Tools: Skilled in using ETL tools like Apache Airflow

• Experience with AWS cloud services ,data-related services like AWS Glue, EMR, Redshift, and S3

• Experience with data warehousing solutions like Snowflake, Redshift, or Hive

• Understanding of data modeling, data architecture, and ETL processes

• Experience with version control systems (e.g., Git) and continuous integration/continuous deployment pipelines

• Strong problem-solving abilities and attention to detail

• Ability to analyse complex datasets and derive actionable insights

• Experience with data visualisation tools

• Excellent communication and collaboration skills

• Ability to work effectively in a team-oriented environment

• Strong organizational and time-management abilities

#LI-AK1 

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.

When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!

Salary transparency

Diversity & Belonging
We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).