Principal Platform Engineer (Cloud Infrastructure - Big Data)

4 Months ago • 10 Years + • DevOps • $141,400 PA - $228,800 PA

Job Summary

Job Description

Autodesk seeks a Principal Platform Engineer with 10+ years of experience in large-scale data intensive distributed systems, expertise in Apache Iceberg, Parquet, Spark, Hive, Presto, Trino, Avro, and AWS services (EKS, EMR, S3, IAM). Strong coding skills in Python, Unix shell scripting, and API development are crucial. You'll design, develop, and operate highly reliable data platforms, automating infrastructure and ensuring operational excellence.
Must have:
  • Large-scale Data
  • Apache Iceberg
  • AWS Services
  • Python Coding
Good to have:
  • CloudOS
  • Datadog
  • Azure, GCP
  • Security Best
Perks:
  • Health Benefits
  • Stock Grants

Job Details

Job Requisition ID #

24WD77185

Autodesk's Platform Services and Emerging Technology (PSET) team is hiring a Principal Platform Engineer with experience automating large-scale cloud infrastructure services. In this exciting role, you will help us automate a robust and scalable data platform used by numerous teams across the company. Reporting to our Software Engineering Manager for Platform Infrastructure, you'll help us tackle tough problems and improve our platform's reliability, resiliency, and scalability. If you enjoy developing high quality and resilient systems and want to make a big impact with data at Autodesk, we want to meet you!

Responsibilities

  • Design, develop, and operate highly reliable large-scale data lake
  • Partner closely with Product teams to understand requirements and design new capabilities that go directly into customer's hands
  • Build and scale a data platform infrastructure that powers batch and real-time data processing of billions of records daily
  • Automate and administer big data applications and services on cloud
  • Help drive observability into the health of our data infrastructure and understanding of system behavior
  • Guide initiatives to enable best practices across infrastructure, deployments, automation, and accessibility
  • Set technical directions and influence cross-functional teams
  • Ensure operational excellence of the services and meet the commitments to our customers regarding reliability, availability, and performance
  • Develop and implement security best practices at the data, application, infrastructure, and network layers

Minimum Qualifications

  • 10+ years of hands-on direct internal experience in large-scale data intensive distributed systems, especially in query engines, object storage, data warehouse, data lake, data analytics, SQL/NoSQL databases, distributed file systems and data platform infrastructure
  • Experience with Apache Iceberg, Parquet, Spark, Hive, Presto, Trino, and Avro
  • Experience provisioning and managing orchestration tools like Airflow
  • Excellent coding skills and experience in Python, Unix shell scripting
  • Experience building, implementing and automating APIs
  • Experience building code-driven infrastructure on AWS through end-to-end automation including integration tests and unit tests
  • Experience with Self-service platform offering by building APIs to deploy Cloud resources
  • Demonstrated experience with EKS, EMR, S3, IAM, Networking and other AWS services
  • Experience with observability tools (such as, Hive, Spark, Presto, Jenkins, CloudOS, Datadog)
  • Experience communicating solutions and resolutions with technical and non-technical audiences
  • Willingness to participate in professional development activities to stay current on industry knowledge and excitement about breaking the status quo by seeking innovative solutions
  • Experience with public clouds (AWS, Azure, GCP)
  • Computer Science degree (or equivalent experience will be considered)

#LI-CD2

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

 

We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

 

When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!

Benefits

From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting https://benefits.autodesk.com/

Salary transparency

Salary is one part of Autodesk’s competitive compensation package. For U.S.-based roles, we expect a starting base salary between $141,400 and $228,800. Offers are based on the candidate’s experience and geographic location, and may exceed this range. In addition to base salaries, we also have a significant emphasis on annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

Equal Employment Opportunity

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Diversity & Belonging

We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).

Similar Jobs

Nisum - UI Architect- A6697

Nisum

Plano, Texas, United States (On-Site)
4 Months ago
paypal - Senior Technical Trainer / Evangelist

paypal

San Jose, California, United States (Hybrid)
4 Months ago
PublicisGroupe - Senior Associate Infrastructure L2 - Azure

PublicisGroupe

Gurugram, Haryana, India (On-Site)
4 Months ago
Axinous - Product Support Engineer III

Axinous

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Playtech - Database Developer

Playtech

(On-Site)
4 Months ago
Axinous - Principal Software Engineer - Automation, Python

Axinous

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Windriver - Senior Cloud Solutions Architect

Windriver

Singapore, Singapore (On-Site)
4 Months ago
Google - Associate Cloud Technical Solutions Engineer, Storage

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Months ago
Anblicks - Lead DevOps Engineer

Anblicks

Hyderabad, Telangana, India (On-Site)
3 Months ago
Nielsen - Software Engineer - Bigdata (Java/Scala and SQL)

Nielsen

Bengaluru, Karnataka, India (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

CleverTap - Senior Backend Engineer (Java & Mongo DB)

CleverTap

Mumbai, Maharashtra, India (Hybrid)
4 Months ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Speech & Audio) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Paytm - Data DevOps - Senior DevOps Engineer

Paytm

Noida, Uttar Pradesh, India (On-Site)
4 Months ago
Fluence - Controls Engineer (m/f/d)

Fluence

Amsterdam, North Holland, Netherlands (Remote)
4 Months ago
Google - Technical Solutions Engineer, Google Cloud Security

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Months ago
Cision - Senior Microsoft 365 Administrator

Cision

Mexico (Remote)
4 Months ago
Playtech - Database Developer

Playtech

(On-Site)
4 Months ago
The Walt Disney Company - KABC Freelance Newscast Director

The Walt Disney Company

Glendale, California, United States (On-Site)
3 Months ago
PlayStation Global - Data Engineer Intern - Undergraduate

PlayStation Global

Los Angeles, California, United States (On-Site)
4 Months ago
IMC Trading - Site Reliability Engineer

IMC Trading

Mumbai, Maharashtra, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

SSC Technologies - Senior Associate, Private Equity / FOF Fund Accounting

SSC Technologies

Dallas, Texas, United States (Hybrid)
4 Months ago
[P1] Games - Volunteer Associate Game Producer

[P1] Games

United States (Remote)
5 Months ago
Team Liquid - Global Early Careers

Team Liquid

Los Angeles, California, United States (On-Site)
5 Months ago
Google - Strategic Risk Manager

Google

Austin, Texas, United States (On-Site)
3 Months ago
Activision - Senior Gameplay Engineer - High Moon Studios

Activision

Carlsbad, California, United States (On-Site)
4 Months ago
Netflix - Business Analyst, CS Workforce Management

Netflix

United States (Remote)
3 Months ago
The Walt Disney Company - Member Consultant I

The Walt Disney Company

Lake Buena Vista, Florida, United States (On-Site)
3 Months ago
Netflix - Data Analyst, Security

Netflix

United States (Remote)
3 Months ago
The Walt Disney Company - Software Engineer, SDET

The Walt Disney Company

Orlando, Florida, United States (On-Site)
3 Months ago
Trek - Assistant Store Manager

Trek

Nashua, New Hampshire, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Ziff Davis - Principal DevOps Engineer

Ziff Davis

New York, New York, United States (Hybrid)
3 Months ago
Travelex - Cloud Engineer

Travelex

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Google - Software Engineer, Data Residency, Monitoring and Compliance

Google

Sunnyvale, California, United States (On-Site)
3 Months ago
Nielsen - Software Engineering - AM-TECH-DA-35

Nielsen

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Saviynt - Sr. Principal Software Engineer - Privileged Access Management (PAM)

Saviynt

El Segundo, California, United States (Hybrid)
4 Months ago
Interactive Brokers - Senior Cloud Security Engineer

Interactive Brokers

Greenwich, Connecticut, United States (Hybrid)
4 Months ago
The Workshop - Database Engineer (PostgreSQL / MySQL) - Blockchain

The Workshop

Málaga, Andalusia, Spain (Hybrid)
6 Months ago
undefined - Solargraf - Devops  Engineer

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Nielsen - Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL) (copy)

Nielsen

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Ubisoft - Engine Programmer [Snowdrop]

Ubisoft

Bucharest, Bucharest, Romania (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Autodesk is changing how the world is designed and made. Our technology spans architecture, engineering, construction, product design, manufacturing, media, and entertainment, empowering innovators everywhere to solve challenges big and small. From greener buildings to smarter products to more mesmerizing blockbusters, Autodesk software helps our customers to design and make a better world for all. Over 100 million people use Autodesk software like AutoCAD, Revit, Maya, 3ds Max, Fusion 360, SketchBook, and more to unlock their creativity and solve important design, business and environmental challenges. Our software runs on both personal computers and mobile devices and taps the infinite computing power of the cloud to help teams around the world collaborate, design, simulate and fabricate their ideas in 3D. We provide exceptional compensation/benefit packages and we’d love for you to join us. We’re proud to be an equal opportunity employer and we consider all qualified applicants without regard to race, gender, disability, veteran status or other protected category. To see our culture in action, check out #AutodeskLife. We are headquartered in the San Francisco Bay Area and have more than 10,000 employees worldwide.

Vancouver, British Columbia, Canada (Hybrid)

Vancouver, British Columbia, Canada (Hybrid)

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)

London, England, United Kingdom (On-Site)

Germany (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Autodesk

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug