Senior Data Engineer
Job Summary
Job Description
- 5+ years of experience in back-end distributed systems.
- Strong programming skills, preferably Python & SQL.
- Experience with Spark and Airflow is mandatory.
- Experience building code-driven infrastructure on AWS.
- Understanding of SQL and dimensional modeling.
- Experience with automation frameworks like Git, Jenkins.
- Familiarity with containers and infrastructure-as-code.
- Experience with data processing and SQL databases.
- Experience with Hadoop / Spark Source Code.
- Experience with Hive and/or Snowflake.
- Strong knowledge and experience in Hadoop 2.0 and its ecosystem.
- Experience with Airflow.
- Experience in microservices based architecture.
21 skills required
Job Details
Job Requisition ID #
Position Overview
Autodesk is looking for a Senior Software Data Engineer to join the Data Ingestion team within the Analytics Data organization.
The Enterprise Data Integration (EDI) team is a collection of systems and integrations focused on servicing the enterprise data needs of all data scientists, data analysts and data engineers throughout the organization.
As a Senior Software Engineer, you will be responsible for developing best practices and making architectural choices to rapidly improve critical data processing & analytics pipelines. You will collaborate with highly motivated and wonderful software engineers. You will lead and support innovative solutions to sophisticated and modern engineering problems. As part of the team, you will learn, teach, grow, and help bring data closer to our users. You will make critical choices, tackle hard problems and improve the platform’s reliability, resiliency, and scalability.
Responsibilities
- Contribute to the team’s vision and articulate strategies to have fundamental impact at our massive scale
- You will need a product-focused mindset. It is essential for you to understand business requirements and architect systems that will scale and extend to accommodate those needs
- Diagnose and solve complex problems in distributed systems, develop and document technical solutions and sequence work to make fast, iterative deliveries and improvements
- Build and maintain high-performance, fault-tolerant and scalable distributed systems that can handle our massive scale
- Ideate and drive innovative projects that will improve user experience
- Provide solid leadership within your very own problem space, through data-driven approach, robust software designs, and effective delegation
- Participate in, or spearhead design reviews with peers and stakeholders to adopt what’s best suited amongst available technologies.
- Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
- Automate cloud infrastructure, services, and observability
- Develop CI/CD pipelines and testing automation
- Establish and uphold best engineering practices through thorough code and design reviews and improved processes and tools
- Groom junior engineers through mentoring and delegation
- Drive a culture of trust, respect and inclusion within your team.
Minimum Qualifications
- 5+ years of relevant industry experience in large back-end distributed systems and cloud computing.
- Strong overall programming skills, able to write modular, maintainable code, preferably Python & SQL
- Experience with Spark & Airflow Mandatory
- Experience building code-driven infrastructure on public cloud platforms, preferably AWS
- Understanding of SQL, dimensional modeling, and at least one relational database
- Experience with automation frameworks/tools like Git, Jenkins, Ansible, and Terraform
- Familiarity with containers and infrastructure-as-code fundamentals
- Solid Proficiency with Amazon Web Services
- Problem solver with excellent written and interpersonal skills; ability to make sound, complex recommendations in a fast-paced, technical environment
- Humble, collaborative, team player, willing to step up and support your colleague
- Effective communication, problem solving and interpersonal skills
- Commit to grow deeper in the knowledge and understanding of how to improve our existing applications
- Enthusiasm for cutting edge technologies, complex problems, and building things
- Familiar with non-functional testing such as load, performance and resiliency testing
- Good command of English (Speaking, Writing and Reading)
- Working in an agile environment using test driven methodologies.
- Bachelor’s degree in Computer Science, Engineering or related field, or equivalent training, fellowship or work experience
Desired Qualifications
- Experience with data processing and SQL databases
- Experience with Hadoop / Spark Source Code
- Experience with Map Reduce
- Experience with Hive and/or Snowflake
- Strong knowledge and experience in Hadoop 2.0 and its ecosystem.
- Experience with Airflow
- Experience with data processing and SQL databases and DBT
- Experience in microservices based architecture
Learn More
About Autodesk
Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.
When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!
Salary transparency
Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.Diversity & Belonging
We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging
Are you an existing contractor or consultant with Autodesk?
Please search for open jobs and apply internally (not on this external site).
Similar Jobs
Interactive Brokers
Fanatee
Apple
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Get notifed when new similar jobs are uploaded
Jobs in Pune, Maharashtra, India
Buckman
ISG
Get notifed when new similar jobs are uploaded
Data Analysis Jobs
Western Digital
Get notifed when new similar jobs are uploaded
About The Company
Autodesk is changing how the world is designed and made. Our technology spans architecture, engineering, construction, product design, manufacturing, media, and entertainment, empowering innovators everywhere to solve challenges big and small. From greener buildings to smarter products to more mesmerizing blockbusters, Autodesk software helps our customers to design and make a better world for all. Over 100 million people use Autodesk software like AutoCAD, Revit, Maya, 3ds Max, Fusion 360, SketchBook, and more to unlock their creativity and solve important design, business and environmental challenges. Our software runs on both personal computers and mobile devices and taps the infinite computing power of the cloud to help teams around the world collaborate, design, simulate and fabricate their ideas in 3D. We provide exceptional compensation/benefit packages and we’d love for you to join us. We’re proud to be an equal opportunity employer and we consider all qualified applicants without regard to race, gender, disability, veteran status or other protected category. To see our culture in action, check out #AutodeskLife. We are headquartered in the San Francisco Bay Area and have more than 10,000 employees worldwide.
Get notified when new jobs are added by Autodesk
