Sr. Software Engineer - GenAI

As a Senior Applied AI Engineer, you will apply machine learning, scheduling and optimization algorithms to improve the efficiency and performance of our engineering systems and infrastructure. From cluster management all the way down to query compilation, our Applied AI team works on some of the hardest, most interesting problems facing the business, making Databricks infrastructure and products as performant and cost-efficient as possible. This is a high impact problem as our customers look at us to deliver the most optimized workloads.

The impact you will have:

• Build end-to-end systems from the ground up in a small team of experienced people.
• Shape the direction of our applied ML areas of investment by engaging with engineering and product teams across the company.
• Drive the development and deployment of state-of-the-art AI models and systems that directly impact the capabilities and performance of Databricks' products, infrastructure and services.
• Architect and implement robust, scalable ML infrastructure, including data storage and processing, model training and serving components, and monitoring and reporting systems to support seamless integration of AI/ML models into production environments.
• Work on novel modeling techniques in the field of ML for Systems
• Contribute to the broader AI community by publishing research, presenting at conferences, and actively participating in open-source projects, enhancing Databricks' reputation as an industry leader.

What we look for:

• 2-8 years of machine learning engineering experience in high velocity, high-growth companies
• Strong understanding of both computer systems and statistics
• Large breadth of knowledge or interest in mathematical modeling beyond ML (OR, combinatorial optimization
• Experience developing AI/ML systems at scale in production
• Strong track record of ML modeling that goes beyond using standard libraries.
• Strong coding and software engineering skills, and familiarity with software engineering principles around testing, code reviews and deployment.
• Experience deploying, scaling and monitoring models in production; deep understanding of the unique infrastructure challenges posed by training and serving predictions in Tier 0 environments.

Why Join Us?

At Databricks, we are building state-of-the-art AI solutions that redefine how users interact with data and our products. You’ll have the opportunity to shape the future of AI-driven products, work with cutting-edge models, and collaborate with a world-class team of AI and ML experts.

If you're excited about pushing the boundaries of AI in real-world applications, we’d love to hear from you!

Please note we are open to employees working from our Mountain View, CA office for this position.