Principal Software Engineer

AI is the strategic bet for Microsoft. The Azure AI Platform is right at the front end. Our project involves cutting edge technologies and problems. Joining the projects you will gain knowledge and experience about generative AI, large language model, transformers, GPU optimization, AI applications, etc. The AI business is also growing rapidly, and our products will directly face the impact of the large number of customers, which is continuously growing.

Within the AI Platform, the Azure ML team enables data scientists and developers to build quickly and easily, train, deploy, manage, and consume machine learning models.

The Models as a Service team is hiring Principal Engineer Manager. The team designs, builds, and operates the largest scale engineering system in the industry for Large Language Models and GenAI Services. Key areas that we are working on

1. Building and Scaling our Inferencing Cloud across our flagships AOAI Service and growing the Model as A Service model Families.
2. Expand the Gen AI Model Offerings to more model providers, and best and latest models and provide a unified experience across AOAI and MAAS/MAAP for Azure AI customers

Required:

• Bachelor's Degree in Computer Science or related technical field and 12 or more years of experience in object-oriented programming and design patterns (C#, C++, .NET or Java)
• 6+ years of hands-on experience shipping products across multiple product cycles
• 2+ years of experience of architecture/tech lead leading products, technology development

Preferred:

• Experience on python, pytorch, large language model, generative AI.
• Experience with Machine Learning Platform and Systems is preferred
• Experience with distributed systems design and implementation.
• Proficiency in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD) 
• Passion for machine learning, artificial intelligence, and data science.
• Experience working on large-scale projects or applications.
• Effective communication skills and ability to collaborate with diverse remote teams.
• Quick learner with a passion for solving complex and exciting problems.
• Familiarity with Azure is a plus.

This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

#AIPLATFORM#

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Responsibilities

• Design and develop products in AI platform and enable our customers to achieve more.
• Work closely with US teams to align priorities, lead the team to effectively collaborate with appropriate stakeholders.
• Lead discussions, project execution with high quality and great agility.
• Lead by example by producing extensible and maintainable code, adhering to best engineering practices, raising the quality bar, and improving the team's response to customer incidents.
• Lead the team to respond, resolve, and integrate customer feedback with agility and dedication.