Senior Software Engineer

1 Month ago • 5-7 Years • DevOps

Job Summary

Job Description

Microsoft's Azure AI Platform team seeks a Senior Software Engineer to build its Model as a Service offering. This role involves developing platform solutions for onboarding, training, customizing, deploying, and scaling LLMs. Collaboration with data scientists and engineers within Microsoft and externally is crucial. Responsibilities include independent execution on complex projects, design and architecture discussions, feature execution, code quality maintenance, mentoring junior engineers, and stakeholder collaboration. Experience with large language modeling is a plus, not required. The candidate must be proficient in large-scale, distributed, cloud-based software services and Agile development practices.
Must have:
  • 7+ years software engineering experience (or Master's + 5 years)
  • Experience delivering large-scale cloud services
  • Strong software design & engineering skills
  • Collaboration & communication skills
  • Proficiency in Agile and CI/CD
Good to have:
  • Experience with Azure cloud services (serving ML models)
  • Passion for machine learning and AI
  • .Net, Java, Azure functions, Docker, Python proficiency
  • Familiarity with Azure
Perks:
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Job Details

Overview

AI is the strategic bet for Microsoft. The Azure AI Platform is right at the front end. Our team in Azure GenAI is at the cutting edge of developing large language model technologies to power Azure AI Platform products and offering them as a service for both internal and external applications.

 

Our Azure Machine Learning Training Team is at the forefront of this mission, working on groundbreaking projects for training & customizing LLMs. We collaborate closely with research institutions, industry leaders, and organizations worldwide, including OpenAI, Meta, Mistral and numerous Microsoft internal product & research teams, to create innovative solutions that impact millions of users. 

 

The team is looking for a passionate, impact oriented, and analytical individual contributor with strong software design & engineering skills to build our Model as a Service offering. You will work on platform solutions that enable onboarding, training, customization, deployment and scaling of LLMs, partnering with data scientists & engineers from within Microsoft and external partners & model providers. 

 

Experience with or a background in large language modeling is a plus, but not required.

Qualifications

Required/Minimum Qualifications:

  • Bachelor's Degree in Computer Science, or Computer Engineering, or related field AND 7+ years related software engineering experience OR Master's Degree in Computer Science, or Computer Engineering, or related field AND 5+ years related software engineering experience OR equivalent experience 
  • Experience delivering large scale, distributed, cloud based software services 
  • Ability to work collaboratively in a team and communicate complex concepts effectively

 

Preferred Qualifications:

  • Proven track record of shipping and maintaining Microsoft Azure cloud services, preferably related to serving machine learning models  
  • Proficiency in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD) 
  • Passion for machine learning, artificial intelligence, and data science 
  • Proficiency in programming languages & tools such as .Net, Java, Azure functions, Docker, Python 
  • Quick learner with a passion for solving complex and exciting problems
  • Familiarity with Azure is a plus 

 

#IDCAIPlatformHiring 

 

 

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Responsibilities

  • Execute independently on complex, multi-dependency, medium-high ambiguity projects 
  • Work closely with IDC & US team counterparts for design & code reviews, align priorities, and effectively collaborate with appropriate stakeholders 
  • Collaborate with key stakeholders to comprehend and identify user requirements, scope solutions, estimate work, and schedule deliverables 
  • Lead discussions on the design & architecture of products or solutions and apply engineering principles to establish robust and maintainable architecture 
  • Manage and drive feature execution with high quality and great agility 
  • Lead by example by producing extensible and maintainable code, adhering to best engineering practices, raising the quality bar, and improving the team's response to customer incidents 
  • Mentor and grow junior engineers 
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Similar Jobs

Luxoft - QA Automation Engineer (.Net)

Luxoft

Bengaluru, Karnataka, India (On-Site)
3 Months ago
PlayStation Global - Senior Service Reliability Engineer

PlayStation Global

Aliso Viejo, California, United States (On-Site)
3 Months ago
Bally's Interactive - Software Engineer - Full Stack

Bally's Interactive

London, England, United Kingdom (On-Site)
1 Month ago
Netflix - Network Architecture Intern, Summer 2025

Netflix

Los Gatos, California, United States (On-Site)
3 Months ago
Hunting Cube Recruitment Solutions - SDE 3

Hunting Cube Recruitment Solutions

Mumbai, Maharashtra, India (On-Site)
4 Months ago
NVIDIA - Senior Site Reliability Engineer - AI Research Clusters

NVIDIA

Santa Clara, California, United States (Hybrid)
1 Month ago
Nagarro - Staff Engineer (Cloud Infrastructure)

Nagarro

Gurugram, Haryana, India (On-Site)
4 Months ago
Google - Cloud Technical Solutions Engineer, Security

Google

Bengaluru, Karnataka, India (On-Site)
3 Months ago
WebPT - Senior DevOps Engineer

WebPT

Hyderabad, Telangana, India (Hybrid)
4 Months ago
ION - Cloud Engineer/Architect (DevOps)

ION

Pisa, Tuscany, Italy (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Paytm - DevOps (Data DevOps) - Lead DevOps Engineer

Paytm

Noida, Uttar Pradesh, India (On-Site)
4 Months ago
N-iX - Senior Java Engineer

N-iX

Colombia (Remote)
2 Weeks ago
Activision - Senior Staff Backend Engineer - Activision Blizzard Media

Activision

San Francisco, California, United States (On-Site)
3 Months ago
Interface AI - QA Engineer III

Interface AI

(Remote)
6 Days ago
Microsoft - (Senior) Software Engineer - Multiple Roles

Microsoft

Prague, Prague, Czechia (On-Site)
1 Month ago
Onward Search - Java Engineer

Onward Search

San Jose, California, United States (Hybrid)
1 Week ago
Acceldata - Senior SDET - ADOC

Acceldata

Bengaluru, Karnataka, India (On-Site)
5 Months ago
PENN Interactive - Senior Software Developer, Sports Modeling Automation (Java)

PENN Interactive

Philadelphia, Pennsylvania, United States (Hybrid)
1 Week ago
Anthology  Inc  - Platform Engineer II

Anthology Inc

Bogotá, Bogota, Colombia (Remote)
2 Months ago
Nielsen Holdings - Software Engineer ( Java , Python , SQL , AWS / Oracle)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

PwC - Senior Associate-D365 Technical

PwC

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Skan AI - Release Manager

Skan AI

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Desk Expansion - Social Media Manager

Desk Expansion

Sahibzada Ajit Singh Nagar, Punjab, India (Remote)
3 Months ago
Kwalee - UI Artist

Kwalee

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Indus Insights - IT Manager / Senior Manager

Indus Insights

Gurugram, Haryana, India (Hybrid)
4 Months ago
Omnissa - Staff Engineer (C++ Windows)

Omnissa

Chennai, Tamil Nadu, India (On-Site)
4 Months ago
Rockstar Games - Animation Content Developer

Rockstar Games

Bengaluru, Karnataka, India (On-Site)
1 Day ago
PwC - IN-Senior Associate_Strategy_FS Tech_Advisory _Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
2 Months ago
PwC - IN_Manager_CPI_Enterprise Apps SAP_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
3 Months ago
HOUZLOOK - Interior Designer

HOUZLOOK

Bhubaneswar, Odisha, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Fortis Games - DevOps Engineer II

Fortis Games

Portugal (On-Site)
3 Months ago
ARHS - Solution Architect (Data Migration)

ARHS

Stockholm, Stockholm County, Sweden (Remote)
4 Months ago
ION - Senior DevSecOps Engineer, Italy

ION

London, England, United Kingdom (On-Site)
4 Months ago
Nielsen Holdings - Devops Engineer (026)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Axinous - Staff Software Development Engineer (Data Engineering)

Axinous

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Ajmera Infotech - Senior DevOps - Azure Infrastructure + DevOps

Ajmera Infotech

Bengaluru, Karnataka, India (Hybrid)
3 Weeks ago
Tanla Platforms  - Senior Site Reliability Engineer

Tanla Platforms

Hyderabad, Telangana, India (On-Site)
4 Months ago
VGW - Staff Site Reliability Engineer

VGW

Perth, Western Australia, Australia (On-Site)
8 Hours ago
Omnissa - Staff Engineer (C++ Windows)

Omnissa

Chennai, Tamil Nadu, India (On-Site)
4 Months ago
The Walt Disney Company - Senior Software Engineer

The Walt Disney Company

New York, New York, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

New York, New York, United States (Hybrid)

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

London, England, United Kingdom (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Mountain View, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug