Machine Learning Engineer II

1 Month ago • 2 Years + • Artificial Intelligence

Job Summary

Job Description

This Machine Learning Engineer II role at Microsoft's AzureGenAI team focuses on adapting and grounding large language models for product-driven scenarios, specifically enhancing the custom copilot experience. Responsibilities include developing deep learning techniques for efficient adaptation of large-scale language models, using supervised fine-tuning and Reinforcement Learning from Human Feedback (RLHF). The work spans multiple stages of adaptation and requires collaboration with various Microsoft product groups. The ideal candidate will possess strong machine learning concepts, large model training experience, proficiency in Python, and a good understanding of cloud-native infrastructure and distributed systems.
Must have:
  • Bachelor's Degree in relevant field
  • 2+ years of experience
  • Solid grasp of ML concepts
  • Proficiency in Python
  • Understanding of cloud infrastructure
Good to have:
  • Experience in large language modeling
  • Publications in top-tier conferences
  • Familiarity with Triton, CUDA
  • Experience with large datasets
Perks:
  • Industry-leading healthcare
  • Educational resources
  • Product and service discounts
  • Savings and investment options
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Job Details

Overview

Our team in Azure GenAI is at the cutting edge of developing large language model technologies to power Azure AI Platform products and offering them as a service for both internal and external applications. We collaborate deeply with OpenAI and numerous Microsoft product teams, including GitHub and Office. 

 

The team is looking for a passionate, creative, and analytical individual contributor with a background in large language modeling. You will work on adapting and grounding large language models for product-driven scenarios. The focus will be on developing deep learning techniques to enhance the custom copilot experience through efficient adaptation of large-scale language models. The work will span multiple stages of adaptation, including supervised fine-tuning and post-training with Reinforcement Learning from Human Feedback (RLHF). 

 

We are looking for a Machine Learning Engineer II to join our team. 

 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more, and we’re dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.  

 

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

Qualifications

Required Qualification:

 

  • Bachelor's Degree in Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research) 
  • Solid grasp of machine learning concepts, large model training and proficiency in Python or similar languages  
  • Good understanding of modern cloud native infrastructure, distributed systems and frameworks.

 

Preferred/Additional Qualifications: 

 

  • Rich experience in large language modeling and related areas. 
  • Publication in top-tier conferences on large language models is a big plus.  
  • Familiarity with Triton, CUDA 
  • Experience with data processing and handling large datasets.  
  • Ability to work collaboratively in a team and communicate complex concepts effectively

 

#IDCAIPlatformHiring

 

 

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Responsibilities

  • Development for OpenAI models customization and large scale training 
  • Data preparation, training and evaluation of customization tasks 
  • Scaling Engineering system and Enterprise readiness 
  • Collaboration with product groups in Microsoft
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Similar Jobs

Topsoe - Senior Software Engineer II

Topsoe

New Delhi, Delhi, India (On-Site)
4 Months ago
CLO Virtual Fashion  Inc  - DevOps Engineer

CLO Virtual Fashion Inc

Bengaluru, Karnataka, India (On-Site)
4 Months ago
PlayStation Global - Senior Software Engineer (Network Solutions)

PlayStation Global

Aliso Viejo, California, United States (On-Site)
6 Months ago
Rush Street Interactive - Analytics Engineer

Rush Street Interactive

Estonia (Hybrid)
1 Week ago
NVIDIA - Software Engineering Intern, AI Engineering - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago
Meta - Software Engineer, Systems ML - SW/HW Co-design

Meta

Sunnyvale, California, United States (Remote)
3 Months ago
NVIDIA - Performance Engineer - Deep Learning

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
NVIDIA - AI Digital Human Development Intern - 2025

NVIDIA

Hong Kong, Hong Kong (On-Site)
3 Weeks ago
Microsoft - Data & Applied Scientist II

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ASSIST Software - Node.js Engineer

ASSIST Software

Suceava, Suceava County, Romania (Remote)
3 Months ago
TOPPAN Edge  Inc  - Senior QA Engineer I

TOPPAN Edge Inc

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Thales - Avionics Software Developer

Thales

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Trackman - Senior Front-end Developer

Trackman

Denmark (On-Site)
1 Month ago
Infogain - QA Automation Engineer (Senior)

Infogain

Mumbai, Maharashtra, India (On-Site)
4 Months ago
House of How - Senior Designer - Sweden

House of How

Boden, Norrbotten County, Sweden (On-Site)
3 Months ago
Lytx,  Inc  - Senior Site Reliability Engineer

Lytx, Inc

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Nielsen Holdings - Senior Software Engineer - Bigdata ( Java / Scala / Python , Spark, SQL , AWS)

Nielsen Holdings

Mumbai, Maharashtra, India (Hybrid)
4 Months ago
Xsolla - PHP Backend Developer

Xsolla

Baku, Azerbaijan (Hybrid)
4 Weeks ago
PwC - IN_Senior Associate_AWS Devops Engineer_Data &Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

PwC - IN_Associate_SAP BASIS_Enterprise Apps SAP _Advisory_Hyderabad

PwC

Hyderabad, Telangana, India (On-Site)
1 Month ago
Velotio Technologies - AI/ML Engineer

Velotio Technologies

India (Remote)
3 Weeks ago
Intel Corporation - India Tax Director

Intel Corporation

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Altair - QA Engineer

Altair

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Google - Senior Software Engineer, Full Stack, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
DNEG - Pipeline Supervisor

DNEG

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Hitachi Rail - HR Analytics Specialist

Hitachi Rail

Bengaluru, Karnataka, India (On-Site)
5 Months ago
ACV Auctions - Senior Engineer, Machine Learning

ACV Auctions

Chennai, Tamil Nadu, India (On-Site)
4 Months ago
PwC - IN_Director_ESG sustainability_Climate & Sustainability Strategy_Advisory_kolkata

PwC

Kolkata, West Bengal, India (On-Site)
4 Months ago
Accor - Painter (Engineering)

Accor

Maharashtra, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

GoTo Group - Lead Data Scientist - KYC

GoTo Group

Singapore (On-Site)
2 Months ago
Zoox - Senior/Staff Software Engineer - 3D World Generation Pipelines

Zoox

Seattle, Washington, United States (Hybrid)
4 Months ago
Google - Software Engineer III, AI/ML, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ByteDance - Research Scientist, Vision Foundation Model

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
NVIDIA - Deep Learning Engineer, Generative AI and 3D Reconstruction

NVIDIA

Tokyo, Japan (On-Site)
3 Weeks ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

Menlo Park, California, United States (On-Site)
3 Months ago
Zoox - Senior/Staff Software Engineer - Prediction Integration

Zoox

Foster City, California, United States (Hybrid)
4 Months ago
Zoox - Senior Safety Research Engineer, Human Factors Modeling

Zoox

Foster City, California, United States (Hybrid)
4 Months ago
Haptic - Senior AI/ML Engineer

Haptic

Paris, Île-de-France, France (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

New York, New York, United States (Hybrid)

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

London, England, United Kingdom (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Mountain View, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug