Senior Machine Learning Engineer

3 Months ago • 7-9 Years • Artificial Intelligence

Job Summary

Job Description

Microsoft's AI Platform team seeks a Senior Machine Learning Engineer to build evaluation frameworks for cutting-edge deep learning models (LLMs, SLMs, RAG, etc.). Responsibilities involve designing and developing the next-generation Azure AI evaluation platform, integrating advanced AI solutions, and ensuring a highly performant, scalable, and reliable system. The role requires expertise in generative AI, transformer-based models, large-scale data processing, and cloud platforms (Azure). Building end-to-end pipelines for model training, data analysis, model serving, and evaluation is crucial, along with experience in CI/CD and collaboration with cross-functional teams.
Must have:
  • 7+ years experience in relevant field
  • Generative AI expertise (LLMs, NLP, CV)
  • Proficiency in Python and ML frameworks
  • Large-scale data processing experience
  • Cloud platform experience (Azure)
  • CI/CD expertise
Good to have:
  • Large data training & fine-tuning
  • Statistical analysis and visualization
  • Strong understanding of statistics, linear algebra, probability
Perks:
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Job Details

Overview

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.

The AI Platform organization at Microsoft builds the end-to-end Azure AI stack/PaaS and is core to Azure’s innovation and differentiation, as well as all of Microsoft’s flagship products, from Office to Teams, to Xbox. We are the team building Azure OpenAI, Azure ML, Cognitive Services, and the global Azure AI infrastructure for running the largest AI workloads on the planet. 

Within the AI Platform, our Evaluation AI team specializes in building evaluation frameworks for cutting-edge deep learning models, including Large Language Models, Small Language Models, RAG, fine-tuned, and distilled models across NLP, vision, multimodal, Co-pilot and agentic frameworks. We build the next-generation model evaluation platform for generative applications, leveraging state-of-the-art (SOTA) OSS and OAI models.

We are looking for a passionate, creative, analytical Machine Learning Engineer who loves NLP, deep learning and wants to ship products quickly at a massive scale. We will provide a lot of opportunities for you to learn, grow and contribute.

Qualifications

Required Qualification:

  • Master's AND 7+ years' experience, or Bachelor's AND 9+ years' experience in Computer Science, Computer Engineering, or related field with specialization in Generative AI - LLMs/natural language processing/computer vision/multimodal analysis/deep learning/machine learning/Data Science
  • Strong hold on Data Structures, algorithmic problem solving and proficiency in software development/engineering skills (Python/Java/C#)
  • Proficiency in Python and open-source tools (e.g., TensorFlow, PyTorch) to develop production-grade quality product 
  • Proven Industry experience on large-scale data processing, distributed computing, or cloud platforms and building highly performant production solutions
  • Knowledge of Generative AI suite, transformer-based and diffuser-based models (e.g., BERT, GPT, T5, Llama, Stable diffusion) and LLMs
  • Proficiency in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD)
  • Experience with cloud platforms (e.g., Azure, AWS) and distributed computing
  • Design and build end-to-end high performance ML workloads covering model training, data analysis, model serving and model evaluation
  • Excellent verbal and written communication skills and ability to work independently and collaboratively

Preferred Qualifications: 

  • Training & fine-tuning experience on large data
  • Experience with statistical analysis and data visualization tools
  • Good understanding of statistics, linear algebra, and probability theory

#IDCAIPHiring

 

 

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Responsibilities

  • Build sophisticated Evaluation framework for cutting-edge deep learning models, including LLMs, SLMs, RAG, fine-tuned, distilled models and Generative AI applications such as Co-pilots, Agentic frameworks
  • Design and develop the next generation of Azure AI's evaluation platform by integrating advanced AI evaluation solutions into production, with a strong emphasis on building a highly performant, scalable, reliable, and high-quality distributed system
  • Research, design, implement State-of-the-art evaluation frameworks to assess model performance across diverse metrics, including quality, latency, cost, robustness and fairness
  • Engage in sophisticated prompt engineering techniques to optimize and tailor model outputs for various real-world applications and use cases
  • Design and build end-to-end pipelines covering model training, data analysis, model serving and model evaluation
  • Build and Utilize CI/CD pipelines to manage the build, release, deployment, and test automation processes for AI models, ensuring seamless integration into production systems and maintaining high-quality standards
  • Collaborate with cross-functional teams, including researchers, data scientists, software engineers, and product managers
  • Implement new product features and evaluation metrics
  • Embody our  and 
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Similar Jobs

GoTo Group - Senior Software Engineer - Data Platform (Mercury)

GoTo Group

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Ajmera Infotech - Technical Program Manager

Ajmera Infotech

Bengaluru, Karnataka, India (On-Site)
1 Month ago
PwC - Cloud Security Specialist - Associate

PwC

Turin, Piedmont, Italy (On-Site)
6 Months ago
Netflix - Product Manager, ML Platform: Training

Netflix

Los Gatos, California, United States (Hybrid)
6 Months ago
Brillio - Senior Data Specialist- R01531001

Brillio

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Zoox - Senior/Staff Software Engineer - 3D World Generation Pipelines

Zoox

Seattle, Washington, United States (Hybrid)
6 Months ago
Seedify - AI Product Manager

Seedify

London, England, United Kingdom (Remote)
3 Months ago
HP - Machine Learning Intern

HP

Austin, Texas, United States (On-Site)
7 Months ago
Appier - Software Engineer, Machine Learning Platform

Appier

Taipei City, Taiwan (On-Site)
5 Months ago
Level AI - Senior Backend Engineer - CX

Level AI

Noida, Uttar Pradesh, India (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Hasura - Software Engineer, Data Connectors (Bangalore, India)

Hasura

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Go Fund Me - Software Engineer (Integrity)

Go Fund Me

Buenos Aires, Buenos Aires, Argentina (On-Site)
5 Months ago
Ubisoft - DevOps Linux Administrator

Ubisoft

Saint-Mandé, Île-de-France, France (On-Site)
2 Months ago
PwC - ETIC, Cloud Infrastructure - Manager

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
5 Months ago
PwC - Senior Data Engineer

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
6 Months ago
bosh group india - .Net, React Azure FullStack Developer_SDS_EMT2

bosh group india

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Anthology  Inc  - Associate Software Engineer II

Anthology Inc

Chennai, Tamil Nadu, India (Hybrid)
4 Months ago
Warner Bros Games - Software Engineer II

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
1 Month ago
Sonar Source - Solutions Engineer - Strategic Accounts

Sonar Source

Austin, Texas, United States (Hybrid)
6 Months ago
PwC - Senior Associate -ETL Testing_D&A_Advisory_Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Sinch - System Administrator

Sinch

Noida, Uttar Pradesh, India (On-Site)
6 Months ago
Verifone - Software QA Engineer

Verifone

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Nagarro - Senior Engineer

Nagarro

Bengaluru, Karnataka, India (On-Site)
6 Months ago
ION - Credit Analyst - 7915

ION

Mumbai, Maharashtra, India (On-Site)
6 Months ago
PwC - IN- Manager_ SAP PLM_Enterprise Apps SAP_Advisory_Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Luxoft - Google Cloud Engineer

Luxoft

New Delhi, Delhi, India (Remote)
4 Months ago
Interactive Brokers - New Accounts Associate - Application Support Group

Interactive Brokers

Mumbai, Maharashtra, India (Hybrid)
6 Months ago
PwC - IN-Manager –Agile Coach -Advisory Corporate– Advisory –Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Paytm - Data Engineering - Data Engineer

Paytm

Noida, Uttar Pradesh, India (On-Site)
4 Months ago
Quizizz - Account Executive

Quizizz

Bengaluru, Karnataka, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

NVIDIA - Senior Deep Learning Research Engineer, Advanced AI Systems

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Warner Bros Games - Game Development & Machine Learning Intern

Warner Bros Games

San Francisco, California, United States (On-Site)
3 Months ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
2 Months ago
Microsoft - Post Doc Researcher

Microsoft

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Interface AI - Senior Product Manager

Interface AI

Hyderabad, Telangana, India (Remote)
1 Month ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

Redmond, Washington, United States (On-Site)
5 Months ago
Match Group - Senior ML Platform Engineer

Match Group

New York, New York, United States (Hybrid)
6 Months ago
Canva - Research Engineering Manager - Image Generation (m/f/x) - Canva Austria

Canva

Vienna, Vienna, Austria (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

Noida, Uttar Pradesh, India (On-Site)

Redmond, Washington, United States (Hybrid)

Hyderabad, Telangana, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Hyderabad, Telangana, India (On-Site)

Redmond, Washington, United States (Remote)

Cairo, Cairo Governorate, Egypt (On-Site)

Budapest, Hungary (Hybrid)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug