Principal Software Engineer (Microsoft AI Big Data Platform)

55 Minutes ago • 6 Years + • Backend Development • Full Stack Development

About the job

Job Description

The Principal Software Engineer will design and develop large-scale distributed software services and solutions for Microsoft's Bing MagneTar team, a big data platform built on open-source technologies like Hadoop, Spark, Kafka, Flink, and Kubernetes. Responsibilities include collaborating with stakeholders, system design, developing high-quality code, improving test coverage, troubleshooting, and optimizing the platform's reliability and monitoring. The role requires experience with big data technologies, large-scale distributed systems, and expertise in languages such as C, C++, C#, Java, JavaScript, or Python. The engineer will work to enhance the performance, integration, security, and reliability of the platform, pushing the boundaries of what's possible in big data analytics.
Must have:
  • 6+ years experience
  • Large-scale distributed systems
  • Big Data technologies (Spark, Hadoop, Kubernetes)
  • C/C++/C#/Java/JavaScript/Python
  • System design & development
Good to have:
  • Experience with web applications, microservices
  • Database design, API design, performance tuning
  • Telemetry design and analysis
  • Proficient analytical skills
  • Leadership and communication skills
Perks:
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Overview

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world. Bing Fundamentals team focuses on providing a search and recommendation platform for Microsoft internal partners using the documentation recall and reranking backend service suite. As a team, we manage one of the world’s largest distributed systems and have experienced success in building efficient large scale distributed systems.


Within Bing Fundamentals, Bing MagneTar team provides a range of products that enable software engineers and data scientists to lead the transformation of analytics in the world of data. Our mission is to build a big data platform for the age of AI, using open-source technologies such as Hadoop, Spark, Kafka, Flink and Kubernetes to empower the Microsoft AI organization.

We are hiring a Principal Software Engineer (Microsoft AI Big Data Platform) and are looking to push the boundaries of what is possible, again. You can help rebuild the way analytics engines process data. We build services that enable big data developers to build mission critical applications with high levels of Service Level Agreement (SLA). As an engineer in our team, you will work on and extend Open-Source Software (OSS) technologies like Apache Hadoop, Spark, Delta Lake, Kubernetes as well as proprietary Microsoft services. You will help design & implement software components, participate in code reviews, design reviews, assist customers as needed to be able to leverage the service and keep the service running. You will support a team of talented engineers aiming to improve the abilities of what is possible today with industry leading performance, integration, security and reliability. This will require exploring the frontiers of what is possible.

 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Qualifications

Required Qualifications:

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • 4+ years of hands-on engineering experience developing large-scale distributed systems.
  • 2+ years of experience as Senior/Principal technical lead role.
  • 2+ years of experience with Big Data technologies like Apache Spark, Hadoop, and Kubernetes.

 

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements that are required for this role. These requirements include, but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

  • Experience in large scale system architecture, design, development, testing, and release, including but not limited to web applications, microservices in layers, database design, API design, performance tuning, telemetry design and analysis.
  • Demonstrated programming skills and knowledge of architectural patterns for large, high-scale applications.
  • Proficient analytical skills with systematic and structured approaches to software design.
  • Demonstrated strength to quickly get up-to-speed and be productive on new technical domains and are comfortable in dealing with ambiguity.
  • Ability to drive for results and influence for impact, ability to drive clarity, communicate goals to key stakeholders, and motivate them to execute on time and at a high quality. 
  • Proactively identifies problems, proposes solutions, with demonstrated ability to navigate ambiguity. 

 

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:


Microsoft will accept applications for the role until January 10, 2025. 

 

 

 

#Bing

Responsibilities

  • Design and develop large-scale distributed software services and solutions following modern software engineering practices through design and code reviews.
  • Collaborate with appropriate stakeholders to determine user requirements for a scenario, drive identification of dependencies and the development of design documents for a product, application, service, or platform.
  • Perform system design with well-defined interfaces across multiple components, leveraging data/telemetry to inform decisions.
  • Develop best-in-class engineering for our services, ensuring components are modular, secure, reliable, testable, diagnosable, maintainable, actively monitored, and reusable.
  • Improve test coverage, organize and implement integration tests, and resolve problem areas.
  • Troubleshoot and optimize automation, reliability, and monitoring for Live Site.
  • Embody our culture and values.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect
View Full Job Description
$137.6K - $294.0K/yr (Outscal est.)
$215.8K/yr avg.
Redmond, Washington, United States

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

Seoul, South Korea (On-Site)

New York, New York, United States (On-Site)

Texas, United States (Hybrid)

Dublin, County Dublin, Ireland (On-Site)

Hyderabad, Telangana, India (On-Site)

Sydney, New South Wales, Australia (Hybrid)

Bengaluru, Karnataka, India (On-Site)

Hyderabad, Telangana, India (On-Site)

London, England, United Kingdom (On-Site)

Beijing, Beijing, China (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Similar Jobs

Luxoft - Senior/Lead Java Developer

Luxoft, India (Remote)

Netflix - Full Stack Engineer 5: Games Messaging

Netflix, United States (Remote)

Wind River Systems - Field Application Engineer

Wind River Systems, United States (On-Site)

Paypal - Senior Engineer, Backend (Java)

Paypal, United States (Hybrid)

Whoop - Senior Software Engineer (Backend, Growth)

Whoop, United States (On-Site)

Tencent - Senior Fullstack Web Developer

Tencent, Singapore (On-Site)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Luxoft - Solutions Architect

Luxoft, India (On-Site)

Playrix - Technical Director (Game Project)

Playrix, Serbia (Remote)

Nagarro - Associate Staff Engineer, Java

Nagarro, India (Remote)

Rocket - Senior Software Architect

Rocket, United Kingdom (On-Site)

Keywords Studios (Player Support) - Senior Localization Engineer (VB, VBA, C#, Java)

Keywords Studios (Player Support), India (On-Site)

Fluence - Staff Data Engineer

Fluence, United States (Hybrid)

Autodesk - Senior Principal Engineer - MarTech

Autodesk, United States (Hybrid)

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

Aristocrat Gaming - IT Financial Management Coordinator

Aristocrat Gaming, United States (Hybrid)

Sawhorse Productions - Senior Roblox Developer (Contract)

Sawhorse Productions, United States (Remote)

Next Level Business Services - Bigdata / Hadoop Architect

Next Level Business Services, United States (On-Site)

Glean - Product Manager, Platform

Glean, United States (On-Site)

PlayStation Global - Principal Product Manager

PlayStation Global, United States (Remote)

The Walt Disney Company - Lead Machine Learning Engineer

The Walt Disney Company, United States (On-Site)

WebFX - Jr. Marketing Analytics Consultant

WebFX, United States (On-Site)

The Walt Disney Company - Lead Software Engineer

The Walt Disney Company, United States (On-Site)

Elsewhere - Marketing and Community Manager

Elsewhere, United States (On-Site)

Get notifed when new similar jobs are uploaded

Backend Development Jobs

Aera Technology - Senior Software Engineer (Backend Java)

Aera Technology, India (On-Site)

Playrix - Tech Lead Full Stack (Web Services)

Playrix, Armenia (Remote)

ESL FACEIT Group - EFG - Senior Software Engineer - Platform and Game Servers

ESL FACEIT Group - EFG, United Kingdom (Remote)

Skyhigh Security - Senior Software Development Engineer

Skyhigh Security, India (On-Site)

seeking alpha - Senior Backend Data Developer

seeking alpha, Poland (Remote)

Fliff  Inc  - Senior Software Engineer

Fliff Inc , Bulgaria (On-Site)

Ajmera Infotech - Sr. Backend Engineer - Node Expert

Ajmera Infotech, India (On-Site)

StockX - Software Engineer - iOS

StockX, India (On-Site)

Get notifed when new similar jobs are uploaded