Software Engineer

The MAI division at Microsoft IDC is on a journey to create amazing AI experiences using LLM applications in the mobile space to offer useful, simple, and on-the-go intelligence. LLMs are creating opportunities that were completely out of reach for technology solutions only a year ago. Our team is capitalizing on this wave of advancement to deliver magical user experiences that were previously only possible with humans in the loop.  

A big part of this job will be focusing on ultimate outcomes / big picture conceptualizing all the way down to ensuring the delivered product exceeds expectations with the feedback mechanisms in place to allow validation and continual improvement. 

We are looking for talented Software Engineer who has experience in working on designing efficient and scalable systems using LLMs for synthetic data generation, human in the loop labelling, automating algorithm validation, building reports and dash boards, etc. Job may also require working on LLM/Cloud AI models.  

 Our colleagues are among the best in the industry and share an intense passion for delivering amazing products. We’re also a team that likes to have fun and continually learn, and we build that attitude into how we work together and what we create. Some domestic and international travel will be necessary.   

The job is highly dynamic and involves working across various disciplines to successfully deliver the platform with great experience and quality.   

Required Qualifications: 
 

• A minimum of 1+ year of experience in software and/or product development.
• Excellent C/C++/Java/Kotlin/JNI design and coding skills 
• Android skills (platform and app layer) 
• Data/ML skills/LLM and Cloud AI models 
• Design/coding/Debugging/Problem solving (Data structures) 
• Experience with shipping Android based products with AI powered experience 
  BS in Engineering or equivalent experience 
   

Additional Qualifications: 

• Proven track record of designing and directing complex architecture that spans multiple technologies .
• Proven track record of shipping high volume consumer devices (Windows, Android, Linux) .
• Data infrastructure - synthetic phone data and pipeline, automation, etc. 
• DB with vector indexing and Embedding .
• APPX package for hosting models with encryption / theft protection 
  Background runners for data processing .
• LLM prompts and option sets for Sydney to support RAG 
  Suggestion service prompts .
• LlamA /AI Runtime (SNPe, QNN or similar) 
•  Ability to quickly ramp-up on complex and unfamiliar code 
• Experience with dealing in geographically diverse teams 
   

• Building outstanding consumer-grade mobile applications and platforms with LLM experiences.
• Ship high-quality, well-tested, secure, and maintainable code.  
• Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.  
• Enjoy working in a fast-paced, design-driven, product development cycle.