Microsoft 365 Copilot is a groundbreaking productivity tool that leverages the power of large language models, user data, Microsoft Graph, and the web to drive unparalleled creativity and productivity. At the heart of this innovation is the Office AI Platform team, which plays a crucial role in the development of Copilot experiences across M365 and an expanding list of partners across Microsoft. We own the infrastructure that enables complex orchestration of Copilot workflows to put powerful AI capabilities at the user’s fingertips. 

　　We are looking for a Principal Software Engineer to work with generative AI model. The individual should be a savvy engineer who can work through architectural issues and yet familiar with all of the state-of-the-art technologies around generative AI.

　　The individual should be able to extend the usage of LLMs by using vector databases. The individual should have experience in working with any type of knowledge base document repository spanning multiple document types. The individual should have deep understanding of segmentation and should be able to apply it for comprehension of documents of various sizes.  These capabilities should be provably demonstrable on the kind of work the individual has recently done with respect to current projects.

　　The individual should have experience in working in building natural language to code generation systems such that the individual understands the nuances and the challenges to the approach. This includes experience with working with code generation of Domain Specific languages (DSLs) as well as programming languages such as Javascript. 

　　The individual should have experience in improving performance of LLMs by means of applying caching techniques to LLM responses. Leveraging lighter weight models in place for specific scenarios. In addition, the individual should have experience of working with low cost open source LLMs as well. 

　　The individual should have capability of working with research teams and partnering with them to deliver joint solutions.  This can range from working together to build fine tuned models to coming up with ways to build custom LLMs for specific product needs.

　　The individual should be able to work with a early in career teammates and set the technical direction of the team. The said person should have experience with building credible relationship with Microsoft technical leadership and working with them to deliver great product outcomes.

　　We are excited to hear from candidates who are passionate about making a significant impact on how people interact with their computers in the last 30 years, and who are excited about the opportunity to be at the forefront of growing new business for Microsoft. This is a rare chance to be part of a cutting-edge technology that is poised to revolutionize productivity and innovation. We are looking for individuals who are passionate about pushing the boundaries of what is possible, and who are eager to join us in shaping the future of this field during these exciting times. 

　　Responsibilities

　　Development and unit testing in C#/C++/Javascript/NodeJS/Python

　　Proactively identify and resolve people, process, and technology issues to reduce incident mitigation time.

　　Solve issues through software or automation improvements.

　　Collaborate on the design of the overall services with a focus on service reliability and automated troubleshooting.

　　Research, architect, develop and deliver solutions in an evolving agile development environment. 

　　Qualifications

　　Required/Minimum Qualifications

　　Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including C#, C++ and Java 

　　OR equivalent experience.

　　4+ years of design, implementation, debugging and testing of complex distributed services. 

　　3+ years of experience working on ML models specifically with Natural language based models, vector databases and graph databases.

　　1+ year experience with working with LLMs and prompt engineering,

　　Additional or Preferred Qualifications

　　3+ years of experience shipping products through more than one development cycle. 

　　Working knowledge of Distributed Systems and Cloud Technologies. 

　　Experience driving a complex multi-year infrastructure project

　　Experience building commercial grade software, with much of that experience in a large scale, high availability service.

　　Experience with directory and/or data storage systems.

　　Experience working across disciplines and functions

　　Experience with partnering across teams specifically with science research teams

　　Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $133,600 - $256,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $173,200 - $282,200 per year.

　　Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

　　#OPG

　　Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .