We are looking for a talented and experienced Principal Software Engineer to join Bing SFS (Shared Fetching Service) Team (Bing Crawler team) in WWE Web Data Platform org. The Windows and Web Experiences Team (WWE) builds comprehensive and engaging content, services, and platforms for consumers to access the information they need anywhere on any device and for enterprises to enhance their employee and customer experiences. Are you interested in building scalable platforms? At Web Data Platform Team, we build the global web scale Index and the platform that supports it.
The Shared Fetching Service is a distributed highly-scalable politeness-aware web fetching and crawling service which retrieves, downloads and process the documents based on URL with smart quato control. This role is for you who have technical excellence and innovative thinking. This role is also for you if you are interested and have experience in Search, Big Data, Crawling, engineering systems, and Large Language Models (LLM). You will take tech architect role for the team and will be responsible for designing, developing and improving the architecture and codebase of our large-scale web crawler platform system, which fetch, render, process, and store billions of web pages every day. You will also have the opportunity to mentor a team of software engineers, drive technical innovation and decisions, and collaborate with other teams across Bing and Microsoft.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.
Responsibilities
• Bring fresh ideas and innovative solutions across the stack such as scalable infrastructure and building scalable platforms.
• Collaborates with appropriate stakeholders (e.g., platform senior leaders, project managers, other team members, and all platform service owners) to determine user requirements for a set of features.
• Leads product architecture discussions, formulates proposals, independently plans and tests solutions for quality assurance, and drives documentation for dependencies and design in diverse contexts.
• Leads by example in producing extensible, maintainable code, applies proactive and reactive debugging methods, and reviews code for quality, reliability, and scalability.
• Leverages expertise to drive project plans, conducts experiments for change effectiveness, and maintains implementation frameworks aligned with industry standards.
• Implements solutions to complex issues, guides engineers, and drives efforts for telemetry and data analysis.
• Develops and maintains software tools, emphasizing automation, security, and best practices, while staying current with industry developments and fostering communication with Microsoft ecosystem partners.
Embody our Culture & Values
Qualifications
Required/Minimum Qualifications
• Bachelor's Degree or higher in Computer Science, Engineering, Mathematics, or related fields.
• At least 6 years of experience in designing, developing and maintaining distributed information management systems.
• Good at one or more programming languanges such as C, C++, C#, Go, Python, …, efficient coding skills.
• Experience in big data processing or platform system developement.
• Good communication, collaboration and problem solving skills, fluent English speaking and writing.
Preferred Qualifications
• Including the qualifications above
• Master’s degree or PhD in Computer Science, Engineering, Mathematics or related fields.
• 8+ years experience in designing, developing and maintaining distributed information management systems. Experience in writing high quality code and conducting code reviews.
• Nice to have the experiences in Bing search or other search engine platform services
• Nice to have the experiences in Crawler area.
• Nice to have knowledges for deep learning techniques and frameworks and experiences in LLM prompt engineering.
#WWE
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .