Be at the forefront of AI evaluation by joining the Copilot Offline Evaluation Platform team and help us deliver the platform that makes Copilot innovation fast, reliable, and regression-free.

As a Principal Software Engineer, you will transform how Copilot features are developed and evaluated. Your team will deliver end-to-end experimentation, evaluation, and validations to Copilot engineers, PMs, and data scientists. You’ll work on the control plane that orchestrates the offline evaluation lifecycle, including tenant and resource management, data generation of users' activities, data hydration and injection, and chaos engineering. Empowering Copilot teams to prototype safely and measure quality with scientific rigor. This opportunity will allow you to dive deep on Copilot technologies, build critical skills in the AI-era, and rapidly grow your career.

The M365 Foundation team is a core pillar within Microsoft’s M365 Core Platform and Services organization, responsible for ensuring the reliability, resilience, performance, and scalability of the platform that underpins Microsoft 365 services. The team drives strategic investments across AI Evaluations, Performance & Efficiency, Change Management, Reliability & Resilience, Observability & Intelligent Cloud, and Fleet & Capacity, with an emphasis on trust, security, and operational excellence.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where

• Lead product development and scaling to customer requirements and apply best practices for meeting scaling needs and performance expectations and holds accountability for products that do not meet expectations.
• Partner with stakeholders (e.g., PM, DS, Leadership) to determine user requirements within and across teams.
• Proactively seek new knowledge and adapt to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and share knowledge with other engineers.
• Guide the team and lead identification of dependencies and the development of design documents for a product, application, service, or platform.
• Guide the team to drive multiple group project plans, release plans, and work items in coordination with appropriate stakeholders.
• Act as an expert and DRI (Designated Responsible Individual), be on call to mitigate system/product/service degradation to avoid downtime or interruptions.
• Embody our culture and values.

• Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.