Microsoft · 6 hours ago
Member of Technical Staff - Copilot AI Evaluation Engineering Manager
United States, California, Mountain View
Full-time
Onsite
Senior Level
$140K/yr - $275K/yr
6+ years expMicrosoft is a leading technology company focused on advancing artificial intelligence. They are seeking a Member of Technical Staff - Copilot AI Evaluation Engineering Manager to lead a team in building LLM evaluation solutions for Copilot, collaborating with cross-functional teams to enhance AI technology for users worldwide.
Artificial Intelligence (AI)Enterprise SoftwareCloud ComputingCyber SecuritySoftwareProfessional ServicesInformation TechnologyAgentic AIApplication Performance ManagementBusiness DevelopmentDevOpsInformation ServicesManagement Information SystemsNetwork Security
Responsibilities
Hire, manage, and lead a team of software engineers, AI engineers, and machine learning engineers responsible for delivering world-class LLM evaluation solutions
Collaborate with Eng and Product leadership to prioritize features and improve our world-class AI companion to the world
Design and build evaluation platforms, novel evaluation techniques, and agentic solutions for measuring and improving copilot quality
Drive implementation of features and systems, breaking down long-term goals into clear milestones, aligning with release plans, and ensuring cross-team coordination
Embody our Culture and Values
Qualification
Required
Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
Preferred
Bachelor's Degree in Computer Science, or related technical discipline AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
3+ years people management experience
Hands on experience with ML and/or AI evaluation OR equivalent experience
Experience leading engineering teams to deliver large-scale software systems, preferably in AI, machine learning, graphics or related fields
Thrive in a fast-paced, collaborative environment and are comfortable making progress in ambiguity
Enjoy working closely with cross-functional partners and teammates in an inclusive, curious culture
Have strong opinions about best investments to make in establishing the most delightful and performant AI companion engineering system
Company
Microsoft
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.
10001+ employees
H1B Sponsorship
Microsoft has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)
Funding
Current Stage
Public CompanyTotal Funding
$1MKey Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M
Leadership Team
Satya Nadella
Chairman and CEO
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
Recent News
2026-01-16
Morningstar.com
2026-01-16
Company data provided by crunchbase