Microsoft · 2 hours ago
Principal Group Applied Science Manager, Online Experimentation - CoreAI
Redmond, WA
Full-time
Hybrid
Senior Level, Lead/Staff
$163K/yr - $296K/yr
5+ years expMicrosoft is at the forefront of redefining how software is built and experienced through its CoreAI division. They are seeking a Principal Group Applied Science Manager to lead the Experimentation science team, focusing on advancing online experimentation methodology and collaborating with cross-functional teams to enhance product learning and user experiences.
Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
Responsibilities
Shapes and propels Microsoft’s industry-leading online experimentation platform, driving breakthrough advancements in product-development tooling and publishing impactful articles and research to establish intellectual property and attract and retain talent
Serves as a technical visionary and thought leader, positioning the ExP Platform to streamline product learning through innovative, research-backed approaches to enable trustworthy, agile, and data-driven decision making on a global scale
Provides expert technical guidance and deep industry insight, advising cross-functional teams on the adoption of cutting-edge tools, technologies, and methodologies to ensure successful experimentation programs and uphold the highest standards of quality and scientific rigor
Ensures teams develop and apply advanced subject matter expertise across a diverse set of specialized tools and methods, driving measurable business outcomes and elevating the scope and impact of Microsoft’s experimentation initiatives
Leverages an extensive professional network and personal expertise to attract exceptional science and engineering talent to Microsoft, identify emerging technology opportunities, and build new areas of application through strategic recruitment and talent development
Qualification
Required
Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 8+ years related experience (e.g., statistics, predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field and AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 5+ years related experience (e.g., statistics, predictive analytics, research). OR equivalent experience
5+ years of people management experience
Preferred
Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or a related field and 12+ years of related experience (e.g., statistics, predictive analytics, research), or Doctorate in Statistics, Econometrics, Computer Science, or a related field and 8+ years of related experience, or equivalent experience
5+ years of experience presenting research or technical work at conferences or industry events as an invited speaker
7+ years of experience designing, developing, and deploying products or systems across multiple stages of the product lifecycle, from ideation and experimentation through production deployment and iteration
Experience designing, building, and scaling online experimentation platforms that support high‑velocity A/B and multivariate testing across complex, multi‑team product ecosystems, including governance models, experimentation guardrails, and causal inference best practices
Experience leading product measurement strategy, including defining north‑star metrics, architecting end‑to‑end measurement frameworks, and influencing senior product and engineering leaders on interpreting ambiguous or noisy data at scale
Experience evaluating and benchmarking large language models and autonomous agents, spanning offline and online evaluation methodologies, safety and reliability measurement, and translating model‑ and agent‑quality signals into product‑level decisions
Company
Microsoft
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.
10001+ employees
H1B Sponsorship
Microsoft has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)
Funding
Current Stage
Public CompanyTotal Funding
$1MKey Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M
Leadership Team
Satya Nadella
Chairman and CEO
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
Recent News
2026-01-16
Morningstar.com
2026-01-16
Company data provided by crunchbase