Microsoft · 2 months ago
Principal Software Engineer - AI Platform Architect
United States, Washington, Redmond
Full-time
Hybrid
Lead/Staff
$163K/yr - $296K/yr
10+ years expMicrosoft is a leading technology company seeking a Principal Software Engineer - Platform Architect for the Teams Platform, focusing on AI & LLM technologies. The role involves designing and building next-generation programmability and API interfaces, enabling developers to integrate intelligent AI agents within Microsoft Teams.
Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
Responsibilities
Define long-term technical strategy: Set vision and direction for Teams API and AI platform initiatives, including agent-to-agent protocols, composable LLM pipelines, and developer extensibility
Architect complex, scalable systems: Lead design for end-to-end scenarios involving distributed microservices, multi-tenant routing, LLM orchestration, tool integration, and secure API endpoints
Build hyperscale LLM-enabled infrastructure: Craft systems to support developer-deployed AI agents, multi-step workflows, data connectors, and runtime MCP patterns across global Teams environments
Design APIs & SDKs for AI applications: Define developer-facing components that allow ISVs to deploy, configure, and manage LLM-powered agents and tools within Teams
Drive engineering culture: Champion scalability, reliability, observability, security, operational excellence, and customer obsession
Collaborate broadly: Partner with leadership, cross-functional teams (Research, Security, UX), and ecosystem stakeholders to deliver unified, strategic outcomes
Hands-on leadership: Develop, debug, optimize, and maintain platform features end-to-end—from coding to deployment and operational excellence
Operational responsibility: Troubleshoot complex infrastructure issues at scale, proactively reduce incidents, and maintain oncall readiness
Mentor and foster growth: Build a healthy, inclusive environment, guiding engineers toward excellence in distributed platforms and AI infra
Embody the Microsoft culture and values
Qualification
Required
Bachelor's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Experience in LLM infrastructure and paradigms including agent-to-agent communication protocols and orchestration, Model Context Protocol, Integration of third-party tools, APIs, and data sources into LLM pipelines
Experience in secure execution of LLMs in cloud environments, multi-tenant isolation, throttle control
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Preferred
Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C#, C++, or Rust OR equivalent experience
10+ years of experience focused on advanced software development and architecture, building commercial-grade, high-availability services
10+ years of experience driving software platform architecture projects from both a technical and functional perspective, guiding complex projects from planning through execution and service operations
Demonstrated commitment to software engineering excellence
Analytical and problem-solving skills, with a history of navigating significant technical challenges, emphasizing a continuous release mindset and service operation in a dynamic environment
Ability to lead in a fast-paced, customer focused, and data-driven environment
A decisive, self-directed, collaborative, and innovative approach to projects
Experience in LLM infrastructure and paradigms: Agent-to-agent communication protocols and orchestration, Model Context Protocol, Integration of third-party tools, APIs, and data sources into LLM pipelines
Secure execution of LLMs in cloud environments, multi-tenant isolation, throttle control
Company
Microsoft
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.
10001+ employees
H1B Sponsorship
Microsoft has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)
Funding
Current Stage
Public CompanyTotal Funding
$1MKey Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M
Leadership Team
Satya Nadella
Chairman and CEO
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
Recent News
2026-01-16
Morningstar.com
2026-01-16
Company data provided by crunchbase