Microsoft · 1 day ago
Principal AI Engineer
United States
Full-time
Remote
Senior Level, Lead/Staff
$140K/yr - $275K/yr
6+ years expMicrosoft Security aspires to make the world a safer place for all. We are seeking a Principal AI Engineer - Platform to help define the technical direction for the Platform + Apps group, designing and architecting solutions for large problems and driving development of microservices and ML inference pipelines.
Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
Responsibilities
Define the technical vision, architecture, and roadmap for the platform; align stakeholders across Security AI, partner product teams, and Azure AI to deliver cohesive customer value
Drive technical direction for engineers building microservices, ML inference pipelines, APIs, and user interfaces
Architect multi-tier ML inference systems: high-performance rule engines, LLM serving, transformer models, and intelligent caching strategies
Provide hands-on technical leadership: prototype critical components, review designs and PRs, define API contracts, establish coding standards, and build evaluation frameworks
Drive microservices architecture decisions: service decomposition, API design (REST/gRPC), data models, state management, and inter-service communication patterns
Own the end-to-end product development lifecycle: requirements analysis, technical design, implementation, testing, and deployment coordination with AI Operations
Collaborate with AI Operations team on deployment strategies, infrastructure requirements, and operational readiness for new features
Ensure Responsible AI, privacy, and security guardrails are designed in from day one; coordinate safety reviews and compliance requirements
Mentor senior and mid-level engineers; cultivate a builder culture of velocity, quality, and continuous improvement
Engage with enterprise customers and partner teams to co-design solutions; communicate technical roadmaps and demonstrate capabilities to executives
Embody our culture and values
Qualification
Required
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
6+ years technical engineering experience building production software systems
6+ years driving complex, cross-functional initiatives; demonstrated success leading without authority across multiple teams
4+ years working with Machine Learning/AI production systems
3+ years building and operating large-scale distributed systems and microservices architectures
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Preferred
Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Proven track record shipping ML inference platforms or AI-powered products at scale with measurable customer and business impact
Deep knowledge in ML inference technologies: model serving frameworks, LLM inference platforms, model optimization, and GPU resource management
Experience guiding full-stack development spanning backend services (C#/.NET, Python) and frontend applications (React, TypeScript)
Security domain knowledge (threat detection, SIEM/SOAR, attack pattern recognition) and familiarity with security analyst workflows
Experience with Azure infrastructure: AKS, Event Hub, Kusto/ADX, Cosmos DB, Redis, and Infrastructure as Code (Bicep, Helm)
Background in API design: REST, gRPC, OpenAPI, versioning strategies, and backward compatibility
Demonstrated success mentoring engineers and influencing technical direction without direct authority
Benefits
Certain roles may be eligible for benefits and other compensation.
Company
Microsoft
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.
10001+ employees
H1B Sponsorship
Microsoft has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)
Funding
Current Stage
Public CompanyTotal Funding
$1MKey Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M
Leadership Team
Satya Nadella
Chairman and CEO
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
Recent News
2026-01-16
Morningstar.com
2026-01-16
Company data provided by crunchbase