Principal Hardware Architect jobs in United States
cer-icon
Apply on Employer Site
company-logo

Microsoft · 19 hours ago

Principal Hardware Architect

Microsoft is a leading technology company seeking a Principal Hardware Architect to join their Strategic Planning and Architecture team within Azure Hardware Systems & Infrastructure. The role involves analyzing and architecting hardware systems for AI workloads, driving the development of AI infrastructure, and collaborating on innovative hardware designs.

Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
check
Growth Opportunities
badNo H1BnoteU.S. Citizen Onlynote

Responsibilities

Analyze hardware architectures for AI workloads at system level and SoC level
Architect large scale systems which support breakthrough performance for AI workloads to shape Azure’s AI infrastructure roadmap
Benchmark GPUs and other AI hardware, with NN models and develop kernels for micro benchmarks
Develop / enhance the inference stack architecture for optimal deployment of novel HW architectures and lead prototyping efforts to demonstrate feasibility and performance
Understand business critical AI workloads/applications
Drive NN model/HW codesign

Qualification

AI Accelerator ArchitectureLarge Scale SystemsPython ProgrammingHPC Workloads KnowledgeDeep Learning FrameworksCNN/Transformer OptimizationCollaborative Mindset

Required

Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Preferred

15+ years of experience developing/architecting high end AI Accelerators
Understanding of large language models, training and inference
Knowledge of commonly used AI and HPC workloads and how they are mapped onto large scale systems
Expertise in python programming and SW engineering
Collaborative mindset
Hands on experience with frameworks such as Pytorch/Tensorflow/TensorRT
Deep knowledge of CNN/transformer architecture and optimization strategies – quantization, sparsity, sharding, KV Cache, Flash Attention
Knowledge of inference stacks, like sglang
Knowledge in developing kernels for AI accelerators / GPUs
Programming skills in Python/C/C++

Company

Microsoft

company-logo
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.

Funding

Current Stage
Public Company
Total Funding
$1M
Key Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M

Leadership Team

leader-logo
Satya Nadella
Chairman and CEO
linkedin
leader-logo
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
linkedin
Company data provided by crunchbase