Samsung Semiconductor · 8 hours ago
Principal Engineer, AI System Architect (Hardware)
San Jose, CA
Full-time
Onsite
Lead/Staff
$219K/yr - $351K/yr
15+ years expSamsung Semiconductor is a global leader in technology solutions. They are seeking a Senior Staff AI System Architect to develop system-level performance models and drive architecture-level design decisions for next-generation AI systems, focusing on performance, efficiency, and scalability.
Semiconductor
Responsibilities
Conduct system-level architectural research for next-generation AI systems, spanning compute, memory, and interconnect/network subsystems
Develop and maintain analytical and simulation-based system modeling frameworks to evaluate AI workloads and identify performance, scalability, and efficiency bottlenecks at rack- and system-scale
Analyze representative and emerging AI workloads (e.g., LLMs, DLRMs, and future AI models) to derive architecture requirements and trade-offs across compute, memory, networking, and power
Drive architecture-level design decisions through quantitative modeling, design-space exploration, and performance/power projections
Perform comparative studies of alternative system architectures, reporting performance and performance-per-watt metrics to guide strategic technology choices
Lead the architecture team with strong technical direction, shaping system‑architecture strategy and advancing key innovations
Collaborate closely with cross-functional teams in hardware architecture, memory, interconnect, and system engineering to align modeling insights with implementation realities
Communicate architectural insights and recommendations through clear technical presentations and documentation
Occasional domestic and international travel
Qualification
Required
Ph.D. in Computer Science, Electrical Engineering, or a related field, with 15+ years of experience in system architecture for large-scale computing platforms, with a strong focus on AI workloads
Proven hands-on experience developing analytical and event-driven simulation models for system-level performance evaluation
Deep understanding of AI system hardware architectures, including compute, memory hierarchies, and high-performance interconnects
Strong knowledge of modern and emerging AI workloads, including LLMs, DLRMs, and large-scale training and inference systems
Demonstrated ability to translate workload characteristics and modeling results into actionable architectural design decisions
Proficiency in Python, C++, and PyTorch for modeling, analysis, and experimentation
Excellent written, verbal, and presentation communication skills, with the ability to influence technical direction across teams
A collaborative mindset, intellectual curiosity, and resilience in tackling complex, open-ended system-level challenges
You're inclusive, adapting your style to the situation and diverse global norms of our people
You approach challenges with curiosity and resilience, seeking data to help build understanding
You're collaborative, building relationships, humbly offering support and openly welcoming approaches
Innovative and creative, you proactively explore new ideas and adapt quickly to change
Benefits
Medical/Dental/Vision/401k
Charitable giving match
Paid time off a year
Stipend for fertility care or adoption
Medical travel support
Virtual vet care for your fur babies
On-demand apps and free confidential therapy sessions
Onsite Café and gym
Virtual classes
Flexible environment
Company
Samsung Semiconductor
Samsung Semiconductor, Inc. (SSI) is a multi-billion dollar wide range of industry-leading semiconductor solutions.
Founded in 1974San Jose, California, USA
10001+ employees
H1B Sponsorship
Samsung Semiconductor has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (130)
2024 (110)
2023 (153)
2022 (134)
2021 (124)
2020 (134)
Funding
Current Stage
Late StageLeadership Team
Daehee Lee
Principal Engineer
Eric Hibbard
Director, Product Planning – Security
Recent News
Android Authority
2025-12-22
2025-11-07
PhAndroid.com
2025-11-07
Company data provided by crunchbase