Red Hat · 5 hours ago
Principal Software Engineer, Agentic AI & Orchestration
Raleigh, NC
Full-time
Onsite
Senior Level, Lead/Staff
$149K/yr - $245K/yr
7+ years expRed Hat is the world’s leading provider of enterprise open source software solutions, and they are seeking a Principal Software Engineer to join their team. In this role, you will design and implement Agentic AI features, collaborate with various engineering teams, and drive innovation in AI technologies.
Enterprise SoftwareInsurTechLinuxOpen SourceOperating SystemsSoftware
Responsibilities
Architectural Leadership: Lead the implementation of scalable, distributed computing solutions designed to serve Agentic AI and ensure seamless integration with the Red Hat product portfolio
MAS Design: Define and implement Multi-Agent System (MAS) architectures, including orchestration layers, state machines, tool registries, and resilient routing policies with safe fallbacks
Interoperability Standards: Hands-on experience implementing Model Context Protocol (MCP) for standardized tool/data access and Agent-to-Agent (A2A) or ACP protocols for cross-platform agent communication and task delegation
Upstream Influence: Contribute to and influence upstream AI/ML communities to steer the evolution of open standards for agentic workflows
Strategic Collaboration: Partner with AI/ML vendors and internal teams to refine AI strategies, addressing specific use cases that drive value through Red Hat’s next-generation UX
Reference Architectures: Develop technical blueprints and multi-product demos that showcase the "Art of the Possible" using the Red Hat AI stack
Innovation: Proactively explore emerging AI technologies to identify opportunities for incorporating new capabilities into software development workflows and tooling
Engineering Excellence: Drive AI integration within the software development lifecycle (SDLC), sharing successful experiment use cases with stakeholders to foster broader innovation
Qualification
Required
7+ years of relevant software engineering experience
Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience
Proven experience building agents and tooling frameworks; deep expertise in LangGraph, PydanticAI, or similar state-management libraries
Experience implementing sophisticated RAG, long-term memory systems, semantic caches, and vector databases
Expert-level proficiency in Python or Go, with a specific focus on building resilient, asynchronous distributed systems
Solid experience with containers and orchestration via OpenShift or Kubernetes
Familiarity with model parallelization, quantization, and memory optimization (e.g., vLLM, DeepSpeed, OpenVino)
Experience with GitOps, automation pipelines, and managing the AI/ML lifecycle in production environments
Direct experience with Agent Evaluation (Eval) frameworks (measuring success rates/hallucinations) and implementing Guardrails & Governance (preventing prompt injection/infinite loops)
Preferred
Cloud Computing experience with AWS, GCP, Azure, or IBM Cloud
A history of open-source contributions or active participation in the AI/ML community (GitHub, Research, or Upstream)
Benefits
Comprehensive medical, dental, and vision coverage
Flexible Spending Account - healthcare and dependent care
Health Savings Account - high deductible medical plan
Retirement 401(k) with employer match
Paid time off and holidays
Paid parental leave plans for all new parents
Leave benefits including disability, paid family medical leave, and paid military leave
Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!
Company
Red Hat
Red Hat is a software company that offers enterprise open-source software solutions. It is a sub-organization of IBM.
10001+ employees
H1B Sponsorship
Red Hat has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (159)
2024 (148)
2023 (156)
2022 (181)
2021 (154)
2020 (106)
Funding
Current Stage
Public CompanyTotal Funding
unknown2018-10-28Acquired
1999-08-20IPO
1999-03-09Corporate Round
Leadership Team
Chris Wright
Chief Technology Officer and Senior Vice President Global Engineering
Andrew Brown
Senior Vice President and Chief Revenue Officer
Recent News
Company data provided by crunchbase