Glean · 3 hours ago
Software Engineer, Agentic Runtime
San Francisco Bay Area
Full-time
Hybrid
Mid Level
$170K/yr - $265K/yr
3+ years expGlean is a Work AI platform that helps organizations work smarter with AI. The role involves building and operating core runtime services for Glean’s AI agents, focusing on performance, reliability, and cost optimization.
Artificial Intelligence (AI)Enterprise SoftwareGenerative AIMachine LearningSearch Engine
Responsibilities
Own impactful runtime problems end‑to‑end — from architecture and design to production launch and ongoing reliability
Build and evolve core services for session lifecycle, streaming responses (e.g., gRPC/WebSockets), structured tool execution, memory/state, and policy/guardrails
Design for performance, correctness, and cost: reduce p50/p95 latency, improve tail behavior, and optimize token/tool budgets
Integrate with leading LLM providers (e.g., OpenAI, Anthropic, Google Gemini) and internal evaluation frameworks to improve quality and predictability
Harden the platform with fault isolation, retries, timeouts, circuit‑breaking, backpressure, and graceful degradation
Instrument deep observability (tracing, metrics, logs) and create playbooks/SLOs for high availability and on‑call excellence
Collaborate closely with product, quality, and application teams to prioritize the most impactful roadmap investments
Qualification
Required
3+ years of software engineering experience building production distributed systems or cloud‑native applications
BS/BA in Computer Science or related field, or equivalent practical experience
Strong coding skills in at least one of: Python, Go, Java, or C++, with a focus on reliability, performance, and tests
Product‑minded: you prioritize customer impact, clear SLAs/SLOs, and pragmatic iteration
Ownership‑driven with a positive, proactive attitude; comfortable leading projects or learning from battle‑tested engineers
Experience operating services on Kubernetes and at least one major cloud (e.g., GCP, AWS, or Azure)
Familiarity with event/streaming systems (e.g., Pub/Sub, Kafka), caching (e.g., Redis), and data stores for low‑latency paths
Practical understanding of LLM/agents building blocks: tool/function calling, structured outputs, streaming, and model selection/routing
Strong observability and debugging skills: tracing (e.g., OpenTelemetry), metrics, dashboards, and production forensics
Preferred
Background in one or more areas is a plus: policy/guardrails, multi‑tenant isolation, rate‑limiting, concurrency control, cost optimization
Benefits
Medical, Vision, and Dental coverage
Generous time-off policy
Opportunity to contribute to your 401k plan
Home office improvement stipend
Annual education and wellness stipends
Healthy lunches daily
Company
Glean
Glean develops an AI-based search engine software that connects enterprise data and generates answers to improve workplace efficiency.
501-1000 employees
H1B Sponsorship
Glean has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (18)
2024 (17)
2023 (7)
2022 (26)
Funding
Current Stage
Late StageTotal Funding
$768.2MKey Investors
Wellington ManagementSequoia CapitalGeneral Catalyst
2025-06-10Series F· $150M
2024-09-10Series E· $260M
2024-02-27Series D· $203.2M
Leadership Team
Arvind Jain
Founder and CEO
Michael Miao
VP of Finance & BizOps
Recent News
Business Insider
2025-12-24
2025-12-11
Company data provided by crunchbase