SIGN IN
Technical Product Manager – AI Neocloud Software Stack jobs in United States
cer-icon
Apply on Employer Site
company-logo

Gruve · 1 day ago

Technical Product Manager – AI Neocloud Software Stack

positionRedwood City, CA
timeFull-time
remoteOnsite
seniorityEntry, Mid Level
money$180K/yr - $220K/yr
date2+ years exp
Gruve is an innovative software services startup dedicated to transforming enterprises to AI powerhouses. They are seeking a Technical Product Manager to shape inference-related product capabilities by collaborating closely with engineering teams and translating customer feedback into actionable priorities.
Artificial Intelligence (AI)SoftwareMachine Learning
check
H1B Sponsor Likelynote

Responsibilities

Own inbound product responsibilities related to AI inference software
Define and refine product requirements for model serving, routing, and performance
Translate customer and partner feedback into actionable product priorities
Partner closely with engineering to guide roadmap decisions and trade-offs
Balance latency, throughput, cost, and usability in product decisions
Ensure product decisions are documented, communicated, and well understood

Qualification

AI neocloud experienceInference platformsGPU-centric infrastructureVLLMSGLangTensorRT-LLMModel routingQuantization techniquesCustomer-centric mindsetCommunication skillsCollaborative approach

Required

2+ years of product management experience in AI neoclouds, inference platforms, or GPU-centric infrastructure products
Experience working closely with engineering teams on highly technical systems
Proven experience owning inbound product responsibilities
Understanding of inference stack components such as: vLLM, SGLang, TensorRT-LLM, or similar
Continuous batching and KV cache behavior
Prefill vs. decode phases
Model routing and request scheduling
Quantization (INT8, INT4, FP8)
GPU utilization, memory constraints, and autoscaling
OpenAI-compatible APIs, SDKs, SLAs, and observability
Bachelor's degree in Computer Science, Engineering, or related technical field (or equivalent practical experience)

Preferred

Advanced degree in a technical field
Hands-on experience with AI infrastructure, inference platforms, or software systems
Strong customer-centric mindset, technical fluency, and collaborative approach
Excellent communication skills, able to ask clarifying questions and earn trust with engineering teams

Benefits

Benefits

Company

Gruve

twittertwitter
company-logo
Gruve is a startup focused on transforming AI strategies into tangible outcomes for enterprises.
dateFounded in 2024
location
San Francisco, California, USA
people-size501-1000 employees
web-link
https://www.gruve.ai

H1B Sponsorship

Gruve has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)

Funding

Current Stage
Late Stage
Total Funding
$87.5M
Key Investors
Xora InnovationMayfield Fund
2026-02-03Series A· $50M
2025-04-30Series A· $20M
2025-04-30Seed· $17.5M

Recent News

SiliconANGLE
AI torches software stocks, even as investors fret about all that AI factory spending
2026-02-06
Tech Startups - Tech News, Tech Trends & Startup Funding
75% of Bitcoin’s source code allegedly came from Jeffrey Epstein’s investments, newly released FBI Epstein Files reveal
2026-02-04
Tech Startups - Tech News, Tech Trends & Startup Funding
Top Startup and Tech Funding News – February 3, 2025
2026-02-04
Company data provided by crunchbase