Baseten · 22 hours ago
Senior Product Engineer - Training Platform
New York, NY
Full-time
Hybrid
Senior Level
$200K/yr - $275K/yr
5+ years expBaseten powers mission-critical inference for leading AI companies, and they are seeking a customer-obsessed software engineer to join their team. The role involves owning features and products related to multi-node training and serverless reinforcement learning, working closely with research engineers to enhance model development workflows.
AI InfrastructureArtificial Intelligence (AI)Developer ToolsMachine LearningSoftwareSoftware Engineering
Responsibilities
Iterate like crazy
Design ergonomic APIs and abstractions to model complex resources and lifecycles
Work throughout the stack (API layer, backend and database implementation, infra layer; frontend is a plus) to implement features
Fine-tune and deploy models to develop intuition around training workflows
Partner closely with model developers and world-class research engineers to understand the requirements and pain points of post-training workflows
Drive long-term improvements to improve reliability of systems and velocity of development
Fix bugs & resolve customer issues with urgency
Qualification
Required
5+ years experience building software applications
Deep knowledge of the web stack, databases, and distributed systems
Experience developing developer tooling or infrastructure products for external or internal users
Good taste in product, particularly developer-oriented tools
Interest in ML/AI infrastructure and willingness to learn
Driven by high agency and ownership
Strong communication skills with the ability to bridge technical depth and business needs
Preferred
Experience launching features and products through different release cycles (MVP, Beta, GA, etc.)
Experience with model development methods and paradigms, like Supervised Fine-Tuning, Reinforcement Learning, Synthetic Data Generation, LoRA, Full Finetunes, etc
Familiarity or experience with the open source training stack and frameworks (NCCL, PyTorch, Megatron, NemoRL, VeRL, Axolotl, HF Trainer) and distributed training techniques (FSDP, DeepSpeed)
Experience developing AI products, tooling, or agents
Frontend fluency
Benefits
Competitive compensation, including meaningful equity.
100% coverage of medical, dental, and vision insurance for employee and dependents
Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Company
Baseten
Baseten is an AI infrastructure company that integrates machine learning into business operations, production, and processes.
51-200 employees
H1B Sponsorship
Baseten has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)
2024 (8)
2023 (1)
2020 (1)
Funding
Current Stage
Late StageTotal Funding
$585MKey Investors
BondGreylock
2026-01-20Series Unknown· $300M
2025-09-05Series D· $150M
2025-02-19Series C· $75M
Leadership Team
Aaron Relph
Design
Recent News
Tech Startups - Tech News, Tech Trends & Startup Funding
2026-01-22
2026-01-22
Company data provided by crunchbase