Nebius · 2 months ago
Senior ML Solutions Architect - Token Factory
United States
Full-time
Hybrid
Senior Level
$215K/yr - $275K/yr
5+ years expNebius is leading a new era in cloud computing to serve the global AI economy. They are seeking an experienced Senior ML Solutions Architect to support customers leveraging Nebius Token Factory's serverless inference platform for open-source LLMs, collaborating with clients to design and implement customized LLM-based solutions and architect scalable AI applications.
AI InfrastructureCloud InfrastructureGPUIaaSPaaS
Responsibilities
Design and implement LLM-based solutions using Nebius Token Factory’s inference services to drive business value and support customer goals
Build production-ready applications leveraging our serverless LLM APIs, including multimodal models (text, vision, audio) and domain-specific models
Provide technical expertise in prompt engineering, RAG architectures, model selection, and inference optimization
Collaborate with product and engineering teams to surface customer feedback and shape the platform roadmap
Guide customers in scaling from POC to production with a focus on performance, reliability, and cost efficiency
Qualification
Required
5+ years of experience in ML/AI systems, with at least 2 years focused on LLMs and generative AI
Deep knowledge of the LLM ecosystem, including model architectures and fine-tuning approaches
Hands-on experience with prompt engineering and LLM pipeline development, including evaluation
Hands-on experience with agentic frameworks such as Langchain, Langsmith, smolagents, or equivalent
Hands-on experience with vector databases and RAG implementation patterns
Hands-on experience deploying LLM-powered applications using APIs from OpenAI, Anthropic, or open-source models
Strong Python programming skills
Excellent communication skills, with the ability to clearly explain technical concepts to diverse audiences
Preferred
Experience with inference frameworks and libraries (e.g., vLLM, SGLang, TensorRT-LLM, Transformers)
Familiarity with inference optimization techniques such as quantization, batching, caching, and routing
Work with multimodal AI models (e.g., vision-language, speech)
Proficiency with DevOps tools (Docker, Kubernetes)
Contributions to open-source ML/AI projects
Benefits
Health Insurance: 100% company-paid medical, dental, and vision coverage for employees and families.
401(k) Plan: Up to 4% company match with immediate vesting.
Parental Leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.
Remote Work Reimbursement: Up to $85/month for mobile and internet.
Disability & Life Insurance: Company-paid short-term, long-term, and life insurance coverage.
Company
Nebius
The Nebius AI Cloud brings powerful full-stack infrastructure for AI developers and practitioners across startups, enterprises and science institutes to build and deploy generative AI applications and rapidly deliver scientific breakthroughs by training and running ML models within a secure, high-performance, and cost-optimized cloud environment.
501-1000 employees
Funding
Current Stage
Late StageTotal Funding
$1.04B2025-06-04Debt Financing· $1B
2025-05-15Grant· $45M
2024-12-02Seed
Leadership Team
E
Evan Helda
Head of Physical AI
Vinita Ananth
Sr. Director of Product
Recent News
2025-10-25
Company data provided by crunchbase