DeepRec.ai · 5 hours ago
LLM Algorithm Tech Lead
DeepRec.ai is a product-focused AI start-up building LLM systems for daily use by over a million professionals. This role is responsible for designing, shipping, and maintaining applied LLM systems that support real product features, emphasizing reliability, cost, and scale.
Responsibilities
Own how LLM systems behave in a large, user-facing product
Make architectural decisions that affect reliability, latency, and cost
Move LLM features from prototype to stable production systems
Set technical direction for applied LLM algorithms and evaluation practices
Design structured LLM workflows, including planning, reasoning, and multi-step execution
Build and maintain core components such as memory, personalization, and reusable LLM modules
Lead development of LLM-powered product features from design through production
Build and optimize retrieval pipelines (RAG) via chunking, indexing, reranking, and evaluation
Select and route between models based on performance, cost, and latency constraints
Define evaluation metrics, monitoring, and feedback loops
Debug production issues and drive algorithm-level improvements
Qualification
Required
Experience shipping LLM-based systems into production
Strong understanding of prompting, reasoning workflows, and system design
Hands-on experience with RAG systems
Experience building evaluation, monitoring, or safety mechanisms
Ability to lead technical decisions and guide other engineers
Preferred
Experience with inference optimization, efficiency, or large-scale systems is a plus