Open Talent ยท 10 hours ago
Senior Software Engineer (TypeScript / React / LLM Systems) / Fintech / $250,000 / Hybrid (2 days) / New York, NY
Open Talent is seeking a Senior Software Engineer to help build production-grade LLM-powered systems used in high-impact, real-world workflows. The role involves designing and building TypeScript services and developing React interfaces, while collaborating with product, design, and ML engineers to ensure reliability and user experience.
Responsibilities
Design and build TypeScript services that power LLM workflows including RAG pipelines, prompt orchestration and fine-tuning flows
Develop rich, intuitive React interfaces for AI-driven products - heavy focus on UX, clarity and usability
Implement retrieval systems using vector databases, hybrid search and structured data sources
Work hands-on with LLM APIs and open-source models (OpenAI, Anthropic, open-weight models)
Collaborate with ML engineers on evaluation, fine-tuning strategies and production rollout
Own backend architecture across Node.js services, async pipelines and model-facing APIs
Improve system reliability through logging, monitoring, tracing and failure handling
Mentor engineers and contribute to design and architecture decisions across the platform
Qualification
Required
Must be based in NYC & the role requires US Citizenship due to regulatory constraints. No sponsorship/visas/Green Card
Design and build TypeScript services that power LLM workflows including RAG pipelines, prompt orchestration and fine-tuning flows
Develop rich, intuitive React interfaces for AI-driven products - heavy focus on UX, clarity and usability
Implement retrieval systems using vector databases, hybrid search and structured data sources
Work hands-on with LLM APIs and open-source models (OpenAI, Anthropic, open-weight models)
Collaborate with ML engineers on evaluation, fine-tuning strategies and production rollout
Own backend architecture across Node.js services, async pipelines and model-facing APIs
Improve system reliability through logging, monitoring, tracing and failure handling
Mentor engineers and contribute to design and architecture decisions across the platform
Frontend: React, TypeScript, Next.js, Tailwind CSS, Storybook
Backend: Node.js, TypeScript, REST, GraphQL
LLM Systems: RAG pipelines, fine-tuning workflows, prompt orchestration
Data & Retrieval: PostgreSQL, Vector DBs (Pinecone, Weaviate, pgvector), Redis
Infrastructure: AWS, Docker, Kubernetes, Terraform
Observability: OpenTelemetry, Prometheus, Grafana, Sentry
Preferred
Experience building production LLM systems beyond prototypes
Hands-on fine-tuning experience (LoRA, adapters, evaluation pipelines)
Background in ML engineering or applied NLP
Experience designing complex frontend UX for data-heavy or AI-driven products
Familiarity with model evaluation, guardrails and hallucination mitigation
Benefits
Health
Dental
Vision
401(k)
Flexible PTO + company holidays
Conference budget
Learning allowance
Company
Open Talent
๐ Recruiting elite-tier 0.1% AI/ML, GTM & software engineers in New York City, partnering exclusively with the most ambitious scale-ups from pre-seed through Series D.
Funding
Current Stage
Early StageCompany data provided by crunchbase