Apply on Employer Site

TensorZero · 3 weeks ago

Member of Technical Staff — Back-end Engineering (Systems)

NYC

Full-time

Onsite

Mid Level

$200K/yr - $300K/yr

TensorZero is building an automated AI engineer powered by their open-source LLMOps platform. They are seeking a Member of Technical Staff with a background in systems engineering to collaborate on projects that enhance LLM systems and contribute to open-source efforts.

Artificial Intelligence (AI)Generative AIMachine LearningSoftware

Responsibilities

Analyze millions of inferences to surface error patterns and optimization opportunities

Recommend models and inference strategies to improve quality, cost, and latency

Generate and refine prompts based on human feedback, metrics, and evaluations

Drive optimization workflows like fine-tuning, reinforcement learning, and distillation

Set up evaluations, prevent regressions, and align LLM judges to real-world scenarios

Run A/B tests to validate changes, identify winners, and close the feedback loop

Qualification

Systems programmingRustC/C++ZigPersonal growthTechnical leadership

Required

Strong technical background — You've tackled hard technical problems. You're comfortable driving large projects from inception to deployment

Background in systems SWE — You'll complement the team with a strong background and technical leadership. You have extensive experience with systems programming languages (e.g. Rust, C/C++, Zig)

Hungry for personal growth — There are no speed limits at TensorZero. You're excited about learning and contributing across the stack

In-person in NYC — We work in-person five days a week in NYC. We work hard and obsess about the craft

Benefits

Competitive compensation — We believe that great talent deserves great compensation (salary, equity, benefits), even at an early-stage startup.

Open-source contributions — The vast majority of your work will be open-source and public.

Learning and growth opportunities — You’ll join with a background in back-end / systems but will have the opportunity (& be encouraged) to expand your skill set way beyond that (curious about ML?).

Small, technical, in-person team — You’ll work alongside a 100% technical team and help shape our vision, culture, and engineering practices.

Best-in-class investors — We’re lucky to be have raised $7.3M+ from leading funds like FirstMark (backed ClickHouse), Bessemer (backed Anthropic), Bedrock (backed OpenAI), and many angels. We have years of runway and a long-term mindset.