Arize AI · 5 hours ago
Senior AI Product Engineer, Backend
United States
Full-time
Remote
Mid, Senior Level
$125K/yr - $225K/yr
5+ years expArize AI is a leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. The Senior AI Product Engineer will be responsible for building scalable backend services and APIs for machine learning workflows, as well as collaborating with product and engineering teams to enhance product offerings.
AI InfrastructureArtificial Intelligence (AI)Information TechnologyMachine LearningSoftware
Responsibilities
Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript
Build high-volume and highly available analytics systems
Design and build APIs specific to our customers’ Machine Learning and LLM workflows
Prototype, optimize, and maintain scalable backend services that power the Arize core platform
Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks
Develop and integrate collection tools for robust monitoring of ML and LLM pipelines
Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment
Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings
Contribute to the build our own in-house AI Agents
Qualification
Required
5+ years of experience working with high-performance backend systems
Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages
Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies
Previous work building and operating highly complex SaaS platforms/systems
Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc
Preferred
Experience with distributed stream processing - Kafka, Gazette, or similar
Experience with OLAP systems
Familiarity with system observability tooling like Prometheus
Working knowledge of Machine Learning and/or Data Science
First-hand experience working with large language models (LLMs) or developing AI products
Benefits
Medical
Dental
Vision
A 401(k) plan
Unlimited paid time off
A generous parental leave plan
Additional support for mental health and wellness
A WFH monthly stipend to pay for co-working spaces
Company
Arize AI
Arize is an AI engineering platform focused on evaluation and observability. It helps engineers develop, evaluate, and observe AI agents.
51-200 employees
H1B Sponsorship
Arize AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)
Funding
Current Stage
Growth StageTotal Funding
$131.02MKey Investors
Adams Street PartnersTCVBattery Ventures
2025-02-20Series C· $70M
2022-09-07Series B· $38M
2021-09-28Series A· $19M
Leadership Team
Jason Lopatecki
Founder - CEO
Recent News
Foundation Capital
2026-01-02
2025-12-10
varinsights.com
2025-12-03
Company data provided by crunchbase