AllSpice.io · 1 day ago
Data & LLM Systems Engineer
Boston
Full-time
Hybrid
Mid, Senior LevelAllSpice is building the automation engine for the next generation of circuit design, focusing on hardware development. The Data & LLM Systems Engineer will design, build, and operate systems that integrate hardware design with data and large language models, ensuring data reliability and performance while collaborating with various teams.
Enterprise SoftwareSoftwareCollaboration
Responsibilities
Design, build, and maintain data pipelines for ingesting, cleaning, transforming, and storing data
Define and evolve data schemas that support analytics, applications, and LLM workflows
Work with relational databases, analytical data stores, and vector databases
Ensure data reliability, performance, and cost efficiency
Implement best practices around data versioning, lineage, and access control
Build backend services and APIs that expose data to internal tools and user-facing applications
Develop applications and internal tooling for managing datasets, experiments, prompts, and configurations
Collaborate with product and design to ensure tools are usable, safe, and scalable
Support both real-time and batch processing workflows
Design systems that track prompt versions, context construction, and model configurations
Instrument LLM interactions to capture inputs, outputs, metadata, latency, and cost
Help establish standards for monitoring, debugging, and evaluating LLM behavior in production
Analyze LLM outputs and user interactions to identify failure modes, drift, and quality issues and help ensure overall reliability and consistency
Define and track metrics related to response quality, task success, and user outcomes
Run comparisons between model versions, prompt changes, or system configurations
Communicate findings clearly to engineering, product, and leadership stakeholders using
Work closely with other engineers, product, and other stakeholders
Take end-to-end ownership of systems from design through production and iteration
Qualification
Required
Strong experience building backend systems and APIs
Solid understanding of data modeling, databases, and data pipelines
Experience analyzing applications that leverage LLMs (e.g., OpenAI, Anthropic, open-source models) in production systems
Comfort analyzing data and drawing actionable conclusions
Ability to reason about system performance, reliability, and cost
Preferred
Experience with vector databases and semantic search
Familiarity with analytics warehouses (e.g., BigQuery, Snowflake, Redshift)
Experience with LLM observability, evaluation frameworks, or experimentation platforms
Background working on internal developer tools or data platforms
Exposure to privacy, security, or governance considerations in data systems
Benefits
Supportive and smart colleagues
Flexible work
Opportunity to make a big impact
Competitive salary & equity
Health
Dental
Vision
Generous PTO
Home office stipend
Company
AllSpice.io
AllSpice.io is a platform built for hardware teams, enabling engineers to manage, review, and collaborate on designs more effectively.
Founded in 2020
11-50 employees
H1B Sponsorship
AllSpice.io has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Early StageTotal Funding
$25.28MKey Investors
Rethink ImpactXFactor Ventures
2025-06-23Series A· $15M
2023-07-14Series Unknown· $6M
2021-12-08Seed· $3.78M
Leadership Team
Valentina Ratner
Co-founder and CEO
Kyle Dumont
CTO & Co-founder
Recent News
2025-07-22
thesaasnews.com
2025-07-04
Company data provided by crunchbase