AppLab Systems, Inc · 1 day ago
AI Evals Engineers – W2 contract Only
Austin, TX
Contract
Onsite
Mid, Senior LevelAppLab Systems, Inc is seeking AI Evals Engineers for a W2 contract position in Austin, TX. The role involves designing and building agentic workflows and evaluating the performance of autonomous AI agents.
Big DataBlockchainInformation TechnologySoftware
Hiring Manager
Mohit Mittal
Responsibilities
Design, build, and ship agentic workflows across various domains, including research agents and workflow automation agents
Architect systems using modern agent stacks and build robust retrieval pipelines for effective agent functionality
Deploy agents as microservices with proper observability and systematic evaluations to ensure performance and reliability
Work closely with product managers and domain experts to translate business workflows into agent behaviors and create reusable frameworks
Design adversarial tests and red team protocols to assess the performance and safety of autonomous AI agents
Qualification
Required
Agentic Systems
Gen AI System Evaluations
Generative AI Systems
Human Annotations
LLM Response Evaluation
Python
RAG Systems
Experience with Docker
Experience with Linux environments
Strong technical background
Deep understanding of agentic systems and their evaluation methodologies
Company
AppLab Systems, Inc
AppLab Systems has a strong reputation as a Recruitment, Staffing, Healthcare and information technology consulting company.
Founded in 2006
201-500 employees
H1B Sponsorship
AppLab Systems, Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2022 (5)
2021 (38)
2020 (7)
Funding
Current Stage
Growth StageLeadership Team
Tanuj Vashishta
Client Services Partner
Company data provided by crunchbase