US Tech Solutions · 3 months ago
Human Evaluation & Content Quality Vendor Operations Manager
Mountain View, CA
Full-time
Hybrid
Senior Level
$89/hr - $104/hr
7+ years expUS Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. The Human Evaluation & Content Quality Vendor Operations Manager will play a key role in scaling and optimizing the global human evaluation ecosystem, partnering with cross-functional teams and vendor partners to enhance data quality and streamline evaluation workflows.
Information Technology
Responsibilities
Drive Quality Improvements
Partner with global vendors to design and implement strategies that raise quality scores across human evaluation workflows
Conduct root-cause analysis to uncover quality drivers and pilot innovative methodologies that go beyond traditional training approaches
Hold vendors accountable for sustained performance improvement through structured governance and ongoing enablement
Support Rating & Calibration Programs
Collaborate with the Rater Operations and Human Evaluation teams to organize and maintain rating question taxonomies and calibration materials
Lead or support calibration discussions with vendors to ensure consistent interpretation of rating guidelines and alignment with evolving model evaluation criteria
Facilitate feedback loops that enhance evaluator understanding and maintain output consistency across vendor sites
Optimize Capacity Management
Monitor and analyze vendor performance metrics to proactively identify bottlenecks and inefficiencies
Work with vendors to optimize rater availability and scheduling, ensuring adequate coverage for business needs while maintaining throughput and quality
Partner with internal teams on forecasting, backlog reduction, and operational readiness initiatives
Performance Management & Reporting
Track and report on key vendor KPIs (quality, timeliness, utilization, throughput)
Analyze performance data to identify trends, highlight improvement areas, and communicate insights to internal stakeholders
Contribute to quarterly business reviews and strategic planning with vendor partners
Qualification
Required
7+ years of experience in Vendor Operations, Business Operations, or Program Management, ideally within a tech, AI, or content evaluation environment
Proven success managing and improving performance across multiple vendor partners
Strong analytical and problem-solving skills, with experience using data to drive operational decisions
Excellent communication and negotiation skills, with the ability to influence external partners and cross-functional stakeholders
Highly organized with a proactive approach to issue identification and resolution
Bachelor's degree
Company
US Tech Solutions
US Tech Solutions counted among the largest yet the fastest growing staffing firm; all achieved organically.
1001-5000 employees
H1B Sponsorship
US Tech Solutions has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (4)
2024 (9)
2023 (13)
2022 (24)
2021 (18)
2020 (14)
Funding
Current Stage
Late StageLeadership Team
Manoj Agarwal
Chief Executive Officer
Recent News
Kelly Services, Inc.
2025-05-17
GlobeNewswire News Room
2024-12-13
Company data provided by crunchbase