Crossing Hurdles ยท 3 days ago
English Language Quality Analyst | $18.14/hr | Remote
Crossing Hurdles is seeking an English Language Quality Analyst to evaluate LLM-generated responses for accuracy and relevance. The role involves conducting fact-checking, generating feedback, and ensuring AI outputs align with expected standards.
Staffing & Recruiting
Responsibilities
Evaluate LLM-generated responses for accuracy, relevance, and usefulness across diverse topics
Conduct fact-checking using trusted public sources and external tools
Generate high-quality human feedback by annotating strengths, weaknesses, and factual errors in model responses
Assess reasoning quality, clarity, tone, and completeness of AI outputs
Ensure responses align with expected conversational behavior and system guidelines
Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks
Qualification
Required
Bachelor's degree completed
Native-level or near-native fluency in Spanish (ILR 5 / CEFR C2) and strong English proficiency
Demonstrated experience using large language models and understanding real-world LLM use cases
Excellent writing skills with the ability to provide clear, nuanced feedback
Strong attention to detail and analytical thinking skills
Ability to work across multiple topics, domains, and evaluation criteria
Background in structured analytical domains such as research, policy, analytics, linguistics, or engineering
Strong college-level mathematics skills
Company
Crossing Hurdles
At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals.
Funding
Current Stage
Early StageCompany data provided by crunchbase