Keystone Recruitment · 19 hours ago
Data Analyst I
Menlo Park, CA
Full-time
Onsite
New Grad, Entry Level
$70/hr - $85/hrKeystone Recruitment is seeking a detail-oriented Data Analyst I to support large-scale data curation and evaluation initiatives for advanced generative AI systems. This role focuses on improving model quality and involves managing data labeling workflows, maintaining data pipelines, and analyzing model outputs.
Staffing & Recruiting
Responsibilities
Manage end-to-end data labeling workflows
Enqueue datasets for labeling and maintain labeling interfaces
Extract structured labels for modeling teams
Manually annotate training data when required
Audit and correct human-labeled data
Maintain and optimize large-scale data processing pipelines (billions of images)
Support data sourcing and content understanding using ML models
Leverage LLMs to clean, annotate, and evaluate data
Assist in building efficient ETL workflows
Maintain dataset portfolio with proper access controls
Ensure compliance with data retention and privacy standards
Support governance and documentation practices
Identify model quality gaps using structured evaluation protocols
Collaborate with engineers to summarize findings and recommend improvements
Mine and prepare new datasets for iterative model training
Scale validated evaluation frameworks across product teams
Qualification
Required
Associate's degree or equivalent training in Computer Science, Engineering, Physics, Bioinformatics, or other STEM field
Basic knowledge of Python and SQL
Foundational understanding of computer vision and generative AI models
Experience with data ETL workflows or pipelines
Familiarity using LLMs for data labeling or evaluation tasks
Strong attention to detail and analytical thinking
Preferred
Prior industry experience in software development, QA, or research
Exposure to human-computer interaction or ML evaluation work
Experience working in large-scale technology environments
Strong written and verbal communication skills
Company
Keystone Recruitment
Great companies are built on strong people. At Keystone Recruitment, we identify the pivotal talent that holds your organisation together.
11-50 employeesFunding
Current Stage
Early StageCompany data provided by crunchbase