AIML - Sr Applied AI Scientist - GenAI Model Autograding, Evaluation jobs in United States
info-icon
This job has closed.
company-logo

Apple · 11 hours ago

AIML - Sr Applied AI Scientist - GenAI Model Autograding, Evaluation

Apple is seeking a highly innovative and passionate Applied AI Scientist to enhance the evaluation of various AI products. In this role, you will design and advance autograder systems for quality assessment of AI products, applying your expertise in prompt engineering and foundation model adaptation.

AppsArtificial Intelligence (AI)BroadcastingDigital EntertainmentFoundational AIMedia and EntertainmentMobile DevicesOperating SystemsTVWearables
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Design and advance state-of-the-art autograder systems that evaluate various AI product quality at scale
Apply deep expertise in prompt engineering, foundation model adaptation, and evaluation methodology to build robust, trustworthy, and extensible autograders that assess product performance, user experience, and adherence to quality and safety standards
Collaborate with product, annotation, evaluation data scientists, and autograder tooling engineers to deploy the state-of-the-art autograders

Qualification

GenAI modelsPrompt engineeringLLMOps processesAI model evaluationHuman-in-the-loop workflowsAnalytical skillsImage quality evaluationOwnership mindset

Required

Extensive experience with prompting techniques
Deep understanding of GenAI models and 1+ year of industry experience in building or evaluation GenAI models
Familiarity with LLMOps processes for deploying, monitoring and hillclimbing AI models in production environments
Excellent analytical skills and judgement, capable of assessing data quality, diagnosing autograder limitations or biases, synthesizing findings into actionable insights, and communicating them clearly across teams
Ownership mindset with the flexibility to take on whatever tasks—including annotation or operational work—are necessary to deliver results

Preferred

Experience in developing AI models specifically for quality assessment or automated feedback generation
Familiarity with human annotation operations, sampling strategies, or subjective judgment evaluation
Experience in designing human-in-the-loop evaluation workflows
Familiar with image quality evaluation
Demonstrated passion for leveraging AI to improve work efficiency and scale

Benefits

Comprehensive medical and dental coverage
Retirement benefits
A range of discounted products and free services
Reimbursement for certain educational expenses — including tuition
Discretionary bonuses or commission payments
Relocation

Company

Apple is a technology company that designs, manufactures, and markets consumer electronics, personal computers, and software.

H1B Sponsorship

Apple has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6998)
2024 (3766)
2023 (3939)
2022 (4822)
2021 (4060)
2020 (3656)

Funding

Current Stage
Public Company
Total Funding
$5.67B
Key Investors
Berkshire HathawayMicrosoftSequoia Capital
2025-05-05Post Ipo Debt· $4.5B
2025-01-16Post Ipo Debt· $0.31M
2021-04-30Post Ipo Equity

Leadership Team

leader-logo
Tim Cook
CEO
leader-logo
Craig Federighi
SVP, Software Engineering
Company data provided by crunchbase