Apple · 5 days ago
AIML - Data Scientist, Evaluation
Cupertino, CA
Full-time
Onsite
Senior Level
$147K/yr - $272K/yr
5+ years expApple is seeking a Data Scientist in the AIML Evaluation organization to drive product impact through measurement and evaluation. This role involves developing evaluation methods, working with large data sets, and collaborating with engineering teams to enhance product quality and user experience.
AppsArtificial Intelligence (AI)BroadcastingDigital EntertainmentFoundational AIMedia and EntertainmentMobile DevicesOperating SystemsTVWearables
Responsibilities
Design and Own End-to-End Evaluation Frameworks: Develop rigorous evaluation methodologies for AI/ML systems, including metric definition, sampling strategy, experiment design, and statistical validity checks. Build scalable pipelines that ensure trustworthy, reproducible, and interpretable results across product surfaces and model iterations
Build High-Quality Evaluation Datasets & Human-in-the-Loop Systems: Create and maintain gold-standard datasets for offline and online model assessment. Lead data generation and annotation workflows (e.g., human ratings, Red Teaming, preference data, domain-specific evals), ensuring coverage, data quality, bias mitigation, and alignment with product and safety goals
Partner Cross-Functionally to Drive Model & Product Decision-Making: Translate evaluation insights into actionable recommendations for model training, ranking, and product launches. Collaborate closely with Research, Engineering, Product, and Safety teams to define quality bars, monitor regressions, optimize user experience, and guide roadmap prioritization
Qualification
Required
Experience in data science, machine learning, and analytics, including statistical data analysis and A/B testing
Experience articulating and translating business questions and using statistical techniques to arrive at an answer using available data
Strong programming skills, including data-querying skills (SQL and/or Spark, etc.) and experience with a scripting language for data processing and development (e.g., Python, R, or Scala)
Excellent collaboration skills to achieve impactful results by working effectively with diverse cross-functional teams, including PMs, engineers, data scientists, and others
B.S. in Machine Learning, Computer Science, Statistics, Operations Research or other quantitative fields
Preferred
Applicants have a good understanding of large language model (LLMs), including their architecture, training methods, prompt engineering and fine-tuning for specific tasks
Hands-on experience in applying LLMs to solve technical problems, such as data analysis, data automation, synthetic data generation, with proven ability to optimize model performance for accuracy and efficiency
Ph.D. in machine learning, computer science, statistics, operations research or other quantitative fields
5 years of relevant work experience
Benefits
Comprehensive medical and dental coverage
Retirement benefits
A range of discounted products and free services
Reimbursement for certain educational expenses — including tuition
Discretionary bonuses or commission payments
Relocation
Company
Apple
Apple is a technology company that designs, manufactures, and markets consumer electronics, personal computers, and software.
10001+ employees
H1B Sponsorship
Apple has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6998)
2024 (3766)
2023 (3939)
2022 (4822)
2021 (4060)
2020 (3656)
Funding
Current Stage
Public CompanyTotal Funding
$5.67BKey Investors
Berkshire HathawayMicrosoftSequoia Capital
2025-05-05Post Ipo Debt· $4.5B
2025-01-16Post Ipo Debt· $0.31M
2021-04-30Post Ipo Equity
Leadership Team
Tim Cook
CEO
Craig Federighi
SVP, Software Engineering
Recent News
Venrock
2025-12-01
2025-09-25
Mac Daily News
2025-09-25
Company data provided by crunchbase