Back to jobs

Senior Research Manager, AI Evaluation Science

Apple · Seattle, United States of America

Spotted 2d ago

Job details

Level
Senior
Experience
5+ years
Education
PhD
Posted
Nov 16, 2026
Last confirmed open
Nov 17, 2026

What you'll need to apply

What this employer's standard application typically asks

NameEmailPhoneLocationResumeWork authorization answer

Company-specific questions

  • Have you previously worked at Apple?
Job description

About this role

AI systems are only as trustworthy as the methods used to evaluate them. At Apple, where AI powers experiences for billions of people, getting evaluation right is not a support function. It is a foundational science.

As these systems grow in complexity, the quality of our products is increasingly constrained by the quality of our evaluation methods. Our team is building the scientific foundation and self-service tools for how AI evaluation is done at scale, spanning LLMs, agentic systems, and human-AI interaction.

Our goal is evidence that teams can act on: what to measure, whether a change helped, why a system failed, and whether it is ready to ship. We don’t just publish methods; we productionize them. We are looking for a Sr.

Research Manager to lead an interdisciplinary research team that advances the state-of-the-art in evaluation methods that can be shipped as production tools for Apple developers and published in top venues.

We are looking for a Sr. Research Manager to lead an interdisciplinary research team advancing the frontier of evaluation methods. The team works in close collaboration with applied scientists and measurement scientists to build evaluation methodology and systems that are human-centered, psychometrically rigorous, and technically frontier.

You will set the research agenda, direct the team's portfolio across near-term and long-term bets, and ensure that novel methods are designed from the outset for productionization into evaluation SDKs and APIs. You will have a strong background in ML or a closely related quantitative field and a track record of leading research teams that publish at top venues while simultaneously shipping methods into production tools.

What makes this team unusual is its interdisciplinary core. You will lead ML researchers, measurement scientists, and applied scientists, bringing together frontier ML research, psychometric and statistical rigor, and production engineering. What unites the strongest candidates is depth of thinking about evaluation as a research problem and the conviction that how we measure AI systems is as important as how we build them.

Ph.D. in Computer Science, Machine Learning, Statistics, or a closely related field 5+ years of experience managing or leading research teams in an industry setting, with demonstrated ability to attract and retain strong research talent Experience publishing research at top-tier AI/ML venues (NeurIPS, ICML, ICLR, ACL, EMNLP) or comparable venues in statistics or measurement Experience partnering with applied science and engineering teams to translate research into production systems, tools, or capabilities adopted by others Technical depth in AI evaluation, with the ability to critically assess and advance methods for measuring AI system behavior, whether through automated judgment, benchmark design, synthetic data, human evaluation, experimentation, failure analysis, or other approaches Demonstrated ability to set research strategy, manage a research portfolio with competing priorities, and make disciplined investment decisions across near-term and long-term work Excellent communication skills, including the ability to represent research to executive leadership, partner teams, and the external research community

Ability to bridge ML research and measurement science.

This could mean a machine learning background with genuine familiarity with validity and evaluation design, or a measurement science background with strong technical depth in ML methods Publications or demonstrated expertise specifically in evaluation methodology (papers about how to evaluate, not just papers that use evaluation) Demonstrated ability to coach researchers toward higher-impact publications: improving framing, identifying contribution clarity issues, and helping position work for acceptance at top-tier venues Strong opinions about how evaluation methods should be implemented in user-facing tools: what defaults, abstractions, and guardrails make the difference between a generic SDK and a world-class evaluation platform Experience designing research with self-service adoption as a first-class constraint, where the end goal is not a bespoke system your team operates but a method or tool that others can apply correctly without deep knowledge of the underlying research Track record of personally recruiting research talent in competitive hiring markets, including sourcing candidates who would not have applied through standard channels Experience with experimentation and causal analysis, such as A/B testing or tracing failures in complex systems to their causes Experience building a new team from a small core, including shaping its charter and hiring plan

Interested in this role?Continue on Apple's careers page.
Apply on Apple