Apply on Employer Site

The College Board · 1 day ago

Executive Director, Advanced Placement, Curriculum and Assessment, Reading and Scoring

United States

Full-time

Remote

Director/Executive

$144K/yr - $215K/yr

10+ years exp

College Board is a mission-driven, not-for-profit organization dedicated to excellence in education. The Executive Director will lead the strategy, systems, and professional learning infrastructure for the AP Reading, ensuring scoring excellence and validity across 40+ AP subjects.

Education Management

Responsibilities

Lead the strategy and execution of training programs that prepare 18,000+ AP Readers and scoring leaders annually to score 20 million+ student responses across 40+ AP subjects

Advance training and readiness of 80+ internal AP Course Experts, ensuring all are prepared to facilitate Pre-Reading Prep, Pre-Reading, and Reading activities across all AP Exams

Develop and deliver the annual AP Reader learning courses, training modules, user guides, and job aids, ensuring readiness by mid-May each year

Lead the AP Internal Training Series, ensuring C&A staff receive end-to-end training on Pre-Reading planning, sample selection, annotation, digital scoring tools, and post-administration publications

Partner with AP Assessment Leadership and AP Delivery to ensure training systems, LMS environments, and scoring applications operate seamlessly and meet needs to train Readers and execute all scoring at the AP Reading

Integrate learning science, accessibility, and AI-driven design tools to improve training quality, efficiency, and consistency

Establish systems to measure Reader confidence and scoring consistency, achieving a goal of 90% Reader agreement that scoring materials enable accurate and consistent scoring

Guide the annual selection process of the new cohort of Chief Reader Designates in partnership with AP Delivery

Lead the annual development and review of 650+ scoring guidelines across 40+ AP subjects, ensuring alignment with course frameworks, psychometric standards, and instructional validity

Lead the maintenance and evolution of AP’s library of generic rubrics to ensure consistent, transparent application across all subjects and exam formats

Direct the development of all Reading planning workbooks (five-part Smartsheet suite) used to identify sample-selection requirements and scoring leadership needs for multiple forms (4–5) across 38 courses

Lead creation of post-administration publication templates and assets, including Chief Reader Reports, Free-Response Questions, scoring commentaries, Summer Institute workshop packets, and AP Central materials for multiple forms across all subjects

Partner with AP Assessment to maintain and provision gold-source documentation for scoring systems, including dimension names, IDs, score scales, and form data

Partner with AP Publications and AP Professional Learning teams to ensure all scoring and publication materials meet accuracy, accessibility, and instructional value standards

Provide oversight and escalation for all test-security processes related to Exam and Reading assets, ensuring management of timely responses to flagged or exposed content as well as student work flagged as plagiarized or compromised, in alignment with CB Test Security standards and processes

Lead modernization of Reading systems, processes, and training through digital tools and generative AI for workflow automation, content generation, and efficiency

Advance integration across SharePoint, Smartsheet, LMS, and vendor platforms to enhance coordination, transparency, and reporting

Define annual technical and MVP requirements for the scoring application, in collaboration with AP Assessment and AP Delivery leaders

Guide the establishment of calibration and quality configurations supporting AP calibration, rater performance, and validity standards

Lead data-driven retrospectives to assess rubric design, scoring performance, and training outcomes, implementing improvements across cycles

Lead a team of 3 that is responsible for the planning and execution of the annual Reading, ensuring all student responses are scored accurately and fairly, according to assessment best practices

Set vision and priorities for the team, track and manage progress to goals, and provide coaching and support to ensure team members meet and exceed goals, remain engaged, and contribute meaningfully to our mission

Cultivate an inclusive and high-achieving culture that enables all team members to live out College Board’s Operating Principles effectively

Lead the annual grade-setting process across 40+ AP subjects, ensuring all cut scores are determined through rigorous psychometric methods and established College Board standards

Collaborate with AP Psychometrics and AP Curriculum & Assessment Course Teams to analyze performance data and establish cut scores for multiple exam forms per subject

Ensure 100% of AP Exam cut scores are based on psychometric best practices, including equating or Evidence-Based Standard Setting (EBSS), to uphold fairness, validity, and reliability across administrations

Lead EBSS standard setting processes for selected subjects annually, partnering with Psychometrics and C&A Course Teams to develop the Briefing Book, conduct data analyses, and support the evaluation of score outcomes

Maintain and analyze AP Exam performance data to inform internal reporting, trend analysis, and continual improvement of exam design, scoring accuracy, and operational quality

Ensure that by June 30 each year, cut scores are finalized for multiple exam forms across all AP subjects, supporting valid and reliable score setting

Partner with AP leadership to communicate grade-setting outcomes and ensure alignment between psychometric analyses, scoring policies, and instructional intent

Lead the documentation, validation, and archival of standard- and grade-setting processes in compliance with College Board research and quality standards

Lead annual strategic and operational planning cycles for Reading and Scoring, ensuring capacity, change initiatives, and performance metrics align with AP’s strategic priorities

Partner with finance and operations to ensure fiscal responsibility and strategic use of resources

Track progress toward AP Program scoring goals and report key outcomes to AP leadership

Qualification

Large-scale assessment operationsScoring qualityRubric developmentTraining systemsGenerative AIStrategic planningData-driven decision-makingCuriosity for emerging technologiesCommunication skillsLeadership experienceCollaborationCommitment to growth

Required

10+ years of experience leading high-impact programs with expertise in large-scale assessment operations, scoring, or training systems within complex organizations, ideally in education, nonprofit, or mission-driven environments

Deep understanding of assessment design, scoring quality, rubric development, and learning systems

Proven ability to apply emerging technologies—including generative AI—to improve scoring and training workflows

A strategic and inclusive leadership style: you set clear priorities, build effective team structures, plan for future needs, and foster a culture of belonging

A systems-thinking mindset: you thrive in complexity and create clarity through structure, communication, and data-driven decision-making

Ability to execute work as both a leader and collaborator across a variety of different internal teams using exceptional communication skills to inspire collaboration

A master's degree in a relevant field is required; an advanced degree is strongly preferred

Willingness to travel approximately 6 times per year, including 2–4 weeks from late May to mid-June for the on-site AP Readings

A passion for expanding educational and career opportunities and mission-driven work

Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and a comfort learning and applying new digital tools independently and proactively

Clear and concise communication skills, written and verbal

A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input

A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking

A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success

Authorization to work in the United States

Benefits

Annual bonuses and opportunities for merit-based raises and promotions

A mission-driven workplace where your impact matters

A team that invests in your development and success

Company

The College Board

Glassdoor3.7

College Board is a not-for-profit organization that clears a path for all students to own their future through the Advanced Placement Program, the SAT, Official SAT Practice on Khan Academy, BigFuture, and more.

Founded in 1900

New York, NY, US

1001-5000 employees