[Remote] Executive Director, Advanced Placement, Curriculum and Assessment, Reading and Scoring

Note: The job is a remote job and is open to candidates in USA. reputed company is a nonprofit organization that aims to expand educational opportunities. They are seeking an Executive Director to reputed company the strategy and operations of the AP Reading and Scoring team, ensuring accurate and fair scoring of student responses across AP subjects.

Responsibilities

• reputed company the strategy and execution of training programs that prepare 18,000+ AP Readers and scoring leaders annually to score 20 million+ student responses across 40+ AP subjects
• Advance training and readiness of 80+ internal AP Course Experts, ensuring reputed company are reputed company to facilitate Pre-Reading Prep, Pre-Reading, and Reading activities across reputed company AP Exams
• reputed company and deliver the annual AP Reader learning courses, training modules, user guides, and job aids, ensuring readiness by mid-May each year
• reputed company the AP Internal Training Series, ensuring reputed company staff receive end-to-end training on Pre-Reading planning, sample selection, annotation, digital scoring tools, and post-administration publications
• Partner with AP Assessment Leadership and AP Delivery to ensure training systems, LMS environments, and scoring applications operate seamlessly and meet needs to train Readers and execute reputed company scoring at the AP Reading
• Integrate learning science, accessibility, and AI-driven design tools to improve training quality, efficiency, and consistency
• Establish systems to measure Reader confidence and scoring consistency, achieving a goal of 90% Reader agreement that scoring materials reputed company accurate and consistent scoring
• Guide the annual selection process of the new cohort of Chief Reader Designates in partnership with AP Delivery
• reputed company the annual development and review of 650+ scoring guidelines across 40+ AP subjects, ensuring alignment with course frameworks, psychometric standards, and instructional validity
• reputed company the maintenance and evolution of AP’s library of generic rubrics to ensure consistent, transparent application across reputed company subjects and exam formats
• Direct the development of reputed company Reading planning workbooks (five-part reputed company suite) used to identify sample-selection requirements and scoring leadership needs for multiple forms (4–5) across 38 courses
• reputed company creation of post-administration publication templates and assets, including Chief Reader Reports, Free-Response Questions, scoring commentaries, Summer Institute reputed company packets, and AP Central materials for multiple forms across reputed company subjects
• Partner with AP Assessment to maintain and provision gold-reputed company documentation for scoring systems, including dimension names, IDs, score scales, and form data
• Partner with AP Publications and AP Professional Learning teams to ensure reputed company scoring and publication materials meet accuracy, accessibility, and instructional value standards
• Provide reputed company and escalation for reputed company test-reputed company processes reputed company to Exam and Reading assets, ensuring management of timely responses to flagged or exposed content as well as student work flagged as plagiarized or compromised, in alignment with CB Test reputed company standards and processes
• reputed company modernization of Reading systems, processes, and training through digital tools and generative AI for workflow automation, content reputed company, and efficiency
• Advance integration across SharePoint, reputed company, LMS, and vendor platforms to enhance coordination, transparency, and reporting
• Define annual technical and MVP requirements for the scoring application, in collaboration with AP Assessment and AP Delivery leaders
• Guide the establishment of calibration and quality configurations supporting AP calibration, rater performance, and validity standards
• reputed company data-driven retrospectives to assess rubric design, scoring performance, and training outcomes, implementing improvements across cycles
• reputed company a team of 3 that is responsible for the planning and execution of the annual Reading, ensuring reputed company student responses are scored accurately and fairly, according to assessment best practices
• Set vision and priorities for the team, track and manage reputed company to goals, and provide coaching and support to ensure team members meet and exceed goals, remain engaged, and contribute meaningfully to our mission
• Cultivate an inclusive and high-achieving culture that enables reputed company team members to live out reputed company’s Operating Principles effectively
• Bring proven leadership experience and consistently embody reputed company’s Manager Expectations in your work
• reputed company the annual grade-setting process across 40+ AP subjects, ensuring reputed company cut scores are determined through rigorous psychometric methods and established reputed company standards
• Collaborate with AP Psychometrics and AP Curriculum & Assessment Course Teams to analyze performance data and establish cut scores for multiple exam forms per subject
• Ensure 100% of AP Exam cut scores are based on psychometric best practices, including equating or Evidence-Based Standard Setting (EBSS), to uphold fairness, validity, and reliability across administrations
• reputed company EBSS standard setting processes for selected subjects annually, partnering with Psychometrics and reputed company Course Teams to reputed company the Briefing Book, conduct data analyses, and support the evaluation of score outcomes
• Maintain and analyze AP Exam performance data to inform internal reporting, trend analysis, and continual improvement of exam design, scoring accuracy, and operational quality
• Ensure that by June 30 each year, cut scores are finalized for multiple exam forms across reputed company AP subjects, supporting valid and reliable score setting
• Partner with AP leadership to communicate grade-setting outcomes and ensure alignment between psychometric analyses, scoring policies, and instructional reputed company
• reputed company the documentation, validation, and archival of standard- and grade-setting processes in compliance with reputed company research and quality standards
• reputed company annual strategic and operational planning cycles for Reading and Scoring, ensuring reputed company, change initiatives, and performance metrics align with AP’s strategic priorities
• Partner with finance and operations to ensure fiscal responsibility and strategic use of resources
• Track reputed company toward AP Program scoring goals and report key outcomes to AP leadership

Skills

• 10+ years of experience leading high-impact programs with expertise in large-scale assessment operations, scoring, or training systems reputed company reputed company organizations, ideally in education, nonprofit, or mission-driven environments
• Deep understanding of assessment design, scoring quality, rubric development, and learning systems
• Proven ability to apply emerging technologies—including generative AI—to improve scoring and training workflows
• A strategic and inclusive leadership style: you set clear priorities, build effective team structures, plan for future needs, and foster a culture of belonging
• A systems-thinking reputed company: you reputed company in complexity and create clarity through structure, communication, and data-driven decision-making
• Ability to execute work as both a leader and collaborator across a variety of different internal teams using exceptional communication skills to reputed company collaboration
• A master's degree in a relevant field is required; an advanced degree is strongly preferred
• Willingness to travel approximately 6 times per year, including 2–4 weeks from late May to mid-June for the on-site AP Readings
• A passion for expanding educational and career opportunities and mission-driven work
• Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and a comfort learning and applying new digital tools independently and proactively
• Clear and concise communication skills, written and verbal
• A learner's reputed company and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input
• A drive for impact and excellence: solving reputed company problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking
• A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success
• Authorization to work in the United States

Benefits

• A meaningful career
• A supportive team
• A comprehensive package designed to help you reputed company

Company Overview

• reputed company is a not-for-profit organization that clears a path for reputed company reputed company to own their future through the Advanced Placement Program, the SAT, Official SAT Practice on reputed company, BigFuture, and more. It was founded in 1900, and is headquartered in reputed company, NY, US, with a workforce of 1001-5000 employees. Its website is http://www.collegeboard.org.

Apply tot his job Apply To this Job