This job was posted by https://illinoisjoblink.illinois.gov : For more information, please see: https://illinoisjoblink.illinois.gov/jobs/12481105 College Board - Learning and Assessment - Psychometrics

100% Remote (anticipated 25% travel, usually 2-3 days at a time)

About the Team

The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. We provide our partners with measurement solutions that set the standard for quality, efficiency, and innovation through operational excellence and research leadership that advances the field of Psychometrics and supports College Board\'s mission of access and equity in education.We are a 25+ person core team of Psychometricians and Research Statisticians that collaborate deeply with other departments and divisions including, but not limited to Assessment Design & Development, College Readiness Assessments, Advanced Placement & Instruction, State & District Partnerships, and Technology.

About the Opportunity

As our Vice President, Psychometrics, you are energized by our mission to enhance educational and career opportunities for millions of students. You bring innovative thinking and strong leadership skills, with a deep understanding of educational assessments and measurement. As a change agent, you are excited to develop new assessment analytic solutions in response to the evolving education landscape. You excel at leading teams, whether they report directly to you or are part of cross-functional groups. You will champion the advancement of psychometrics and measurement solutions through strategic planning, effective communications, and exceptional team leadership. You will serve as a national expert to ensure the influence and validity of College Board assessments in the field.

In this role, you will:

Measurement Leadership (50%)

• Provide strategic oversight of operational and quality management across assessment programs, including the SAT Suite of Assessments, AP, Pre-AP, ACCUPLACER, and CLEP, to ensure timely and accurate psychometric analyses
• Obtain institutional support for psychometric suggestions and recommendations and proactively address obstacles to ensure seamless operational execution
• Set an internal psychometric research agenda to advance our research-based approach to digital testing and leverage advances in analytics including Artificial Intelligence (AI)
• Champion novel psychometric solutions for the design and implementation of current and new digital assessments to enhance the reach and relevance of our assessment programs
• Communicate key psychometric analysis, insights and recommendations to a wide range of internal stakeholders, including the CEO, President, and SVP Learning & Assessment, in user-friendly formats

Team Leadership and Management (30%)

• Lead and inspire a team to enhance culture and engagement, fostering a highly motivated and cohesive unit through strategic vision, effective communication, and innovative engagement initiatives
• Manage a team of 4 senior leaders to prioritize work and achieve goals
• Ensure the highest levels of staff productivity, effectiveness, and engagementwithin a motivated and creative team
• Collaborate with divisional leaders to drive the SVP\'s vision and goals
• Manage the Psychometrics\' budget of \$4.5M

Collaboration and Communications (20%)

• Represent the quality and credibility of our assessment programs within the measurement community and with educators, states, policymakers, and the press
• Review technical and research reports involving psychometric analyses, test validity and reliability, mode comparability, and other areas relevant to Coll ge Board assessments
• Collaborate with other College Board divisions on new products and enhancements that support increasing the reach and relevance of the College Board suite of assessments and other offerings

About You

You have:

10+ years\' experience in a management or leadership role, with demonstrated success managing through layers

Demonstrated senior level experience in an educational research or assessment organization

Advanced knowledge and/or experience with digital assessments, and with item response theory (IRT) and other psychometric models

Demonstrated expertise leveraging advanced technologies (e.g., ML, GenAI, and LLMs) for evaluating open-ended/free-response answers and developing psychometric applications to enhance assessment accuracy, analytic efficiency, and scalability, is preferred

Proven ability to establish a clear vision and direction, and effectively manage teams to achieve aligned goals and performance metrics

Adept problem-solving and data analysis skills to interpret complex data sets and translate them into clear, actionable insights

Excellent verbal and written communication skills, with experience facilitating meetings and