College Board
Senior Assessment Specialist, ELA/Literacy
Edtech.com's Summary
- Conduct expert-level SAT Essay scoring and verify machine-generated scores for accuracy.
- Train to mastery on SAT Essay and ACCUPLACER/ACCUPLACER ESL scoring and content development.
- Participate in calibration activities and maintain scoring agreement rates that meet program targets.
- Monitor scoring patterns and provide feedback to Psychometrics and Scoring Leadership.
- Develop and review items aligned with CEFR, NRS ESL Benchmarks, TWC Benchmarks, and CCSS Anchor Standards.
- Support development of study materials and instructional videos for ACCUPLACER Essay Tests.
- Engage in research for federal NRS submission requirements and contribute to documentation for ACCUPLACER ESL federal approval.
- Require a master’s degree in English, English education, writing, or related field and four to six years of experience in large-scale writing assessment.
- Demonstrate strong communication, collaboration, organizational, and computer skills, including proficiency in Microsoft Office and scoring technologies.
- Compensation ranges from $68,000 to $100,000 depending on location and experience, with national travel required 6-10 times per year.
Senior Assessment Specialist, ELA/Literacy Full Description
Senior Assessment Specialist, ELA/Literacy
College Board - Learning and Assessment
Location: This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office).
Type: This is a full-time term position that will last for 2 years from the start date.
About the Team
As a Senior Assessment Specialist, ELA/Literacy within our team, you will apply your expertise in writing, English language arts, and direct writing assessment to support high-quality scoring operations for SAT Essay and contribute to related assessment initiatives across the organization.
About the Opportunity
As a Senior Assessment Specialist focused on SAT Essay scoring and ACCUPLACER/ACCUPLACER ESL content development, you will apply your deep expertise in writing, language, and assessment to ensure the accuracy, reliability, and fairness of human-scored responses and multilingual assessment content. Your close attention to detail, strong command of scoring rubrics, and ability to apply expert judgment consistently will be essential to maintaining high-quality scoring operations. You are analytical, mission-driven, and committed to precision, ensuring that every score supports students' opportunities and reflects the highest standards of assessment quality.
In this role, you will:
Conduct Expert-Level SAT Essay Scoring and Backreading (60%)
Train to expert level on the SAT Essay scoring task and demonstrate full mastery of rubric domains and scoring conventions.
Serve as an expert backreader supporting the Automated Essay Scoring (AES) system by verifying the accuracy of machine-generated scores.
Complete 100% of assigned backreading within required timeframes to ensure timely and accurate score delivery.
Participate in calibration activities, maintaining agreement rates that meet or exceed program targets.
Flag anomalous or rubric-ambiguous responses and provide clear rationale for expert review.
Support Scoring Quality, Calibration, and Process Excellence (15%)
Monitor scoring patterns and identify potential scoring drift or discrepancies, providing actionable feedback to Psychometrics and Scoring Leadership.
Participate in ongoing scoring validity checks and quality assurance processes.
Contribute to improvements in scoring processes, documentation, and scorer guidance.
Communicate complex scoring issues clearly to cross-functional partnersâincluding Psychometrics, Vendor Management, and Scoringâto ensure alignment and uphold quality standards.
Develop and Review ACCUPLACER and ACCUPLACER ESL Content (15%)
Train to expert level on ACCUPLACER and ACCUPLACER ESL item authoring and review conventions.
Author and review items aligned to Common European Framework of Reference for Language (CEFR), National Reporting System (NRS) ESL Benchmarks, Texas Workforce Commission (TWC) Benchmarks, and Common Care State Standards (CCSS) Anchor Standards.
Complete item coding and conduct Content Reviews 1 and 2 for ESL items submitted by outside item writers.
Support development for TSIA2 and ACCUPLACER Study App materials, including writing and reviewing rationales.
Support development of high-quality, effective instructional videos for ACCUPLACER Essay Tests.
Advance Research, Development, and Innovation (10%)
Conduct research to deepen familiarity with federal National Report System (NRS) submission requirements.
Co-author documentation supporting ACCUPLACER ESL submission for federal approval.
Contribute insights that improve scoring accuracy, rubric clarity, and test development processes.
Identify opportunities to enhance efficiency and quality through improved workflows, guidance materials, or technological tools.
About You
To qualify for this role, you must have:
- âA master's degree or the equivalent education and experience in English, English education, writing, or a closely related field.
- Four to six years of experience in standardized, large-scale K-12 or K-16 direct writing assessment with a nationally recognized testing organization, publisher, or state testing program (highly preferred).
- Teaching experience at the middle, secondary, or postsecondary levels (preferred).
- In-depth exposure to state and national curriculum standards (preferred).
- Exceptional verbal and written communication skills and the ability to clearly articulate scoring rationales and rubric interpretations.
- Strong interpersonal skills, with the ability to collaborate effectively with colleagues, scoring experts, and external partners.
- Solid organizational, time-management, and task-management skills, with the ability to manage multiple scoring activities simultaneously.
- A demonstrated ability to work both independently and as part of a team in a fast-paced scoring environment.
- Strong attention to detail, especially in the consistent application of scoring rubrics.
- Computer literacy, including proficiency with Microsoft Office applications and comfort learning new scoring technologies and platforms.
- The ability and willingness to travel nationally as needed to support scoring operations or other program activities.
- The ability to travel 6-10 times a year to College Board offices or on behalf of College Board business
All roles at College Board require:
A passion for expanding educational and career opportunities and mission-driven work
Authorization to work in the United States for any employer
Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and a comfort learning and applying new digital tools independently and proactively.
Clear and concise communication skills, written and verbal
A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input.
A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success.
About Our Process
Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days.
While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.
What We Offer
At College Board, we offer more than just a paycheckâwe provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We're a self-sustaining nonprofit that believes in fair and competitive compensation, grounded in your qualifications, experience, impact, and the market.
A Thoughtful Approach to Compensation
The hiring range for this role is $68,000-$100,000
Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board.
We aim to make our best offer upfrontârooted in fairness, transparency, and market data.
We adjust salaries by location to ensure fairness, no matter where you live.
You'll have open, transparent conversations about compensation, benefits, and what it's like to work at College Board throughout your hiring process. Check out our careers page for more.
Similar Jobs
Work-Based Learning Instructional Designer (Part-Time) ("Restricted)
Northern Virginia Community College
🇺🇸 Fairfax County, VA
Instructional Design Quality Specialist PT - Regular Part-time (Benefits eligible) - 528325
University of Alabama
🇺🇸 Hybrid - AL
Learning Design & Delivery Specialist
ADP
🇺🇸 Hybrid - Maitland, FL
Learning Design Strategist
American Academy of Family Physicians
🇺🇸 Hybrid - Leawood, KS
Instructional Designer
Murata
🇺🇸 Hybrid - Carrollton, TX
