Associate Psychometrician / Research Scientist
Remote/Nationwide, USA
Full time
Job Title Associate Psychometrician / Research Scientist
Job Description
For more than 80 years, Kaplan has been a trailblazer in education and professional advancement. We are a global company at the intersection of education and technology, focused on collaboration, innovation, and creativity to deliver a best-in-class educational experience and make Kaplan a great place to work.
The future of education is here and we are eager to work alongside those who want to make a positive impact and inspire change in the world around them.
Kaplan North America is looking for an Associate Psychometrician/Research Scientist to join the Psychometrics and Learning Analytics team and provide psychometric support for the development, delivery, maintenance and expansion of the Kaplan Test of English (KTE) and various Kaplan’s testing and learning products.
KTE is a cloud-based platform managed by Kaplan International, delivering a computerized-adaptive test (CAT) of English language that delivers instant proficiency evaluations with best-in-class accuracy, efficiency and accessibility. The test assesses English language proficiency skills ranging from beginner to advanced for individuals aged 16 or above. It is used by multiple companies across Kaplan and externally by universities, colleges, businesses worldwide, as a fair, valid and reliable assessment tool for admissions, placement, progress tracking workforce evaluation and proficiency certification.
This is a great opportunity to join a dynamic and important team in Kaplan’s digital learning and testing enterprise. The Psychometrics and Learning Analytics team help drive assessment design and creation. This team enables proper assessment functioning across all product lines and is responsible for the adaptive algorithm, machine learning and artificial intelligence applications within the Kaplan North America technology ecosystem.
We are seeking a highly-motivated and talented individual to be responsible for KTE's psychometric planning and implementation. The ideal candidate will combine strong psychometric and data science expertise with technical programming skills to maintain and enhance our adaptive testing platform, and work closely with IT teams to drive continuous improvement of our assessment system. The candidate is enthusiastic about data and education, has experience with computer adaptive testing, is able to work effectively in a remote global team, and respond to multi-priorities quickly. This is an exciting opportunity to be part of a team driving the success of innovative assessments and great impacts of learners
Primary/Key Responsibilities
- Work closely with the senior management team of Kaplan Testing Services (KTS) to provide the psychometric support to the Kaplan Test of English (KTE).
- Collaborate with cross-functional teams globally consisting of IT engineers, content developers, business owners from different time zones in US, UK, Australia, and India.
- Conduct all aspects of psychometric analysis in operational work, including item analysis, IRT calibration, reliability and validity studies, test scaling and equating.
- Conduct all aspects of psychometric analysis to ensure the adaptive item bank quality and maintenance, including monitoring item exposure, parameter drift, response patterns, and test security.
- Design and optimize adaptive algorithms, evaluating and improving item selection and ability estimation methods.
- Develop and maintain programming scripts for data cleaning, processing, analysis, automation of psychometric workflow and process.
- Leverage emerging AI and machine learning technologies to enhance automated scoring, test delivery, adaptive algorithms and other aspects of psychometric analysis.
- Prepare technical reports and related documentation.
- Present research results to internal and external stakeholders and affiliates.
- Engage with the professional community through conferences and publications.
- Other duties as assigned
Minimum Qualifications
- PhD Degree in statistics, psychometrics, educational measurement, quantitative psychology, data science or a closely related subject
- Experience with large-scale educational assessment programs
- Direct experience with CAT assessments and excellent working knowledge of adaptive algorithm and estimation methods
- Excellent working knowledge of classical and modern test theory and advanced psychometric models
- Proficient in at least one programming language ( Python and SQL are preferred)
- Excellent working knowledge of psychometric packages and software
- Knowledge and experience in applying ML and AI in educational research
- Excellent communication and interpersonal skills
Preferred Qualifications
- Experience with English language assessments
- Experience working with cloud-based infrastructure across Azure, AWS & GCP
We offer a competitive benefits package including:
Remote work providing flexible work/life balance
Comprehensive Retirement Package automatically enrolled in The Company Contribution Plan (8-10% annual company contribution based on tenure)
Our Gift of Knowledge Program provides tuition assistance and substantial discounts for our employees and close family members
Competitive health benefits and new hire eligibility starts day-1 of employment
Generous Paid Time Off includes paid holidays, vacation, personal, sick paid time-off, plus one (1) volunteer day and one (1) diversity and inclusion day to participate and give back to our local communities
And so much more!
#LI-DK1
#LI-Remote
For full-time positions, Kaplan has two Salary Grades, this position is Salary Grade B: $64,000 - $202,600. Actual compensation for this role is determined by several factors including but not limited to job level, candidate's skills, experience, and education, among other factors determined by the business.
LocationRemote/Nationwide, USA
Additional Locations
Employee TypeEmployee
Job Functional Area Data Analytics/Business Intelligence
Business Unit00091 Kaplan Higher ED
At Kaplan, we recognize the importance of attracting and retaining top talent to drive our success in a competitive market. Our salary structure and compensation philosophy reflect the value we place on the experience, education, and skills that our employees bring to the organization, taking into consideration labor market trends and total rewards. All positions with Kaplan are paid at least $15 per hour or $31,200 per year for full-time positions. Additionally, certain positions are bonus or commission-eligible. And we have a comprehensive benefits package, learn more about our benefits
here.
Diversity & Inclusion Statement:
Kaplan is committed to cultivating an inclusive workplace that values diversity, promotes equity, and integrates inclusivity into all aspects of our operations. We are an equal opportunity employer and all qualified applicants will receive consideration for employment regardless of age, race, creed, color, national origin, ancestry, marital status, sexual orientation, gender identity or expression, disability, veteran status, nationality, or sex. We believe that diversity strengthens our organization, fuels innovation, and improves our ability to serve our students, customers, and communities. Learn more about our culture
here.
Kaplan considers qualified applicants for employment even if applicants have an arrest or conviction in their background check records. Kaplan complies with related background check regulations, including but not limited to, the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. There are various positions where certain convictions may disqualify applicants, such as those positions requiring interaction with minors, financial records, or other sensitive and/or confidential information.
Kaplan is a drug-free workplace and complies with applicable laws.