Senior Psychometrician

About the Role
The Psychometrician is responsible for the construction, maintenance and validation of large-scale high-stakes examinations for Licensure and Certification programs at PSI. The person in this role is expected to have advanced training, expertise and proven consulting skills in test development, measurement, and project management for examination programs.
This is a full-time permanent role, with flexible hours around core office availability Monday to Friday. The role can be performed remotely, with occasional travel (up to 20%) required for meetings, events and workshops.

Role Responsibilities
Designs and conducts job/practice analysis studies, including surveys and focus groups, and develops test blueprints/exam specifications.
Facilitates exam development workshops, committee meetings, and provides training sessions for item writers and subject matter experts.
Directs and conducts statistical analyses of test items and examinations (e.g., item calibration, form assembly, equating, scaling and psychometric monitoring) using CTT and IRT methods.
Designs/implements equating, linking, and item banking, and conducts standard setting studies.
Writes technical reports and documentation.
Advises clients regarding psychometric and test development methods and best practices.
Ensures high quality in examinations and practices that comply with professional standards and legal guidelines.
Manages projects to ensure milestones and deliverables are met with quality and timelines.
Directs and implements continuous improvement of procedures and processes.
Offers training on updated software, procedures, and processes.
Communicates results and presents findings to internal and external clients and stakeholders clearly and concisely.
Performs specialized research studies related to test construction and validation (e.g., LOFT, AIG).
Presents in professional conferences and testing community.
Complies with industry best practices, standards and guidelines.
Other duties, responsibilities, and activities may change or be assigned at any time with or without notice.

Knowledge, Skills and Experience Requirements
Master’s degree or Ph.D. in psychometrics, quantitative research methods, educational measurement and statistics, l/O psychology, or other highly related areas.
At least 5 years’ experience in professional test development and psychometrics required.
Experience with client advisory for large-scale testing programs, including Certification and/or Licensure applications preferred.
Knowledge of SAS, SPSS, SQL, Word and Excel required, knowledge of IRT software (e.g., Winsteps, Parscale, BILOG) and CTT applications preferred. Performs specialized research studies related to test construction and validation (e.g., LOFT, AIG).