University of Kansas - R programmer with experiences in measurement

paid / Lawrence, KS or Remote / full-time

Psychometrician Associate

Achievement & Assessment Inst

Position Overview

ATLAS, at the University of Kansas, is seeking a Psychometrician Associate to support the operational psychometric work for the Kansas Assessment Program, including the statewide general education summative assessment, interim assessment, and the Kansas English language proficiency assessment. Responsibilities include statistical tasks such as cleaning data, managing data sets, and running descriptive and inferential statistics; psychometric tasks under the supervision of senior staff such as item and test analysis, calibration, equating and scaling, differential item functioning, and assisting with standard setting; performing quality assurance checks on analysis and reports; assisting with reliability and validity studies by analyzing data; contributing to technical documents; may present to Technical Advisory Committees or other audiences, and other duties as assigned.

The preferred work location assignment would be on-site. However, we will consider remote work for a well-qualified candidate.

Job Description

  • 60% : Uses various types of statistical and psychometric models to analyze large-scale assessment data. Under the supervision of senior staff, assists or conducts all aspects of operational assessment work related to scoring and reporting including data cleaning, key validation, calibration, equating, scoring, quality control, reporting, differential item function, and standard setting. Produces item and test analyses and summary data tables for use in technical documentation.
  • 15% : Contribute to the development of statistical and psychometric analysis scripts using R. Developments will include streamlining new and existing workflows and analyses.
  • 10% : Performs other statistical and psychometric tasks for research under the supervision of senior staff.
  • 5% : Assist in preparing technical reports and related documents
  • 5% : Present to various audiences, including state education agency partners, Technical Advisory Committees, and professional conferences.
  • 5% : Other duties to support the research and psychometric activities for the Kansas Assessment Program

Position Requirements

Due to COVID restrictions, this position will begin teleworking and may transition to on-site work when deemed safe and necessary.

This position could work remotely from home (telework) for well-qualified candidates.

Required Qualifications

  • Master's degree in psychometrics, statistical or other closely related field or a bachelor's degree and 3 years of full-time related experience in large-scale assessment.
  • At least 2 years of experience with quantitative analysis and coding in R or SAS. Example R package includes dplyr, tidyr, data.table, stringr, ggplot2, and mirt. Example PROCs includes Freq, Sort, Transpose, Means, Reg, Corr, Logistic, Print and different DATA Step statements and functions.
  • Knowledge and experience with SQL such as pulling data from SQLite database, or skills with RSQLite package, or skills with PROC SQL.
  • Experience applying classical and IRT psychometric models such as item and test analysis, calibration, equating, scoring, and scaling.
  • Experience with data management and descriptive and inferential statistics such as data manipulation, quality control in the data cleaning, calculating and reporting descriptive statistics, and fitting regression (linear and logistic) models.
  • Experience managing multiple priorities and deadlines, including adapting in response to changes in work priorities and processes, as evidenced in application.
  • Detail oriented with strong organizational skills, as evidenced by application materials.

Preferred Qualifications

  • Master's degree in psychometrics, statistical or other closely related field with 2 years of full-time related experience in large-scale assessment or a bachelor's degree and 4 years of full-time related experience in large-scale assessment.
  • Extensive experience writing scripts in R as evidenced in application materials and interview (e.g., building packages, vignettes, etc.)
  • Strong problem-solving skills as evidenced by application materials and interview

Contact Information to Applicants

Cynthia Perez

Additional Candidate Instruction

A complete application includes:

  • Online application
  • Vita
  • Cover letter highlighting qualifications and including specific examples of experience
  • Names and contact information for three professional references
  • Technical writing sample.

Only complete applications will be considered.

Application review begins May 23rd, 2021. To ensure first consideration, apply before the application review date.


The University of Kansas prohibits discrimination on the basis of race, color, ethnicity, religion, sex, national origin, age, ancestry, disability status as a veteran, sexual orientation, marital status, parental status, gender identity, gender expression, and genetic information in the university's programs and activities. Retaliation is also prohibited by university policy. The following persons have been designated to handle inquiries regarding the nondiscrimination policies and are the Title IX coordinators for their respective campuses: Director of the Office of Institutional Opportunity and Access,, Room 1082, Dole Human Development Center, 1000 Sunnyside Avenue, Lawrence, KS 66045, 785-864-6414, 711 TTY (for the Lawrence, Edwards, Parsons, Yoder, and Topeka campuses); Director, Equal Opportunity Office, Mail Stop 7004, 4330 Shawnee Mission Parkway, Fairway, KS 66205, 913-588-8011, 711 TTY (for the Wichita, Salina, and Kansas City, Kansas medical center campuses).

Apply to this position

This topic was automatically closed after 31 days. New replies are no longer allowed.

If you have a query related to it or one of the replies, start a new topic and refer back with a link.