Skip to main content

BRIEF RESEARCH REPORT article

Front. Educ.
Sec. Assessment, Testing and Applied Measurement
Volume 10 - 2025 | doi: 10.3389/feduc.2025.1506674

Accuracy of Attribute Estimation in the Crossed Random Effects Linear Logistic Test Model: Impact of Q-matrix Misspecification

Provisionally accepted
  • 1 University of South Florida, Tampa, United States
  • 2 American Board of Psychiatry & Neurology, Chicago, United States
  • 3 University of Alabama at Birmingham, Birmingham, Alabama, United States
  • 4 University of Massachusetts Lowell, Lowell, Massachusetts, United States

The final, formatted version of the article will be published soon.

    A simulation study is designed to explore the accuracy of attribute parameter estimation in the crossed random effects linear logistic test model (CRELLTM) with the impact of Q-matrix misspecification on attribute parameter estimation using the SAS ® GLIMMIX procedure with a scaling constraint on item parameter. In addition, the impact of the interactions of Q-matrix misspecification with other manipulated factors, such as population distribution, sample size, and Q-matrix density, on parameter estimation is also investigated. The results indicated that misspecification type and percent have a considerable impact on the bias and root mean squared error of attribute estimates, especially under the conditions of high percent misspecification and over-misspecification. However, attribute correlation between the estimated and true parameters is not affected by misspecification type and percent. Other manipulated variables have no impact or interaction effects with Q-matrix misspecifications on attribute estimates. Since the Q-matrix is an indispensable element in applying the crossed random effects linear logistic test model, specifying an appropriate Q-matrix is a crucial task and must be completed with generous assistance from content and subject experts.

    Keywords: cross random effects, linear logistic test model, simulation, Q-matrix misspecification, SAS GLIMMIX Accuracy of Cognitive Attribute Estimation in the Crossed Random Effects Linear Logistic Test Model: Impact of Q-matrix Misspecification

    Received: 05 Oct 2024; Accepted: 10 Feb 2025.

    Copyright: © 2025 CHEN, Li, Cao and Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: YI-HSIN CHEN, University of South Florida, Tampa, United States

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.