Aims of these studies were to develop the Portuguese Physical Literacy Assessment Observation instrument (PPLA-O) to assess the physical and part of the cognitive domain of Physical Literacy (PL) through data collected routinely by Physical Education (PE) teachers; and to assess the construct validity (dimensionality, measurement invariance, and convergent and discriminant validity) and score reliability of one of its modules [Movement Competence, Rules, and Tactics (MCRT)].
Content analysis of the Portuguese PE syllabus and literature review were used for PPLA-O domain identification. Multidimensional Item Response Theory (MIRT) models were used to assess construct validity and reliability, along with bivariate correlations in a sample of 515 Portuguese grade 10–12 students (
PPLA-O development resulted in an instrument with two modules: MCRT (22 physical activities) and Health-Related Fitness (HRF; 5 protocols); both assessed with teacher-reported data entered in a spreadsheet. A two correlated dimensions Graded Response Model (Manipulative-based Activities [MA], and Stability-based Activities [SA]) showed best fit to the MCRT data, suggesting measurement invariance across sexes, and adequate to good score reliabilities (MA = .89, and SA = .73). There was a moderate to high correlation (
PPLA-O is composed of two modules that integrate observational data collected by PE teachers into a common frame of criterion-referenced PL assessment. The HRF module uses data collected through widely validated FITescola® assessment protocols. The MCRT makes use of teacher-reported data collected in a wide range of activities and movement pursuits to measure movement competence and inherent cognitive skills (