Katharina Voltmer
Maria von Salisch- Institute of Psychology, Leuphana University Lüneburg, Lüneburg, Germany
Children with an advanced knowledge of emotions are generally more socially competent, less likely to suffer from psychopathology, and more likely to succeed in school, both socially and academically. The assessment of children's emotion knowledge has thus gained importance in recent decades - both in psychiatric practice and in developmental and educational psychology. However, there is still a lack of appropriate instruments for assessing children's emotion knowledge in a performance test reliably, and for a broad age range. The Adaptive Test of Emotion Knowledge (ATEM 3–9) is a newly developed measure which encompasses seven components of emotion knowledge in 3–9-year-olds. The ATEM 3–9 is an adaptive test which uses skip and dropout rules to adjust for children's varying levels of knowledge. In addition to German, the ATEM has been translated into English and Hebrew. The German norming sample of the ATEM 3–9 comprises N = 882 (54% female, 21% bilingual) children between the ages of 3 and 9 years, who were divided into seven age groups. Test items, which are ordered according to the item response theory, showed a good fit to a seven-dimensional model reflecting the seven components. The internal consistencies of the dimensions are acceptable to good. Construct validity was examined by means of correlations with other measures of emotion knowledge, as well as measures on language skills and executive functions in a subsample. This resulted in medium size correlations in the expected directions. In addition, children with externalizing and internalizing disorders who were recruited in psychiatric in- and outpatient clinics showed deficits in various components of emotion knowledge when compared to their agemates in the norming sample. Overall, the ATEM 3–9 is well suited to measure individual components of emotion knowledge in children and to obtain a differentiated picture of the various aspects of emotion knowledge. The ATEM 3–9 thus supports the investigation of the development of social-emotional competencies in normative development (e.g., school readiness) and in social-emotional-learning interventions. Furthermore, it is suitable as an instrument for the differentiated assessment of (progress of) children's emotion knowledge in clinical child psychology and psychiatry.
Introduction
Emotion knowledge, also referred to as emotion understanding, is an integral part of emotional competencies along with emotion regulation and emotion expression. Emotion knowledge is thus a cornerstone of emotional functioning which is described, for example, in the conceptual framework of Emotion Understanding in Recognition and Knowledge Abilities (EUReKA) by Castro et al. (1). These authors use the term emotion understanding to refer to the recognition of and knowledge about emotions and emotional cues in oneself and others. Pons et al. (2) use the term emotion knowledge to describe the development of emotion recognition and knowledge about emotions in others in early and middle childhood. Thus, the two models encompass overlapping but not identical skills and competencies. Both research teams agree that emotional competencies develop in early to middle childhood and are further refined in adolescence and adulthood. Following Pons et al. (2), the present work focuses on the development and assessment of the recognition and knowledge of other peoples' emotions during early and middle childhood. In the present paper, we will call these components emotion knowledge. The present work presents results on the psychometric properties, validity, and applications of the Adaptive Test of Emotion Knowledge for 3- to 9-year-old children (ATEM 3–9) in a German sample. The ATEM 3–9 encompasses seven of the emotion knowledge components described in Pons et al. (2), which are (1) facial recognition, (2) situational recognition, (3) knowledge about desire-related emotion, (4) recognition of mixed emotions, (5) knowledge about belief-related emotions, (6) knowledge about display rules, and (7) knowledge about emotion regulation strategies. The development of these components is presented in a more detailed way in the next section. In the ATEM 3–9 the corresponding skills are measured in the order in which they develop in childhood. In this way, it is possible to verify whether the developmental course of emotion knowledge is age appropriate in typically developing children and in children who are under psychiatric treatment. Of course, other development variables also play a role in this assessment. Therefore, an overview of cognitive and social as well as sociodemographic and psychopathological correlates of emotion knowledge is provided below. Before describing the ATEM 3–9 itself in detail and pointing out the aims of the present work, a brief overview of existing emotion knowledge assessment instruments is given.
Development of Emotion Knowledge Components
The ability to distinguish the different facial expressions of others starts in the newborn period and refines within the second and third year of life. Most 3-year-olds can read the four basic emotions of joy/happiness, sadness, fear, and anger in the faces of others (2). They are also able to label them – a competence that goes along with language development (3). Using situational cues to identify one emotion (or several emotions at the same time) starts in the fourth year of life and goes on until late childhood (2, 4). Younger children find it easiest to recognize happiness (or joy) in prototypical situations. With age, various negative emotions, such as anger, sadness, or fear, are increasingly recognized and emotions in non-prototypical situations are labeled with increasing accuracy (5). During the same period, the internal states of other people are increasingly used to identify their emotions. Theory of Mind skills are essential for identifying emotions as a function of the other person's preferences, desires, or beliefs (2, 6). Theory of Mind also plays a role when differentiating between the emotions which individuals show to others and the emotions they actually feel. The ability to recognize and understand these display rules begins around age four and is largely developed by age 6–8 years of age (7). Finally, knowledge about socially accepted, adaptive, and functional strategies of emotion regulation develop from the age of four onward. First, behavioral regulation strategies and later cognitive regulation strategies are recognized and labeled (8). In Table 1, the development of the components of emotion knowledge is summarized.
Table 1. Overview of emotion knowledge components and their development in early childhood.
Emotion Knowledge, Language Skills, and Executive Functions
Language skills and executive functions are often considered important cognitive correlates of emotion knowledge. Because emotion knowledge is mainly taught and learnt via emotion talk, i.e., language input during verbal interactions, receptive and expressive language competencies are strong positive correlates, especially in early childhood (3, 9, 10). Conte et al. (11) found a zero-order correlation of r = 0.66 between 2- and 3-year-old children's receptive vocabulary and their emotion knowledge. In a slightly older sample, the mean correlation between receptive vocabulary and emotion knowledge was r = 0.51 (12). Brock et al. (13) reported a zero-order correlation of r = 0.40 between emotion knowledge and expressive vocabulary in 5-year-olds. These studies suggest that language skills are very important when acquiring the basic knowledge about emotions before entering formal schooling. The importance of verbal abilities is underlined by studies that indicate that language skills have a positive impact on the growth trajectory of children's knowledge about emotions (10, 14, 15). Studies on children with language impairments which found deficits in children's emotion knowledge (16) further emphasize the importance of emotion talk for the acquisition of emotion knowledge (17). Better language skills thus seem to help children in acquiring emotion knowledge. However, associations seem to be bidirectional, because other studies show that language skills were predicted by emotion knowledge in 3–8-year-olds, independent of age and gender (12, 18). As Ogren and Johnson [(19), p. 113] conclude, “[…] there is an important relation between a child's language abilities and emotion understanding, but the precise mechanism behind this existing relation remains unclear.”
Just like language, executive functions cannot be separated from emotion knowledge. Oftentimes all three variables interact. A recent study suggests that children's executive functions play a role in linking their emotion knowledge and their social competence via verbal skills, namely by moderating the mediating effect of language skills on the relation (20). This means that the more developed the children's executive functions were, the higher was the mediating function of verbal skills on the relation between emotion knowledge and social competence. In another study, verbal skills mediated the relation between cognitive flexibility and emotion knowledge (15). The zero-order correlations between emotion knowledge and working memory and emotion knowledge and cognitive flexibility (as a component parts of executive functions) were small to medium sized (15, 20). Moreover, executive functions work as predictors of emotion knowledge above and beyond the effects of language abilities: Set shifting predicted emotion knowledge over and above mothers' age, and children's IQ, language ability, and Theory of Mind in a sample of N = 75 preschool children (21). Working memory also played an explanatory role in the age-related growth of emotion knowledge (22). In a longitudinal design, executive functions contributed to the prediction of the emotion knowledge of N = 306 3-year-old children over a period of 18 months (23). The assumption that emotion knowledge and executive functions mutually reinforce each other seems to be rational, because other studies concluded that emotion knowledge longitudinally predicted the growth of executive functions (24). There is even evidence for bidirectional effects (25). In summary, language abilities and executive functions seem to be intertwined with the development of emotion knowledge.
Emotion Knowledge and School Success
Executive functions and language skills are well-known cognitive predictors of children's success in school. However, social skills that are associated with emotion knowledge are often forgotten as predictors of school success, even though they play a critical role in academic achievement and social success. In Denham and Brown's (26) model of social-emotional learning (SEL), children's effective social interactions are based on five social and emotional skills: (1) self-awareness, (2) self-regulation, (3) social awareness, (4) responsible decision making, and (5) relationship skills. Social awareness relies heavily on emotion knowledge. When children can recognize and understand the emotions of their classmates and teachers, i.e., when they are aware of their social partners' emotions, successful interactions are more likely. Socially aware children tend to be better liked by their classmates in school, find friends easier (27, 28), and are thus in a better position to share knowledge and other academic resources with their peers. Children with supportive relationships with teachers and peers are likely to be more engaged in school, have more personal resources available for learning, and demonstrate better academic performance (29–31). In a meta-analysis, Trentacosta and Fine (32) reported a mean association of r = 0.22 between emotion knowledge and social skills in children and youths. More recent studies corroborate the association between emotion knowledge and various social skills in different age-groups (33, 34). The association between emotion knowledge and academic achievements was mediated by the social behavior of school-aged children (35). Social behavior may be an explanation for the medium sized (r = 0.32) association found in a meta-analysis between emotion knowledge and academic achievement in children aged 3–12 years (36). A longitudinal analysis, which used an earlier version of the ATEM 3–9, found a significant influence of kindergartners' emotion knowledge on their phonological awareness just before they entered formal schooling about 1 year later (37). Taken together, many studies agree that children's emotion knowledge is, among others, an important predictor of their academic and social success in school.
Emotion Knowledge and Psychopathology
Emotion knowledge often comes into play when children's development deviates from the typical course, i.e., in psychopathology. The most intensely researched component of emotion knowledge regarding psychopathology is emotion recognition. Evidence shows that emotion recognition in children and adolescents is impaired in many disorders like schizophrenia, mood disorders, anxiety disorders, attention deficit (hyperactivity) disorder, eating disorders, and conduct disorders with participants being less accurate in emotion recognition in general or showing biases toward specific emotions (38). Emotion recognition and emotion knowledge in general take on a special significance in autism spectrum disorders. In the late 1980s Baron-Cohen started to investigate the Theory of Mind of children with autism spectrum disorders (39) and soon began to examine children's recognition and understanding of emotions (40, 41). Studies agree that children with autism spectrum disorders often present less developed emotion knowledge than typically developing children, at least in some components. This also holds for normally intelligent or high functioning children with autism spectrum disorders [(42); for short review about emotion recognition skills see (43)]. Various interventions were developed to teach autistic children about the different components of emotion knowledge (44–47). In recent years, underlying mechanisms and moderators of this association came into the focus of research (48, 49).
In order to elucidate the emotional precursors of psychopathology in children, researchers have oftentimes investigated the associations between emotion knowledge and self-reported or third-party reported internalizing and externalizing problem behaviors. A meta-analysis established small correlations between emotion knowledge and concurrent or longitudinal internalizing and externalizing behavioral problems (both r = −0.17) without any direction of effect (32). Negative correlations of a similar magnitude were found in later studies by Tarullo et al. (50) and Martin et al. (51). Correlations were higher for children with post-traumatic stress disorder and obsessive-compulsive disorder in a study of clinically anxious children (52). In a cross-sectional regression design with N = 87 6- to 10-year-olds, Dede et al. (53) showed that facial emotion recognition skills for fear predicted internalizing symptoms. Longitudinal designs which support a causal interpretation of these associations are rare, however, even though they highlight the predictive and preventive power of emotion knowledge for (later) behavioral problems (54–56). However, Göbel et al. (57) only found small relations of emotion knowledge with internalizing problems and no significant cross-sectional associations with externalizing problems.
Emotion Knowledge and Sociodemographics
Given that emotion knowledge differs widely among children of different age groups, research evidence regarding gender differences is not entirely clear. While studies agree that boys and girls do not tend to differ in their overall or general knowledge of emotions (11, 24, 58–61), studies of individual components sometimes result in differences in favor of girls. Girls seem to be better able to differentiate between situational causes for emotions (62–66), to better understand mixed emotions (4), and to know more about internal causes of emotions (60) than boys. A small but relevant female advantage on the processing of emotional expressions on the face was discovered in a meta-analytic review of studies including infants, children, and adolescents (67). One explanation for these findings may lie in differences in the socialization of emotions in boys and girls. Because girls are more frequently engaged in conversations about emotions than boys, they are more likely to be encouraged to recognize emotions in others (62, 68).
Some studies take into account the socioeconomic background of the children's families and specialize in the emotion knowledge of children from low-income families (69–72). Studies agree that, on average, children from less privileged households tend to display less emotion knowledge than children from middle class families (59, 73–75). Children from immigrant families are particularly likely to live in homes with a low socioeconomic status. This may be another reason – in addition to the reduced language skills described above – for their oftentimes lower knowledge of emotions. Indeed, even in studies in which receptive language skills were controlled for or emotion knowledge was assessed in the children's native language, differences in performance were found between children with and without an immigrant background (76–79). Differences in the rules of when and how emotions are to be expressed and talked about as well as different socialization processes within families of children from different cultures, offer further conclusive explanations for these differences (80–82). Children from immigrant families do not only have to acquire typical situational causes and expression and feeling rules in their own culture, but they also have to learn these rules in the majority culture (83).
Instruments for Assessing Emotion Knowledge
An instrument for assessing emotion knowledge in children should encompass the components described above, while taking into account the developmental course of emotion knowledge and associations with children's cognitive abilities. The instrument should cover as many components as necessary, or as expected to be solved in a particular age-group, with as few demands on children's language abilities and attention and memory skills as possible. In addition, it should be designed to be time-efficient and attractive for children. Apart from the many studies in which are confined to the recognition of emotions in children's faces [recently also with dynamically changing facial expressions (84)], two types of tasks were given in most studies which assessed children's knowledge of the basic emotions of happiness/joy, sadness, fear, and anger: First, children were asked to recognize emotions in the facial expressions of people in photographs or drawings; second, pictures of stories were presented or acted out with hand puppets, in which children were asked to recognize the emotions that the situations typically evoke (1). Thus, the two components that most children acquire between the ages of three and four (i.e., facial recognition and situational recognition of basic emotions) were mainly measured in this way. These tests are independent from expressive language skills because children point at the facial expressions of emotions and are not asked to name the emotions. The Affective Knowledge Test (85) and the Emotion Matching Task (86, 87) are well known instruments that contain these tasks. Additionally, these instruments include language-dependent emotion naming tasks. The Emotion Understanding Assessment (88) includes items to assess the knowledge of desire-based and belief-based emotions and is thus an exception, because mostly study-specific instruments have been developed for measuring the more complex components of emotion knowledge which are connected with children's Theory of Mind. Recognizing that emotions can result from false beliefs or separating the experience from the expression of emotion (which slightly older children can solve), are examples for these more sophisticated components of emotion knowledge (14). A rare exception is the Test of Emotion Comprehension (TEC) (89) which comprises nine components of emotion knowledge. The TEC uses one (mixed emotions, moral emotions, emotion regulation strategies, display rules) to five (emotion recognition and situation knowledge) short vignettes with line-drawn pictures to assess each component. The advantages of the TEC are that it examines the nine components within in a short period of time and that it can be used for children between the ages of 3 and 10. Expressive language skills are not required in the TEC. To prevent possible gender effects, it is available in a boy's and a girl's version. A major drawback is that the TEC covers only the two emotion recognition components (facial recognition and situational recognition) with five items each. Because the more demanding components are recorded with only one or two items per component, these components can only be asked for regarding one (or two) target emotions. Moreover, there is a 25% probability of correctly solving a one-item-component by guessing. Interpreting emotion knowledge at the emotion and the component levels is therefore not possible with the TEC. Instead, the components of the TEC form three basic levels of emotion knowledge which are arranged in a hierarchical order: (1) The external aspects are composed of emotion recognition abilities (facial, situational, mixed emotions) and develop before entering school at around the age of six. (2) The mental aspects are understanding emotions resulting from desires, beliefs, and memory and develop between the ages of five and seven. (3) And the reflective aspects are knowledge about emotion regulation strategies, display rules, and moral emotions that develops between the ages of seven and nine. Younger children are asked to complete the entire test, although they are usually not yet able to answer a large part of the items correctly. This may lead to frustration.
The ATEM 3–9
With the ATEM 3–9, a test has been developed that captures seven components of emotion knowledge in early and middle childhood. According to the rules of Item Response Theory (IRT), the components are arranged in a way which reflects the developmental course of the individual competencies over time, i.e., items within and between components increase in difficulty. This makes it possible to give a child only a subset of the available items within the components, and to do so until the child's ability limit is reached. It also allows to present to the child only a subset of the available components when it is foreseeable that the more difficult components can no longer be solved. The components of emotion knowledge in the ATEM 3–9 (Table 2) can be assessed without expressive language skills. Children are asked to read facial expressions of emotions, to identify external and internal reasons for emotions, and to distinguish between shown and felt emotions and between adaptive and maladaptive strategies of regulating emotions. In addition to the basic emotions of happiness/joy, sadness, fear, and anger, ATEM 3–9 includes items on surprise and disgust. The ATEM 3–9 is adaptively designed by means of skip and termination rules within and between the components. The ATEM 3–9 is structured and looks like a picture book that tells a story about two children who visit a zoo with their parents. Each setting in the story corresponds to a particular component of emotion knowledge (e.g., Component 6: Petting Zoo). When a component is completed, the setting in the story also changes. Components 1 and 2 each include six items, components 3 through 6 each include five items, and component 7 includes three items. ATEM 3–9 is available in a girl's version and a boy's version with two female or two male characters, respectively. The names and the drawings suggest an immigrant background for one of the two characters in the story. In a one-to-one setting, the ATEM 3–9 can be completed both on paper and in an electronic offline (Android application) or online (test-platform) version with the story as an audio output on a tablet or a computer. The digital version opens up the possibility to complete the ATEM 3–9 over long distances with video conference tools.
Table 2. Components of the ATEM 3–9.
The aim of the present paper is to describe the factorial structure and estimates of reliability and validity of the ATEM 3–9, as well as the psychometric properties of the items. Multidimensional item response theory (MIRT) makes it possible to analyze the multidimensional construct emotion knowledge. Therefore, a seven-dimensional model of emotion knowledge representing the seven components of the ATEM 3–9 is compared to a one-dimensional solution, with (1) an expected superiority of the seven-dimensional model. Because the ATEM 3–9 is designed to reflect the development of emotion knowledge in childhood, children's performances are (2) expected to increase with age. The gender-specific versions of the test may facilitate the identification of girls and boys with the characters in the test and thus prevent effects of gender due to misidentification. However, because some studies found that girls tend to perform better in some aspects of emotion knowledge, we (3) expect higher scores for girls than for boys in the ATEM 3–9. (4) Multilingual children are expected to score lower on the ATEM 3–9, especially in the more complex components with high text load because of the effects of receptive language skills. Correlations of the ATEM 3–9 score with language skills, executive functions, and other measures of emotion knowledge are described as indicators of construct validity. (5) We expect medium-size positive correlations with the other emotion knowledge measure (TEC) and with the measures of language skills and executive functions, because of overlapping but not identical constructs of emotion knowledge and because of the complex interrelations between language skills, behavioral self-regulation, and emotion knowledge. Differences in emotion knowledge between children with and without mental disorders are considered evidence of criterion validity. (6) Based on the literature on emotion knowledge and psychopathology, typically developing children are expected to score higher on the ATEM 3–9 than their agemates with a diagnosed mental disorder. A last aim of the present paper is to make some suggestions for the application of the ATEM 3–9 in research and (clinical) practice.
Methods
Sample and Procedure
Analyses are based on the norm sample of the German version of the ATEM 3–9. In total, the norm sample included N = 882 children between the ages of three and nine (mean age = 72.13 months, SD = 21.17), from whom data were collected between June 2019 and September 2020. Overall, 54% of the children were female. The proportion of children growing up in multilingual households ranged from 16% to 33% percent, depending on the age group. Children from kindergartens and primary schools located in Lower Saxony, Hamburg, and two other German cities participated. Data on the socioeconomic status of the children's families was not available. Children were tested individually using the digital version of the ATEM 3–9 on tablets with an audio output. The tablet was usually placed on a table and was initially operated by the test leaders. Through the audio output, both the instructions of the test were given, and each test item was read aloud. The children themselves only had to tap on one of the four given emotion pictures to select their solution. Thus, the independent execution of the test with the tablet was possible even for 3-year-olds. Children's data entry was supported, only if necessary, by the test leaders who were always present. For a proportion of 34% of the children, the test ended after the second component due to the termination rule. Most of these children (85%) were younger than 6 years of age. When individual components (because of the skipping rules) were abbreviated or the whole test was terminated after component 2, it took less time to finish the ATEM 3–9. The mean processing time for children between 3 and 5 years of age (preschoolers) was 15 min, and for children between 6 and 9 years (school-aged children) it was 25 min. A subsample of n = 160 children (of 3–6 years of age) was also tested individually on sentence comprehension, and another subsample of n = 48 children between 6 and 9 years of age was also tested individually on receptive vocabulary. A subsample of n = 220 children between the ages of three to six was additionally tested on behavioral self-regulation. These additional tests extended the interview by about 20 min for these children. Only children for whom parental consent form was available and who had voluntarily agreed to participate, took part in the data collection. Table 3 provides an overview over the composition of the norm sample.
Table 3. Sample characteristics of the norm sample of the ATEM 3–9.
In addition to the norm sample, a sample of N = 55 children between the ages of six and nine (mean age = 99.1 months, SD = 12.64; 36% female) was included. These children had been diagnosed with at least one mental disorder by means of test psychology by a licensed therapist in child and adolescent psychiatry or psychotherapy. Of these children, 44% presented an internalizing disorder and 25% an externalizing disorder. Eighteen percent of the children had a mixed disorder, while another 13% were diagnosed with other disorders.
An in-depth study was conducted with an earlier paper-pencil version of the ATEM 3–9 with 40 items in the intervention project “Feeling Thinking Talking” which was designed to promote children's language skills, emotion knowledge and scientific thinking by training kindergarten teachers to use child-adapted language promotion strategies and emotion talk in everyday situations (FTT) (90, 91). At the first measurement point of the FTT study, the final 32 items of components 1–6 of the ATEM 3–9 and the resulting total test score were evaluated in N = 211 3- to 5-year-olds (mean age = 50 months, SD = 7.2). Of these children, 47% were female and 20% grew up in multilingual households according to parent report. Unfortunately, the information on multilingualism was missing for 33% of the children. Combined teacher and parent reports agree that for 43% of the children in the FTT sample at least one parent was born abroad. Among others, the FTT assessments included individual assessments of receptive and expressive vocabulary and behavioral self-regulation, as well as additional measures of emotion knowledge.
Materials
ATEM 3–9
Developing the final version of the ATEM 3–9 took several steps. Initially, the item pool for the ATEM included 100 items, which were divided among six components of emotion knowledge, six distinct emotions (joy, fear, sadness, anger, disgust, and surprise), and two distinct test versions (with 12 anchor items and 44 parallel items each). The seventh component (emotion regulation strategies) was added in a later step. After a first pilot study with these 100 items, six anchor-items, which were too easy, and 44 items with poorer item characteristics than the corresponding item in the parallel version were excluded, resulting in a 50-item first version of the ATEM 3–9. In addition, skipping and termination rules were developed to simplify the use with young children. The first rule mandates that all children perform component 1 and 2 but stop the test after component 2, if they fail on three items in a row within these two components. The second rule mandates that children skip the following items of components 3 through 6 and start the following component (stop the test at component 6), if they fail to solve three items in a row in the respective component. This first test version turned out to be too long for preschool children. It also contained items on both positive and negative surprise, which would have led to inconsistencies. Therefore, items about negative surprise and items with poorer psychometric characteristics were excluded from the test, resulting in a second version with 40 items within six components. This version was used in the FTT intervention project. It was still too long for many children, resulting in dropping additional items with poorer item characteristics in each component, leading to a 32-item version. Acknowledging the importance of strategies of emotion regulation, three items on this component were added in a last step. These items ask about three different types of functional emotion regulation, i.e., problem-oriented behavior, attention shifting, and reappraisal. The three items of this component are located within component 2 and component 6. Termination and skipping rules do not apply to these items. Simple items in this component ask about emotion regulation strategies that are easy to apply (problem-oriented behavior, attention shifting) within the component 2. The more difficult regulation strategy (reappraisal) is presented at the end of the test among the items of component 6. In the final 35-items version of the ATEM 3–9 the first and second component contain six items and the third to sixth component consist of five items with the target emotions happiness/joy, (positive) surprise, anger, sadness, fear, and disgust. Component 7 consists of three items which target strategies for regulating fear, anger, and disgust. The target emotion of each item is presented in Table 5. The scores for each component and the total score were obtained by summing the correct answers for each component and for the total test.
Instruments for Validation
Receptive vocabulary was assessed both in a subsample of the norm sample and in the FTT sample with the German version of the Peabody Picture Vocabulary Test (PPVT-4) (92). The PPVT-4 was designed for children between the ages of three and sixteen and consists of 228 items organized in an adaptive structure with age-related starting points as well as reversal and termination rules. The children are presented items consisting of four pictures. They are then asked to point to the picture which corresponds to the word named by the experimenter (“Point to...”). Thus, children can score a maximum of 228 points. The internal consistency of the PPVT-4 was very high in the FTT sample with Cronbach's α = 0.98.
The subtest Sentence Understanding of the German Language Development Test for 3- to 5-year-old children (SETK 3–5) (93) was used to assess sentence comprehension in a subsample of the norm sample and in the FTT sample. Children score points for carrying out the experimenter's instructions with various materials. The test contains 15 sentences of increasing grammatical complexity, resulting in the highest score of 15 points. In the norm sample Cronbach's α was 0.87 and in the FTT sample it was 0.88.
In the FTT sample, the Active Vocabulary Test-Revised (AWST-R) (94) was used to assess children's expressive vocabulary. It is suitable for children between the ages of three and five and a half years. The children are presented a series of cards on which objects or activities are depicted. For the 51 nouns, the interviewer asks the question “What is this?” and for the 24 verbs, “What does he/she do?” The test is terminated if the children cannot solve any of the first 10 items correctly. Correct answers yield the raw score, which can be compared to the test norms. The internal consistency of the AWST-R was very high, with Cronbach's α = 0.97.
Children's executive functions were measured in the form of behavioral self-regulation both in a subsample of the norm sample and in the FTT sample with the Head Toes Knees Shoulders Task (HTKS) (95). The HTKS was designed for children between the ages of three and six. Children are asked to do the opposite of what the experimenter did (e.g., “If I touch my head, you touch your toes”; “If I touch my toes, you touch your head”). After this first rule was tested in a 10-point block, a second rule and later a third rule were introduced: Touching the shoulders instead of the knees and vice versa. And then a mixture of the first two rules. Compliance with both and later all three rules was tested in a second and third block of 10 trials each. The children's correct responses (two points) and self-corrections (1 point) were tallied (0–60 points).
In the FTT study emotion knowledge was assessed using an abbreviated version of the Test of Emotion Comprehension (TEC) (89) which can be used for children between the ages of 3 and 10. The moral emotion component was omitted because it was too difficult for the 3- to 6-year-olds in the sample. Therefore, the test included 17 items in eight components. Gender-specific versions of the test booklet were available. The TEC contained one to five items for each component. The children looked at the test booklet together with the investigator and were asked to point to the correct emotion from a selection of four emotions. For each component solved, the children received one point, allowing them to score up to eight points. In the FTT sample, Cronbach's α was 0.64.
Results
Dimensionality
For the analysis of the dimensionality and the internal consistency of the ATEM 3–9 the software ACER ConQuest (96) was used. The ATEM 3–9 was constructed to measure seven components, that is, seven dimensions of emotion knowledge. Therefore, a seven-dimensional model was computed using the Monte Carlo estimator and 2000 nodes. For this, items 1–6 were assigned to the first component (facial recognition), items 7–12 to the second component (situational recognition), items 13–17 to the third component (desires), items 18–22 to the fourth component (mixed emotions), items 23–27 to the fifth component (beliefs), items 28–32 to the sixth component (display rules), and items 33–35 to the seventh component (emotion regulation strategies). The seven-dimensional model was compared to a unidimensional model computed using Gaussian quadrature. The comparison to a one-dimensional model was chosen to make sure that emotion knowledge captured by the ATEM 3–9 is a multidimensional construct. Only then would an evaluation at the component level make sense. Although there is, for example, the three-factorial model of emotion understanding by Castro et al. (97), the ability domains contained there are not fully covered by the components of the ATEM 3–9. This precludes a comparison with this model. Unlike a factor analysis within the framework of classical test theory, MIRT does not focus on model fit and model comparison, but rather on the individual fit of the items. Nevertheless, it is possible to compare different models with a Chi-square test. A comparison of the seven-dimensional model with the one-dimensional model revealed that the deviance of the seven-dimensional model was significantly lower when compared to the deviance of the one-dimensional model (χ2(27, N = 882) = 770.54, p < 0.001). This suggests that the seven-dimensional model is the better model, which confirms the first hypothesis. Table 4 presents the correlations between the ability distributions of the components of ATEM 3–9 and the variances of the components for this model (latent correlations). The variances of components 3–6 are higher than those of components 1, 2 and 7, because most 3- to 6-year-olds did not score points on the components beyond the termination point after component 2, i.e., all items which follow the drop-out from the test are scored with zero points.
Table 4. Latent intercorrelations and variances of the ATEM 3–9 components.
Interitemcorrelations
All 35 items were correlated in the norm sample to identify items that did not share variance with others. According to Cohen (98), correlations with r ≥ 0.30 are considered medium and correlations with r ≥ 0.50 are considered high. The averaged correlations of the items within a component ranged from r = 0.14 (component 6) to r = 0.44 (component 4). The mean correlations of the items between components ranged from r = 0.16 (between components 1 and 6 and components 6 and 7) to r = 0.38 (between components 3 and 4). Almost all items correlated significantly with each other with r = 0.07 to r = 0.70 (p < 0.05). However, items 30 and 31 (in component 6) were significantly correlated with only 12 (34%) other items each. Item 32 (in component 6) correlated significantly with 21 (60%) of the other items.
Itemfit
In a Rasch-scaled test, the item parameters should be distributed over the entire range of person parameters so that the entire range of performance of the tested persons is covered. Figure 1 compares the item and person parameters of the seven-dimensional model. Figure 1 suggests that the item parameters cover the person parameters well. For components 3–6, many children's scores are located in the lower range of the performance spectrum whose performance levels are not covered by test items.
Figure 1. Item- and person parameters of the ATEM 3–6 dimensions.
Table 5 lists the individual items of the components of the ATEM 3–9 with their psychometric properties. This includes the item difficulty (p), which indicates the proportion of children who solved this item correctly. It is also reported as a standardized item parameter with the associated standard error. At a solution probability of 50%, i.e., an average item difficulty, the item parameter is zero. The smaller the value, the lower the difficulty. According to Fisseni (99), the discriminatory power (ri(t−i)) should be at least 0.30, very discriminatory items are > 0.50. The fit of an item to the Rasch model is estimated with the weighted root mean square (WMNSQ), and the associated t-value. The expected value of the WMNSQ is 1.00. It should not exceed 1.25, whereas a value below 1.00 is not considered to be a problem (100).
Table 5. Item characteristics of the ATEM 3–9.
Item 11 (WMNSQ = 1.13, t = 3.7), Item 15 (WMNSQ = 1.12, t = 3.0), Item 16 (WMNSQ = 1.11, t = 2.7), Item 17 (WMNSQ = 1.23, t = 4.7), Item 22 (WMNSQ = 1.16, t = 2.3), Item 24 (WMNSQ = 1.20, t = 4.0), and Item 33 (WMNSQ = 1.16, t = 4.5) deviated significantly from the expected value of 1.00 but were below 1.25. The discriminatory power of the items ranged from ri(t−i) = 0.12 to ri(t−i) = 0.79. Especially the three very difficult items on Display Rules in component 6 (items 30 to 32) showed an insufficient discriminatory power. Only 3 and 4% of the children, respectively, were able to solve these items correctly.
The skip and termination rules of the components stipulate that the first two components, i.e., the first 14 items (including the two items of component 7 on emotion regulation strategies), should be presented to every child. A linear increase in difficulty within these components to capture children's abilities is therefore not necessary. This requirement is fulfilled nevertheless with one exception each in component 1 (items 3 and 4) and component 2 (items 7 and 8). Within components 3 to 7, the difficulties always increase from the first to the last item of the component with one exception in two adjacent items each (components 3: items 15 and 16; component 4: items 19 and 20; component 5: items 26 and 27; component 6: items 28 and 29).
Table 6 shows the averaged item scores of the components of ATEM 3–9. Item difficulties/item parameters increased from the first to the sixth component. In addition, EAP/ PV reliabilities, a measure of internal consistency which should be interpreted like Cronbach's alpha (101), of the components ranged from 0.78 to 0.91.
Table 6. Mean item characteristics for the components of the ATEM 3–9.
Validity
For the norming procedure, children of the norm sample were divided into seven age groups. Raw scores were calculated at both the level of the total test and the level of the individual components for each of the age groups. The less demanding components 1 and 2 (and component 7) showed rather left-skewed distributions especially among the older children, whereas components 3 to 6 showed extremely right-skewed distributions among the younger children due to the frequent use of the test termination criterion after component 2, which resulted in a score of 0 for all subsequent items. The distribution of the total raw scores of the ATEM 3–9 for the different age groups is depicted in Figure 2. The figure also shows that the values for the younger children assume a rather right-skewed distribution and for the older children a rather left-skewed distribution. In component 6, no child reached the maximum score of five points. Thus, the maximum score of 35 points on the overall test was not reached either. Among the 120 3-year-olds, 111 (96%) terminated the test after component 2 because of the termination rule. For three of the remaining nine children, the skipping rule was applied in component 3 and for four of them in components 4–6. At 4 years of age, 67% of the children terminated the ATEM 3–9 after component 2 and 3% (component 3) to 23% (component 5) of the children who continued the test skipped items of the following components.
Figure 2. Distribution of the total raw score of the ATEM 3–9 grouped by age.
Differential item functioning (DIF) analyses were conducted in ConQuest to investigate the effects of children's age, gender, and multilingualism on all component scores and the total score of the ATEM 3–9. The deviances of person parameters from zero for age groups, gender, and multilingualism are displayed in Table 7. Overall, the difference between the person parameters of all adjacent age groups varied between 0.028 (6- and 7-year-olds in the total score) and 1.841 (3- and 4-year-olds in component 4). In summary, the mean performance of the 3-year-olds was lowest in all components and the total test, and that of 8-year-olds was highest in components 2–7 and in the total test. Only in component 1 did the 9-year-olds perform better than the 8-year-olds. In accordance with the age-related differences on the component level, age-related DIF was evident in the majority of items, especially for 3- and 8-year-olds. Alltogether, the results were in line with the second hypothesis.
Table 7. Person parameter deviance estimates from zero of age groups, gender, and multilingualism for the components and the total scale of the ATEM 3–9.
In line with hypothesis 3, girls scored higher on all components and on the total score of the ATEM 3–9 than boys. The lowest deviance of the person parameters from zero was in component 6. However, the estimated deviances were low in all components. Gender-related DIF was found for the items 10, 22, and 26. In two items, boys scored lower than girls. DIF was small with estimated deviances from zero between 0.302 (SE = 0.114) and 0.332 (SE = 0.085)
Because multilingual children scored significantly lower on all components except for component 1, their total score was lower. All estimated deviances from zero were very low in components 1 and 2 and slightly higher in the more complex components, which is in line with hypothesis 4. The highest deviance was found in component 5. DIF for multilingualism was found for eight items (items 3, 8, 11, 14, 16, 19, 20, 33). However, monolingual children scored higher than multilinguals on five of them (items 3, 8, 11, 16, 33) and lower on the other three (item 14, 19, 20). Highest deviance in favor of monolingual children was found for item 3 with 0.540 (SE = 0.110). Highest deviance in favor of multilingual children was found for item 19 with 0.490 (SE = 0.098).
To determine the convergent validity of the ATEM 3–9, the total score and the component scores from the norm sample and the FTT sample were correlated with the total score of the TEC and with the measures of expressive and receptive vocabulary and behavioral self-regulation while controlling for children's age and gender. For these analyses the software R (102) was used. The Pearson correlations are displayed in Table 8. All partial correlations with the ATEM 3–9 total score were significant. Also, all components correlated significantly with the Test of Emotion Comprehension (TEC) in the FTT sample. Especially for younger children, aged three to six, partial correlations with language abilities were medium sized and significant. For the small subsample of older children who took the receptive vocabulary test, the partial correlations were smaller and significant for only a few components. Partial correlations with behavioral self-regulation were rather small in both samples. In summary, these results are in line with hypothesis 5.
Table 8. Pearson correlations of ATEM 3–9 scores with other constructs, controlled for age and gender.
Because receptive grammar was strongly associated with multilingualism [t(49) = 4.616, p < 0.001], analyses of covariance were conducted to examine the effect of multilingualism on emotion knowledge beyond the effect of language abilities. When including the test of receptive grammar (Sentence Understanding) as a covariate, multilingualism showed a trend (p < 0.10) to explain additional variance of emotion knowledge for components 3, 4, and 7, and the total test score. For all other components, the effect of multilingualism on emotion knowledge was not significant beyond the effect of receptive grammar.
To calculate the criterion validity of the ATEM 3–9, a matching procedure (nearest neighbor matching) (103) was used to match each child from the psychiatric sample with a maximum of three children from the norm sample. On average, the groups did not differ in age, gender, or multilingualism. Due to missing values, group sizes differed according to the component of the ATEM 3–9 examined. T-tests were used to examine whether performance on the ATEM 3–9 differed between the groups. Due to the small size of the psychiatric sample and because it only involved children between the ages of six and nine, age was not included in the analyses. In line with hypothesis 6, there were significant differences in favor of the children from the norm sample in the components Facial Recognition [t(68) = 2.189, p = 0.032], Mixed Emotions [t(75) = 2.578, p = 0.012], Beliefs [t(100) = 2.776, p = 0.007], and Display Rules [t(64) = 3.121, p = 0.003]. This resulted in a significant difference between the two groups in the total test score [t(62) = 2.722, p = 0.008]. The difference between the means was rather small at 0.27 in component 1, but at 0.65, 0.65, and 0.51, respectively, in the other components, the differences were greater than half a point.
Discussion
The ATEM 3–9 was developed in accordance with IRT with the aim of assessing the emotion knowledge of children between 3 and 9 years of age. It measures seven components of emotion knowledge of increasing complexity in an adaptive design, which corresponds to the development of emotion knowledge in childhood (2). In the present work, the dimensional structure of the ATEM 3–9, the psychometric properties of the test items and the total test were examined as well as indicators of its reliability and validity.
Analyses within the framework of MIRT with test scores collected from N = 882 children showed that the seven-dimensional model of the ATEM 3–9 was superior to the unidimensional model of overall emotion knowledge. This result was in line with the first hypothesis. It confirms the hypothesis that emotion knowledge is composed of different components. The rather high latent correlations between the seven components suggest that they are not independent from each other but that they also do not measure the same dimension. High correlations rather indicate a high efficiency of the ATEM 3–9, because it is possible to obtain much information with few items, compared to a unidimensional solution for each component (104). High efficiency is also demonstrated by the good to very good reliability estimates of the components which could not have been achieved with several unidimensional analyses with so few items. With the ATEM 3–9 it is therefore possible to reliably examine children's performance on seven components of emotion knowledge with only one instrument. This is a unique characteristic of the test compared to tests like the TEC (89) or the Affective Knowledge Task (73, 105). Whereas a total score on the ATEM 3–9 means that the child's emotion knowledge is developed in an age-appropriate manner overall, it could be that above-average scores in one component of emotion knowledge are compensated by below-average scores in another component. Therefore, it is always recommended to interpret the results at the component level as well. Below-average scores in individual components point to areas which are possibly in need of intervention, while above-average scores in individual components can be considered resources.
In addition to some overlap in content, the mean partial correlation with the TEC as another measure of emotion knowledge indicates that the ATEM 3–9 does not measure exactly the same construct as the TEC. Given the only partially overlapping components of the ATEM 3–9 and the TEC, this is consistent with our expectations in hypothesis 5.
The increasing variances of the component ability distributions underline ATEM 3–9's ability to discriminate between individuals in the more complex components. Many of the younger children were able to solve only a minority of the items in components 3–6 or terminated the test after component 2 due to the termination rules. This is also evident in the distribution of the person- and item parameters in Figure 1, which showed that many persons in the lower range of the performance spectrum in component 3–6 were not covered by the test. The distribution of raw scores in Figure 2 corroborates this state of affairs. The fact that only 4% of the 3-year-olds and 33% of the 4-year-olds reached components 3–6 confirms that using the termination and skip rules was reasonable.
The ATEM 3–9's characteristics on the item and the component level confirm that the intended structure with increasing difficulties within and between components was successfully implemented. The few exceptions were not important for an accurate description of a child's ability because the solution of these items did not affect the application of skip- or termination rules. No item exceeded the expected value of the WMNSQ of 1 to such an extent that the fit of the item to the Rasch model could no longer be assumed. In addition, the discriminatory power of the items was good, except for three items of component 6.
Three of the items in component 6 correlated with only 34 and 60% of the other items. As the item characteristics show, these items were solved correctly by only 3 and 4% of the children and thus had insufficient discriminatory power. The text load of these items is very high, and children must remember much complex information. The correlations of component 6 with behavioral self-regulation, which includes aspects of working memory, was rather high, when compared to the correlations of behavioral self-regulation with the other components. Thus, the reason for the high difficulty (or low probability of solving these items) may have been not so much the lack of children's emotion knowledge, but rather the complexity of the items and their demands on working memory. However, emotion knowledge is not completely detached from working memory. Even in everyday social interactions much information must be processed in working memory in order to be able to make person- and situation-specific statements about their emotional states. Executive functions should rather be regarded as an integral part of emotion knowledge. This is also supported by results from Morra et al. (22) who found that the effect of age dropped below significance when working memory was entered as a predictor of emotion knowledge. Older children with more developed working memory capacities may be better able to solve the more difficult items of component 6. Rather than violating the fixed structure of the ATEM 3–9 by excluding these items, the heavy demands on working memory suggest that extending the age range of the ATEM 3–9 to 10- and 11-year-olds may be appropriate.
An additional argument for an extension of the age range lies in the fact that so far no child in the present sample of over 800 children has reached the full score of 35 points in the ATEM 3–9. Nevertheless, as expected, children's performance on the ATEM 3–9 improved with age, which supports our second hypothesis and previous studies on emotion knowledge (2, 58, 106). The 5-year-olds showed the smallest deviations of the person parameters from the mean (from zero). Differences between neighboring age groups were small but significant in most cases. Providing different norm tables of the ATEM 3–9 for the different age groups is therefore necessary.
Male and female children differed significantly at the component level and at the total score. Differences were the smallest in component 6 and at the level of the total score. This meets our expectations in hypothesis 3 and confirms previous research on gender differences in emotion knowledge, which concludes that there are no or minimal differences in general emotion knowledge but remarkable differences in individual components (4, 22, 60, 62, 67). However, many of these gender differences depended partly on age (4). Because small groups resulted when dividing children into different age- and gender-groups, separate norm tables for boys and girls could not be realized. However, gender differences should be kept in mind, when interpreting and comparing ATEM 3–9 scores.
The performance of children growing up in multilingual families did not differ from the performance of children growing up in monolingual homes in component 1, i.e., Facial Recognition. This is the component which contains the least amount of text and therefore places the least demands on children's receptive language skills. In line with hypothesis 4 , the difference between the monolingual and multilingual group were the greatest in component 4. When Sentence Understanding was included in analyses of covariance as a covariate, growing up with multiple languages contributed to the explanation of additional variance of emotion knowledge only for some components as a trend. These results suggest that less developed language skills may be more important predictors of children's emotion knowledge than cultural aspects of multilingualism, such as having one or two parents who were born abroad. In order to account for these differences, separate norm tables for monolingual children on the one hand and monolingual and multilingual children on the other hand were generated for the ATEM 3–9. Due to the small proportion of multilingual children in the norm sample, it was not possible to create separate norm tables for these children. When interpreting the results in the ATEM 3–9 from multilingual children, the mixed norm table will give somewhat less strict cutoff values. Conversely, monolingual children are rated more strictly because possible effects of language skills that attenuate cutoff scores are accounted for in the norm table for monolingual children. However, when assessing children's emotion knowledge with the ATEM 3–9 and interpreting the results, language abilities should be kept in mind as a possible influence.
When comparing the performance of children with a mental disorder with their typically developing agemates the former tended to show a less developed emotion knowledge than the latter. This is consistent both with hypothesis 6 and with previous findings that the emotional competencies of children with various mental disorders are often not developed in an age-appropriate manner (38, 42, 107). This result provides not only evidence for the criterion validity of the ATEM 3–9, but also demonstrates the value of the ATEM 3–9 for clinical practice, where instruments for reliably assessing the individual components of emotion knowledge – particularly the more sophisticated ones – have not been available so far.
Limitations
In addition to the many advantages of the ATEM 3–9, some limitations must be noted. On the side of the study, larger groups of children of different ages and sociodemographic characteristics should be addressed in future research to gain more information of, for example, gender differences in emotion knowledge for children of different ages. In addition, the question of whether the ATEM 3–9 is appropriate for 10- and 11-year-olds remained open, because no ceiling effects appeared in the performances. More data should also be obtained on immigrant children or on children growing up in multilingual families to account for their less developed language abilities in norm data. Clinical samples should be divided by specific disorders before comparing the children in treatment with their typically developing agemates. This was not possible in the present sample due to the small sample size. Thus, larger clinical samples are needed. On the side of the ATEM 3–9, some items in component 6 seemed to be too difficult for most children, even for the oldest ones. In a future revision of the ATEM 3–9, assessing the knowledge of emotional display rules should be carried out in a manner that requires less working memory capacity. This can be done, for example, by condensing the text of the items even further. Items which showed DIF regarding gender or multilingualism should also be revised and adjusted, for example, by changing response options.
Areas of Application of the ATEM 3–9
The ATEM 3–9 was developed to measure children's emotion knowledge from the perspective of developmental psychology and psychopathology. The reliable assessment of individual components makes the ATEM 3–9 well suited for profile analyses which illustrate well-developed and poorly developed domains of emotion knowledge. This can be helpful when trying to identify a child's emotional resources. The ATEM 3–9 is also well suited for monitoring the development of emotion knowledge, after an intervention or prevention program, a social training, a mindfulness intervention, or during psychotherapy. The assessment of emotion knowledge is also particularly interesting in the case of mental disorders in children [e.g., attention deficit (hyperactivity) disorder, autistic spectrum disorders, social behavior disorder, affective disorders, etc.] as well as in the case of developmental delays in emotional competencies. Because children's emotion knowledge contributes to the explanation of their academic skills (36), using the ATEM 3–9 in educational-psychological research and practice is also conceivable. Because the ATEM 3–9 is available in German, English, and Hebrew it can also be used in cross-cultural comparisons. Moreover, in a small sample of N = 21 children who performed the ATEM 3–9 via tele-assessment, 86% reported that they enjoyed completing the ATEM 3–9 (108). This is consistent with the positive feedback that was provided by many children of the norm sample and the FTT sample.
Conclusion
In summary, in the present study with norm data from Germany, the ATEM 3–9 has a seven-dimensional structure which aligns with the seven components of emotion knowledge that it aims to measure. Most of the 35 items showed a good item fit with increasing item difficulties within and between the components. Revising three very difficult items in the component that assesses the knowledge about display rules may be reasonable. Future research should also examine whether the ATEM 3–9 is also appropriate for older children. Because the ATEM 3–9 is the first instrument which reliably depicts the development of individual components of children's emotion knowledge it seems to be not only valuable as a performance test of an important component of emotional competence but also useful for clinical research and practice.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by Ethics Committee of Leuphana University Lüneburg. Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.
Author Contributions
KV and MS contributed to the design of the study, manuscript revision, read, and approved the submitted version. KV organized the database and performed statistical analyses and wrote the first draft of the article.
Funding
ATEM 3–9 data were collected in the multicenter Feeling Thinking Talking study which was funded by the German Federal Ministry for Family, Senior Citizens, Women, and Youth under the grant BIS00.00007.16.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We thank the children, parents, (early childhood) teachers, and administrators who took part in the studies reported here. We are indebted to our colleagues Gisa Aschersleben and Corina Möller (both University Saarbrücken), Anne Mareike Möller (University Leipzig), and Gerlind Grosse (University of Applied Sciences Potsdam) as well as to several psychotherapists in private practice and in the Department of Child and Adolescent Psychiatry of Innsbruck University (Kathrin Sevecke) who contributed to the collection of the norm data for the ATEM 3–9. In addition, we appreciate the cooperation with Katja Koch (Technical University Braunschweig), Claudia Mähler and Peter Cloos (both University Hildesheim) who collected ATEM 3–9 data in the multicenter Feeling Thinking Talking study. We gratefully acknowledge the help of the many doctoral and post-doctoral students and research assistants who contributed to the collection and organization of the data.
References
1. Castro VL, Cheng Y, Halberstadt AG, Grühn D. EUReKA! A conceptual model of emotion understanding. Emotion Rev. (2016) 8:258–68. doi: 10.1177/1754073915580601
2. Pons F, Harris PL, de Rosnay M. Emotion comprehension between 3 and 11 years: developmental periods and hierarchical organization. Eur J Dev Psychol. (2004) 1:127–52. doi: 10.1080/17405620344000022
3. Streubel B, Gunzenhauser C, Grosse G, Saalbach H. Emotion-specific vocabulary and its contribution to emotion understanding in 4- to 9-year-old children. J Exp Child Psychol. (2020) 193:104790. doi: 10.1016/j.jecp.2019.104790
4. Zajdel RT, Bloom JM, Fireman G, Larsen JT. Children's understanding and experience of mixed emotions: the roles of age, gender, and empathy. J Genet Psychol. (2013) 174:582–603. doi: 10.1080/00221325.2012.732125
5. Denham SA. Emotional Development in Young Children. The Guilford Series on Social and Emotional Development. New York, NY: Guilford Press (1998).
6. Wellman HM, Banerjee M. Mind and emotion: Children's understanding of the emotional consequences of beliefs and desires. Br J Dev Psychol. (1991) 9:191–214. doi: 10.1111/j.2044-835X.1991.tb00871.x
7. Sidera F, Amadó A, Serrat E. Are you really happy? Children's understanding of real vs. pretend emotions. Curr Psychol. (2013) 32:18–31. doi: 10.1007/s12144-012-9159-9
8. Cole PM, Dennis TA, Smith-Simon KE, Cohen LH. Preschoolers' emotion regulation strategy understanding: relations with emotion socialization and child self-regulation. Soc Dev. (2009) 18:324–52. doi: 10.1111/j.1467-9507.2008.00503.x
9. De Stasio S, Fiorilli C, Di Chiacchio C. Effects of verbal ability and fluid intelligence on children's emotion understanding. Int J Psychol. (2014) 49:409–14. doi: 10.1002/ijop.12032
10. von Salisch M, Hänel M, Denham SA. Self-regulation, language skills, and emotion knowledge in young children from northern Germany. Early Educ Dev. (2015) 26:792–806. doi: 10.1080/10409289.2015.994465
11. Conte E, Ornaghi V, Grazzani IG, Pepe A, Cavioni V. Emotion knowledge, theory of mind, and language in young children: testing a comprehensive conceptual model. Front Psychol. (2019) 10:2144. doi: 10.3389/fpsyg.2019.02144
12. Grazzani I, Ornaghi V, Conte E, Pepe A, Caprin C. The relation between emotion understanding and theory of mind in children aged 3 to 8: the key role of language. Front Psychol. (2018) 9:724. doi: 10.3389/fpsyg.2018.00724
13. Brock LL, Kim H, Kelly CL, Mashburn AJ, Grissmer DW. Theory of mind, directly and indirectly, facilitates kindergarten adjustment via verbal ability, executive function, and emotion knowledge. Psychol Sch. (2018) 56:176–93. doi: 10.1002/pits.22216
14. Ketelaars MP, van Weerdenburg M, Verhoeven L, Cuperus JM, Jansonius K. Dynamics of the theory of mind construct: a developmental perspective. Eur J Dev Psychol. (2010) 7:85–103. doi: 10.1080/17405620903482081
15. Wang X, Liu X, Feng T. The continuous impact of cognitive flexibility on the development of emotion understanding in children aged 4 and 5 years: a longitudinal study. J Exp Child Psychol. (2021) 203:105018. doi: 10.1016/j.jecp.2020.105018
16. Fujiki M, Spackman MP, Brinton B, Illig T. Ability of children with language impairment to understand emotion conveyed by prosody in a narrative passage. Int J Lang Commun Disord. (2008) 43:330–45. doi: 10.1080/13682820701507377
17. Rieffe C, Wiefferink CH. Happy faces, sad faces: emotion understanding in toddlers and preschoolers with language impairments. Res Dev Disabil. (2017) 62:40–9. doi: 10.1016/j.ridd.2016.12.018
18. Sarmento-Henrique R, Quintanilla L, Lucas-Molina B, Recio P, Giménez-Dasí M. The longitudinal interplay of emotion understanding, theory of mind, and language in the preschool years. Int J Behav Dev. (2020) 44:236–45. doi: 10.1177/0165025419866907
19. Ogren M, Johnson SP. Factors facilitating early emotion understanding development: contributions to individual differences. Hum Dev. (2021) 64:108–18. doi: 10.1159/000511628
20. Tang Y, Harris PL, Zou H, Wang J, Zhang Z. The relationship between emotion understanding and social skills in preschoolers: the mediating role of verbal ability and the moderating role of working memory. Eur J Dev Psychol. (2021) 18:593–609. doi: 10.1080/17405629.2020.1854217
21. Martins EC, Osório A, Veríssimo M, Martins C. Emotion understanding in preschool children: the role of executive functions. Int J Behav Dev. (2016) 40:1–10. doi: 10.1177/0165025414556096
22. Morra S, Parrella I, Camba R. The role of working memory in the development of emotion comprehension. Br J Dev Psychol. (2011) 29(Pt 4):744–64. doi: 10.1348/2044-835X.002006
23. Thompson SF, Zalewski M, Kiff CJ, Moran L, Cortes R, Lengua LJ. An empirical test of the model of socialization of emotion: maternal and child contributors to preschoolers' emotion knowledge and adjustment. Dev Psychol. (2020) 56:418–30. doi: 10.1037/dev0000860
24. von Salisch M, Denham SA, Koch T. Emotion knowledge and attention problems in young children: a cross-lagged panel study on the direction of effects. J Abnorm Child Psychol. (2017) 45:45–56. doi: 10.1007/s10802-016-0157-5
25. Farrell CB, Gilpin AT. Longitudinal bidirectionality of emotion knowledge and inhibitory control in low-income children using cross-lagged panels. Soc Dev. (2021) 30:1006–22. doi: 10.1111/sode.12523
26. Denham SA, Brown CA. “Plays nice with others”: social-emotional learning and academic success. Early Educ Dev. (2010) 21:652–80. doi: 10.1080/10409289.2010.497450
27. Sette S, Spinrad TL, Baumgartner E. The relations of preschool children's emotion knowledge and socially appropriate behaviors to peer likability. Int J Behav Dev. (2017) 36:1–10. doi: 10.1177/2F0165025416645667
28. Wang Y, Hawk ST, Tang Y, Schlegel K, Zou H. Characteristics of emotion recognition ability among primary school children: relationships with peer status and friendship quality. Child Indic Res. (2019) 12:1369–88. doi: 10.1007/s12187-018-9590-z
29. Guo Q, Zhou J, Feng L. Pro-social behavior is predictive of academic success via peer acceptance: a study of Chinese primary school children. Learn Individ Differ. (2018) 65:187–94. doi: 10.1016/j.lindif.2018.05.010
30. Jurkowski S, Hänze M. A closer look at social skills and school performance: students' peer relations skills and assertion skills as predictors for their written and oral performances. Eur J Psychol Educ. (2017) 32:79–95. doi: 10.1007/s10212-015-0284-3
31. Rimm-Kaufman SE, Larsen RAA, Baroody AE, Curby TW, Ko M, Thomas JB, et al. Efficacy of the responsive classroom approach. Am Educ Res J. (2014) 51:567–603. doi: 10.3102/0002831214523821
32. Trentacosta CJ, Fine SE. Emotion knowledge, social competence, and behavior problems in childhood and adolescence: a meta-analytic review. Soc Dev. (2010) 19:1–29. doi: 10.1111/j.1467-9507.2009.00543.x
33. Gal-Szabo DE, Spinrad TL, Eisenberg N, Sulik MJ. The relations of children's emotion knowledge to their observed social play and reticent/uninvolved behavior in preschool: moderation by effortful control. Soc Dev. (2019) 28:57–73. doi: 10.1111/sode.12321
34. Qualter P, Urquijo I, Henzi P, Barrett L, Humphrey N. Ability emotional intelligence and children's behaviour in the playground. Soc Dev. (2019) 28:430–48. doi: 10.1111/sode.12340
35. McKown C, Russo-Ponsaran NM, Allen A, Johnson JK, Warren-Khot HK. Social-emotional factors and academic outcomes among elementary-aged children. Infant Child Dev. (2016) 25:119–36. doi: 10.1002/icd.1926
36. Voltmer K, von Salisch M. Three meta-analyses of children's emotion knowledge and their school success. Learn Individ Differ. (2017) 59:107–18. doi: 10.1016/j.lindif.2017.08.006
37. von Salisch M, Voltmer K. Sagt das Emotionswissen von jungen Kindern ihre phonologische Bewusstheit im Entwicklungsverlauf voraus? [Does emotion knowledge of young children predict their phonological awareness in the developmental course?]. Kindh Entwickl. (2020) 29:221–8. doi: 10.1026/0942-5403/a000320
38. Collin L, Bindra J, Raju M, Gillberg C, Minnis H. Facial emotion recognition in child psychiatry: a systematic review. Res Dev Disabil. (2013) 34:1505–20. doi: 10.1016/j.ridd.2013.01.008
39. Baron-Cohen S. Are autistic children “behaviorists”? An examination of their mental-physical and appearance-reality distinctions. J Autism Dev Disord. (1989) 19:579–600. doi: 10.1007/BF02212859
40. Baron-Cohen S. Do people with autism understand what causes emotion? Child Dev. (1991) 62:385–95. doi: 10.1111/j.1467-8624.1991.tb01539.x
41. Hadwin J, Baron-Cohen S, Howlin P, Hill K. Can we teach children with autism to understand emotions, belief, or pretence? Dev Psychopathol. (1996) 8:345–65. doi: 10.1017/S0954579400007136
42. Begeer S, Koot HM, Rieffe C, Meerum Terwogt M, Stegge H. Emotional competence in children with autism: diagnostic criteria and empirical evidence. Dev Rev. (2008) 28:342–69. doi: 10.1016/j.dr.2007.09.001
43. Rump KM, Giovannelli JL, Minshew NJ, Strauss MS. The development of emotion recognition in individuals with autism. Child Dev. (2009) 80:1434–47. doi: 10.1111/j.1467-8624.2009.01343.x
44. Baron-Cohen S, Golan O, Ashwin E. Can emotion recognition be taught to children with autism spectrum conditions? Philos Trans R Soc Lond B Biol Sci. (2009) 364:3567–74. doi: 10.1098/rstb.2009.0191
45. Vasilevska Petrovska I, Trajkovski V. Effects of a computer-based intervention on emotion understanding in children with Autism Spectrum Conditions. J Autism Dev Disord. (2019) 49:4244–55. doi: 10.1007/s10803-019-04135-5
46. Williams BT, Gray KM, Tonge BJ. Teaching emotion recognition skills to young children with autism: a randomised controlled trial of an emotion training programme. J Child Psychol Psychiatry. (2012) 53:1268–76. doi: 10.1111/j.1469-7610.2012.02593.x
47. Zhang S, Xia X, Li S, Shen L, Liu J, Zhao L, et al. Using technology-based learning tool to train facial expression recognition and emotion understanding skills of Chinese pre-schoolers with autism spectrum disorder. Int J Dev Disabil. (2019) 65:378–86. doi: 10.1080/20473869.2019.1656384
48. Leung FYN, Sin J, Dawson C, Ong JH, Zhao C, Veić A, et al. Emotion recognition across visual and auditory modalities in autism spectrum disorder: a systematic review and meta-analysis. Dev Rev. (2022) 63:101000. doi: 10.1016/j.dr.2021.101000
49. Salomone E, Bulgarelli D, Thommen E, Rossini E, Molina P. Role of age and IQ in emotion understanding in autism spectrum disorder: implications for educational interventions. Eur J Spec Needs Educ. (2019) 34:383–92. doi: 10.1080/08856257.2018.1451292
50. Tarullo AR, Youssef A, Frenn KA, Wiik K, Garvin MC, Gunnar MR. Emotion understanding, parent mental state language, and behavior problems in internationally adopted children. Dev Psychopathol. (2016) 28:371–83. doi: 10.1017/S095457941500111X
51. Martin SE, Williamson LR, Kurtz-Nelson EC, Boekamp JR. Emotion understanding (and misunderstanding) in clinically referred preschoolers: the role of child language and maternal depressive symptoms. J Child Fam Stud. (2015) 24:24–37. doi: 10.1007/s10826-013-9810-6
52. Bender PK, Pons F, Harris PL, Esbjørn BH, Reinholdt-Dunne ML. Emotion understanding in clinically anxious children: a preliminary investigation. Front Psychol. (2015) 6:1916. doi: 10.3389/fpsyg.2015.01916
53. Dede B, Delk L, White BA. Relationships between facial emotion recognition, internalizing symptoms, and social problems in young children. Pers Individ Dif. (2021) 171:110448. doi: 10.1016/j.paid.2020.110448
54. Acland EL, Jambon M, Malti T. Children's emotion recognition and aggression: a multi-cohort longitudinal study. Aggress Behav. (2021) 47:646–58. doi: 10.1002/ab.21989
55. Schuberth DA, Zheng Y, Pasalich DS, McMahon RJ, Kamboukos D, Dawson-McClure S, et al. The role of emotion understanding in the development of aggression and callous-unemotional features across early childhood. J Abnorm Child Psychol. (2019) 47:619–31. doi: 10.1007/s10802-018-0468-9
56. Yang Y, Wang Q. Emotion knowledge psychosocial adjustment in middle childhood: A cross-cultural longitudinal investigation. (2021) Available online at: https://psyarxiv.com/jmgqp/
57. Göbel A, Henning A, Möller C, Aschersleben G. The relationship between emotion comprehension and internalizing and externalizing behavior in 7- to 10-year-old children. Front Psychol. (2016) 7:1917. doi: 10.3389/fpsyg.2016.01917
58. Albanese O, Grazzani IG, Molina PFM, Antoniotti C, Arati L, Farina E, et al. Children's emotion understanding: preliminary data from the Italian validation project of test of emotion comprehension (TEC). In: Pons F, Daniel MF, Lafortune L, Doudin P-A, Albanese A, editors. Toward Emotional Competences. Chicago, IL: Aalborg University Press (2006), p. 39–53.
59. Bennett DS, Bendersky M, Lewis M. Antecedents of emotion knowledge: predictors of individual differences in young children. Cogn Emot. (2005) 19:375–96. doi: 10.1080/02699930441000201
60. Fidalgo AM, Tenenbaum HR, Aznar A. Are there gender differences in emotion comprehension? Analysis of the test of emotion comprehension. J Child Fam Stud. (2018) 27:1065–74. doi: 10.1007/s10826-017-0956-5
61. Kårstad SB, Wichstrøm L, Reinfjell T, Belsky J, Berg-Nielsen TS. What enhances the development of emotion understanding in young children? A longitudinal study of interpersonal predictors. Br J Dev Psychol. (2015) 33:340–54. doi: 10.1111/bjdp.12095
62. Bosacki SL, Moore C. Preschoolers' understanding of simple and complex emotions: Links with gender and language. Sex Roles. (2004) 50:659–75. doi: 10.1023/B:SERS.0000027568.26966.27
63. Garner PW, Waajid B. Emotion knowledge and self-regulation as predictors of preschoolers' cognitive ability, classroom behavior, and social competence. J Psychoeduc Assess. (2012) 30:330–43. doi: 10.1177/0734282912449441
64. Hughes C, Dunn J. ‘When I say a naughty word': a longitudinal study of young children's accounts of anger and sadness in themselves and close others. Br J Dev Psychol. (2002) 20:515–35. doi: 10.1348/026151002760390837
65. Merz EC, Zucker TA, Landry SH, Williams JM, Assel M, Taylor HB, et al. Parenting predictors of cognitive skills and emotion knowledge in socioeconomically disadvantaged preschoolers. J Exp Child Psychol. (2015) 132:14–31. doi: 10.1016/j.jecp.2014.11.010
66. Sette S, Bassett HH, Baumgartner E, Denham SA. Structure and validity of Affect Knowledge Test (AKT) in a sample of Italian preschoolers. J Genet Psychol. (2015) 176:330–47. doi: 10.1080/00221325.2015.1075466
67. McClure EB. A meta-analytic review of sex differences in facial expression processing and their development in infants, children, and adolescents. Psychol Bull. (2000) 126:424–53. doi: 10.1037/0033-2909.126.3.424
68. Fivush R, Brotman MA, Buckner JP, Goodman SH. Gender differences in parent–child emotion narratives. Sex Roles. (2000) 42:233–53. doi: 10.1023/A:1007091207068
69. Denham SA, Ferrier DE, Bassett HH. Preschool teachers' socialization of emotion knowledge: considering socioeconomic risk. J Appl Dev Psychol. (2020) 69:101160. doi: 10.1016/j.appdev.2020.101160
70. Heinze JE, Miller AL, Seifer R, Locke R. Emotion knowledge, loneliness, negative social experiences, and internalizing symptoms among low-income preschoolers. Soc Dev. (2015) 24:240–65. doi: 10.1111/sode.12083
71. Izard CE, Fine SE, Schultz D, Mostow AJ, Ackerman BP, Youngstrom EA. Emotion knowledge as a predictor of social behavior and academic competence in children at risk. Psychol Sci. (2001) 12:18–23. doi: 10.1111/1467-9280.00304
72. Miller AL, Gouley KK, Seifer R, Zakriski A, Eguia M, Vergnani M. Emotion knowledge skills in low-income elementary school children: associations with social status and peer experiences. Soc Dev. (2005) 14:637–51. doi: 10.1111/j.1467-9507.2005.00321.x
73. Denham SA, Bassett HH, Way E, Mincic M, Zinsser K, Graling K. Preschoolers' emotion knowledge: Self-regulatory foundations, and predictions of early school success. Cogn Emot. (2012) 26:667–79. doi: 10.1080/02699931.2011.602049
74. Denham SA, Bassett HH, Brown CA, Way E, Steed J. “I Know How You Feel”: Preschoolers' emotion knowledge contributes to early school success. J Early Child Res. (2013) 13:252–62. doi: 10.1177/1476718X13497354
75. Skalická V, Wold Hygen B, Stenseng F, Kårstad SB, Wichstrøm L. Screen time and the development of emotion understanding from age 4 to age 8: a community study. Br J Dev Psychol. (2019) 37:427–43. doi: 10.1111/bjdp.12283
76. Doan SN, Wang Q. Maternal discussions of mental states and behaviors: relations to emotion situation knowledge in European American and immigrant Chinese children. Child Dev. (2010) 81:1490–503. doi: 10.1111/j.1467-8624.2010.01487.x
77. Downs A, Strand PS, Cerna S. Emotion understanding in English- and Spanish-speaking preschoolers enrolled in Head Start. Soc Dev. (2007) 16:410–39. doi: 10.1111/j.1467-9507.2007.00391.x
78. Wang Q. Emotion situation knowledge in American and Chinese preschool children and adults. Cogn Emot. (2003) 17:725–46. doi: 10.1080/02699930302285
79. Wang Q. Emotion knowledge and autobiographical memory across the preschool years: a cross-cultural longitudinal investigation. Cognition. (2008) 108:117–35. doi: 10.1016/j.cognition.2008.02.002
80. Garrett-Peters P, Mills-Koonce R, Zerwas S, Cox M, Vernon-Feagans L. Fathers' early emotion talk: associations with income, ethnicity, and family factors. J Marriage Fam. (2011) 73:335–53. doi: 10.1111/j.1741-3737.2010.00810.x
81. Raval VV, Walker BL. Unpacking ‘culture': caregiver socialization of emotion and child functioning in diverse families. Dev Rev. (2019) 51:146–74. doi: 10.1016/j.dr.2018.11.001
82. Wang Q. “Did you have fun?”: American and Chinese mother–child conversations about shared emotional experiences. Cogn Dev. (2001) 16:693–715. doi: 10.1016/S0885-2014(01)00055-7
83. von Salisch M, Voltmer K, Miller-Slough R, Chih J-C, Denham SA, Emotions and social development in childhood. In: Smith PK, Hart CH, editors. The Wiley-Blackwell Handbook of Childhood Social Development, (3rd ed.). Hoboken, NJ: John Wiley and Sons Ltd (2022), p. 631–50. doi: 10.1002/9781119679028.ch34
84. Halberstadt AG, Cooke AN, Hagan CA, Liu X. Perceived: perceptions of children's emotions in videos, evolving and dynamic task. Emotion. (2021) 21:1781–95. doi: 10.1037/emo0001019
85. Denham SA. Social cognition, prosocial behavior, and emotion in preschoolers: contextual validation. Child Dev. (1986) 57:194–201. doi: 10.2307/1130651
86. Izard CE, Haskins FW, Schultz D, Trentacosta CJ, King KA. Emotion Matching Task. Unpublished test (Contains 182 Standardized Color Photos of Children's Emotion Expressions). Newark, DE: University of Dalaware (2003).
87. Morgan JK, Izard CE, King KA. Construct validity of the emotion matching task: preliminary evidence for convergent and criterion validity of a new emotion knowledge measure for young children. Soc Dev. (2010) 19:52–70. doi: 10.1111/j.1467-9507.2008.00529.x
88. Barbosa-Leiker C, Strand PS, Mamey MR, Downs A. Psychometric properties of the emotion understanding assessment with Spanish- and English-speaking preschoolers attending Head Start. Assessment. (2014) 21:628–36. doi: 10.1177/1073191114524017
89. Pons F, Harris PL. Test of Emotion Comprehension: TEC. Oxford: University of Oxford (2000). Available online at: http://books.google.de/books?id=6jrGPgAACAAJ
90. von Salisch M, Hormann O, Cloos P, Koch K, Mähler C. Fühlen Denken Sprechen: Alltagsintegrierte Sprachbildung in Kindertageseinrichtungen [Feeling Thinking Talking: Language Education Integrated Into Daily Life in Child Day Care Facilities]. Munster: Waxmann Verlag. (2021). doi: 10.31244/9783830993025
91. Voltmer K, Hormann O, Pietsch M, Maehler C, von Salisch M. Teaching the teachers about language support strategies: effects on young children's language development. Front Psychol. (2021) 12:660750. doi: 10.3389/fpsyg.2021.660750
92. Lenhard A, Segerer R, Lenhard W, Suggate SP. Peabody Picture Vocabulary Test, 4th ed. Gottingen: Hogrefe (2015).
93. Grimm H. SETK 3-5: Sprachentwicklungstest für drei- bis fünfjährige Kinder (3;0-5;11 Jahre): Diagnose von Sprachverarbeitungsfähigkeiten und auditiven Gedächtnisleistungen [Language Development Test For Three- To Five-Year-Old Children], 3rd ed.. Gottingen: Hogrefe (2015).
94. Kiese-Himmel C. Aktiver Wortschatztest für 3- bis 5-jährige Kinder – Revision [Active Vocabulary Test - Revision], 1st ed. Göttingen: Beltz Test(2005).
95. Ponitz CE, McClelland MM, Jewkes AM, Connor CM, Farris CL, Morrison FJ. Touch your toes! Developing a direct measure of behavioral regulation in early childhood. Early Child Res Q. (2008) 23:141–58. doi: 10.1016/j.ecresq.2007.01.004
96. Wu ML, Adams RJ, Wilson MR. ACER ConQuest Version 2.0: Generalised Item Response Modelling Software. Camberwell, VIC: ACER Press (2007).
97. Castro VL, Halberstadt AG, Garrett-Peters P. A three-factor structure of emotion understanding in third-grade children. Soc Dev. (2016) 25:602–22. doi: 10.1111/sode.12162
98. Cohen J. Statistical Power Analysis For the Behavioral Sciences, 2nd ed. Mahwah, NJ: Erlbaum (1988).
99. Fisseni H.-J. (2004). Lehrbuch der psychologischen Diagnostik: Mit Hinweisen zur Intervention [Teaching Book of Psychological Diagnostics: With notes for Intervention] (3rd ed.). Hogrefe.
100. Adams RJ, Wu ML. PISA Programme for International Student Assessment (PISA): PISA 2000 Technical Report. Berlin: OECD Publishing (2003). doi: 10.1787/9789264199521-en
101. Rost J. Lehrbuch Testtheorie – Testkonstruktion [Textbook Test Theory – Test Construction]. Atlanta, GA: Huber (2004).
102. R Core Team. R: A Language Environment For Statistical Computing (Version 4.1.2) [Computer software].Vienna: R Foundation for Statistical Computing (2021). Available online at: https://www.R-project.org/ (accessed February 23, 2022).
103. Caliendo M, Kopeinig S. Some practical guidance for the implementation of propensity score matching. J Econ Surv. (2008) 22:31–72. doi: 10.1111/j.1467-6419.2007.00527.x
104. Wang W-C, Chen P-H, Cheng Y-Y. Improving measurement precision of test batteries using multidimensional item response models. Psychol Methods. (2004) 9:116–36. doi: 10.1037/1082-989X.9.1.116
105. Bassett HH, Denham SA, Mincic M, Graling K. The structure of preschoolers' emotion knowledge: Model equivalence and validity using a structural equation modeling approach. Early Educ Dev. (2012) 23:259–79. doi: 10.1080/10409289.2012.630825
106. Nook EC, Stavish CM, Sasse SF, Lambert HK, Mair P, McLaughlin KA, et al. Charting the development of emotion comprehension and abstraction from childhood to adulthood using observer-rated and linguistic measures. Emotion. (2020) 20:773–92. doi: 10.1037/emo0000609
107. Da Fonseca D, Seguier V, Santos A, Poinso F, Deruelle C. Emotion understanding in children with ADHD. Child Psychiatry Hum Dev. (2009) 40:111–21. doi: 10.1007/s10578-008-0114-9
Keywords: emotion knowledge, children, adaptive test, development, measure, emotion understanding
Citation: Voltmer K and von Salisch M (2022) The Adaptive Test of Emotion Knowledge for 3-to 9-Year-Olds: Psychometric Properties and Validity. Front. Psychiatry 13:901304. doi: 10.3389/fpsyt.2022.901304
Received: 21 March 2022; Accepted: 20 June 2022;
Published: 08 July 2022.
Edited by:
Sakari Lemola, Bielefeld University, GermanyReviewed by:
Arnold Lohaus, Bielefeld University, GermanyUsama EL-Awad, Bielefeld University, Germany
Copyright © 2022 Voltmer and von Salisch. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Maria von Salisch, dm9uc2FsaXMmI3gwMDA0MDtsZXVwaGFuYS5kZQ==