- 1Neuropsychology Unit, IRCCS Fondazione Santa Lucia of Rome, Rome, Italy
- 2Department of Psychology, Sapienza Università di Roma, Rome, Italy
- 3Life, Health and Environmental Science Department, University of L'Aquila, L'Aquila, Italy
- 4Department of Medical and Surgical Sciences, University Magna Graecia, Catanzaro, Italy
- 5Department of Biotechnological and Applied Clinical Science, University of L'Aquila, L'Aquila, Italy
Unlike for other abilities, children do not receive systematic spatial orientation training at school, even though navigational training during adulthood improves spatial skills. We investigated whether navigational training programme (NTP) improved spatial orientation skills in pre-schoolers. We administered 12-week NTP to seventeen 4- to 5-year-old children (training group, TG). The TG children and 17 age-matched children (control group, CG) who underwent standard didactics were tested twice before (T0) and after (T1) the NTP using tasks that tap into landmark, route and survey representations. We determined that the TG participants significantly improved their performances in the most demanding navigational task, which is the task that taps into survey representation. This improvement was significantly higher than that observed in the CG, suggesting that NTP fostered the acquisition of survey representation. Such representation is typically achieved by age seven. This finding suggests that NTP improves performance on higher-level navigational tasks in pre-schoolers.
Introduction
Representing and transforming spatial information are everyday activities that are crucial to moving to a new town, reading and interpreting maps. Human navigation requires the ability to mentally transform images from two-dimensional to three-dimensional forms, similar to following a map to reach a goal in a new environment. It also requires recognizing a place from a different perspective and finding an alternative route when an initial route is interrupted. Navigational ability and spatial behavior develop gradually and at distinct time points during childhood (Siegel and White, 1975; Lehnung et al., 2003). According to Siegel and White's model 1975, environmental knowledge is acquired in three separate and distinct steps: (i) landmark knowledge, with which individuals are able to perceptually discriminate and recognize landmarks but are unable to derive directional information from them (the location of a landmark, its relation with the environment and its relation to other landmarks); (ii) route knowledge, with which directional information based on egocentric representation is added to landmark knowledge, allowing individuals to navigate by following directional instructions that link consecutive landmarks (e.g., turn right at the bakery to reach the theater); and (iii) survey knowledge, with which individuals build a mental map of the environment based on an allocentric frame of reference. The way in which environmental knowledge is acquired, as well as its organization continue to be debated. On the one hand, Siegel and White's Model suggests a hierarchical organization in which phases are acquired sequentially (Siegel and White, 1975). On the other hand, Montello (1998) suggests an environmental representation acquired simultaneously. One must distinguish between two different frames of reference in environmental mental representation, namely, egocentric and allocentric representations of the environment. Egocentric representation expresses the relation of an environmental object with respect to the self, and this frame of reference is generated from sensory data and may provide a direct basis for action; allocentric representation expresses the location of the environmental object with respect to an external frame of reference, which is more difficult to compute but provides a better basis for flexible navigation and long-term storage of complex layouts (Byrne et al., 2007). Egocentric and allocentric representations roughly correspond to the route and survey knowledge described in Siegel and White's Model. In route-based navigation, individuals use egocentric coordinates, whereas in survey-based navigation, they mainly use allocentric coordinates. The nature of spatial representation in the brain indicates the parallel presence of both survey and route knowledge. Individuals could proficiently shift from a route to a survey perspective (Taylor and Tversky, 1992), even if the environment has been learned using the other perspective (Boccia et al., 2016a). Neural activity within the brain network underlying human navigation, such as the parahippocampal place area (PPA) and the retrosplenial cortex (RSC) (Boccia et al., 2014, 2016b), has been found to depend on the familiarization and the type of strategy participants adopt in performing a topographical memory task (Boccia et al., 2016a). These findings suggest that these brain areas underlie the shift between different types of environmental knowledge, namely, route and survey knowledge. This result confirms the idea that environmental objects are processed in parallel in different formats and that a proficient shift from one format to another may occur from the first stage of environmental knowledge acquisition (Montello, 1998).
Regarding the development of navigational abilities during childhood, some competences are developed during the early years, while others require a longer time to become fully functioning. Overall, studies suggest that although some spatial knowledge may be innate, the majority of skills requires time to fully mature (Vasilyeva and Lourenco, 2012; Nys et al., 2015). Some of these skills develop early in life, such as the use of egocentric strategies to find a hidden target, reference memory and visuo-spatial working memory (Piaget and Inhelder, 1948; Acredolo, 1978; Bremner, 1978; Acredolo and Evans, 1980; Foreman et al., 1984, 1990), while others require a longer period to fully develop. For example, the development of navigational working memory is complete at ~10 years of age (Piccardi et al., 2014b). A similar developmental trajectory holds for the ability to construct a cognitive map of the environment based on distal cues, that is, a stable mental representation of navigational space (O'Keefe and Nadel, 1979). This competence becomes fully developed at approximately only 7 years of age (Overman et al., 1996; Lehnung et al., 1998, 2003). Later, by age 10, relational place strategies, which are necessary for cognitive mapping, develop (Overman et al., 1996; Lehnung et al., 1998). More recent studies suggest that by the age of 4, children use movement information or unique proximal landmarks to solve a viewpoint-independent reorientation task in which spatial recall cannot be performed using a stored view, that is, using a flexible representation of the environmental layout. Instead, a flexible recall from novel viewpoints is available by the ages of 6 to 8 (Nardini et al., 2009). Interestingly, 4-year-old children have some basic features of allocentric coding (Negen et al., 2017). Moreover, the spontaneous use of an allocentric world-centered representation of the environment progressively increases between 5 and 10 years of age (Bullens et al., 2010), even if younger children are able to use an allocentric strategy when aided (Bullens et al., 2010). Overall, these findings suggest that a “developmental window” occurs between 4 and 8 years of age and poses a new and fascinating question regarding whether specific formal training may foster navigational skills in children.
However, compared to other human skills (such as math, reading, writing, and problem solving) that receive formal training during childhood, spatial orientation is not strengthened through specific educational training at school, during childhood or later, with the exception of individuals trained to use this competence at higher levels in a professional context, e.g., aerospace pilots, astronauts, medical surgeons, topographers, or military raiders (Apuzzo, 1996; Verde et al., 2013, 2015, 2016). It is largely accepted that learning produces a brain re-organization that acts as a “brain reserve,” increasing the brain's tolerance to disease (Stern, 2012; Colangeli et al., 2016). It has been shown that the brain may be continuously modified by life experiences (Verde et al., 2013, 2015, 2016), even when the brain is affected by neuropathology or when cognitive training enhances the effect of pharmacological therapy (Onder et al., 2005). For this reason, navigational training in pre-schoolers may foster navigational ability and prevent the development of navigational disorders, such as developmental topographical disorientation (DTD: Iaria et al., 2005, 2009; Bianchini et al., 2010). DTD is a developmental disorder for which the etiology is currently unknown; no cerebral damage or psychiatric disorders have been associated with it. Iaria and Barton (2010) showed that DTD is widespread in the population, and the detailed descriptions of healthy individuals who suffer from DTD (refer to Bianchini et al., 2014b; Palermo et al., 2014; Nemmi et al., 2015; Piccardi et al., under revision) appear to suggest that this neurodevelopmental disorder should be monitored from childhood to prevent the persistence of the disorder in adults. The existence of DTD and its different types strongly suggests the importance of introducing navigational training during early infancy. Furthermore, navigational training may be useful for blind children. Research appears to suggest that children with visual impairments tend to rely on egocentric encoding (Ruggiero et al., 2009; Iossifova and Marmolejo-Ramos, 2013). Moreover, visually impaired children show a tendency for narrowing spatial frames by substituting the allocentric space with egocentric or bodily space (Iossifova and Marmolejo-Ramos, 2013). These findings appear to suggest that a lack of vision may affect allocentric but not egocentric frames of references.
Here, we aimed to investigate the effectiveness of navigational training programme (NTP) to develop spatial orientation skills in 4-year-old children based on Siegel and White's hierarchical model. According to the aforementioned studies, we expected that this early period of life may constitute a developmental window in which it is possible to observe training effects. With this aim, we administered a 12-week NTP and tested the children in both the training and control groups twice (before and after NTP) on navigational tasks that tap into landmark, route and survey knowledge (Figure 1A). We hypothesized that the NTP would yield a better performance on highly demanding navigational tasks (i.e., survey knowledge-based tasks; Figure 1A) in the training group (TG) than that seen in the control group, which was not exposed to the training. A comparison of these groups enabled us to subtract the normal development of these skills from the improvement produced by the NTP. We expected an earlier acquisition of the ability to form a cognitive map of the environment to be detected only in the group exposed to NTP.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/289751/fnins-11-00574-HTML/image_m/fnins-11-00574-g001.jpg)
Figure 1. Schematic depiction of tasks and results according to the stages of acquisition of spatial knowledge. (A) Siegel and White's model of acquisition of spatial knowledge. (B) Landmarks used during WalCT. (C) WalCT apparatus; (D) Sketch maps of the WalCT with and without landmarks are represented on the bottom-left and -right, respectively. (E) Drawing of the pathway in the L-WalCT and (F) the WL-WalCT outlines. (G) Landmark location on the map. Written informed consent was obtained from both parents of the child represented in the figure for the publication of this study.
Materials and Methodology
Participants
The present study was conducted in a sample of 34 typically developing Italian children (19 M and 15 F) who were recruited from a primary school, the “Istituto Comprensivo di Via Anagni,” in Rome (Italy). Ages ranged from 49 to 72 months (mean age = 63.09 months; SD = 2.12 months).
None of the children included in the study had primary visual or hearing impairments, had been diagnosed with a neurological condition or had ever exhibited emotional or behavioral problems. To determine their general cognitive level, all children were administered Raven's Colored Progressive Matrices (Raven, 1986; Belacchi et al., 2008); no difficulty in clear-thinking ability emerged. The study was approved by the local ethics committee of the Psychology Department of “Sapienza” University of Rome in accordance with the Declaration of Helsinki. Written and informed consent was obtained from the parents of each child. The children were subdivided into two groups consisting of 17 participants per group and were comparable in age [t(32) = 0.08; p = 0.93] and gender [chi-squared = 28.94; p = 0.62].
Instruments and Procedure
The children were tested individually in a quiet room in kindergarten. The TG was tested immediately before and after the NTP period at T0 and T1, respectively. The control group (CG), which received standard didactics, was tested at T0 and T1 without being subjected to a training procedure.
Training Procedure
NTP was conceived to enhance the visuo-spatial abilities that underlie human navigation, such as mental rotation (Piccardi et al., 2017), visuo-spatial and navigational memory (Piccardi and Nori, 2011), navigational planning (Bocchi et al., 2017), spatial orientation, left and right discrimination and spatial representation of the body according to Siegel and White's hierarchical model. Each activity fosters a specific level of the acquisition of navigational knowledge, namely, landmark, route, and survey knowledge. Thus, activities involving landmark and pictorial recognition and perceptual discrimination were thought to foster landmark representation; activities involving the acquisition of directional egocentric information were thought to foster the acquisition of route representation; finally, activities that targeted mental transformation and map-based orientation were thought to foster the acquisition of survey representation (see the description of activities below for details). The activities were administered according to the hierarchical model with increasing levels of difficulty. The NTP was administered at the school and covered 18 sessions (1.5 h each) during a period of 12 weeks (see Supplementary Figure 1A for the experimental timeline). The protocol comprised paper-and-pencil and navigational activities (see the detailed description of activities below). The experimenter ascertained that all children played together during navigational activities. Each session was structured to contain both types of activities. Most procedures were inspired by Piccardi (2011) and are subsequently described below according to the level they fostered.
Landmark Knowledge Acquisition
Colored Matrix (Visuo-Spatial Memory)
This task is a paper-and-pencil activity. The children were provided with a set of colored paper-and-pencil matrices (Supplementary Figure 1B) presented one by one in the center of a vertically aligned sheet of white paper (A4 format). In each matrix, boxes were only partially filled-in. The children were instructed to observe the colored boxes in the matrix. After 1 min of observation, the children were required to turn the page and fill-in the same boxes in an empty matrix. This task included seven trials, with increasing levels of difficulty.
Large-Scale Memory
This task is a practical spatial game. We developed a larger version of the classic “memory game,” the card game in which all cards are placed face down on a surface and only two cards may be turned face up during each turn. The object of the game is to turn over all pairs of matching cards. In the large-scale memory exercise, we used 10 pairs of pictures representing different animals (i.e., sheep, elephant, pig, crocodile), which were manually drawn by one of the authors (LPi) on sheets of white paper (A4 format) and were vertically placed on the floor of a large room covering a surface of 2.5 × 2.5 m. The children were divided into two teams. All participants on each team turned over a pair of sheets in turn. When a participant found the matching animal, the participant took both sheets, and another participant on the same team turned over another pair of sheets. When a participant failed to obtain a match, another participant attempted to obtain a match. The team with the highest number of matching sheets won the game.
Route Knowledge Acquisition
Paper-and-Pencil Labyrinth (Navigational Planning)
This task is a paper-and-pencil activity. The children were provided with a set of pictures, including (a) a subject (a child or an animal), (b) a goal target (e.g., food, water), and (c) a path between the subject and the goal target (Supplementary Figure 1C). They were instructed to draw the path the subject had to follow to reach his/her goal. For the first 8 trials, the path was unambiguous, whereas the last 3 trials showed a high level of complexity and some dead ends.
Joystick (Spatial Orientation and Left/Right Discrimination)
This task is a practical spatial game. A leader was selected among the children. All other children were required to place themselves in front of the leader. The leader verbally instructed the participants to move forward, backward, to the left, or to the right. He/she could give the instruction more or less quickly in order to make it more difficult for them participants to follow his/her instructions. The participants who got the order wrong were out of the game. The last player left became the leader of the following game session.
The Navigator (Spatial Orientation and Left/Right Discrimination)
This task is a practical spatial game. The players were divided into pairs comprising one player guiding (i.e., the guide) and the other navigating blindfolded (i.e., the navigator). At the end of each turn, the players traded places. A guide was chosen, and he/she hid an object. Each guide had to guide his/her blindfolded navigator to be the first to find the hidden object. Only directional (e.g., right, left) and numerical (e.g., 2 steps, 3 steps) cues were allowed. The first pair to find the object could hide it during the following turn and decide which pair should have the blindfolded navigator.
Paths (Spatial Orientation)
This task is a practical spatial game. The children were divided into teams. The teacher built a path, and each team, in turn, had to follow it. The team that completed the path the fastest won the game.
Juggle (Spatial Representation of the Body)
This task is a practical spatial game. Each child received a balloon to juggle. The first children were allowed to juggle with any part of the body. After this initial phase, the children were instructed to juggle with a specific part of the body (e.g., the right hand, the left foot). The child who kept the balloon for the longest time won the game.
Up and Down (Spatial Representation of the Body)
This task is a practical spatial game. The children were divided into two teams. The players on each team formed a line, and the first player of each line had a balloon. At a starting signal, the player with the balloon gave it to the player behind him/her by passing it over his/her head. The second player passed the balloon to the third player by passing it under his/her legs. The third player passed the balloon to the fourth player by passing it over his/her head and so on to the last player in the line. The team whose balloon reached the last player first won the game.
In and Out of the Hoop (Spatial Representation of the Body)
This task is a practical spatial game. The children were divided into two teams. The players of each team formed a line at ~2 m from the other team. A hoop was given to the first player of the line. At a starting signal, the player stepped into the hoop with his/her foot and lifted it up over his/her head. The player behind him/her grabbed the hoop and did the same, as did the other players until the last player in the line. The team that reached the last player first won the game.
Survey Knowledge Acquisition
Objects' Mental Rotation (Mental Rotation)
This task is a paper-and-pencil activity. The children were provided with a set of 10 sheets where (a) a target flower in the center of the sheet and (b) three test flowers below the target item (Supplementary Figure 1D) were depicted. Only one of the three test flowers corresponded to the target. The children were required to find the correct flower among the test flowers.
The Explorers (Spatial Orientation and Navigational Memory)
This task is a practical spatial game. The children were divided into teams or small groups and were invited to navigate through the school (e.g., visiting the garden) for ~15 min and register as many details (e.g., sounds, odors, objects, and positions) as possible. When they returned to the classroom, they were instructed to draw a map of the path they had taken. They were also required to answer questions regarding the details on their map. The team that drew the best map and answered the most questions won the game.
Testing Procedures
We tested verbal comprehension of spatial locatives using the Test for Reception of Grammar (TROG: Bishop, 1982; Italian version: Chilosi and Cipriani, 1995), which assesses grammatical comprehension from age 4 to adulthood. Each test stimulus is presented in a four-picture, multiple-choice format with lexical and grammatical foils. The grammatical complexity increases consistently from locative structure to active, passive, negative, dative and relative clauses. For experimental purposes, we selected only spatial locative sentences (14 sentences); these sentences included locative topological elements (below/above, up/down, in/out and near/far) and prospective locative elements (in front of/behind, from/to and between). The participants' task was to select the picture that matched a sentence spoken by the examiner; in the case of errors, the sentence was repeated. The score was 0 if the answer was immediately correct, 0.5 if the answer was correct after repetition and 1 if the answer was wrong.
Topographical learning (TL) was assessed using the Walking Corsi Test (WalCT: Piccardi et al., 2008, 2014a,b). The WalCT is a larger version (3 × 2.5 m; scale 1:10) of the Corsi Block Tapping Test (CBT; Corsi, 1972). It has been used for experimental and clinical purposes (Piccardi et al., 2008, 2014a,b; Bianchini et al., 2010, 2014a,b; Nemmi et al., 2013; Palermo et al., 2014) to investigate topographical memory by instructing individuals to reproduce a previously observed pathway. The WalCT is set up in an empty room. It is composed of nine black squares (30 × 30 cm) placed on the floor. This test is scaled to the standard CBT. The starting point is the black square located outside the layout.
In the WalCT, the examiner walks and stops on a series of squares. The subject must walk, reach different locations and reproduce the sequence demonstrated by the examiner. In this study, two aspects of topographical long-term memory were assessed, based on the results of a previous study (Piccardi et al., 2015): TL and topographical delayed recall (TDR) under two different conditions, namely, with landmarks (L-WalCT) and without landmarks (WL-WalCT) (Figures 1B–D). The only difference between the L-WalCT and WL-WalCT conditions was the presence in the L-WalCT of pictures of three landmarks placed on three black squares (Figure 1B).
In the TL, the children had to learn a fixed supra-span sequence, which was calculated according to their chronological age by considering the span plus 2 according to the median span sample of Piccardi et al.'s (2014b) study. Specifically, 4-year-old children had to learn a 4-block sequence (because the median span was 1.90 at this age). At each trial, after the examiner presented the sequence, the child was invited to step onto the carpet to reproduce it and step off the carpet when he/she had finished (Figures 1C–D). In each trial, the number of correct black squares reproduced in the sequence was calculated for the final score, but no feedback regarding performance correctness was provided. The learning criterion (indicating that learning was achieved) corresponds to three consecutive correct sequence reproductions; if the child did not achieve the learning criterion, the sequence was repeated for a maximum of 18 trials. The learning score was calculated by attributing one point for each square correctly walked until the criterion was achieved; the score corresponding to the correct performance of the remaining trials was added to this score (up to the 18th; maximum score: 72). After 5 min, the TDR was administered. The examiner instructed each participant to reproduce the previously learned four-block sequence in a single attempt. The score represented the number of squares correctly reproduced. TL and TDR may be considered as tapping into route knowledge (Siegel and White, 1975).
At the end of the L-WalCT, the children were shown 6 items on an A4 sheet (3 landmarks and 3 distractors). They had to indicate which of the landmarks were present in the L-WalCT (landmark recognition). An individual's score corresponded to the sum of correct responses (maximum score: 6). This task may be considered as tapping into landmark knowledge (Siegel and White, 1975). The children were subsequently instructed to place small pictures depicting 3 landmarks on an outline of the WalCT as they experienced them during the administration of the WalCT (landmark location). In this case, an individual's score also corresponded to the sum of correct responses (maximum score: 3) (Figure 1G). This task may be considered as tapping into survey knowledge (Siegel and White, 1975). At the end of both the L-WalCT and WalCT, the children were also instructed to use a felt-tip marker to retrace the pathways they had learned during the two conditions on the outline of the WalCT. An individual's score corresponded to the sum of the squares correctly identified during the line-tracing (drawing; maximum score: 4) (Figures 1E,F). The path line retracing in the drawing of both the L-WalCT and WL-WalCT may be considered the transposition of route knowledge on a map-like/survey representation of the environment and thus an intermediate stage between route- and survey-based knowledge representation (for a schematic depiction of tasks and knowledge representation, see Figures 1A,E,F).
Statistical Analysis
For analysis, 2 × 2 mixed factorial ANOVAs with Group (CT and TG) as the between factor and time (T0 and T1) as the repeated measures were performed to detect the effect of training on (1) spatial locative comprehension (the number of errors on the TROG), (2) landmark recognition, (3) TL in the L-WalCT, (4) TL in the WL-WalCT, (5) the TDR in the L-WalCT, (6) the TDR in the WL-WalCT, (7) the drawing of the path line on the L-WalCT and (8) on the WL-WalCT outline, and (9) landmark location on the map. The alpha level was set at p = 0.05. Eta effect sizes (η2) were computed for main and interaction effects. The benchmarks available to interpret η2 are 0.01–small, 0.06–medium, and 0.14–large (Kittler et al., 2007). However, these benchmarks have not been previously indicated for psychological data (as highlighted by Iossifova and Marmolejo-Ramos, 2013). Therefore, “as η can refer to linear and non-linear relationships, η can be considered a general case in which r is a special example (Rosenthal and Rosnow, 2008). Thus, the generally accepted regression benchmark for effect size r can be used to interpret η: small–0.10, medium–0.30, and large–0.50 (Cohen, 1992)” (p. 2178 in Iossifova and Marmolejo-Ramos, 2013). Post-hoc comparisons were performed by applying Bonferroni's correction for multiple comparisons.
Results
The children participated in the training sessions an average of 71.24% (SD = 12.92) of the “maximum” training time.
We identified a main effect of time on spatial locative comprehension as measured by the TROG [F(1, 32) = 17.89; p < 0.001; Partial Eta Squared = 0.36], with better performances at T1 (Table 1). No other effect was identified on the scores of the TROG.
A main effect of time was also identified for the TL in the L-WalCT [F(1, 32) = 6.93; p = 0.01; Partial Eta Squared = 0.18] with a similar effect in the WL-WalCT [F(1, 32) = 4.06; p = 0.05; Partial Eta Squared = 0.11]. For both tasks, performances were better at T1 (Table 1).
The ANOVA on performances in the landmark recognition (Table 1), as well as the ANOVAs on the TDR in the L-WalCT and the WL-WalCT (Table 1), showed no significant effects. The ANOVAs on the drawing of the path line showed a main effect of time both in the L-WalCT [F(1, 32) = 4.77; p = 0.04; Partial Eta Squared = 0.13] and the WL-WalCT outline [F(1, 32) = 10.29; p < 0.01; Partial Eta Squared = 0.24], with better performances at T1 (Table 1). Interestingly, the ANOVA on landmark location performances showed a group by time interaction effect [F(1, 32) = 6.49; p = 0.02; Partial Eta Squared = 0.17]. Post-hoc comparisons showed that the two groups significantly differed at T1 (p = 0.03 Bonferroni's correction for multiple comparisons), with the TG performing better than the CG (Table 1). Moreover, the children in the TG significantly ameliorated their performances at T1 compared with that at T0 (Figure 2).
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/289751/fnins-11-00574-HTML/image_m/fnins-11-00574-g002.jpg)
Figure 2. Averaged group performances (and standard deviations) on Landmark location on the map, before (T0) and after (T1) 12-weeks. CG, control group; TG, training group; *p = 0.007 with Bonferroni's correction for multiple comparisons.
Discussion
We hypothesized that navigational training during childhood may promote an earlier acquisition of high level spatial abilities. Unlike many other abilities, which receive educational training at school during childhood, spatial orientation does not receive systematic training. Nevertheless, high levels of navigational training in adulthood significantly improve spatial orientation ability (Verde et al., 2013, 2015, 2016). The present results show that NTP enhanced the ability to transform egocentric navigational information in a map-like, allocentric representation of the environment in 4- to 5-year old children.
As previously discussed, even if 4-year-old children have basic features of allocentric coding (Negen et al., 2017), children typically master this ability at ~7 years of age. Spatial orientation abilities are fully functioning by age 10, with an increase in the spontaneous use of allocentric world-centered representation of the environment (Bullens et al., 2010). Similarly, in this study, we found that children (mean 63.09 ± 2.12 months) who underwent NTP were more proficient in locating landmarks on a map than their peers who did not receive undergo NTP. This result suggests that NTP yields an earlier development of an allocentric world-centered representation of the environment. To locate landmarks on a map, children must translate egocentric tri-dimensional information regarding the environment they experience in an allocentric bi-dimensional representation. This operation is similar to a “cognitive map,” that is, a stable mental spatial representation independent of perception (Tolman, 1948; Boccia et al., 2017). When required to locate landmarks on a map, children must retrieve navigational information regarding their position from memory and convert it into a map-like representation. As a result of NTP, the children developed the ability to use allocentric coding earlier, and they could pinpoint a location in relation to other locations rather than using egocentric coding. The use of allocentric coding requires an individual to generate, maintain, inspect and transform an image in the mind. These aspects of mental imagery (Kosslyn, 1980) are pivotal to human navigation (Pazzaglia and De Beni, 2006; Palermo et al., 2012; Piccardi et al., 2017). The NTP encompassed activities involving mental rotation (i.e., mental transformation) and visuo-spatial memory (i.e., maintaining an online mental image), as well as activities focused on spatial orientation, left/right discrimination, navigational memory, and planning. The finding that the TG achieved the ability to use an allocentric coding earlier than the CG suggests that a formal training of visuo-spatial abilities that underlie human navigation (such as mental rotation, visualization, or navigational problem solving) improves the ability to transform egocentric representation into an allocentric representation.
Interestingly, our data suggest that the development of spatial locative comprehension and mastery of route knowledge-based tasks (i.e., L-WalCT and WL-WalCT) and the path-line drawing on a map (i.e., Drawing L-WalCT and Drawing WL-WalCT) spontaneously improved from T0 to T1 in the CG as well. In contrast, landmark location on the map is the only task significantly improved by NTP. Route knowledge-based tasks require only an egocentric frame of reference, which may also be used during a task that requires drawing a path. Individuals who have not fully developed an allocentric strategy may trace the line of the path by simply repeating the egocentric path they learned. Instead, when individuals are asked to locate landmarks on a map, they must use both egocentric and allocentric information. Thus, even if performances on route knowledge-based tasks spontaneously increase in 4- to 5-year-old children, the NTP allowed the children in the TG to move to the next developmental step, that is, to form and use an allocentric representation of space.
The TDR of a pathway (in both the L-WalCT and WL-WalCT) did not show an effect of time or training. It must be noted that performances on these tasks were subject to a ceiling effect by the T0. This result suggests that once a pathway is learned, its mental representation is stable and long-lasting. This finding is also in line with the performances of young adults in the same task (Piccardi et al., 2008, 2011, 2013).
Moreover, in landmark recognition, we did not identify an effect of time or NTP. We assume that this step is fully developed in 4- to 5-year-old children. It is a first step of environmental knowledge (Siegel and White, 1975) and includes the identification of landmarks (Thorndyke and Hayes-Roth, 1982). This finding is also in line with that of a previous study demonstrating that young individuals unfamiliar with the environment were able to identify landmarks but could not place them on a map (Nori and Piccardi, 2011). Landmark recognition is the first step in the familiarization process with a new environment (Nori and Piccardi, 2011). Interestingly, as opposed to landmark recognition, we found that children improve on the TL of the L-WalCT between T0 and T1. This result suggests that even if landmark recognition was fully achieved, the ability to integrate landmark-based knowledge with route-based knowledge in the L-WalCT is still developing at age 5. It must be noted that integrating landmark-based knowledge with route-based knowledge is a next step in the normal development of navigational skills. Navigation is typically expected to be easier when landmarks are available in the environment (Nico et al., 2008). Moreover, environments enriched in landmarks assist 5- to 7-year-old children in orienting themselves (Hermer-Vazquez et al., 2001), with an automatic shift toward a landmark-based strategy that results in a significant improvement in performances. This observation also holds in adulthood (Nico et al., 2008; Piccardi, 2009). However, a 20-year-old woman who has never been able to orient herself within the environment as a result of a congenital brain malformation showed the worst performance in a way-finding task when landmarks were available, despite preserved landmark identification (Iaria et al., 2005). This observation also holds in the case of acquired deficits, specifically in right-brain-damaged patients with hemineglect, who did not improve their performances when landmarks were available in the environment (Nico et al., 2008), even if patient performances may be dissociated (Pizzamiglio et al., 1998; Piccardi, 2009). Thus, our data suggest that this developmental step, which may be selectively prevented by a congenital malformation and damaged in acquired brain lesions, is still developing in 4- to 5-year-old children, despite evidence from typical development that demonstrates an earlier acquisition of this step at ~24 months of age (Hermer and Spelke, 1994, 1996).
In general, our results suggest that the normal development of spatial orientation abilities may be considered to follow a continuum rather than a serial organization of navigational mechanisms, which is consistent with previous neuropsychological evidence (e.g., Bianchini et al., 2010, 2014a; Palermo et al., 2014). In light of Siegel and White's cumulative model (1975), we speculate that intermediate stages exist between landmark- and route-based knowledge and between route- and survey-based knowledge. Within these intermediate stages, information coded in different formats is integrated and results in improved performance. Within this framework, even if in the presence of spontaneous improvements in integrating landmark- and route-based knowledge (performance on L-WalCT) and integrating route- and survey-based knowledge (path line drawing), NTP specifically improves performances at the highest level of navigational task. Specifically, the allocentric representation of environmental places arises from the transformation of an egocentric frame of reference. Interestingly, NTP may be useful not only in preventing developmental navigational deficits but also in helping children with visual impairments. As demonstrated by Iossifova and Marmolejo-Ramos (2013), blind children show a difficulty in the use of allocentric coding that may be addressed with specific training, such as an adapted version of NTP for visually impaired children.
Although our results are novel and the future applications in education are interesting, the present study has several weaknesses. In particular, the sample size is small, which represents a potential limitation in the statistical approach that may be adopted. In a future study, we must implement non-parametric or robust approaches to data analyses by increasing the sample size and enrolling participants at different ages of development. Moreover, further studies are needed to understand the long-term effects of the improvement identified in the TG and whether formal training later in life has the same effect on spatial skills. The consequences of NTP in preventing the development of navigational disorders should also be investigated in future studies.
In conclusion, our findings support the idea that the inclusion of formal training of spatial orientation ability during childhood may result in enhanced navigational abilities, particularly for the highest level navigational task.
Author Contributions
LPi, CG, and SD designed and conceived the study. MR and FV collected data. MB, AT, and LPa analyzed data and MB wrote a first draft of the manuscript which has been further revised by all the authors. All the authors contributed to the discussion of the results.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors thank the “Istituto Comprensivo di Via Anagni” in Rome for their cooperation and interest in this research. In particular, the authors thank the School's Director, Dr. Maura Frasca, for her interest in this project, as well as Dr. Chiara Bellagamba and Dr. Veronica Sacco for their help with the children during NTP. We also acknowledge the children who participated in the study and their families, who provided their consent.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnins.2017.00574/full#supplementary-material
Supplementary Figure 1. (A) Experimental timeline; (B) An example of an item of the Colored Matrix. The children were instructed to observe the colored boxes in the matrix (up). After 1min of observation, the children were required to turn the page and fill-in the same boxes in an empty matrix (down); (C) An example of an item of an unambiguous Paper-and-Pencil Labyrinth. The children were required to help the bee to reach flowers; (D) An example of an item of the Objects' Mental Rotation. The children's task was to observe the target flower in the center of the sheet and to identify the only correct one of the three rotated flowers corresponding to the target.
References
Acredolo, L. P. (1978). Development of spatial orientation in infancy. Dev. Psychol. 14, 224–234. doi: 10.1037/0012-1649.14.3.224
Acredolo, L. P., and Evans, D. (1980). Developmental changes in the effects of landmarks on infant spatial behavior. Dev. Psychol. 16, 312–318. doi: 10.1037/0012-1649.16.4.312
Apuzzo, M. L. J. (1996). New dimensions of neurosurgery in the realm of high technology: possibilities, practicalities, realities. Neurosurgery 38, 625–639. doi: 10.1097/00006123-199604000-00001
Belacchi, C., Scalisi, T. G., Cannoni, E., and Cornoldi, C. (2008). Manuale CPM Coloured progressive Matrices. Standardizzazione Italiana CPM Handbook. Colored Progressive Matrices. Italian Standardization. Florence: Giunti; O. S. Organizzazioni Speciali.
Bianchini, F., Di Vita, A., Palermo, L., Piccardi, L., Blundo, C., Guariglia, C., et al. (2014a). A selective egocentric topographical working memory deficit in the early stages of Alzheimer's Disease: a preliminary study. Am. J. Alzheimers Dis. Other Demen. 29, 749–754. doi: 10.1177/1533317514536597
Bianchini, F., Incoccia, C., Palermo, L., Piccardi, L., Zompanti, L., Sabatini, U., et al. (2010). Developmental topographical disorientation in a healthy subject. Neuropsychologia 48, 1563–1573. doi: 10.1016/j.neuropsychologia.2010.01.025
Bianchini, F., Palermo, L., Piccardi, L., Incoccia, C., Nemmi, F., Guariglia, C., et al. (2014b). Where am I? A new case of de- velopmental topographical disorientation. J. Neuropsychol. 8, 107–124. doi: 10.1111/jnp.12007
Bocchi, A., Carrieri, M., Lancia, S., Quaresima, V., and Piccardi, L. (2017). The Key of the Maze: The role of mental imagery and cognitive flexibility in navigational planning. Neurosci. Lett. 651, 146–150. doi: 10.1016/j.neulet.2017.05.009
Boccia, M., Guariglia, C., Sabatini, U., and Nemmi, F. (2016a). Navigating toward a novel environment from a route or survey perspective: neural correlates and context-dependent connectivity. Brain Struct Funct. 221, 2005–2021. doi: 10.1007/s00429-015-1021-z
Boccia, M., Nemmi, F., and Guariglia, C. (2014). Neuropsychology of environmental navigation in humans: review and meta-analysis of FMRI studies in healthy participants. Neuropsychol. Rev. 24, 236–251. doi: 10.1007/s11065-014-9247-8
Boccia, M., Sulpizio, V., Nemmi, F., Guariglia, C., and Galati, G. (2016b). Direct and indirect parieto-medial temporal pathways for spatial navigation in humans: evidence from resting-state functional connectivity. Brain Struct Funct. 222, 1945–1957. doi: 10.1007/s00429-016-1318-6
Boccia, M., Sulpizio, V., Palermo, L., Piccardi, L., Guariglia, C., and Galati, G. (2017). I can see where you would be: patterns of fMRI activity reveal imagined landmarks. Neuroimage 144, 174–182. doi: 10.1016/j.neuroimage.2016.08.034
Bremner, J. G. (1978). Egocentric versus allocentric spatial coding in nine-month-old infants: Factors influencing the choice of code. Dev. Psychol. 14, 346–355. doi: 10.1037/0012-1649.14.4.346
Bullens, J., Igloi, K., Berthoz, A., Postma, A., and Rondi-Reig, L. (2010). Developmental time course of the acquisition of sequential egocentric and allocentric navigation strategies. J. Exp. Child Psychol. 107, 337–350. doi: 10.1016/j.jecp.2010.05.010
Byrne, P., Becker, S., and Burgess, N. (2007). Remembering the past and imagining the future: a neural model of spatial memory and imagery. Psychol. Rev. 114, 340–375. doi: 10.1037/0033-295X.114.2.340
Chilosi, A. M., and Cipriani, P. (1995). Test di Comprensione Grammaticale per Bambini. Tirrenia: Edizioni del Cerro.
Colangeli, S., Boccia, M., Verde, P., Guariglia, P., Bianchini, F., and Piccardi, L. (2016). Cognitive reserve in healthy aging and Alzheimer's disease: a meta-analysis of fMRI studies. Am. J. Alzheimer's Dis. Other Demen. 31, 443–449 doi: 10.1177/1533317516653826
Corsi, P. M. (1972). Human Memory and the Medial Temporal Region of the Brain. Unpublished doctoral dissertation, Montreal, QC: McGill University.
Foreman, N., Arber, M., and Savage, J. (1984). Spatial memory in preschool infants. Dev. Psychobiol. 17, 129–137. doi: 10.1002/dev.420170204
Foreman, N., Warry, R., and Andmurray, P. (1990). Development of reference and spatial memory in preschool children. J. General Psychol. 117, 267–276.
Hermer, L., and Spelke, E. (1996). Modularity and development: the case of spatial reorientation. Cognition 61, 195–232. doi: 10.1016/S0010-0277(96)00714-7
Hermer, L., and Spelke, E. S. (1994). A geometric process for spatial reorientation in young children. Nature 370, 57–59 doi: 10.1038/370057a0
Hermer-Vazquez, L., Moffet, A., and Munkolm, P. (2001). Language, space, and the development of cognitive flexibility in humans: the case of two spatial memory tasks. Cognition 79, 263–299. doi: 10.1016/S0010-0277(00)00120-7
Iaria, G., and Barton, J. J. (2010). Developmental Topographical Disorientation: a newly discovered cognitive disorder. Exp. Brain Res. 206, 189–196. doi: 10.1007/s00221-010-2256-9
Iaria, G., Bogod, N., Fox, C. J., and Barton, J. J. (2009). Developmental topographical disorientation: case one. Neuropsychologia 47, 30–40. doi: 10.1016/j.neuropsychologia.2008.08.021
Iaria, G., Incoccia, C., Piccardi, L., Nico, D., Sabatini, U., and Guariglia, C. (2005). Lack of orientation due to a congenital brain malformation: a case study. Neurocase 11, 463–474. doi: 10.1080/13554790500423602
Iossifova, R., and Marmolejo-Ramos, F. (2013). When the body is time: spatial and temporal deixis in children with visual impairments and sighted children. Res. Dev. Disabil. 34, 2173–2184. doi: 10.1016/j.ridd.2013.03.030
Kittler, J. E., Menard, W., and Phillips, K. A. (2007). Weight concerns in individuals with body dysmorphic disorder. Eat. Behav. 8, 115–120. doi: 10.1016/j.eatbeh.2006.02.006
Lehnung, M., Leplow, B., Ekroll, V., Benz, B., Ritz, A., Mehdorn, M., et al. (2003). Recovery of spatial memory and persis tence of spatial orientation deficits after traumatic brain injury during childhood. Brain Inj. 17, 855–869. doi: 10.1080/0269905031000089369
Lehnung, M., Leplow, B., Friege, L., Ferstl, R., and Mehdorn, M. (1998). Developmentof spatial memory and spatial orientation in preschoolers and primary schoolchildren. Br. J. Psychol. 89, 463–480. doi: 10.1111/j.2044-8295.1998.tb02697.x
Montello, D. R. (1998). “A new framework for understanding the acquisition of spatial knowledge in large-scale environments,” in Spatial and Temporal Reasoning in Geographic Information Systems, eds M. J. Egenhofer and R. G. Golledge (Oxford: Oxford University Press), 143–154.
Nardini, M., Thomas, R. L., Knowland, V. C. P., Braddick, O. J., and Atkinson, J. (2009). A viewpoint-independent process for spatial reorientation. Cognition 112, 241–248. doi: 10.1016/j.cognition.2009.05.003
Negen, J., Heywood-Everett, E., Roome, H. E., and Nardini, M. (2017). Development of allocentric spatial recall from new viewpoints in virtual reality. Dev. Sci. doi: 10.1111/desc.12496. [Epub ahead of print].
Nemmi, F., Bianchini, F., Piras, F., Péran, P., Palermo, L., Piccardi, L., et al. (2015). Finding my own way: an fMRI single case study of a subject with developmental topographical disorientation. Neurocase 21, 573–583. doi: 10.1080/13554794.2014.960424
Nemmi, F., Boccia, M., Piccardi, L., Galati, G., and Guariglia, C. (2013). Segregation of neural circuits involved in spatial learning in reaching and navigational space. Neuropsychologia 51, 1561–1570. doi: 10.1016/j.neuropsychologia.2013.03.031
Nico, D., Piccardi, L., Iaria, G., Bianchini, F., Zompanti, L., Guariglia, C., et al. (2008). Landmark based navigation in brain damaged patients with neglect. Neuropsychologia 46, 1898–1907. doi: 10.1016/j.neuropsychologia.2008.01.013
Nori, R., and Piccardi, L. (2011). “Familiarity and spatial cognitive style: how important are they for spatial representation?,” in Spatial Memory: Visuospatial Processes, Cognitive Performance and Developmental Effects, ed J. B. Thomas (New York, NY: Novapublisher), 103–124.
Nys, M., Gyselinck, V., Orriols, E., and Hickmann, M. (2015). Landmark and route knowledge in children's spatial representation of a virtual environment. Front. Psychol. 5:1522. doi: 10.3389/fpsyg.2014.01522
O'Keefe, J., and Nadel, L. (1979). Précis of O'Keefe & Nadel's The hippocampus as a cognitive map. Behav. Brain Sci. 2, 487–494. doi: 10.1017/S0140525X00063949
Onder, G., Zanetti, O., Giacobini, E., Frisoni, G. B., Bartorelli, L., Carbone, G., et al. (2005). Reality orientation therapy combined with cholinesterase inhibitors in Alzheimer's disease: randomised controlled trial. Br. J. Psychiatry 187, 450–455. doi: 10.1192/bjp.187.5.450
Overman, W. H., Pate, B. J., Moore, K., and Peuster, A. (1996). Ontogeny of place learning in children as measured in the radial arm maze, Morris search task, and open field task. Behav. Neurosci. 110, 1205–1228. doi: 10.1037/0735-7044.110.6.1205
Palermo, L., Piccardi, L., Bianchini, F., Nemmi, F., Giorgio, V., Incoccia, C., et al. (2014). Looking for the compass in a case of developmental topographical disorientation: a behavioral and neuroimaging study. J. Clin. Exp. Neuropsychol. 36, 464–481. doi: 10.1080/13803395.2014.904843
Palermo, L., Ranieri, G., Nemmi, F., and Guariglia, C. (2012). Cognitive maps in imagery neglect. Neuropsychologia 50, 904–912. doi: 10.1016/j.neuropsychologia.2012.01.030
Pazzaglia, F., and De Beni, R. (2006). Are people with high and low mental rotation abilities differently susceptible to the alignment effect? Perception 35, 369–383. doi: 10.1068/p5465
Piaget, J., and Inhelder, B. (1948). La Représentation de l'espace chez l'enfant. Paris: Presses Universitaires de France.
Piccardi, L. (2009). Representational neglect patients and navigation in virtual space. Cogn. Neuropsychol. 26, 247–265. doi: 10.1080/02643290902978390
Piccardi, L. (2011). Come Impariamo a Muoverci Nell'ambiente? [How Do We Learn to Move Through the Environment?]. Milan: Springer-Verlag.
Piccardi, L., Bianchini, F., Argento, O., De Nigris, A., Maialetti, A., Palermo, L., et al. (2013). The Walking Corsi Test (WalCT): standardization of the topographical memory test in an Italian population. Neurol Sci. 34, 971. doi: 10.1007/s10072-012-1175-x
Piccardi, L., Bianchini, F., Iasevoli, L., Giannone, G., and Guariglia, C. (2011). Sex differences in a landmark environmental re-orientation task only during the learning phase. Neurosci. Lett. 503, 181–185. doi: 10.1016/j.neulet.2011.08.031
Piccardi, L., Bocchi, A., Palmiero, M., Verde, P., and Nori, R. (2017). Mental imagery skills predict the ability in performing environmental directional judgements. Exp. Brain Res. 235, 2225–2233. doi: 10.1007/s00221-017-4966-8
Piccardi, L., Iaria, G., Ricci, M., Bianchini, F., Zompanti, L., Guariglia, C., et al. (2008). Walking in the Corsi test: Which type of memory do you need? Neurosci. Lett. 432, 127–131. doi: 10.1016/j.neulet.2007.12.044
Piccardi, L., Leonzi, M., D'Amico, S., Marano, A., and Guariglia, C. (2014a). Development of navigational working memory: evidence from 6- to 10-year-old children. Br. J. Dev. Psychol. 32, 205–217. doi: 10.1111/bjdp.12036
Piccardi, L., and Nori, R. (2011). “Effects of visuo-spatial working memory on wayfinding ability,” Working Memory: Capacity, Developments and Improvement Techniques, ed E. S. Levin (New York, NY: Nova Science publishers), 81–108.
Piccardi, L., Palermo, L., Bocchi, A., Guariglia, C., and D'Amico, S. (2015). Does spatial locative comprehension predict landmark-based navigation? PLoS ONE 10:e0115432. doi: 10.1371/journal.pone.0115432
Piccardi, L., Palermo, L., Leonzi, M., Risetti, M., Zompanti, L., Guariglia, C., et al. (2014b). The walking corsi test (WalCT): a normative study of topographical working memory in a sample of 4- to 11-year-olds. Clin. Neuropsychol. 28, 84–96. doi: 10.1080/13854046.2013.863976
Pizzamiglio, L., Guariglia, C., and Cosentino, T. (1998). Evidence for separate allocentric and egocentric space processing in neglect patients. Cortex 34, 719–730. doi: 10.1016/S0010-9452(08)70775-5
Raven, J. C. (1986). Coloured Progressive Matrices (CPM). Serie a, ab, b Colored Progressive Matrices (CPM). Series a, ab, b. Firenze: Organizzazioni Speciali.
Rosenthal, R. L., and Rosnow, R. (2008). Essentials of Behavioral Research. Methods and Data Analysis, 3rd Edn. NewYork, NY: McGraw-Hill.
Ruggiero, G., Ruotolo, F., and Iachini, T. (2009). The role of vision in egocentric and allocentric spatial frames of reference. Cogn. Process. 10, 283–285. doi: 10.1007/s10339-009-0320-9
Siegel, A. W., and White, S. H. (1975). “The development of spatial representations of large-scale environments,” in Advances in Child Development & Behavior, ed H. W. Reese (New York, NY: Academic Press), 9–55.
Stern, Y. (2012). Cognitive reserve in ageing and Alzheimer's disease. Lancet Neurol. 11, 1006–1012. doi: 10.1016/S1474-4422(12)70191-6
Taylor, H. A., and Tversky, B. (1992). Spatial mental models derived from survey and route descriptions. J. Mem. Lang. 31, 261–292. doi: 10.1016/0749-596X(92)90014-O
Thorndyke, P. W., and Hayes-Roth, B. (1982). Differences in spatial knowledge acquired from maps and navigation. Cogn. Psychol. 14, 560–589. doi: 10.1016/0010-0285(82)90019-6
Tolman, C. E. (1948). Cognitive maps in rats and men. Psychol. Rev. 55, 189–208. doi: 10.1037/h0061626
Vasilyeva, M., and Lourenco, S. F. (2012). Development of spatial cognition. Interdiscip. Rev. Cogn. Sci. 3, 349–362. doi: 10.1002/wcs.1171
Verde, P., Boccia, M., Colangeli, S., Barbetti, S., Nori, R., Ferlazzo, F., et al. (2016). Domain-specific interference tests on navigational working memory in military pilots. Aerosp. Med. Hum. Perform. 87, 528–533. doi: 10.3357/AMHP.4521.2016
Verde, P., Piccardi, L., Bianchini, F., Guariglia, C., Carrozzo, P., Morgagni, F., et al. (2015). Gender differences in navigational memory: pilots vs. nonpilots. Aerosp. Med. Hum. Perform. 86, 103–111. doi: 10.3357/AMHP.4024.2015
Keywords: human navigation, normal development, allocentric representation, egocentric representation, spatial orientation training, environmental knowledge, survey knowledge
Citation: Boccia M, Rosella M, Vecchione F, Tanzilli A, Palermo L, D'Amico S, Guariglia C and Piccardi L (2017) Enhancing Allocentric Spatial Recall in Pre-schoolers through Navigational Training Programme. Front. Neurosci. 11:574. doi: 10.3389/fnins.2017.00574
Received: 23 June 2017; Accepted: 02 October 2017;
Published: 16 October 2017.
Edited by:
Alfredo Meneses, Center for Research and Advanced Studies of the National Polytechnic Institute (CINVESTAV), MexicoReviewed by:
Greeshma Sharma, Netaji Subhas Institute of Technology, IndiaFernando Marmolejo-Ramos, University of Adelaide, Australia
Dong Song, University of Southern California, United States
Santiago J. Ballaz, Yachay Tech University, Ecuador
Copyright © 2017 Boccia, Rosella, Vecchione, Tanzilli, Palermo, D'Amico, Guariglia and Piccardi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Laura Piccardi, laura.piccardi@cc.univaq.it