- 1Penn Frontotemporal Degeneration Center, Department of Neurology, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
- 2Neuroscience Graduate Group, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
- 3Penn Image Computing and Science Laboratory, Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
- 4Center for Neurodegenerative Disease Research, Department of Pathology and Laboratory Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
Indirect speech acts—responding “I forgot to wear my watch today” to someone who asked for the time—are ubiquitous in daily conversation, but are understudied in current neurobiological models of language. To comprehend an indirect speech act like this one, listeners must not only decode the lexical-semantic content of the utterance, but also make a pragmatic, bridging inference. This inference allows listeners to derive the speaker’s true, intended meaning—in the above dialog, for example, that the speaker cannot provide the time. In the present work, we address this major gap by asking non-aphasic patients with behavioral variant frontotemporal dementia (bvFTD, n = 21) and brain-damaged controls with amnestic mild cognitive impairment (MCI, n = 17) to judge simple question-answer dialogs of the form: “Do you want some cake for dessert?” “I’m on a very strict diet right now,” and relate the results to structural and diffusion MRI. Accuracy and reaction time results demonstrate that subjects with bvFTD, but not MCI, are selectively impaired in indirect relative to direct speech act comprehension, due in part to their social and executive limitations, and performance is related to caregivers’ judgment of communication efficacy. MRI imaging associates the observed impairment in bvFTD to cortical thinning not only in traditional language-associated regions, but also in fronto-parietal regions implicated in social and executive cerebral networks. Finally, diffusion tensor imaging analyses implicate white matter tracts in both dorsal and ventral projection streams, including superior longitudinal fasciculus, frontal aslant, and uncinate fasciculus. These results have strong implications for updated neurobiological models of language, and emphasize a core, language-mediated social disorder in patients with bvFTD.
Introduction
“The chief end of language in communication is to be understood, and words don’t serve well for that end—whether in everyday or in philosophical discourse—when some word fails to arouse in the hearer the idea it stands for in the mind of the speaker.” –John Locke (1689), “An Essay Concerning Human Understanding”
To paraphrase the famed English philosopher John Locke, human communication does not depend only on decoding the individual meanings of words per se, but rather decoding the speaker’s idea represented by those words. Indeed, we do not communicate by volleying single words back and forth in isolation: we communicate through stories, narratives, and conversations (Bell, 2002; Kellas, 2005). This is a critical point that bears significant implications for the experimental methodology adopted by neuroscientists and the theoretical frameworks they endorse in studying language. From this perspective, the methodology we have used to date—studying the neural basis of phonology, morphology, syntax, and semantics—may be too narrowly focused, as these elements alone are often insufficient for comprehension. Instead, when we consider language in an interactive real-world context—as language for communication—we recognize that language is polysemous and consequently, listeners must make pragmatic, bridging inferences in order to derive a speaker’s true meaning. In the present study, we address this major gap in traditional neurobiological models of language by focusing on the highly common but often overlooked inferential component of conversational speech.
Indirect speech acts, which are ubiquitous in daily communication, are a canonical example of natural, inferential language. Consider, for instance, if Sally asks Betty, “Do you want some cake for dessert?” and Betty sadly replies, “I’m on a very strict diet right now.” In the given exchange, Sally can easily infer that Betty is declining the cake, even though it is not explicitly stated in her reply. Although indirect speech epitomizes the resource-demanding, socially constrained nature of language, its processing appears to be both quick and effortless (Clark, 1979). Still unknown, however, are the brain correlates of this remarkable feat: what are the cognitive and neural substrates of indirect speech act comprehension?
Historical investigations into the neurobiology of language have typically been limited to studies of speech sounds, words, and sentences. Pioneered by the physicians Paul Broca and Carl Wernicke, the resulting “Wernicke-Lichtheim-Geschwind” (WLG) model emphasizes two primary hubs in left hemisphere peri-Sylvian cortex: the inferior frontal gyrus, specific for language production, and the posterior superior temporal gyrus, specific for language comprehension. While we have now developed a more nuanced understanding of the contributions of these brain regions in supporting language, the WLG model cannot fully account for the complexities of real-world language and communication—how we integrate utterances with prior context so effortlessly, make inferences about speaker meaning, and engage in the rapid back and forth of conversation (Tremblay and Dick, 2016; Hasson et al., 2018).
More recently, we have begun to study natural language discourse—that is, the social use of language, or language for communication. Discourse typically has a supra-sentential structure, and consequently, may require additional neurocognitive resources to disambiguate meaning. Despite its ubiquity in daily language, however, scant attention has been paid to indirect speech acts like the one above—communicative exchanges in which the intended speaker meaning is not directly coded in the lexical-semantic content of the utterance itself (Grice, 1975; Searle, 1975). To address this major gap in natural language use, we study indirect replies, a subtype of indirect speech that boasts several theoretical advantages over previous language domains used to study discourse: (1) they are relatively short and can be tightly controlled, unlike lengthy narratives; (2) their meaning does not become “frozen” due to repeated usage, as with metaphors, idioms, or proverbs; (3) they do not have an affective component, which typically characterizes irony and sarcasm; and (4) they involve an interactive exchange between speakers, which reflects how language is most commonly used. With these factors in mind, we developed a novel, question-answer paradigm manipulating inferential demand—whether a reply is conveyed directly or indirectly.
Previous studies investigated indirect speech comprehension with fMRI in healthy adults (Shibata et al., 2011; Basnáková et al., 2013; Jang et al., 2013; Feng et al., 2017). Here, we use a patient lesion-model to examine the neurobiological basis of indirect speech. Specifically, we study patients with behavioral variant frontotemporal dementia (bvFTD), who constitute an ideal cohort to study deficits in “real world” communication (Grossman, 2018). A young-onset neurodegenerative disease, bvFTD is characterized by changes in social comportment, personality, and executive function due to disease in frontal and temporal cortices. Importantly, while patients are grossly non-aphasic, they may show deficits at the discourse level of language. Previous research thus has demonstrated that bvFTD speech is marked by poor narrative organization and limited appreciation of global meaning, abnormal prosody, simplified grammatical structures, and a reliance on concrete concepts and literal meaning (Ash et al., 2006; Farag et al., 2010; Charles et al., 2014; Cousins et al., 2017; Nevler et al., 2017). Moreover, to demonstrate that limited indirect speech comprehension cannot be easily attributed to the presence of any neurodegenerative disease, we examined non-aphasic patients with amnestic mild cognitive impairment (MCI). Patients with MCI show some cognitive decline but remain largely capable of independent day-to-day functioning (Gauthier et al., 2010), and thus represent an appropriate brain-damaged control group to examine the specificity of an effect observed in bvFTD.
Based on previous work from our laboratory and others, we predict that non-aphasic bvFTD patients will show deficits in indirect speech related in part to disease in brain regions associated with an “extended language network” encompassing social, executive, and language regions (Ferstl et al., 2008). We hypothesize further that critical white matter tracts linking these linguistic and extra-linguistic regions may also be disrupted in bvFTD, and interruption of white matter-mediated connectivity within the extended language network also may contribute to a limitation in indirect speech comprehension. While the initial WLG model posited only a single white matter tract for language—the arcuate fasciculus, connecting Broca’s and Wernicke’s areas—more recent work has begun to implicate multiple tracts, including the superior longitudinal fasciculus, inferior longitudinal fasciculus, and uncinate fasciculus (Saur et al., 2008; Friederici, 2015; Vassal et al., 2016). It is these tracts that would permit the traditional language network to interact with extra-Sylvian regions – namely, the executive control and social brain networks that are hypothesized to play a role in discourse processing. Accordingly, and given that bvFTD is known to show significant WM disease (Agosta et al., 2012), we adopt a multimodal approach and use a combination of high-resolution structural magnetic resonance imaging (sMRI) and diffusion tensor imaging (DTI) to expand our understanding of the neuroanatomic changes associated with real-world communication.
Materials and Methods
Participants
Participants included 21 patients with bvFTD, 17 age and education-matched healthy controls, and 17 brain-damaged controls with amnestic MCI. See Table 1 for a summary of demographic and clinical characteristics. All patients (bvFTD, MCI) were diagnosed by board-certified neurologists (M.G. and D.J.I.) using published criteria and a consensus procedure (Albert et al., 2011; Rascovsky et al., 2011). As some bvFTD patients may develop language deficits associated with semantic variant primary progressive aphasia (svPPA), any patients with symptomatic evidence of svPPA or a score greater or equal to 1 on the Language Supplement of the Clinical Dementia Rating Scale (CDR) (Knopman et al., 2011) were excluded from the sample population. We note here that we chose MCI as our brain-damaged control group rather than svPPA since we wanted all patients to be non-aphasic and capable of performing the discourse task at a reasonable level of proficiency and without obvious language-related deficits. Alternative causes of cognitive difficulty (e.g., vascular dementia, hydrocephalus, stroke, head trauma, primary psychiatric disorders) were excluded by clinical exam, neuroimaging, CSF, and blood tests. As summarized in Table 1, severity of overall cognitive impairment was assessed in patients using the Mini-Mental State Examination (MMSE). On average, patient scores fell in the mild range. Healthy control subjects were verified through negative self-report of a neurological and psychiatric history and a score of greater than or equal to 28 on MMSE. All subjects were recruited from the Penn Frontotemporal Degeneration Center and gave informed consent according to a protocol approved by the Institutional Review Board at the University of Pennsylvania.
Experimental Design and Statistical Analyses
The stimulus materials consisted of 120 question-answer dialogs (60 experimental items and 60 filler items of similar structure), summarized in Table 2. They were of the form: “Do you want some cake for dessert?” “I’m on a very strict diet right now,” All questions were polar, such that the expected answer was either “yes” or “no.” Stimuli were presented as printed text in order to avoid any confounds introduced by prosodic cutes inherent in the speech stream or limited working memory.
Each question (n = 30) was associated with two different replies, which systematically varied according to inferential demand (direct, indirect). The 60 filler items used the same questions, but presented both the indirect and indirect replies in succession (30 provided the direct reply first, and 30 provided indirect reply first). The filler items will not be discussed further here. Table 2 illustrates each condition and sample stimuli. Note that indirect replies, as operationalized here, are equivalent to Grice’s notion of “conversational implicatures” (Grice, 1975).
Stimuli were carefully constructed to minimize linguistic variation within and across conditions. The direct and indirect items were matched within each item for number of syllables, mean word frequency (Brysbaert and New, 2009), and mean concreteness (Brysbaert et al., 2014). For word frequency and concreteness, a mean score was generated for each sentence by averaging across the individual scores of each content word. This careful matching procedure is meant to ensure that any differences in processing direct and indirect items are due to the manipulation of inferential demand, and not to any differences in other linguistic properties.
Stimulus presentation, timing, and responses were controlled via E-Prime presentation software. On each trial, a fixation cross was presented (3 s), followed by the question (3 s), and then reply (3 s). The question remained on the screen as the reply appeared, in order to reduce any working memory demands. Following each trial, subjects were presented a probe: “Does the reply mean yes or no?” and given 10 s to respond via button press. Response accuracy and response time were recorded for each condition. Items were counterbalanced so that half the replies had a positive connotation (i.e., mean “yes”) and half the replies had a negative connotation (i.e., mean “no”). Participants were trained prior to testing and completed 12 practice trials. In total, task administration took approximately one hour.
We assessed performance using two independent metrics: response accuracy and reaction time, as well as two derivative measures: an impairment score and a slowing score. The impairment score, which was meant to quantify a patient’s degree of impairment in indirect speech processing specifically, was calculated by subtracting accuracy in the direct condition from accuracy in the indirect condition within each individual subject (impairment score per subject = indirect accuracy – direct accuracy). The slowing score is an analogous measure for reaction time (slowing score = indirect reaction time – direct reaction time). All analyses used non-parametric statistics as the data were not normally distributed according to Shapiro–Wilks tests. Between-group comparisons were performed with Mann-Whitney tests, and within-group comparisons with Wilcoxon tests. Correlations were calculated using the Spearman method. All statistical analyses were performed in R1.
Prior to data collection, stimulus validity was confirmed via pre-testing. In a norming study, healthy, young adult subjects (n = 10) were asked to read each dialog and respond to a series of question via button press. As in the main experiment, subjects were first asked to indicate if the reply meant “yes” or “no”. Next, subjects were asked to rate how direct the reply sounded and how natural the dialog sounded, both on a scale of 1 to 5 (where 1 = very direct/natural and 5 = very indirect/unnatural). Overall, subjects performed at ceiling, with a mean (±S.D.) accuracy of 97.87% (±0.05) across all items. Furthermore, there was no significant difference for accuracy [direct = 96.88 (±0.02), indirect = 98.63 (±0.01); p = 0.07] or naturalness [direct = 1.45 (±0.64), indirect = 1.87 (±0.51); p = 0.12], in the direct and indirect conditions. Importantly, there was a significant difference between stimuli in terms of the directness rating [direct = 1.19 (±0.13), indirect = 3.50 (±0.98); p = 0.00003].
Neuropsychological Battery
In order to assess the potential contribution of linguistic and non-linguistic cognitive processes to speech act comprehension, both bvFTD and MCI patient groups were also administered a comprehensive neuropsychological battery. Language was assessed with 3 measures, each representing a different level of language processing. Phonological awareness was assessed with the Repetition score from the Philadelphia Brief Assessment of Cognition (PBAC) (Libon et al., 2011), and semantic knowledge with the Multi-Lingual Naming Test (MINT) (Gollan et al., 2012). Finally, grammatical comprehension was assessed using a two-alternative forced-choice sentence-picture matching task, which yields a ratio score comparing comprehension of object-relative sentences to subject-relative sentences (Charles et al., 2014).
Next, executive function was assessed with backward digit span (BDS) (Wechsler, 1997), a test of working memory which requires subjects to repeat an orally presented sequence of numbers in reverse order, and Trailmaking Test B (TMT) (Reitan, 1958), a test of mental flexibility in which subjects must connect a series of dots in ascending order, alternating between letters (A-K) and numbers (1-12). The time to complete Trailmaking Test B (in seconds) was normalized to each subjects time to complete Trailmaking Test A (in which only numbers are presented and there is no switching involved), in order to control for any potential motor differences across subjects.
Social cognition was assessed with the Social Norms Questionnaire (SNQ), a 22-item questionnaire probing social knowledge and an individual’s ability to use context to decide when a behavior is or is not socially appropriate (Panchal et al., 2015). A higher score on the SNQ indicates greater knowledge of social norms. Scoring of the SNQ also yields two subscores: an “Overadhere” score, which refers to the endorsement of socially appropriate behavior as inappropriate (e.g., wearing the same shirt twice in 2 weeks), and a “Break” score, which refers to endorsement of a socially inappropriate behavior as appropriate (e.g., hugging a stranger without asking first). A caregiver informant also completed the Perception of Conversation Index (PCI). Section 1 of the questionnaire assesses caregiver perception of conversational difficulties in patients and includes questions such as “Has difficulty with telephone conversations,” and “Mixes-up the details while telling a story” (Orange et al., 2009; Savundranayagam and Orange, 2011).
We also collected measures in two unrelated cognitive domains to serve as negative controls: visuospatial functioning and episodic memory. Both of these abilities are typically relatively preserved in bvFTD. To assess visuospatial functioning, we used the “copy” measure of Rey-Osterreith Complex Figure Test (Libon et al., 2011), in which a subject must copy a complicated geometric line drawing freehand, and Judgment of Line Orientation (JOLO), in which subjects to match an angled line to one of 11 lines that are arranged in a semicircle (Benton et al., 1983). Finally, to assess episodic memory, we used the “recall” measure of the Rey-Osterreith Complex Figure Test (Libon et al., 2011), where a subject must draw the same complicated line drawing from memory, after a delay. We also assessed episodic memory with Philadelphia Verbal Learning Test (Libon et al., 1996), which is a 9-item list-learning task modeled after the California Verbal Learning Test. The number of correct items recalled on Trial 7 was used as the dependent variable here.
Structural Imaging: Methods and Analysis
Image Acquisition
High-resolution volumetric T1-weighted structural magnetic resonance imaging (MRI) was collected for 19 bvFTD patients and an independent cohort of 25 healthy age- and education-matched controls from the surrounding community (mean age = 67.23 (±7.46), p = 0.37; mean education = 15.88 (±2.19) p = 0.22). These controls were used to define an average template brain of comparable age that can be used to identify regions of significant gray matter disease in patients, on a voxel by voxel basis. A T1 image was not available for two patients with bvFTD due to contraindications and safety concerns, including claustrophobia and metal in the body (i.e., pacemaker). MRI volumes were acquired using a magnetization prepared rapid acquisition with gradient echo (MPRAGE) sequence from a SIEMENS 3.0T Tim Trio scanner using an axially acquired protocol with the following acquisition parameters: repetition time (TR) = 1620 ms; echo time (TE) = 3.87 ms; slice thickness = 1.0 mm; flip angle = 15°; matrix = 192 × 256, 160 slices, and in-plane resolution = 0.9766 × 0.9766 mm2. Whole-brain MRI volumes were preprocessed using Advanced Normalization Tools2 using the state-of-the-art antsCorticalThickness pipeline described previously (Avants et al., 2008; Klein et al., 2010; Tustison et al., 2014). Briefly, processing begins by deforming each individual dataset into a standard local template space that uses a canonical stereotactic coordinate system, generated using a subset of images from the open access series of imaging studies dataset (OASIS) (Marcus et al., 2010). ANTs then applies a highly accurate registration algorithm using symmetric and topology-preserving diffeomorphic deformations, which minimize bias to the reference space while still capturing the deformation necessary to aggregate images in common space. The ANTs Atropos tool uses template-based priors to segment images into six tissue classes (cortex, white matter, CSF, subcortical gray structures, brainstem, and cerebellum) and generate corresponding probability maps. Voxelwise cortical thickness is finally measured in millimeters (mm). Resulting images are warped into Montreal Neurological Institute (MNI) space, smoothed using a 2 sigma smoothing kernel, and downsampled to 2mm isotropic voxels.
Voxel-Wise Analyses
To define areas of significant cortical thinning in bvFTD, non-parametric, permutation-based imaging analyses were performed with threshold-free cluster enhancement (Smith and Nichols, 2009) and the randomize tool in FSL3. Briefly, permutation-based t-tests evaluate a true assignment of cortical thickness values across groups (signal) relative to many (e.g., 10,000) random assignments (noise). Accordingly, permutation-based statistical testing is robust to concerns regarding multiple comparisons and preferred over traditional methods using parametric-based t-tests as permutation testing effectively controls for false positives (Winkler et al., 2014). Cortical thickness was compared in patients relative to the independent cohort of 25 healthy controls described above and restricted to an explicit mask of high probability cortex (> 0.4). We report clusters that survived a statistical threshold of p < 0.01, correcting for multiple comparisons using the family wise error (FWE) rate relative to 10,000 random permutations. Results were projected onto the Conte69 surface-based atlas using Connectome Workbench4.
To relate behavioral performance to regions of significant cortical thinning, we fit linear regression models with the randomize tool of FSL and the impairment score as a covariate. Permutations were run exhaustively up to a maximum of 10,000 for each analysis. To constrain our interpretation to areas of known disease, we restricted our regression analyses to an explicit mask containing voxels of significant cortical thinning, as defined by the group comparison described above. Results outside these regions of known disease would be difficult to interpret since they could be attributed to a variety of individual differences unrelated to disease per se (e.g., healthy aging, genetic variation, etc.). For the regression analyses, we report clusters with a minimum of 20 adjacent voxels and surviving a height threshold of p < 0.005, which is recommended for optimal balance of Type I and Type II error rates (Lieberman and Cunningham, 2009). Results were projected onto slices using MRIcron software (Rorden and Brett, 2000).
ROI Analyses
Next, we conducted a series of whole-brain region-of-interest (ROI) analyses in order to specifically test our hypothesis that indirect reply comprehension involves the interaction of multiple brain networks: the core language network, the theory-of-mind/social network, and the multiple-demand network/executive network. Using publicly available software5, we extracted mean cortical thickness values for each of the 3 networks for each subject. Each network ROI (see below for network ROI definitions) was warped from MNI space to the subject’s native T1 space prior to extracting the estimates of cortical thickness (mm). To demonstrate specificity of our predicted relationship, we similarly extracted cortical thickness estimates from the sensorimotor network to use as a negative control.
The language network ROI was constructed by summing 4 language ROIs identified by Fedorenko et al. (2010, 2013), who used a language localizer contrasting reading sentences to reading lists of unconnected, but pronounceable words. The final ROIs, which included left IFG, IFG (pars orbitalis), anterior temporal lobe, and posterior temporal lobe, were created from a probabilistic overlap map from 220 healthy participants.
The social network was the sum of 7 ROIs, which were originally constructed by Dufour et al. (2013) and included: dorsomedial prefrontal cortex (dmPFC), middle medial prefrontal cortex (mmPFC), ventromedial prefrontal cortex (vmPFC), precuneus (PC), right superior temporal sulcus (RSTS), right temporoparietal junction (RTPJ), and left temporoparietal junction (LTPJ). The ROIs were developed by contrasting the false belief and false photograph conditions of a standard story-based theory-of-mind task across 462 healthy participants.
The executive ROIs were also adopted from Fedorenko et al. (2013), who contrasted hard and easy versions of a spatial working memory task in 197 healthy participants. For our purposes, we summed only those ROIs overlapping the so-called “fronto-parietal attention network.” The ROIs we selected thus included dorsolateral prefrontal cortex, orbital middle frontal gyrus, bilateral superior parietal lobe, inferior parietal sulcus, and inferior parietal lobule.
Finally, our control sensorimotor network was taken from Shirer et al. (2012), who defined ninety functional ROIs across 14 large-scale resting state brain networks using a classifier with leave-one-out cross-validation.
Diffusion Tensor Imaging: Procedure and Analysis
White matter tracts play a critical role in network activity by transmitting electrical signals across spatially separate gray matter regions, both within and across hemispheres. Therefore, even when gray matter regions are intact, synchronized network activity can be disrupted if there is damage to the white matter projections connecting gray matter nodes to each other. Because of this possibility, we use diffusion tensor imaging to examine patterns of structural connectivity in bvFTD and build a large-scale, multimodal network underlying speech act comprehension.
Diffusion weighted imaging (DWI) was available for the same 19 bvFTD patients with T1 imaging. A 30-directional DWI sequence was collected using single-shot, spin-echo, diffusion-weighted echo planar imaging (FOV = 240 mm; matrix size = 128 × 128; number of slices = 70; voxel size = 1.875 × 1.875 × 2.2 mm3, TR = 8100 ms; TE = 83 ms; fat saturation). Thirty volumes with diffusion weight (b = 1000 s/mm2) were collected along 30 non-collinear directions, and either one or five volumes without diffusion weight (b = 0 s/mm2) were collected per subject. A chi-square test demonstrated that the distribution of subjects with either one or five volumes without diffusion weight did not differ significantly across our groups (X 2 = 5.4412, p = 0.08). We also include a nuisance covariate for sequence in our subsequent analyses.
The diffusion images were processed using ANTs (Tustison et al., 2014) and Camino (Cook et al., 2006). Motion and distortion artifacts were removed using affine co-registration of each diffusion-weighted image to the average of the unweighted (b = 0) images. Diffusion tensors were calculated using a weighted linear least-squares algorithm (Salvador et al., 2005) implemented in Camino. Fractional anisotropy (FA) was computed in each voxel from the DT image, and distortion between the subject’s T1 and DT image was corrected by registering the FA to the T1 image. DTs were then relocated to the local template for statistical analysis by applying the FA-to-T1, T1-to-local template, and local template-to-MNI warps, and tensors were reoriented using the preservation of principal direction algorithm (Alexander et al., 2002). Each participant’s FA image was recomputed from the DT image in MNI152 template space and smoothed using a 2-sigma smoothing kernel.
Like the pipeline for GM analysis, we used the randomize tool in FSL to compare FA in patients relative to the same cohort healthy age-matched controls. The two-sample t-test of patients vs. controls was run with 10,000 permutations and restricted to voxels containing WM based on an explicit mask of high probability WM (minimum FA considered WM = 0.20). We also include a nuisance covariate of no interest for sequence difference (sequences with one versus five volumes without diffusion weight). We report clusters that survived a statistical threshold of p < 0.005 and a minimum cluster extent of 200 voxels. Regression analyses then related patient impairment to reduced FA, using a covariate for the indirect impairment score and a nuisance covariate for sequence. These regressions were restricted to the results of the previous analysis—that is, only voxels showing a significant effect of group. As above, we report clusters surviving a height threshold of p < 0.005 and a minimum of 20 contiguous voxels.
Data Availability
The data for the study are available from the authors to qualified investigators with appropriate Institutional Review Board approval and Material Transfer Agreement.
Results
Analysis of Task Performance
Our first objective was to test the hypothesis that inferential demand (i.e., whether a reply was communicated directly versus indirectly) modulates response accuracy in bvFTD. Results are summarized in Figure 1. We find that healthy control subjects performed at ceiling in both direct and indirect conditions, with no significant difference between conditions (W = 23.5, p = 0.10). Patients with bvFTD, on the other hand, perform significantly worse in the indirect condition than the direct condition (W = 132.5, p = 0.0008). bvFTD patients were also significantly impaired relative to healthy controls in the indirect condition (W = 276.5, p = 0.003), but not the direct condition (U = 237.5, p = 0.07). The null result in the direct condition suggests that segmental language ability, such as the comprehension of single words and sentences, is unlikely to be responsible for the decrement in indirect performance. To confirm the group-level results in bvFTD, we also calculated an “impairment score” by subtracting accuracy in the direct condition from accuracy in the indirect condition within each individual subject (impairment score = indirect accuracy – direct accuracy). Accordingly, more negative scores represent a greater degree of impairment. Results again indicate that bvFTD patients [mean impairment = −0.08 (±0.09)] are significantly more impaired than healthy controls (mean impairment = −0.01 (±0.02), U = 273.00, p = 0.004). Sixteen of 21 (76.20%) bvFTD patients showed a negative impairment score, suggesting that an impairment of indirect speech comprehension is not an uncommon finding in bvFTD.
Figure 1. Response accuracy: Response accuracy in controls, patients with behavioral variant frontotemporal dementia (bvFTD), and patients with amnestic mild cognitive impairment (MCI) in the experimental (short) conditions. (A) Mean (±SE) accuracy in the direct and indirect conditions. Controls are shown in dark gray (left-most bar), bvFTD patients in medium gray (middle bar), and MCI patients in light gray (right bar). (B) Mean (±SEM) impairment score (indirect – direct) across groups. A more negative impairment score indicates more difficulty with the indirect condition relative to a patient’s individual baseline performance on the direct condition. * indicates significance at p < 0.05, ** indicates significance at p < 0.01, *** indicates significance at p < 0.001.
Consider next the brain-damaged control group used to examine the specificity of the effect observed in bvFTD. Results in MCI show that, unlike bvFTD patients, MCI patients are not significantly impaired relative to healthy controls in either the direct (U = 165.50, p = 0.43) or indirect condition (U = 170.00, p = 0.36). Similarly, their mean impairment score [−0.006 (±0.06)], calculated within each individual, does not differ from that of healthy controls (U = 171.00, p = 0.35), but does differ from bvFTD (U = 110.00, p = 0.04) (please see Figure 1). Because bvFTD and MCI patients are matched in terms of global cognition as assessed by the MMSE (U = 107.5, p = 0.93), it is difficult to attribute the relative impairment observed in bvFTD entirely to an effect of overall cognitive impairment, but is more likely to be associated with the deficits characteristic of bvFTD.
The reaction time data offer converging evidence for our claim that patients with bvFTD are selectively impaired in indirect reply comprehension, relative to both healthy controls and patients with MCI. A Kruskal–Wallis test indicates that there are significant differences across our three groups for reaction time in both the direct condition (χ2(2) = 10.97, p = 0.001) and the indirect condition (χ2(2) = 13.75, p = 0.001). Upon further analysis, we find that patients with bvFTD are significantly slower to respond to direct replies than healthy controls (U = 81.5, p = 0.004), but not MCI (U = 155.00, p = 0.5). More importantly, in the indirect condition, bvFTD are slower to respond than both groups (controls: U = 67.5, p = 0.001; MCI: U = 108.00, p = 0.038). These data, however, do not address whether bvFTD patients have slower, non-specific motor reaction times or are more affected by the increased inferential demand characteristic of the indirect condition relative to the two other subject groups. To answer this question, we computed an individualized “slowing score” (slowing score = indirect RT – direct RT), analogous to the impairment score calculated for accuracy. In this case, a positive slowing score means a subject is relatively slower in the indirect condition. We find a significant difference in slowing scores across our three groups (χ2 = 9.30, p = 0.001). Post hoc testing indicates that patients with bvFTD have significantly larger slowing scores than healthy controls (U = 81.5, p = 0.005) and MCI (U = 99.00, p = 0.019) (please see Figure 2). Therefore, the disproportionate slowing for indirect compared to direct stimuli in bvFTD suggests that our observations cannot be easily attributed to simple motor slowing. Moreover, this finding demonstrates that patients with bvFTD do not slow their performance in a strategic effort to improve accuracy. Taken together, our data confirm that patients with bvFTD struggle to process indirect replies during conversation both quickly and accurately.
Figure 2. Response latency: Response latency in controls, patients with behavioral variant frontotemporal dementia (bvFTD), and patients with amnestic mild cognitive impairment (MCI). (A) Mean (±SE) reaction time in the direct and indirect conditions. Controls are shown in dark gray (leftmost bar), bvFTD patients in medium gray (middle bar), and MCI patients in light gray (right bar). (B) Mean (±SE) slowing score across groups. A higher slowing score indicates longer reaction times in the indirect condition relative to a patient’s individual baseline performance in the direct condition. * indicates significance at p < 0.05, ** indicates significance at p < 0.01, *** indicates significance at p < 0.001.
Correlational Analyses With Neuropsychological Measures
Next, to examine the cognitive mechanism(s) associated with the observed deficits in bvFTD patients, we administered a broad neuropsychological battery targeting core language skills, executive function, and social cognition that may contribute to inferential comprehension, as well as negative control measures of visuospatial functioning and episodic memory. We used Spearman correlations to relate these independent measures to the indirect-relative-to-direct inferential impairment score.
Our first aim is to demonstrate that indirect speech act comprehension impairment in bvFTD discourse is largely independent of segmental language ability. Consistent with our earlier finding of intact performance in the direct condition, correlation analyses indicate that language ability at both the phonological (i.e., repetition test) and single word (i.e., MINT) levels is not related to inferential impairment (please see Table 3). A measure of grammatical comprehension, however, comparing comprehension of object-relative sentences to subject-relative sentence, is significantly correlated with inferential impairment (rho = 0.52, p = 0.04).
Next, although patients with bvFTD are known to have deficits in working memory capacity (Kramer et al., 2003; Libon et al., 2007; Baez et al., 2016), we find no relationship between backward digit span and inferential impairment. Other domains of executive function, however, do demonstrate an effect: poor task-switching ability (as indicated by Trailmaking) is correlated with inferential impairment (Trailmaking: rho = −0.63, p = 0.006), suggesting a role for mental flexibility in the interpretation of indirect replies.
In the social domain, the impairment score is also positively associated with total score of the SNQ (rho = 0.47, p = 0.04). Upon further examination, we find that most patients performing worse on the SNQ have a higher Overadhere score than Break score [Overadhere: mean = 1.95 (±1.47); Break: mean = 1.05 (±1.35)], suggesting that patients who are more rigid in their application of rules to behavior may be similarly rigid in their interpretation of discourse. Finally, we also confirm the construct validity of our indirect speech task by demonstrating that impairment on the task is correlated with real-world conversational difficulties, as assessed by caregivers in the PCI-DAT (rho = 0.49, p = 0.02).
bvFTD performance in the indirect condition is not related to visuospatial or episodic memory functioning. The same correlation analyses are also performed in patients with MCI in order to test the specificity of the results in bvFTD, and no results in MCI are significant. In sum, we conclude that a relative impairment in understanding indirect speech is specific to bvFTD and related to the social and executive deficits that characterize the disease. More specifically, we implicate the ability to adapt behavior to changing rules and/or contexts in the interpretation of indirect speech.
Based on these initial correlation results, we then used multiple linear regression to predict the impairment score based on three significant and possibly interacting variables, one from each domain: grammatical comprehension, Trailmaking (B-A), and SNQ. A total of 5 different models were tested: all variables as independent (Model 1); all variables interacting (Model 2); and each of the pairwise interactions (the remaining predictor as independent, Models 3-5). Only one model yields a significant regression equation [(Impairment Score ∼ Grammatical Comprehension + Trailmaking ∗ SNQ); F(4,13) = 9.346, p = 0.006]. The overall model fit is strong, with R2 = 0.84. Both Trailmaking (β = 0.009, p = 0.004) and SNQ (β = 0.067, p = 0.002) are significant independent predictors of the impairment score, along with their interaction (β = −0.005, p = 0.004), while grammatical comprehension is not a significant independent predictor (β = 0.11, p = 0.19). The results of this analysis suggest that social cognition and executive functioning interact with one another and may play a role in the interpretation of indirect speech in bvFTD.
Neuroimaging Analyses
We also sought to determine the neuroanatomic basis of indirect speech act comprehension. More specifically, we examined regions of gray and white matter disease that may be related to impaired indirect speech act performance in patients with bvFTD. We note here that we focus solely on bvFTD patients in the following analyses because patients with MCI showed no impairment in the indirect condition, which is our experimental condition of interest.
We first contrasted cortical thickness in patients with bvFTD relative to an independent cohort of age-matched healthy controls. As illustrated in Figure 3 and summarized in Table 4, this reveals significantly reduced cortical thickness throughout the frontal and anterior temporal lobes bilaterally in bvFTD, with a peak in orbitofrontal cortex, consistent with disease diagnosis and previous structural imaging studies (Rascovsky et al., 2011; Möller et al., 2016).
Figure 3. Structural Neuroimaging Results: (A) Surface renderings depicting regions of significant cortical thinning in behavioral variant frontotemporal dementia (bvFTD) patients relative to age-matched healthy controls. Heat map intensity refers to t-statistic values. (B) Axial slices and z-axis coordinates illustrating regions of significant cortical thinning in bvFTD patients relative to age-matched healthy controls (red and blue regions) and regions of significant cortical thinning associated with indirect comprehension impairment in bvFTD (red areas, only).
Next, to relate patient deficits in indirect speech act comprehension to gray matter disease, we performed a regression analysis using the impairment score (indirect – direct) as a covariate. We find that greater relative impairment in the indirect condition is related to reduced cortical thickness in a largely left-lateralized cortical network, spanning frontal, temporal, and parietal regions. Significant clusters are observed within the classic peri-Sylvian language network, including left inferior frontal gyrus and posterior middle to superior temporal gyri, as well as right inferior frontal gyrus (pars opercularis). Additional effects are seen in regions that are more traditionally associated with social cognition, including medial prefrontal cortex, orbitofrontal cortex, and precuneus; and with executive function, including dorsolateral prefrontal cortex. Although unpredicted, we also see significant associations with premotor cortex, precentral gyrus, and supplementary motor areas, which have been previously implicated as part of the multiple-demand network and thought to play a role in broad domain-general functions (Fedorenko et al., 2013).
Our next set of analyses tested our hypothesis that three primary networks (language, social, and executive) are related to indirect speech comprehension by computing linear models using the mean cortical thickness score for each network as predictors for the impairment score. We did this by using a ROI-based approach across the whole-brain, rather than a voxel-wise approach. Using the network ROIs associated with language, social, and executive function defined in the Methods section, we find significant effects for each of our three networks, as shown in Figure 4. This effect is specific to these 3 networks and is not observed in the negative control, sensorimotor network.
Figure 4. Network Analyses: (A) Network Key. Surface renderings of the brain showing each of the 4 network ROIs tested for their relationship with indirect speech processing: language network (green), social network (blue), executive network (yellow), and sensorimotor network (red). See text for a description of how each network was defined. (B) Network associations with Indirect comprehension impairment. Graphs plot the relationships between network cortical thickness in behavioral variant frontotemporal dementia (bvFTD) and indirect impairment score for language, executive, social, and sensorimotor networks. Note that the sensorimotor network is included as a negative control network to demonstrate specificity. See bottom right corner of each plot for R2-values.
Finally, while the majority of previous work on language comprehension has focused primarily on gray matter contributions to processing, we adopt a more connectionist approach here. Using a voxel-wise approach, we observe a significant change in FA in the following tracts within bvFTD: uncinate fasciculus, superior and inferior longitudinal fasciculi, and inferior fronto-occipital fasciculus. These are all long-range association tracts. We also observed disease in the corpus callosum, as well as white matter of the middle frontal and temporal gyri. We next examined which of these tracts are associated with the (indirect – direct) impairment score in bvFTD. As illustrated in Figure 5 and summarized in Table 5, we find significant effects for the superior longitudinal fasciculus (typically implicated in language processing), as well as the uncinate fasciculus (typically implicated in social-behavioral functioning), and inferior fronto-occipital fasciculus and frontal aslant.
Figure 5. White Matter Imaging Results: (A) Axial slices showing regions of significantly reduced fractional anisotropy (FA) in white matter (WM) of behavioral variant frontotemporal dementia (bvFTD) patients relative to age-matched healthy controls (blue), regions of significantly reduced FA related to indirect impairment (red), and ancillary white matter regions (outside of blue regions of disease) also related to indirect impairment (violet). See key in upper right hand corner.
Discussion
Most listeners are exceedingly adept at decoding a speaker’s intended meaning, despite the ambiguity inherent in much conversational speech. An unresolved question in neuroscience is how the brain accomplishes this feat. To address this issue, we study speech act processing in non-aphasic patients with bvFTD, and demonstrate that their comprehension is most impaired when a speaker’s intended meaning is communicated indirectly. This is related in part to neuropsychological measures of social and executive functioning and grammatical comprehension. Moreover, the observed impairment in indirect speech act comprehension is related to disease not only in the traditional language network (including left IFG and pMTG/STG), but also in two additional networks: the social brain network (including mPFC, OFC, and precuneus) and the executive network (including DLPFC, premotor cortex, and supplementary motor area), as well as the long-tract white matter projections that integrate these networks. Therefore, while traditional models of language highlight a left peri-Sylvian network, our observations are consistent with the hypothesis that the highly common but often overlooked inferential component of conversational speech is supported in part an extended language network. This network also incorporates frontal and parietal association cortices well beyond traditional left peri-Sylvian language regions. We discuss these findings and their implications below.
Inferential Demand Modulates Language Comprehension
Our primary objective was to examine how inferential demand—whether a speaker’s message is communicated directly or indirectly—modulates comprehension. Analyses of patient performance based on both accuracy and reaction time metrics suggest a deficit in indirect speech act comprehension in bvFTD. Findings of reduced accuracy extend the social-executive deficit in bvFTD to the language domain. We are unaware of other studies of indirect speech act comprehension in bvFTD, although clinical observations of schizophrenia, autism, and traumatic brain injury suggest difficulties with indirect speech exist in these populations (Champagne-Lavau and Stip, 2010; Johnson and Turkstra, 2012; Pastor-Cerezuela et al., 2018). Even for items where comprehension is preserved, moreover, we find significantly slowed performance. Previous studies have also reported that reaction time increases along with higher inferential demand (Ferstl and von Cramon, 2002; Kuperberg et al., 2006; Siebörger et al., 2007), and our findings suggest that slowing during a communication task that depends in part on inferencing is even greater in patients with bvFTD. Slowed processing can have considerable effects on real-world communication, as the gap between “turns at talk” is typically on the order of 200-250ms (Stivers et al., 2009; Levinson, 2016). In our data, bvFTD patients show a slowing effect of ∼600 ms: such a processing lag would obviously impede the rapid exchanges that characterize human conversation.
We further demonstrate that our effects are specific to bvFTD and not observable in brain-damaged controls with MCI. While evidence suggests that pragmatic deficits such as proverb interpretation may exist in MCI (Leyhe et al., 2011; Cardoso et al., 2014), such findings may be a consequence of experimental confounds related to stimulus length or “frozen” meanings, and potentially associating findings with impaired episodic memory retrieval rather than impaired inferential processing. More work is needed to investigate this possibility.
Next, we examined the cognitive mechanisms that may contribute to indirect speech comprehension by evaluating the results of a neuropsychological battery. Findings indicate that the observed deficit in bvFTD may be multifactorial in nature, as the indirect speech impairment (indirect – direct) score is related in part to language, social, and executive functioning, but not to episodic memory or visuospatial functioning.
Consider first executive function, which was assessed by Trailmaking. This finding aligns well with previous research showing a relationship between mental flexibility and pragmatic competence (Eslinger et al., 2007; Torralva et al., 2015). For example, Torralva et al. (2015) demonstrated that cognitive theory of mind and the ability to infer a speaker’s intention in a faux pas task is related to Trailmaking performance, although this finding is confounded in part by the lengthy nature of the stimulus items. While using a narrative helps establish context, as in most theory of mind stimulus materials, this can also increase executive demands and introduce carry-over effects that make it difficult to dissociate inferential processing from task-related components of narrative processing, such as working memory demands needed to maintain narrative elements and track a character over time. Other results emphasize this potential confound by suggesting that working memory capacity may predict inference revision ability (Tompkins et al., 1994; Wright and Newhoff, 2002; Pérez et al., 2014). In our experiment, we suggest that bvFTD patients struggle to infer a speaker’s intention, perhaps related to difficulty switching from a literal to a pragmatic interpretation of utterance meaning. Our results are less likely to be confounded by working memory demands due to the brief stimulus items and the availability of written stimuli during the entire procedure. Indeed, although working memory is decreased in bvFTD (Kramer et al., 2003), we find little relationship between indirect speech act comprehension impairment and digit span. Future work using auditory stimuli should further investigate working memory contributions to language comprehension.
We also report a positive association between the indirect speech impairment score and performance on SNQ—a questionnaire assessing an individual’s ability to apply socially dictated rules given different constraints (e.g., a conversation with a stranger versus a friend). One important social norm for conversational exchanges is Grice’s “Maxim of Relevance,” which states that an individual’s contribution to an ongoing exchange should always be pertinent and on-topic. bvFTD subjects may fail to appreciate this maxim due to degraded social knowledge, and can be observed clinically to respond to questions with tangential replies. Thus, they may judge indirect speech as irrelevant to an ongoing exchange and disregard it accordingly, ultimately resulting in impaired comprehension, as observed here. Task demands also depend in part on meta-judgments, that is, the patient’s judgment of whether a reply means “yes” or “no.” This kind of judgment in a controlled experimental context may differ from judgments in a real-world context where there is also additional contextual support for responding to an indirect request. While indirect responses to some requests may be overlearned (e.g., Question: “Do you have the time?” Response: “Noontime.”) relative to a direct response (Question: “Do you have the time?” Response: “Yes.”), the clinical impression is that questions eliciting an indirect response tend to yield a direct or literal response from bvFTD patients more often than would ordinarily be expected. Additional work is needed in a real-world setting to gauge the extent of an indirect speech act comprehension deficit in bvFTD.
Multiple regression analysis confirms the role that executive function and social cognition play in impairment. The final model (Impairment Score ∼ Grammatical Comprehension + Trailmaking ∗ SNQ) also suggests that social and executive deficits are not independent, but rather interact. This result has implications for an ongoing debate in the bvFTD literature concerning the relationship between social cognition and executive function (Lough et al., 2001; Eslinger et al., 2007; Le Bouc et al., 2012; Bertoux et al., 2016).
Although patients with bvFTD are grossly non-aphasic according to clinician assessments of speech, their indirect impairment is associated in part with a language measure—grammatical comprehension. In this case, grammatical comprehension was assessed by comparing sentence-picture matching for grammatically complex object-relative sentences compared to subject-relative sentences. We note here that the comprehension of object-relative sentences is known to be more difficult than subject-relative sentences in both healthy adults and patients with bvFTD (Charles et al., 2014; Demberg and Sayeed, 2016). This positive association may be related in part to the mental manipulation of linguistic materials that may contribute to comprehension of both object-related sentences and indirect speech acts. We also note here that the relationship between grammatical comprehension and indirect speech act comprehension impairment is lessened when concomitant deficits in social cognition and executive function are taken into account in our three-factor regression model. Additional work is needed to examine the nature of deficits in grammatical comprehension in bvFTD, and the potential contribution of such a deficit to the comprehension of indirect speech acts in these patients.
While we used carefully constructed and well-matched experimental materials to assess comprehension of indirect relative to direct speech acts, one shortcoming of our study is that performance depends on patients’ judgments of speech acts rather than their difficulty engaging in actual speech acts during day-to-day natural discourse. To mitigate this shortcoming, we related patients’ indirect speech act performance to caregivers’ judgments of communicative efficacy. We find that difficulty with indirect speech act comprehension is related to caregivers’ perception of impoverished day-to-day conversational ability. Ultimately, our goal is to help improve daily discourse in bvFTD in order to advance a patient’s quality of life and minimize health-related risks associated with limitations in conversational exchanges that frequently involve indirect speech acts. Consider a situation where a caregiver asks a loved one “Do you need me?”, and the patient with bvFTD responds “Yes.” A direct reply to this request, when an indirect response to a question is wished, for example, does not indicate that the patient is feeling chest pain as might be experienced in a myocardial infarct. Instead, the caregiver may be obliged in this situation to make an inference based on the patient’s facial expression of pain. It is exceedingly common that a caregiver infers a bvFTD patient’s needs based on information other than that most often available from a verbal response. Additional work is needed to confirm the consequences of impaired indirect speech act comprehension in natural, day-to-day conversation in bvFTD.
An Extra-Sylvian Network for Speech Act Comprehension
Although neurobiological models of language centered on left peri-Sylvian regions have been foundational in studies of human brain functioning, these models remain limited in their external validity and generalizability to real-world contexts (Hasson et al., 2018). Here, we examine cortical thinning and fractional anisotropy in patients with bvFTD, and begin to build a large-scale, multimodal language network that can potentially account for some very common aspects of real-world discourse such as indirect speech act comprehension.
To date, only a limited number of studies has examined the neural basis of indirect reply comprehension (Shibata et al., 2011; Basnáková et al., 2013; Jang et al., 2013; Feng et al., 2017). While these fMRI studies offer preliminary evidence for the role of non-language regions including mPFC, TPJ, and precuneus in discourse processing, there are some caveats to keep in mind. For example, several studies used experimental tasks that involve reading a brief narrative followed by an exchange between speakers. Using narratives to establish context can increase executive demands and introduce carry-over effects that make it difficult to dissociate inferential processing from other task-related components of narrative processing—including tracking a character over time, processing event structure, maintaining narrative elements in working memory, and more. To help manage this potential confound, we designed a novel question-answer paradigm that manipulates inferential demand while simultaneously minimizing task-related resource demands and controlling for linguistic variation across stimuli. Moreover, fMRI studies may not fully control for all task-related demands.
As our paradigm was language-based, we did observe significant effects in the IFG and the posterior MTG/STG. These areas, initially proposed by the WLG model and later confirmed, constitute the primary nodes of the classic language network (Binder et al., 1997; Price, 2000). In our study, we point out that these peri-Sylvian regions are related to patient impairment in the indirect condition over and above that found in the direct condition. Therefore, our results support a role for left peri-Sylvian regions not only in lexical, semantic, and syntactic processing, but also in higher-level selection and global integration that may be required in discourse, as suggested previously (Hagoort, 2005). Previous fMRI studies of indirect speech and causal inferencing make similar arguments (Mason and Just, 2004; Eviatar and Just, 2006). We also observe an effect in the right IFG, which is consistent with the dynamic spillover hypothesis described by Prat and colleagues (Prat et al., 2011). According to this model, activity in the right hemisphere is more likely to be invoked when 1) readers are less skilled, and 2) passage difficulty is harder. It is important to point out that bilateral IFG also appears to contribute to other aspects of speech such as prosody, and prosody may signal a speech act that is indirect in nature. While this may be less relevant in the present study due to the availability of written stimuli, we showed elsewhere that disease in IFG is related to reduced pitch range in the speech of bvFTD patients (Nevler et al., 2017). Additional work is needed to investigate the relative contributions of inferencing and prosodic processing in the limited comprehension of indirect speech acts during bvFTD patients’ natural conversation.
We now know that language processing also extends beyond peri-Sylvian regions (Ferstl et al., 2008; Fedorenko and Thompson-Schill, 2014; Hagoort, 2014). We report here that extra-Sylvian regions, including the orbitofrontal, medial prefrontal, dorsolateral prefrontal cortices, as well as precuneus and premotor and supplementary motor regions, are related to indirect speech processing in bvFTD. These are regions encompassed by social and executive networks of the brain. Importantly, these findings are relatively selective, as we find no evidence of other network involvement (e.g., sensorimotor network).
Consider first mPFC and precuneus, which are both related to a social brain network commonly associated with “theory of mind” (Saxe and Kanwisher, 2003; Frith and Frith, 2012; Dufour et al., 2013; Healey and Grossman, 2018). While mPFC is traditionally associated with perspective-taking and the ability to make inferences about conspecifics, recent research also suggests that a ventral portion of mPFC, similar to the cluster observed here, plays a role in scene construction and situational processing (Lieberman et al., 2019). In the case of indirect speech acts, mPFC may help generate a “schema” or “situation model” that guides interpretation of ambiguous stimuli and events. The precuneus may play a similar role. One of the brain’s most globally connected areas, the precuneus is traditionally associated with a diverse set of cognitive functions including visuospatial processing, episodic memory (Shallice et al., 1994), and mental imagery (Hassabis et al., 2007; Johnson et al., 2007). Newer work, moreover, has demonstrated that the precuneus also plays a role in self-referential processing and first-person perspective-taking, as well as situation model-building and the retrieval of contextual associations from internal stores (Lundstrom et al., 2005; Cavanna and Trimble, 2006; Binder et al., 2009; Mashal et al., 2014; Herold et al., 2016). Taken together, the relationship of mPFC and precuneus to indirect speech impairment suggests that indirect reply comprehension requires listeners to (1) adopt the speaker’s perspective, and (2) integrate contextual information into some kind of mental model. Finally, we also observed an effect in orbitofrontal cortex, which is sometimes included in the social brain network. Like mPFC and precuneus, some studies implicate OFC in theory of mind, in addition to tasks involving reversal learning, set-shifting, and affective decision-making (Rolls, 2004; Sabbagh, 2004; Badre and Wagner, 2006).
DLPFC, on the other hand, is often considered to be part of a “multiple-demand” network commonly linked to domain-general, executive control processes that may be involved in language and other behaviors (Novais-Santos et al., 2007; Duncan, 2010; Fedorenko et al., 2013). These regions are often defined by contrasting two task conditions that vary in difficulty (e.g., verbal working memory tasks with 4 digits versus 8 digits), mirroring our indirect-direct contrast. It is important to note that these “harder” tasks may not only require additional computational resources, but could also invoke strategic reasoning processes mediated by DLPFC (Yoshida et al., 2010; Yamagishi et al., 2016). Finally, with well-documented roles in working memory and selection (Petrides, 2005; Badre, 2008), DLPFC is also implicated in the Memory-Unification-Control model of language (Hagoort, 2013), serving as the “control” component and mediating processes such as turn-taking and the selection of contextually appropriate meanings. The motor-associated regions we observed, including premotor cortex, precentral gyrus, and supplementary motor area, have also been hypothesized to belong to this same network as DLPFC (Fedorenko et al., 2013). While additional work is needed to determine more precisely the cortical constituents underlying the social and executive components of language, our extended neurobiological model of language proposes that a neural network supporting common elements of discourse such as indirect speech act comprehension incorporating these brain regions associated with executive and social functioning.
Other materials have been used to study inferential demands in language, but may be associated with confounds that can limit interpretation. For example, recent work using fMRI (Paunov et al., 2019) has demonstrated that story comprehension elicits synchronized network activity not only in traditional language-associated regions, but also in social regions including mPFC, TPJ, and precuneus. Similar results have been reported elsewhere (Xu et al., 2005; Mar, 2011; AbdulSabur et al., 2014). A third, fronto-parietal network associated with executive control, possibly related to working memory, has also been implicated in story comprehension (Raposo and Marques, 2013; Smirnov et al., 2014; Mineroff et al., 2018; Aboud et al., 2019; Paunov et al., 2019). Although these results are promising, narratives are inherently long, which makes them difficult to control experimentally and overly dependent on task-related executive resources.
Another common approach to examining the inferential component of discourse has been the study of non-literal or figurative language, including sarcasm, irony, metaphors, idioms, and proverbs (see Rapp et al., 2012 for a comprehensive review). This body of work also implicates social and executive components in the comprehension of pragmatic language (Wakusawa et al., 2007; Bohrn et al., 2012; Uchiyama et al., 2012; Iskandar and Baird, 2014; Obert et al., 2016; Filik et al., 2019). While informative, these materials are often subject to confounds related to varying degrees of familiarity and emotional valence, among others (Nippold and Haq, 1996; Schmidt and Seger, 2009; Ziv et al., 2011; Kaiser et al., 2013). To minimize confounds associated with lengthy, contextualizing narratives, differential familiarity, and emotional valence, we opted to study the neural basis for inferential reasoning in discourse by studying indirect speech acts, where we found that comprehension encompasses a core, left peri-Sylvian language network as well as cortical regions often encompassed by executive controls and social networks.
White Matter Correlates of Speech Act Comprehension
Recent work has paid increasing attention to white matter connectivity. While the traditional WLG model of language focuses primarily on the arcuate fasciculus – a component of the superior longitudinal fasciculus connecting IFG and STG, newer work has identified pathways that not only interconnect peri-Sylvian regions, but also connect these regions to extra-Sylvian regions (Catani et al., 2005; Dick and Tremblay, 2012). Analogous to the visual system, these pathways may be divided into dorsal and ventral streams. One characterization implicates the dorsal stream as broadly involved in auditory-motor integration and the ventral stream in mapping form to meaning (Hickok and Poeppel, 2004; Saur et al., 2008). Using voxel-based fractional anisotropy analyses, we find evidence implicating tracts in both dorsal and ventral streams in indirect speech act comprehension. This includes the uncinate and inferior fronto-occipital fasciculi in the ventral stream, and the superior longitudinal fasciculus and frontal aslant in the dorsal stream. The frontal aslant, in particular, is a recently discovered tract implicated in both speech and language (on the left) and executive function (on the right) (Varriano et al., 2018; Dick et al., 2019). The frontal aslant, which is thought to project between the IFG and the supplementary motor areas, has previously been implicated in verbal fluency deficits in aphasic variants of frontotemporal dementia known as primary progressive aphasia (Catani et al., 2013). The uncinate fasciculus, carrying projections between orbitofrontal cortex and anterior temporal regions, has also gained more attention recently as a white matter tract mediating the interaction of social and language networks. For example, damage to the uncinate fasciculus is bvFTD is associated not only with a bvFTD diagnosis, but also with deficits in non-literal language comprehension including sarcasm and irony (Agosta et al., 2012; Downey et al., 2015). Thus, we propose that cortical components of our extended language network are integrated by white matter projections in both dorsal and ventral projection streams.
Conclusion
Strengths of our study include the novel task design with carefully matched direct and indirect conditions and minimal task-related demands, observation of a significant indirect language impairment in a non-aphasic brain-damaged cohort with selective social and executive deficits, an association of indirect speech with deficits on measures of task-switching and social functioning, a relationship between indirect speech act performance and real-world communicative efficacy, and robust association of these deficits with an anatomic network implicating language, social, and executive networks. Nevertheless, several caveats should be kept in mind when interpreting our results. Although we tested a relatively large bvFTD cohort and demonstrated specificity with a brain-damaged control group, our cohort is small, patients are not pathologically confirmed, we cannot specify the exact anatomic extent of a “lesion” in neurodegenerative disease, and generalizability is limited to the mild-moderate disease stage. Second, while we confirmed an indirect speech impairment with reaction time data, we report ceiling effects for accuracy in our control subjects, thereby limiting examination of individual differences associated with aging. To differentiate the functions of nodes within the extended language network, future experimental studies should contrast different types of indirect speech, including indirect requests (which have a motor component) and “face-saving” replies (which have an affective component), and assess indirect speech acts in natural discourse. While correlative, it would be valuable to confirm our anatomic observations in healthy young adults using fMRI, and to confirm a causal association for these anatomic observations in bvFTD using longitudinal studies.
The findings discussed here also have meaningful clinical implications. Communication difficulties can compromise social interactions, and in turn, diminish safety, interpersonal relationships and overall well-being. We find that impaired indirect speech is related to communicative efficacy, which is a crucial element of patient safety and quality of life. Accordingly, language deficits may be a target for intervention in bvFTD. Our data also have implications for “best-practice” communication strategies used by patient caregivers: to optimize successful communication, language should be as direct as possible.
With these caveats in mind, we conclude that patients with bvFTD struggle to make the pragmatic inferences necessary to support comprehension of indirect replies, a very common but understudied example of conversational discourse that depends on inferencing. This is due in part to social-executive deficits and degradation of a multimodal, extra-Sylvian network supporting natural, daily language use. More specifically, our findings emphasize the extension of the brain’s traditional language network beyond left peri-Sylvian regions into additional frontal and parietal regions that may be incorporated into a real-world language network that supports everyday discourse. We conclude by emphasizing the importance of studying language in context—the way in which we use it in everyday life. Indeed, it is only when we study language in this way—as a means of communication—that we can begin to characterize the full extent of its neurobiologic foundations.
Data Availability Statement
The data for the study are available from the authors to qualified investigators with appropriate Institutional Review Board approval and Material Transfer Agreement.
Ethics Statement
The studies involving human participants were reviewed and approved by Institutional Review Board, University of Pennsylvania. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
MH did the design of experiments, performing statistical analyses and initial draft of report. EH, MU, and DI did the data collection and reading and editing manuscript. CO performed statistical analyses and read and edited the manuscript. NN read and edited the manuscript. MG did the design of experiments, reading and editing manuscript, and funding. All authors contributed to the article and approved the submitted version.
Funding
This work was supported in part by grants from NIH (AG066597, AG017586, AG052943, AG054519, and NS101863), the Wyncote Foundation, and an anonymous donor.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We thank the radiographers at the Hospital of the University of Pennsylvania for their assistance with data collection and our patients and volunteers for their continued participation.
Footnotes
- ^ https://cran.r-project.org/
- ^ https://github.com/ANTsX/ANTs
- ^ http://fsl.fmrib.ox.ac.uk/fsl/fslwiki
- ^ http://www.humanconnectome.org/software/connectome-workbench.html
- ^ https://github.com/ftdc-picsl/QuANTs/tree/master/R
References
AbdulSabur, N. Y., Xu, Y., Liu, S., Chow, H. M., Baxter, M., Carson, J., et al. (2014). Neural correlates and network connectivity underlying narrative production and comprehension: a combined fMRI and PET study. Cortex 57, 107–127. doi: 10.1016/j.cortex.2014.01.017
Aboud, K. S., Bailey, S. K., Del Tufo, S. N., Barquero, L. A., and Cutting, L. E. (2019). Fairy tales versus facts: genre matters to the developing brain. Cereb. Cortex 29, 4877–4888. doi: 10.1093/cercor/bhz025
Agosta, F., Scola, E., Canu, E., Marcone, A., Magnani, G., Sarro, L., et al. (2012). White matter damage in frontotemporal lobar degeneration spectrum. Cereb. Cortex 22, 2705–2714. doi: 10.1093/cercor/bhr288
Albert, M. S., DeKosky, S. T., Dickson, D., Dubois, B., Feldman, H. H., Fox, N. C., et al. (2011). The diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations the national institute on Aging-Alzheimer’s association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 7, 270–279. doi: 10.1016/j.jalz.2011.03.008
Alexander, D. C., Barker, G. J., and Arridge, S. R. (2002). Detection and modeling of non-Gaussian apparent diffusion coefficient profiles in human brain data. Magn. Reson. Med. 48, 331–340. doi: 10.1002/mrm.10209
Ash, S., Moore, P., Antani, S., McCawley, G., Work, M., and Grossman, M. (2006). Trying to tell a tale: discourse impairments in progressive aphasia and frontotemporal dementia. Neurology 66, 1405–1413. doi: 10.1212/01.wnl.0000210435.72614.38
Avants, B. B., Epstein, C. L., Grossman, M., and Gee, J. C. (2008). Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly an neurodegenerative brain. Med. Image Anal. 12, 26–41. doi: 10.1016/j.media.2007.06.004
Badre, D. (2008). Cognitive control, hierarchy, and the rostro-caudal organization of the frontal lobes. Trends Cogn. Sci. 12, 193–200. doi: 10.1016/j.tics.2008.02.004
Badre, D., and Wagner, A. D. (2006). Computational and neurobiological mechanisms underlying cognitive flexibility. Proc. Natl. Acad. Sci. U.S.A. 103, 7186–7191. doi: 10.1073/pnas.0509550103
Baez, S., Pinasco, C., Roca, M., Ferrari, J., Couto, B., García-Cordero, I., et al. (2016). Brain structural correlates of executive and social cognition profiles in behavioral variant frontotemporal dementia and elderly bipolar disorder. Neuropsychologia 126, 159–169. doi: 10.1016/j.neuropsychologia.2017.02.012
Basnáková, J., Weber, K., Petersson, K. M., van Berkum, J., and Hagoort, P. (2013). Beyond the language given: the neural correlates of inferring speaker meaning. Cereb. Cortex 24, 2572–2578. doi: 10.1093/cercor/bht112
Benton, A. L., Sivan, A. B., Hamsher, K. de S., Varney, N. R., and Spreen, O. (1983). Judgment of Line Orientation. Contributions to Neuropsychological Assessment – A Clinical Manual 25414BC. Oxford: Oxford University Press, Inc.
Bell, J. S. (2002). Narrative inquiry: more than just telling stories. TESOL Q. 36, 207–213. doi: 10.2307/3588331
Bertoux, M., Callaghan, C. O., Dubois, B., and Hornberger, M. (2016). In two minds : executive functioning versus theory of mind in behavioural variant frontotemporal dementia. J. Neurol. Neurosurg. Psychiatry 87, 231–234. doi: 10.1136/jnnp-2015-311643
Binder, J. R., Desai, R. H., Graves, W. W., and Conant, L. L. (2009). Where is the semantic system? a critical review and meta-analysis of 120 functional neuroimaging studies. Cereb. Cortex 19, 2767–2796. doi: 10.1093/cercor/bhp055
Binder, J. R., Frost, J. A., Hammeke, T. A., Cox, R. W., Rao, S. M., and Prieto, T. (1997). Human brain language areas identified by functional magnetic resonance imaging. J. Neurosci. 17, 353–362. doi: 10.1523/jneurosci.17-01-00353.1997
Bohrn, I. C., Altmann, U., and Jacobs, A. M. (2012). Looking at the brains behind figurative language-A quantitative meta-analysis of neuroimaging studies on metaphor, idiom, and irony processing. Neuropsychologia 50, 2669–2683. doi: 10.1016/j.neuropsychologia.2012.07.021
Brysbaert, M., and New, B. (2009). Moving beyond Kucera and Francis: a critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behav. Res. Methods 41, 977–990. doi: 10.3758/BRM.41.4.977
Brysbaert, M., Warriner, A. B., and Kuperman, V. (2014). Concreteness ratings for 40 thousand generally known English word lemmas. Behav. Res. Methods 46, 904–911. doi: 10.3758/s13428-013-0403-5
Cardoso, S., Silva, D., Maroco, J., De Mendonça, A., and Guerreiro, M. (2014). Non-literal language deficits in mild cognitive impairment. Psychogeriatrics 14, 222–228. doi: 10.1111/psyg.12101
Catani, M., Jones, D. K., and Ffytche, D. H. (2005). Perisylvian language networks of the human brain. Ann. Neurol. 57, 8–16. doi: 10.1002/ana.20319
Catani, M., Mesulam, M. M., Jakobsen, E., Malik, F., Martersteck, A., Wieneke, C., et al. (2013). A novel frontal pathway underlies verbal fluency in primary progressive aphasia. Brain 136, 2619–2628. doi: 10.1093/brain/awt163
Cavanna, A. E., and Trimble, M. R. (2006). The precuneus: a review of its functional anatomy and behavioural correlates. Brain 129, 564–583. doi: 10.1093/brain/awl004
Champagne-Lavau, M., and Stip, E. (2010). Pragmatic and executive dysfunction in schizophrenia. J. Neurolinguistics 23, 285–296. doi: 10.1016/j.jneuroling.2009.08.009
Charles, D., Olm, C., Powers, J., Ash, S., Irwin, D. J., McMillan, C. T., et al. (2014). Grammatical comprehension deficits in non-fluent/agrammatic primary progressive aphasia. J. Neurol. Neurosurg. Psychiatry 85, 249–256. doi: 10.1136/jnnp-2013-305749
Clark, H. H. (1979). Responding to indirect speech acts. Cogn. Psychol. 11, 430–477. doi: 10.1016/0010-0285(79)90020-3
Cook, P. A., Bai, Y., Nedjati-Gilani, S., Seunarine, K. K., Hall, M. G., Parker, G. J., et al. (2006). “Camino: Open-Source Diffusion-MRI Reconstruction and Processing,” in Proceedings of the 13th Scientific Meeting, International Society for Magnetic Resonance in Medicine, Seattle, WA, 2759.
Cousins, K. A. Q., Ash, S., Irwin, D. J., and Grossman, M. (2017). Dissociable substrates underlie the production of abstract and concrete nouns. Brain Lang. 165, 45–54. doi: 10.1016/j.bandl.2016.11.003
Demberg, V., and Sayeed, A. (2016). The frequency of rapid pupil dilations as a measure of linguistic processing difficulty. PLoS One 11:e0146194. doi: 10.1371/journal.pone.0146194
Dick, A. S., Garic, D., Graziano, P., and Tremblay, P. (2019). The frontal aslant tract (FAT) and its role in speech, language and executive function. Cortex 111, 148–163. doi: 10.1016/j.cortex.2018.10.015
Dick, A. S., and Tremblay, P. (2012). Beyond the arcuate fasciculus: Consensus and controversy in the connectional anatomy of language. Brain 135, 3529–3550. doi: 10.1093/brain/aws222
Downey, L. E., Mahoney, C. J., Buckley, A. H., Golden, H. L., Henley, S. M., Schmitz, N., et al. (2015). White matter tract signatures of impaired social cognition in frontotemporal lobar degeneration. Neuroimage Clin. 8, 640–651. doi: 10.1016/j.nicl.2015.06.005
Dufour, N., Redcay, E., Young, L., Mavros, P. L., Moran, J. M., Triantafyllou, C., et al. (2013). Similar brain activation during false belief tasks in a large sample of adults with and without autism. PLoS One 8:e75468. doi: 10.1371/journal.pone.0075468
Duncan, J. (2010). The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour. Trends Cogn. Sci. 14, 172–179. doi: 10.1016/j.tics.2010.01.004
Eslinger, P. J., Moore, P., Troiani, V., Antani, S., Cross, K., Kwok, S., et al. (2007). Oops! resolving social dilemmas in frontotemporal dementia. J. Neurol. Neurosurg. Psychiatry 78, 457–460. doi: 10.1136/jnnp.2006.098228
Eviatar, Z., and Just, M. A. (2006). Brain correlates of discourse processing: an fMRI investigation of irony and conventional metaphor comprehension. Neuropsychologia 44, 2348–2359. doi: 10.1016/j.neuropsychologia.2006.05.007
Farag, C., Troiani, V., Bonner, M., Powers, C., Avants, B., Gee, J., et al. (2010). Hierarchical organization of scripts: converging evidence from FMRI and frontotemporal degeneration. Cereb. Cortex 20, 2453–2463. doi: 10.1093/cercor/bhp313
Fedorenko, E., and Thompson-Schill, S. L. (2014). Reworking the language network. Trends Cogn. Sci. 18, 120–126. doi: 10.1016/j.tics.2013.12.006
Fedorenko, E., Duncan, J., and Kanwisher, N. (2013). Broad domain generality in focal regions of frontal and parietal cortex. Proc. Natl. Acad. Sci.U.S.A. 110, 16616–16621. doi: 10.1073/pnas.1315235110
Fedorenko, E., Hsieh, P.-J., Nieto-Castanon, A., Whitfield-Gabrieli, S., and Kanwisher, N. (2010). New method for fMRI investigations of language: defining ROIs functionally in individual subjects. J. Neurophysiol. 104, 1177–1194. doi: 10.1152/jn.00032.2010
Feng, W., Wu, Y., Jan, C., Yu, H., Jiang, X., and Zhou, X. (2017). Effects of contextual relevance on pragmatic inference during conversation: an fMRI study. Brain Lang. 171, 52–61. doi: 10.1016/j.bandl.2017.04.005
Ferstl, E. C., Neumann, J., Bogler, C., and von Cramon, D. Y. (2008). The extended language network: a meta-analysis of neuroimaging studies on text comprehension. Hum. Brain Mapp. 29, 581–593. doi: 10.1002/hbm.20422
Ferstl, E. C., and von Cramon, D. Y. (2002). What does the frontomedian cortex contribute to language processing: coherence or theory of mind? Neuroimage 17, 1599–1612. doi: 10.1006/nimg.2002.1247
Filik, R., Ţurcan, A., Ralph-Nearman, C., and Pitiot, A. (2019). What is the difference between irony and sarcasm? An fMRI study. Cortex 115, 112–122. doi: 10.1016/j.cortex.2019.01.025
Friederici, A. D. (2015). White-matter pathways for speech and language processing. Handb. Clin. Neurol. 129, 177–186. doi: 10.1016/B978-0-444-62630-1.00010-X
Frith, C. D., and Frith, U. (2012). Mechanisms of social cognition. Annu Rev Psychol. 63, 287–313. doi: 10.1146/annurev-psych-120710-100449
Gauthier, S., Reisberg, B., Zaudig, M., Petersen, R. C., Ritchie, K., Broich, K., et al. (2010). Mild cognitive impairment. Lancet 367, 1262–1270.
Gollan, T. H., Weissberger, G. H., Runnqvist, E., Montoya, R. I., and Cera, C. M. (2012). Self969 ratings of spoken langage dominance: a multi-lingual naming test (MINT) and preliminary norms for young and aging Spanish-English bilinguals. Biling (Camb. Engl.) 15, 594–615. doi: 10.1017/S1366728911000332
Grice, H. P. (1975). “Logic and conversation,” in Syntax and Semantics, Vol. 3, eds P. Cole and J. Morgan (New York: Academic Press), 41–58.
Grossman, M. (2018). Linguistic aspects of primary progressive aphasia. Annu. Rev. Linguist. 4, 377–403. doi: 10.1146/annurev-linguistics-011516-034253
Hagoort, P. (2005). On Broca, brain, and binding: a new framework. Trends Cogn. Sci. 9, 416–423. doi: 10.1016/j.tics.2005.07.004
Hagoort, P. (2013). MUC (Memory, Unification, Control) and beyond. Front. Psychol. 4:416. doi: 10.3389/fpsyg.2013.00416
Hagoort, P. (2014). Nodes and networks in the neural architecture for language: Broca’s region and beyond. Curr. Opin. Neurobiol. 28, 136–141. doi: 10.1016/j.conb.2014.07.013
Hassabis, D., Kumaran, D., and Maguire, E. A. (2007). Using imagination to understand the neural basis of episodic memory. J. Neurosci. 27, 14365–14374. doi: 10.1523/jneurosci.4549-07.2007
Hasson, U., Egidi, G., Marelli, M., and Willems, R. M. (2018). Grounding the neurobiology of language in first principles: the necessity of non-language-centric explanations for language comprehension. Cognition 180, 135–157. doi: 10.1016/j.cognition.2018.06.018
Healey, M. L., and Grossman, M. (2018). Cognitive and affective perspective-taking: evidence for shared and dissociable anatomical substrates. Front. Neurol. 9:491. doi: 10.3389/fneur.2018.00491
Herold, D., Spengler, S., Sajonz, B., Usnich, T., and Bermpohl, F. (2016). Common and distinct networks for self-referential and social stimulus processing in the human brain. Brain Struct. Funct. 221, 3475–3485. doi: 10.1007/s00429-015-1113-9
Hickok, G., and Poeppel, D. (2004). Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language. Cognition 92, 67–99. doi: 10.1016/j.cognition.2003.10.011
Iskandar, S., and Baird, A. D. (2014). The role of working memory and divided attention in metaphor interpretation. J. Psycholinguist. Res. 43, 555–568. doi: 10.1007/s10936-013-9267-1
Jang, G., Yoon, S. A., Lee, S. E., Park, H., Kim, J., Ko, J. H., et al. (2013). Everyday conversation requires cognitive inference: neural bases of comprehending implicated meanings in conversations. Neuroimage 81, 61–72. doi: 10.1016/j.neuroimage.2013.05.027
Johnson, J. E., and Turkstra, L. S. (2012). Inference in conversation of adults with traumatic brain injury. Brain Inj. 26, 1118–1126. doi: 10.3109/02699052.2012.666370
Johnson, M. R., Mitchell, K. J., Raye, C. L., D’Esposito, M., and Johnson, M. K. (2007). A brief thought can modulate activity in extrastriate visual areas: top-down effects of refreshing just-seen visual stimuli. Neuroimage 37, 290–299. doi: 10.1016/j.neuroimage.2007.05.017
Kaiser, N. C., Lee, G. J., Lu, P. H., Mather, M. J., Shapira, J., Jimenez, E., et al. (2013). What dementia reveals about proverb interpretation and its neuroanatomical correlates. Neuropsychologia 51, 1726–1733. doi: 10.1016/j.neuropsychologia.2013.05.021
Kellas, J. K. (2005). Family ties: communicating identity through jointly told family stories. Commun. Monogr. 72, 365–389. doi: 10.1080/03637750500322453
Klein, A., Ghosh, S. S., Avants, B., Yeo, B. T., Fischl, B., Ardekani, B., et al. (2010). Evaluation of volume-based and surface-based brain image registration methods. Neuroimage 51, 214–220. doi: 10.1016/j.neuroimage.2010.01.091
Knopman, D., Weintraub, S., and Pankratz, V. (2011). Language and behavior domains enhance the value of the clinical dementia rating scale. Alzheimers Dement. 7, 293–299. doi: 10.1016/j.jalz.2010.12.006
Kramer, J. H., Jurik, J., Sha, S. J., Rankin, K. P., Rosen, H. J., Johnson, J. K., et al. (2003). Distinctive neuropsychological patterns in frontotemporal dementia, semantic dementia, and Alzheimer Disease. Cogn. Behav. Neurol. 16, 211–218. doi: 10.1097/00146965-200312000-00002
Kuperberg, G. R., Lakshmanan, B. M., Caplan, D. N., and Holcomb, P. J. (2006). Making sense of discourse: an fMRI study of causal inferencing across sentences. Neuroimage 33, 343–361. doi: 10.1016/j.neuroimage.2006.06.001
Le Bouc, R., Lenfant, P., Delbeuck, X., Ravasi, L., Lebert, F., Semah, F., et al. (2012). My belief or yours? Differential theory of mind deficits in frontotemporal dementia and Alzheimer’s disease. Brain 135, 3026–3038. doi: 10.1093/brain/aws237
Levinson, S. C. (2016). Turn-taking in human communication – origins and implications for language processing. Trends Cogn. Sci. 20, 6–14. doi: 10.1016/j.tics.2015.10.010
Leyhe, T., Saur, R., Eschweiler, G., and Milian, M. (2011). Impairment in proverb interpretation as an executive function deficit in patients with amnestic mild cognitive impairment and early Alzheimer’s Disease. Dement. Geriatr. Cogn. Disord. 1, 51–61. doi: 10.1159/000323864
Libon, D., Mattson, R. E., Glosser, G., Kaplan, E., Malamut, B. L., Sands, L. P., et al. (1996). A nine-word dementia version of the California verbal learning test. Clin. Neuropsychol. 10, 236–244. doi: 10.1080/13854049608406686
Libon, D. J., Rascovsky, K., Gross, R. G., White, M. T., Xie, S. X., Dreyfuss, M., et al. (2011). The philadelphia brief assessment of cognition (PBAC): a validated screening measure for dementia. Clin. Neuropsychol. 25, 1314–1330. doi: 10.1080/13854046.2011.631585
Libon, D. J., Xie, S. X., Moore, P., Farmer, J., Antani, S., McCawley, G., et al. (2007). Patterns of neuropsychological impairment in frontotemporal dementia. Neurology 68, 369–375. doi: 10.1212/01.wnl.0000252820.81313.9b
Lieberman, M. D., and Cunningham, W. A. (2009). Type I and Type II error concerns in fMRI research: re-balancing the scale. Soc. Cogn. Affect. Neurosci. 4, 423–428. doi: 10.1093/scan/nsp052
Lieberman, M. D., Straccia, M. A., Meyer, M. L., Du, M., and Tan, K. M. (2019). Social, self, (situational), and affective processes in medial prefrontal cortex (MPFC): causal, multivariate, and reverse inference evidence. Neurosci. Biobehav. Rev. 99, 311–328. doi: 10.1016/j.neubiorev.2018.12.021
Lough, S., Gregory, C., and Hodges, J. R. (2001). Dissociation of social cognition and executive function in frontal variant frontotemporal dementia. Neurocase 7, 123–113. doi: 10.1093/neucas/7.2.123
Lundstrom, B. N., Ingvar, M., and Petersson, K. M. (2005). The role of precuneus and left inferior frontal cortex during source memory episodic retrieval. Neuroimage 27, 824–834. doi: 10.1016/j.neuroimage.2005.05.008
Mar, R. A. (2011). The neural bases of social cognition and story comprehension. Annu. Rev. Psychol. 62, 103–134. doi: 10.1146/annurev-psych-120709-145406
Marcus, D. S., Fotenos, A. F., Csernansky, J. G., Morris, J. C., and Buckner, R. L. (2010). Open Access Series Of Imaging Studies (OASIS): cross-sectional mri data in young, middle ged, nondemented, and demented older adults. J. Cogn. Neurosci. 22, 2677–2684. doi: 10.1162/jocn.2009.21407
Mashal, N., Vishne, T., and Laor, N. (2014). The role of the precuneus in metaphor comprehension: evidence from an fMRI study in people with schizophrenia and healthy participants. Front. Hum. Neurosci. 8:818. doi: 10.3389/fnhum.2014.00818
Mason, R. A., and Just, M. A. (2004). How the brain processes causal inferences in text. Psychol. Sci. 15, 1–7. doi: 10.1111/j.0963-7214.2004.01501001.x
Mineroff, Z., Blank, I. A., Mahowald, K., and Fedorenko, E. (2018). A robust dissociation among the language, multiple demand, and default mode networks: Evidence from inter-region correlations in effect size. Neuropsychologia 119, 501–511. doi: 10.1016/j.neuropsychologia.2018.09.011
Möller, C., Hafkemeijer, A., Pijnenburg, Y. A. L., Rombouts, S. A. R. B., van der Grond, J., Dopper, E., et al. (2016). Different patterns of cortical gray matter loss over time in behavioral variant frontotemporal dementia and Alzheimer’s disease. Neurobiol. Aging 38, 21–31. doi: 10.1016/j.neurobiolaging.2015.10.020
Nevler, N., Ash, S., Jester, C., Irwin, D. J., Liberman, M., and Grossman, M. (2017). Automatic measurement of prosody in behavioral variant FTD. Neurology 89, 650–656. doi: 10.1212/WNL.0000000000004236
Nippold, M. A., and Haq, F. S. (1996). Proverb comprehension in youth: the role of concreteness and familiarity. J. Speech Hear. Res. 39, 166–176. doi: 10.1044/jshr.3901.166
Novais-Santos, S., Gee, J., Shah, M., Troiani, V., Work, M., and Grossman, M. (2007). Resolving sentence ambiguity with planning and working memory resources: evidence from fMRI. Neuroimage 37, 361–378. doi: 10.1016/j.neuroimage.2007.03.077
Obert, A., Gierski, F., Calmus, A., Flucher, A., Portefaix, C., Pierot, L., et al. (2016). Neural correlates of contrast and humor: processing common features of verbal irony. PLoS One 11:e0166704. doi: 10.1371/journal.pone.0166704
Orange, J., Lubinski, R., Johnson, A., Purves, B., and Small, J. (2009). “Validity analysis of a measure of conversation in dementia,” in Proceedings of the Clinical Aphasiology Conference, Keystone, CO, Vol. 15.
Panchal, H., Paholpak, P., Lee, G., Carr, A., Barsuglia, J. P., Mather, M., et al. (2015). Neuropsychological and neuroanatomical correlates of the social norms questionnaire in frontotemporal dementia versus Alzheimer’s Disease. Am. J. Alzheimers Dis. Other Demen. 31, 326–332. doi: 10.1177/1533317515617722
Pastor-Cerezuela, G., Yllescas, J. C. T., González-Sala, F., Montagut-Asunción, M., and Fernández-Andrés, M. I. (2018). Comprehension of generalized conversational implicatures by children with and without autism spectrum disorder. Front. Psychol. 9:272. doi: 10.3389/fpsyg.2018.00272
Paunov, A., Blank, I., and Fedorenko, E. (2019). Functionally distinct language and theory of mind networks are synchronized at rest and during language comprehension abbreviated title: language and theory of mind networks. J. Neurophysiol. 121, 1244–1265. doi: 10.1152/jn.00619.2018
Pérez, A. I., Paolieri, D., Macizo, P., and Bajo, T. (2014). The role of working memory in inferential sentence comprehension. Cogn. Process. 15, 405–413. doi: 10.1007/s10339-014-0611-7
Petrides, M. (2005). Lateral prefrontal cortex: architectonic and functional organization. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 360, 781–795. doi: 10.1098/rstb.2005.1631
Prat, C. S., Mason, R. A., and Just, M. A. (2011). Individual differences in the neural basis of causal inferencing. Brain Lang. 116, 1–13. doi: 10.1016/j.bandl.2010.08.004
Price, C. J. (2000). The anatomy of language: contributions from functional neuroimaging. J. Anat. 197, 335–359. doi: 10.1046/j.1469-7580.2000.19730335.x
Rapp, A. M., Mutschler, D. E., and Erb, M. (2012). Where in the brain is nonliteral language? A coordinate-based meta-analysis of functional magnetic resonance imaging studies. Neuroimage 63, 600–610. doi: 10.1016/j.neuroimage.2012.06.022
Raposo, A., and Marques, J. F. (2013). The contribution of fronto-parietal regions to sentence comprehension: insights from the Moses illusion. Neuroimage 83, 431–437. doi: 10.1016/j.neuroimage.2013.06.052
Rascovsky, K., Hodges, J. R., Knopman, D., Mendez, M. F., Kramer, J. H., Neuhaus, J., et al. (2011). Sensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia. Brain 134, 2456–2477. doi: 10.1093/brain/awr179
Reitan, R. M. (1958). Validity of the Trail Making Test as an indicator of organic brain damage. Percept. Mot. Skills. 8, 271–276. doi: 10.2466/pms.8.7.271-276
Rolls, E. T. (2004). The functions of the orbitofrontal cortex. Brain Cogn. 55, 11–29. doi: 10.1016/S0278-2626(03)00277-X
Rorden, C., and Brett, M. (2000). Stereotaxic display of brain lesions. Behav. Neurol. 12, 191–200. doi: 10.1155/2000/421719
Sabbagh, M. A. (2004). Understanding orbitofrontal contributions to theory-of-mind reasoning: implications for autism. Brain Cogn. 55, 209–219. doi: 10.1016/j.bandc.2003.04.002
Salvador, R., Peña, A., Menon, D. K., Carpenter, T. A., Pickard, J. D., and Bullmore, E. T. (2005). Formal characterization and extension of the linearized diffusion tensor model. Hum. Brain. Mapp. 24, 144–155. doi: 10.1002/hbm.20076
Saur, D., Kreher, B. W., Schnell, S., Kummerer, D., Kellmeyer, P., Vry, M.-S., et al. (2008). Ventral and dorsal pathways for language. Proc. Natl. Acad. Sci. U.S.A. 105, 18035–18040.
Savundranayagam, M. Y., and Orange, J. B. (2011). Relationships between appraisals of caregiver communication strategies and burden among spouses and adult children. Int. Psychogeriatr. 23, 1470–1478. doi: 10.1017/s1041610211000408
Saxe, R., and Kanwisher, N. (2003). People thinking about thinking people: the role of the temporo-parietal junction in “theory of mind.”. Neuroimage 19, 1835–1842. doi: 10.1016/s1053-8119(03)00230-1
Schmidt, G. L., and Seger, C. A. (2009). Neural correlates of metaphor processing: the roles of figurativeness, familiarity and difficulty. Brain Cogn. 71, 375–386. doi: 10.1016/j.bandc.2009.06.001
Searle, J. (1975). “Indirect speech acts,” in Syntax and Semantics, Vol. 3, eds P. Cole and J. Morgan (Cambridge, MA: Academic Press), 59–82. doi: 10.1163/9789004368811_004
Shallice, T., Fletcher, P., Frith, C. D., Grasby, P., Frackowiak, R. S., and Dolan, R. J. (1994). Brain regions associated with acquisition and retrieval of verbal episodic memory. Nature 368, 633–635. doi: 10.1038/368633a0
Shibata, M., Abe, J. I., Itoh, H., Shimada, K., and Umeda, S. (2011). Neural processing associated with comprehension of an indirect reply during a scenario reading task. Neuropsychologia 49, 3542–3550. doi: 10.1016/j.neuropsychologia.2011.09.006
Shirer, W. R., Ryali, S., Rykhlesvskaia, E., Menon, V., and Greicius, M. D. (2012). Decoding subject-driven cognitive states with whole-brain connectivity patterns. Cereb. Cortex 22, 1–8. doi: 10.1093/cercor/bhr099
Siebörger, F. T., Ferstl, E. C., and von Cramon, D. Y. (2007). Making sense of nonsense: an fMRI study of task induced inference processes during discourse comprehension. Brain Res. 1166, 77–91. doi: 10.1016/j.brainres.2007.05.079
Smirnov, D., Glerean, E., Lahnakoski, J. M., Salmi, J., Jääskeläinen, I. P., Sams, M., et al. (2014). Fronto-parietal network supports context-dependent speech comprehension. Neuropsychologia 63, 293–303. doi: 10.1016/j.neuropsychologia.2014.09.007
Smith, S. M., and Nichols, T. E. (2009). Threshold-free cluster enhancement: addressing problems of smoothing, threshold dependence and localisation in cluster inference. Neuroimage 44, 83–98. doi: 10.1016/j.neuroimage.2008.03.061
Stivers, T., Enfield, N. J., Brown, P., Englert, C., Hayashi, M., Heinemann, T., et al. (2009). Universals and cultural variation in turn-taking in conversation. Proc. Natl. Acad. Sci. U.S.A. 106, 10587–10592. doi: 10.1073/pnas.0903616106
Torralva, T., Gleichgerrcht, E., Ardila, M. J. T., Roca, M., and Manes, F. F. (2015). Differential cognitive and affective theory of mind abilities at mild and moderate stages of behavioral variant frontotemporal dementia. Cogn. Behav. Neurol. 28, 63–70. doi: 10.1097/WNN.0000000000000053
Tompkins, C., Bloise, C., Timko, M., and Baumgaertner, A. (1994). Working memory and inference revision in brain-damaged and normally aging adults. J. Speech Hear. Res. 37, 896–912. doi: 10.1044/jshr.3704.896
Tremblay, P., and Dick, A. S. (2016). Broca and wernicke are dead, or moving past the classic model of language neurobiology. Brain Lang. 162, 60–71. doi: 10.1016/j.bandl.2016.08.004
Tustison, N. J., Cook, P. A., Klein, A., Song, G., Das, S. R., Duda, J. T., et al. (2014). Large-scale evaluation of ANTs and FreeSurfer cortical thickness measurements. Neuroimage 99, 166–179. doi: 10.1016/j.neuroimage.2014.05.044
Uchiyama, H. T., Saito, D. N., Tanabe, H. C., Harada, T., Seki, A., Ohno, K., et al. (2012). Distinction between the literal and intended meanings of sentences: a functional magnetic resonance imaging study of metaphor and sarcasm. Cortex 48, 563–583. doi: 10.1016/j.cortex.2011.01.004
Varriano, F., Pascual-Diaz, S., and Prats-Galino, A. (2018). When the FAT goes wide: Right extended Frontal Aslant Tract volume predicts performance on working memory tasks in healthy humans. PLoS One 13:e0200786. doi: 10.1371/journal.pone.0200786
Vassal, F., Schneider, F., Boutet, C., Jean, B., Sontheimer, A., and Lemaire, J. J. (2016). Combined DTI tractography and functional MRI study of the language connectome in healthy volunteers: Extensive mapping of white matter fascicles and cortical activations. PLoS One 11:e0152614. doi: 10.1371/journal.pone.0152614
Wakusawa, K., Sugiura, M., Sassa, Y., Jeong, H., Horie, K., Sato, S., et al. (2007). Comprehension of implicit meanings in social situations involving irony: a functional MRI study. Neuroimage 37, 1417–1426. doi: 10.1016/j.neuroimage.2007.06.013
Wechsler, D. (1997). Wechsler Memory Scale-Third Edition: Manual. San Antonio, TX: Psychological Corporation.
Winkler, A. M., Ridgway, G. R., Webster, M. A., Smith, S. M., and Nichols, T. E. (2014). Permutation inference for the general linear model. Neuroimage 92, 381–397. doi: 10.1016/j.neuroimage.2014.01.060
Wright, H. H., and Newhoff, M. (2002). Age-related differences in inference revision processing. Brain Lang. 80, 226–239. doi: 10.1006/brln.2001.2595
Xu, J., Kemeny, S., Park, G., Frattali, C., and Braun, A. (2005). Language in context: emergent features of word, sentence, and narrative comprehension. Neuroimage 25, 1002–1015. doi: 10.1016/j.neuroimage.2004.12.013
Yamagishi, T., Takagishi, H., Fermin Ade, S., Kanai, R., Li, Y., and Matsumoto, Y. (2016). Cortical thickness of the dorsolateral prefrontal cortex predicts strategic choices in economic games. Proc. Natl. Acad. Sci.U.S.A. 113, 5582–5587. doi: 10.1073/pnas.1523940113
Yoshida, W., Seymour, B., Friston, K. J., and Dolan, R. J. (2010). Neural mechanisms of belief inference during cooperative games. J. Neurosci. 30, 10744–10751. doi: 10.1523/jneurosci.5895-09.2010
Keywords: discourse, comprehension, frontotemporal dementia, behavioral variant frontotemporal dementia, inferencing, frontal lobe, white matter tractography
Citation: Healey M, Howard E, Ungrady M, Olm CA, Nevler N, Irwin DJ and Grossman M (2021) More Than Words: Extra-Sylvian Neuroanatomic Networks Support Indirect Speech Act Comprehension and Discourse in Behavioral Variant Frontotemporal Dementia. Front. Hum. Neurosci. 14:598131. doi: 10.3389/fnhum.2020.598131
Received: 28 August 2020; Accepted: 24 November 2020;
Published: 14 January 2021.
Edited by:
Sascha Frühholz, University of Zurich, SwitzerlandReviewed by:
Markus Otto, University of Ulm, GermanyLeonardo Ceravolo, Université de Genève, Switzerland
Copyright © 2021 Healey, Howard, Ungrady, Olm, Nevler, Irwin and Grossman. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Murray Grossman, mgrossma@pennmedicine.upenn.edu