- 1Faculty of Psychology, University of Valencia, Valencia, Spain
- 2Neurology Department, Hospital General Universitario de Valencia, Valencia, Spain
- 3Faculty of Psychology, Jaume I University, Castellón de La Plana, Spain
Introduction: Mild neurocognitive disorder (mNCD), a pre-dementia stage close to Mild Cognitive Impairment, shows a progressive and constant decline in the memory domain. Of the non-pharmacological therapeutic interventions that may help to decelerate the neurodegenerative progress, transcranial direct current stimulation (tDCS) shows beneficial effects on the learning curve, immediate recall, immediate verbal memory and executive functions. The purpose of this research was to study the effect of tDCS on general cognition, immediate and delayed memory and executive functions by comparing an active group with a placebo group of mNCD patients.
Methods: Participants were 33 mNCD due to possible AD, randomly assigned to two groups: 17 active tDCS and 16 placebo tDCS. Ten sessions of tDCS were conducted over the left dorsolateral prefrontal cortex. Several neuropsychological scales were administered to assess the primary outcome measures of general cognitive function, immediate and delayed memory and learning ability, whereas the secondary outcome measures included executive function tests. All participants were evaluated at baseline and at the end of the intervention. Mixed ANOVAs were performed.
Results: Significant effects were obtained on general cognitive function, immediate and delayed memory and learning ability, with increases in scores in the active tDCS group. However, there were no significant effects on executive function performance.
Conclusion: The present study demonstrated the effectiveness of tDCS in an active tDCS group, compared to a placebo group, in improving general cognition and immediate and delayed memory, as previous studies found. Taken together, our data suggest that tDCS is a simple, painless, reproducible and easy technique that is useful for treating cognitive alterations found in neurodegenerative diseases.
Introduction
Neurodegenerative diseases that cause impairments in cognitive functions are currently one of the main health problems in the older adult population (Mayeux and Stern, 2012), with Alzheimer’s disease (AD) being the most frequent cause (Rosenberg et al., 2020; McKeown et al., 2021). Memory loss is the most common initial symptom of AD, and although various therapeutic approaches have been proposed, none of them is sufficiently effective in slowing the progression of the disease (Lynch, 2020).
Mild neurocognitive disorder (mNCD; American Psychiatric Association, 2013), similar to the concept of mild cognitive impairment (MCI), is a pre-dementia stage (Sperling et al., 2011) that shows an objective progressive and constant decline in the memory domain, with no evidence of other aetiologies that could be responsible for it and without interfering with the capacity for independence in performing daily activities. Non-pharmacological therapeutic interventions during these stages may halt or at least slow down the neurodegenerative progress, thus preserving clinically unobtrusive stages as long as possible (Thams et al., 2020). Intervention techniques such as transcranial direct current stimulation (tDCS) may be a therapeutic option for maintaining cognitive functions that deteriorate throughout the course of the disease.
tDCS is based on the induction of low-intensity direct electric current (usually 1–2 mA) through electrodes placed on the scalp (Liu et al., 2017), and it is able to alter neuronal activity by crossing the calotte bone. Its main mechanism involves the modulation of the neuron’s resting potential, facilitating or inhibiting its depolarisation upon arrival of a stimulus (internal or external) and, thus, modifying the excitability of the cortex (Nitsche et al., 2008). Stimulation of the area underlying the anode (positive) reduces the resting potential and facilitates the discharge of the neuron upon arrival of a stimulus (facilitating effect), which can lead to an increase in brain activity. Cathodal stimulation (negative) is hyperpolarising and conditions an inhibition of the underlying area, with the neuron requiring the arrival of a stimulus of greater intensity in order to depolarise (Kalu et al., 2012).
Thus, tDCS changes the probability that an incoming action’s potential will generate postsynaptic firing, either in parallel to stimulation or a short time after it. Specifically, Prehn and Flöel (2015) proposed that, through this mechanism, memory traces are laid down in neuronal pathways. If a neuronal pathway is activated, a permanent change in this network would occur, thus allowing the information to be more easily retrieved or remembered. Di Lorenzo et al. (2018) noted that AD can be considered the result of a disconnection between different neuronal systems, suggesting a dysfunction of large-scale networks underlying memory processes. This suggestion leads to the idea that tDCS could have potentiating effects on neural circuits that act on various memory networks, favouring the functional restoration of these altered networks. Therefore, tDCS would be able to ameliorate cognitive dysfunction in MCI and temporarily reverse pathological brain activity (Meinzer et al., 2015).
tDCS induces effects that resemble the synaptic plasticity of glutamatergic connections (namely, synaptic long-term potentiation and long-term depression) (Nitsche et al., 2003), and studies have found that anodic tDCS strengthens the connections between remote, but functionally associated, brain areas (Polanía et al., 2011; Meinzer et al., 2012). Di Lorenzo et al. (2020) showed that, in patients with AD, there is a consistent long-term potentiation-like cortical plasticity alteration assessed with transcranial magnetic stimulation. This idea leads us to propose that tDCS could improve the synaptic plasticity of these circuits and, therefore, improve memory and learning. These effects are especially appropriate in patients who need to improve their ability to recall and make connections between memories, which is the case in patients with cognitive impairment. For this reason, much of the research to date has been directed to the temporal cortex, due to its important role in memory consolidation, and more specifically, to the dorsolateral prefrontal cortex (DLPFC), due to its important role in memory encoding, executive control functions and working memory. Some studies have shown that tDCS over the DLPFC is able to improve cognitive performance in both healthy and neuropsychiatric samples (Shin et al., 2015). As Tremblay et al. (2014) stated in their review, when using tDCS over the DLPFC with a specific set of parameters, it is possible to modulate a specific cognitive function such as memory performance and learning, working memory performance, word retrieval or executive function performance. Recently, Li et al. (2021), using transcranial magnetic stimulation over the DLPFC in AD patients, found a significant improvement in cognitive skills that correlated with improved cortical plasticity.
tDCS has a very favourable tolerability and safety profile. The most frequently reported side effects are a tingling or itching sensation under the electrodes, headache or tiredness (Fertonani et al., 2015). However, the slight itching sensation at the beginning of stimulation usually disappears during the process (Ambrus et al., 2012), and the patient does not usually notice anything. It is safe to say that no structural damage to the underlying brain tissue occurs when following current stimulation protocols (Nitsche and Paulus, 2001).
With regard to its application in older adults with and without neurodegenerative pathologies, evidence supporting the efficacy of tDCS for cognitive functions such as memory and executive functions is inconsistent.
Anodic stimulation of the temporo-parietal area in healthy older adults shows positive effects on the learning curve and immediate recall (Flöel et al., 2012), and these effects are maintained up to 1 week later, suggesting that the technique facilitates more efficient encoding and minimises the deterioration of learned information. It has been proposed that the memory improvements observed may be related to effects on the acquisition and/or consolidation of memory traces through increased plasticity (Coffman et al., 2014). Anodal stimulation in MCI patients also shows improved performance on immediate verbal memory (Fileccia et al., 2019). Several meta-analyses (Wang et al., 2021; Majdi et al., 2022) have confirmed the efficacy of anodal stimulation on the DLPFC in MCI and AD patients on memory tests. However, a recent review (Ciullo et al., 2021) reported that evidence of a positive effect on memory is inconclusive in AD and weak in MCI.
In the case of the executive functions, anodic stimulation on the left DLPFC has been found to enhance the effectiveness of working memory training (Mancuso et al., 2016). Combining working memory training with cognitive stimulation strengthens the gains, compared to the exclusive administration of stimulation (Nissim et al., 2019). Meta-analyses have pointed to different results depending on the population to which the technique has been administered. In healthy older adults, significant but small effects of anodal stimulation on the left DLPFC have been reported (Mancuso et al., 2016; Lee et al., 2021). In MCI patients, slightly significant benefits of anodic stimulation have been found for executive functions, pointing to its potential clinical application in these patients (Xu et al., 2019).
Due to the lack of consensus and the contradictions in the literature, it seems necessary to try to obtain information about the efficacy of anodic tDCS. Given the high prevalence of mNCD and the inexistence of effective treatments, anodic tDCS would provide important social and economic benefits (Fileccia et al., 2019), mainly due to its easy administration, safety and low cost. The present study aimed to examine whether active tDCS has an effect on general cognition, immediate and delayed memory tasks and executive functions. Specifically, we hypothesised that active stimulation, compared to placebo stimulation, would improve performance in the cognitive domains assessed in patients with mNCD due to possible AD.
Materials and methods
Study design and participants
We carried out a randomised, single-blind and controlled-placebo study consisting of 10 sessions of active anodal tDCS on the left DLPFC, compared to a sham or placebo group. Participants with mild neurocognitive disorder due to possible Alzheimer’s disease were assessed before and after the intervention. At the end of the first assessment, inclusion and exclusion criteria were checked, and patients were randomly assigned to the active tDCS group or the sham group.
Before randomisation, participants who were eligible for the study had to meet the following criteria:
1. Age > 65 years.
2. A score equal to 3 on the Global Deterioration Scale (GDS; Reisberg et al., 1982).
3. A score of more than 18 and less than 26 on the Mini-Mental State Examination (MMSE; Folstein et al., 1975).
4. Presence of mild neurocognitive disorder due to possible Alzheimer’s disease, according to DSM-5 criteria (American Psychiatric Association, 2013). For this diagnosis, there had to be: A. Evidence of a moderate cognitive decline based on: 1. concern about cognition expressed by the individual or an informant who knows him/her; 2. lower performance than expected on an objective assessment; B. Cognitive deficits must not interfere with the ability to be independent in activities of daily living; C. They must not occur exclusively in the context of delirium and D. They would not be better explained by another mental disorder. In addition, for a diagnosis of possible Alzheimer’s disease, evidence of a genetic mutation causing Alzheimer’s disease is not required, but the following three criteria must be met: a. clear evidence of a decline in memory and learning, b. a progressive, gradual, and steady decline in cognitive ability without prolonged plateaus, and c. no evidence of another causal aetiology.
If one or more of the following criteria were present in the randomisation, potential participants were excluded: a score of 4 or more on the GDS and/or a score of less than 18 on the MMSE. In addition, subjects with contraindications to tDCS (intracranial metallic implants, intracranial hypertension), significant cerebrovascular disease or severe psychiatric symptoms were excluded.
Participants were recruited from the Neurological department of the Consorcio Hospital General Universitario of Valencia. Initially, 38 patients were contacted. Three were excluded because they had an MMSE of less than 18, and two patients decided not to participate after being assessed the first time. The final sample consisted of 33 subjects, 17 men and 16 women (51.5 and 48.5% respectively), between 65 and 88 years old (M = 75; SD = 6.08). All of them signed the informed consent form at the beginning of the study. This study was approved by the Human Research Ethics Committee of the University of Valencia.
The eligible patients were allocated to the anodal and sham tDCS groups through stratified block randomisation. Using a random number system, participants were randomly assigned to the experimental groups (anodal vs. sham) at a 1:1 ratio, with gender as the stratum. Participants did not know to which group they had been assigned until the intervention ended, given that this was a single-blind study. A flowchart of the study is shown in Figure 1.
The active anodal tDCS group consisted of 17 participants, and the sham or placebo group consisted of 16 participants. Table 1 presents the main data and comparison tests for the two groups, which were matched on their characteristics.
Measures
The primary outcome measures were general cognitive function, immediate and delayed memory and learning ability. The secondary outcome measures included executive function tests. The selection of primary outcomes was based on the DSM-5 criterion (American Psychiatric Association, 2013) that states that mild neurocognitive disorder due to possible Alzheimer’s disease should show clear evidence of a decline in memory and learning. The assessment of memory and learning is a main criterion in the characterisation of the pathology, and we aimed to analyse the possible change on measures of these variables. In addition, given that the progression of these patients to major neurocognitive disorder due to Alzheimer’s disease is usually accompanied by a deterioration in executive control, changes in the measures that assess this variable were proposed as a secondary outcome.
The Mini-Mental State Examination (MMSE; Folstein et al., 1975) was used as an index of global cognitive functioning; the maximum score is 30 points. This test was designed to estimate the existence and severity of cognitive impairment; it is a brief, quantitative test that measures general cognitive function.
Test de Aprendizaje Verbal Complutense (TAVEC; Benedet and Alejandre, 1998). On this test, the evaluator reads a list of 16 words that the participant has to repeat. The list is repeated five times (trials), and after 20 min, the participant is again asked to remember the 16 words. The test was administered in order to evaluate the participant’s immediate memory (Trial 1), learning ability (analysing Trial 5 and the total number of correct answers on the five trials) and delayed memory.
Memory Alteration Test (M@T; Rami et al., 2007). The M@T provides efficient and valid screening for A-MCI and early-stage AD. The test evaluates different abilities such as encoding, orientation, semantic memory and free recall. The maximum score is 50 points.
Direct and inverse digits of the Wechsler Intelligence Scale for Adults-III (Wechsler, 2001). These tests assess attentional capacity by exposing the participant to increasing amounts of information. On the direct digits task, which is used to assess immediate recall, the subject must repeat the sequence of numbers in the same order in which they are read by the examiner. On the inverse digits task, which assesses working memory and mental flexibility, the subject must say the digits backwards from the way they were presented by the examiner. Both tests are evaluated in the same way, assigning one point for each correct item, with a maximum score of 16 on both tests.
Rey’s Complex Figure (Rey, 1984). This test is used to evaluate both memory and executive capacity, such as planning, motor skills, working memory and visuoconstructive and spatial ability. The subject has to attentively reproduce a complex geometric drawing and later reproduce it after a 3-min delay.
Semantic fluency and phonological fluency subtests of the Barcelona Test Revised (TBR; Peña-Casanova, 2005). The semantic fluency subtest requires the subject to evoke the maximum number of words linked to a specific category, “animals,” in 1 min. In the case of phonological verbal fluency, the subject is asked to recall the maximum number of words beginning with the letter “p” 3 min or less. This test evaluates the ability to access and recall elements from the lexical and semantic store. Among the processes involved, information processing speed, cognitive flexibility and working memory have been pointed out.
Intervention
Stimulation was performed using an HDC stimulator (Newronika TM, Milan, Italy), which is battery-driven and delivers a direct current. The current intensity was 2 mA, and the stimulation lasted 20 min. In addition, a current ramp was delivered for 30 s prior to the start and end of stimulation. A pair of 25 cm2 rubber electrodes transferred the direct current. These electrodes were inserted into sponge pads soaked with sterile water. The electrodes and sponges were placed in a neoprene headcap with predefined and clearly annotated positions, based on a subset of the international 10–10 EEG system. The anode was placed on F3 at the left dorsolateral prefrontal cortex (DLPFC), and the cathode was placed on the right frontal lobe (Fp2). Electrode placement and session duration were identical in the active and placebo tDCS conditions. However, in the placebo tDCS condition, at the end of the onset ramp, the current was automatically turned off for 20 min and then turned on again for the last 30 s.
Procedure
The Neurology Department recruited patients who reported memory complaints and could be candidates for the study and briefly informed them of the study’s objective. After initial telephone contact, an appointment was made to explain the research procedure. After providing their informed consent, the patients participated in a demographic interview to check the eligibility criteria. Performance in the cognitive domains was then assessed; participants had to obtain test scores within the range of 1–2 standard deviations (SD) below the mean to be included. A multidisciplinary team (neurologists and psychologists) performed the diagnosis and made clinical decisions. Participants who met the eligibility criteria were randomly assigned to the anodal tDCS and sham groups. After assigning patients to the groups, an appointment was made for the home-based intervention, which lasted 10 consecutive days. Two technicians (psychologists) who were specifically trained in the technique performed and monitored the home intervention daily in the patients’ homes. In addition, to check the stimulations carried out, the HDCstim® stimulator was connected to the HDCprog, which has a “treatment report” in its menu. These reports show: (a) the time and date of each stimulation, (b) the average impedance of each stimulation a suitable impedance range would be from 4 to 12 kOhm and (c) the result of the treatment (completed, failed or cancelled). On the last day, after the stimulation ended, the evaluation was performed again.
Data analysis
An a priori power calculation for a repeated-measures ANOVA within-between interaction called for a total sample of 32 participants in order to detect an effect size of 0.30 with 90% power, with alpha set at 0.05. Power calculations were carried out using GPower 3.1.7.
To analyse the sociodemographic variables, we used independent sample t-tests and chi-square tests. To analyse the cognitive variables, mixed ANOVAs with 2 groups (active vs. sham; between-subjects) × 2 sessions (before vs. after intervention; within-subjects) were conducted. Post-hoc simple effects tests were conducted to analyse the significant interactions. Because we performed the same ANOVAs on the primary and secondary dependent variables, we applied the Bonferroni correction to control the type I error. Data were analysed using SPSS 28.
Results
Table 2 shows the main and interaction effects of the mixed ANOVAs with 2 groups (active vs. sham; between-subjects) × 2 sessions (before vs. after intervention; within-subjects). Given that the effectiveness of the tDCS should be observed by finding a significant interaction between the two independent variables (where the active group would improve throughout the sessions, whereas the sham or control group would not), for the sake of simplicity, only the significant interactions are analysed below. The means (and SD) of the group (active vs. sham) × session (before vs. after intervention) interactions are shown in Table 3.
Table 2. Main and interaction effects of the mixed ANOVAs with two groups (active vs. sham; between-subjects) × 2 sessions (before vs. after intervention; within-subjects).
Table 3. Means (and SD) of the dependent variables as a function of groups (active vs. sham) and sessions (before vs. after intervention).
General cognition
MMSE post-hoc simple effects tests to analyse the significant interaction (Table 3) showed that the groups did not differ significantly before the intervention (p = 0.45), but after the intervention, the active group scored significantly higher than the placebo group (p = 0.02). Moreover, the sham group did not improve across the sessions (p = 0.47), but the active group did (p = 0.001).
Memory
Because we conducted six similar ANOVAs on the six memory variables, only effects with p ≤ 0.008 (Bonferroni correction) were considered significant.
Post-hoc simple effects tests to analyse the significant interaction in TAVEC 1 trial 1 (Table 3) showed that the groups scored similarly before the intervention (p = 0.48), but after the intervention, the active group scored marginally higher than the placebo group (p = 0.03). In addition, the control group showed a significant decrease across sessions (p = 0.004), whereas the active group showed a significant increase (p = 0.001).
Moreover, when analysing the significant interaction in TAVEC trial 5 (Table 3), post-hoc simple effects tests showed that the groups scored similarly before the intervention (p = 0.20); however, the active group’s score after the intervention was significantly higher than the sham group’s score (p = 0.001). The sham group did not improve their scores across sessions (p = 0.46), but the active group did (p < 0.001).
With regard to the total number of correct answers on the five TAVEC trials, although the means were in the expected direction (Table 3), the interaction was marginally significant (p = 0.017), probably due to the small sample size.
For the last TAVEC subtest (delay), the results obtained on the post-hoc tests indicated that the scores of the groups before the intervention were similar and showed no significant differences (p = 0.18); after the intervention, the active group’s score was marginally higher than the sham group’s score (p = 0.021). The sham group did not improve significantly across the sessions (p = 0.84), whereas the active group did (p < 0.001).
Regarding the analysis of the M@T test, post-hoc simple effects tests showed (Table 3) that the groups scored similarly before the intervention (p = 0.16), but after the intervention, the active group scored significantly higher than the sham group (p = 0.003). Moreover, the sham group did not improve across the sessions (p = 0.47), but the active group did (p < 0.001).
For the last primary outcome, the analysis of direct digits (Wechsler test), post-hoc tests revealed (Table 3) that the groups scored similarly before the intervention (p = 0.75), but after the intervention, the active group scored marginally higher than the simulated group (p = 0.015). In addition, the sham group did not improve over the sessions (p = 0.63), but the active group did (p = 0.001).
Overall, these results demonstrate the efficacy of the tDCS in improving the patients’ memory.
Executive functions
Because we conducted six similar ANOVAs on the six secondary variables, only effects with p ≤ 0.008 (Bonferroni correction) were considered significant.
In the case of these secondary variables, none of the interactions reached statistical significance, which would indicate that tDCS was ineffective in improving the executive functions.
Safety and tolerability
All the participants tolerated stimulation, and apart from a brief tingling sensation under the electrodes, no adverse events were reported during stimulation.
Discussion
The aim of the present study was to compare the effects of an active anodal tDCS intervention on general cognition, immediate and delayed memory and executive functions in patients with mild NCD due to possible AD. tDCS was found to be effective in improving general cognition and immediate and delayed memory. However, no significant effects on performance on executive function tests were observed.
The results obtained for general cognition are consistent with previous research that applied anodal stimulation on the left DLPFC (Khedr et al., 2014; Im et al., 2019). With a protocol similar to the one used in this research, it can be argued that the improvement mechanism is probably multifactorial; the technique may facilitate the activation of the cognitive reserve that is still present in patients at the onset of cognitive impairment (Khedr et al., 2014). A more recent study administered stimulation to patients with mild AD for 6 months and concluded that this technique can prevent the worsening of global cognitive functioning in patients who begin to show symptoms of significant impairment (Im et al., 2019). Several meta-analyses have reported the efficacy of tDCS in improving overall cognition in patients with AD (Hsu et al., 2015; Majdi et al., 2022), patients with mild to moderate AD (Chen et al., 2022) and patients with MCI, with anodal stimulation also being the most effective method (Saxena and Pal, 2021). However, other meta-analyses (Inagawa et al., 2019; Gu et al., 2022) of patients with MCI and AD reported no efficacy. These contradictory results may be due to a lack of consensus in the methodology and small sample sizes (Chang et al., 2018).
In the memory domain, the present study demonstrated the effectiveness of tDCS compared to a placebo. These results converge with previous studies that obtained significant improvements in the active group on memory recall and immediate and delayed recall in patients with MCI after stimulation on the left DLPFC (Murugaraja et al., 2017; Gomes et al., 2019). Other research (Yun et al., 2016; Fileccia et al., 2019) reported that when anodic stimulation was applied on the DLPFC in subjects with MCI, memory performance increased. In this regard, some authors have concluded that tDCS could have the potential to restore brain activity in patients at risk of developing dementia (Ciullo et al., 2021). However, other research (Cruz Gonzalez et al., 2018) did not observe significant improvements in short-term memory performance.
MCI patients have impaired functional connectivity between the DLPFC and several cortical and subcortical regions involved, and this would affect various cognitive functions, including learning, which is closely related to memory (Liang et al., 2011). In AD, it has been hypothesised that the DLPFC is a compensatory brain resource that supports memory function, and that this compensatory mechanism is strongest in the prodromal and mild stages of the disease, decreasing with the progression to more advanced stages of AD (Gigi et al., 2010). Thus, as suggested in several neuroimaging studies, the left DLPFC should be a major area for the stimulation of declarative memory (Cabeza and Nyberg, 2000). Furthermore, the DLPFC has been found to be involved in the encoding, manipulation, organisation and retrieval of verbal content (Cabeza et al., 2002; Nyberg et al., 2003; Barbey et al., 2013), and these results have been confirmed in review studies (Manenti et al., 2012).
In contrast to these cognitive domains, no significant effects were obtained on the executive function tests. This result is similar to those obtained in other studies (Khedr et al., 2014; Fileccia et al., 2019; Gomes et al., 2019) that did not observe significant increases in executive function performance after anodic stimulation on the DLPFC. A meta-analysis (Chen et al., 2022) revealed that stimulation of temporal-lobe-related brain regions produced better cognitive improvement than left DLPFC stimulation, and it concluded that AD patients may benefit more than MCI because tDCS treatment did not provide significant benefits in the latter. Whereas with disease progression AD patients may also experience impairments in executive function, MCI is considered an initial stage of Alzheimer’s disease in which memory shows impairment while executive function may be preserved. This argument could be the key to explaining why, in this study, executive function performance did not improve after stimulation, and it is plausible that no significant effects on performance would be observed if performance was already adequate at baseline. Huo et al. (2018) were unable to find statistical evidence for an effect of anodal stimulation on the executive function of healthy older adults. This result may be due to the absence of simultaneous cognitive training, and it suggests that, at least in the executive function domain, tDCS may be an adjuvant to cognitive training rather than a cognitive modulator with an independent effect. The cognitive enhancement potential of tDCS may occur by boosting the efficiency of training. However, other studies have found effects of the technique. Applying tDCS over the DLPFC for 6 months in AD produced stability in the scores of the active group, whereas these scores decreased in the sham group (Im et al., 2019). In another previous study, anodic stimulation of the DLPFC combined with cognitive stimulation was administered in patients with MCI, obtaining better executive function performance (Cruz Gonzalez et al., 2018). Furthermore, the DLPFC is specialised in executive function (Otero and Barker, 2014) and hypo-activated in mNCD (Peelle et al., 2014), and so its stimulation could be essential in reducing hypoactivation.
In conclusion, given its easy home administration, tolerability, safety and low cost, tDCS could become a real treatment option for the maintenance of cognitive function in patients with mNCD [35]. However, evidence of its efficacy remains controversial (Ciullo et al., 2021). The high inter-individual variability in the effects of the technique (Button et al., 2013) and the lack of standardised parameters and measurements of current intensity, stimulation time, electrode placement and the number and frequency of sessions (Gomes et al., 2019) are some of the elements that hinder the generalisability of the results. Thus, further information is needed to help to consolidate the technique and its specific parameters and indicate which specific cognitive abilities might obtain a real and significant effect (Majdi et al., 2022) and which patients would benefit the most from the technique.
Finally, it should be noted that several clinical trials reinforce the idea that efficacy increases with multiple sessions and that the effects are believed to be cumulative (Ferrucci et al., 2014; Meesen et al., 2014). However, multiple sessions require subjects to travel to the clinic for each treatment, placing a significant and often insurmountable burden on patients and their caregivers and requiring significant provider time and cost, especially as the sample size increases (Charvet et al., 2015). These difficulties lead to high dropout rates (Valiengo et al., 2013).
Providing tDCS treatment at home can decrease the burden on patients and their families by eliminating the need to travel to medical or research facilities for each treatment session, thus promoting treatment adherence and compliance (Charvet et al., 2020). However, some research points out that the lack of remote supervision (optional telephone backup) seems to be a main factor in dropouts when tDCS is applied by patients or caregivers at home. Therefore, applying procedures such as remotely supervised, regular or even daily visits, as in this research, seems to be necessary, not only to assess clinical efficacy, but also to control the correct performance of the stimulations and prevent dropout (Palm et al., 2018).
Limitations
Some limitations should be considered. Regarding to the sample, it would be interesting to increase the number of patients in order to improve the statistical power. In addition, it should be noted that, although the criterion of independence in instrumental activities differentiates MCI from AD patients, at a cognitive level, the differentiation between initial dementias is not always clear. Moreover, in relation to the design, this study was single-blind with pre- and post-intervention measures. It would have been advisable to apply a double-blind design to avoid possible researcher bias and obtain follow-up measures to find out whether the results are maintained, for example, 1 month after the intervention. In addition, the importance of including biomarkers in the diagnosis of the early stages of AD, which this study was unable to do, should be noted. Dubois et al. (2014) point out that the research criteria for the early stages of AD require the presence of at least one biomarker of Alzheimer’s pathology for identification (decreased Aβ1–42 along with increased T-tau or P-tau in CSF or increased tracer retention on amyloid PET). These authors consider pathophysiological markers to be indicators of Alzheimer’s pathology in the brain, rather than markers linked to disease stages. That is, they describe the presence of disease pathology at any stage and simplify the diagnostic approach by designating a single in vivo pathophysiological signature of AD, measured in CSF or using amyloid PET.
As future lines of work, the intervention could be administered to patients with major NCD in order to determine whether stimulation is also effective when there is significant cognitive impairment. In addition, it would be interesting to find out whether the changes at the cognitive level have a positive long-term effect on the quality of life and emotional level of the participants in the active group.
Conclusion
This randomised, placebo-controlled study revealed significant results for general cognition and memory in patients with mNCD due to possible AD. This trial showed high safety and tolerability of tDCS, a simple, painless, reproducible, easy to administer and inexpensive technique. For all these reasons, its potential usefulness for treating the cognitive alterations in neurodegenerative diseases presents researchers with a great opportunity.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by the Human Research Ethics Committee of the University of Valencia H1526539449220. The patients/participants provided their written informed consent to participate in this study.
Author contributions
JM and AP designed and drafted the work. AP and ID were in charge of carrying out the statistical analyses and writing the results. ES and JM contrasted the results obtained with other studies and wrote the discussion. JE, ES, and ER participated in the selection of the sample and the design of the stimulation based on tDCS. All authors carefully read the manuscript and fully approved it.
Funding
This work was supported by Ministerio de Ciencia e Innovación (MCIN)/Agencia Estatal de Investigación (AEI)/10.13039/501100011033 (Grant PID2019-103956RB-I00) and Conselleria de Innovación, Universidades, Ciencia y Sociedad Digital of Generalitat Valenciana (Spain) (Grant GV/2021/174).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Ambrus, G. G., Al-Moyed, H., Chaieb, L., Sarp, L., Antal, A., and Paulus, W. (2012). The fade-in–short stimulation–fade out approach to sham tDCS–reliable at 1 mA for naive and experienced subjects, but not investigators. Brain Stimulation 5, 499–504. doi: 10.1016/j.brs.2011.12.001
American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders. Washington, DC: American Psychiatric Association.
Barbey, A. K., Koenigs, M., and Grafman, J. (2013). Dorsolateral prefrontal contributions to human working memory. Cortex 49, 1195–1205. doi: 10.1016/j.cortex.2012.05.022
Benedet, M. J., and Alejandre, M. A. (1998). TAVEC: Test de aprendizaje verbal España-Complutense. Madrid: TEA Ediciones.
Button, K. S., Ioannidis, J., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S., et al. (2013). Power failure: why small sample size undermines the reliability of neuroscience. Nat. Rev. Neurosci. 14, 365–376. doi: 10.1038/nrn3475
Cabeza, R., Dolcos, F., Graham, R., and Nyberg, L. (2002). Similarities and differences in the neural correlates of episodic memory retrieval and working memory. Neuroimage 16, 317–330. doi: 10.1006/nimg.2002.1063
Cabeza, R., and Nyberg, L. (2000). Neural bases of learning and memory: functional neuroimaging evidence. Curr. Opin. Neurol. 13, 415–421. doi: 10.1097/00019052-200008000-00008
Chang, C. H., Lane, H. Y., and Lin, C. H. (2018). Brain stimulation in Alzheimer’s disease. Front. Psych. 9:201. doi: 10.3389/fpsyt.2018.00201
Charvet, L. E., Kasschau, M., Datta, A., Knotkova, H., Stevens, M. C., Alonzo, A., et al. (2015). Remotely-supervised transcranial direct current stimulation (tDCS) for clinical trials: guidelines for technology and protocols. Front. Syst. Neurosci. 9:26. doi: 10.3389/fnsys.2015.00026
Charvet, L. E., Shaw, M. T., Bikson, M., Woods, A. J., and Knotkova, H. (2020). Supervised transcranial direct current stimulation (tDCS) at home: a guide for clinical research and practice. Brain Stimul. 13, 686–693. doi: 10.1016/j.brs.2020.02.011
Chen, J., Wang, Z., Chen, Q., Fu, Y., and Zheng, K. (2022). Transcranial direct current stimulation enhances cognitive function in patients with mild cognitive impairment and early/mid Alzheimer’s disease: A systematic review and meta-analysis. Brain Sci. 12:562. doi: 10.3390/brainsci12050562
Ciullo, V., Spalletta, G., Caltagirone, C., Banaj, N., Vecchio, D., Piras, F., et al. (2021). Transcranial direct current stimulation and cognition in neuropsychiatric disorders: systematic review of the evidence and future directions. Neuroscientist 27, 285–309. doi: 10.1177/1073858420936167
Coffman, B. A., Clark, V. P., and Parasuraman, R. (2014). Battery powered thought: enhancement of attention, learning, and memory in healthy adults using transcranial direct current stimulation. Neuroimage 85, 895–908. doi: 10.1016/j.neuroimage.2013.07.083
Cruz Gonzalez, P., Fong, K. N., and Brown, T. (2018). The effects of transcranial direct current stimulation on the cognitive functions in older adults with mild cognitive impairment: a pilot study. Behav. Neurol. 2018, 1–14. doi: 10.1155/2018/5971385
Di Lorenzo, F., Motta, C., Casula, E. P., Bonnì, S., Assogna, M., Caltagirone, C., et al. (2020). LTP-like cortical plasticity predicts conversion to dementia in patients with memory impairment. Brain Stimul. 13, 1175–1182. doi: 10.1016/j.brs.2020.05.013
Di Lorenzo, F., Ponzo, V., Motta, C., Bonnì, S., Picazio, S., Caltagirone, C., et al. (2018). Impaired spike timing dependent cortico-cortical plasticity in Alzheimer’s disease patients. J. Alzheimers Dis. 66, 983–991. doi: 10.3233/JAD-180503
Dubois, B., Feldman, H. H., Jacova, C., Hampel, H., Molinuevo, J. L., Blennow, K., et al. (2014). Advancing research diagnostic criteria for Alzheimer’s disease: the IWG-2 criteria. Lancet Neurol. 13, 614–629. doi: 10.1016/S1474-4422(14)70090-0
Ferrucci, R., Vergari, M., Cogiamanian, F., Bocci, T., Ciocca, M., Tomasini, E., et al. (2014). Transcranial direct current stimulation (tDCS) for fatigue in multiple sclerosis. NeuroRehabilitation 34, 121–127. doi: 10.3233/NRE-131019
Fertonani, A., Ferrari, C., and Miniussi, C. (2015). What do you feel if I apply transcranial electric stimulation? Safety, sensations and secondary induced effects. Clin. Neurophysiol. 126, 2181–2188. doi: 10.1016/j.clinph.2015.03.015
Fileccia, E., Di Stasi, V., Poda, R., Rizzo, G., Stanzani-Maserati, M., Oppi, F., et al. (2019). Effects on cognition of 20-day anodal transcranial direct current stimulation over the left dorsolateral prefrontal cortex in patients affected by mild cognitive impairment: a case-control study. Neurol. Sci. 40, 1865–1872. doi: 10.1007/s10072-019-03903-6
Flöel, A., Suttorp, W., Kohl, O., Kürten, J., Lohmann, H., Breitenstein, C., et al. (2012). Non-invasive brain stimulation improves object-location learning in the elderly. Neurobiol. Aging 33, 1682–1689. doi: 10.1016/j.neurobiolaging.2011.05.007
Folstein, M., Folstein, S., and Mc Hugh, P. (1975). Mini mental state. A practical method for grading the cognitive state of patients for the clinical. J. Psychiatr. Res. 12, 189–198. doi: 10.1016/0022-3956(75)90026-6
Gigi, A., Babai, R., Penker, A., Hendler, T., and Korczyn, A. D. (2010). Prefrontal compensatory mechanism may enable normal semantic memory performance in mild cognitive impairment (MCI). J. Neuroimaging 20, 163–168. doi: 10.1111/j.1552-6569.2009.00386.x
Gomes, M. A., Akiba, H. T., Gomes, J. S., Trevizol, A. P., Lacerda, A. L. T. D., and Dias, Á. M. (2019). Transcranial direct current stimulation (tDCS) in elderly with mild cognitive impairment: a pilot study. Dementia Neuropsychol. 13, 187–195. doi: 10.1590/1980-57642018dn13-020007
Gu, L., Xu, H., and Qian, F. (2022). Effects of non-invasive brain stimulation on Alzheimer’s disease. J. Prev. Alzheimer’s Dis. 9, 410–424. doi: 10.14283/jpad.2022.40
Hsu, W. Y., Ku, Y., Zanto, T. P., and Gazzaley, A. (2015). Effects of noninvasive brain stimulation on cognitive function in healthy aging and Alzheimer’s disease: a systematic review and meta-analysis. Neurobiol. Aging 36, 2348–2359. doi: 10.1016/j.neurobiolaging.2015.04.016
Huo, L., Zheng, Z., Li, J., Wan, W., Cui, X., Chen, S., et al. (2018). Long-term transcranial direct current stimulation does not improve executive function in healthy older adults. Front. Aging Neurosci. 10:298. doi: 10.3389/fnagi.2018.00298
Im, J. J., Jeong, H., Bikson, M., Woods, A. J., Unal, G., Oh, J. K., et al. (2019). Effects of 6-month at-home transcranial direct current stimulation on cognition and cerebral glucose metabolism in Alzheimer’s disease. Brain Stimul. 12, 1222–1228. doi: 10.1016/j.brs.2019.06.003
Inagawa, T., Narita, Z., Sugawara, N., Maruo, K., Stickley, A., Yokoi, Y., et al. (2019). A meta-analysis of the effect of multisession transcranial direct current stimulation on cognition in dementia and mild cognitive impairment. Clin. EEG Neurosci. 50, 273–282. doi: 10.1177/1550059418800889
Kalu, U. G., Sexton, C. E., Loo, C. K., and Ebmeier, K. P. (2012). Transcranial direct current stimulation in the treatment of major depression: a meta-analysis. Psychol. Med. 42, 1791–1800. doi: 10.1017/S0033291711003059
Khedr, E. M., Gamal, N. F. E., El-Fetoh, N. A., Khalifa, H., Ahmed, E. M., Ali, A. M., et al. (2014). A double-blind randomized clinical trial on the efficacy of cortical direct current stimulation for the treatment of Alzheimer’s disease. Front. Aging Neurosci. 6:275. doi: 10.3389/fnagi.2014.00275
Lee, J. H., Lee, T. L., and Kang, N. (2021). Transcranial direct current stimulation decreased cognition-related reaction time in older adults: a systematic review and meta-analysis. Ageing Res. Rev. 70:101377. doi: 10.1016/j.arr.2021.101377
Li, X., Qi, G., Yu, C., Lian, G., Zheng, H., Wu, S., et al. (2021). Cortical plasticity is correlated with cognitive improvement in Alzheimer’s disease patients after rTMS treatment. Brain Stimul. 14, 503–510. doi: 10.1016/j.brs.2021.01.012
Liang, P., Wang, Z., Yang, Y., Jia, X., and Li, K. (2011). Functional disconnection and compensation in mild cognitive impairment: evidence from DLPFC connectivity using resting-state fMRI. PLoS One 6:e22153. doi: 10.1371/journal.pone.0022153
Liu, C. S., Rau, A., Gallagher, D., Rajji, T. K., Lanctôt, K. L., and Herrmann, N. (2017). Using transcranial direct current stimulation to treat symptoms in mild cognitive impairment and Alzheimer’s disease. Neurodegener. Dis. Manag. 7, 317–329. doi: 10.2217/nmt-2017-0021
Lynch, C. (2020). World Alzheimer report 2019: attitudes to dementia, a global survey: public health: engaging people in ADRD research. Alzheimers Dement. 16:e038255. doi: 10.1002/alz.038255
Majdi, A., van Boekholdt, L., Sadigh-Eteghad, S., and Mc Laughlin, M. (2022). A systematic review and meta-analysis of transcranial direct-current stimulation effects on cognitive function in patients with Alzheimer’s disease. Mol. Psychiatry 27, 2000–2009. doi: 10.1038/s41380-022-01444-7
Mancuso, L. E., Ilieva, I. P., Hamilton, R. H., and Farah, M. J. (2016). Does transcranial direct current stimulation improve healthy working memory?: a meta-analytic review. J. Cogn. Neurosci. 28, 1063–1089. doi: 10.1162/jocn_a_00956
Manenti, R., Cotelli, M., Robertson, I. H., and Miniussi, C. (2012). Transcranial brain stimulation studies of episodic memory in young adults, elderly adults and individuals with memory dysfunction: a review. Brain Stimul. 5, 103–109. doi: 10.1016/j.brs.2012.03.004
Mayeux, R., and Stern, Y. (2012). Epidemiology of Alzheimer disease. Cold Spring Harb. Perspect. Med. 2:a006239. doi: 10.1101/cshperspect.a006239
McKeown, A., Malhi, G. S., and Singh, I. (2021). Ethics of early intervention in Alzheimer’s disease. AJOB Neurosci. 12, 212–223. doi: 10.1080/21507740.2021.1896595
Meesen, R. L., Thijs, H., Leenus, D. J., and Cuypers, K. (2014). A single session of 1 mA anodal tDCS-supported motor training does not improve motor performance in patients with multiple sclerosis. Restor. Neurol. Neurosci. 32, 293–300. doi: 10.3233/RNN-130348
Meinzer, M., Antonenko, D., Lindenberg, R., Hetzer, S., Ulm, L., Avirame, K., et al. (2012). Electrical brain stimulation improves cognitive performance by modulating functional connectivity and task-specific activation. J. Neurosci. 32, 1859–1866. doi: 10.1523/JNEUROSCI.4812-11.2012
Meinzer, M., Lindenberg, R., Phan, M. T., Ulm, L., Volk, C., and Flöel, A. (2015). Transcranial direct current stimulation in mild cognitive impairment: behavioral effects and neural mechanisms. Alzheimers Dement. 11, 1032–1040. doi: 10.1016/j.jalz.2014.07.159
Murugaraja, V., Shivakumar, V., Sivakumar, P. T., Sinha, P., and Venkatasubramanian, G. (2017). Clinical utility and tolerability of transcranial direct current stimulation in mild cognitive impairment. Asian J. Psychiatr. 30, 135–140. doi: 10.1016/j.ajp.2017.09.001
Nissim, N. R., O’Shea, A., Indahlastari, A., Kraft, J. N., Von Mering, O., Aksu, S., et al. (2019). Effects of transcranial direct current stimulation paired with cognitive training on functional connectivity of the working memory network in older adults. Front. Aging Neurosci. 11:340. doi: 10.3389/fnagi.2019.00340
Nitsche, M. A., Cohen, L. G., Wassermann, E. M., Priori, A., Lang, N., Antal, A., et al. (2008). Transcranial direct current stimulation: state of the art 2008. Brain Stimul. 1, 206–223. doi: 10.1016/j.brs.2008.06.004
Nitsche, M. A., Liebetanz, D., Antal, A., Lang, N., Tergau, F., and Paulus, W. (2003). Modulation of cortical excitability by weak direct current stimulation–technical, safety and functional aspects. Suppl. Clin. Neurophysiol. 56, 255–276. doi: 10.1016/S1567-424X(09)70230-2
Nitsche, M. A., and Paulus, W. (2001). Sustained excitability elevations induced by transcranial DC motor cortex stimulation in humans. Neurology 57, 1899–1901. doi: 10.1212/WNL.57.10.1899
Nyberg, L., Marklund, P., Persson, J., Cabeza, R., Forkstam, C., Petersson, K. M., et al. (2003). Common prefrontal activations during working memory, episodic memory, and semantic memory. Neuropsychologia 41, 371–377. doi: 10.1016/S0028-3932(02)00168-9
Otero, T. M., and Barker, L. A. (2014). “The frontal lobes and executive functioning” in Handbook of Executive Functioning. eds. S. Goldstein and J. A. Naglieri (New York, NY: Springer), 29–44.
Palm, U., Kumpf, U., Behler, N., Wulf, L., Kirsch, B., Wörsching, J., et al. (2018). Home use, remotely supervised, and remotely controlled transcranial direct current stimulation: a systematic review of the available evidence. Neuromodulation 21, 323–333. doi: 10.1111/ner.12686
Peelle, J. E., Powers, J., Cook, P. A., Smith, E. E., and Grossman, M. (2014). Frontotemporal neural systems supporting semantic processing in Alzheimer’s disease. Cogn. Affect. Behav. Neurosci. 14, 37–48. doi: 10.3758/s13415-013-0239-6
Peña-Casanova, J. (2005). Programa Integrado de Exploración Neuropsicológica. Test Barcelona-Revisado. Manual. Barcelona: Masson.
Polanía, R., Nitsche, M. A., and Paulus, W. (2011). Modulating functional connectivity patterns and topological functional organization of the human brain with transcranial direct current stimulation. Hum. Brain Mapp. 32, 1236–1249. doi: 10.1002/hbm.21104
Prehn, K., and Flöel, A. (2015). Potentials and limits to enhance cognitive functions in healthy and pathological aging by tDCS. Front. Cell. Neurosci. 9:355. doi: 10.3389/fncel.2015.00355
Rami, L., Molinuevo, J. L., Sanchez-Valle, R., Bosch, B., and Villar, A. (2007). Screening for amnestic mild cognitive impairment and early Alzheimer’s disease with T@M (memory alteration test) in the primary care population. Int. J. Geriatr. Psychiatry 22, 294–304. doi: 10.1002/gps.1672
Reisberg, B., Ferris, S. H., de Leon, M. J., and Crook, T. (1982). The global deterioration scale for assessment of primary degenerative dementia. Am. J. Psychiatry 139, 1136–1139. doi: 10.1176/ajp.139.9.1136
Rosenberg, A., Mangialasche, F., Ngandu, T., Solomon, A., and Kivipelto, M. (2020). Multidomain interventions to prevent cognitive impairment, Alzheimer’s disease, and dementia: from FINGER to world-wide FINGERS. J. Prev. Alzheimers Dis. 7, 29–36. doi: 10.14283/jpad.2019.41
Saxena, V., and Pal, A. (2021). Role of transcranial direct current stimulation in the management of Alzheimer’s disease: a meta-analysis of effects, adherence and adverse effects. Clin. Psychopharmacol. Neurosci. 19, 589–599. doi: 10.9758/cpn.2021.19.4.589
Shin, Y. I., Foerster, A., and Nitsche, M. A. (2015). Reprint of: transcranial direct current stimulation (tDCS)–Application in neuropsychology. Neuropsychologia 74, 74–95. doi: 10.1016/j.neuropsychologia.2015.06.021
Sperling, R. A., Aisen, P. S., Beckett, L. A., Bennett, D. A., Craft, S., Fagan, A. M., et al. (2011). Toward defining the preclinical stages of Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 7, 280–292. doi: 10.1016/j.jalz.2011.03.003
Thams, F., Kuzmina, A., Backhaus, M., Li, S. C., Grittner, U., Antonenko, D., et al. (2020). Cognitive training and brain stimulation in prodromal Alzheimer’s disease (AD-Stim)—study protocol for a double-blind randomized controlled phase IIb (monocenter) trial. Alzheimers Res. Ther. 12, 142–112. doi: 10.1186/s13195-020-00692-5
Tremblay, S., Lepage, J. F., Latulipe-Loiselle, A., Fregni, F., Pascual-Leone, A., and Théoret, H. (2014). The uncertain outcome of prefrontal tDCS. Brain Stimul. 7, 773–783. doi: 10.1016/j.brs.2014.10.003
Valiengo, L., Benseñor, I. M., Goulart, A. C., de Oliveira, J. F., Zanao, T. A., Boggio, P. S., et al. (2013). The sertraline versus electrical current therapy for treating depression clinical study (select-TDCS): results of the crossover and follow-up phases. Depress. Anxiety 30, 646–653. doi: 10.1002/da.22079
Wang, T., Guo, Z., Du, Y., Xiong, M., Yang, Z., Ren, L., et al. (2021). Effects of noninvasive brain stimulation (NIBS) on cognitive impairment in mild cognitive impairment and Alzheimer disease: a meta-analysis. Alzheimer Dis. Assoc. Disord. 35, 278–288. doi: 10.1097/WAD.0000000000000464
Wechsler, D. (2001). Escala de Inteligencia Wechsler para Adultos-III (WAIS-III). Madrid: TEA Ediciones.
Xu, Y., Qiu, Z., Zhu, J., Liu, J., Wu, J., Tao, J., et al. (2019). The modulation effect of non-invasive brain stimulation on cognitive function in patients with mild cognitive impairment: a systematic review and meta-analysis of randomized controlled trials. BMC Neurosci. 20, 1–11. doi: 10.1186/s12868-018-0484-2
Keywords: ageing, memory, executive function, transcranial electric stimulation, neurocognitive disorder
Citation: Satorres E, Escudero Torrella J, Real E, Pitarque A, Delhom I and Melendez JC (2023) Home-based transcranial direct current stimulation in mild neurocognitive disorder due to possible Alzheimer’s disease. A randomised, single-blind, controlled-placebo study. Front. Psychol. 13:1071737. doi: 10.3389/fpsyg.2022.1071737
Edited by:
Zhiwei Zheng, Institute of Psychology (CAS), ChinaReviewed by:
Francesco Di Lorenzo, Santa Lucia Foundation (IRCCS), ItalyLijuan Huo, Guangzhou Medical University, China
Copyright © 2023 Satorres, Escudero Torrella, Real, Pitarque, Delhom and Melendez. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Juan C. Melendez, SnVhbi5DLk1lbGVuZGV6QHV2LmVz