Skip to main content

OPINION article

Front. Psychiatry, 22 July 2024
Sec. Digital Mental Health

AI-empowered imagery writing: integrating AI-generated imagery into digital mental health service

  • 1Department of Psychology, School of Education, Guangzhou University, Guangzhou, Guangdong, China
  • 2Department of Psychology, University of Science and Technology of China, Hefei, China
  • 3School of Public Health and the Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, Zhejiang, China
  • 4Department of Psychology, Queen’s University, Kingston, ON, Canada

Introduction

As mental health systems grapple with soaring demands, rising costs, and accessibility barriers, increasing the reach and impact of psychological therapies has become an urgent public health priority (1). Recent generative artificial intelligence (AI) advancements offer a pathway toward scalable, accessible, and potentially more effective mental health solutions. For example, AI chatbots such as ChatGPT have been proposed as a first aid for young adults with mental health issues (2). Although the value of digital mental health services has been recently recognized—due to the low-threshold access, geographic independence, constant availability, and potentially lower cost (1, 3)—the potential of generative AI remains underexplored, particularly concerning AI-generated imagery. Mental imagery, especially emotional mental imagery, is central to many mental disorders and the associated psychotherapeutic interventions (4, 5). To explore the potential of incorporating AI-generated imagery into mental health services, we propose a novel paradigm termed “AI-empowered imagery writing” (AIW).

In AIW, as users compose sentences, the AI system generates corresponding art imagery—potentially resembling iconic art styles like Impressionism (see Figure 1 for an example)—and adapts this imagery to reflect the emotional context of the text. This approach builds on the well-established benefits of expressive writing (EW), a cost-effective intervention that improves mental well-being and alleviates trauma-related symptoms (68). EW allows writers to gain valuable insights into their thoughts and feelings, particularly concerning adverse experiences. AIW enhances EW by adding a visual dimension. Like an architect employing a 3D model to visualize a building design better, AIW enables users to vividly “see” and “revise” their thoughts through generated images.

Figure 1
www.frontiersin.org

Figure 1 Online AIW system generated image corresponding to the writing: “I used to think there would be many people here, then in the end there was only one bird/我曾经认为这里会有很多人, 然后最后只有一只鸟”.

With the proper instructions from professional psychologists and psychotherapists, AIW could provide effective psychological interventions or psychotherapy for participants. For example, psychotherapists can adapt the classical instructions of EW (6, 7) and then display them on patients’ personal computing devices at home via the internet: “Find a time and place where you won’t be disturbed. Promise yourself that you will write for a minimum of 15 minutes a day for at least 3 or 4 consecutive days. Once you begin writing, write continuously … You can type on a computer, a tablet, or a smartphone. If you cannot type, you can also use audio input.” Participants can write about something they are thinking or worrying about too much, something they are dreaming about, something they feel is affecting their lives in an unhealthy way, or something they have been avoiding for days, weeks, or years.

Figure 1 is a screenshot of our online AIW platform. The user writes in a text box, presses the return key or the “submit” button, and then AI generates the corresponding image in 5 seconds and displays it on the top of the text box. Meanwhile, the user can continue to write, submit, and see the generated images. In the following, we suggest key mechanisms that position AIW as a promising and attainable digital intervention for mental health improvement.

Vicarious empathy and emotional expression

AIW can provide “vicarious empathy”. While it is well-known that AI can create images corresponding to textual input—capabilities offered by software like Dall-E, Stable Diffusion, and Midjourney—it is less commonly recognized that AI can also discern emotions embedded within the text, as evidenced in large language models such as ChatGPT and Claude. Leveraging these capabilities, AIW can customize imagery to align with the writer’s emotional state during the writing process. For instance, the imagery can be adjusted to be of darker or brighter hues and colder or warmer color tones. These emotionally congruent images may serve as positive reinforcement, just as empathy is rewarding in interpersonal interaction (9). This reinforcement could encourage further participation in the writing process.

AIW can even help users express their emotions. For EW to be effective for individuals who have experienced traumas, it would be better for participants to express emotions related to their negative experiences (7, 10). However, some individuals may struggle to express such feelings due to their personality traits, sociocultural factors (11, 12), or mental disorders (e.g., alexithymia) (13). Such individuals may omit emotional expression when recalling negative experiences, instead writing only facts related to the event. In this case, AI-empowered imagery may help individuals express their negative emotions by visualizing these feelings.

Promoting wisdom

AIW has the potential to foster individuals’ wisdom (i.e., profound and comprehensive understanding of one’s experience; 1416), thereby ameliorating emotional distress and promoting growth following negative life events. Improving wisdom is helpful for individuals who have experienced major yet commonplace adverse events (e.g., job loss, relationship dissolution, or the death of a loved one; 17, 18). Central to the construct of wisdom is perspectival metacognition (PMC), a nuanced form of metacognition that encompasses non-propositional elements like epistemic humility and the consideration of diverse perspectives (19). PMC enables a more mature and balanced understanding of events, harmonizing potentially conflicting interests and perspectives.

By incorporating the principles of PMC, AIW has the potential to facilitate metacognitive shifts and offer alternative perspectives through generated imagery. Specifically, AIW can help users transition from being immersed in their subjective experiences to observing them from an external perspective—a shift crucial for mental health and wisdom (19, 20). Moreover, the multi-dimensional imagery generated by AIW, which encompasses length, width, height, and time, may offer a more robust paradigm for metacognition than text alone. Providing richer metacognitive opportunities may be particularly advantageous when individuals write about negative autobiographical experiences, as suggested by previous clinical research (4, 5).

AIW can further facilitate wisdom development by encouraging individuals to process negative life events critically. While wisdom development often necessitates challenging “exploratory processing” such as meaning-making, this can be daunting during stressful times (15, 21). Individuals may default to “tunnel vision”, focusing solely on immediate needs and neglecting alternative perspectives (21, 22). However, AIW’s generated imagery catalyzes PMC: by externalizing the “self” to the imagery, AIW could create a psychological distance between the self and the negative experiences, thereby encouraging a more objective and expansive understanding (cf. 19, 2325). Additionally, AI-generated imagery can be designed to include other characters from the narratives, enabling writers to adopt a more comprehensive and nuanced view of the situation, much like how schematic diagrams assist in mathematical problem-solving (26).

As writers articulate their thought process and subsequently review their text and the corresponding AI-generated images, they could gain heightened metacognitive sensitivity, which is beneficial for counteracting overgeneralized self-related thinking, a cognitive distortion linked to depression (27, 28). AIW can produce abstract imagery in response to overgeneralized thoughts, such as “I am useless”, which contrasts sharply with the more concrete and detailed imagery generated for specific life scenarios, like “I am skilled/unskilled at cooking fish.” Therapists can remind the patients of this visual discrepancy and encourage writers to engage in more nuanced narrative construction, thereby mitigating the over-general autobiographical memory that predicts depression (28, 29).

AIW can further promote wisdom development by utilizing visual art to foster new perspectives and interpretations of written content (30). Drawing on the creativity-enhancing potential of art (31), imagery from AIW can catalyze creative self-expression, a cornerstone of art therapy shown to improve mental well-being (3234). Notably, these AI-generated images are not mere replicas of the writer’s mental imagery but rather nuanced variations. For example, in text-to-image AI software, the AI adapts existing images related to the text’s keywords, essentially offering alternative perspectives on the writer’s narrative (35, 36). Engaging with these images can be likened to getting a “second opinion” on one’s experiences, facilitating a broader perspective of these events. This aligns with research showing that a third-person perspective enhances wise reasoning during social conflicts (37) and that writing about adverse experiences from a third-person perspective (cf. first-person perspective) can improve positive emotions (38).

Discussion

AIW presents an exciting avenue for enhancing mental health by synergistically combining fundamental elements of expressive writing, art therapy, and wisdom therapy—such as meaning-making, creative expression, and perspectival metacognition. As AI technology continues to evolve, AIW can be increasingly customized to meet individual needs, thereby optimizing the impact of writing and AI-generated art on psychological well-being.

AIW holds great promise as an attainable mental health intervention. Traditional therapeutic settings often need trained clinical psychologists and counselors. AIW, accessible via personal computing devices, offers a resource-efficient alternative that can be widely deployed at home and in public service settings like hospitals and schools. Notably, the platform can maintain user anonymity, allowing individuals to engage in therapeutic writing without fear of privacy infringement. Users can selectively share portions of their writing with the AI, receiving personalized feedback.

This emerging field raises many intriguing questions about efficacy, implementation, and potential risks. Much empirical work is needed to verify the efficacy of AIW and identify optimal implementation strategies to maximize its therapeutic efficacy and minimize its risk. For example, researchers can conduct a randomized controlled trial (RCT) to test if individuals are gaining “metacognitive sensitivity” by using AIW.

Additional questions also arise regarding the impact of AIW on writers’ mental visualization skills, which are important for mental health (4, 5). For example, could AIW enhance or impair an individual’s ability to mentally visualize and conceptualize past events? Furthermore, what are the long-term implications of such changes in mental visualization skills on overall mental health? While AIW could be particularly beneficial for those struggling with mental imagery by allowing them to conceptualize their experiences more vividly, it may inadvertently limit those already possessing robust visualization skills. To mitigate this, AIW could employ deliberately blurred or abstract images, thereby avoiding the “formatting” or “framing” of an individual’s imagination. Such an approach would preserve the interpretive space necessary for mental visualization, offering a more nuanced and flexible therapeutic tool.

Application of AIW must adhere to stringent ethical standards, transparency, respect for patient rights, data protection, and particular attention to vulnerable demographics (e.g., individuals with posttraumatic stress disorders), as recommended by e-mental health experts (1). For example, some AI-generated images may be distracting or even offensive to users. To mitigate this risk, users could provide feedback to the AI system at the beginning of writing. Users might relay their comfort level with the images and express how motivating they find the imagery for their writing endeavors. Subsequently, the system could iteratively fine-tune itself to align with each user’s emotional and cognitive preferences.

Limitation

Empirical data are needed to test our proposal, especially regarding the long-term effects of AI-generated imagery on mental health. In addition, potential biases and limitations of AI-generated imagery across different social groups (e.g., the poor and the disabled) and cultures need to be evaluated. Researchers from diverse cultures and fields (e.g., psychiatry, computer science, sociology, creative writing, art) should collaborate to better manage the risks and benefits of AI-generated imagery (39).

Conclusion

AI-generated imagery technology can potentially aid digital mental health services. AIW harnesses the power of AI to boost the effectiveness of expressive writing, bringing images to insights and pixels to perspectives. As this fusion develops, we must remain vigilant, guarding against risks while maximizing benefits for mental health. With thoughtful development, AIW can potently improve mental health and well-being at scale.

Author contributions

CH: Conceptualization, Visualization, Writing – original draft. NZ: Writing – review & editing. ZL: Writing – review & editing. LJ: Funding acquisition, Writing – review & editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work is supported by the Social Sciences and Humanities Research Council (SSHRC) of Canada (NFRFR-2022-00402) research grant, “An AI-guided Imagery Writing Program to Improve Chinese Healthcare Workers’ Mental Health”, awarded to Ji, Hu, and Zhang.

Acknowledgments

We thank Haotian Zhang, Wuhan University, for comments on this paper. Author ZL revised the manuscript extensively and contributed to the final version. LJ and NZ contributed to this paper's writing and revision.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Seiferth C, Vogel L, Aas B, Brandhorst I, Carlbring P, Conzelmann A, et al. How to e-mental health: A guideline for researchers and practitioners using digital technology in the context of mental health. Nat Ment Health. (2023) 1:542–54. doi: 10.1038/s44220-023-00085-1

CrossRef Full Text | Google Scholar

2. Aminah S, Hidayah N, Ramli M. Considering ChatGPT to be the first aid for young adults on mental health issues. J Public Health. (2023) 45:e615–6. doi: 10.1093/pubmed/fdad065

CrossRef Full Text | Google Scholar

3. Schueller SM, Morris RR. Clinical science and practice in the age of large language models and generative artificial intelligence. J Consulting Clin Psychol. (2023) 91:559–61. doi: 10.1037/ccp0000848

CrossRef Full Text | Google Scholar

4. Pearson J, Naselaris T, Holmes EA, Kosslyn SM. Mental imagery: functional mechanisms and clinical applications. Trends Cogn Sci. (2015) 19:590–602. doi: 10.1016/j.tics.2015.08.003

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Pile V, Williamson G, Saunders A, Holmes EA, Lau JYF. Harnessing emotional mental imagery to reduce anxiety and depression in young people: An integrative review of progress and promise. Lancet Psychiatry. (2021) 8:836–52. doi: 10.1016/S2215-0366(21)00195-4

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Pennebaker JW. Expressive writing in psychological science. Perspect psychol Sci. (2018) 13:226–9. doi: 10.1177/1745691617707315

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Tarragona M. Personal narratives, expressive writing and well-being. In: Snyder CR, Lopez SJ, Edwards LM, Marques SC, editors. The Oxford Handbook of Positive Psychology, 3rd. Oxford, England: Oxford University Press (2019). p. 892–906. doi: 10.1093/oxfordhb/9780199396511.013.52

CrossRef Full Text | Google Scholar

8. Ruini C, Mortara CC. Writing technique across psychotherapies—from traditional expressive writing to new positive psychology interventions: A narrative review. J Contemp Psychother. (2021). 1–12. doi: 10.1007/s10879-021-09520-9

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Miller F, Wallis J. Social interaction and the role of empathy in information and knowledge management: A literature review. J Educ Library Inf Sci. (2011) 52:122–32.

Google Scholar

10. Pennebaker J, Beall SK. Confronting a traumatic event: Toward an understanding of inhibition and disease. J Abnormal Psychol. (1986) 95:274–81. doi: 10.1037/0021-843X.95.3.274

CrossRef Full Text | Google Scholar

11. Markus HR, Kitayama S. Cultures and selves: A cycle of mutual constitution. Perspect psychol Sci. (2010) 5:420–30. doi: 10.1177/1745691610375557

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Han M, Pong H. Mental health help-seeking behaviors among Asian American community college students: The effect of stigma, cultural barriers, and acculturation. J Coll Student Dev. (2015) 56:1–14. doi: 10.1353/csd.2015.0001

CrossRef Full Text | Google Scholar

13. Renzi A, Mariani R, Di Trani M, Tambelli R. Giving words to emotions: The use of linguistic analysis to explore the role of alexithymia in an expressive writing intervention. Res Psychotherapy: Psychopathology Process Outcome. (2020) 23:121–32. doi: 10.4081/ripppo.2020.452

CrossRef Full Text | Google Scholar

14. Ferrari M, Weststrate NM. The scientific study of personal wisdom. In: The Scientific Study of Personal Wisdom. New York: Springer Netherlands (2013). p. 325–41. doi: 10.1007/978-94-007-7987-7_15

CrossRef Full Text | Google Scholar

15. Weststrate NM, Glück J. Hard-earned wisdom: Exploratory processing of difficult life experience is positively associated with wisdom. Dev Psychol. (2017) 53:800–14. doi: 10.1037/dev0000286

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Hu CS, Zheng Y, Dong G, Glassman H, Huang C, Xuan R. Resting state default mode network is associated with wise advising. Sci Rep. (2023) 13:Article 1. doi: 10.1038/s41598-023-41408-7

CrossRef Full Text | Google Scholar

17. Linden M. Posttraumatic embitterment disorder and wisdom therapy. J Cogn Psychother. (2008) 22:4–14. doi: 10.1891/0889.8391.22.1.4

CrossRef Full Text | Google Scholar

18. Linden M, Baumann K, Lieberei B, Lorenz C, Rotter M. Treatment of posttraumatic embitterment disorder with cognitive behaviour therapy based on wisdom psychology and hedonia strategies. Psychother Psychosomatics. (2011) 80:199–205. doi: 10.1159/000321580

CrossRef Full Text | Google Scholar

19. Grossmann I, Weststrate NM, Ardelt M, Brienza JP, Dong M, Ferrari M, et al. The science of wisdom in a polarized world: Knowns and unknowns. psychol Inq. (2020) 31:103–33. doi: 10.1080/1047840X.2020.1750917

CrossRef Full Text | Google Scholar

20. Bernstein A, Hadash Y, Lichtash Y, Tanay G, Shepherd K, Fresco DM. Decentering and related constructs: A critical review and metacognitive processes model. Perspect psychol Sci. (2015) 10:Article 5. doi: 10.1177/1745691615594577

CrossRef Full Text | Google Scholar

21. Ardelt M, Bruya B. Three-dimensional wisdom and perceived stress among college students. J Adult Dev. (2021) 28:93–105. doi: 10.1007/s10804-020-09358-w

CrossRef Full Text | Google Scholar

22. Neff LA, Nguyen TTT, Williamson HC. Too stressed to help? The effects of stress on noticing partner needs and enacting support. Pers Soc Psychol Bull. (2021) 47:1565–79. doi: 10.1177/0146167220974490

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Belk R. Extended self and the digital world. Curr Opin Psychol. (2016) 10:50–4. doi: 10.1016/j.copsyc.2015.11.003

CrossRef Full Text | Google Scholar

24. Grossmann I, Dorfman A, Oakes H, Santos HC, Vohs KD, Scholer AA. Training for wisdom: The distanced-self-reflection diary method. psychol Sci. (2021) 32:381–94. doi: 10.1177/0956797620969170

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Trope Y, Liberman N. Construal-level theory of psychological distance. psychol Rev. (2010) 117:440–63. doi: 10.1037/a0018963

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Larkin JH, Simon HA. Why a diagram is (Sometimes) worth ten thousand words. Cogn Sci. (1987) 11:65–100. doi: 10.1016/S0364-0213(87)80026-5

CrossRef Full Text | Google Scholar

27. Carver CS, Ganellen RJ. Depression and components of self-punitiveness: High standards, self-criticism, and overgeneralization. J Abnormal Psychol. (1983) 92:330–7. doi: 10.1037/0021-843X.92.3.330

CrossRef Full Text | Google Scholar

28. Raes F, Griffith JW, Craeynest M, Williams JMG, Hermans D, Barry TJ, et al. Overgeneralization as a predictor of the course of depression over time: the role of negative overgeneralization to the self, negative overgeneralization across situations, and overgeneral autobiographical memory. Cogn Ther Res. (2023) 47:598–613. doi: 10.1007/s10608-023-10385-6

CrossRef Full Text | Google Scholar

29. Sumner JA, Griffith JW, Mineka S. Overgeneral autobiographical memory as a predictor of the course of depression: A meta-analysis. Behav Res Ther. (2010) 48:614–25. doi: 10.1016/j.brat.2010.03.013

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Costa AC, Abreu MV. Expressive and creative writing in the therapeutic context: From the different concepts to the development of writing therapy programs. Psychologica. (2018) 61:69–86. doi: 10.14195/1647-8606_61-1_4

CrossRef Full Text | Google Scholar

31. Marshall J. Connecting art, learning, and creativity: A case for curriculum integration. Stud Art Educ. (2005) 46:227–41. doi: 10.1080/00393541.2005.11650076

CrossRef Full Text | Google Scholar

32. Blomdahl C, Gunnarsson AB, Guregård S, Björklund A. A realist review of art therapy for clients with depression. Arts Psychother. (2013) 3:322–30. doi: 10.1016/j.aip.2013.05.009

CrossRef Full Text | Google Scholar

33. Haeyen S, van Hooren S, van der Veld WM, Hutschemaekers G. Measuring the contribution of art therapy in multidisciplinary treatment of personality disorders: The construction of the Self-expression and Emotion Regulation in Art Therapy Scale (SERATS). Pers Ment Health. (2018) 12:3–14. doi: 10.1002/pmh.1379

CrossRef Full Text | Google Scholar

34. Chiang M, Reid-Varley WB, Fan X. Creative art therapy for mental illness. Psychiatry Res. (2019) 275:129–36. doi: 10.1016/j.psychres.2019.03.025

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Dhariwal P, Nichol A. Diffusion models beat GANs on image synthesis. Adv Neural Inf Process Syst. (2021) 34:8780–94.

Google Scholar

36. Borji A. Generated faces in the wild: quantitative comparison of stable diffusion, midjourney and DALL-E 2. arXiv:2210.00586. (2023). 1–9. doi: 10.48550/arXiv.2210.00586

CrossRef Full Text | Google Scholar

37. Grossmann I, Kross E. Exploring solomon’s paradox: Self-distancing eliminates the self-other asymmetry in wise reasoning about close relationships in younger and older adults. psychol Sci. (2014) 25:1571–80. doi: 10.1177/0956797614535400

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Dorfman A, Oakes H, Santos HC, Grossmann I. ). Self-distancing promotes positive emotional change after adversity: Evidence from a micro-longitudinal field experiment. J Pers. (2019). 89(1):132–44. doi: 10.1111/jopy.12534

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Lin Z. Progress and challenges in the symbiosis of AI with science and medicine. Eur J Clin Invest. (2024). e14222-e14222 doi: 10.1111/eci.14222

CrossRef Full Text | Google Scholar

Keywords: digital mental health service, AI-generated imagery, art therapy, wisdom therapy, mental imagery, expressive writing

Citation: Hu C, Lin Z, Zhang N and Ji L-J (2024) AI-empowered imagery writing: integrating AI-generated imagery into digital mental health service. Front. Psychiatry 15:1434172. doi: 10.3389/fpsyt.2024.1434172

Received: 17 May 2024; Accepted: 09 July 2024;
Published: 22 July 2024.

Edited by:

Maria Lucia O. Souza-Formigoni, Federal University of São Paulo, Brazil

Reviewed by:

Eunjoo Kim, Yonsei University, Republic of Korea

Copyright © 2024 Hu, Lin, Zhang and Ji. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Chao Hu, aGNfM0AxNjMuY29t

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.