Rüdiger Pryss1,2*
Jan vom Brocke3,4,5
Manfred Reichert6
Enrico Rukzio7
Winfried Schlee8,9
Barbara Weber10- 1Institute of Clinical Epidemiology and Biometry, University of Würzburg, Würzburg, Germany
- 2Institute of Medical Data Science, University Hospital of Würzburg, Würzburg, Germany
- 3Department of Information Systems, University of Liechtenstein, Vaduz, Liechtenstein
- 4Department of Information Systems, University of Münster, Münster, Germany
- 5European Research Center for Information Systems (ERCIS), Münster, Germany
- 6Institute of Databases and Information Systems, Ulm University, Ulm, Germany
- 7Institute for Media Research and Media Development, Ulm University, Ulm, Germany
- 8Institute for Information and Process Management, Eastern Switzerland University of Applied Sciences, St. Gallen, Switzerland
- 9Department of Psychiatry and Psychotherapy, Interdisciplinary Tinnitus Clinic, University of Regensburg, Regensburg, Germany
- 10Institute of Computer Science, University of St. Gallen, St. Gallen, Switzerland
Editorial on the Research Topic
Application of neuroscience in information systems and software engineering
1 Motivation and Research Topic in numbers
The integration of methodologies from cognitive psychology and neuroscience into the study of IT systems has seen a notable uptick in recent years. This surge is spurred by the escalating complexity of IT systems, which increasingly tax both novice and seasoned users alike (Ma et al., 2023; Leger et al., 2014). Consequently, insights into constructing IT systems with a reduced cognitive burden are gaining paramount importance.
A survey of the current literature reveals several discernible trends. Researchers are delving into the cognitive processes involved in programming (Peitek et al., 2021), exploring the perceptual dynamics of virtual reality environments (Rixen et al., 2023; Holzwarth et al., 2021), deciphering how individuals comprehend process models (Abbad-Andaloussi et al., 2023; Winter et al., 2023), and examining the general perception of information systems (vom Brocke et al., 2020; Brocke et al., 2013). Moreover, there exist established models for analyzing the acceptance of information systems (Dwivedi et al., 2011), predominantly within the domain of computer science. It is also anticipated that the integration of artificial intelligence (AI) across various spheres of life will catalyze heightened research into the cognitive burden or alleviation offered by AI-driven IT systems (Gandhi et al., 2023). In technical terms, eye tracking (Scherer et al., 2012), think aloud protocols (Abbad Andaloussi et al., 2021), EEG (Zhang et al.), and measuring electrical skin conductivity (Winter et al., 2020) are commonly observed methods within the context of this Research Topic. The pinnacle of this field is exemplified by brain-computer interfaces (BCIs) (Fiani et al., 2021; Proverbio et al.), which establish a direct connection between the brain and input/output devices. With the proliferation of digital devices such as smartwatches and wristbands, as well as advanced facial recognition services, neuroscience is increasingly finding its way into everyday working and private life. Many use cases have been identified, including using emotion-sensing devices to significantly reduce stress and supporting flow in people's work processes (Whelan et al., 2019). Research has also begun to investigate the design of so-called neuro-adaptive processes, which capture body data during process execution and adapt the process flow and human-computer interaction accordingly in real time (vom Brocke, 2022).
Against this backdrop, this topic aims to foster a neuroscientific perspective on the subject matter. A total of 76 authors were actively solicited to contribute, with 29 ultimately participating. Out of the 22 targeted submissions, 17 papers were received. Following a rigorous review process, 12 papers were regrettably declined, while 5 were accepted, yielding an acceptance rate of 29%. Moreover, the topic has amassed 12,200 visits to date, underscoring the continued relevance of its content.
Spanning a duration of 11 months in 2022, this Research Topic enjoyed the collaborative support of both computer scientists and neuroscientists on the editorial board. In the subsequent chapters, we provide a comprehensive overview of the 5 accepted papers, culminating in a summary and future outlook in this editorial.
2 The papers of the Research Topic
In this Research Topic, five papers were accepted. These papers bear the following titles:
• On the accuracy of code complexity metrics: A neuroscience-based guideline for improvement (Hao et al.)
• Event-related brain potential markers of visual and auditory perception: A useful tool for brain computer interface systems (Proverbio et al.)
• Using spontaneous eye blink-related brain activity to investigate cognitive load during mobile map-assisted navigation (Cheng et al.)
• Don't overthink it: The paradoxical nature of expertise for the detection of errors in conceptual business process models (Boutin et al.)
• EEG emotion recognition based on cross-frequency granger causality feature extraction and fusion in the left and right hemispheres (Zhang et al.)
The papers can all be categorized as we discussed in the introduction. The following three papers heavily rely on EEG and cognitive load, underscoring the relevance of EEG as a method and the examination of mental load, validating their significance in the context of this topic.
First, the authors of Hao et al. present findings from an experiment involving 27 programmers, revealing that traditional code complexity metrics often fail to accurately capture the perceived complexity of code. Utilizing EEG measurements of cognitive load as a reference, the study suggests that these metrics may inadequately assess the difficulty programmers experience in comprehending code, prompting recommendations for refining existing metrics and proposing guidelines for future research in this domain.
Second, the authors of Cheng et al. delve into blink-related brain potentials, revealing that the visualization of landmarks on mobile maps impacts navigators' cognitive load in virtual environments, synthesizing cognitive neuroscience, navigation information system design, and brain-computer interface fields. It suggests that a mobile map featuring a moderate number of landmarks (specifically, five landmarks) optimally supports spatial learning without overwhelming navigators' attentional resources. Additionally, the study indicates a cognitive load spillover effect between map viewing and navigation, highlighting the validity of blink-related potential analysis as a method for assessing cognitive load during navigation.
Third, the authors of Zhang et al. introduce an emotion recognition scheme based on multi-feature extraction and fusion from EEG signals, leveraging the asymmetry of the brain hemispheres and Granger causality (GC) relationships. By categorizing EEG signals into four groups based on hemisphere and frequency, and employing an adaptive thresholding method (ATD) for feature extraction, the proposed scheme effectively enhances emotion recognition performance, as demonstrated by improvements of 8.43% compared to single GC features and 5.36% compared to direct cascade fusion methods on the DEAP emotion dataset, emphasizing the importance of considering cross-frequency causality in EEG signal analysis for enhanced emotion recognition.
The remaining two papers deal with the mental load in comprehending process models (Boutin et al.) and the improvement of brain-computer interfaces (Proverbio et al.), highlighting the relevance of process model comprehension and brain-computer interfaces.
The authors of Boutin et al. explore expertise in conceptual modeling and its impact on business analysts' performance, particularly focusing on visual attention and error detection processes. Results reveal unexpected findings where experts did not demonstrate significantly better performance compared to novices, suggesting potential biases and over-complexification among experts in error detection tasks. Future research avenues include investigating domain expertise, exploring brain activity using neuroimaging techniques, and considering nuanced measures like scan paths to enhance our understanding of expertise in conceptual modeling.
Finally, the authors of Proverbio et al. aim to identify reliable electrophysiological markers associated with visual and auditory perception of basic semantic categories, providing signals recognizable by brain-computer interface (BCI) systems for patients or device users. By contrasting brain signals across various perceptual categories in the same participants, the study uncovers unprecedented markers for sensory modalities, aiding in future development of automated classification systems. While categorization based on statistical analyses and expert supervision seems superior to machine learning systems for discriminating living stimuli, it requires human supervision for site and latency selection, suggesting potential for optimizing AI systems in reconstructing mental representations related to different categories of stimuli.
3 Summary
Many of the initially identified topics have been well-represented in the selected papers. EEG's prominence in measuring cognitive load stands out, reflecting its widespread use for this purpose. The increasing integration of process models in various industries highlights their growing importance, as evidenced by the inclusion of a paper on this subject. Moreover, the rising interest in brain-computer interfaces, evident in developments like Neuralink (Fiani et al., 2021) and concepts such as the Metaverse (Lee et al., 2021), indicate the emergence of new research avenues. Overall, these trends affirm the significance of neuroscience in fields like information systems or software engineering, pointing toward promising opportunities for future exploration.
Author contributions
RP: Writing – original draft, Writing – review & editing. JvB: Writing – original draft, Writing – review & editing. MR: Writing – original draft, Writing – review & editing. ER: Writing – original draft, Writing – review & editing. WS: Writing – original draft, Writing – review & editing. BW: Writing – original draft, Writing – review & editing.
Acknowledgments
We are grateful to all contributors of this Research Topic. Twenty-nine different authors contributed with research and review articles. Furthermore, we thank the reviewers who helped us and the authors to create an interesting and high-quality Research Topic. We hope that readers will enjoy reading this Research Topic as much as we have enjoyed editing it.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Abbad Andaloussi, A., Zerbato, F., Burattin, A., Slaats, T., Hildebrandt, T. T., and Weber, B. (2021). Exploring how users engage with hybrid process artifacts based on declarative process models: a behavioral analysis based on eye-tracking and think-aloud. Softw. Syst. Model. 20, 1437–1464. doi: 10.1007/s10270-020-00811-8
Abbad-Andaloussi, A., Burattin, A., Slaats, T., Kindler, E., and Weber, B. (2023). Complexity in declarative process models: metrics and multi-modal assessment of cognitive load. Expert Syst. Appl. 233:120924. doi: 10.1016/j.eswa.2023.120924
Brocke, J. V., Riedl, R., and Léger, P.-M. (2013). Application strategies for neuroscience in information systems design science research. J. Comput. Inform. Syst. 53, 1–13. doi: 10.1080/08874417.2013.11645627
Dwivedi, Y. K., Rana, N. P., Chen, H., and Williams, M. D. (2011). “A meta-analysis of the unified theory of acceptance and use of technology (utaut),” in Governance and Sustainability in Information Systems. Managing the Transfer and Diffusion of IT: IFIP WG 8.6 International Working Conference, Hamburg, Germany, September 22-24, 2011. Proceedings (Springer), 155–170. doi: 10.1007/978-3-642-24148-2_10
Fiani, B., Reardon, T., Ayres, B., Cline, D., Sitto, S. R., Reardon, T. K., et al. (2021). An examination of prospective uses and future directions of neuralink: the brain-machine interface. Cureus 13:e14192. doi: 10.7759/cureus.14192
Gandhi, T. K., Classen, D., Sinsky, C. A., Rhew, D. C., Vande Garde, N., Roberts, A., et al. (2023). How can artificial intelligence decrease cognitive and work burden for front line practitioners? JAMIA Open 6:ooad079. doi: 10.1093/jamiaopen/ooad079
Holzwarth, V., Schneider, J., Handali, J., Gisler, J., Hirt, C., Kunz, A., et al. (2021). Towards estimating affective states in virtual reality based on behavioral data. Virt. Real. 25, 1139–1152. doi: 10.1007/s10055-021-00518-1
Lee, L.-H., Braud, T., Zhou, P., Wang, L., Xu, D., Lin, Z., et al. (2021). All one needs to know about metaverse: a complete survey on technological singularity, virtual ecosystem, and research agenda. arXiv preprint arXiv:2110.05352.
Leger, P.-M., Riedl, R., and vom Brocke, J. (2014). Emotions and erp information sourcing: the moderating role of expertise. Industr. Manag. Data Syst. 114, 456–471. doi: 10.1108/IMDS-09-2013-0365
Ma, R., Lassila, H., Nurgalieva, L., and Lindqvist, J. (2023). “When browsing gets cluttered: Exploring and modeling interactions of browsing clutter, browsing habits, and coping,” in Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 1–29. doi: 10.1145/3544548.3580690
Peitek, N., Apel, S., Parnin, C., Brechmann, A., and Siegmund, J. (2021). “Program comprehension and code complexity metrics: an fMRI study,” in 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) (IEEE), 524–536. doi: 10.1109/ICSE43902.2021.00056
Rixen, J. O., Belz, J. H., Meinhardt, L.-M., Gugenheimer, J., and Rukzio, E. (2023). “Exploring the effects of head-mounted augmented reality on helping behaviour,” in Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia, 440–455. doi: 10.1145/3626705.3627969
Scherer, S., Layher, G., Kane, J., Neumann, H., and Campbell, N. (2012). “An audiovisual political speech analysis incorporating eye-tracking and perception data,” in LREC, 1114–1120.
vom Brocke, J. (2022). “From neuro-adaptive systems to neuro-adaptive processes: opportunities of NeuroIS to contribute to the emerging field of process science,” in Proceedings NeuroIS Retreat 2022.
vom Brocke, J., Hevner, A., Léger, P. M., Walla, P., and Riedl, R. (2020). Advancing a neurois research agenda with four areas of societal contributions. Eur. J. Inform. Syst. 29, 9–24. doi: 10.1080/0960085X.2019.1708218
Whelan, E., McDuff, D., Gleasure, R., and Vom Brocke, J. (2019). “How emotion-sensing technology can reshape the workplace,” in Why Humans Matter More Than Ever, ed. MIT Sloan Management Review (London: MIT press). doi: 10.7551/mitpress/12450.003.0012
Winter, M., Neumann, H., Pryss, R., Probst, T., and Reichert, M. (2023). Defining gaze patterns for process model literacy-exploring visual routines in process models with diverse mappings. Expert Syst. Appl. 213:119217. doi: 10.1016/j.eswa.2022.119217
Keywords: neuroscience, information systems, software engineering, cognitive load, cognitive psychology, brain-computer interfaces, process model comprehension
Citation: Pryss R, vom Brocke J, Reichert M, Rukzio E, Schlee W and Weber B (2024) Editorial: Application of neuroscience in information systems and software engineering. Front. Neurosci. 18:1402603. doi: 10.3389/fnins.2024.1402603
Received: 17 March 2024; Accepted: 22 October 2024;
Published: 19 November 2024.
Edited by:
Hanliang Fu, Xi'an University of Architecture and Technology, ChinaReviewed by:
Peter ten Klooster, University of Twente, NetherlandsCopyright © 2024 Pryss, vom Brocke, Reichert, Rukzio, Schlee and Weber. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Rüdiger Pryss, cnVlZGlnZXIucHJ5c3MmI3gwMDA0MDt1bmktd3VlcnpidXJnLmRl