Skip to main content

ORIGINAL RESEARCH article

Front. Hum. Neurosci.

Sec. Sensory Neuroscience

Volume 19 - 2025 | doi: 10.3389/fnhum.2025.1549698

This article is part of the Research Topic Neuro-Behavioral Insights on Low Vision and Beyond View all 3 articles

Point-SPV: End-to-End Enhancement of Object Recognition in Simulated Prosthetic Vision using Synthetic Viewing Points

Provisionally accepted
Ashkan Nejad Ashkan Nejad 1,2,3*Burcu Küçükoğlu Burcu Küçükoğlu 3Jaap de Ruyter van Steveninck Jaap de Ruyter van Steveninck 3Sandra Bedrossian Sandra Bedrossian 2Gera A. de Haan Gera A. de Haan 1,2Joost Heutink Joost Heutink 1,2Frans W. Cornelissen Frans W. Cornelissen 4Marcel van Gerven Marcel van Gerven 3
  • 1 Royal Dutch Visio, Huizen, Netherlands
  • 2 University of Groningen, Groningen, Netherlands
  • 3 Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
  • 4 University Medical Center Groningen, Groningen, Netherlands, Netherlands

The final, formatted version of the article will be published soon.

    Prosthetic vision systems aim to restore functional sight for visually impaired individuals by replicating visual perception by inducing phosphenes through electrical stimulation in the visual cortex, yet there remain challenges in visual representation strategies such as including gaze information and task-dependent optimization. In this paper, we introduce Point-SPV, an end-toend deep learning model designed to enhance object recognition in simulated prosthetic vision.Point-SPV takes an initial step towards gaze-based optimization by simulating viewing points, representing potential gaze locations, and training the model on patches surrounding these points. Our approach prioritizes task-oriented representation, aligning visual outputs with object recognition needs. A behavioral gaze-contingent object discrimination experiment demonstrated that Point-SPV outperformed a conventional edge detection method, by facilitating observers to gain a higher recognition accuracy, faster reaction times, and a more efficient visual exploration.Our work highlights how task-specific optimization may enhance representations in prosthetic vision, offering a foundation for future exploration and application.

    Keywords: simulated prosthetic vision, Synthetic Viewing Points, object recognition, End-to-end training, deep learning

    Received: 21 Dec 2024; Accepted: 24 Feb 2025.

    Copyright: © 2025 Nejad, Küçükoğlu, de Ruyter van Steveninck, Bedrossian, de Haan, Heutink, Cornelissen and van Gerven. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Ashkan Nejad, Royal Dutch Visio, Huizen, Netherlands

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

    Research integrity at Frontiers

    Man ultramarathon runner in the mountains he trains at sunset

    94% of researchers rate our articles as excellent or good

    Learn more about the work of our research integrity team to safeguard the quality of each article we publish.


    Find out more