gms | German Medical Science

Artificial Vision 2024

The International Symposium on Visual Prosthetics

05. - 06.12.2024, Aachen, Germany

How to enable embedded neural signal processing in future retinal implants

Meeting Abstract

  • Nick Buron - University of Duisburg-Essen, Intelligent Embedded Systems Lab, Duisburg, Germany
  • L. Kaiser - University of Duisburg-Essen, Intelligent Embedded Systems Lab, Duisburg, Germany
  • J. Dicke - University of Duisburg-Essen, Intelligent Embedded Systems Lab, Duisburg, Germany
  • N. Lorenz - University of Duisburg-Essen, Department of Electronic Components and Circuits, Duisburg, Germany
  • J. Zimmermann - University of Pavia, Department of Civil Engineering and Architecture, Pavia, Italy
  • K. Seidl - University of Duisburg-Essen, Department of Electronic Components and Circuits, Duisburg, Germany
  • G. Schiele - University of Duisburg-Essen, Intelligent Embedded Systems Lab, Duisburg, Germany
  • A. Erbslöh - University of Duisburg-Essen, Intelligent Embedded Systems Lab, Duisburg, Germany

Artificial Vision 2024. Aachen, 05.-06.12.2024. Düsseldorf: German Medical Science GMS Publishing House; 2025. Doc24artvis46

doi: 10.3205/24artvis46, urn:nbn:de:0183-24artvis464

Published: May 9, 2025

© 2025 Buron et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.


Outline

Text

Objective: Modern prototypes of closed-loop stimulation systems include stimulation and recording front-ends for interacting with the tissue. To analyze the extracellular activity for understanding retinal processes of the retinal tissue, further signal processing with machine learning support is necessary. These methods should also be implemented in hardware as a retinal signal processor. The implementation of these hardware accelerators have to fulfill hard constraints for using in neural implants (low space, limited power budget, low latency, high data rate processing). This abstract presents methods for enable neural signal processing in future retinal implants.

Concept and Methods: From the extracellular recordings, it is possible to classify four subtypes (ON/OFF, transient/sustained) of retinal ganglion cells (RGC) using deep learning methods. Here, the classification is done on the detected spike frames from the transient input. For transferring the models into hardware, elasticAI.creator is used for building the digital accelerators on FPGAs. In addition, it is possible to fit the impedance value from transient stimulation signals (current and voltage) to get the electrical impedance spectroscopy and the corresponding electrical model parameters. This can be used for determining the electrode quality during run-time.

Results: The 1D-CNN-based classification model for RGC subtypes consist of five CNN layers with PReLU activation function and MaxPooling and of five dense-layers with ReLU activation function. In total, it achieves a precision of 73.84% and the detection of ON/OFF RGCs achieves a precision of 81.24% after 100 epochs with 80/20 dataset splitting using Retinal Ganglion Cell Typology Database. In extracting the impedance properties from the transient electrical stimulation, a mean absolute percentage error of 9% and a difference of the tissue resistance is below 6% are achieved, compared to the reference from electrical impedance spectroscopy