Phone: (+39) 0813995453

Smartphone video nystagmography using convolutional neural networks: ConVNG

HumanInsight Smartphone video nystagmography using convolutional neural networks: ConVNG

J Neurol. 2022 Nov 23. doi: 10.1007/s00415-022-11493-1. Online ahead of print.


BACKGROUND: Eye movement abnormalities are commonplace in neurological disorders. However, unaided eye movement assessments lack granularity. Although videooculography (VOG) improves diagnostic accuracy, resource intensiveness precludes its broad use. To bridge this care gap, we here validate a framework for smartphone video-based nystagmography capitalizing on recent computer vision advances.

METHODS: A convolutional neural network was fine-tuned for pupil tracking using > 550 annotated frames: ConVNG. In a cross-sectional approach, slow-phase velocity of optokinetic nystagmus was calculated in 10 subjects using ConVNG and VOG. Equivalence of accuracy and precision was assessed using the "two one-sample t-test" (TOST) and Bayesian interval-null approaches. ConVNG was systematically compared to OpenFace and MediaPipe as computer vision (CV) benchmarks for gaze estimation.

RESULTS: ConVNG tracking accuracy reached 9-15% of an average pupil diameter. In a fully independent clinical video dataset, ConVNG robustly detected pupil keypoints (median prediction confidence 0.85). SPV measurement accuracy was equivalent to VOG (TOST p < 0.017; Bayes factors (BF) > 24). ConVNG, but not MediaPipe, achieved equivalence to VOG in all SPV calculations. Median precision was 0.30°/s for ConVNG, 0.7°/s for MediaPipe and 0.12°/s for VOG. ConVNG precision was significantly higher than MediaPipe in vertical planes, but both algorithms' precision was inferior to VOG.

CONCLUSIONS: ConVNG enables offline smartphone video nystagmography with an accuracy comparable to VOG and significantly higher precision than MediaPipe, a benchmark computer vision application for gaze estimation. This serves as a blueprint for highly accessible tools with potential to accelerate progress toward precise and personalized Medicine.

PMID:36422668 | DOI:10.1007/s00415-022-11493-1

Powered by WPeMatico

P.IVA 08738511214
Privacy Policy
Cookie Policy

Sede Legale
Viale Campi Flegrei 55
80124 - Napoli

Sede Operativa
Via G.Porzio 4
Centro Direzionale G1
80143 - Napoli

AI 4394
© Copyright 2022 - Humaninsight Srls - All Rights Reserved
Privacy Policy | Cookie Policy
envelopephone-handsetmap-marker linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram