October 2020
Volume 20, Issue 11
Open Access
Vision Sciences Society Annual Meeting Abstract  |   October 2020
Predicting the functional organization of human visual cortex from anatomy using geometric deep learning
Author Affiliations & Notes
  • Alexander Puckett
    University of Queensland
  • Steffen Bollmann
    University of Queensland
  • Fernanda Ribeiro
    University of Queensland
  • Footnotes
    Acknowledgements  This work was supported by the Australian Research Council (DE180100433).
Journal of Vision October 2020, Vol.20, 928. doi:https://doi.org/10.1167/jov.20.11.928
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Alexander Puckett, Steffen Bollmann, Fernanda Ribeiro; Predicting the functional organization of human visual cortex from anatomy using geometric deep learning. Journal of Vision 2020;20(11):928. https://doi.org/10.1167/jov.20.11.928.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Human visual cortex is comprised of a number of areas, nearly all of which are organized retinotopically. This retinotopic mapping is similar across individuals; however, considerable inter-subject variation does exist, and this variation has been linked to cortical folding and other anatomical features. It was our aim to develop a neural network capable of learning the complex relationship between the functional organization of visual cortex and the underlying anatomy. Importantly, we used a geometric approach able to directly interact with data represented on cortical surface models, as many properties only make sense considering their location with respect to the various sulci and gyri. To build our network, we used the most comprehensive retinotopy dataset openly available – that from the Human Connectome Project. This dataset includes 7T fMRI data from 181 participants. The data serving as input to our network included curvature and myelin values as well as the connectivity among vertices forming the cortical surface and their spatial disposition. The output of the network was the retinotopic mapping value for each vertex of the surface model. Our final network included 12 spline-based convolution layers, interleaved by batch normalization and dropout. Our neural network accurately predicted the main features of both polar angle and eccentricity maps. More impressive yet, we show that the network was able to predict nuanced variations in the retinotopic maps across individuals. We further showed how disruption of the spatial organization of the input features increases the error and reduces the individual variability of the predicted maps. In conclusion, we were able to predict the detailed functional organization of visual cortex from anatomical properties alone using geometric deep learning. Although we demonstrate its utility for visual neuroscience, geometric deep learning is flexible and well-suited for a range of other applications involving data structured in non-Euclidean spaces.


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.