Data representations and ensemble deep learning networks for functional neuroimaging datasets

Date
2023-06-28
Authors
Alizadeh-Shabdiz, Farshid
Cambareri, Morgan
Version
Other
OA Version
Citation
F. Alizadeh-Shabdiz, M. Cambareri. 2023. "Data Representations and Ensemble Deep Learning Networks for Functional Neuroimaging Datasets" CSECS 2023, LNICST 514 proceedings.
Abstract
This project was designed to test the predictive accuracy of combining two separate data representations of resting state functional magnetic resonance imaging (rsfMRI) data into an ensemble deep learning architecture. Three main data representations of the same neuroimaging dataset were tested by building associated deep learning architectures and testing their accuracy in predicting if the neuroimaging data originated from healthy controls or from individuals diagnosed with autism spectrum disorder (ASD). The three data representations were 2D correlation matrices derived from time courses ex-tracted from the blood-oxygen-level-depended (BOLD) signal within the brain, a graph tensor representation of the same connectivity data, and a 3D profile of the posterior cingulate cortex’s (PCC) connectivity across the brain. These data representations were fed into a 2D Convolutional Neural Network (2D-CNN), a Graph Convolutional Network (GCN), and a 3D Convolutional Neural Network (3D-CNN) respectively. Finally, the 2D-CNN and the 3D-CNN were chosen to combine into a single ensemble model to test the hypothesis that the combination of two different represen-tations of the same data can improve upon the individual models. This en-semble model performed better than both the 2D-CNN and 3D-CNN mod-els individually when validated using 5-fold cross-validation and 5x2-fold cross validation. However, this improvement was only statistically signifi-cant for the comparison with the 3D-CNN model (p = 0.0224). This result suggests that using combinations of multiple data representations may im-prove model accuracy when using neuroimaging data in deep learning appli-cations.
Description
License