Multi-subject brain decoding with multi-task feature selection

In the neural science society, multi-subject brain decoding is of great interest. However, due to the variability of activation patterns across brains, it is difficult to build an effective decoder using fMRI samples pooled from different sub- jects. In this paper, a hierarchical model is proposed to extract robust features for decoding. With feature selection for each subject treated as a separate task, a novel multi-task feature selection method is introduced. This method utilizes both com- plementary information among subjects and local correlation between brain areas within a subject. Finally, using fMRI sam- ples pooled from all subjects, a linear support vector machine (SVM) classifier is trained to predict 2-D stimuli-related im- ages or 3-D stimuli-related images. The experimental results demonstrated the effectiveness of the proposed method.