Federated Multi-Task Learning for Joint Diagnosis of Multiple Mental Disorders on MRI Scans

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

3 Scopus Citations
View graph of relations


Original languageEnglish
Pages (from-to)1137-1149
Number of pages13
Journal / PublicationIEEE Transactions on Biomedical Engineering
Issue number4
Online published30 Sept 2022
Publication statusPublished - Apr 2023


Objective: Deep learning (DL) techniques have been introduced to assist doctors in the interpretation of medical images by detecting image-derived phenotype abnormality. Yet the privacy-preserving policy of medical images disables the effective training of DL model using sufficiently large datasets. As a decentralized computing paradigm to address this issue, federated learning (FL) allows the training process to occur in individual institutions with local datasets, and then aggregates the resultant weights without risk of privacy leakage. Methods: We propose an effective federated multi-task learning (MTL) framework to jointly identify multiple related mental disorders based on functional magnetic resonance imaging data. A federated contrastive learning-based feature extractor is developed to extract high-level features across client models. To ease the optimization conflicts of updating shared parameters in MTL, we present a federated multi-gate mixture of expert classifier for the joint classification. The proposed framework also provides practical modules, including personalized model learning, privacy protection, and federated biomarker interpretation. Results: On real-world datasets, the proposed framework achieves robust diagnosis accuracies of 69.48 ± 1.6%, 71.44 ± 3.2%, and 83.29 ± 3.2% in autism spectrum disorder, attention deficit/hyperactivity disorder, and schizophrenia, respectively. Conclusion: The proposed framework can effectively ease the domain shift between clients via federated MTL. Significance: The current work provides insights into exploiting the advantageous knowledge shared in related mental disorders for improving the generalization capability of computer-aided detection approaches.

Research Area(s)

  • attention deficit/hyperactivity disorder, autism spectrum disorder, Data models, domain shift, Feature extraction, Federated multi-task learning, functional magnetic resonance imaging, joint diagnosis, Medical diagnostic imaging, Mental disorders, Multitasking, schizophrenia, Task analysis, Training

Bibliographic Note

Publisher Copyright: IEEE