One-Shot Generative Adversarial Learning for MRI Segmentation of Craniomaxillofacial Bony Structures

Xu Chen, Chunfeng Lian, Li Wang, Hannah Deng, Steve H Fung, Dong Nie, Kim-Han Thung, Pew-Thian Yap, Jaime Gateno, James J Xia, Dinggang Shen

Research output: Contribution to journalArticle

1 Scopus citations

Abstract

Compared to computed tomography (CT), magnetic resonance imaging (MRI) delineation of craniomaxillofacial (CMF) bony structures can avoid harmful radiation exposure. However, bony boundaries are blurry in MRI, and structural information needs to be borrowed from CT during the training. This is challenging since paired MRI-CT data are typically scarce. In this paper, we propose to make full use of unpaired data, which are typically abundant, along with a single pairedMRI-CT data to construct a one-shot generative adversarial model for automated MRI segmentation of CMF bony structures. Our model consists of a cross-modality image synthesis sub-network, which learns the mapping between CT and MRI, and an MRI segmentation sub-network. These two sub-networks are trained jointly in an end-to-end manner. Moreover, in the training phase, a neighbor-based anchoring method is proposed to reduce the ambiguity problem inherent in cross-modality synthesis, and a feature-matching-based semantic consistency constraint is proposed to encourage segmentation-oriented MRI synthesis. Experimental results demonstrate the superiority of our method both qualitatively and quantitatively in comparison with the state-of-the-art MRI segmentation methods.

Original languageEnglish (US)
JournalIEEE Transactions on Medical Imaging
DOIs
StateE-pub ahead of print - Aug 14 2019

Fingerprint Dive into the research topics of 'One-Shot Generative Adversarial Learning for MRI Segmentation of Craniomaxillofacial Bony Structures'. Together they form a unique fingerprint.

Cite this