TY - JOUR
T1 - BBox-Guided Segmentor
T2 - Leveraging expert knowledge for accurate stroke lesion segmentation using weakly supervised bounding box prior
AU - Ou, Yanglan
AU - Huang, Sharon X.
AU - Wong, Kelvin K.
AU - Cummock, Jonathon
AU - Volpi, John
AU - Wang, James Z.
AU - Wong, Stephen T.
N1 - Funding Information:
This material is based upon work supported by the College of Information Sciences and Technology at The Pennsylvania State University, the T.T. and W.F. Chao Foundation, the John S. Dunn Research Foundation, and The Scullock Foundation.
Publisher Copyright:
© 2023 Elsevier Ltd
PY - 2023/7
Y1 - 2023/7
N2 - Stroke is one of the leading causes of death and disability in the world. Despite intensive research on automatic stroke lesion segmentation from non-invasive imaging modalities including diffusion-weighted imaging (DWI), challenges remain such as a lack of sufficient labeled data for training deep learning models and failure in detecting small lesions. In this paper, we propose BBox-Guided Segmentor, a method that significantly improves the accuracy of stroke lesion segmentation by leveraging expert knowledge. Specifically, our model uses a very coarse bounding box label provided by the expert and then performs accurate segmentation automatically. The small overhead of having the expert provide a rough bounding box leads to large performance improvement in segmentation, which is paramount to accurate stroke diagnosis. To train our model, we employ a weakly-supervised approach that uses a large number of weakly-labeled images with only bounding boxes and a small number of fully labeled images. The scarce fully labeled images are used to train a generator segmentation network, while adversarial training is used to leverage the large number of weakly-labeled images to provide additional learning signals. We evaluate our method extensively using a unique clinical dataset of 99 fully labeled cases (i.e., with full segmentation map labels) and 831 weakly labeled cases (i.e., with only bounding box labels), and the results demonstrate the superior performance of our approach over state-of-the-art stroke lesion segmentation models. We also achieve competitive performance as a SOTA fully supervised method using less than one-tenth of the complete labels. Our proposed approach has the potential to improve stroke diagnosis and treatment planning, which may lead to better patient outcomes.
AB - Stroke is one of the leading causes of death and disability in the world. Despite intensive research on automatic stroke lesion segmentation from non-invasive imaging modalities including diffusion-weighted imaging (DWI), challenges remain such as a lack of sufficient labeled data for training deep learning models and failure in detecting small lesions. In this paper, we propose BBox-Guided Segmentor, a method that significantly improves the accuracy of stroke lesion segmentation by leveraging expert knowledge. Specifically, our model uses a very coarse bounding box label provided by the expert and then performs accurate segmentation automatically. The small overhead of having the expert provide a rough bounding box leads to large performance improvement in segmentation, which is paramount to accurate stroke diagnosis. To train our model, we employ a weakly-supervised approach that uses a large number of weakly-labeled images with only bounding boxes and a small number of fully labeled images. The scarce fully labeled images are used to train a generator segmentation network, while adversarial training is used to leverage the large number of weakly-labeled images to provide additional learning signals. We evaluate our method extensively using a unique clinical dataset of 99 fully labeled cases (i.e., with full segmentation map labels) and 831 weakly labeled cases (i.e., with only bounding box labels), and the results demonstrate the superior performance of our approach over state-of-the-art stroke lesion segmentation models. We also achieve competitive performance as a SOTA fully supervised method using less than one-tenth of the complete labels. Our proposed approach has the potential to improve stroke diagnosis and treatment planning, which may lead to better patient outcomes.
KW - Adversarial learning
KW - Bounding box
KW - Efficient annotation
KW - Lesion segmentation
KW - Stroke
KW - Weakly supervised
KW - Image Processing, Computer-Assisted
KW - Humans
KW - Diffusion Magnetic Resonance Imaging
KW - Stroke/diagnostic imaging
UR - http://www.scopus.com/inward/record.url?scp=85154043642&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85154043642&partnerID=8YFLogxK
U2 - 10.1016/j.compmedimag.2023.102236
DO - 10.1016/j.compmedimag.2023.102236
M3 - Article
C2 - 37146318
AN - SCOPUS:85154043642
SN - 0895-6111
VL - 107
SP - 102236
JO - Computerized Medical Imaging and Graphics
JF - Computerized Medical Imaging and Graphics
M1 - 102236
ER -