论文标题
使用带有变压器层的杂化CNN在MRI中的关节肝脏和肝病变分割
Joint Liver and Hepatic Lesion Segmentation in MRI using a Hybrid CNN with Transformer Layers
论文作者
论文摘要
由于每年肝癌的发病率增加,因此对肝脏和肝病变的深度分割在临床实践中稳步增长。尽管在过去的几年中成功开发了各种具有整体有希望的结果的网络变体,但几乎所有的网络都在磁共振成像(MRI)中精确分割肝病变的挑战而挣扎。这导致了结合基于卷积和变压器架构的要素以克服现有局限性的想法。这项工作提出了一个称为SWTR-UNET的混合网络,该网络由预告片的重置,变压器块以及常见的UNET式解码器路径组成。该网络主要应用于单模式非对比度增强肝脏MRI,除了公开可用的计算机断层扫描(CT)数据的肝肿瘤分割(LITS)挑战以验证其他方式上的适用性。为了进行更广泛的评估,实施和应用了多个最先进的网络,以确保直接可比性。此外,进行了相关性分析和消融研究,以研究对提出方法的分割精度的各种影响因素。 With Dice scores of averaged 98+-2% for liver and 81+-28% lesion segmentation on the MRI dataset and 97+-2% and 79+-25%, respectively on the CT dataset, the proposed SWTR-Unet proved to be a precise approach for liver and hepatic lesion segmentation with state-of-the-art results for MRI and competing accuracy in CT imaging.发现所达到的分割精度与手动执行的专家分割相当,如肝脏病变分割的观察者间变异性所示。总之,提出的方法可以节省临床实践中的宝贵时间和资源。
Deep learning-based segmentation of the liver and hepatic lesions therein steadily gains relevance in clinical practice due to the increasing incidence of liver cancer each year. Whereas various network variants with overall promising results in the field of medical image segmentation have been successfully developed over the last years, almost all of them struggle with the challenge of accurately segmenting hepatic lesions in magnetic resonance imaging (MRI). This led to the idea of combining elements of convolutional and transformer-based architectures to overcome the existing limitations. This work presents a hybrid network called SWTR-Unet, consisting of a pretrained ResNet, transformer blocks as well as a common Unet-style decoder path. This network was primarily applied to single-modality non-contrast-enhanced liver MRI and additionally to the publicly available computed tomography (CT) data of the liver tumor segmentation (LiTS) challenge to verify the applicability on other modalities. For a broader evaluation, multiple state-of-the-art networks were implemented and applied, ensuring a direct comparability. Furthermore, correlation analysis and an ablation study were carried out, to investigate various influencing factors on the segmentation accuracy of the presented method. With Dice scores of averaged 98+-2% for liver and 81+-28% lesion segmentation on the MRI dataset and 97+-2% and 79+-25%, respectively on the CT dataset, the proposed SWTR-Unet proved to be a precise approach for liver and hepatic lesion segmentation with state-of-the-art results for MRI and competing accuracy in CT imaging. The achieved segmentation accuracy was found to be on par with manually performed expert segmentations as indicated by inter-observer variabilities for liver lesion segmentation. In conclusion, the presented method could save valuable time and resources in clinical practice.