PlaqueViT: a vision transformer model for fully automatic vessel and plaque segmentation in coronary computed tomography angiography

Journal article, 2025

ObjectivesTo develop and evaluate a deep learning model for segmentation of the coronary artery vessels and coronary plaques in coronary computed tomography angiography (CCTA).Materials and methodsCCTA image data from the Swedish CardioPulmonary BioImage Study (SCAPIS) was used for model development (n = 463 subjects) and testing (n = 123) and for an interobserver study (n = 65). A dataset from Link & ouml;ping University Hospital (n = 28) was used for external validation. The model's ability to detect coronary artery disease (CAD) was tested in a separate SCAPIS dataset (n = 684). A deep ensemble (k = 6) of a customized 3D vision transformer model was used for voxelwise classification. The Dice coefficient, the average surface distance, Pearson's correlation coefficient, analysis of segmented volumes by intraclass correlation coefficient (ICC), and agreement (sensitivity and specificity) were used to analyze model performance.ResultsPlaqueViT segmented coronary plaques with a Dice coefficient = 0.55, an average surface distance = 0.98 mm and ICC = 0.93 versus an expert reader. In the interobserver study, PlaqueViT performed as well as the expert reader (Dice coefficient = 0.51 and 0.50, average surface distance = 1.31 and 1.15 mm, ICC = 0.97 and 0.98, respectively). PlaqueViT achieved 88% agreement (sensitivity 97%, specificity 76%) in detecting any coronary plaque in the test dataset (n = 123) and 89% agreement (sensitivity 95%, specificity 83%) in the CAD detection dataset (n = 684).ConclusionWe developed a deep learning model for fully automatic plaque detection and segmentation that identifies and delineates coronary plaques and the arterial lumen with similar performance as an experienced reader.Key PointsQuestionA tool for fully automatic and voxelwise segmentation of coronary plaques in coronary CTA (CCTA) is important for both clinical and research usage of the CCTA examination.FindingsSegmentation of coronary artery plaques by PlaqueViT was comparable to an expert reader's performance.Clinical relevanceThis novel, fully automatic deep learning model for voxelwise segmentation of coronary plaques in CCTA is highly relevant for large population studies such as the Swedish CardioPulmonary BioImage Study.Key PointsQuestionA tool for fully automatic and voxelwise segmentation of coronary plaques in coronary CTA (CCTA) is important for both clinical and research usage of the CCTA examination.FindingsSegmentation of coronary artery plaques by PlaqueViT was comparable to an expert reader's performance.Clinical relevanceThis novel, fully automatic deep learning model for voxelwise segmentation of coronary plaques in CCTA is highly relevant for large population studies such as the Swedish CardioPulmonary BioImage Study.Key PointsQuestionA tool for fully automatic and voxelwise segmentation of coronary plaques in coronary CTA (CCTA) is important for both clinical and research usage of the CCTA examination.FindingsSegmentation of coronary artery plaques by PlaqueViT was comparable to an expert reader's performance.Clinical relevanceThis novel, fully automatic deep learning model for voxelwise segmentation of coronary plaques in CCTA is highly relevant for large population studies such as the Swedish CardioPulmonary BioImage Study.