Self-supervised CT super-resolution with hybrid model

被引:18
作者
Zhang, Zhicheng [1 ,3 ]
Yu, Shaode [2 ]
Qin, Wenjian [3 ]
Liang, Xiaokun [3 ]
Xie, Yaoqin [3 ]
Cao, Guohua [4 ]
机构
[1] Stanford Univ, Dept Radiat Oncol, Stanford, CA 94305 USA
[2] Commun Univ China, Coll Informat & Commun Engn, Beijing 100024, Peoples R China
[3] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Guangdong, Peoples R China
[4] Virginia Polytech Inst & State Univ, Blacksburg, VA 24061 USA
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Computed tomography; Super resolution; Self-supervised; Hybrid model; IMAGE QUALITY ASSESSMENT; ITERATIVE RECONSTRUCTION;
D O I
10.1016/j.compbiomed.2021.104775
中图分类号
Q [生物科学];
学科分类号
090105 [作物生产系统与生态工程];
摘要
Software-based methods can improve CT spatial resolution without changing the hardware of the scanner or increasing the radiation dose to the object. In this work, we aim to develop a deep learning (DL) based CT super resolution (SR) method that can reconstruct low-resolution (LR) sinograms into high-resolution (HR) CT images. We mathematically analyzed imaging processes in the CT SR imaging problem and synergistically integrated the SR model in the sinogram domain and the deblur model in the image domain into a hybrid model (SADIR). SADIR incorporates the CT domain knowledge and is unrolled into a DL network (SADIR-Net). The SADIR-Net is a self-supervised network, which can be trained and tested with a single sinogram. SADIR-Net was evaluated through SR CT imaging of a Catphan700 physical phantom and a real porcine phantom, and its performance was compared to the other state-of-the-art (SotA) DL-based CT SR methods. On both phantoms, SADIR-Net obtains the highest information fidelity criterion (IFC), structure similarity index (SSIM), and lowest root-mean-square error (RMSE). As to the modulation transfer function (MTF), SADIR-Net also obtains the best result and improves the MTF50% by 69.2% and MTF10% by 69.5% compared with FBP. Alternatively, the spatial resolutions at MTF50% and MTF10% from SADIR-Net can reach 91.3% and 89.3% of the counterparts reconstructed from the HR sinogram with FBP. The results show that SADIR-Net can provide performance comparable to the other SotA methods for CT SR reconstruction, especially in the case of extremely limited training data or even no data at all. Thus, the SADIR method could find use in improving CT resolution without changing the hardware of the scanner or increasing the radiation dose to the object.
引用
收藏
页数:10
相关论文
共 58 条
[1]
Abdelhay R. M, ZAGAZIG U MED J, V2021
[2]
[Anonymous], **DATA OBJECT**
[3]
Ex vivo evaluation of an atherosclerotic human coronary artery via histology and high-resolution hard X-ray tomography [J].
Buscema, Marzia ;
Hieber, Simone E. ;
Schulz, Georg ;
Deyhle, Hans ;
Hipp, Alexander ;
Beckmann, Felix ;
Lobrinus, Johannes A. ;
Saxer, Till ;
Mueller, Bert .
SCIENTIFIC REPORTS, 2019, 9 (1)
[4]
Attention-Aware Face Hallucination via Deep Reinforcement Learning [J].
Cao, Qingxing ;
Lin, Liang ;
Shi, Yukai ;
Liang, Xiaodan ;
Li, Guanbin .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1656-1664
[5]
LEARN: Learned Experts' Assessment-Based Reconstruction Network for Sparse-Data CT [J].
Chen, Hu ;
Zhang, Yi ;
Chen, Yunjin ;
Zhang, Junfeng ;
Zhang, Weihua ;
Sun, Huaiqiang ;
Lv, Yang ;
Liao, Peixi ;
Zhou, Jiliu ;
Wang, Ge .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1333-1347
[6]
Sparse representation based computed tomography images reconstruction by coupled dictionary learning algorithm [J].
Deeba, Farah ;
Kun, She ;
Ali Dharejo, Fayaz ;
Zhou, Yuanchun .
IET IMAGE PROCESSING, 2020, 14 (11) :2365-2375
[7]
Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[8]
Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[9]
PCA-SRGAN: Incremental Orthogonal Projection Discrimination for Face Super-resolution [J].
Dou, Hao ;
Chen, Chen ;
Hu, Xiyuan ;
Xuan, Zuxing ;
Hu, Zhisen ;
Peng, Silong .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :1891-1899
[10]
A simple approach to measure computed tomography (CT) modulation transfer function (MTF) and noise-power spectrum (NPS) using the American College of Radiology (ACR) accreditation phantom [J].
Friedman, Saul N. ;
Fung, George S. K. ;
Siewerdsen, Jeffrey H. ;
Tsui, Benjamin M. W. .
MEDICAL PHYSICS, 2013, 40 (05)