Self-supervised CT super-resolution with hybrid model

被引:18
作者
Zhang, Zhicheng [1 ,3 ]
Yu, Shaode [2 ]
Qin, Wenjian [3 ]
Liang, Xiaokun [3 ]
Xie, Yaoqin [3 ]
Cao, Guohua [4 ]
机构
[1] Stanford Univ, Dept Radiat Oncol, Stanford, CA 94305 USA
[2] Commun Univ China, Coll Informat & Commun Engn, Beijing 100024, Peoples R China
[3] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Guangdong, Peoples R China
[4] Virginia Polytech Inst & State Univ, Blacksburg, VA 24061 USA
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Computed tomography; Super resolution; Self-supervised; Hybrid model; IMAGE QUALITY ASSESSMENT; ITERATIVE RECONSTRUCTION;
D O I
10.1016/j.compbiomed.2021.104775
中图分类号
Q [生物科学];
学科分类号
090105 [作物生产系统与生态工程];
摘要
Software-based methods can improve CT spatial resolution without changing the hardware of the scanner or increasing the radiation dose to the object. In this work, we aim to develop a deep learning (DL) based CT super resolution (SR) method that can reconstruct low-resolution (LR) sinograms into high-resolution (HR) CT images. We mathematically analyzed imaging processes in the CT SR imaging problem and synergistically integrated the SR model in the sinogram domain and the deblur model in the image domain into a hybrid model (SADIR). SADIR incorporates the CT domain knowledge and is unrolled into a DL network (SADIR-Net). The SADIR-Net is a self-supervised network, which can be trained and tested with a single sinogram. SADIR-Net was evaluated through SR CT imaging of a Catphan700 physical phantom and a real porcine phantom, and its performance was compared to the other state-of-the-art (SotA) DL-based CT SR methods. On both phantoms, SADIR-Net obtains the highest information fidelity criterion (IFC), structure similarity index (SSIM), and lowest root-mean-square error (RMSE). As to the modulation transfer function (MTF), SADIR-Net also obtains the best result and improves the MTF50% by 69.2% and MTF10% by 69.5% compared with FBP. Alternatively, the spatial resolutions at MTF50% and MTF10% from SADIR-Net can reach 91.3% and 89.3% of the counterparts reconstructed from the HR sinogram with FBP. The results show that SADIR-Net can provide performance comparable to the other SotA methods for CT SR reconstruction, especially in the case of extremely limited training data or even no data at all. Thus, the SADIR method could find use in improving CT resolution without changing the hardware of the scanner or increasing the radiation dose to the object.
引用
收藏
页数:10
相关论文
共 58 条
[21]
Recent and Upcoming Technological Developments in Computed Tomography High Speed, Low Dose, Deep Learning, Multienergy [J].
Lell, Michael M. ;
Kachelriess, Marc .
INVESTIGATIVE RADIOLOGY, 2020, 55 (01) :8-19
[22]
Li BK, 2020, EXPERT REV MOL DIAGN, V20, P293, DOI [10.1080/22221751.2020.1750307, 10.1080/14737159.2020.1714439]
[23]
Li N., MED IMAGE ANAL
[24]
Enhanced Deep Residual Networks for Single Image Super-Resolution [J].
Lim, Bee ;
Son, Sanghyun ;
Kim, Heewon ;
Nah, Seungjun ;
Lee, Kyoung Mu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1132-1140
[25]
MRI Super-Resolution With Ensemble Learning and Complementary Priors [J].
Lyu, Qing ;
Shan, Hongming ;
Wang, Ge .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 :615-624
[26]
Effect of Ultra High-Resolution Computed Tomography and Model-Based Iterative Reconstruction on Detectability of Simulated Submillimeter Artery [J].
Morisaka, Hiroyuki ;
Shimizu, Yuta ;
Adachi, Takuya ;
Fukushima, Keita ;
Arai, Takahiro ;
Yamamura, Wataru ;
Koyanagi, Masamichi ;
Kariyasu, Toshiya ;
Machida, Haruhiko ;
Sano, Katsuhiro ;
Yokoyama, Kenichi ;
Ichikawa, Tomoaki .
JOURNAL OF COMPUTER ASSISTED TOMOGRAPHY, 2020, 44 (01) :32-36
[27]
Relaxed Linearized Algorithms for Faster X-Ray CT Image Reconstruction [J].
Nien, Hung ;
Fessler, Jeffrey A. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (04) :1090-1098
[28]
Recent and Future Directions in CT Imaging [J].
Pelc, Norbert J. .
ANNALS OF BIOMEDICAL ENGINEERING, 2014, 42 (02) :260-268
[29]
Fields of Experts [J].
Roth, Stefan ;
Black, Michael J. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2009, 82 (02) :205-229
[30]
Sankaraiah Y.R., 2018, ICPCSI, P2032