MR图像预测CT图像研究进展

doi:10.13491/j.issn.1004-714X.2021.03.021

2021, Vol. 30

Issue (3): 366-370 DOI: 10.13491/j.issn.1004-714X.2021.03.021

Review Articles

Current Issue | Archive | Adv Search

Research progress of MR imaging for prediction of CT imaging

XI Qianyi^1,2,3, XIE Kai^2,3, GAO Liugang^2,3, SUN Jiawei^2,3, NI Xinye^2,3, JIAO Zhuqing¹

1. School of Microelectronics and Control Engineering, Changzhou University, Changzhou 213164 China;
2. Department of Radiotherapy the Second People's Hospital of Changzhou Affiliated to Nanjing Medical University, Changzhou 213003 China;
3. Central Laboratory of Medical Physics, Nanjing Medical University, Changzhou 213003 China

Abstract
Figure/Table
References (0)
Related Citation (15)

Download: PDF (502 KB) HTML ( )
Export: BibTeX | EndNote (RIS)

Abstract Medical images can provide clinicans with accurate and comprehensive patients’ information. Morphological or functional abnormalities caused by various diseases can be manifested in many aspects. Although MR images and CT images can highlight the medical image data of different tissue structures of patients, single MR images or CT images cannot fully reflect the complexity of diseases. Using MR image to predict CT image is one of the cross-modal prediction of medical images. In this paper, the methods of MR image prediction for CTmage are classified into four categoriesincluding registration based on atlas, based on image segmentationmethod, based on learning method and based on deep learning method. In our research, we concluded that the method based on deep learning should bemore promoted in the future by compering the existing problems and future development of MR image predicting CT image method.

Key words： Cross-modal Prediction Atlas Image Segmentation T Deep Learning

Received: 28 January 2021

PACS:

R812

	Service

	E-mail this article
	Add to my bookshelf
	Add to citation manager
	E-mail Alert
	RSS
	Articles by authors
	XI Qianyi
	XIE Kai
	GAO Liugang
	SUN Jiawei
	NI Xinye
	JIAO Zhuqing

Cite this article:

XI Qianyi,XIE Kai,GAO Liugang, et al. Research progress of MR imaging for prediction of CT imaging[J]. , 2021, 30(3): 366-370.

URL:

http://www.zgfsws.com/EN/10.13491/j.issn.1004-714X.2021.03.021 OR http://www.zgfsws.com/EN/Y2021/V30/I3/366

[1] 董国亚, 宋立明, 李雅芬, 等. 基于深度学习的跨模态医学图像转换[J]. 中国医学物理学杂志,2020,37(10):1335-1339. DOI: 10.3969/j.issn.1005-202X.2020.10.021
Dong GY, Song LM, Li YF, et al. Cross-modality medical image synthesis based on deep learning[J]. Chin J Med Phys, 2020, 37(10): 1335-1339. DOI: 10.3969/j.issn.1005-202X.2020.10.021
[2] Karen S. Caldemeyer, Kenneth A. Buckwalter. The basic principles of computed tomography and magnetic resonance imaging[J]. J Am Acad Dermatol, 1999, 41(5): 768-771
[3] 侯超. 对核磁共振的成像原理及临床应用研究[J]. 影像研究与医学应用,2017,1(9):25-26. DOI: 10.3969/j.issn.2096-3807.2017.09.015
Hou C. Imaging principle and clinical application of nuclear magnetic resonance imaging[J]. J Imaging Res Med Appl, 2017, 1(9): 25-26. DOI: 10.3969/j.issn.2096-3807.2017.09.015
[4] Miller MI, Christensen GE, Amit Y, et al. Mathematical textbook of deformable neuroanatomies[J]. Proc Natl Acad Sci USA, 1993, 90(24): 11944-11948. DOI: 10.1073/pnas.90.24.11944
[5] Burgos N, Cardoso MJ, Thielemans K, et al. Attenuation correction synthesis for hybrid PET-MR scanners: application to brain studies[J]. IEEE Trans Med Imaging, 2014, 33(12): 2332-2341. DOI: 10.1109/tmi.2014.2340135
[6] Burgos N, Guerreiro F, McClelland J, et al. Iterative framework for the joint segmentation and CT synthesis of MR images: application to MRI-only radiotherapy treatment planning[J]. Phys Med Biol, 2017, 62(11): 4237-4253. DOI: 10.1088/1361-6560/aa66bf
[7] Arabi H, Zaidi H. Magnetic resonance imaging-guided attenuation correction in whole-body PET/MRI using a sorted atlas approach[J]. Med Image Anal, 2016, 31: 1-15. DOI: 10.1016/j.media.2016.02.002
[8] Torrado-Carvajal A, Herraiz JL, Alcain E, et al. Fast patch-based pseudo-CT synthesis from T1-weighted MR images for PET/MR attenuation correction in brain studies[J]. J Nucl Med, 2016, 57(1): 136-143. DOI: 10.2967/jnumed.115.156299
[9] 谢凯, 陆正大, 李春迎, 等. 医学图像合成方法研究进展[J]. 中国医学影像技术,2020,36(12):1903-1906. DOI: 10.13929/j.issn.1003-3289.2020.12.031
Xie K, Lu ZD, Li CY, et al. Research progresses of medical image synthesis methods[J]. Chin J Med Imaging Technol, 2020, 36(12): 1903-1906. DOI: 10.13929/j.issn.1003-3289.2020.12.031
[10] Jog A, Carass A, Prince JL. Improving magnetic resonance resolution with supervised learning[J]. Proc IEEE Int Symp Biomed Imaging, 2014, 2014: 987-990. DOI: 10.1109/ISBI.2014.6868038
[11] Andreasen D, Edmund JM, Zografos V, et al. Computed tomography synthesis from magnetic resonance images in the pelvis using multiple random forests and auto-context features[C]//San Diego: Medical Imaging 2016: Image Processing, 2016. DOI: 10.1117/12.2216924.
[12] Huynh T, Gao YZ, Kang JY, et al. Estimating CT image from MRI data using structured random forest and auto-context model[J]. IEEE Trans Med Imaging, 2016, 35(1): 174-183. DOI: 10.1109/TMI.2015.2461533
[13] Yang XF, Lei Y, Shu HK, et al. Pseudo CT estimation from MRI using patch-based random forest[C]//Orlando, Florida, USA. Medical Imaging 2017: Image Processing. DOI: 10.1117/12.2253936.
[14] Lei Y, Jeong JJ, Wang TH, et al. MRI-based pseudo CT synthesis using anatomical signature and alternating random forest with iterative refinement model[J]. J Med Imaging (Bellingham), 2018, 5(4): 043504. DOI: 10.1117/1.JMI.5.4.043504
[15] Mahanta LB, Hussain E, Das N, et al. IHC-Net: a fully convolutional neural network for automated nuclear segmentation and ensemble classification for Allred scoring in breast pathology[J]. Appl Soft Comput, 2021, 103: 107136. DOI: 10.1016/j.asoc.2021.107136
[16] Lecun Y, Bengio Y, Hinton G. Deep learning[J]. Nature, 2015, 521(7553): 436-444. DOI: 10.1038/nature14539
[17] Li J Jia JJ, Xu DL. Unsupervised representation learning of image-based plant disease with deep convolutional generative adversarial networks[C]//第37届中国控制会议论文集. 武汉:中国自动化学会控制理论专业委员会, 2018: 587-591.
[18] Kaiser B, Albarqouni S. MRI to CT Translation with GANs[J]. 2019.
[19] Nie D, Trullo R, Lian J, et al. Medical image synthesis with context-aware generative adversarial networks[C]//Med Image Comput Comput Assist Interv, 2017, 10435:417-425. DOI: 10.1007/978-3-319-66179-7_48.
[20] Nie D, Cao X, Gao Y, et al. Estimating CT image from MRI data using 3D fully convolutional networks[J]. Deep Learn Data Label Med Appl, 2016, 2016: 170-178. DOI: 10.1007/978-3-319-46976-8_18
[21] Wolterink JM, Dinkla AM, Savenije MHF, et al. Deep MR to CT synthesis using unpaired data[M]//Simulation and Synthesis in Medical Imaging. Cham: Springer International Publishing, 2017: 14-23. DOI: 10.1007/978-3-319-68127-6_2.
[22] Han X. MR-based synthetic CT generation using a deep convolutional neural network method[J]. Med Phys, 2017, 44(4): 1408-1419. DOI: 10.1002/mp.12155
[23] Chen SP, Qin A, Zhou DY, et al. Technical Note: U-net-generated synthetic CT images for magnetic resonance imaging-only prostate intensity-modulated radiation therapy treatment planning[J]. Med Phys, 2018, 45(12): 5659-5665. DOI: 10.1002/mp.13247
[24] Badrinarayanan V, Kendall A, Cipolla R. SegNet: a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Trans Pattern Anal Mach Intell, 2017, 39(12): 2481-2495. DOI: 10.1109/TPAMI.2016.2644615
[25] 周沛, 陈后金, 于泽宽, 等. 跨模态医学图像预测综述[J]. 电子学报,2019,47(1):220-226. DOI: 10.3969/j.issn.0372-2112.2019.01.029
Zhou P, Chen HJ, Yu ZK, et al. Review of cross-modality medical image prediction[J]. Acta Electron Sin, 2019, 47(1): 220-226. DOI: 10.3969/j.issn.0372-2112.2019.01.029
[26] 王海鹏, 樊馨, 贠明凯, 等. PET/MRI衰减校正技术研究进展[J]. 中国医学影像技术,2014,30(2):295-299. DOI: 10.13929/j.1003-3289.2014.02.025
Wang HP, Fan X, Yun MK, et al. Developments of attenuation correction for PET/MRI[J]. Chin J Med Imaging Technol, 2014, 30(2): 295-299. DOI: 10.13929/j.1003-3289.2014.02.025
[27] 吴艺超. 基于多模态的医学图像分割关键技术研究[D]. 杭州: 浙江大学, 2020.
Wu YC. Research on key techniques of medical image segmentation based on multimodality[D]. Hangzhou: Zhejiang University, 2020.
[28] 李梓萌. 脑部MRI图像的分割与识别[D]. 长春: 吉林大学, 2020.
Li ZM. Segmentation and recognition of brain MRI images[D]. Changchun: Jilin University, 2020.
[29] Krinidis S, Chatzis V. A robust fuzzy local information C-Means clustering algorithm[J]. IEEE Trans Image Process, 2010, 19(5): 1328-1337. DOI: 10.1109/TIP.2010.2040763
[30] Ortiz A, Gorriz JM, Ramirez J, et al. Improving MR brain image segmentation using self-organising maps and entropy-gradient clustering[J]. Inf Sci, 2014, 262: 117-136. DOI: 10.1016/j.ins.2013.10.002
[31] Hsu SH, Cao Y, Huang K, et al. Investigation of a method for generating synthetic CT models from MRI scans of the head and neck for radiation therapy[J]. Phys Med Biol, 2013, 58(23): 8419-8435. DOI: 10.1088/0031-9155/58/23/8419
[32] 何小海, 梁子飞, 唐晓颖, 等. 图谱法脑部MRI图像自动分割技术发展及应用[J]. 数据采集与处理,2015,30(5):956-964. DOI: 10.16337/j.1004-9037.2015.05.005
He XH, Liang ZF, Tang XY, et al. Development and application for atlas-based brain MRI image segmentation technology[J]. J Data Acquis Process, 2015, 30(5): 956-964. DOI: 10.16337/j.1004-9037.2015.05.005
[33] Su KH, Hu LZ, Stehning C, et al. Generation of brain pseudo-CTs using an undersampled, single-acquisition UTE-mDixon pulse sequence and unsupervised clustering[J]. Med Phys, 2015, 42(8): 4974-4986. DOI: 10.1118/1.4926756
[34] Zhu JY, Park T, Isola P, et al. Unpaired image-to-image translation using cycle-consistent adversarial networks[C]//2017 IEEE International Conference on Computer Vision (ICCV). Venice:IEEE, 2017: 2242-2251. DOI: 10.1109/ICCV.2017.244.
[35] Bi L, Kim J, Kumar A, et al. Synthesis of positron emission tomography (PET) images via multi-channel generative adversarial networks (GANs)[C]//Mol Imaging Reconstr Anal Mov Body Organs Stroke Imaging Treat, 2017: 43-51. DOI: 10.1007/978-3-319-67564-0_5.