Review on Detecting Pneumonia in Deep Learning
Article Sidebar
Main Article Content
Abstract
Deep learning is a machine learning technique that has been optimized for image classification and object detection. Deep learning has brought huge advancement to the medical field as it helps to diagnose various diseases through computed tomography (CT) scan or X-ray images. Pneumonia is a respiratory disease, and it is one of the killer diseases that causes numerous death all around the world. In 2019, the outbreak of COVID-19 has increased the number of pneumonia patients tremendously. With the increasing number of patients, the clinical and medical facilities have become insufficient. The lack of doctors and radiologists to diagnose pneumonia has caused a high number of patients to be misdiagnosed. Chest image is one of the most effective methods to diagnose this disease, however, examining the X-ray or CT images requires specialists such as radiologists. Meanwhile, examining chest CT or X-ray images might be subjective as the presence of pneumonia can be unclear in the images. The main objective of this paper is to provide a comprehensive review of recent advancement in the diagnosis of pneumonia with deep learning, including state-of-art methodology, datasets, discussion, challenges, and future improvements.
[Manuscript received: 22 December 2023 | Accepted: 21 February 2024 | Published: : 30 April 2024]
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
B. Dadonaite, and M. Roser, “Pneumonia,” OurWorldInData.org [Online]. Nov 2019. Available https://ourworldindata.org/pneumonia
O. Ruuskanen, E. Lahti, L. C. Jennings, D. R. Murdoch, “Viral Pneumonia,” The Lancet, vol. 377, no. 9773, pp. 1264-1275, 2011, doi: 10.1016/S0140-6736(10)61459-6.
A. Torres, C. Cilloniz, M. S. Niederman, R. Menéndez, J. D. Chalmers, R. G. Wunderink, and T. van der Poll, “Pneumonia,” Nat Rev Dis Primers, doi: 10.1038/s41572-021-00259-0.
A. Elengoe, “COVID-19 Outbreak in Malaysia,” Osong Public Health and Research Perspectives, vol. 11, no. 3, pp. 93-100, 2020, doi: 10.24171/j.phrp.2020.11.3.08.
World Health Organization, “WHO Coronavirus (COVID-19) Dashboard,” September 2023. [Online]. Available: https://covid19.who.int
S. Sharma, and K. Guleria, “A Deep Learning based model for the Detection of Pneumonia from Chest X-Ray Images using VGG-16 and Neural Networks,” Procedia Computer Science, vol. 218, pp. 357-366, 2023, doi: 10.1016/j.procs.2023.01.018.
M. Javaid, A. Haleem, R. P. Singh, R. Suman, and S. Rab, “Significance of machine learning in healthcare: Features, pillars and applications,” International Journal of Intelligent Networks, vol. 3, pp. 58-73, 2022, doi: 10.1016/j.ijin.2022.05.002.
A. Saxe, S. Nelli, and C. Summerfield, “If deep learning is the answer, what is the question?,” Nat Rev Neurosci, vol. 22, pp. 55–67, 2021, doi: 10.1038/s41583-020-00395-8.
S. S. Yadav, and S. M. Jadhav, “Deep convolutional neural network based medical image classification for disease diagnosis,” Journal of Big Data, vol. 6, pp. 113, 2019, doi: 10.1186/s40537-019-0276-2.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” Journal Article, vol. 60, no. 6, pp. 84-90, 2017, doi: 10.1145/3065386.
F. Chollet, “Xception: Deep Learning with Depthwise Separable Convolutions,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251-1258, 2017, doi: 10.48550/arXiv.1610.02357.
K. Simonyan, and A. Zisserman, “Very Deep Convolutional Networks for Large-Scale Image Recognition,” arXiv preprint arXiv:1409.1556, 2014, doi: 10.48550/arXiv.1409.1556.
G. Huang, Z. Liu, L. V. D. Maaten, and K. Q. Weiberger, “Densely Connected Convolutional Networks,” Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, doi: 10.48550/arXiv.1608.06993.
K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," 2016 IEEE Conference on Computer Vision and Pattern Recognition, pp. 770-778, 2016, doi: 10.1109/CVPR.2016.90.
D. Varshni, K. Thakral, L. Agarwal, R. Nijhawan, and A. Mittal, "Pneumonia Detection Using CNN based Feature Extraction," 2019 IEEE International Conference on Electrical, Computer and Communication Technologies, 2019, pp. 1-7, doi: 10.1109/ICECCT.2019.8869364.
S. P, and A. V. A. Mary, "A Comprehensive study on the Detection of Pneumonia using Machine Learning and Deep Learning Approaches," 2023 International Conference on Advancement in Computation & Computer Technologies, pp. 233-237, 2023, doi: 10.1109/InCACCT57535.2023.10141758.
S. Bharati, P. Podder, M. R. H. Mondal, and V. B. S. Prasath, “Medical Imaging with Deep Learning for COVID- 19 Diagnosis: A Comprehensive Review,” arXiv e-prints, 2021, doi: 10.48550/arXiv.2107.09602.
L. Racic, T. Popovic, S. cakic, and S. Sandi, "Pneumonia Detection Using Deep Learning Based on Convolutional Neural Network," 2021 25th International Conference on Information Technology, pp. 1-4, 2021, doi: 10.1109/IT51528.2021.9390137.
S. Christin, É. Hervet, and N. Lecomte, “Applications for deep learning in ecology,” Methods Ecol Evol, vol. 10, pp. 1632-1644, 2019, doi: 10.1111/2041-210X.13256.
W. Nash, T. Drummond, and N. Birbilis, “A review of deep learning in the study of materials degradation,” npj Mater Degrad, vol. 2, 2018, doi: 10.1038/s41529-018-0058-x.
Z. Zhang, Y. Zhao, X. Liao, W. Shi, K. Li, Q. Zou, and S. Peng, “Deep learning in omics: a survey and guideline,” Briefings in Functional Genomics, vol. 18, pp. 41-57, 2019, doi: 10.1093/bfgp/ely030.
R. Yamashita, M. Nishio, R. K. G. Do, and K. Togashi, “Convolutional neural networks: an overview and application in radiology,” Insights Imaging, vol. 9, pp. 611–629, 2018, doi: 10.1007/s13244-018-0639-9.
Y. Sun, B. Xue, M. Zhang, and G. G. Yen, "Completely Automated CNN Architecture Design Based on Blocks," IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 4, pp. 1242-1254, 2020, doi: 10.1109/TNNLS.2019.2919608.
Y. Sun, B. Xue, M. Zhang, G. G. Yen, and J. Lv, “Automatically Designing CNN Architectures Using the Genetic Algorithm for Image Classification,” IEEE Transactions on Cybernetics, vol. 50, no. 9, pp. 3840-3854, 2020, doi: 10.1109/TCYB.2020.2983860.
W. Hao, W. Yizhou, L. Yaqin, and S. Zhili, “The Role of Activation Function in CNN,” 2020 2nd International Conference on Information Technology and Computer Application, pp. 429-432, 2022, doi: 10.1109/ITCA52113.2020.00096.
Y. Wang, Y. Li, Y. Song, and X. Rong, “The Influence of the Activation Function in a Convolution Neural Network Model of Facial Expression Recognition,” Applied Sciences, vol. 10, no. 5, pp. 1897, 2020, doi: 10.3390/app10051897.
A. Mazouz, and C. P. Bridges, “Automated CNN back-propagation pipeline generation for FPGA online training,” J Real-Time Image Proc, vol. 18, pp. 2583–2599, 2021, doi: 10.1007/s11554-021-01147-2.
V. H. Phung, and E. J. Rhee, “A High-Accuracy Model Average Ensemble of Convolutional Neural Networks for Classification of Cloud Image Patches on Small Datasets,” Applied Sciences, vol. 9, no. 21, pp. 4500, 2019, doi: 10.3390/app9214500.
T. Gabruseva, D. Poplavskiy, and A. Kalinin, “Deep Learning for Automatic Pneumonia Detection,” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pp. 350-351, 2020, doi: 10.1109/CVPRW50498.2020.00183.
P. Rajpurkar, J. Irvin, K. Zhu, B. Yang, H. Mehta, T. Duan, D. Ding, A. Bagul, C. Langlotz, K. Shpanskaya, M. P. Lungren, and A. Y. Ng, “CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning,” arXiv e-prints, 2017, doi:10.48550/arXiv.1711.05225.
D. Varshni, K. Thakral, L. Agarwal, R. Nijhawan, and A. Mittal, "Pneumonia Detection Using CNN based Feature Extraction," 2019 IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT), pp. 1-7, 2019, doi: 10.1109/ICECCT.2019.8869364.
A. Vahab, M. S. Naik, P. G. Raikar, and P. S. R, “Applications of object detection system,” International Research Journal of Engineering and Technology (IRJET), vol. 6, no. 4, pp. 4186-4192, 2019.
A. O. Vuola, S. U. Akram, and J. Kannala, “Mask-RCNN and U-Net Ensembled for Nuclei Segmentation,” 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), pp. 208-212, 2019, doi: 10.1109/ISBI.2019.8759574.
A. K. Jaiswal, P. Tiwari, S. Kumar, D. Gupta, A. Khanna, and J. J. P. C. Rodrigues, “Identifying pneumonia in chest X-rays: A deep learning approach,” Measurement, vol. 145, pp. 511-518, 2019, doi: 10.1016/j.measurement.2019.05.076.
N. Siddique, S. Paheding, C. P. Elkin, and V. Devabhaktuni, “U-Net and Its Variants for Medical Image Segmentation: A Review of Theory and Applications,” IEEE Access, vol. 9, pp. 82031-82057, 2021, doi: 10.1109/ACCESS.2021.3086020.
A. Pant, A. Jain, K. C. Nayak, D. Gandhi, and B. G. Prasad, “Pneumonia Detection: An Efficient Approach Using Deep Learning,” 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), pp. 1-6, 2020, doi: 10.1109/ICCCNT49239.2020.9225543.
E. Ayan, and H. M. Ünver, “Diagnosis of Pneumonia from Chest X-Ray Images Using Deep Learning,” 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT), pp. 1-5, 2019, doi: 10.1109/EBBT.2019.8741582.
R. Kundu, R. Das, Z. W. Geem, G. T. Han, and R. Sarkar, “Pneumonia detection in chest X-ray images using an ensemble of deep learning models,” PloS one, vol. 16, no. 9, 2021, doi: 10.1371/journal.pone.0256630.
S. Sakib, N. Ahmed, A. J. Kabir, H. Ahmed, “An Overview of Convolutional Neural Network: Its Architecture and Applications,” Preprints, 2018, doi: 10.20944/preprints201811.0546.v4.
W. O’Quinn, R. J. Haddad, and D. L. Moore, “Pneumonia Radiograph Diagnosis Utilizing Deep Learning Network,” 2019 IEEE 2nd International Conference on Electronic Information and Communication Technology (ICEICT), pp. 763-767, 2019, doi: 10.1109/ICEICT.2019.8846438.
C. J. Saul, D. Y. Urey, and C. D. Taktakoglu, “Early Diagnosis of Pneumonia with Deep Learning,” arXiv e-prints,2019, doi:10.48550/arXiv.1904.00937.
R. Khaldi, A. E. Afia, R. Chiheb, and S. Tabik, “What is the best RNN-cell structure to forecast each time series behavior?,” Expert Systems with Applications, vol. 215, pp. 119140, 2023, doi: 10.1016/j.eswa.2022.119140.
J. Xiao, and Z. Zhou, “Research Progress of RNN Language Model,” 2020 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), pp. 1285-1288, 2020, doi: 10.1109/ICAICA50127.2020.9182390.
F. M. Bianchi, E. Maiorino, M. C. Kampffmeyer, A. Rizzi, and R. Jenssen, “Recurrent Neural Network Architectures,” Recurrent Neural Networks for Short-Term Load Forecasting. SpringerBriefs in Computer Science. Springer, Cham, 2017, doi: 10.1007/978-3- 319-70338-1_3
T. A. Rashid, P. Fattah, and D. K. Awla, “Using Accuracy Measure for Improving the Training of LSTM with Metaheuristic Algorithms”, Procedia Computer Science, vol. 140, pp. 324-333, 2018, doi: 10.1016/j.procs.2018.10.307.
Z. M. Kim, H. Oh, H. G. Kim, C. G. Lim, K. J. Oh, and H. J. Choi, “Modeling long-term human activeness using recurrent neural networks for biometric data,” BMC Med Inform Decis Mak, vol. 17, 2017, doi: 10.1186/s12911-017-0453-1.
S. Minaee, Y. Boykov, F. Porikli, A. Plaza, N. Kehtarnavaz, and D. Terzopoulos, “Image Segmentation Using Deep Learning: A Survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 7, pp. 3523-3542, 2022, doi: 10.1109/TPAMI.2021.3059968.
N. M. Elshennawy, and D. M. Ibrahim, “Deep-Pneumonia Framework Using Deep Learning Models Based on Chest X-Ray Images,” Diagnostics, vol. 10, no. 9, p. 649, Aug. 2020, doi: 10.3390/diagnostics10090649.
K. Shankar, E. Perumal, V. G. Díaz, P. Tiwari, D. Gupta, A. K. J. Saudagar, and K. Muhammad, “An optimal cascaded recurrent neural network for intelligent COVID-19 detection using Chest X-ray images”, Applied Soft Computing, vol. 113, pp. 107878, 2021, doi: 10.1016/j.asoc.2021.107878.
NIH Clinical Center, “NIH Clinical Center provides one of the largest publicly available chest x-ray datasets to scientific community,” NIH [Online], Sept 2017. Available: https://nihcc.app.box.com/v/ChestXray-NIHCC/folder/37178474737
D. Kermany, K. Zhang, and M. Goldbaum, “Labeled Optical Coherence Tomography (OCT) and Chest X-Ray Images for Classification,” Mendeley Data [Online], Jan 2018, doi: 10.17632/rscbjbr9sj.2.
IEEE8023, “covid-chestxray-dataset,” GitHub [Online], Mar 2021. Available: https://github.com/ieee8023/covid-chestxray-dataset.
E. Avsar, “Effects of Image Preprocessing on the Performance of Convolutional Neural Networks for Pneumonia Detection,” 2021 International Conference on Innovations in Intelligent SysTems and Applications (INISTA), pp. 1-5, 2021, doi: 10.1109/INISTA52262.2021.9548351.
C.P. Lee, and K.M. Lim, “COVID-19 Diagnosis on Chest Radiographs with Enhanced Deep Neural Networks”, Diagnostics. 2022, 12, 1828, pp. 1-14. https://doi.org/10.3390/
diagnostics12081828z.
A. Musha, A. A. Mamun, A. Tahabilder, M.J. Hossen, B. Jahan, and S. Ranjbari , “A deep learning approach for COVID-19 and pneumonia detection from chest X-ray images”, International Journal of Electrical and Computer Engineering (IJECE), Vol. 12, No. 4, August 2022, pp. 3655~3664.
J. R. Lee, K. W. Ng, Y. J. Yoong, “Face and Facial Expressions Recognition System for Blind People Using ResNet50 Architecture and CNN”, Journal of Informatics and Web Engineering,2023, Vol. 2, No. 2, pp. 284 – 298.