AI-Assisted Analysis for Breast Cancer Imaging and Diagnostics
Main Article Content
Abstract
Breast cancer cases have increased by 0.5% each year. X-ray, CT-Scan, and magnetic resonance imaging have been used to detect cancer without harming the patient. However, these methods usually used manual screening to process medical images, which leads to longer processing time and increases the burden on the expert. With the help of deep learning, automation-driven breast cancer detection, segmentation, and explanation can be performed in the process, which can greatly reduce the processing time and the burden on experts. This paper proposed a deep learning model, S-YOLOv11 by combining YOLOv11 with SimAM attention mechanism and a GUI with integration of a large language model. The model is trained with 624 images and tested with 156 images. Several YOLO architectures were compared, including YOLOv8, YOLOv9, YOLOv10, and YOLOv11. The proposed model has outperformed the other models. In the detection task, 0.806 precision, 0.635 recall, and 0.724 mAP were achieved. In the segmentation task, 0.833 precision, 0.65 recall, and 0.739 mAP were achieved. In addition, the study also improved the functionality of the GUI by accessing the ChatGPT API. It is possible to generate medical analysis for breast cancer tumors, with the use of GUI for visualization. However, current research is still in the development stage and it needs to be put into clinical trials before it can be used.
Manuscript received: 3 Jan 2025 | Revised: 20 Feb 2025 | Accepted: 27 Feb 2025 | Published: 31 Mar 2025
Article Details

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
R.L. Siegel, K.D. Miller, N.S. Wagle and A. Jemal, "Cancer statistics, 2023," CA: A Cancer Journal for Clinicians, vol. 73, no. 1, pp. 17-48, 2023.
DOI: https://doi.org/10.3322/caac.21763
H. Gandhi and K. Kumar, “Artificial Intelligence for the Management of Breast Cancer: An Overview,” Current Drug Discovery Technologies, vol. 21, no. 4, Art. no. e031123223115, 2024.
DOI: https://doi.org/10.2174/0115701638262066231030052520
C. Li, L. Li, H. Jiang, K. Weng, Y. Geng, L. Li, Z. Ke, Q. Li, M. Cheng, W. Nie, Y. Li, B. Zhang, Y. Liang, L. Zhou, X. Xu, X. Chu, X. Wei and X. Wei, "YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications," arXiv, 2022.
DOI: https://doi.org/10.48550/arXiv.2209.02976
Y. Zhang, P. Li, Y. Lan, X. Jia, and Y. Lv, “Research on Breast Cancer Detection Methods Based on ODMV-MulDyHead-YOLO,” IEEE Access, 2024.
DOI: https://doi.org/10.1109/ACCESS.2024.3508780
D. Shah, M.A.U. Khan, M. Abrar and M. Tahir, "Optimizing Breast Cancer Detection With an Ensemble Deep Learning Approach," International Journal of Intelligent Systems, vol. 2024, no. 1, 2024.
DOI: https://doi.org/10.1155/2024/5564649
S.R. Kebede, F.G. Waldamichael, T.G. Debelee, M. Aleme, W. Bedane, B. Mezgebu and Z.C. Merga, "Dual view deep learning for enhanced breast cancer screening using mammography," Scientific Reports, vol. 14, no. 1, 2024.
DOI: https://doi.org/10.1038/s41598-023-50797-8
T.A. Toma, S. Biswas, M.S. Miah, M. Alibakhshikenari, B.S. Virdee, S. Fernando, M.H. Rahman, S.M. Ali, F. Arpanaei, M.A. Hossain, M.M. Rahman, M. Niu, N.O. Parchin and P. Livreri, "Breast Cancer Detection Based on Simplified Deep Learning Technique With Histopathological Image Using BreaKHis Database," Radio Science, vol. 58, no. 11, 2023.
DOI: https://doi.org/10.1029/2023RS007761
W. T. Chan, "Review on Present-day Breast Cancer Detection Techniques,"International Journal on Robotics, Automation and Sciences, vol. 6, no. 1, pp. 94–101, 2024.
DOI: https://doi.org/10.33093/ijoras.2024.6.1.13
K. V. Sriram, R. H. Havaldar, "Analytical review and study on object detection techniques in the image,"International Journal of Modeling, Simulation, and Scientific Computing, vol. 12, no. 05, pp. 2150031, 2021.
DOI: https://doi.org/10.1142/S1793962321500318
R. Ye, J. Shao, J. Shao, and J. Ji, “Review of deep learning based target detection algorithm research,” in Proceedings of SPIE, 6th International Conference on Mechatronics and Intelligent Robotics (ICMIR2022), vol. 12301, Art. no. 123011T, 2022
DOI: https://doi.org/10.1117/12.2644526
P. Viola, M. Jones, "Robust real-time face detection,"Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, vol. 2, pp. 747–747, 2001.
DOI: https://doi.org/10.1109/ICCV.2001.937709
N. Dalal, B. Triggs, "Histograms of Oriented Gradients for Human Detection,"2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1, pp. 886–893, 2005.
DOI: https://doi.org/10.1109/CVPR.2005.177
M. Hussain, "YOLO-v1 to YOLO-v8, the Rise of YOLO and Its Complementary Nature toward Digital Manufacturing and Industrial Defect Detection," Machines, vol. 11, no. 7, pp. 677, 2023.
DOI: https://doi.org/10.3390/machines11070677
S. Zahia, D. Sierra-Sosa, B. Garcia-Zapirain and A. Elmaghraby, "Tissue classification and segmentation of pressure injuries using convolutional neural networks," Computer Methods and Programs in Biomedicine, vol. 159, pp. 51-58, 2018.
DOI: https://doi.org/10.1016/j.cmpb.2018.02.018
F. Prinzi, M. Insalaco, A. Orlando, S. Gaglio, and S. Vitabile, “A Yolo-Based Model for Breast Cancer Detection in Mammograms,” Cognitive Computation, vol. 16, pp. 107–120, 2024.
DOI: https://doi.org/10.1007/s12559-023-10189-6
F. Prinzi, M. Insalaco, A. Orlando, S. Gaglio and S. Vitabile, "A Yolo-Based Model for Breast Cancer Detection in Mammograms," Cognitive Computation, vol. 16, no. 1, pp. 107-120, 2024.
DOI: https://doi.org/10.1007/s12559-023-10189-6
P.K. Samanta, A. Basuli, N.K. Rout and G. Panda, "Improved Breast Cancer Detection from Ultrasound Images Using YOLOv8 Model," 2023 IEEE 3rd International Conference on Applied Electromagnetics, Signal Processing, & Communication (AESPC), pp. 1-6, 2023.
DOI: https://doi.org/10.1109/AESPC59761.2023.10390341
H. Gui, T. Su, X. Jiang, L. Li, L. Xiong, J. Zhou and Z. Pang, "FS-YOLOv9: A Frequency and Spatial Feature-Based YOLOv9 for Real-time Breast Cancer Detection," Academic Radiology, vol. 32, no. 3, pp. 1228-1240, 2025.
DOI: https://doi.org/10.1016/j.acra.2024.09.048
L. Zheng, W. Chiang, Y. Sheng, S. Zhuang, Z. Wu, Y. Zhuang, Z. Lin, Z. Li, D. Li, E.P. Xing, H. Zhang, J.E. Gonzalez and I. Stoica, "Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena," arXiv, 2023.
DOI: https://doi.org/10.48550/arXiv.2306.05685
A.Y. Yuan, Y. Gao, L. Peng, L. Zhou, J. Liu, S. Zhu and W. Song, "Hybrid deep learning network for vascular segmentation in photoacoustic imaging," Biomedical Optics Express, vol. 11, no. 11, pp. 6445, 2020.
DOI: https://doi.org/10.1364/BOE.409246
W. Al-Dhabyani, M. Gomaa, H. Khaled and A. Fahmy, "Dataset of breast ultrasound images," Data in Brief, vol. 28, pp. 104863, 2020.
DOI: https://doi.org/10.1016/j.dib.2019.104863
F.F. Ting, Y.J. Tan and K.S. Sim, "Convolutional neural network improvement for breast cancer classification," Expert Systems with Applications, vol. 120, pp. 103-115, 2019.
DOI: https://doi.org/10.1016/j.eswa.2018.11.008
Y. J. Tan, K. S. Sim and F. F. Ting, "Breast cancer detection using convolutional neural networks for mammogram imaging system," 2017 International Conference on Robotics, Automation and Sciences (ICORAS), pp. 1-5, 2017.
DOI: https://doi.org/10.1109/ICORAS.2017.8308076
J.J. Toh and M.S. Sayeed, "Review on Detecting Pneumonia in Deep Learning," International Journal on Robotics, Automation and Sciences, vol. 6, no. 1, pp. 70-77, 2024.
DOI: https://doi.org/10.33093/ijoras.2024.6.1.10
J. Cheng and S. Haw, "Mental Health Problems Prediction Using Machine Learning Techniques," International Journal on Robotics, Automation and Sciences, vol. 5, no. 2, pp. 59-72, 2023.
DOI: https://doi.org/10.33093/ijoras.2023.5.2.7
N.M. Loorutu, H. Yazid and K.S.A. Rahman, "Prostate Cancer Classification Based on Histopathological Images," International Journal on Robotics, Automation and Sciences, vol. 5, no. 2, pp. 43-53, 2023.