Performance Evaluation of YOLO Models in Plant Disease Detection

Main Article Content

Usman Ali
Maizatul Akmar Ismail
Riyaz Ahamed Ariyaluran Habeeb
Syed Roshaan Ali Shah

Abstract

Plant diseases significantly impact global agriculture, leading to substantial production losses and economic consequences. Timely disease detection can enhance crop yield, optimize resource utilization, reduce costs, and mitigate environmental effects, ultimately ensuring high-quality food production. Deep learning, specifically computer vision-based techniques, have proven invaluable in tasks like image classification, segmentation, and object detection. Deep Learning techniques such as You Only Look Once (YOLO) models are state of the art neural network algorithms used for accurate object detection. In this study, YOLOv5, YOLOv7 and YOLOv8 models were trained on CCL’20 dataset for citrus disease detection. Data augmentation techniques such as image translation, image scaling, flip, mosaic augmentations were implemented to improve the models’ performance during training phase. The model performance was evaluated using metric such as Mean Average Precision at 50% to 95% Intersection over Union score i.e. mAP@50-95. The results show that YOLOv8 model performs better than other variants and offers significant improvements over the benchmark performance from previous studies. The final hyper-parameter tuned model achieved 96.1% mAP@50-95 on testing data for citrus disease detection and mAP@50-95 of 95.3%, 96.0% and 97.0% for detection of Anthracnose, Melanose and Bacterial Brown Spot diseases, respectively. The trained model was able to detect single and multiple instances of same or different disease in an image showing the potential of recent YOLO models. The trained YOLOv8 model is deployed on Roboflow platform.

Article Details

How to Cite
Ali, U., Maizatul Akmar Ismail, Riyaz Ahamed Ariyaluran Habeeb, & Syed Roshaan Ali Shah. (2024). Performance Evaluation of YOLO Models in Plant Disease Detection. Journal of Informatics and Web Engineering, 3(2), 199–211. https://doi.org/10.33093/jiwe.2024.3.2.15
Section
Regular issue

References

W. Albattah, M. Nawaz, A. Javed, M. Masood, and S. Albahli, “A novel deep learning method for detection and classification of plant diseases,” Complex and Intelligent Systems, vol. 8, no. 1, pp. 507 – 524, 2022, doi: 10.1007/s40747-021-00536-1.

R. Sujatha, J. M. Chatterjee, N. Jhanjhi, and S. N. Brohi, “Performance of deep learning vs machine learning in plant leaf disease detection,” Microprocess Microsyst, vol. 80, p. 103615, Feb. 2021, doi: 10.1016/j.micpro.2020.103615.

S. K. Balasundram, K. Golhani, R. R. Shamshiri, and G. Vadamalai, “Precision Agriculture Technologies for Management of Plant Diseases,” in PLANT DISEASE MANAGEMENT STRATEGIES FOR SUSTAINABLE AGRICULTURE THROUGH TRADITIONAL AND MODERN APPROACHES, vol. 13, I. UlHaq and S. Ijaz, Eds., in Sustainability in Plant and Crop Protection, vol. 13. , 2020, pp. 259–278. doi: 10.1007/978-3-030-35955-3_13.

I. El Ouadi, “Understanding the Climate-Water-Energy-Food Nexus and the Transition Towards a Circular Economy: The Case of Morocco,” in E3S Web of Conferences, 2023. doi: 10.1051/e3sconf/202336401006.

D. Kumar and P. Kalita, “Reducing Postharvest Losses during Storage of Grain Crops to Strengthen Food Security in Developing Countries,” Foods, vol. 6, no. 1, 2017, doi: 10.3390/foods6010008.

A. Khattak et al., “Automatic Detection of Citrus Fruit and Leaves Diseases Using Deep Neural Network Model,” IEEE Access, vol. 9, pp. 112942–112954, 2021, doi: 10.1109/ACCESS.2021.3096895.

C. R. Rahman et al., “Identification and recognition of rice diseases and pests using convolutional neural networks,” Biosyst Eng, vol. 194, pp. 112–120, Jun. 2020, doi: 10.1016/j.biosystemseng.2020.03.020.

S. Jain et al., “Automatic Rice Disease Detection and Assistance Framework Using Deep Learning and a Chatbot,” Electronics (Basel), vol. 11, no. 14, 2022, doi: 10.3390/electronics11142110.

S. Dananjayan, Y. Tang, J. Zhuang, C. Hou, and S. Luo, “Assessment of state-of-the-art deep learning based citrus disease detection techniques using annotated optical leaf images,” Comput Electron Agric, vol. 193, p. 106658, Feb. 2022, doi: 10.1016/j.compag.2021.106658.

M. Li et al., “High-Performance Plant Pest and Disease Detection Based on Model Ensemble with Inception Module and Cluster Algorithm,” Plants, vol. 12, no. 1, 2023, doi: 10.3390/plants12010200.

J. Du, “Understanding of Object Detection Based on CNN Family and YOLO,” J Phys Conf Ser, vol. 1004, no. 1, p. 12029, Apr. 2018, doi: 10.1088/1742-6596/1004/1/012029.

J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You Only Look Once: Unified, Real-Time Object Detection,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 779–788. doi: 10.1109/CVPR.2016.91.

Y. Huang, Y. Qian, H. Wei, Y. Lu, B. Ling, and Y. Qin, “A survey of deep learning-based object detection methods in crop counting,” Comput Electron Agric, vol. 215, p. 108425, 2023, doi: https://doi.org/10.1016/j.compag.2023.108425.

X. Zhai, Z. Huang, T. Li, H. Liu, and S. Wang, “YOLO-Drone: An Optimized YOLOv8 Network for Tiny UAV Object Detection,” Electronics (Basel), vol. 12, no. 17, 2023, doi: 10.3390/electronics12173664.

V. Devisurya, R. Devi Priya, and N. Anitha, “Early detection of major diseases in turmeric plant using improved deep learning algorithm,” Bulletin of the Polish Academy of Sciences: Technical Sciences, vol. 70, no. 2, 2022, doi: 10.24425/bpasts.2022.140689.

X. Zhang, Y. Xun, and Y. Chen, “Automated identification of citrus diseases in orchards using deep learning,” Biosyst Eng, vol. 223, pp. 249–258, Nov. 2022, doi: 10.1016/j.biosystemseng.2022.09.006.

J. Qi et al., “An improved YOLOv5 model based on visual attention mechanism: Application to recognition of tomato virus disease,” Comput Electron Agric, vol. 194, p. 106780, Mar. 2022, doi: 10.1016/j.compag.2022.106780.

R.-Z. Qiu et al., “An automatic identification system for citrus greening disease (Huanglongbing) using a YOLO convolutional neural network,” Front Plant Sci, vol. 13, 2022, doi: 10.3389/fpls.2022.1002606.

G. Dai and J. Fan, “An Industrial-Grade Solution for Crop Disease Image Detection Tasks,” Front Plant Sci, vol. 13, 2022, doi: 10.3389/fpls.2022.921057.

J. Li, Y. Qiao, S. Liu, J. Zhang, Z. Yang, and M. Wang, “An improved YOLOv5-based vegetable disease detection method,” Comput Electron Agric, vol. 202, p. 107345, Nov. 2022, doi: 10.1016/j.compag.2022.107345.

W. Bao, T. Fan, G. Hu, D. Liang, and H. Li, “Detection and identification of tea leaf diseases based on AX-RetinaNet,” Sci Rep, vol. 12, no. 1, p. 2183, 2022, doi: 10.1038/s41598-022-06181-z.

D. Li, F. Ahmed, N. Wu, and A. I. Sethi, “YOLO-JD: A Deep Learning Network for Jute Diseases and Pests Detection from Images,” Plants, vol. 11, no. 7, 2022, doi: 10.3390/plants11070937.

X. Li, Z. Yue, J. Su, S. Wang, J. Hua, and F. Duan, “Application of Lightweight Object Detection Network in Cucumber Leaf Detection,” in 2022 IEEE International Conference on Mechatronics and Automation (ICMA), 2022, pp. 686–691. doi: 10.1109/ICMA54519.2022.9855974.

J. Li, X. Zhu, R. Jia, B. Liu, and C. Yu, “Apple-YOLO: A Novel Mobile Terminal Detector Based on YOLOv5 for Early Apple Leaf Diseases,” in 2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC), 2022, pp. 352–361. doi: 10.1109/COMPSAC54236.2022.00056.

P. Nayar, S. Chhibber, and A. K. Dubey, “An Efficient Algorithm for Plant Disease Detection Using Deep Convolutional Networks,” in 2022 14th International Conference on Computational Intelligence and Communication Networks (CICN), 2022, pp. 156–160. doi: 10.1109/CICN56167.2022.10008235.

C. Liu, H. Zhu, W. Guo, X. Han, C. Chen, and H. Wu, “EFDet: An efficient detection method for cucumber disease under natural complex environments,” Comput Electron Agric, vol. 189, p. 106378, Oct. 2021, doi: 10.1016/j.compag.2021.106378.

S. Uguz, G. Sikaroglu, and A. Yagiz, "Disease detection and physical disorders classification for citrus fruit images using convolutional neural network," Food Measure, vol. 17, pp. 2353–2362, 2023. [Online]. Available: https://doi.org/10.1007/s11694-022-01795-3

M. J. A. Soeb, M. F. Jubayer, T. A. Tarin et al., "Tea leaf disease detection and identification based on YOLOv7 (YOLO-T)," Sci Rep, vol. 13, 6078, 2023. [Online]. Available: https://doi.org/10.1038/s41598-023-33270-4

Y. Liu, Q. Yu, and S. Geng, "Real-time and lightweight detection of grape diseases based on Fusion Transformer YOLO," Frontiers in Plant Science, vol. 15, p. 1269423, 2024.

Researchzkhu, "Researchzkhu/CCL-20," GitHub. [Online]. Available: https://github.com/researchzkhu/CCL-20

"CCL’20," Kaggle. [Online]. Available: https://www.kaggle.com/datasets/downloader007/ccl20

"How to use the CCL20 object detection API," Roboflow. [Online]. Available: https://universe.roboflow.com/mds-h6qle/ccl20/model/1