A Data Augmented Method for Plant Disease Leaf Image Recognition based on Enhanced GAN Model Network
Article Sidebar
Main Article Content
Abstract
The identification of plant disease leaves based on deep learning is the key to control the development and spread of plant diseases. In this paper, the existing problems of traditional classification and recognition of plant disease leaves and the limitations of deep learning-based plant disease leaf training are analysed. An enhanced GAN model network based on the Wasserstein GAN loss function has been developed to address the limited training images of plant disease leaves. The self-attention layer is added into the self-encoding structure of the generating network. The effectiveness of data generated by the encoder is increased after the self-attention layer is added after the convolution. Finally, the model's training process is stabilised using the depth gradient punishment method. Three types of corn disease photos and 100 health images from the PlantVillage dataset were used as data sets in the experiment. An AWGAN model was applied to generate around 3000 images. Several data improvement techniques were applied to augment the same datasets. Comparative tests are conducted using AlexNet, VGG16, and ResNet18. The results indicate that the proposed AWGAN model is capable of generating sufficient images of maize leaf diseases with apparent lesions, making it a viable solution for data augmentation of plant disease images. The training model's recognition accuracy is significantly increased. The proposed awGAN-based image identification method for plant leaf disease efficiently resolves the over-fitting problem in the small sample training set. The model recognition accuracy in the ResNet18 network achieves 98.4%.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published in JIWE are licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) License. Readers are allowed to
- Share — copy and redistribute the material in any medium or format under the following conditions:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use;
- NonCommercial — You may not use the material for commercial purposes;
- NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.
References
Yang Hongzhen, Zhang Jianwei & Li Xiangtao, “Research on remote insect automatic recognition system based on image”, Transactions of the Chinese society of agricultural engineering, Vol .24, No. 1, 2019, pp. 188-192.
Neethirajan, S., Karunakaran, C., Jayas, D., & White, N, “Detection techniques for stored-product insects in grain” Food Control, Vol. 18, No. 2, 2007, pp. 157-162, doi.org/10.1016/j.foodcont.2005.09.008
Zhang Hongtao & Mao Hanping. “Application of coarse centralization weights based on FCM discretization in extension classification of grain insects”. Transactions of the Chinese society for agricultural machinery, Vol. 39, No. 7, 2008, pp. 124-128.
M. H. Hesamian, W. Jia, X. He, & P. Kennedy, “Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges”, Journal of Digit. Imaging, Vol. 32, No. 4, pp. 582–596, 2019, doi: 10.1007/s10278-019-00227-x.
I. Goodfellow, Data Augmentation of Grape Leaf Diseases Based on Generative Adversarial Network, 3 (2021).
H. Zhang, I. Goodfellow, D. Metaxas, and A. Odena, Self-Attention Generative Adversarial Networks, 36th Int. Conf. Mach. Learn. ICML 2019 2019-June, 12744 (2019).
Zhang Jianhua,Kong Fantao et al, “Cotton disease recognition model based on improved VGG convolutional neural network”, Journal of China Agricultural University, Vol, 23. No. 11, 2018, pp161-171.
Li Hang, “Research on object detection algorithm based on deep learning”. Changchun: University of Chinese Academy of Sciences (Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, 2020.
Ma Yuandong, Luo Zijiang, Ni Zhaofeng, et al, “Improved SSD algorithm for multi-object detection”. Computer engineering and applications. Vol. 56, No. 23, 2020, pp. 23-30.
Natarajan N, Dhillon I S, Ravikumar P, et al, “Learning with noisy labels” NIPS, Vol. 26, 2013, pp1196-1204.
S. E. A. Raza, G. Prince, J. P. Clarkson, & N. M. Rajpoot, “Automatic detection of diseased tomato plants using thermal and stereo visible light images” PLoS One, Vol. 10, No. 4, 2015, pp1–20. doi: 10.1371/journal.pone.0123262.
S. P. Mohanty, D. P. Hughes, & M. Salathé, “Using deep learning for image-based plant disease detection” Front. Plant Sci., Vol. 7, 2016, pp. 1–10. doi: 10.3389/fpls.2016.01419.
Bao Wenxia & Wu Gang, “Apple leaf disease recognition based on improved convolutional neural network,” Sensors, Vol. 20, No. 12, 2021, pp. 3535.
Z. Shanwen & W. Zhen, “Image segmentation method of cucumber disease leaves based on multi-scale Fusion convolutional Neural network,” Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), Vol. 36, No. 16, 2020, pp. 149-157. DOI:10.11975/j. issn.1002-6819.2020.16.019 2020.
Z. Chen, Y. Fu, Y. Zhang, Y. G. Jiang, X. Xue, and L. Sigal, “Multi-Level Semantic Feature Augmentation for One-Shot Learning,” IEEE Trans. Image Process., vol. 28, no. 9, pp. 4594–4605, 2019, doi: 10.1109/TIP.2019.2910052.
S. Ye et al., “Light-weight calibrator: A separable component for unsupervised domain adaptation,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2020, pp. 13733–13742, doi: 10.1109/CVPR42600.2020.01375.
F. Deng, S. Pu, X. Chen, Y. Shi, T. Yuan, and P. Shengyan, “Hyperspectral image classification with capsule network using limited training samples,” Sensors (Switzerland), Vol. 18, No. 9, 2018, doi: 10.3390/s18093153.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet Classification with Deep Convolutional Neural Networks,” Handb. Approx. Algorithms Metaheuristics, 2007, pp. 1–1432, doi: 10.1201/9781420010749.
C. O. M. Pu and T. E. R. Engineering, Overview of Research on Generative Adversarial Network GAN (2021).
Z. Zhibo, T. Qizhi, R. Chao, H. Xiaohai, and Z. Sen, “Unsupervised image super-resolution algorithm based on Generative Adversarial Network”, 2022, pp. 55–62.
Goodfellow, I & Pouget-Abadie, Jean & Mirza, Mehdi & Xu, Bing & Warde-Farley, David & Ozair, Sherjil & Courville, Aaron & Bengio, Y. “Generative Adversarial Networks. Advances in Neural Information Processing Systems” 2014, doi: 3. 10.1145/3422622.
Arjovsky M , Chintala S , L, et al. Wasserstein generative adversarial networks[C] International Conference on Machine Learning. PMLR, 2017.
K. H. Fanchiang, Y. C. Huang, & C. C. Kuo, “Power electric transformer fault diagnosis based on infrared thermal images using wasserstein generative adversarial networks and deep learning classifier,” Electron., Vol. 10, No. 10, 2021, doi: 10.3390/electronics10101161.
D. Wang, H. Hu, & D. Chen, “Transformer with sparse self-attention mechanism for image captioning,” Electron. Lett., Vol. 56, No. 15, 2020, pp. 764–766, doi: 10.1049/el.2020.0635.
Mirza Mehdi and O. Simon, “Conditional Generative Adversarial Nets,” 2014, pp. 1–7.
S. Kiranyaz, O. Avci, O. Abdeljaber, T. Ince, M. Gabbouj, and D. J. Inman, “1D convolutional neural networks and applications: A survey,” Mech. Syst. Signal Process., Vol. 151, 2021, pp. 107398, doi: 10.1016/j.ymssp.2020.107398.
H. Zhang, I. Goodfellow, D. Metaxas, and A. Odena, “Self-attention generative adversarial networks,” 36th Int. Conf. Mach. Learn. ICML 2019, Vol. 2019-June, pp. 12744–12753.
C. Chu, A. Zhmoginov, and M. Sandler, “CycleGAN, a Master of Steganography,” Nips, 2017, pp. 1–6.
Q. H. Cap, H. Uga, S. Kagiwada, and H. Iyatomi, “LeafGAN: An Effective Data Augmentation Method for Practical Plant Disease Diagnosis,” IEEE Trans. Autom. Sci. Eng., 2020, doi: 10.1109/TASE.2020.3041499.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, ImageNet Classification with Deep Convolutional Neural Networks, Handb. Approx. Algorithms Metaheuristics 1097 (2012).