Sine Cosine Algorithm for Enhancing Convergence Rates of Artificial Neural Network: A Comparative Study Manuscript Received: 26 December 2023, Accepted: 24 January 2024, Published: 15 September 2024, ORCiD: 0000-0003-1718-7038, https://doi.org/10.33093/jetap.2024.6.2.5
Article Sidebar
Main Article Content
Abstract
Artificial neural networks (ANNs) is widely adopted by researchers for classification tasks due to their simplicity and superior performance. This study offerings the ANN and it variant such as Elman Neural Network (NN) model to address its strengths, although it faces with issues like local minima and slow convergence. This study presents a comprehensive evaluation of four distinct algorithms for classification tasks, focusing on their performance on both training and testing datasets. These algorithms such as Sine Cosine Algorithm is integrated with Artificial Neural Networks (SCA_ANN), Back Propagation Neural Networks (SCA_BP), Elman Neural Networks (SCA_ElmanNN), and Elman Neural Networks (ElmanNN). The evaluation employs two key performance metrics: Accuracy (ACC) and Mean Squared Error (MSE). The training dataset, representing 70% of the data, is used for algorithm training, and the testing dataset, constituting the remaining 30 %, assesses the algorithms' ability to generalize to new, unseen data. Results indicate that SCA_ElmanNN in both training and testing datasets, achieving high accuracy and minimal MSE, showcasing its proficiency in classification and prediction precision. SCA_BP and SCA_ANN also demonstrate robust performance. Conversely, ElmanNN, while relatively accurate, exhibits a slightly higher MSE on the testing data, indicating some variability in its predictions. These findings offer valuable insights for researchers in selecting the most appropriate algorithm for specific classification tasks.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
N. M. Nawi, A. Khan, M. Rehman, H. Chiroma and T. Herawan, "Weight Optimization in Recurrent Neural Networks with Hybrid Metaheuristic Cuckoo Search Techniques for Data Classification," Math. Probl. in Eng., vol. 2015, pp. 868375, 2015.
R. Ullah, A. Khan, S. B. S. Abid, S. Khan, S. K. Shah and M. Ali, "Crow-ENN: An Optimized Elman Neural Network with Crow Search Algorithm for Leukemia DNA Sequence Classification," Mobil. Device. and Smart Gadgets in Medical Sci., pp. 173-213, IGI Global, 2020.
L. Abualigah and A. Diabat, "Advances in Sine Cosine Algorithm: A Comprehensive Survey," Artif. Intellig. Rev., vol. 54, no. 4, pp. 2567-2608, 2021.
L. Abualigah, M. Shehab, M. Alshinwan and H. M. Alabool, "Salp Swarm Algorithm: A Comprehensive Survey," Neural Comput. and Appl., vol. 32, pp. 11195-11215, 2020.
S. Mirjalili, "SCA: A Sine Cosine Algorithm for Solving Optimization Problems," Knowledge-Based Sys., vol. 96, pp. 120-133, 2016.
M. Ali, A. Khan, A. Khan and S. A. Lashari, "Analysis of Variable Learning Rate Back Propagation with Cuckoo Search Algorithm for Data Classification," in Int. Conf. Emerg. Appl. and Technol. for Indust. 4.0, vol. 254, pp. 9-21, Springer, 2021.
B. Ali, S. A. Lashari, W. Sharif, A. Khan, K. Ullah and D. A. Ramli, "An Efficient Learning Weight of Elman Neural Network with Chicken Swarm Optimization Algorithm," Proc. Comp. Sci., vol. 192, pp. 3060-3069, 2021.
H. Chiroma, A. Khan, A. I. Abubakar, S. A. Muaz, A. Y. Gital, A. B. Dauda and M. J. Usman, "Hybrid of Swarm Intelligent Algorithms in Medical Applications," in Proc. Int. Conf. Data Eng. 2015, pp. 619-628, 2019.
A. Khan, R. Shah, J. Bukhari, N. Akhter, M. Idrees and H. Ahmad, "A Novel Chicken Swarm Neural Network Model for Crude Oil Price Prediction," Adv. on Computat. Intellig. in Ener., pp. 39-58, 2019.
M. Z. Rehman, A. Khan, R. Ghazali, M. Aamir and N. M. Nawi, "A New Multi Sine-Cosine Algorithm for Unconstrained Optimization Problems," PLOS ONE, vol. 16, no. 8, pp. e0255269, 2021.
A. A. Abdelsalam and H. S. E. Mansour, "Optimal Allocation And Hourly Scheduling of Capacitor Banks using Sine Cosine Algorithm for Maximizing Technical and Economic Benefits," Electr. Power Component. and Sys., vol. 47, no. 11-12, pp. 1025-1039, 2019.
M. M. Eid, E. S. M. El Kenawy and A. Ibrahim, "A Binary Sine Cosine-Modified Whale Optimization Algorithm for Feature Selection," in 2021 Nat. Comput. Colleges Conf., pp. 1-6, 2021.
A. F. Attia, R. A. El Sehiemy and H. M. Hasanien, "Optimal power Flow Solution in Power Systems using A Novel Sine-Cosine Algorithm," Int. J. Electr. Power & Ener. Sys., vol. 99, pp. 331-343, 2018.
R. M. Rizk-Allah, "Hybridizing Sine Cosine Algorithm with Multi-Orthogonal Search Strategy for Engineering Design Problems," J. Computat. Design and Eng., vol. 5, no. 2, pp. 249-273, 2018.
Q. Yang, S. C. Chu, J. S. Pan and C. M. Chen, "Sine Cosine Algorithm with Multigroup and Multistrategy for Solving CVRP," Math. Probl. in Eng., vol. 2020, pp. 1-10, 2020.
N. Aalimahmoody, C. Bedon, N. Hasanzadeh-Inanlou, A. Hasanzade-Inallu and M. Nikoo, "BAT Algorithm-based ANN to Predict The Compressive Strength of Concrete—A Comparative Study," Infrastructures, vol. 6, no. 6, pp. 80, 2021.
C. A. Cheng and H. W. Chiu, "An Artificial Neural Network Model for The Evaluation of Carotid Artery Stenting Prognosis using A National-Wide Database," in 39th Annual Int. Conf. of the IEEE Eng. in Medic. and Bio. Soc., pp. 2566-2569, 2017.
A. Khan, A. Khan, J. I. Bangash, F. Subhan, A. Khan, A. Khan, M. I. Uddin and M. Mahmoud, "Cuckoo Search-based SVM (CS-SVM) Model for Real-Time Indoor Position Estimation in IoT Networks," Secur. Commun. Netw., vol. 2021, pp. 6654926, 2021.
F. Aldakheel, R. Satari and P. Wriggers, "Feed-forward Neural Networks for Failure Mechanics Problems," Appl. Sci., vol. 11, no. 14, p. 6483, 2021.
A. Fida, P. Thankachan and T. M. Pillai, "Optimisation of Artificial Neural Network using Cuckoo Search Algorithm for Damage Detection," in Proc. SECON'22: Structural Eng. and Construct. Manage., pp. 723-737, 2022.
A. A. Abusnaina, S. Ahmad, R. Jarrar and M. Mafarja, "Training Neural Networks using Salp Swarm Algorithm for Pattern Classification," in Proc. of the 2nd Int. Conf. Future Netw. and Distributed Sys., pp. 1-6, 2018.
H. Chiroma, S. Abdul-kareem, A. Khan, N. M. Nawi, A. Y. Gital, L. Shuib, A. I. Abubakar, M. Z. Rahman and T. Herawan, "Global Warming: Predicting OPEC Carbon Dioxide Emissions from Petroleum Consumption using Neural Network and Hybrid Cuckoo Search Algorithm," PLOS ONE, vol. 10, no. 8, pp. e0136140, 2015.
A. Khan, N. M. Nawi, R. Shah, N. Akhter, A. Ullah, M. Z. Rehman, Norhamreeza, A. Hamid and H. Chiroma, "Chicken S-BP: An Efficient Chicken Swarm Based Back-Propagation Algorithm," in Int. Conf. on Soft Comput. and Data Mining, pp. 122-129, 2016.
A. Zeb, S. A. Lashari, A. Khan, A. Khan, K. Nazar and M. Ishaq, "Numerical Solution of Wavelet Neural Network Learning Weights using Accelerated Particle Swarm Optimization Algorithm," FRACTALS, vol. 31, no. 2, pp. 2340026, 2023.
A. Khan, R. Shah, M. Imran, A. Khan, J. I. Bangash and K. Shah, "An Alternative Approach to Neural Network Training Based on Hybrid Bio Meta-Heuristic Algorithm," J. Ambient Intellig. and Human. Comput., vol. 10, pp. 3821-3830, 2019.