Integrated Circuit Packaging Recognition with Tilt Auto Adjustment using Deep Learning Approach Manuscript Received: 13 April 2023, Accepted: 6 May 2023, Published: 15 September 2023, ORCiD: 0000-0002-4192-1477, https://doi.org/10.33093/jetap.2023.5.2.9

Main Article Content

Siu Hong Loh
Peh Chiong Teh
Jia Jia Sim
Kim Ho Yeap
Yong Kang Lee

Abstract

A deep-learning-based approach for recognizing integrated circuit (IC) packaging type is presented in this paper. The objective of this work is to design a deep-learning method that can recognize multiple types of packaging per detection, performing counting operations, and calculating the centre location of an IC with its tilting angle. The transfer learning from model You-Only-Look-Once (YOLO) v5 was chosen because it has been trained with the coco dataset and has a more reliable feature extraction system than the other models. In order to extract data from images, OpenCV was used, which allows the deep learning model to perform more efficient analysis of the input data. Apart from that, the principal component analysis (PCA) was used to estimate the angle of the IC in order to determine the rotation of each IC for the purpose of tilting adjustment. The developed model has an average confidence score of 85% and is capable of operating in a variety of conditions, as demonstrated by ANOVA analysis.

Article Details

Section
Articles

References

S. J. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, Fourth Ed., Pearson, 2021.

E. Burns, “What is artificial intelligence (AI)? - AI definition and how it works,” Enterprise AI. https://www.techtarget.com/searchenterpriseai/definition/AI-Artificial-Intelligence (Accessed on 11 April 2023).

I. A. Joiner, “Artificial Intelligence,” Emerging Library Technologies, Elsevier, pp. 1–22, 2018.

E. Lisowski, “Using Artificial Intelligence (AI) for Image Recognition,” Addepto, May 2021. https://addepto.com/blog/using-artificial-intelligence-ai-for-image-recognition/ Aaccessed on 11 April, 2023).

G. E. Hinton, S. Osindero and Y. W. Teh, “A Fast Learning Algorithm for Deep Belief Nets,” Neural Comput., vol. 18, no. 7, pp. 1527–1554, 2006.

I. H. Sarker, “Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions,” SN Comput. Sci., vol. 2, no. 6, p. 420, 2021.

M. Hussain, J. J. Bird and D. R. Faria, “A Study on CNN Transfer Learning for Image Classification,” in UK Workshop Computat. Intellig., Adv. Computat. Intellig. Sys., Springer, vol. 840, pp. 191–202, 2019.

J. Redmon, S. Divvala, R. Girshick and A. Farhadi, “You Only Look Once: Unified, Real-Time Object Detection,” Comp. Vision and Pattern Recogn., 2015, doi: 10.48550/ARXIV.1506.02640.

P. Blaes and C. Young, “Mobile IC Package Recognition,” Stanford University, 2008. [Online Available: https://stacks.stanford.edu/file/druid:yj296hj2790/Young_Blaes_Mobile_IC_Package_Recognition_and_Information_Retrieval.pdf]

Y. N. Voon, K. M. Ang, Y. H. Chong, W. H. Lim and S. S. Tiang, “Computer-Vision-Based Integrated Circuit Recognition Using Deep Learning,” in Proc. 6th Int. Conf. Electrical, Control and Comput. Eng., Lecture Notes in Electrical Eng., Springer, vol. 842, pp. 913–925, 2022.

M. A. Reza, Z. Chen and D. J. Crandall, “Deep Neural Network–Based Detection and Verification of Microelectronic Images,” J. Hardw. Sys. Secur., vol. 4, no. 1, pp. 44–54, 2020.

M. A. Reza and D. J. Crandall, “IC-ChipNet: Deep Embedding Learning for Fine-grained Retrieval, Recognition, and Verification of Microelectronic Images,” in 2020 IEEE Appl. Image. Pattern Recogn. Workshop, Washington DC, pp. 1–10, 2020.

V. R. Joseph, “Optimal Ratio for Data Splitting,” Statistical Analysis, vol. 15, no. 4, pp. 531–538, 2022.

R. M. Heiberger and E. Neuwirth, “One-Way ANOVA,” R Through Excel, Springer, pp. 165–191, 2009.

S. H. Loh, P. C. Teh, J. J. Sim, C. K. Tai, K. H. Yeap, Y. J. Lee and A. U. Mazlan, “Decoding Dot Peen Data Matrix Code with Deep Learning Capability for Product Traceability,” Appl. Model. and Simul., vol. 7, pp. 38–48, 2023.

D. Mahmood, H. Nisar, V. V. Yap and C.-Y. Tsai, “The Effect of Music Listening on EEG Functional Connectivity of Brain: A Short-Duration and Long-Duration Study,” Mathematics, vol. 10, no. 3, 349, pp. 1-19, 2022.

R. Nawaz, H. Nisar, V. V. Yap and C. Y. Tsai, “The Effect of Alpha Neurofeedback Training on Cognitive Performance in Healthy Adults,” Mathematics, vol. 10, no. 7, 1095, pp. 1-16, 2022.