A COMPARATIVE STUDY OF CONVOLUTIONAL NEURAL NETWORKS AND CYBERNETIC APPROACHES ON CIFAR-10 DATASET

Authors

  • S. B. Vinay Chettinad Vidyashram, Chennai, Tamil Nadu, India. Author
  • S. Balasubramanian Professor, Department of Mechanical Engineering, Rathinam Technical Campus, Coimbatore, Tamil Nadu, India. Author

Keywords:

CIFAR-10,  Convolutional Neural Networks, Cybernetic Approaches, Image Classification, Deep Learning, Machine Learning, Computer Vision, Performance Evaluation

Abstract

In this paper, a comparison is made between Convolutional Neural Networks (CNNs) and cybernetic approaches to image classification using the CIFAR-10 dataset. The primary objective of the study is to assess the performance of these two methods based on several factors, such as accuracy, precision, recall, F1-score, computational efficiency, and training time. The paper offers an overview of the CIFAR-10 dataset and image preprocessing techniques, followed by a discussion of the architecture, layers, and training techniques of CNNs. Additionally, various types of cybernetic approaches are described, including their advantages and limitations. The paper also delves into the experimental setup, implementation of both methods, and performance evaluation metrics. Based on the results, CNNs surpass cybernetic approaches in terms of accuracy, precision, recall, and F1-score, though with longer training time and higher computational requirements. Finally, the paper concludes with a summary of the findings, their implications, and potential future research directions.

 

 

References

The CIFAR-10 dataset, https://www.cs.toronto.edu/~kriz/cifar.html

Krizhevsky, A., Sutskever, I. and Hinton, G. E., ImageNet Classification with Deep Convolutional Neural Networks NIPS 2012: Neural Information Processing Systems, Lake Tahoe, Nevada

Hinton, G. E., Krizhevsky, A., & Wang, S. (2011). Transforming auto-encoders. In International Conference on Artificial Neural Networks. Helsinki, Finland.

Sharma, N., Jain, V., & Mishra, A. (2018). An analysis of convolutional neural networks for image classification. In International Conference on Computational Intelligence and Data Science (ICCIDS 2018). Procedia Computer Science, 132, 377-384.

Brownlee, J. (2019). How to develop a CNN from scratch for CIFAR-10 photo classification

Yang, L., He, Z., & Fan, D. (2018). A fully on-chip binarized convolutional neural network FPGA implementation with accurate inference. In Proceedings of the International Symposium on Low Power Electronics and Design (ISLPED '18) (pp. 50-55). July, 2018. doi: 10.1145/3218603.3218615.

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS 2012), (pp. 1097-1105). Lake Tahoe, Nevada, USA.

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84-90. doi: 10.1145/3065386.

Mukta Jagdish, E.R. Aruna, Gaddam Hrithik Goud, Tejashwini Gundlapally, Katteboina Sai Charan Tej, Digital Method to Talk with Machine Using Image Processing and Machine Learning Techniques, International Journal of Advanced Research in Engineering and Technology (IJARET), 13(8), 2022, pp. 18-26. doi: https://doi.org/10.17605/OSF.IO/B2MXH

Fei-Fei, L., Fergus, R., & Perona, P. (2007). Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories. Computer Vision and Image Understanding, 106(1), 59-70.

Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2013). Improving neural networks by preventing co-adaptation of feature detectors. In Proceedings of the 30th International Conference on Machine Learning (ICML 2013), (pp. 1-9). Atlanta, Georgia, USA

Fang, U., Li, J., Lu, X., Mian, A., & Gu, Z. (2023). Robust image clustering via context-aware contrastive graph learning. Pattern Recognition, 138, 109340. doi: 10.1016/j.patcog.2023.109340.

S. Balasubramanian, SQuAD 2.0: A Comprehensive Overview of the Dataset and Its Significance in Question Answering Research, International Journal of Artificial Intelligence Research and Development (IJAIRD), 1(1), 2023, pp. 1-14 doi: https://doi.org/10.17605/OSF.IO/ENKPH

Mukta Jagdish, E.R. Aruna, Gaddam Hrithik Goud, Tejashwini Gundlapally, Katteboina Sai Charan Tej, Digital Method to Talk with Machine Using Image Processing and Machine Learning Techniques, International Journal of Advanced Research in Engineering and Technology (IJARET), 13(8), 2022, pp. 18-26. doi: https://doi.org/10.17605/OSF.IO/B2MXH

P Manjula and R Kalaivani, Processing of Medical Images from Large Datasets using Convolutional Neural Network, International Journal of Advanced Research in Engineering and Technology (IJARET), 12(3), 2021, pp. 922-927 doi: https://doi.org/10.17605/OSF.IO/9SCV7

K K Ramachandran, Predicting Supermarket Sales with Big Data Analytics: A Comparative Study of Machine Learning Techniques, International Journal of Data Analytics (IJDA), 1(1), 2023, pp. 1-11 doi: https://doi.org/10.17605/OSF.IO/UTNMW

Mayank R. Kapadia and Chirag N. Paunwala, Multi-Channel Convolution Neural Network for Accurate CBMIR System with Reduced Semantic Gap, International Journal of Advanced Research in Engineering and Technology, 12(1), 2021, pp. 159-172. doi: 10.34218/IJARET.12.1.2021.013

Buda, M., Maki, A., & Mazurowski, M. A. (2018). A systematic study of the class imbalance problem in convolutional neural networks. Neural Networks, 106, 249-259.

Adiwangsa, M. (2018). Classification of Images from the CIFAR10 Dataset: A Deep Learning Approach Using Convolutional Neural Networks. http://users.cecs.anu.edu.au/~Tom.Gedeon/conf/ABCs2018/paper/ABCs2018_paper_124.pdf

Abouelnaga, Y., Girgis, M., & Elsharnoby, M. (2016). CIFAR-10: KNN-Based Ensemble of Classifiers. 2016 International Conference on Computational Science and Computational Intelligence (CSCI), 1192-1195. doi: 10.1109/CSCI.2016.0107

Majumdar, S., & Jain, I. (2016). Deep Columnar Convolutional Neural Network. International Journal of Computer Applications, 145(12), 25-32.

Lecun, Y., Huang, F. J., & Bottou, L. (2004). Learning methods for generic object recognition with invariance to pose and lighting. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004 (Vol. 2, pp. II-97). IEEE.

Mukta Jagdish, E.R. Aruna, Gaddam Hrithik Goud, Tejashwini Gundlapally, Katteboina Sai Charan Tej, Digital Method to Talk with Machine Using Image Processing and Machine Learning Techniques, International Journal of Advanced Research in Engineering and Technology (IJARET), 13(8), 2022, pp. 18-26. doi: https://doi.org/10.17605/OSF.IO/B2MXH

PapersWithCode. (2023). Image Classification on CIFAR-10 - SOTA. Retrieved May 5, 2022, from https://paperswithcode.com/sota/image-classification-on-cifar-10

Melnik, E.V., Klimenko, A.B. (2020). A Peer-to-Peer Crowdsourcing Platform for the Labeled Datasets Forming. In: Silhavy, R. (eds) Applied Informatics and Cybernetics in Intelligent Systems. CSOC 2020. Advances in Intelligent Systems and Computing, vol 1226. Springer, Cham. https://doi.org/10.1007/978-3-030-51974-2_9

Rohit Khankhoje, "Beyond Coding: A Comprehensive Study of Low-Code, No-Code and Traditional Automation," Journal of Artificial Intelligence & Cloud Computing, vol. 1, no. 4, pp. 1-5, 2022. DOI: 10.47363/JAICC/2022(1)148.

Downloads

Published

2023-04-07

How to Cite

A COMPARATIVE STUDY OF CONVOLUTIONAL NEURAL NETWORKS AND CYBERNETIC APPROACHES ON CIFAR-10 DATASET. (2023). INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (IJMLC), 1(1), 1-13. https://lib-index.com/index.php/IJMLC/article/view/IJMLC_01_01_001