GAN-BASED PERSON REIDENTIFICATION USING DWT
Keywords:
DWT, Deep Learning, GAN, Matching Features, Person ReidentificationAbstract
Person Re-identification (Re-id) is used in real-world applications for non-invasive biometric surveillance, validation, and identification of people in congested areas. In this paper, we propose GAN-based Person Reidentification using DWT. Generative Adversarial Network (GAN) generates identical persons with altered postures that appear in the output images. For every picture of a person, eight new photos are produced by defining a set of eight predefined poses. In order to extract features, the Discrete Wavelet Transform (DWT) technique is used which breaks down images into three high-frequency bands and one low-frequency band. The one low-frequency band of one-fourth of the size of the original image is considered for the final features with less noise. The features of test and database images are compared using Cityblock, Euclidean Distance (ED), and Cosine Similarity approaches. Through enhanced feature discrimination made possible by this dual technique, people are effectively re-identified from various camera angles and improve recognition accuracy by up to 99%.
References
L. Zheng, Y. Huang, H. Lu, and Y. Yang, "Pose-Invariant Embedding for Deep Person Re-Identification," IEEE Transactions on Image Processing, vol. 28, no. 9, pp. 4500-4509, September 2019, doi: 10.1109/TIP.2019.2910414.
Le An, Xiaojing Chen, Shuang Liu, Yinjie Lei, and Songfan Yang, “Integrating Appearance Features and Soft Biometrics for Person Re-Identification”, Multimedia Tools and Applications, Vol.76, pp. 12117–12131, 2017.
Muhammad Fayyaz, Mussarat Yasmin, Muhammad Sharif, Jamal Hussain Shah, Mudassar Raza and Tassawar Iqbal, “Multi-level Semantic Appearance Representation for Person Re-Identification System”, Neural Computing and Applications, Vol.32, pp. 10519–10540, 2020.
Shao-Mei Li, Chao Gao, Jun-Guang Zhu, and Chun-Wei Li, “Person Reidentification Using Attribute-Restricted Projection Metric Learning”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 28, No. 8, pp. 1765-1776, 2018.
Cairong Zhao, Xuekuan Wang, Wai Keung Wong, Weishi Zheng, Jian Yang and Duoqian Miao, “Multiple metric learning based on bar-shape descriptor for person re-identification”, Pattern Recognition, Vol. 71, pp. 218-234, 2017.
Qingming Leng, “Co-metric learning for person re-identification”, Advances in Multimedia, Vol. 2018, pp. 1-9, 2018.
Cheng-Hao Kuo, Sameh Khamis, Vinay Shet, “Person re-identification using semantic color names and rank boost”, IEEE workshop on applications of computer vision, pp. 281-287, 2013.
Peter Roth, Martin Hirzer, Martin Kostinger, Csaba Beleznai, Horst Bischof, “Mahalanobis Distance Learning for Person Re-Identification”, Advances in Computer Vision and Pattern Recognition, Springer, pp. 247-267, 2014.
Martin Hirzer, Peter Roth, Martin Kostinger and Horst Bischof, “Relaxed Pairwise Learned Metric for Person Re-identification”, Proceedings of the European Conference on Computer Vision, pp. 780-793, 2012.
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio, “Generative Adversarial Nets,” Advances in neural information processing systems, 27, 2014.
F. Xu, B. Ma, H. Chang, and S. Shan, "PRDP: Person Reidentification with Dirty and Poor Data," IEEE Transactions on Cybernetics, vol. 52, no. 10, pp. 11014-11026, October 2022, doi: 10.1109/TCYB.2021.3105970.
L. Zhang, R. Song, Y. Wang, Q. Zhang, and W. Zhang, "Dual-Graph Contrastive Learning for Unsupervised Person Reidentification," IEEE Transactions on Cognitive and Developmental Systems, vol. 16, no. 4, pp. 1352-1363, August 2024, doi: 10.1109/TCDS.2023.3348766.
B. Tan, L. Xu, Z. Qiu, Q. Wu, and F. Meng, "MFAT: A Multi-Level Feature Aggregated Transformer for Person Re-Identification," IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 2023, pp. 1-5, doi: 10.1109/ICASSP49357.2023.10095095.
H. Fan, X. Wang, Q. Wang, S. Fu, and Y. Tang, "Skip Connection Aggregation Transformer for Occluded Person Reidentification," IEEE Transactions on Industrial Informatics, vol. 20, no. 1, pp. 442-451, January 2024, doi: 10.1109/TII.2023.3266372.
Y. Lv, G. Wang, W. Zhao, W. Zhao, and Z. Guan, "Edge-Weight-Embedding Graph Convolutional Network for Person Reidentification," IEEE Intelligent Systems, vol. 39, no. 4, pp. 74-82, July-August 2024, doi: 10.1109/MIS.2024.3385381.
T. Si, F. He, P. Li, and M. Ye, "Homogeneous and Heterogeneous Optimization for Unsupervised Cross-Modality Person Reidentification in Visual Internet of Things," IEEE Internet of Things Journal, vol. 11, no. 7, pp. 12165-12176, 1 April, 2024, doi: 10.1109/JIOT.2023.3332077.
T. Zhang, S. Zhang and W. Jia, "Person Reidentification Based on Adaptive Relation Attention Network in Intelligent Monitoring System for the IoB," IEEE Transactions on Engineering Management, vol. 71, pp. 12648-12657, 2024, doi: 10.1109/TEM.2022.3170550.
H. Zhu, P. Budhwant, Z. Zheng and R. Nevatia, "SEAS: ShapE-Aligned Supervision for Person Re-Identification," IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 2024, pp. 164-174, doi: 10.1109/CVPR52733.2024.00024.
Z. Gao, S. Wei, W. Guan, L. Zhu, M. Wang, and S. Chen, "Identity-Guided Collaborative Learning for Cloth-Changing Person Reidentification," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 46, no. 5, pp. 2819-2837, May 2024, doi: 10.1109/TPAMI.2023.3334741.
Y. Zhang, Y. Jin, J. Chen, S. Kan, Y. Cen, and Q. Cao, "PGAN: Part-Based Nondirect Coupling Embedded GAN for Person Reidentification," IEEE MultiMedia, vol. 27, no. 3, pp. 23-33, 1 July-September 2020, doi: 10.1109/MMUL.2020.2999445.
H. Ku, P. Zhou, X. Cai, H. Yang, and Y. Chen, "Person re-identification method based on CNN and manually-selected feature fusion," IEEE 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), Guilin, China, 2017, pp. 93-96, doi: 10.1109/FSKD.2017.8393401.
Z. Liu, A. McClung, H. W. F. Yeung, Y. Y. Chung and S. M. Zandavi, "Top-Down Person Re-Identification with Siamese Convolutional Neural Networks," IEEE International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil, pp. 1-8, 2018, doi: 10.1109/IJCNN.2018.8489317.
Teng-Yok Lee, "Visualization for neural-network-based person re-identification," IEEE 15th Pacific Visualization Symposium (PacificVis), Tsukuba, Japan, pp. 171-175, 2022, doi: 10.1109/PacificVis53943.2022.00027.
L. Qi, L. Wang, J. Huo, Y. Shi, X. Geng, and Y. Gao, "Adversarial Camera Alignment Network for Unsupervised Cross-Camera Person Re-Identification," IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 5, pp. 2921-2936, May 2022.
De Cheng, Zhihui Li, Yihong Gong, and Dingwen Zhang, “Fusion of Multiple Person Re-id Methods with Model and Data-Aware Abilities”, IEEE Transactions on Cybernetics, Vol. 50, No. 2, pp. 561-571, 2020.
Minxian Li, Xiatian Zhu, and Shaogang Gong, “Unsupervised Tracklet Person Re-Identification”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 42, No. 7, pp. 1770-1782, 2020.
Navaneet K L, Ravi Kiran Sarvadevabhatla, Shashank Shekhar, R Venkatesh Babu, and Anirban Chakraborty, “Operator-in-the-Loop Deep Sequential Multi-Camera Feature Fusion for Person Re-identification”, IEEE Transactions on Information Forensics and Security, Vol. 15, pp. 2375-2385, 2020.
Jianjun Lei, Lijie Niu, Huazhu Fu, Bo Peng, Qingming Huang and Chunping Hou, “Person Re-Identification by Semantic Region Representation and Topology Constraint”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 29, No. 8, pp. 2453-2466, 2019.
Long Wei, Zhenyong Wei, Zhongming Jin, Zhengxu Yu, Jianqiang Huang, Deng Cai, Xiaofei He, and Xian-Sheng Hua, “SIF: Self-Inspirited Feature Learning for Person Re-Identification”, IEEE Transactions on Image Processing, Vol. 29, pp. 4942-4951, 2020.
Wenfeng Song, Shuai Li, Tao Chang, Aimin Hao, Qinping Zhao and Hong Qin, “Context-Interactive CNN for Person Re-Identification”, IEEE Transactions on Image Processing, Vol. 29, pp. 2860-2874, 2020.
Mang Ye and Pong C. Yuen, “PurifyNet: A Robust Person Re-Identification Model with Noisy Labels”, IEEE Transactions on Information Forensics and Security, Vol. 15, pp. 2655-2666, 2020.
Hong-Xing Yu, Ancong Wu and Wei-Shi Zheng, “Unsupervised Person Re-identification by Deep Asymmetric Metric Embedding”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 42, No. 4, pp. 956-973, 2020.
Liang Zheng, Liyue Shen, Lu Tian, Shengjin Wang, Jingdong Wang, and Qi Tian, “Scalable Person Re-identification: A Benchmark”, IEEE International Conference on Computer Vision, pp. 1116 -1124, 2015.
Wei Li, Rui Zhao, and Xiaogang Wang, “Human Reidentification with Transferred Metric Learning”, in Proceedings of Asian Conference on Computer Vision, vol 7724, pp. 31–44, 2013.
Ahmed Banafa, "Introduction to Artificial Intelligence (AI)," in Introduction to Artificial Intelligence (AI), River Publishers, pp. i-x, 2024.
A. Holzinger, M. Kargl, B. Kipperer, P. Regitnig, M. Plass and H. Müller, "Personas for Artificial Intelligence (AI) an Open Source Toolbox," IEEE Access, vol. 10, pp. 23732-23747, 2022, doi: 10.1109/ACCESS.2022.3154776.
J. Peck, B. Goossens and Y. Saeys, "An Introduction to Adversarially Robust Deep Learning," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 46, no. 4, pp. 2071-2090, April 2024, doi: 10.1109/TPAMI.2023.3331087.
Alzubaidi, L., Zhang, J., Humaidi, A.J. et al. “Review of deep learning: concepts, CNN architectures, challenges, applications, future directions,” Springer Journal of Big Data, 8, 53, pp 1-74, 2021, https://doi.org/10.1186/s40537-021-00444-8.
www.simplilearn.com/ List of Generative Adversarial Networks Applications.
Xuelin Qian, Yanwei Fu, Tao Xiang, Wenxuan Wang, Jie Qiu, Yang Wu, Yu-Gang Jiang, and Xiangyang Xue, “Pose-Normalized Image Generation for Person Re-Identification”, Proceedings of the European Conference on Computer Vision (ECCV), pp.650-667, 2018.
Z. Cao, G. Hidalgo, T. Simon, S. -E. Wei and Y. Sheikh, "OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 1, pp. 172-186, 1 Jan. 2021, doi: 10.1109/TPAMI.2019.2929257.
G. V. Sagar, S. Y. Barker, K. B. Raja, K. S. Babu, and Venugopal K R, “Convolution-based Face Recognition using DWT and Feature Vector Compression,” IEEE International Conference on Image Information Processing (ICIIP), pp. 444-449, 2015, doi: 10.1109/ICIIP.2015.7414814.
R. Gonzalez and R. Woods, ‘‘Digital Image Processing,’’ Prentice Hall, Englewood Cliffs, NJ, 2002.
https://in.mathworks.com/help/wavelet/gs/introduction-to-the-wavelet-families.html.
Thakral, S., Manhas, P. “Image Processing by Using Different Types of Discrete Wavelet Transform,” Springer International Conference on Advanced Informatics for Computing Research, vol 955, 2019, doi.org/10.1007/978-981-13-3140-4_45.
https://docs.tibco.com/pub/spotfire/7.0.0/doc/html/hc/hc_city_block_distance.htm.
https://www.sciencedirect.com/topics/engineering/euclidean-distance.
https://builtin.com/machine-learning/cosine-similarity.
Kunhong Yu, Congyan Lang, Songhe Feng, and Tao Wang, “Reasonably Assign Label Distributions to GAN Images in Person Re-identification Baseline,” IEEE Fourth International Conference on Multimedia Big Data, pp. 1-5, 2018,doi.org/10.1109/BigMM.2018.8499058.
Shuang Liu, Tongzhen Si, Xiaolong Hao, and Zhong Zhang, “Semantic Constraint GAN for Person Re-Identification in Camera Sensor Networks,” IEEE Access, vol. 7, pp. 176257- 176265, 2019. doi.org/10.1109/ACCESS.2019.2958126.
Wu Lin, Chunhua Shen, and Hengel A. van den, “Deep Linear Discriminant Analysis On Fisher Networks: A Hybrid Architecture for Person Re-Identification,” Elsevier Pattern Recognition, 65, pp 238–250, 2017, doi:10.1016/j.patcog.2016.12.022.
Wei Li, X. Zhu, and S. Gong, "Harmonious Attention Network for Person Re-identification," IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 2018, pp. 2285-2294, doi: 10.1109/CVPR.2018.00243.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Ravinaik D , Divya A, Harshith K Raj (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
