EVOLUTION OF HUMAN-COMPUTER INTERACTION: INTEGRATING AUGMENTED REALITY AND VIRTUAL REALITY
Keywords:
Compliance, Cybersecurity, IT Audit, Software, Software Development Lifecycle (SDLC)Abstract
Human interaction with computers has undergone significant transformation, driven by the integration of Augmented Reality (AR) and Virtual Reality (VR) technologies. This chapter provides a comprehensive review of how these immersive technologies are reshaping the landscape of human-computer interaction (HCI), offering new dimensions of engagement and usability. Understanding the evolution of Human-Computer Interaction (HCI) provides a foundation for appreciating how immersive technologies like Augmented Reality (AR) and Virtual Reality (VR) have transformed user experiences. The historical development of HCI, tracing its origins from early interaction models to the advent of imersive technologies and the progression of interaction paradigms
References
Yiyi Liu. Design of human-computer interaction system based on virtual reality and its application in the dissemination of study lodge culture. October 2023. Conference: 2023 4th International Conference on Intelligent Design (ICID). DOI:10.1109/ICID60307.2023.10396826
Chenna, Sankalp, Augmented Reality and AI: Enhancing Human-Computer Interaction in the Metaverse (January 15, 2023). Available at SSRN: https://ssrn.com/abstract=4324629 or http://dx.doi.org/10.2139/ssrn.4324629
Lyu, Z. (2023). State-of-the-Art Human-Computer-Interaction in Metaverse. International Journal of Human–Computer Interaction, 1–19. https://doi.org/10.1080/10447318.2023.2248833
Luca Gualtieri., et al. A human-centered conceptual model for integrating Augmented Reality and Dynamic Digital Models to reduce occupational risks in industrial contexts. Procedia Computer Science. Volume 217, 2023, Pages 765-773. https://doi.org/10.1016/j.procs.2022.12.273
Dozio, N., Marcolin, F., Scurati, G. W., Ulrich, L., Nonis, F., Vezzetti, E., Marsocci, G., La Rosa, A., & Ferrise, F. (2022). A design methodology for affective virtual reality. International Journal of Human-Computer Studies, 162(2022, June), 102791. https://doi.org/10.1016/j.ijhcs.2022.102791
Turhan B, Gümüş ZH. A Brave New World: Virtual Reality and Augmented Reality in Systems Biology. Front Bioinform. 2022 Apr;2:873478. doi: 10.3389/fbinf.2022.873478. Epub 2022 Apr 6. PMID: 35647580; PMCID: PMC9140045.
Liu, Y., Sivaparthipan, C. B., & Shankar, A. (2022). Human-computer interaction based visual feedback system for augmentative and alternative communication. International Journal of Speech Technology, 25(2), 305–314.
Alireza Sadeghi Milani, Aaron Cecil-Xavier, Avinash Gupta, J. Cecil & Shelia Kennison (2022): A Systematic Review of Human–Computer Interaction (HCI) Research in Medical and Other Engineering Fields, International Journal of Human–Computer Interaction, DOI: 10.1080/10447318.2022.2116530
Ziyan Chu., et al. MIND-VR: A Utility Approach of Human-Computer Interaction in Virtual Space based on Autonomous Consciousness. October 2022. Conference: 2022 International Conference on Virtual Reality, Human-Computer Interaction and Artificial Intelligence (VRHCIAI). DOI:10.1109/VRHCIAI57205.2022.00030
Sun, Y., Guo, Q., Zhao, S., Chandran, K., & Fathima, G. (2022). Context-Aware Augmented Reality Using Human–Computer Interaction Models. Journal of Control and Decision, 11(1), 1–14. https://doi.org/10.1080/23307706.2022.2026260
Katona, J. A Review of Human–Computer Interaction and Virtual Reality Research Fields in Cognitive InfoCommunications. Appl. Sci. 2021, 11, 2646. https://doi.org/10.3390/app11062646
Zsolt, J.; Levente, H. Improving Human-Computer Interaction by Gaze Tracking. In Proceedings of the 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom), Kosice, Slovakia, 2–5 December 2010; pp. 155–160.
Torok, A. From Human-Computer Interaction to Cognitive Infocommunications: A Cognitive Science Perspective. In Proceedings of the 2016 7th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), Wrocław, Poland, 16–18 October 2016; pp. 433–438.
Wang K., Yap L. W., Gong S., Wang R., Wang S. J., Cheng W. (2021). Nanowire‐Based Soft Wearable Human-Machine Interfaces for Future Virtual and Augmented Reality Applications. Adv. Funct. Mater. 31, 2008347. 10.1002/adfm.202008347
Gattullo, M., Evangelista, A., Manghisi, V. M., Uva, A. E., Fiorentino, M., Boccaccio, A., … Gabbard, J. L. (2020a). Towards next generation technical documentation in augmented reality using a context-aware information manager. Applied Sciences, 10(3), 780. https://doi.org/10.3390/app10030780
Geng, J., Song, X., Pan, Y., Tang, J., Liu, Y., Zhao, D., & Ma, Y. (2020). A systematic design method of adaptive augmented reality work instruction for complex industrial operations. Computers in Industry, 119, 103229. https://doi.org/10.1016/j.compind.2020.103229
Kim, J. C., Laine, T. H., & Åhlund, C. (2021). Multimodal Interaction Systems based on internet of things and augmented reality: A systematic literature review. Applied Sciences, 11(4), 1738. https://doi.org/10.3390/app11041738
Lampropoulos, G., Keramopoulos, E., & Diamantaras, K. (2020). Enhancing the functionality of augmented reality using deep learning, semantic web and knowledge graphs: A review. Visual Informatics, 4(1), 32–42. https://doi.org/10.1016/j.visinf.2020.01.001
Pascoal, R., Almeida, A. D., & Sofia, R. C. (2020). Mobile Pervasive Augmented Reality Systems—MPARS: The Role of User Preferences in the Perceived Quality of Experience in Outdoor Applications. ACM Transactions on Internet Technology, 20(1), 1–17. https://doi.org/10.1145/3375458
Quandt, M., Beinke, T., & Freitag, M. (2020). User-centered evaluation of an augmented reality-based assistance system for maintenance. Procedia CIRP, 93, 921–926. https://doi.org/10.1016/j.procir.2020.03.053
Laghari, A., Jumani, A. K., Kumar, K., Chhajro, M. A.: Systematic Analysis of Virtual Reality & Augmented Reality. International Journal of Information Engineering and Electronic Business, 13(1), 36-43 (2021). https://doi.org/10.5815/ijieeb.2021.01.04.
Ferran Argelaguet, et al. Spatial and rotation invariant 3D gesture recognition based on sparse representation. January 2017. Conference: 2017 IEEE Symposium on 3D User Interfaces (3DUI). DOI:10.1109/3DUI.2017.7893333
Karpov, A. A., & Yusupov, R. M. (2018). Multimodal interfaces of human-computer interaction. Herald of the Russian Academy of Sciences, 88(1), 67–74. https://doi.org/10.1134/S1019331618010094
Kober, S. E., & Neuper, C. (2013). Personality and presence in virtual reality: Does their relationship depend on the used presence measure? International Journal of Human–Computer Interaction, 29(1), 13–25. https://doi.org/10.1080/10447318.2012.668131
Li J., Nie L., Li Z., Lin L., Tang L., Ouyang J. (2012). Maximizing Modern Distribution of Complex Anatomical Spatial Information: 3D Reconstruction and Rapid Prototype Production of Anatomical Corrosion Casts of Human Specimens. Anat. Sci. Educ. 5, 330–339.
Sutcliffe A., Gault B., Shin J.-E. (2005). Presence, Memory and Interaction in Virtual Environments. Int. J. Human-Computer Stud. 62, 307–327. DOI: 10.1016/j.ijhcs.2004.11.010
N. Alalwan, L. Cheng, H. Al-Samarraie, R. Yousef, A.I. Alzahrani, S.M. Sarsam. Challenges and prospects of virtual reality and augmented reality utilization among primary school teachers: A developing country perspective. Studies In Educational Evaluation, 66 (2020), Article 100876
P. Biswas, P. Orero, M. Swaminathan, K. Krishnaswamy, P. Robinson
Adaptive accessible AR/VR systems. InExtended abstracts of the 2021 CHI Conference on human Factors in computing systems (2021), pp. 1-7.
B. Boyles. Virtual reality and augmented reality in education
Center For Teaching Excellence, United States Military Academy, West Point, Ny (2017).
R. Du, E. Turner, M. Dzitsiuk, L. Prasso, I. Duarte, J. Dourgarian, …, D. Kim. DepthLab: Real-time 3D interaction with depth maps for mobile augmented reality. InProceedings of the 33rd annual ACM Symposium on user interface Software and technology (2020), pp. 829-843
C. Kim, H.C. Yoon, D.H. Kim, Y.R. Do. Spectroscopic influence of virtual reality and augmented reality display devices on the human nonvisual characteristics and melatonin suppression response. IEEE Photonics Journal, 10 (4) (2018), pp. 1-11
Xu Jinning. Research on digital somatosensory interactive art performance [D].Northwest University, 2023.
Li Shi, Lu Junyang, Zhang Mingwei, et al. Free gesture interaction technology in large scenes [J]. Research on Printing and Digital Media Technology, 2023(04): 244-251.
Creed, C., Al-Kalbani, M., Theil, A., Sarcar, S., & Williams, I. (2023). Inclusive Augmented and Virtual Reality: A Research Agenda. International Journal of Human–Computer Interaction, 1–20. https://doi.org/10.1080/10447318.2023.2247614
Yang Ziying. Research on trust issues in human-computer interaction relationships[D]. Dalian University of Technology, 2023.
Cao Shizhou. Research on virtual learning environment modeling and human-computer interaction technology [D]. Chongqing University of Posts and Telecommunications, 2022.
Wang Lingyun, Yang Shikang. Research on augmented reality human-computer interaction technology[J]. Computer Knowledge and Technology, 2021, 17(14):179-180.
Zhao Yacong. Research on human-computer interaction technology in smart homes[D]. Southeast University, 2020.
V. Pavlovic, R. Sharma, T.S. Huang, Visual interpretation of hand gestures for Human–Computer Interaction: a review, IEEE PAMI 19 (7) (1997 (July)) 677 – 695.
R. Azuma, Augmented reality: approaches and technical challenges, in: Woodrow Barfield, Thomas Caudell (Eds.), Fundamentals of Wearable Computers and Augmented Reality, vol. 2, Lawrence Erlbaum Associates, 2001, pp. 27 – 63.
Baker, S., Kelly, R. M., Waycott, J., Carrasco, R., Hoang, T., Batchelor, F., Ozanne, E., Dow, B., Warburton, J., & Vetere, F. (2019). Interrogating social virtual reality as a communication medium for older adults. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), 1–24. https://doi.org/10.1145/3359251
Wang, K. J., Zhang, L., Luan, B., Tung, H. W., Liu, Q., Wei, J., Sun, M., & Mao, Z. H. (2019). Human-centered, ergonomic wearable device with computer vision augmented intelligence for VR multimodal human-smart home object interaction [Paper presentation]. IEEE International Conference on Rehabilitation Robotics, 1073–1078. https://doi.org/10.1109/ICORR.2017.8009392
Zhao, Y., Bennett, C., Benko, H., Cutrell, E., Hloz, C., Morris, M., & Sinclair, M. (2018). Enabling people with visual impairments to navigate virtual reality with a haptic and auditory cane simulation [Paper presentation]. Proceedings of the CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3173574.3173690
Zhao, Y., Cutrell, E., Holz, C., Morris, M. R., Ofek, E., & Wilson, A. D. (2019). SeeingVR: A set of tools to make virtual reality more accessible to people with low vision [Paper presentation]. Proceedings of the Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3290605.3300341
Zheng, H., & Motti, V. G. (2018). Assisting students with intellectual and developmental disabilities in inclusive education with Smartwatches [Paper presentation]. Proceedings of the CHI Conference on Human Factors in Computing Systems, 2018-April, 1–12. https://doi.org/10.1145/3173574.3173924
R. M. Prakash, T. Deepa, T. Gunasundari and N. Kasthuri, "Gesture recognition andfingertip detection for human computer interaction", 2017 International Conference on Innovations in Information Embedded and Communication Systems (ICIIECS), pp. 1-4, 2017.
B. J. Boruah, A. K. Talukdar and K. K. Sarma, "Development of a Learning-aid tool using Hand Gesture Based Human Computer Interaction System," 2021 Advanced Communication Technologies and Signal Processing (ACTS), 2021, pp. 1-5, doi: 10.1109/ACTS53447.2021.9708354
Virtual Mouse Event Handling Model using Gesture Recognition. Nishtha Parashar, Danish Samad, Shashi Kumar Verma, IJAST, vol.29 no.03, (2020).
Published
Issue
Section
License
Copyright (c) -1 Narendar Kumar Ale (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
