Published: 2025-12-01
Deep Learning Based Augmented Reality for 3D Object Recognition
DOI: 10.35870/ijsecs.v5i3.5431
Downloads
Abstract
Augmented Reality (AR) technology is being widely adopted in various fields such as education, entertainment, and creativity. However, there are still some challenges to be overcome in recognizing and rendering three-dimensional (3D) objects accurately and in real-time. We implemented an AR system that utilizes deep learning techniques to recognize 3D objects with improved accuracy levels. Our approach involved training a Convolutional Neural Network (CNN) model using 3D object datasets captured from different viewpoints. The development included designing the network architecture, training the model, evaluating its accuracy, and integrating it into an AR platform based on Unity 3D and Vuforia SDK. The results indicated that the system could achieve recognition of the 3D objects with an average accuracy of 93.7%, precision of 92.4%, and recall of 91.8%, all while keeping response times below 0.8 seconds. Objects with complex geometries like cars and chairs had recognition rates above 94%, while those with similar textures had lower accuracy because of detailed surface complexities. It allows stable interactive visualization of objects in augmented reality even under different lighting conditions and camera angles. Combining deep learning with AR improves the quality of object recognition and provides a more realistic interactive experience. This paper discusses the advances made in AR technology toward better adaptability and efficiency, which can be applied to interactive education, industrial simulation, architecture, and medical fields.
Keywords
Augmented Reality ; Deep Learning ; Object Recognition ; 3D ; Convolutional Neural Network
Article Information
This article has been peer-reviewed and published in the International Journal Software Engineering and Computer Science (IJSECS). The content is available under the terms of the Creative Commons Attribution 4.0 International License.
-
Issue: Vol. 5 No. 3 (2025)
-
Section: Articles
-
Published: %750 %e, %2025
-
License: CC BY 4.0
-
Copyright: © 2025 Authors
-
DOI: 10.35870/ijsecs.v5i3.5431
AI Research Hub
This article is indexed and available through various AI-powered research tools and citation platforms. Our AI Research Hub ensures that scholarly work is discoverable, accessible, and easily integrated into the global research ecosystem. By leveraging artificial intelligence for indexing, recommendation, and citation analysis, we enhance the visibility and impact of published research.
Muhamad Ziaul Haq
Informatics Study Programs, Universitas Muhammadiyah Palu, Palu City, Central Sulawesi Province, Indonesia
Nursalim Nursalim
Informatics Study Programs, Universitas Muhammadiyah Palu, Palu City, Central Sulawesi Province, Indonesia
-
Ghasemi, Y., Jeong, H., Choi, S. H., Park, K. B., & Lee, J. Y. (2022). Deep learning-based object detection in augmented reality: A systematic review. Computers in Industry, 139, 103661. https://doi.org/10.1016/j.compind.2022.103661
-
Park, K. B., Kim, M., Choi, S. H., & Lee, J. Y. (2020). Deep learning-based smart task assistance in wearable augmented reality. Robotics and Computer-Integrated Manufacturing, 63, 101887. https://doi.org/10.1016/j.rcim.2019.101887
-
Park, K. B., Choi, S. H., Kim, M., & Lee, J. Y. (2020). Deep learning-based mobile augmented reality for task assistance using 3D spatial mapping and snapshot-based RGB-D data. Computers & Industrial Engineering, 146, 106585. https://doi.org/10.1016/j.cie.2020.106585
-
Cheng, Q., Zhang, S., Bo, S., Chen, D., & Zhang, H. (2020). Augmented reality dynamic image recognition technology based on deep learning algorithm. IEEE Access, 8, 137370–137384. https://doi.org/10.1109/ACCESS.2020.3012130
-
Wang, S., Zargar, S. A., & Yuan, F. G. (2021). Augmented reality for enhanced visual inspection through knowledge-based deep learning. Structural Health Monitoring, 20(1), 426–442. https://doi.org/10.1177/1475921720976986
-
Raj, S., Murthy, L. R. D., Shanmugam, T. A., Kumar, G., Chakrabarti, A., & Biswas, P. (2024). Augmented reality and deep learning based system for assisting assembly process. Journal on Multimodal User Interfaces, 18(1), 119–133. https://doi.org/10.1007/s12193-023-00428-3
-
Kastner, L., Frasineanu, V. C., & Lambrecht, J. (2020). A 3D-deep-learning-based augmented reality calibration method for robotic environments using depth sensor data. Proceedings - IEEE International Conference on Robotics and Automation, 1135–1141. https://doi.org/10.1109/ICRA40945.2020.9197155
-
Hsu, S. H., Hung, H. T., Lin, Y. Q., & Chang, C. M. (2023). Defect inspection of indoor components in buildings using deep learning object detection and augmented reality. Earthquake Engineering and Engineering Vibration, 22(1), 41–54. https://doi.org/10.1007/s11803-023-2152-5
-
Rupa, C., Srivastava, G., Ganji, B., Tatiparthi, S. P., Maddala, K., Koppu, S., & Chun-Wei Lin, J. (2022). Medicine drug name detection based object recognition using augmented reality. Frontiers in Public Health, 10, 881701. https://doi.org/10.3389/fpubh.2022.881701
-
Egipko, V., Zhdanova, M., Gapon, N., Voronin, V. V., & Semenishchev, E. A. (2024). Real-time deep learning-based object recognition in augmented reality. Proceedings of SPIE, 13000, 171–177. https://doi.org/10.1117/12.3024957
-
Park, K. B., Choi, S. H., & Lee, J. Y. (2024). Self-training based augmented reality for robust 3D object registration and task assistance. Expert Systems with Applications, 238, 122331. https://doi.org/10.1016/j.eswa.2023.122331
-
Lee, T., Jung, C., Lee, K., & Seo, S. (2022). A study on recognizing multi-real world object and estimating 3D position in augmented reality. The Journal of Supercomputing, 78(5), 7509–7528. https://doi.org/10.1007/s11227-021-04161-0
-
Li, V., Amponis, G., Nebel, J.-C., Argyriou, V., Lagkas, T., & Sarigiannidis, P. (2021). Object recognition for augmented reality applications. Azerbaijan Journal of High Performance Computing, 4(1), 15–28. https://doi.org/10.32010/26166127.2021.4.1.15.28
-
Gupta, Y. P., Mukul, & Gupta, N. (2023). Deep learning model based multimedia retrieval and its optimization in augmented reality applications. Multimedia Tools and Applications, 82(6), 8447–8466. https://doi.org/10.1007/s11042-022-13555-y
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
1. Copyright Retention and Open Access License
Authors retain copyright of their work and grant the journal non-exclusive right of first publication under the Creative Commons Attribution 4.0 International License (CC BY 4.0).
This license allows unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
2. Rights Granted Under CC BY 4.0
Under this license, readers are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, including commercial use
- No additional restrictions — the licensor cannot revoke these freedoms as long as license terms are followed
3. Attribution Requirements
All uses must include:
- Proper citation of the original work
- Link to the Creative Commons license
- Indication if changes were made to the original work
- No suggestion that the licensor endorses the user or their use
4. Additional Distribution Rights
Authors may:
- Deposit the published version in institutional repositories
- Share through academic social networks
- Include in books, monographs, or other publications
- Post on personal or institutional websites
Requirement: All additional distributions must maintain the CC BY 4.0 license and proper attribution.
5. Self-Archiving and Pre-Print Sharing
Authors are encouraged to:
- Share pre-prints and post-prints online
- Deposit in subject-specific repositories (e.g., arXiv, bioRxiv)
- Engage in scholarly communication throughout the publication process
6. Open Access Commitment
This journal provides immediate open access to all content, supporting the global exchange of knowledge without financial, legal, or technical barriers.