Published: 2025-01-01

Optimasi Deteksi Gerak Bahasa Isyarat dan Ekpresi Wajah Real Time Dengan Metode Random Forest

DOI: 10.35870/jtik.v9i1.3188

Dadang Iskandar Mulyana, Rasiban, Sutisna, Samuel Figo Banase
  • Dadang Iskandar Mulyana: Sekolah Tinggi Ilmu Komputer Cipta Karya Informatika , Affiliation name not available , Indonesia
  • Rasiban: Sekolah Tinggi Ilmu Komputer Cipta Karya Informatika , Affiliation name not available , Indonesia
  • Sutisna: Sekolah Tinggi Ilmu Komputer Cipta Karya Informatika , Affiliation name not available , Indonesia
  • Samuel Figo Banase: Sekolah Tinggi Ilmu Komputer Cipta Karya Informatika , Affiliation name not available , Indonesia
Issue Cover

Downloads

Article Metrics
Share:

Abstract

Sign language is the primary means of communication for deaf individuals, one of the alternative languages used by people with disabilities, and it has evolved from the deaf community. Sign language has many variations, making it something unfamiliar and difficult to interpret for some hearing or uninitiated people. This research aims to develop a real-time sign language motion and facial expression detection system using the Random Forest method. The main challenge in this detection is the complexity and variation of the movements and facial expressions. In this study, MediaPipe is used to extract features from video input, which are then analyzed using the Random Forest algorithm for classification. In this research, the model's evaluation results use a confusion matrix with testing scenarios based on the division of training and testing data. From the model evaluation results, an accuracy of 99% was achieved. This research is expected to help deaf individuals communicate with hearing people, thereby reducing social gaps.

Keywords

Mediapipe ; Random Forest ; Deaf ; Classification

Peer Review Process

This article has undergone a double-blind peer review process to ensure quality and impartiality.

Indexing Information

Discover where this journal is indexed at our indexing page to understand its reach and credibility.

Open Science Badges

This journal supports transparency in research and encourages authors to meet criteria for Open Science Badges by sharing data, materials, or preregistered studies.

How to Cite

Mulyana, D. I., Rasiban, Sutisna, & Banase, S. F. (2025). Optimasi Deteksi Gerak Bahasa Isyarat dan Ekpresi Wajah Real Time Dengan Metode Random Forest. Jurnal JTIK (Jurnal Teknologi Informasi Dan Komunikasi), 9(1), 277-284. https://doi.org/10.35870/jtik.v9i1.3188
Article Information

This article has been peer-reviewed and published in the Jurnal JTIK (Jurnal Teknologi Informasi dan Komunikasi). The content is available under the terms of the Creative Commons Attribution 4.0 International License.

  • Issue: Vol. 9 No. 1 (2025)

  • Section: Computer & Communication Science

  • Published: %750 %e, %2025

AI Research Hub

This article is indexed and available through various AI-powered research tools and citation platforms. Our AI Research Hub ensures that scholarly work is discoverable, accessible, and easily integrated into the global research ecosystem. By leveraging artificial intelligence for indexing, recommendation, and citation analysis, we enhance the visibility and impact of published research.

Semantic Scholar Scite Dimensions Connected Papers
Scholarly Connection Platforms
Dimensions Dimensions Connected Papers Connected Papers Scite Scite Google Scholar Google Scholar Semantic Scholar Semantic Scholar Garuda Garuda Scilit Scilit Crossref Crossref BASE BASE Zenodo Zenodo Unpaywall Unpaywall OpenCitations OpenCitations
Author Biographies
Dadang Iskandar Mulyana
Google Scholar ResearchGate ORCID

Program Studi Teknik Informatika, Sekolah Tinggi Ilmu Komputer Cipta Karya Informatika, Kota Jakarta Timur, Daerah Khusus Ibukota Jakarta, Indonesia.

Rasiban
Google Scholar ResearchGate ORCID

Program Studi Teknik Informatika, Sekolah Tinggi Ilmu Komputer Cipta Karya Informatika, Kota Jakarta Timur, Daerah Khusus Ibukota Jakarta, Indonesia.

Sutisna
Google Scholar ResearchGate ORCID

Program Studi Teknik Informatika, Sekolah Tinggi Ilmu Komputer Cipta Karya Informatika, Kota Jakarta Timur, Daerah Khusus Ibukota Jakarta, Indonesia.

Samuel Figo Banase
Google Scholar ResearchGate ORCID

Program Studi Teknik Informatika, Sekolah Tinggi Ilmu Komputer Cipta Karya Informatika, Kota Jakarta Timur, Daerah Khusus Ibukota Jakarta, Indonesia.

References
  • Ardiansyah, A. R., Nur’azizan, A. H., & Fernandis, R. (2024, January). Implementasi Deteksi Bahasa Isyarat Tangan Menggunakan OpenCV dan MediaPipe. In Seminar Nasional Teknologi & Sains (Vol. 3, No. 1, pp. 331-337).
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
  • Goyal, K. (2023). Indian sign language recognition using mediapipe holistic. arXiv preprint arXiv:2304.10256. DOI: https://doi.org/10.48550/arXiv.2304.10256.
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
  • Han, J. S., Lee, C. I., Youn, Y. H., & Kim, S. J. (2022). A study on real-time hand gesture recognition technology by machine learning-based mediapipe. Journal of System and Management Sciences, 12(2), 462-476.
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
  • Kaur, S., Shukla, H. K., Pal, R. K., Yadav, N., & Singh, S. (2022). Human Activity Recognition. International Journal of Scientific Research in Science, 9(3), 161-66.
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
  • Khamdi, N., & Adrafi, M. R. (2022). Sarung Tangan Cerdas Sebagai Translator Bahasa Isyarat untuk Tuna Wicara. Jurnal ELEMENTER (Elektro dan Mesin Terapan), 8(2), 113-122.
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
  • Mulyana, D. I., Lazuardi, M. F., & Yel, M. B. (2022). Deteksi Bahasa Isyarat Dalam Pengenalan Huruf Hijaiyah Dengan Metode YOLOV5. Jurnal Teknik Elektro dan Komputasi (ELKOM), 4(2), 145-151. DOI: https://doi.org/10.32528/elkom.v4i2.8145.
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
  • Nisa, I. M. K., & Nooraeni, R. (2020). Penerapan Metode Random Forest Untuk Klasifikasi Wanita Usia Subur di Perdesaan Dalam Menggunakan Internet (SDKI 2017). Jurnal Matematika Dan Statistika Serta Aplikasinya, 8(1), 72-76.
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
  • Peling, I. B. A., Ariawan, I. M. P. A., & Subiksa, G. B. (2024). Deteksi Bahasa Isyarat Menggunakan Tensorflow Lite dan American Sign Language (ASL). Jurnal Krisnadana, 3(2), 90-100. DOI: https://doi.org/10.58982/krisnadana.v3i2.534.
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
  • Pradikja, M. H., Tolle, H., & Brata, K. C. (2018). Pengembangan Aplikasi Pembelajaran Bahasa Isyarat Berbasis Android Tablet. Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, 2(8), 2877-2885.
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
  • Putri, H. M., Fadlisyah, F., & Fuadi, W. (2022). Pendeteksian Bahasa Isyarat Indonesia Secara Real-Time Menggunakan Long Short-Term Memory (LSTM). Jurnal Teknologi Terapan and Sains 4.0, 3(1), 663-675. DOI: https://doi.org/10.29103/tts.v3i1.6853.
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
  • Rahayuningsih, I., Wibawa, A. D., & Pramunanto, E. (2018). Klasifikasi Bahasa Isyarat Indonesia Berbasis Sinyal EMG Menggunakan Fitur Time Domain (MAV, RMS, VAR, SSI). Jurnal Teknik ITS, 7(1), A175-A180. DOI: 10.12962/j23373539.v7i1.29967.
    Google Scholar Scite Semantic Scholar Scilit Crossref Connected Papers
License & Copyright
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Authors who publish with this journal agree to the following terms:

1. Copyright Retention and Open Access License

Authors retain copyright of their work and grant the journal non-exclusive right of first publication under the Creative Commons Attribution 4.0 International License (CC BY 4.0).

This license allows unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

2. Rights Granted Under CC BY 4.0

Under this license, readers are free to:

  • Share — copy and redistribute the material in any medium or format
  • Adapt — remix, transform, and build upon the material for any purpose, including commercial use
  • No additional restrictions — the licensor cannot revoke these freedoms as long as license terms are followed

3. Attribution Requirements

All uses must include:

  • Proper citation of the original work
  • Link to the Creative Commons license
  • Indication if changes were made to the original work
  • No suggestion that the licensor endorses the user or their use

4. Additional Distribution Rights

Authors may:

  • Deposit the published version in institutional repositories
  • Share through academic social networks
  • Include in books, monographs, or other publications
  • Post on personal or institutional websites

Requirement: All additional distributions must maintain the CC BY 4.0 license and proper attribution.

5. Self-Archiving and Pre-Print Sharing

Authors are encouraged to:

  • Share pre-prints and post-prints online
  • Deposit in subject-specific repositories (e.g., arXiv, bioRxiv)
  • Engage in scholarly communication throughout the publication process

6. Open Access Commitment

This journal provides immediate open access to all content, supporting the global exchange of knowledge without financial, legal, or technical barriers.

Downloads

Similar Articles

You may also start an advanced similarity search for this article.

Most read articles by the same author(s)