Published: 2024-08-01
Optimization of Hospital Queue Management Using Priority Queue Algorithm and Reinforcement Learning for Emergency Service Prioritization
DOI: 10.35870/ijsecs.v4i2.2772
Iwan Adhicandra, Safitri Nurhidayati, Tribowo Rachmat Fauzan
Abstract
This study aims to develop and implement an efficient hospital queue management system by integrating the Priority Queue algorithm with Reinforcement Learning (RL). The primary objective is to enhance the prioritization of emergency patients, ensuring that those with the most critical conditions receive timely care. The Priority Queue algorithm facilitates the sorting of patients based on the severity of their medical conditions, while RL enables the system to continuously learn and optimize the queue management process using historical data and real-time feedback. The research methodology includes data collection from hospital queues, algorithm model development, and simulated and real-world data validation. The results demonstrate that the combination of these algorithms significantly reduces waiting times for emergency patients and improves overall hospital operational efficiency. Additionally, implementing this algorithm has increased patient satisfaction due to shorter wait times and more timely services. The study concludes that the Priority Queue algorithm enhanced by RL is an effective solution for hospital queue management and recommends further research on larger scales and with more complex algorithms.
Keywords
Queue Management ; Hospital ; Priority Queue ; Reinforcement Learning
Downloads
Article Information
This article has been peer-reviewed and published in the International Journal Software Engineering and Computer Science (IJSECS). The content is available under the terms of the Creative Commons Attribution 4.0 International License.
-
Issue: Vol. 4 No. 2 (2024)
-
Section: Articles
-
Published: August 1, 2024
-
License: CC BY 4.0
-
Copyright: © 2024 Authors
-
DOI: 10.35870/ijsecs.v4i2.2772
AI Research Hub
This article is indexed and available through various AI-powered research tools and citation platforms. Our AI Research Hub ensures that scholarly work is discoverable, accessible, and easily integrated into the global research ecosystem. By leveraging artificial intelligence for indexing, recommendation, and citation analysis, we enhance the visibility and impact of published research.
Iwan Adhicandra
Informatics Engineering Study Program, Universitas Bakrie, South Jakarta City, Special Capital Region, Indonesia
Safitri Nurhidayati
Economics and Business Study Program, Universitas Muhammadiyah Berau, Berau Regency, East Kalimantan Province, Indonesia
Tribowo Rachmat Fauzan
Logistics Business Study Program, Faculty of Social and Political Sciences, Universitas Padjadjaran, Sumedang Regency, West Java Province, Indonesia
-
Armony, M., Israelit, S., Mandelbaum, A., Marmor, Y., Tseytlin, Y., & Yom-Tov, G. (2015). On patient flow in hospitals: A data-based queueing-science perspective. Stochastic Systems, 5(1), 146-194. https://doi.org/10.1287/14-ssy153
-
Benevento, E., Aloini, D., Squicciarini, N., Dulmin, R., & Mininno, V. (2019). Queue-based features for dynamic waiting time prediction in emergency departments. Measuring Business Excellence, 23(4), 458-471. https://doi.org/10.1108/mbe-12-2018-0108
-
Liang, C. (2016). Queueing management and improving customer experience: Empirical evidence regarding enjoyable queues. Journal of Consumer Marketing, 33(4), 257-268. https://doi.org/10.1108/jcm-07-2014-1073
-
Brown, R. (1988). Calendar queues: A fast 0(1) priority queue implementation for the simulation event set problem. Communications of the ACM, 31(10), 1220-1227. https://doi.org/10.1145/63039.63045
-
Thorup, M. (2007). Equivalence between priority queues and sorting. Journal of the ACM, 54(6), 28. https://doi.org/10.1145/1314690.1314692
-
He, Q., Xie, J., & Zhao, X. (2012). Priority queue with customer upgrades. Naval Research Logistics (NRL), 59(5), 362-375. https://doi.org/10.1002/nav.21494
-
Liu, B., Xie, Q., & Modiano, E. (2019). Reinforcement learning for optimal control of queueing systems. Proceedings of Allerton Conference on Communication, Control, and Computing, 2019. https://doi.org/10.1109/allerton.2019.8919665
-
Maity, I., & Taleb, T. (2022). Resq: Reinforcement learning-based queue allocation in software-defined queuing framework. Journal of Networking and Network Applications, 2(4), 143-152. https://doi.org/10.33969/j-nana.2022.020402
-
Yousif, A., Hassan, H., & Muttasher, G. (2022). Applying reinforcement learning for random early detection algorithm in adaptive queue management systems. Indonesian Journal of Electrical Engineering and Computer Science, 26(3), 1684. https://doi.org/10.11591/ijeecs.v26.i3.pp1684-1691
-
Turnip, H., & Soewondo, P. (2022). Analisis manajemen anggaran pada rumah sakit rujukan di masa pandemi COVID-19. Jurnal Ekonomi Kesehatan Indonesia, 7(2), 124. https://doi.org/10.7454/eki.v7i2.5993
-
Suhartatik, S., Putra, D., Farlinda, S., & Wicaksono, A. (2022). Evaluasi keberhasilan implementasi SIMRS di rumah sakit X Kabupaten Jember dengan pendekatan metode TTF. J-Remi Jurnal Rekam Medik dan Informasi Kesehatan, 3(3), 231-242. https://doi.org/10.25047/j-remi.v3i3.2586
-
Armono, D. (2022). Pengukuran dan Evaluasi Kinerja Lembaga Rumah Sakit dalam Rangka Meningkatkan Kualitas Layanan Publik. Jurnal Aplikasi Bisnis, 19(2), 201-208. https://doi.org/10.20885/jabis.vol19.iss2.art1
-
Cho, Y., & Hong, P. (2023). Applying machine learning to healthcare operations management: CNN-based model for malaria diagnosis. Healthcare, 11(12), 1779. https://doi.org/10.3390/healthcare11121779
-
Elalouf, A., & Wachtel, G. (2021). Queueing problems in emergency departments: A review of practical approaches and research methodologies. Operations Research Forum, 3(1). https://doi.org/10.1007/s43069-021-00114-8
-
Zheng, L., Li, W., Wang, L., & Ou, J. (2023). Development and validation of machine learning-based models for prediction of adolescent idiopathic scoliosis: A retrospective study. Medicine, 102(14), e33441. https://doi.org/10.1097/md.0000000000033441
-
Imran, M., Zaman, U., Imtiaz, J., Fayaz, M., & Gwak, J. (2021). Comprehensive survey of IoT, machine learning, and blockchain for health care applications: A topical assessment for pandemic preparedness, challenges, and solutions. Electronics, 10(20), 2501. https://doi.org/10.3390/electronics10202501
-
Brown, N. (2024). Predicting accurate batch queue wait times on production supercomputers by combining machine learning techniques. Concurrency and Computation: Practice and Experience, 36(15). https://doi.org/10.1002/cpe.8112
-
Tassew, T., & Xu, M. (2022). A comprehensive review of the application of machine learning in medicine and healthcare. TechRxiv Preprints. https://doi.org/10.36227/techrxiv.21204779
-
Mishra, R. (2024). Deep learning techniques for forecasting emergency department patient wait times in healthcare queue systems. Research Square Preprints, 2024. https://doi.org/10.21203/rs.3.rs-4392800/v1
-
Davalos, D. (2024). A conceptual swarm intelligence framework for deriving a global healthcare machine learning model. International Journal of Business and Applied Social Science, 12(27). https://doi.org/10.33642/ijbass.v10n5p2
-
López Martínez, F. E. (2020). A Big Data and Machine Learning Model to Improve Medical Decision Support in Population Health Management (Doctoral dissertation).
-
Hijry, H., & Olawoyin, R. (2021). Predicting patient waiting time in the queue system using deep learning algorithms in the emergency room. International Journal of Industrial Engineering and Operations Management, 03(01), 33-45. https://doi.org/10.46254/j.ieom.20210103
-
Mtange, M. (2023). Log-in, track-it and customer-care: Women’s perspective of queueing technology system in healthcare in Kenya. Jurnal Komunikasi Ikatan Sarjana Komunikasi Indonesia, 8(1), 192-197. https://doi.org/10.25008/jkiski.v8i1.863
-
Septian, E. (2021). Penerapan sistem pelayanan aplikasi pendaftaran online di Rumah Sakit Umum Pusat Dr. Sardjito Yogyakarta. Matra Pembaruan, 5(1), 53-64. https://doi.org/10.21787/mp.5.1.2021.53-64
-
Sherzer, E., Senderovich, A., Baron, O., & Krass, D. (2022). Can machines solve general queueing systems? arXiv Preprint, 2022. https://doi.org/10.48550/arxiv.2202.01729
-
Vucevic, N., Perez-Romero, J., Sallent, O., & Agusti, R. (2007). Reinforcement learning for active queue management in mobile all-IP networks. Proceedings of the IEEE International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC). https://doi.org/10.1109/pimrc.2007.4394713.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Copyright and Licensing Agreement
Authors who publish with this journal agree to the following terms:
1. Copyright Retention and Open Access License
- Authors retain full copyright of their work
- Authors grant the journal right of first publication under the Creative Commons Attribution 4.0 International License (CC BY 4.0)
- This license allows unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited
2. Rights Granted Under CC BY 4.0
Under this license, readers are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, including commercial use
- No additional restrictions — the licensor cannot revoke these freedoms as long as license terms are followed
3. Attribution Requirements
All uses must include:
- Proper citation of the original work
- Link to the Creative Commons license
- Indication if changes were made to the original work
- No suggestion that the licensor endorses the user or their use
4. Additional Distribution Rights
Authors may:
- Deposit the published version in institutional repositories
- Share through academic social networks
- Include in books, monographs, or other publications
- Post on personal or institutional websites
Requirement: All additional distributions must maintain the CC BY 4.0 license and proper attribution.
5. Self-Archiving and Pre-Print Sharing
Authors are encouraged to:
- Share pre-prints and post-prints online
- Deposit in subject-specific repositories (e.g., arXiv, bioRxiv)
- Engage in scholarly communication throughout the publication process
6. Open Access Commitment
This journal provides immediate open access to all content, supporting the global exchange of knowledge without financial, legal, or technical barriers.