Document Type : Original Article
Authors
1
Ph.D. Student, Department of Information Technology Management, Central Tehran Branch, Islamic Azad University, Tehran, Iran.
2
Associate Professor, Department of Industrial Management, Central Tehran Branch, Islamic Azad University, Tehran, Iran.
3
Professor, Department of Industrial Management, Science and Research Branch, Islamic Azad University, Tehran, Iran.
4
Assistant Professor, Department of Information Technology Management, Central Tehran Branch, Islamic Azad University, Tehran, Iran.
Abstract
Introduction: This study presents the elements and methodology of the reinforcement learning model according to the agent-based conceptual model of hospital accreditation in Iran. The elements and methodology of the mentioned model will create a favorable study base for creating a smart and multi-agent hospital accreditation system and environment simulation trends to provide efficient guidelines to relevant agents and policymakers. This study aims to address the main research questions concerning the uncertainties related to the reinforcement learning elements and the methodology selection in a multi-agent socio-technical system.
Methods: To collect the necessary information to understand the elements and identify hospital accreditation processes, agents, the environment, and their interactions, systematic reviews of sources, scientific document reviews, and semi-structured interviews with experts were conducted. Interviewees were selected from university faculty members, hospital managers, and quality improvement officers through a targeted non-random snowball sampling method. The interviews were summarized using grounded-theory-based methods and a sequential and systematic approach. The characteristics of the machine learning process were collected using a systematic review method from the "Iran Hospital Accreditation Guide 2022". The process of selecting the features was done by correctly choosing the output features of the model, which are the actions of the agent. The list of agent actions was extracted as a general non-binary tree based on the classification of the tree structure from the conceptual content of the document.
Findings: The extracted reinforcement learning model seeks to find the optimal chains of operational actions under conditions where quantitative data of the hospital are available. The most important elements of the model are:
Set of States: Hospital accreditation factors such as input variables, output variables, indicators, parameters, and fixed numbers related to the metrics of each conceptual agent in the "Iran Hospital Accreditation Guide 2022".
Set of Actions: Actions of intelligent agents in each reinforcement learning episode, paths from the hierarchically clustered binary tree, which are operational actions that can be performed in the hospital per set of state features.
Reward Function: "Obtaining the highest possible score in the hospital ranking system by performing the least number of necessary actions."
Policy Function: Based on the learning process of each agent, it relies on a DQN deep neural network and a gradient reduction algorithm.
Operational Agents: The operational goal of each conceptual agent is "maximizing the accreditation points of the metrics of the relevant field by recommending the least measures."
General Cycle of the Model: In this structure, each intelligent agent, a subset of the nine conceptual agents, has a multi-layered neural network. The characteristics of related states are entered into this neural network, and in the output, based on the special policy function definition of that agent, a map of optimal actions is created according to the agent's current conditions and states.
Neural Network Model: The neural network of the intelligent agent is derived from the conceptual agent "management and leadership," specifying the input, hidden, and output layers of the network.
Conclusion: Summarizing the background of related research showed that the approach to designing hospital accreditation models could be divided into two groups: "conceptual models without using intelligent agents" and "conceptual models using intelligence and operating systems". The investigations showed that these studies had the expected results and that the efficiency and effectiveness of the models and processes proposed by them had the necessary validity.
Keywords
Main Subjects
)