Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Capturing multi-stage fuzzy uncertainties in hybrid system dynamics and agent-based models for enhancing policy implementation in health systems research

Abstract

Background

In practical research, it was found that most people made health-related decisions not based on numerical data but on perceptions. Examples include the perceptions and their corresponding linguistic values of health risks such as, smoking, syringe sharing, eating energy-dense food, drinking sugar-sweetened beverages etc. For the sake of understanding the mechanisms that affect the implementations of health-related interventions, we employ fuzzy variables to quantify linguistic variable in healthcare modeling where we employ an integrated system dynamics and agent-based model.

Methodology

In a nonlinear causal-driven simulation environment driven by feedback loops, we mathematically demonstrate how interventions at an aggregate level affect the dynamics of linguistic variables that are captured by fuzzy agents and how interactions among fuzzy agents, at the same time, affect the formation of different clusters(groups) that are targeted by specific interventions.

Results

In this paper, we provide an innovative framework to capture multi-stage fuzzy uncertainties manifested among interacting heterogeneous agents (individuals) and intervention decisions that affect homogeneous agents (groups of individuals) in a hybrid model that combines an agent-based simulation model (ABM) and a system dynamics models (SDM). Having built the platform to incorporate high-dimension data in a hybrid ABM/SDM model, this paper demonstrates how one can obtain the state variable behaviors in the SDM and the corresponding values of linguistic variables in the ABM.

Conclusions

This research provides a way to incorporate high-dimension data in a hybrid ABM/SDM model. This research not only enriches the application of fuzzy set theory by capturing the dynamics of variables associated with interacting fuzzy agents that lead to aggregate behaviors but also informs implementation research by enabling the incorporation of linguistic variables at both individual and institutional levels, which makes unstructured linguistic data meaningful and quantifiable in a simulation environment. This research can help practitioners and decision makers to gain better understanding on the dynamics and complexities of precision intervention in healthcare. It can aid the improvement of the optimal allocation of resources for targeted group (s) and the achievement of maximum utility. As this technology becomes more mature, one can design policy flight simulators by which policy/intervention designers can test a variety of assumptions when they evaluate different alternatives interventions.

Introduction: Background and motivation

Implementation research has become popular since the beginning of the 21st century. It translates research findings into sustainable interventions [1]. Policy design and the implementation of interventions were traditionally based on evidence-based research (with limited data) along with the feedback from implementation efforts. When using this approach, the obtained "evidence" is typically not sufficient to fully implement a designed policy that leads to health interventions. It has to go through the three steps, i.e., principle adoption, early implementation, and implementation persistence [2]. However, there are multi-stage uncertainties in stakeholder decision making during implementation (Fig 1).

thumbnail
Fig 1. Multi-stage uncertainties manifested in stakeholder decision-making processes during implementation.

https://doi.org/10.1371/journal.pone.0194687.g001

However, data obtained from different sources of socioeconomic systems, especially at the individual level, contain enormous amounts of unstructured data that depict people's decision-making process and consequently their behaviors [3, 4]. It was found that most people made health-related decisions not based on numerical data but based on perceptions [58]. Examples include the perceptions and their corresponding linguistic values of health risks such as, smoking, syringe sharing, eating energy-dense food, drinking sugar-sweetened beverages etc. Therefore, to better understand the mechanisms that affect the continued implementation of health interventions, we employ fuzzy variables to quantify linguistic variables in healthcare modeling [912].

In traditional evidence-based research (e.g., randomized clinical trial-RCT) and the ensuing modeling processes, structured data allow researchers and policy makers to define individuals' perceptions and behaviors using crisp variables. These crisp variables result in coarser granularity when identifying target intervention groups. The design of relevant interventions might ignore the needs of individuals or small groups that cannot be identified in the large groups that are defined under the coarse-granularity screening. In this case, the policy implementation can cause social exclusion (where people are worse off as their needs are not identified and addressed) and policy resistance. With the help of linguistic variables that portray individual's characteristics and behaviors, researchers and policy makers can identify groups (clusters) and their needs with the finer-granularity screening. Therefore, customized precise interventions can be implemented on targeted groups [1, 2] (refer to Fig 1).

In the domain of policy implementation research, two simulation approaches, i.e., system dynamics modeling (SD) and agent-based modeling (ABM) are widely employed to better understand the structure of complicated socioeconomic systems and the impact of relevant policies. The major differences between the two simulation approaches are the assumptions on which they are based. ABM focuses on evolution and heterogeneity of interacting agents, and how certain interventions can influence the characteristics, preferences, and behaviors of individuals. No consistent mathematical formalism characterizes ABMs [13]. SD models, on the contrary, have their foundation in ordinary differential equations. A very important feature of the SD approach is that the state variables (stock aggregating homogeneous agents) and flow (to and from) the stock are homogenous. SD is generally used to understand the how decisions or policies such as resource allocations might impact system structure and consequently the behaviors of key variables characterizing the system [14].

During the past two decades, more scholars started to explore the integration of SDM and ABM [15, 16]. Applications in different field have been addressed such as transportation [17], health-related research [1821], psychology [22], work environment [23], ecological modeling [2427]. In order to simultaneously capture characteristics of heterogeneity and homogeneity in modeling complex socioeconomic systems in dynamic simulation environment, two types of hybrid models that combine ABM and SD were explored. In the first type, ABM is used to create the aggregate construct and then SD uses the aggregate structure to generate dynamic behaviors. Specifically, dynamic agents (automata), under given rules, interact with each other in a random manner and change their characteristics (or utility) under the influence of peer agents. As a result, agents with similar features or behaviors will aggregate into a cluster. This constitutes a phase transition from heterogeneity to homogeneity. Based on the cluster characteristics, resource allocation strategies for different interventions are initiated on the homogeneous clusters and system dynamic behaviors are hence explored. As for the second type hybrid model, SD is used at the microscopic level to derive the features (state) of agents (agents could be institutions, processes, etc.) and ABM deals with the interactions of those agents under different rules [28]. In this research, we mainly address fuzzy variables (using them to process unstructured data), their operations, and algorithms with the first type of hybrid model.

Zimmermann stated that: “Uncertainty implies that in a certain situation a person does not dispose about information which quantitatively and qualitatively is appropriate to describe, prescribe or predict deterministically and numerically a system, its behavior or other characteristics” ([29], p. 192). In order to better exploring and understand the complex socioeconomic systems and dynamics of action-reaction of human interventions, many uncertainties have to be captured and manifested. Many theories have been proposed to enhance the modeling of uncertainties. Hartley [30] employed class set theory to explore the measurement of uncertainty. Probability theory was used by Shannon [31] to measure uncertainty. Zadeh, in 1965, proposed fuzzy set theory [3235] to examine the uncertainties related to using linguistic variables in decision-making process. Shafer [36] used evidence theory and Dubois and Prade [37] employed possibility theory to investigate the measurement and modeling of uncertainties. Apparently, fuzzy set theory has been widely recognized and used given the benefits of representing multiple linguistic values associated with a specific variable or phenomenon. One of the basic premises of fuzzy set theory is that it can represent the degree of truth or relevance of a specific phenomenon. The basic definition for fuzzy set is as follows.

Suppose that U is the universe of discourse, for each x ∈ U, the function μ = f(x) ∈ [0,1] holds, the value μ is called the degree of membership of x in set A = {(x,μ) | x ∈ U, μ = f(x), f ⊆ U × [0,1]}, A is called fuzzy set and μ = f(x) is called the membership function of fuzzy set A. If xU, x is not included in fuzzy set A if μ = 0; x is fully included if μ = 1; x is partially included (a degree of membership) in the fuzzy set A [3235].

Thus far, some research has been conducted to apply fuzzy logic to SD models to explore the use of linguistic variables in resource allocations, institution decisions, and policy evaluation [3841]. Few applications of fuzzy logic to ABM were also attempted in the literature [42, 43]. Nevertheless, no research has been conducted that incorporates fuzzy logic especially using high-dimensional data in a hybrid model that combines SD and ABM, let alone providing a mathematical framework. The objective of this research is to provide the mathematical formalism for incorporating fuzzy variables at multiple stages of the first type of a hybrid AGM and SD model discussed earlier that includes interacting fuzzy agents as well as aggregate level resource allocations. The mathematical formulations for 5 types of dynamics are exhibited: 1) the agents characterized by linguistic variables are able to transition from being heterogeneous to homogeneous [44]; 2) differing from a standalone ABM where interventions are preset, the interventions and their impacts in this model are emergent and are affected by the dynamics of the resource allocations that are addressed by the SD model; 3) once fuzzy agents form certain clusters, they are continuously affected by the dynamic allocations until an optimal status is achieved; 4) the formation of clusters of these fuzzy agents also conversely affects the resource allocation dynamics by feeding information back to the SD model part; 5) in the nonlinear-causal loop, the institutional decision-making process that incorporates fuzzy variables is pivotal in driving the dynamics of whole hybrid model. This helps inform and advance implementation research and helps achieve the sustainability of policies and the persistence of implementations [4547].

This research provides three major contributions to the literature and implementation practice of health policies. First of all, it systematically exhibits the way of integrating ABM and SD models in a single hybrid simulation model which, for purpose of optimizing resource allocation in health interventions, helps to simultaneously capture the homogeneity of clustered (segmented) populations at aggregate level and the heterogeneity of agents at individual level. Secondly, it incorporates unstructured data that portray the perceptions, preferences, behaviors, and decisions of individuals into the hybrid simulation model. Last but not the least, this research intends to employ fuzzy set theory to portray linguistic variables that represent individuals' decisions and behaviors. It also describes the way of using high dimensional data in a hybrid simulation model where an individual's decisions and behaviors resulted from dynamics of multiples linguistic variables and interactions.

This paper is organized as follows. In Section 1, we present the background and motivation for conducting this research. Section 2 depicts how linguistic variables are represented as part of interacting agents that are affected by the dynamics of the interventions that are generated from resource allocation decisions. Section 3 depicts how linguistic variables are represented in system dynamics models. The last section concludes this research by discussing issues, challenges, and future research in terms of theory and applications.

Methodology

Interacting, clustering, and decision-making of fuzzy agents

Definition of fuzzy agents in a simulation environment.

In a simulation environment for a hybrid model that combines ABM and SD, A is a set of agents (e.g., interacting individuals) denoted by ai ∈ SA, i ∈ N, where SA = {sa1,…sai,…,san},; based on Zadeh's quintuple definition of linguistic (fuzzy) variables, i.e., , U is the universe of discourse U = {x1, x2,…,xn}, X, for example, is perceived "temperature", T is the set of T = {Low,Medium,High} defined by G which is the syntactic rule for generating linguistic terms, represents the semantic rule of associating a linguistic term with its meaning.

In this research, let the set be the set of q linguistic variables [3235] characterizing the perceptions of given agents. Here, U = {U1, U2,…,U3} and Uj = {xj1, xj2,…,xjn}, Xj is the jth linguistic variable characterizing the ith agent, where qj ∈ N, q is the number of linguistic variables, Tj = {Low,Medium,High} (Tj is the set of linguistic terms defining the jth linguistic variable) ranging over a universe of discourse U associated with the linguistic variable xj(t), where xj(t) is the jth state variable changing over time in the SD simulation environment. For different linguistic variable, the linguistics term/value can be different. For example, if the chosen linguistic variable is "age", the linguistic terms here {young, middle-aged, old}. In the simulation environment, xj(t) represents the value of x(t) at time t of the jth state variable. In some cases, two variables are used in SD simulation environment to accomplish the representation of linguistic variable with one as base variable, i.e., the normal state variable in model and perceived value of base variable. This means xj(t) is a function of time in the given context, where xj(t) ∈ Uj, Uj = {xj1(t),…,xji(t),…,xjn(t)}, j,i ∈ N, Uj stands for the set of values over time that the jth state variable can take; among which, xj(t) ∈ Uj, μj: Uj → [0,1] is the membership function of A and μj(xj(t)) ∈ [0,1] is the degree of membership/belongingness of xj(t) in A. And in this definition, the membership function for each linguistic term of the linguistic variable of particular agent are defined as follows, where for example, μij(xij(t))Low is the "Low" term of jth linguistic variable of ith agent in the simulation environment (referring to Eqs 13 and Fig 2).

(1)(2)(3)
thumbnail
Fig 2. Representation of change over time of high-dimensional n fuzzy agents having q linguistic variables.

https://doi.org/10.1371/journal.pone.0194687.g002

For the purpose of simplicity and to illustrate the concept, all the membership functions in this paper are triangular membership functions with three linguistic terms i.e. Low, Medium, and High. The framework can be easily generalized to use other types of fuzzy membership functions (e.g. trapezoidal, bell-shaped membership functions, or even more complex membership functions). The constants bij, cij, and dij denote the constants defining the triangular membership functions for jth linguistic variable characterizing ith agent in the simulation environment, which are assumed to follow normal distribution X∼N(μ2) denoted by , , respectively(refer to Fig 3).

thumbnail
Fig 3. Normal distribution for the constants defining membership functions of jth linguistic variable of n agents.

https://doi.org/10.1371/journal.pone.0194687.g003

There are three types of dynamics generated by the interventions in the hybrid simulation environment. Impacts exerted by interventions on individuals in the target population generate one type of dynamics. The values of linguistic terms (Low, Medium, and High) of jth linguistic variable of ith agent are determined by the value xij(t) obtained at a certain time period, which is one of the variables that characterize the outcomes of the interventions implemented by institutions (top right of Fig 4). Peer effects driving agents to change their preference and status create another type of dynamics (top left of Fig 4). The third type of dynamics comes from the decision-making process where the agent incorporates the linguistic variables (svl(t) i.e., the capacity of stores serving healthy food in a certain community, svm(t) the capacity of outdoor activity spaces, etc.) and aggregating the linguistic variables that characterize an agent [40]. However, from the perspective of precisely targeted intervention, it is not meaningful to cluster agents with respect to different linguistic variables in all subspaces. The third type of dynamics is mainly examined at the institutional level decision-making that initiates interventions, which are depicted in the SD model in third part of this paper.

thumbnail
Fig 4. Portrayal of the dynamics of fuzzy agents acting based on personal decisions, institutional interventions, and impacts of other peer fuzzy agents.

https://doi.org/10.1371/journal.pone.0194687.g004

For sake of brevity, in the simulation algorithm, we assume that the generation of the above three types of dynamics follows the order that we introduce them in.

Impact of interventions on agents—first dynamic behavior.

In the simulation environment, since the linguistic variable does not necessarily change linearly as defined in the standard definition, the values of the linguistic terms do not exhibit the standard triangular shape. Two examples are provided to demonstrate how linear and nonlinear changes over time affect the behavior of linguistic variables over time.

Example 1: Suppose the change of xij over time is characterized by the function of xij: f(t) = −α * t + β (upper left of Figs 4 and 5) where α,β > 0, the time horizon for the simulation is t4. We substitute xij(t) with −α * t + β. The corresponding membership functions over time are: (4) (5) (6)

By taking the first and second derivatives for Eqs (4)–(6), we have:

Referring to bottom left of Fig 5, for the Low linguistic term μij(xij(t))Low, it is increasing during the time interval [t2,t3] and approaches 1 in the interval [t3,t4]; as for the Medium linguistic term.

μij(xij(t))Medium, it increases during the interval [t1,t2] and decreases on during the time interval [t2,t3]; for the High linguistic term μij(xij(t))High, it decreases during the interval [t1,t2] and approaches 1 during the interval [t0,t1]. Apparently, as xij(t) decreases over time, the Low and High linguistic terms exchange their relative location in the dynamic simulation environment, which consequently challenges the clustering of dynamic agents based on their dynamic membership values. Right side of Fig 5 provides a more complex case.

Example 2: Suppose the change of the linguistic variable xij over time is characterized by the function of xij: g(t) = (upper right of Fig 4) where α,β > 0, the time horizon for the simulation is t4. We substitute xij(t) with exp(β − α * t), now the corresponding membership functions over time are: (7) (8) (9)

By taking the first and second derivatives of Eqs (7)–(9), we have:

The linguistic term μij(xij(t))Low increases and is concave downward in the interval [t2,t3] and approaches 1 in the interval [t3,t4]; μij(xij(t))Medium decreases and is concave upwards during the interval [t2,t3] and increases and is concave downwards in the interval [t1,t2]; μij(xij(t))High decreases and is concave upwards in the interval [t1,t2] and approaches 1 in the interval [t0,t1]. In the system dynamics model, the behavior of the state variables can be more complicated than what we have shown in examples 1 and 2.

Peer effects on interacting agents—second dynamic behavior.

In the proposed hybrid model, there are generally two types of interactions among agents. One case is that agents randomly make contact with certain (e.g., three persons) agents per day and impact each other by exchanging information and changing their preference accordingly. The other case is that agents have a preset relationship with certain agents in a scale-free network [48,49], which means that in the community or designated population a few agents are at the hub of the network and the rest agents do not have many connections. In a scale-free network, the degree distribution follows a power law, i.e. P(k)∼k − q, where k is degree (1 < k < ∞) and q is a parameter with value in the range (2 < q < 3).

Although we demonstrate distinct interacting mechanisms among agents for the abovementioned two cases, the operations associated with multiple linguistic variables characterizing agents in general do not have much difference. For handling the interactions of fuzzy agents, we need to define the rules, i.e., the way in which agents interact and the results that will be obtained as a result of the interactions.

Rule 1: Choosing linguistic term to start with. During the intervention implementation process, in order to achieve the desired outcomes under scarce resources, it is necessary for decision makers to allocate resource to those being worse off as a consequence of previous policies or decisions. For example, minimizing μij(xij(t))Low (e.g., low satisfaction with respect to the outdoor activity space) with high degree of membership could be the priority. Therefore, we simplify the operations of multiple linguistic variables by only taking into consideration the operations of the Low linguistic term of each linguistic variable, which can be easily extended to include other linguistic terms if necessary.

Rule 2: Fuzzy inference. It is assumed that on the average agent makes contact with other k agents per time unit (generally k ≤ 5, time unit = unit of time in the simulation) in a random manner. And it is assumed that the model is simulated over n time units and the start time is defined t0 and end time is p * τ. Three inference rules are defined hereby.

Pessimistic case. In this case, the obtained information from the peer agent negatively affects an agent's decision. Having communicated with other agents, the agent will choose to attain the lower value among them, i.e., the updated value of μij(xij(t0))Low should take the smaller value obtained by them when comparing itself ith agent with the interacting agents (ir)th agent (we assume contact for 5 times).

Please refer to Fig 6 for Algorithm 1.

thumbnail
Fig 6. Pseudo code for the interactions among agents and the operations of linguistic variables.

https://doi.org/10.1371/journal.pone.0194687.g006

Optimistic case. In this case, the updated value of μij(xij(t0))Low will take the higher value obtained by them when comparing itself ith agent to the interacting agents (ir)th agent (we assume contact for 5 times).

Realistic (mediocre) case. In this case, the updated value of μij(xij(t0))Low will take the weighted sum of both values obtained by them. The assignment of weights φ, ω is determined by the constants that define the triangular membership functions for the linguistic variables (Fig 3), which provides the boundary for different the linguistic terms. Based on the definitions, the larger the constants are the less sensitive the agent responds to the change of the state variables (interventions). Upon an interaction, the agent tends to reduce the gap between itself and a peer [50]. Therefore, in the realistic case, an agent with smaller constants that define the linguistic variables attempts to assign larger values to the interacting agent with larger constants for the linguistic variables, i.e. φi < ωi if b(i−r)j > bij.

Clustering of fuzzy agents in subspaces.

Having completed the interactions and information exchange, agents will be clustered in different subspaces based on the linguistic variables that characterize them, which is conducted in a virtual manner (shadow variable) since it is not possible to physically separate an agent into several parts. That is to say, agents could be virtually located in several subspaces when the clustering operation is completed (Fig 5).

In the previous discussion, we simplified the use of linguistic variables to the linguistic term "Low" to reflect how an agent responds to interventions, where μij(x_ij (p * τ))_Low ∈ [0,1] is the final value (after simulation) for the jth linguistic variable of ith agent. It is assumed in following discussion that there are 2 base variables, i.e., two state variables svl(t) and svm(t) that reflect the intervention results in the SD model. Notwithstanding the simplification, this research still faces the challenge of dealing with operations and the clustering of complex high-dimensional data.

Given the fact that the input of resources corresponds the membership value that μij(x_ij (p * τ))_Low actually takes, we use the following intervals to cluster these agents, i.e. 0, (0,0.1], (0.1,0.2],…, (0.8,0.9], (0.9,1.0] (Fig 7).

For agents having linguistic variables falling into the membership range 0, there is no need to allocate resources to these agents. For those who fall into other ranges, their corresponding discrepancies will be fed back to the system dynamics model for next stage simulation, i.e., from Stage0-Stage1 (Fig 8). With a few iterations, most of the agents will become homogeneous (i.e. Stage2 status in Fig 8).

thumbnail
Fig 8. Hybrid simulation model by combining agent-based simulation and system dynamic modeling.

https://doi.org/10.1371/journal.pone.0194687.g008

Institutional resource allocation decision-making

Incorporating linguistic variable into system dynamics model.

The SD model part of the proposed hybrid model is responsible for the resource allocations. In this part, two linguistic variables with respect two different base variables are investigated. This SD model is built on two previous mature models [40, 51]. We also borrowed a partial dataset from them since there is no such implementation for a real case. Fig 9 provides a simplified version that demonstrates how to incorporate linguistic variables into a system dynamics model.

thumbnail
Fig 9. Simplified system dynamics model with two linguistic variables.

https://doi.org/10.1371/journal.pone.0194687.g009

In Fig 9, two state variables COASF − s1(t) and CSSHF − s2(t) are increased by the inflow of building the capacity (φ1 and φ2) and are decreased by the outflow of capacity decaying (λ1 and λ2) where the COASF is the “Capacity of Safe Outdoor Activity Space and Facilities” and CSSHF is the “Capacity of Store Serving Healthy Food”. Intervention implementers make decision based on the interactions of the perceived values of two state variables, which decide how much money will be used for building the capacity of stock (state variables) with fraction p and 1 − p. Based on their expertise and past experiences, they will define a set of rules when manipulating two linguistic variables while considering their significance. (10) (11) where , , d1 and d2 are life years of built capacities.

The inflows φ1 and φ2 are determined by the allocation fraction p and 1 − p and flow of "using investment" ω(t).

(12)(13)

Flow ω(t) is determined by perceived values of x and y, delay3 (d3), and "Investment for building capacity ρ(t)". It is assumed that perceived values of x, y are defined by triangular membership functions as follows (14) (15) (16)

In order to incorporate the two linguistic variables, we need to define rules for the operations of two fuzzy variables (refer to Table 1).

In the system dynamics model, we defined two linguistic variables COASF and CSSHF, each having three linguistic terms. Therefore, in order to fully consider their mutual interaction, nine rules (3 × 3) are evaluated in our model. In the fuzzy logic system, fuzzy rules defined generally represent the knowledge, experiences, and expertise of decision makers or policy makers. Those rules are derived through several mechanisms 1) verbalizing decision maker’s experiences and expertise, 2) conducting a dedicated survey, 3) observing decision makers' behaviors, 4) tracing behavior with wearable sensors, and 5) textual analysis. As decision makers consciously or unconsciously use such rules to respond to particular interventions and/or actions, rules can be recorded when observing their behaviors [29, 40, 52, 53, 54].

The mechanism of the Mamdani controller [55] is used to get the results based on rule evaluations. For instance, two rules apply and are evaluated at certain time τ (referring to Fig 10). By using the center of gravity (COG), we obtain the value zCOG (z represents the rule consequence of fuzzy variables).

thumbnail
Fig 10. Consequence of the rule evaluation of the decision-making process.

https://doi.org/10.1371/journal.pone.0194687.g010

(17) (18) where C is the initial fund in the investment stock, (19)

Substitute (18) into (19) to solve for ω(t), (20) (21) (22) (23) (24)

Take the Laplace transform for (23) and (24), we have (25) (26)

Results

Having discussed all mathematical formulations involved in this hybrid model, Figs 11 and 12 demonstrate the behaviors of two linguistic variables, i.e. COASF and CSSHF (state variables) and partial values of the different terms of the linguistic variables. As mentioned in the previous section, the constants defining the linguistic variables of different agents follow the normal distribution. This is why the obtained values of these linguistic variables behave as represented in the Figs 11 and 12, i.e., multiple lines representing different linguistic terms of different agents. As the display of a whole set will make the line unidentifiable, therefore we just show some typical curves. Based on the aforementioned clustering criteria, these agents could be grouped into different clusters preparing for further interventions.

thumbnail
Fig 11. Behaviors of capacity of safe outdoor activity space and facilities (COASF) in the system dynamics model and corresponding values of the linguistic variables in the agent-based model.

https://doi.org/10.1371/journal.pone.0194687.g011

thumbnail
Fig 12. Behaviors of capacity of store serving healthy food (CSSHF) in the system dynamics model and corresponding values of the linguistic variables in agent-based model.

https://doi.org/10.1371/journal.pone.0194687.g012

Discussion

Due to the unavailability of commercial off-the-shelf simulation tools that can incorporate fuzzy logic into a hybrid model of SDM and ABM, only partial results were demonstrated, which makes the objective of capturing multistage fuzzy uncertainties in decision making for both individuals and institutions very challenging. Although Anylogic® simulation platform does provide limited capability of modeling a hybrid ABM/SD model that incorporates fuzzy logic into the hybrid model, it is not capable of capturing and depicting very complicated dynamics taking into account the uncertainties represented by the linguistic variables for both the agent decision making process and the decision making associated with institutions. It is even harder for the software to carry out optimizations (e.g., resource allocation decisions) in the hybrid model that takes into account multistage uncertainties.

With respect to the modeling of the intervention path (refer to Fig 8), this framework has assumed the path starting from implementing interventions on heterogeneous individuals. These individuals then form different clusters due to the impacts from the interventions and interaction effects (peer effects and communications). Having allocated the necessary resources for the designated clusters for precise intervention (i.e., resource allocation is not evenly distributed to clusters with different characteristics but based on the actual need of a particular group), distinct clusters converge to a single homogeneous cluster for a set of characteristics for which the policy makers or implementers are concerned with. A second intervention path could start by implementing interventions on population with homogeneous characteristics and then focus on individuals with heterogeneous interests. With the ensuing interventions, the impacts on individuals, and influence of agent interactions, the agents form clusters. Additional resource allocations render the clusters with distinct features homogeneous. The last but not the least intervention path could start by implementing interventions on multiple clusters. In this scenario, two dynamics could be investigated with one focusing on modeling the impacts of precisely targeted interventions on individuals of a particular cluster and the other focusing on modeling the dynamic interactions of heterogeneous clusters.

With respect to optimization in the hybrid model, multiple objectives could be considered. The first consideration is to maximize the implementation effectiveness given certain amount of resources appropriated for the intervention. The second consideration is to minimize resources used for interventions by accurately pinpointing pertinent (i.e., satisfying amount of resources for particular group of agents with certain linguistic characteristics) clusters and using appropriate resources accordingly. The third consideration is to maximize implementation effectiveness by optimizing resource allocation for the combination of multiple interventions by identifying characteristics of clusters and implementing precise interventions accordingly.

The next challenge in using this fuzzy hybrid model is to consider the complexity of obtaining big data and converting big data, especially unstructured data into formats that can be used in the simulation model. Since Big data-driven research brings important opportunities for the precise intervention and for customized individual-based healthcare [5658], it helps inform implementation research. The biggest challenge lies that how to translate (textual and linguistic variables) and integrate multiple streams of live population data into simulation environment and generate meaning outputs for support implementation of policies and interventions. In order to capture the uncertainties represented by fuzzy variables at different stages for both the individual and institutional decision making, it is necessary to identify pertinent fuzzy variables and corresponding linguistic values. The questions that need to be answered include but not limited to: which fuzzy variables are critical for tracking the effectiveness of the intervention impact and their use of resources; what are the appropriate dimensions of a fuzzy variable, i.e., what are the appropriate states of human perception with respect to a decision variable (e.g., satisfaction with respect to treatment); how should interacting rules (agent interaction, cluster interaction) be defined when considering multiple fuzzy variables with multiple linguistic values; how should optimization be explored considering the existence of many states of human perception with respect to decision variables and their complex combinations?

Even though many challenges exist, it is very promising to use a fuzzy hybrid model to simultaneously capture heterogeneity and homogeneity and fuzzy uncertainty in the implementation of interventions in complex socioeconomic systems such as transportation system.

Conclusions

This research investigates the use of linguistic variables in multiple stages of a hybrid model that combines an agent-based simulation model and a system dynamics model. We systematically present how to handle high-dimensional unstructured data associated with the implementation of public interventions. This research provides a mathematical framework when modeling and simulating complex socioeconomic systems, and capturing uncertainties using fuzzy logic. This research raises some challenges for in-depth research to consider system optimization, complex interacting mechanisms (networks), increased agent attributes, and the tradeoff between the validity of the results and the requisite modeling efforts.

Supporting information

S1 Dataset. Dataset used for generating Figs 11 and 12.

https://doi.org/10.1371/journal.pone.0194687.s001

(DOCX)

Acknowledgments

We would like to appreciate all the help from my colleagues and friends to polish this paper.

References

  1. 1. Walker AE, Grimshaw J, Johnston M, Pitts N, Steen N, Eccles M. PRIME–Process modeling in Implementation research: selecting a theoretical basis for interventions to change clinical practice. BMC Health Services Research. 2003; 3(22): 1–12.
  2. 2. Tansella M, Thornicroft G. Implementation science: Understanding the translation of evidence into practice. The British Journal of Psychiatry. 2009; 195(4): 283–285,. pmid:19794192
  3. 3. Lazer D, Kennedy R, King G, Vespignani A. The parable of Google flu: Traps in big data analysis. Science. 2014; 343 (14 March):1203–1205. pmid:24626916
  4. 4. Collins B. Big Data and health economics: Strengths, weaknesses, opportunities and threats. Pharmacoeconomics. 2016; 34(2):101–106. pmid:26093888
  5. 5. Oncken C, McKee S, Krishnan-Sarin S, O'Malley S, Mazure CM. Knowledge and perceived risk of smoking-related conditions: a survey of cigarette smokers. Preventive Medicine. 2005;40(6):779–784. pmid:15850879
  6. 6. Smyth BP, Roche A. Recipient syringe sharing and its relationship to social proximity, perception of risk and preparedness to share. Addictive Behaviors. 2007;32(9):1943–1948. pmid:17258399
  7. 7. Moore SE, Harris C, Wimberly Y. Perception of Weight and Threat to Health. Journal of The National Medical Association. 2010; 102(2): 119–124. pmid:20191924
  8. 8. Winter J, Wuppermann A. Do they know what is at risk? Health risk perception among the obese. Health Economics. 2014 May;23(5):564–85. pmid:23661580
  9. 9. Cordón O, Herrera F. A proposal for improving the accuracy of linguistic modeling. IEEE Transactions on Fuzzy Systems. 2000; 8(3):335–344.
  10. 10. Massad E, Regina N, Ortega S, de Barros LC, Struchiner CJ. Fuzzy logic in action: Applications in epidemiology and beyond. New York, USA: Springer 2009.
  11. 11. Rodríguez RM, Martínes L, Herrera F. Hesitant fuzzy linguistic term sets for decision making. IEEE Transactions on Fuzzy Systems. 2012; 20(1): 109–119.
  12. 12. Chiang TC, Liang WH. A context-aware interactive health care system based on ontology and fuzzy inference. Journal of Medical Systems. 2015; 39(9):105–112. pmid:26265236
  13. 13. Grimm V, Berger U, Bastiansen F, Eliassen S, Ginot V, Giske J, et al. A standard protocol for describing individual-based and agent-based models. Ecological Modeling. 2006; 198: 115–126.
  14. 14. Sterman JD. Business dynamics: Systems thinking and modeling for a complex world. Boston, MA, USA: McGraw-Hill, 2000.
  15. 15. Scholl HJ. Agent-based and system dynamics modeling: A call for cross study and joint research. Proceedings of the 34th Hawaii International Conference on System Sciences (HICSS-34)– 2001, Maui, HI, USA, USA, 6–6 Jan. 2001, IEEE. 10.1109/HICSS.2001.926296.
  16. 16. Stemate L, Pasca C, Taylor I. A comparison between system dynamics and agent based modeling and opportunities for cross-fertilization. 2007 Winter Simulation Conference, Washington, DC, 9–12 Dec. 2007, IEEE, 2376–2376. 10.1109/WSC.2007.4419891.
  17. 17. Shafiei E, Stefansson H, Asgeirsson EI, Davidsdottir B, Raberto M. Integrated agent-based and system dynamics modelling for simulation of sustainable mobility. Transport Reviews. 2013; 33(1): 44–70. https://doi.org/10.1080/01441647.2012.745632.
  18. 18. Macal CM. To agent-based simulation from system dynamics. WSC '10 Proceedings of the Winter Simulation Conference. Baltimore, Maryland, December 05–08, 2010; 371–382, IEEE. 10.1109/WSC.2010.5679148.
  19. 19. Djanatliev A, German R, Kolominsky-Rabas P, Hofmann B. Hybrid simulation with loosely coupled system dynamics and agent-based models for prospective health technology assessments. Proceedings—Winter Simulation Conference. 1–12, 9–12 Dec. 2012, Berlin, Germany, IEEE. 10.1109/WSC.2012.6465024.
  20. 20. Figueredo GP, Siebers P-O, Aickelin U, Whitbrook A, Garibaldi JM. Juxtaposition of system dynamics and agent-based simulation for a case study in immunosenescence. PLoS ONE. 2015;10(3): e0118359. https://doi.org/10.1371/journal.pone.0118359. pmid:25807273
  21. 21. Schryver J, Nutaro J, Shankar M. Emulating a system dynamics model with agent-based models: A methodological case study in simulation of diabetes progression. Open Journal of Modelling and Simulation. 2015;3(4):196–214.
  22. 22. Ferrada F, Camarinha-Matos LM. A system dynamics and agent-based approach to model emotions in collaborative networks. In: Camarinha-Matos L., Parreira-Rocha M., Ramezani J. (eds) Technological Innovation for Smart Systems. DoCEIS 2017. IFIP Advances in Information and Communication Technology, 499. Costa de Caparica, Portugal, May 3–5, 2017, Springer, Cham.
  23. 23. Marin M, Zhu Y, Meade PT Sargent M, Warren J. System dynamics and agent-based simulations for workforce climate. Proceedings of the 2006 Winter Simulation Conference. Perrone LF, Wieland FP, Liu J, Lawson BG, Nicol DM, Fujimoto RM, eds. Monterey, CA, USA, 3–6 Dec. 2006, IEEE. 10.1109/WSC.2006.323144.
  24. 24. Teose M, Ahmadizadeh K, O'Mahony E, Smith RL, Lu Z, Ellner SP, et al. Embedding system dynamics in agent based models for complex adaptive systems. Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence. 2531–2538, Barcelona, Spain, from July 16–22, 2011.10.5591/978-1-57735-516-8/IJCAI11-421.
  25. 25. Baki S, Koutiva I, Makropoulos C. A hybrid artificial intelligence modelling framework for the simulation of the complete, socio-technical, urban water system. R. Seppelt, A.A. Voinov, S. Lange, D. Bankamp (Eds.). International Environmental Modelling and Software Society (iEMSs) 2012 International Congress on Environmental Modelling and Software Managing Resources of a Limited Planet, Sixth Biennial Meeting, Leipzig, Germany. http://www.iemss.org/society/index.php/iemss-2012-proceedings
  26. 26. Martin R, Schlüter M. Combining system dynamics and agent-based modeling to analyze social-ecological interactions—an example from modeling restoration of a shallow lake. Frontiers in Environmental Science. 13. https://doi.org/10.3389/fenvs.2015.00066.
  27. 27. Wallentin G, Neuwirth C. Dynamic hybrid modelling: Switching between AB and SD designs of a predator-prey model. Ecological Modelling. 2017; 345:165–175.
  28. 28. Gao A, Osgood ND, An W, Dyck R. A tripartite hybrid model architecture investigating health and cost impacts and intervention tradeoffs for diabetic end-stage renal disease. Proceedings of 2014 Winter Simulation Conference. December 7–10, 2014, Savannah, GA. 12pp.
  29. 29. Zimmermann HJ. An application-oriented view of modeling uncertainty. European Journal of Operational Research. 2000; 122: 190–198.
  30. 30. Hartley RVL. Transmission of information. The Bell Systems Technical Journal. 1928; 7: 535–553.
  31. 31. Shannon CE. A Mathematical Theory of Communication, The Bell Systems Technical Journal. 27, 1948; 379–423 and 623–656.
  32. 32. Zadeh LA. The concept of a linguistic variable and its application to approximate reasoning. Memorandum ERL-M 411, Berkeley, October, 1973.
  33. 33. Zadeh LA. The concept of a linguistic variable and its application to approximate reasoning—I. Information Sciences. 1975a; 8:199–249.
  34. 34. Zadeh LA. The concept of a linguistic variable and its application to approximate reasoning—II. Information Sciences. 1975b; 8:301–357.
  35. 35. Zadeh LA. The concept of a linguistic variable and its application to approximate reasoning—III. Information Sciences. 1975c; 9:43–80.
  36. 36. Shafer G. A Mathematical Theory of Evidence. Princeton, New Jersey, USA. Princeton University Press, 1976.
  37. 37. Dubois D, Prade H. Possibility Theory. New York, NY: Plenum Press, 1988.
  38. 38. Pankaj SK, Sushil . A fuzzy set theoretic approach to qualitative analysis of causal loops in system dynamics. European Journal of Operational Research. 1994; 78(3):380–393.
  39. 39. Kunsch P, Springael J. Simulation with system dynamics and fuzzy reasoning of a tax policy to reduce CO2 emissions in the residential sector. European Journal of Operational Research. 2008; 185(3):1285–1299.
  40. 40. Liu S, Triantis KP, Sarangi S. Representing qualitative variables and their interactions with fuzzy logic in system dynamics modeling. Systems Research and Behavioral Science. 2011;28(3): 245–263.
  41. 41. Liu S, Triantis KP, Sarangi S. A framework for evaluating the dynamic impacts of a congestion pricing policy for a transportation socioeconomic system. Transportation Research Part A: Policy and Practice. 2010; 44(8): 596–608.
  42. 42. Hassan S, Garmendia L, Pavón J. Introducing uncertainty into social simulation: Using fuzzy logic for agent-based modelling. International Journal on Smart Sensing and Intelligent Systems. 2010; 2(2): 118–124.
  43. 43. Izquierdoa LR, Olarub D, Izquierdoc SS, Purchaseb S, Soutarb GN. Fuzzy logic for social simulation using NetLogo. Journal of Artificial Societies and Social Simulation. 2015;18(4):1–31.
  44. 44. Mei S, Zhu Y, Qiu X, Zhou X, Zu Z, Boukhanovsky AV, et al. Individual decision making can drive epidemics: A fuzzy cognitive map study. IEEE Transactions on Fuzzy Systems. 2014;22(2):264–273.
  45. 45. Yager RR. Decision making with fuzzy probability assessments. IEEE Transactions on Fuzzy Systems. 2002;7(4):462–467.
  46. 46. Acton QA. Issues in artificial intelligence, robotics and machine learning. Atlanta, GA, USA, Scholarly Edition, 2013.
  47. 47. Chen CLP, Zhang CY, Gan M. Fuzzy restricted Boltzmann machine for the enhancement of deep learning. IEEE Transactions on Fuzzy Systems. 2015;23(6):2163–2173.
  48. 48. Barabasi AL, Albert R, Jeong H. Emergence of scaling in random network. Science. 1999; 286:509–512. pmid:10521342
  49. 49. Chen D, Liu Q. Contact processes on scale-free networks. Acta Mathematica Sinica, English Series. 2010;26(27):1383–1392.
  50. 50. Gächter S, Nosenzo D, Sefton M. Peer effects in pro-social behavior: Social norms or social preference? Journal of the European Economic Association. 2013;11(3):548–573. pmid:28553193
  51. 51. Liu S, Osgood N, Gao Q, Xue H, Wang Y. Systems simulation model for assessing the sustainability and synergistic impacts of sugar-sweetened beverages tax and revenue recycling on childhood obesity prevention. Journal of the Operational Research Society. 2016; 67(5): 708–721.
  52. 52. Klir GJ, Yuan B. Fuzzy Sets and Fuzzy Logic: Theory and Applications. New York. USA: Prentice Hall, 1995.
  53. 53. Zimmerman HJ. Fuzzy Sets, Decision Making and Expert Systems. Kluwer Academic Publishers: Boston, 1980.
  54. 54. Teodorovic´ D. Fuzzy logic systems for transportation engineering: The state of the art. Transportation Research Part A. 1999; 33(5): 337–364.
  55. 55. Mamdani EH. Application of fuzzy logic to approximate reasoning using linguistic synthesis. IEEE Transactions on Computers. 1977;26:1182–1191.
  56. 56. Chawla NV, Davis DA. Bringing big data to personalized healthcare: A patient-centered framework. Journal of General Internal Medicine. 2013; S3:S660–665.
  57. 57. Murdoch TB, Detsky AS. The inevitable application of big data to health care. JAMA.2013; 309(13):1351–1352. pmid:23549579
  58. 58. Azmak O, Bayer H, Caplin A, Chun M, Glimcher P, Koonin S, et al. Using big data to understand the human condition: The Kavli HUMAN Project. Big Data. 2015; 3(3):173–188. pmid:26487987