Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A scale assessing doctor-patient communication in a context of acute conditions based on a systematic review

  • Mélanie Sustersic ,

    Roles Conceptualization, Investigation, Methodology, Project administration, Supervision, Writing – original draft

    melanie.sustersic@gmail.com

    Affiliations Laboratory of « Techniques de l’Ingénierie Médicale et de la Complexité, Informatique, Mathématiques et Applications », University Grenoble Alps, Grenoble, France, Emergency Department, Groupe Hospitalier Mutualiste, Grenoble, France

  • Aurélie Gauchet,

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliation Laboratory of Psychology, University Grenoble Alps, Grenoble, France

  • Anaïs Kernou ,

    Contributed equally to this work with: Anaïs Kernou, Charlotte Gibert

    Roles Conceptualization, Data curation, Investigation, Writing – original draft

    Affiliation Laboratory of « Techniques de l’Ingénierie Médicale et de la Complexité, Informatique, Mathématiques et Applications », University Grenoble Alps, Grenoble, France

  • Charlotte Gibert ,

    Contributed equally to this work with: Anaïs Kernou, Charlotte Gibert

    Roles Conceptualization, Data curation, Methodology, Writing – review & editing

    Affiliation Laboratory of « Techniques de l’Ingénierie Médicale et de la Complexité, Informatique, Mathématiques et Applications », University Grenoble Alps, Grenoble, France

  • Alison Foote,

    Roles Methodology, Writing – review & editing

    Affiliation Research Division, Grenoble Alps University Hospital, Grenoble, France

  • Céline Vermorel,

    Roles Methodology, Software, Writing – review & editing

    Affiliation Laboratory of « Techniques de l’Ingénierie Médicale et de la Complexité, Informatique, Mathématiques et Applications », University Grenoble Alps, Grenoble, France

  • Jean-Luc Bosson

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliation Laboratory of « Techniques de l’Ingénierie Médicale et de la Complexité, Informatique, Mathématiques et Applications », University Grenoble Alps, Grenoble, France

Abstract

Background

There is no validated generic tool to measure Doctor-Patient-Communication (DPC) in a context of acute conditions.

Objective

To create and validate such a scale in a real population.

Materials and method

We performed a systematic review of validated DPC scales available in English. From these, using a theoretical model based on a multidisciplinary approach, we selected pertinent items that met the inclusion criteria and included them in a simple questionnaire. This tool based on a synthesis of the literature was then validated in a prospective study in two hospital emergency departments.

Results

We found 22 pertinent questionnaires and scoring systems. From these, we extracted items and built a scale based on 15 questions with graded responses (Likert from 1 to 4). The mean time for questionnaire completion was 3 minutes. We included 189 adults and adolescents in the study and analyzed complete responses to the questionnaire by 149 patients, gathered over the phone one week after their consultation. The scale had high internal consistency (Cronbach’s alpha = 0.89) and good external validity. Two questions were removed due to redundancy giving a scale based on 13 questions.

Conclusions

We have created an easy-to-use and validated generic questionnaire to assess DPC in a context of acute conditions, usable both in clinical research and in routine practice.

Introduction

Nowadays, effective Doctor Patient Communication (DPC) is considered as an essential part of patient [1] as an important basic skill for doctors [2] that cannot be delegated [3]. The components of DPC have been extensively studied [46], especially the relationship between how well the doctor communicates with the patient and the results on the patient’s health [3,7,8]. Good communication has been shown to lead to improvements in symptom relief, clinical outcomes, patient behavior [910], and possibly in medication adherence [11]. The assessment of DPC has become a major field of clinical research [1215].

In a review of the literature about DPC, the three most important aspects were: creating a good interpersonal relationship, exchanging information, and making treatment-related decisions that involve the patients in decision-making [13]. A qualitative study of DPC identified three interacting components (“Listening”, “Asking for information”, and “Giving information”) as central and covering two-thirds of the identified interaction types [16].

Adequate content and an appropriate way of providing information are the founding principles of DPC and contribute to the establishment of a relationship of mutual trust [17].

An acute condition (AC) is often the reason for a primary care consultation (Emergency Department) (ED) or primary care practice) and AC management is becoming a major public health issue [18]. The period after an AC consultation is one of high vulnerability for the patient. The information delivered is crucial [19,20] and could lead to complications if neglected [18] Particularly for AC DPC can be difficult since physicians have restricted time for each patient [20] and don’t already know the patient. The medical communication skills required differ from those required in family practice consultations [1820]. The expectations of the patient before a ED visit mostly concern 4 themes: understanding the cause and expected trajectory of their symptoms; reassurance; symptom relief; and receiving a plan to manage their symptoms, resolve their issue, or pursue further medical care [21].

Thus, in such a context, Patient Information Leaflets (PILs) given during a consultation could be very helpful in assisting patients make informed choices, take treatments appropriately, or follow advice on lifestyle changes [7,22]. Its communicative effectiveness, considered as the ultimate criterion for the assessment of PILs [22], should be studied more broadly.

In spite of the large number of DPC scales validated over the last forty years and reviews of literature on this topic [1315], we found no generic scale usable in the context of any acute condition that are well adapted to assess tools such PILs. There are several possible reason for this: either the DPC scale has been developed to assess the competencies of medical students or healthcare providers [4,23,24]; and/or the video or audio recording methods involved are not well suited to an emergency setting where the constraints of time, stress and organization make it necessary to minimize the complexity of the research protocol; and/ or some items were not appropriate in the context of acute conditions (e.g. “Did the doctor ask about all of your health concerns rather than just focusing on the first one you mentioned?" [23]; “The doctor gave me enough chance to talk about all my problems” [25]); and/or some important items were missing (e.g.: "Did the doctor involve you in the decision- making?"[24]), without any scientific justification.

In the medical and psychology literature there is no consensual definition about what DPC is and how it should be measured and no consensus as to a theoretical model that defines the doctor-patient relationship [26], despite the collaboration of experts in the field [5]. Furthermore, definitions of the dimensions to be used (such as ‘trust’, “empathy”) are not unanimous [27], as reflected by the literature search, which uncovered a multitude of heterogeneous scales attempting to characterize DPC.

To fill this gap and to avoid the vagueness of terminology related to this topic, we started from an initial theoretical model we had previously independently developed using a multidisciplinary phenomenological approach [28]. In this model, DPC (e.g. confidence, empathy, reassurance) has psychological, cognitive and emotional effects on patient outcomes (e.g. knowledge, satisfaction, anxiety, behavioral intentions), which impact their behavior (adherence to drug and to non-drug prescriptions, to hygiene and dietary advice; and use of the health care system) and thus on therapeutic outcomes (level of pain, etc.).

Our objective was to develop and validate a DPC scale usable in the context of acute conditions based on a synthesis of the literature and on our theoretical model.

Materials and methods

Literature search

We sought reviews of studies and articles describing validated tools that are currently available to assess DPC during a consultation. Our search covered five databases using four research equations (Fig 1). We restricted articles to those in English published after 1990 for which at least the title and abstract were available. In addition we searched English (NHS) and US (Agency for Healthcare Research and Quality, AHRQ) institutional databases. A manual search was also conducted using the bibliography of selected articles. Searches were last updated in August 2017. Two of the authors independently selected articles, then, together with a third expert, they reassessed the full text of those for which they had not initially concurred.

thumbnail
Fig 1. Literature search equations and selection of evaluation tools.

https://doi.org/10.1371/journal.pone.0192306.g001

Selection criteria for communication scales and items

Starting from the work of Zill et al. and a multidisciplinary model [28] adapted to acute conditions (Fig 2), we drew up a list of inclusion and exclusion criteria see Table 1. The selection criteria focused exclusively on the doctor-patient interaction. Since no single validated scale met all of our criteria, we made a synthesis of items from selected existing scales, avoiding redundancy, to construct a new scale.

thumbnail
Fig 2. DPC theoretical model adapted to acute conditions.

https://doi.org/10.1371/journal.pone.0192306.g002

thumbnail
Table 1. Inclusion and exclusion criteria for scales and items (based on the criteria proposed by Zill et al. and our theoretical model).

https://doi.org/10.1371/journal.pone.0192306.t001

Questionnaire development

The list of selected items was then submitted to a committee of experts made up of doctors, pharmacists, and psychologists (two of whom were bilingual) who pared down the number of items to give a concise, readily useable questionnaire. The main dimensions that emerged were listening, confidence, empathy, decision-making, information and reassurance all listed at the end of the Table 2. The last step was to give coherence to the formulation of the questions such that the answers could be scored using a Likert-type scale from 1 to 4. Sometimes, and only if necessary, this involved expanding the number of response options to four. Then, the final questionnaire was translated into French, and translated back to English by a different bilingual person to verify that there had been no shift in meaning. The first version of the questionnaire was tested in a pilot study on the first 20 patients consulting one of a group of primary care physicians, whatever the pathology diagnosed. Immediately after the consultation patients were asked open questions as to whether they had understood the questionnaire and whether they had any remarks.

thumbnail
Table 2. Scales found assessing DPC in diverse conditions and settings.

https://doi.org/10.1371/journal.pone.0192306.t002

Validation of the questionnaire

Sample size calculation.

Using Confirmatory Factor Analyses and rule-of-thumb, estimates vary from 4 to 10 subjects per variable, with a minimum of 100 subjects to ensure stability of the variance–covariance matrix [29]. Thus, we set the requirement to 10 subjects per item. Since the DPC scale consists of 15 items, this meant the minimal sample size for the purposes of our study was 150. Allowing for 20% of patients potentially lost to follow-up we required 180 patients in total. We stopped the inclusions when the number needed was reached.

Design.

A two-center prospective observational study was conducted from November 2013 to May 2014 in the emergency departments of two hospitals. The study was approved by the regional ethics committee of Clinical Investigation Centers (Rhône Alpes-Auvergne, Clermont Ferrand, Institutional Review Board n°5891 on 31-Oct-2013).

All consenting adults and adolescents (>15 and accompanied by a parent who gave their consent) diagnosed with either an ankle sprain or an acute infectious disease (infectious colitis, pyelonephritis, diverticulitis, prostatitis or pneumonitis) were informed of the study during the consultation, both by the physician and in a patient information letter. We chose these conditions as they are very frequent and are representative of the non-severe trauma and acute infectious diseases seen both in general practice and in emergency departments. The choice of emergency setting enabled us to avoid situations where the doctor already knew the patient. This also helped to maintain some homogeneity in the type of consultation, with physicians who had to work with a high and rapid turnover of patients and did not have the opportunity to improve DPC by prolonging the consultation [20,30]. We excluded patients whose consultation led to hospitalization for more than 48 hours because their care would be managed by the hospital with several doctors caring for them. Patients gave written informed consent to be contacted one week later and if the patient declined to participate, this was recorded in a log. The doctor who saw the patient then included them in the study by completing a short inclusion-case report form describing the patient’s baseline characteristics.

Patients were contacted by telephone 7 to 10 days after the consultation by a doctor who had not participated in patient recruitment. They were asked the series of generic questions on their perception of DPC during the consultation; the amount of information they had received, their adherence to treatment and/or the doctor’s recommendations. Patient data and answers were anonymized before double entry in an Excel database.

Statistical analysis.

Statistical analysis was performed using Stata Version 13.0 (Stata Corp, College Station, Texas) software for OSX. Categorical variables are expressed as numbers and percentages and continuous variables as the medians and interquartile range (IQR) [25th and 75th percentiles]. To evaluate our DPC score, the consistency of the items was assessed by Cronbach’s alpha, giving an index between 0 and 1, followed by an unrotated Principal Component Analysis (PCA). The limitations of Cronbach’s alpha have been debated [31]. The main issue underlined by Sijtma is that the coefficient underestimates the reliability of a questionnaire, which was not a restriction for our purpose [31]. In psychometrics studies, PCA is often rotated in order to better understand and interpret component loadings. Nevertheless, this was not the purpose of our study, which is why we used an unrotated PCA.

Results

The DPC questionnaire

Our literature search lead to 22 selected scales (Fig 1). The dimensions they covered are listed in Table 2. The final questionnaire contained 15 items see Table 3 with 4 possible answers: no, possibly no, possibly yes, and yes, rated according to a Likert-type scale (1 to 4 points) to avoid the non-committal response inherent to 5 possible replies. The fifteen-item questionnaire (DPC 15) tested in the pilot study was well understood and took about 3 minutes to complete.

Clinical study

Population.

We included 189 patients. Of these patients, 12 were erroneously included (underage, hospitalization > 48 hours) and 21 were lost to follow-up (12%). Data from 156 patients were analyzed and 149 patients answered all questions. The patients were divided into two groups according to the diagnosis: ankle sprain: 83 patients (53.2%) and infection: 73 patients (46.8%) (Fig 3). Table 4 shows the characteristics of the patients and the median score of DPC-13 and DPC-15 questionnaires. The high level of response indicates the feasibility of use of the questionnaire.

thumbnail
Table 4. Characteristics of patients included in the validation study and DPC score values.

https://doi.org/10.1371/journal.pone.0192306.t004

Internal and external validity of the DPC questionnaire.

Cronbach’s alpha was calculated for 149 of the 156 patients, because 7 patients did not answer all the questions. Alpha was calculated as 0.89, indicating good internal consistency of the questionnaire (> 0.8). The correlation coefficients for items 11 ("Do you think the doctor was in general respectful?"), 13 ("Do you think the doctor told the whole truth?") and 2 (“Did the doctor allow you to talk without interrupting you?”) were weaker (r<0.45) see Table 5.

thumbnail
Table 5. Internal coherence of the scale: Correlation score and Cronbach’s alpha score for each item.

https://doi.org/10.1371/journal.pone.0192306.t005

The Principal Component Analysis showed a "butterfly wing" distribution of items for Component 2, showing that the items were exploring the same dimension. Fig 4 shows the PCA. Its two main components are: component 1, with an eigen value of 6.2 and a proportion of explained variance of 0.42; and Component 2 with an eigen value of 1.4 and an explained variance of 0.10. Supporting information S1 Table presents the contribution of each variable to the two main components of the score.

From the statistical results, and after discussion with a multidisciplinary committee, items 11 and 13 of “DPC 15”, often misunderstood by patients, with low coefficients of correlation and redundant in the principal component analysis with item 2 ("Did the doctor stop you while you were talking?") were removed in the final version. The final scale thus includes 13 questions each rated from 1 to 4: DPC-13.

For external validity, DPC is one of the determinants of adherence to treatment [32] and we found a correlation between DPC and adherence (article submitted).

Discussion

Characteristics of the new DPC scale

The new scale we developed has several advantages: 1) it is concise (time required to answer is 3 minutes on average) which is important for research, particularly in an emergency setting (13 items compared to 98 in scales such as the "Family-Centered Care Self-Assessment Tool"), 2) the closed answers make it easy to use, 3) it is independent of the acute condition, 4) it results from a multidisciplinary collaboration and 5) it is based on a theoretical model. The DPC-scale had good internal coherence [33].

The median score for DPC-15 was 52/60 reflecting positive results. At a later stage it will be important to determine whether these good results are related to the particular hospital, to the type of clinical situations studied (acute diseases) or to the DPC itself, and in what proportions.

The high participation rate of patients confirmed that this scale was easy to use and well accepted. The percentage of patients lost to follow-up was low (12%). Only two patients refused to participate and none interrupted the telephone interview. We should mention that information as to whether the patient is seen alone or accompanied should be noted as this may interfere with DPC [23].

Strengths

Although we started from a theoretical model to facilitate our choices (inclusion/exclusion) of items [28], our premise was to consider the exhaustive list of items characterizing DPC coming from 30 years of research in medicine, pharmacy and psychology. Thus by engaging a multidisciplinary team of physicians, pharmacists and health psychologists to make a synthesis of previous work it was possible to build a generic scale that respected our inclusion criteria without omitting any essential concepts. Although only articles in English were included, we believe our literature search covered all main aspects, as confirmed by comparison with literature reviews on the subject and the considerable work of the AHRQ [34]. The scales were from many countries (United States, Switzerland, Australia, and the UK) and cover a period of 30 years of research (the oldest listed scale was from 1988). Furthermore, we achieved saturation after analyzing the 11 tools in the “AHRQ Atlas”; further searches failing to augment the number of relevant items. Thus we consider what we found as representative of the diverse aspects of DPC.

Comparison with other scales

The main differences between this and other scales concern both the methodological choices used to develop the scale (based both on a synthesis of the literature and on a theoretical model) and/or also in the items selected.

Although the development process for the Communication Assessment Tool (CAT) was similar to ours, with a review of frequently used models and tools, it was developed in the context of teaching and assessing physicians’ and medical students’ communication skills, which was one of our exclusion criteria [24]. We compared the scale we had derived from the literature review (DPC 15) to the CAT scale. Our DPC scale covered all of the CAT items, but the CAT does not cover all of our items. Furthermore, according to a the literature13 some important items are missing in the CAT (e.g. "Did the doctor involve you in the decision-making?" “Do you have confidence in the doctor?”).

Although consultation length is a key feature of many DPC scales, such as the GPPS (“the doctor giving you enough time”), the CAT (“the doctor spent the right amount of time with me” or the QQPPI questionnaire [25] (“the doctor spent sufficient time on my consultation”), we decided to exclude these items, as they seem inappropriate for acute conditions. Even though the doctor may have “spent enough time with the patient” they may not have responded to the patient’s communication expectations. Moreover, a very recent study points out that there is no association between consultation length and patient experience of communication [35,36]. It suggests that we should no longer include items related to the perception of time spent in consultation in DPC scales. Similarly, items such as eye contact weren’t included as this is difficult to measure without video recording the consultation and difficult to assess by patient self-reporting. To keep the questionnaire short and easy to use, we restricted items to those directly related to DPC and did not include organizational aspects.

Overall, despite some similarities between our scale and those developed by other authors such as Makoul (CAT) or Bieber (QQPPI), existing scales did not meet our requirements and justify the development of a scale for acute conditions.

A recent study proposes a new general scale for assessing tools such as PILs [37]. However, it does not attempt to measure doctor-patient communication specifically, but a broader range of outcomes in the same time (emotional, cognitive and behavioral), possibly because the elaboration of this scale was not based on any preliminary theoretical model.

Limitations

All the tools we extracted from the “AHRQ Atlas”[34], although validated, were not found by our systematic review. The field of DPC is extremely broad extending over several disciplines, with several thousands of articles published. This obliged us to use filters in our literature searches, which may have restricted exhaustivity.

Regarding our selection of tools, it seemed appropriate to take the patient’s point of view when evaluating DPC [30,38,39]. A patient’s experience will more directly predict their behavior (adherence, compliance with given advice) than the doctor’s point of view [39,40]. Self-evaluation is frequently used in clinical practice as it gives more reproducible results, is more reliable, less expensive and less invasive than direct measurements [22,28,37,38,41]. However, it would be interesting to explore the physician’s point of view about DPC in a further study, since the expectations and perceptions of the patient and of the physician may be very different [42,43].

The study coordinator received no non-inclusion forms. This may be explained by the lack of time in ED. Moreover, it is possible that patients lost to follow-up (who could not be contacted by telephone after 3 attempts) were the ones least satisfied with the consultation. This inclusion bias may lead to an over-estimated of results.

To limit the subjectivity biases, the investigator who assessed DPC was independent of the emergency department.

For reasons of feasibility, we limited our study to 6 AC corresponding to 2 subgroups of pathology (trauma versus infection) that are very different clinical situations in age and sex (ankle sprain in the young man and infection in older woman). The heterogeneity of the population, representative of these two clinical situations, does not affect the DPC scores that are comparable for the two subgroups, for the response rates and for the feasibility of the study. Nevertheless, these two clinical situations do not represent the totality of the clinical situations and the patient profiles encountered in the ED or primary care setting and it would be interesting in future works to extend the research to other clinical situations and / or populations.

Conclusion

This new DPC scale could open new perspectives in clinical research for assessing the impact of any tools aimed at improving DPC during a consultation for acute conditions, where patients are the first to suffer from a lack of information [28]. This tool could be valuable to the research community and enable the results of different studies to be compared, quantitate DPC and correlate its level with other outcomes such as patients’ adherence to treatment, knowledge and/or satisfaction in the particular context of acute conditions.

Supporting information

S1 Table. The contribution of each variable to the two principal components of the score.

https://doi.org/10.1371/journal.pone.0192306.s001

(DOCX)

Acknowledgments

We thank Amelie Duvert and Laure Gonnet for participating in the data collection, and Gérard Arlaud, André Bittar, Nicolas Pinsault, Hugo Terrisse and Joyce Lainé for reading the manuscript.

References

  1. 1. Richard C, Lussier MT. [Professional communication in Health]. 2nd edition.Saint-Laurent, Quebec, Canada: Editions du Renouveau pedagogique; 2016.
  2. 2. Beck RS, Daughtridge R, Sloane PD. Physician-patient communication in the primary care office: a systematic review. J Am Board Fam Pract. 2002;15(1):25–38. pmid:11841136
  3. 3. Simpson M, Buckman R, Stewart M, Maguire P, Lipkin M, Novack D, Till J. Doctor–patient communication: the Toronto consensus statement. Brit Med J 1991;303:1385–7. pmid:1760608
  4. 4. Fossli J, Dahl FA, Safran DG, Garratt AM, Krupat E, Finset A, Gulbrandsen P. The ability of a behaviour-specific patient questionnaire to identify poorly performing doctors. BMJ Qual Saf. 2011: 20 (10): 885–93.Ogden J, Moatti JP. [Health Psychology] Bruxelles: De Boeck; 2008. pmid:21849336
  5. 5. Makoul G. Essential elements of communication in medical encounters: the Kalamazoo consensus statement. Acad Med 2001;76:390–3. pmid:11299158
  6. 6. Garratt AM, Bjærtnes A, Krogstad U, Gulbrandsen P. The OutPatient Experiences Questionnaire (OPEQ): data quality, reliability, and validity in patients attending 52 Norwegian hospitals. Qual Saf Health Care 2005;14;433–7. pmid:16326790
  7. 7. Rao JK, Anderson LA, Inui TS, Frankel RM. Communication interventions make a difference in conversations between physicians and patients: a systematic review of the evidence. Med Care 2007;45:340–9. pmid:17496718
  8. 8. Stewart M, Brown JB, Boon H, Galajda J, Meredith L, Sangster M. Evidence on patient–doctor communication. Cancer Prev Control 1999;3:25–30. pmid:10474749
  9. 9. Burt J, Abel G, Elmore N, Campbell J, Roland M, Benson J, Silverman J. Assessing communication quality of consultations in primary care: initial reliability of the Global Consultation Rating Scale, based on the Calgary-Cambridge Guide to the Medical Interview. BMJ Open. 2014;4:e004339. pmid:24604483
  10. 10. Gauchet A, Tarquinio C, Fischer G. Psychosocial predictors of medication adherence among persons living with HIV. Int J Behav Med. 2007;14(3):141–50. pmid:18062057
  11. 11. World Health Organization (WH0), 2003. Adherence to long-term therapies. Evidence for action [Internet]. 2003. http://whqlibdoc.who.int/publications/2003/9241545992.pdf
  12. 12. Ha JF, Longnecker N. Doctor patient communication: a review. Ochsner J. 2010;10(1):38–43. pmid:21603354
  13. 13. Ong LML, De Haes JCJM, Hoos AM, Lammes FB. Doctor Patient communication: a review of the literature. Soc Sci Med. 1995;40(7):903–18. pmid:7792630
  14. 14. Zill JM, Christalle E, Müller E, Härter M, Dirmaier J, Scholl I. Measurement of Physician-Patient Communication—A Systematic Review. Plos One. 2014. 9(12): e112637. pmid:25532118
  15. 15. Boon H, Stewart M. Patient-physician communication assessment instruments: 1986 to 1996 in review. Patient Educ Couns. 1998;35: 161–176. pmid:9887849
  16. 16. Nowak P. Synthesis of qualitative linguistic research—A pilot review integrating and generalizing findings on doctor–patient interaction. Patient Educ Couns. 2011;82(3):429–41. pmid:21295936
  17. 17. Krucien N, Levaillant M, Pelletier-Fleury N. [Do the changes in care choices correspond to the needs of primary care users?] Quest d’economie Sante. 2011;163.
  18. 18. Ackermann S, Bingisser MB, Heierle A, Langewitz W, Hertwig R, Bingisser R. Discharge communication in the emergency department: physicians underestimate the time needed. Swiss Med Wkly. 2012: 142:w13588. pmid:22685014
  19. 19. Musso MW, Perret JN, Sanders T, et al. Patients’ Comprehension of Their Emergency Department Encounter: A Pilot Study Using Physician Observers. Ann Emerg Med. 2015;65:151–5.e4. pmid:25233813
  20. 20. Simmons S, Sharp B, Fowler J, Fowkes H, Paz-Arabo P, Dilt-Skaggs MK, Singal B, Carter T. Mind the (knowledge) gap: The effect of a communication instrument on emergency department patients’ comprehension of and satisfaction with care. Patient Educ Couns. 2015; 98: 257–262. pmid:25468394
  21. 21. Vaillancourt S, Seaton MB, Schull MJ, Cheng AHY, Beaton DE, Laupacis A, et al. Patients’ Perspectives on Outcomes of Care After Discharge From the Emergency Department: A Qualitative Study. Ann Emerg Med 2017.
  22. 22. Garner M, Ning Z, Francis J. A framework for the evaluation of patient information leaflets: framework for the evaluation of PILs. Health Expect. 2012;15:283–294. pmid:21332620
  23. 23. Gulbrandsen P, Krupat E, Benth JS, Garratt A, Safran DG, Finset A, Frankel R. “Four Habits” goes abroad: Report from a pilot study in Norway. Patient Educ Couns. 2008; 72: 388–393. pmid:18619759
  24. 24. Makoul G, Krupat E, Chang CH. Measuring patient views of physician communication skills: Development and testing of the Communication Assessment Tool; Patient Educ Couns. 2007; 67:333–342. pmid:17574367
  25. 25. Bieber C, Müller KG, Nicolai J, Hartmann M, Eich W. How Does Your Doctor Talk with You? Preliminary Validation of a Brief Patient Self-Report Questionnaire on the Quality of Physician–Patient Interaction. J Clin Psychol Med Settings. 2010;17:125–136. pmid:20217195
  26. 26. Ridd M, Shaw A, Lewis G, Salisbury C, The patient doctor relationship: a synthesis of the qualitative literature on patients’perspectives. Br J Gen Pract. 2009; 59:116–133.
  27. 27. Fournier C, Kerzanet S. [Doctor-patient communication and patient education, related notions in the literature]. 2007;19: 413.
  28. 28. Sustersic M, Gauchet A, Foote A, Bosson JL. How best to use and evaluate Patient Information Leaflets given during a consultation: a systematic review of literature reviews Health Expect 2016; 1–12. 37]
  29. 29. Kline R. Principe and practice of equation structural modeling. New York: The Guilford Press. 2011.
  30. 30. Bos N, Sizmur S, Graham C, Van Stel HF. The accident and emergency department questionnaire: a measure for patients’ experiences in the accident and emergency department. BMJ Qual Saf. 2013;22:139–146. pmid:22942399
  31. 31. Sijtma K. On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha. Psychometrika. 2009; 74: 107–120. pmid:20037639
  32. 32. Gauchet A, Tarquinio C, Fischer G. Psychosocial predictors of medication adherence among persons living with HIV. Int J Behav Med. 2007;14(3):141–50. pmid:18062057
  33. 33. Bland JM, Altman DG. Cronbach’s alpha. Br Med J. 1997;314.
  34. 34. AHRQ. Care Coordination Measures Atlas [Internet]. Agency for Healthcare Research and Quality; 2010. http://www.cshcndata.org/docs/drc/ahrq-care-coordination-atlas-dec-2010.pdf
  35. 35. Elemore N, Burt J, Abel G, Maratos FA, Montague J, Campbell J, Roland M. Investigating the relationship between consultation length and patient experience: a cross-sectional study in primary care. Br J Gen Pract. 2016. http://bjgp.org/content/early/2016/10/24/bjgp16X687733.full.print
  36. 36. Sustersic M, Foote A, Bosson JL. Consultation length should not be included in communication scales. The BMJ. Nov 2016. http://www.bmj.com/content/355/bmj.i5744/rr
  37. 37. Hölzel LP, Ries Z, Dirmaier J, Zill JM, Kriston L, Klesse C, Härter M, Bermejo I. Usefulness scale for patient material (USE)- development and psychometrics properties. BMC Med Inform Decis Mak. 2015;15:34. pmid:25927192
  38. 38. Henbest RJ, Stewart MA. Patient-centredness in the consultation. 1: A method for measurement. Fam pract. 1998; 6: 249–253.
  39. 39. Hudon C, Fortin M, Haggerty JL, Lambert M, Poitras M-E. Measuring Patients’ Perceptions of Patient-Centered Care: A Systematic Review of Tools for Family Medicine. Ann Fam Med. 2011;9(2):155–64. pmid:21403143
  40. 40. Dedianne MC, Hauzanneau P, Labarere J, Moreau A. [Doctor-Patient relationship in Primary Care: what are the expectations of patients?] Rev Prat. 2003;17:611.
  41. 41. DiMatteo MR. Variations in patients’ adherence to medical recommendations: a quantitative review of 50 years of research. Med Care 2004;42:200–9. pmid:15076819
  42. 42. Clack GB, Allen J, Cooper D, O Head J. Personality differences between doctors and their patients: implications for the teaching of communication skills. Med Educ. 2004;38:177–86. pmid:14871388
  43. 43. Moreau A, Dedianne MC, Labarere N. [Expectations and perceptions of the quality of the doctor-patient relationship] Rev Prat Médecine Générale. 2004;18:674–5.