Skip to main content

Measuring patient satisfaction in an outpatient psychiatric clinic. What factors play a role?

Abstract

Introduction

Patient satisfaction is defined as the perception that one’s general health care needs are being met. Prior research suggests that positive patient satisfaction with health care facilitates the physician–patient relationship and enhances quality of life.

Objective

The primary purpose of this study was to assess patient satisfaction (as measured by the Patient Satisfaction Questionnaire (PSQ-18)) of patients observed by general psychiatry residents and to examine the effects of depression and anxiety on patient satisfaction. A secondary purpose was to explore the effects of three 1-h mentalization-based skills training sessions on the PSQ-18 scores of psychiatric residents. We hypothesized that depressive and anxiety symptoms would negatively impact patient satisfaction. We hypothesized that patients’ satisfaction scores would improve after mentalization training.

Methods

This was a prospective case–controlled study, enrolling adult patients (n = 157) referred for psychiatric assessment in a psychiatric resident outpatient clinic. The primary outcome was patient satisfaction as measured by the PSQ-18. This outcome was compared to anxiety and depression symptoms as measured by the Patient Health Questionnaire (PHQ-9) and Generalized Anxiety Disorder 7-Item scale (GAD-7) questionnaires. Outcome data from the PSQ-18 were compared among residents before and after they completed mentalization training. The data were analyzed with univariate analyses and multiple linear regression.

Results

Overall the patients were satisfied with clinician communication and interpersonal manner (4.21 ± 0.66 and 4.15 ± 0.69, respectively). The patients score on PHQ-9 was inversely related to their scores on time spent (TS) (p = 0.01) and accessibility/convenience (AC) (p = 0.0009) subscales of the PSQ-18. GAD-7 score was inversely related to patients scores on AC subscale (p = 0.01). Brief mentalization training for the providers did not impact patient satisfaction scores.

Conclusions

Our study reveals that depression and anxiety can negatively impact PSQ-18 patient scoring in psychiatric outpatients observed for the first time in a resident clinic. However, this study failed to show that a brief mentalization-based training could improve patient satisfaction scores that were already quite high at baseline.

Introduction

Patient satisfaction is defined as the extent to which patients perceive their general health care and medical needs are being met [1]. Most health care providers are aware of the great importance of patient satisfaction in facilitating the provider–patient relationship. Different instruments have been used to measure satisfaction [2, 3]. Recently, there has been an increased effort to use patient satisfaction as one of the several measures of the overall quality of health care [1, 2], and with the approval of the Affordable Care Act (ACA) in the United States, patient satisfaction is now tied to reimbursement in some cases [3].

The clinician’s ability to explain, listen, and empathize is thought not only to impact patient satisfaction and experience of care but also to affect functional health outcomes [4, 5]. However, there is growing evidence that other factors outside the doctor–patient relationship influence patient satisfaction [6, 7].

Several studies have looked at patient’s satisfaction in psychiatric settings [8,9,10,11,12]. Kelstrup et al. sent 274 German patients a questionnaire concerning satisfaction with psychiatric treatment 1 month after their discharge from a psychiatric hospital. Patients, who were diagnosed as suffering from affective disorders or from reactive psychoses, were more satisfied than patients with schizophrenia, paranoia, or with transitory adjustment reactions. Patients who had no personality disorder diagnosis and patients with character neurosis were more satisfied than patients with antisocial or borderline personality disorders. Patients on antidepressant medication were much more satisfied than other patients [8]. More recently, Gebhardt et al. evaluated 113 German patients at time of discharge from a psychiatric hospital. They found that patient satisfaction was dependent on symptom severity, global functioning at discharge, pharmacologic disturbances during treatment, and on the diagnostic group [11]. An Indian study of 60 individuals utilized a cross-sectional study design to evaluate patient satisfaction in an outpatient setting utilizing the patient satisfaction questionnaire. They also found that patient’s satisfaction was correlated to illness severity [10].

A review of 6 randomized trials of participants with major depression treated with various antidepressant medication found a correlation between patient satisfaction and patient improvement in depressive symptoms [13]. Other studies have noted patient satisfaction correlated to disease type, age, educational level, level of anxiety, and pain level [12, 14, 15]. Many of these factors are out of a providers control on an initial visit; however, improving a provider’s ability to empathically communicate could be a way to impact patient satisfaction despite comorbidities and treatment outcomes [4, 5, 14].

The concept of mentalizing was introduced as a theoretical model in the 1970s [16]. However, more recently the concept of “theory of mind” has matured through neurobiological studies (mirror neurons theory) and developmental psychology [17]. Mentalization, at a very basic level, is defined as an ability to hold another’s mind within one’s own [16]. It comes from a well-defined concept of “empathy” described in psychoanalytic literature by Greenson et al. [18, 19]. The ability to communicate empathically is an important skill in every doctor–patient interaction, including those devoted primarily to prescribing and monitoring medication. Empathetic communication can increase the patient’s perception that they are being understood and getting their needs met, thus improving the patient’s satisfaction with the encounter [4, 5, 20, 22].

This study sought to examine Patient’s Satisfaction Questionnaire (PSQ-18) measures and their relationship to depression and anxiety symptom severity (as assessed with the PHQ-9 and GAD-7). A secondary aim of the study was to assess the impact of physician mentalization training on PSQ-18 outcomes. We hypothesized that the more depressed and anxious the patient, the lower their average provider satisfaction rating. We also hypothesized that provider empathy training based on teaching basic skills of mentalization could improve empathic communication, thus improving patient satisfaction scores.

Materials and methods

This was a prospective case–controlled study performed among patients being observed for an “initial” psychiatric evaluation in an outpatient resident clinic at a major psychiatric center located in Minnesota. This study was reviewed by Mayo Clinic internal review board (IRB) and found to have minimal risk (i.e., the probability and magnitude of harm or discomfort anticipated in the research were not greater than that ordinarily encountered in the daily life of the general population or during the performance of routine physical or psychological examinations or tests). This study included male and female patients 18 years or older who provided informed consent. Recruitment was performed using a brochure given to the patient by the desk receptionist that described this study and its objectives. This study excluded patients who were unable to provide informed consent due to cognitive or language barriers. Patients with diagnoses of schizophrenia, delusional disorder or psychotic disorder not otherwise specified (NOS), and those with traumatic brain injury, other organic brain syndromes, mental retardation, pervasive developmental disorders, dementia, or active addiction or prescription use of barbiturates, benzodiazepines, opiates, hallucinogens, stimulants, and/or cocaine at the time of appointment were also excluded from this study.

Third-year general psychiatry residents who agreed to participate (5/8) received three 50 min mentalization-based therapy (MBT) teaching sessions. Patients’ satisfaction was evaluated before and after the physician MBT training to observe if the training itself improved patient’s satisfaction scores. All patients enrolled were new to the clinic. Subsequently, patient’s satisfaction scores prior to the MBT training were acquired from a different set of patients than the patient's satisfaction scores after the MBT training. Patients were blinded to the training status of their provider.

Diagnostic evaluations and procedures

Prescreening and enrollment

Psychiatry residents, in their 3rd year of residency, who consented to participate in this study attended three 50-min sessions on mentalization-based therapy (MBT) led by the same senior faculty member for all residents to assure that everyone received comparable training. Ultimately, 5 out of 8 residents chose to participate. This was a voluntary activity and demographic information from the participating residents was not specifically analyzed. The sessions consisted of discussing the basic theory of MBT, mock interviews, and homework assignments to practice mentalization with friends and family between the meetings. All new patients at the resident clinic were invited to participate in the patient satisfaction portion. Once patients were identified, study personnel reviewed their medical record and current medication list to ensure they qualified to participate. Subjects who met enrollment criteria were included in this study and were given the Patient’s Satisfaction Questionnaire (PSQ-18) after the appointment with their resident provider. Chart review was done to obtain demographic information.

Screening measures

Patient’s satisfaction questionnaire (PSQ-18) is an 18-item questionnaire designed to assess the patient’s overall satisfaction with a clinician. The PSQ-18 evaluates a patient’s perceptions of their providers technical quality, interpersonal manner, communication (doctor–patient), cost effectiveness, time spent with patient, convenience, accessibility, and overall satisfaction. The PSQ-18 was designed using 18 questions to ensure rapid completion (2–3 min) and has been used successfully in several studies with various populations to ascertain patient satisfaction [5,6,7,8,9,10,11,12].

Results

Patient’s description

157 (90 pre- and 67 post-physician training) patients were enrolled in this study out of an eligible pool of 209. The residents observed different patients before their training and after their training. Patients had a mean age of 41.2 (± 15.4) years. 60% of patients were married, 29% single, and 11% were either divorced or widowed. 57% of patients were employed. 33% of patients met criteria for an axis II diagnosis based on clinician assessment. There was no significant difference in demographics between the group of patients observed by residents pre- and post-mentalization training 13% versus 31% (p = 0.01). There was no significant difference between the patient groups in alcohol use (measured by the Alcohol Use Disorders Identification Test (AUDIT) (3.7 ± 5.2 with training vs 2.2 ± 2.5 without training; p = 0.088), Depressive symptom (PHQ-9) (10.9 ± 5.9 vs 11.5 ± 7.2; p = 0.735), or anxiety (GAD-7) (9.5 ± 5.9 vs 10.3 ± 7.2, p = 0.513) (see Table 1 for details).

Table 1 Clinical and demographic characteristics of patients evaluated by physicians with and without mentalization training

Patient’s satisfaction questionnaire (PSQ-18)

The patients were mostly satisfied with clinician communication and interpersonal manner (PSQ-18 average scores of 4.21 ± 0.66 and 4.15 ± 0.69, respectively). To examine whether depression and anxiety ratings influenced the patients’ perception of the quality of medical care, we used Pearson correlation test for PHQ-9 and GAD-7 ratings (see Table 2). The data had a normal distribution. PSQ-18 scores on time spent (TS) and accessibility/convenience (AC) were inversely correlated with higher PHQ-9 scores (see Table 2) (p = 0.01 and 0.0009, respectively). This showed that if patients were more depressed, they were less likely to find that their clinicians were accessible and spent adequate time with them. Regarding anxiety symptoms, the patients score on the GAD-7 was inversely related to their scores on the accessibility and convenience (AC) subscale of the PSQ-18 (p = 0.01). This demonstrates that if patients were more anxious, they were less likely to find their doctor accessible.

Table 2 PHQ-9 and GAD-7 scores compared to PSQ-18 sub-scores

There was good correlation generally in all the PHQ-18 subscales as noted in Table 3. There was no significant difference between the composite PSQ-18 rating before or after the mentalization training (see Fig. 1). Generally, there was no difference in the individual subscales pre-mentalization training and post-training as noted in Table 4.

Table 3 PHQ-18 items
Fig. 1
figure 1

The difference between average PSQ-18 scores before and after brief resident Mentalization training. There was no difference between average patient PSQ-18 scores before and after brief resident Mentalization training (p = 0.439)

Table 4 Comparison of PSQ-18 scales by mentalization training (in the total sample, females, and males)

Discussion

Our study’s goal was to evaluate patient satisfaction in an outpatient psychiatry resident clinic and support the premise that mentalization training can be a helpful part of improving patient satisfaction. Our study shows that the patients observed in the general outpatient clinic had an overall favorable impression of their clinicians even prior to MBT training (average was a 4/5). However, our study also shows that patients observed in an outpatient psychiatry clinic are more likely to be displeased with time-related parameters. Consistent with previously cited studies, depressed patients are more likely to be impatient and frustrated with both the accessibility and the amount of time their clinician spends with them. Furthermore, anxious patients are more likely to find their physicians inaccessible [6,7,8,9,10,11,12,13,14,15, 21, 22]. Given these results, the use of patient satisfaction questionnaires to measure physician performance in a setting where anxiety and depression dominate the patients presenting symptomology should be administered and interpreted with extreme caution (especially in accessibility and time spent parameters).

This study was intended to be a brief introduction to mentalization techniques and not a comprehensive tutelage on the complex subject. The intervention was designed to be simple and short to accommodate practical didactic limitations of an average residency training program. Although our brief training of residents in mentalization strategies did not significantly improve their already high patient rating scale results, we were able to show that mentalization strategies can be easily incorporated into the residency didactic setting.

Limitations

Regarding the correlation between depression, anxiety, and patient satisfaction, this study was limited by the relatively small sample size, limited single assessment of patient satisfaction, and lack of information on other factors that could be limiting the level of satisfaction (i.e., pain). Regarding the assessment of the impact of mentalization training, this study had significant limitations. The relatively short intervention of three educational sessions might have contributed to the lack of PSQ-18 improvement post-training. It is reasonable to hypothesize that the non-significant trends in PSQ-18 scores noted would have reached significance had the resident training been more extensive. It could also be argued that the PSQ-18 was not the best way to evaluate the physician’s ability to build a good therapeutic alliance through mentalization strategies. Another limitation was that we did not measure the resident’s degree of mastery of the mentalization strategy. It is possible that despite being taught the techniques, they did not learn them well enough to put them into practice. Another important source of bias to consider is that mentalization training was based on resident interest (vs. randomizing trainees to training or no training).

Conclusions

Despite these limitations, this study supports the findings of previous studies showing that individuals with depression and anxiety are more likely to be less satisfied with their providers and highlights the difficulties of measuring patient satisfaction in patients with depression and anxiety. This study was unable to demonstrate improvement in patient satisfaction after providers received brief mentalization training. However, this study introduces an approach to defining and measuring the benefits of mentalization training for psychiatry residents that was effectively implemented into the resident’s curriculum.

Suggestions for future studies

Future studies should try and asses more robust mentalization training to a larger, more diverse physician population. Furthermore, future studies should add an evaluation of learner’s mastery of the concepts to observe if it correlates to improvements in outcome measure. Other studies might also include other outcome measures besides the PSQ-18 to evaluate the quality of the doctor–patient interaction.

Availability of data and materials

The datasets during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ACA:

Affordable Care Act

AC:

Accessibility and convenience

AUDIT:

Alcohol Use Disorders Identification Test

CO:

Communication

GAD-7:

Generalized Anxiety Disorder 7-Item scale

FS:

Financial aspects

GS:

General satisfaction

IRB:

Internal review board

IM:

Interpersonal manner

MBT:

Mentalization-based therapy

NOS:

Not otherwise specified

PSQ-18:

Patient Satisfaction Questionnaire

PHQ-9:

Patient Health Questionnaire

TQ:

Technical quality

TS:

Time spent

References

  1. McMillan SS, et al. Patient-centered approaches to health care: a systematic review of randomized controlled trials. Med Care Res Rev. 2013;70:567–96.

    Article  Google Scholar 

  2. National Quality Measures, C. Patients’ satisfaction with care: patients' overall rating of their physician. http://www.qualitymeasures.ahrq.gov/content.aspx?id=26774; http://www.hcahpsonline.org. Accessed 9 May 2013.

  3. Berghofer G, Lang A, Henkel H, Schmidl F, Rudas S, Schmitz M. Satisfaction of inpatients and outpatients with staff, environment, and other patients. Psychiatr Serv. 2001;52(1):104–6.

    CAS  Article  Google Scholar 

  4. Bowers MR, Swan JE, Koehler WF. What attributes determine quality and satisfaction with health care delivery? Health Care Manage Rev. 1994;19(4):49–55.

    CAS  Article  Google Scholar 

  5. Marshall GN, Hays RD. The patient satisfaction Questionnaire Short-form (PSQ-18). Santa Monica: Rand Publication; 1994.

    Google Scholar 

  6. Like R, Zyzanski SJ. Patient satisfaction with the clinical encounter: social psychological determinants. Soc Sci Med. 1987;24(4):351–7.

    CAS  Article  Google Scholar 

  7. Hueston WJ, Mainous III AG, Schilling R. Patients with personality disorders: functional status, health care utilization, and satisfaction with care. J Family Pract. 1996;42(1):54–60.

    CAS  Google Scholar 

  8. Kelstrup A, et al. Satisfaction with care reported by psychiatric inpatients. Relationship to diagnosis and medical treatment. Acta Psychiatr Scand. 1993;87(6):374–9.

    CAS  Article  Google Scholar 

  9. Valdes-Stauber J. Patient satisfaction with psychiatric outpatient services—results of an eight-year survey at a German outpatient service. Nervenheilkunde. 2010;29(3):150–6.

    Article  Google Scholar 

  10. Holikatti PC, Kar N, et al. A study on patient satisfaction with psychiatric services (0019–5545 (Print)).

  11. Gebhardt S, Wolak AM, Huber MT. Patient satisfaction and clinical parameters in psychiatric inpatients—the prevailing role of symptom severity and pharmacologic disturbances. Compr Psychiatry. 2013;54(1):53–60.

    Article  Google Scholar 

  12. Werkkala CM, Bäckmand HM, Kuosmanen LM, Vastamäki MH, Rajala TH, Lindqvist PR, Jylhä PJ. Efficacy of a real-time patient feedback system: patient satisfaction study in psychiatry. Nord J Psychiatry. 2020;74(2):155–62. https://doi.org/10.1080/08039488.2019.1684989.

    Article  PubMed  Google Scholar 

  13. Demyttenaere K, Reines EH, et al. Satisfaction with medication is correlated with outcome but not persistence in patients treated with placebo, escitalopram, or serotonin-norepinephrine reuptake inhibitors: a post hoc analysis. Prim Care Companion CNS Disord. 2011. https://doi.org/10.4088/PCC.10m01080 (155-7780 (Electronic)).

    Article  PubMed  PubMed Central  Google Scholar 

  14. Jackson JL, Chamberlin J, Kroenke K. Predictors of patient satisfaction. Soc Sci Med. 2001;52:609–20.

    CAS  Article  Google Scholar 

  15. Garratt AM, Danielsen K, Hunskaar S. Patient satisfaction questionnaires for primary care out-of-hours services: a systematic review. Br J Gen Pract. 2007;57:741–7.

    PubMed  PubMed Central  Google Scholar 

  16. Choi-Kain LW, Gunderson JG. Mentalization: ontogeny, assessment, and application in the treatment of borderline personality disorder. Am J Psychiatry. 2008;165(9):1127–35 (Epub 2008 Aug 1).

    Article  Google Scholar 

  17. Jankowiak-Siuda K, Rymarczyk K, Grabowska A. How we empathize with others: a neurobiological perspective. Med Sci Monit. 2011;17(1):RA18-24 (Review).

    Article  Google Scholar 

  18. Greenson RR. Empathy and its vicissitudes. Int J Psycho-Anal. 1960;41:418–24.

    Google Scholar 

  19. Sugarman A. Mentalization, insightfulness, and therapeutic action. The importance of mental organization. Int J Psychoanal. 2006;87(Pt 4):965–87.

    Article  Google Scholar 

  20. Neumann M, Scheffer C, Tauschel D, Lutz G, Wirtz M, Edelhäuser F. Physician empathy: definition, outcome-relevance and its measurement in patient care and medical education. GMS Z Med Ausbild. 2012;29(1):Doc11 (Epub 2012 Feb 15. English, German).

    PubMed  PubMed Central  Google Scholar 

  21. Yildirim A. The importance of patient satisfaction and health-related quality of life after renal transplantation. Transplant Proc. 2006;38:2831–4.

    CAS  Article  Google Scholar 

  22. Greenson RR. Loving, hating and indifference toward the patient. Int Rev Psychoanal. 1974;1:259–66.

    Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

No funding for this project was provided.

Author information

Affiliations

Authors

Contributions

MR initiated the project, developed the protocols, helped write the paper, and helped recruit staff. BC and PC provided general support to the project and reviewed manuscript versions offering significant input. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Tyler S. Oesterle.

Ethics declarations

Ethics approval and consent to participate

This study was approved by Mayo Clinic IRB as IRB Application #: 10-007225, under the title “The use of mentalization in outpatient psychiatric clinic. Does residents’ capacity to think psychologically (mentalize) improve their patient–doctor interactions? A Pilot study.” IRB Approval Date: 11/23/2010. All participants signed IRB approved consent forms prior to starting the study. This study was approved for expedited review procedures (45 CFR 46.110, item 7). The Reviewer conducted a risk–benefit analysis and determined the study constitutes minimal risk research. The Reviewer determined that this research satisfies the requirements of 45 CFR 46.111. The Reviewer noted that oral consent with HIPAA authorization is appropriate for this study. The written HIPAA form was reviewed and approved with revisions.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Romanowicz, M., Oesterle, T.S., Croarkin, P.E. et al. Measuring patient satisfaction in an outpatient psychiatric clinic. What factors play a role?. Ann Gen Psychiatry 21, 2 (2022). https://doi.org/10.1186/s12991-022-00379-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12991-022-00379-1

Keywords

  • Patient satisfaction
  • Psychiatry
  • Resident clinic
  • Depression
  • Anxiety
  • Mentalization