Skip to main content
Download PDF
Download ePub

Sequential screening for depression in humanitarian emergencies: a validation study of the Patient Health Questionnaire among Syrian refugees

Annals of General Psychiatry volume 19, Article number: 5 (2020) Cite this article

Abstract

Background

Despite the need for mental health surveillance in humanitarian emergencies, there is a lack of validated instruments. This study evaluated a sequential screening process for major depressive disorder (MDD) using the two- and eight-item Patient Health Questionnaires (PHQ-2 and PHQ-8, respectively).

Methods

This study analyzed data collected during a cross-sectional survey in a Syrian refugee camp in Greece (n = 135). The response rate for each instrument was assessed, and response burden was calculated as the number of items completed. The sequential screening process was simulated to replicate the MDD classifications captured if the PHQ-2 was used to narrow the population receiving the full PHQ-8 assessment. All respondents were screened using the PHQ-2. Only respondents scoring ≥ 2 are considered at risk for symptoms of MDD and complete the remaining six items. The positive and negative percent agreement of this sequential screening process were evaluated.

Results

The PHQ-2, PHQ-2/8 sequential screening process, and PHQ-8 were completed by 91%, 87%, and 84% of respondents, respectively. The sequential screening process had a positive percent agreement of 89% and a negative percent agreement of 100%, and eliminated the need to complete the full PHQ-8 scale for 34 (25%) respondents.

Conclusions

The benefits of the sequential screening approach for the classification of MDD presented here are twofold: preserving classification accuracy relative to the PHQ-2 alone while reducing the response burden of the PHQ-8. This sequential screening approach is a pragmatic strategy for streamlining MDD surveillance in humanitarian emergencies.

Background

Worldwide, 69 million people were forcibly displaced in 2018 [1]. The mental health needs of populations displaced by humanitarian emergencies are a significant yet often overlooked public health problem [2], and are exacerbated by post-migration stressors [3].

The high prevalence of mental health disorders, such as depression, among forcibly displaced populations frequently overwhelms local health system capacity, necessitating the integration of mental health services into the humanitarian response. International guidelines, including those of the Inter-Agency Standing Committee (IASC) [4] and Sphere [5], provide recommendations regarding the provision of mental health services to forcibly displaced populations. Additionally, the World Health Organization (WHO) has launched the comprehensive mental health Gap Action Programme Humanitarian Intervention Guide (mhGAP-HIG) to address the lack of mental health services in humanitarian emergencies, calling for consistent screening and task-shifting to non-specialist health care providers [6]. Efficacious psychological therapies for depression have been evaluated for humanitarian emergencies in low- and middle-income countries [7]; however, forced migrants experience inequitable access to health services relative to the general population [8, 9].

Despite consensus regarding the prioritization of population-level mental health [6, 10], there is no consistent approach to mental health surveillance in humanitarian emergencies. Underdiagnosis for mental health disorders remains higher among forcibly displaced populations compared to the general population [11]. The majority of studies of mental health in humanitarian emergencies include data from instruments with limited or untested validity and reliability among displaced populations [12]. In the absence of locally and culturally validated scales, applying robust standard measures as the first step for screening in emergency contexts may be necessary to expedite the rapid identification of individuals that need services [13]. Evaluations of mental health instruments for epidemiologic surveillance among populations displaced by humanitarian emergencies are therefore urgently needed [14].

As the first step in screening, instruments capturing self-reported symptoms reduce the cost and time requirements of formal clinical diagnostic interviews [15]. The desirability of shorter screening procedures is threefold—first, brief screening instruments reduce the participant response burden; second, shorter instruments may be more readily used in resource-constrained settings because of administration and cost efficiencies; and third, shorter instruments may result in fewer missing responses and thus reductions in the risk of invalidation due to missingness [16]. Overall, ideal screening instruments in humanitarian crises are (1) self-reported or administered by trained non-medical health workers [2], and (2) responsiveness to change [17], with (3) demonstrated acceptable response rate, reliability, and validity in displaced populations [14], (4) and a minimal response burden [16].

The Patient Health Questionnaire (PHQ) diagnostic algorithms incorporate DSM-V depression diagnostic criteria in brief self-report scales that produce estimates of base rates for depressive disorders and are sensitive to change in disorder status over time [18]. Additionally, the PHQ algorithms differentiate major depressive disorder (MDD) from mild and moderate depressive disorder, an important threshold for clinical diagnostic assessments and treatment. Moreover, consistent with the assessment timeframe recommended by the WHO, the questions evaluate symptoms over the last  two weeks [6].

Two approaches to MDD classification using PHQ algorithms have been widely used and validated: the PHQ-8 and PHQ-2. The eight-item version of the PHQ has been used extensively to screen for MDD in epidemiologic research [19, 20], including as an outcome for low-intensity intervention trials [21]. The PHQ-2 is a subset of the PHQ-8 that was developed for use in high-volume settings. The PHQ-8 and the PHQ-2 have both been widely validated in general clinical practice [22] and against a reference interview [23] with good sensitivity and specificity for MDD [17, 19]. Moreover, agreement between the PHQ-8 and PHQ-2 in detecting probable MDD has been demonstrated in a sample of pregnant women in the United States [24].

With the goal of minimizing the response burden while preserving screening validity, we evaluate a third approach: using empirical data, we simulate an MDD classification algorithm whereby individuals are first screened by the PHQ-2 assessment. Individuals flagged as having symptoms consistent with MDD by the PHQ-2 then go on to receive the full PHQ-8 assessment. The sequential screening approach may improve screening efficiency by reducing the number of items administered and managing the number of false-positive cases requiring follow-up [25]. The efficiency of sequential screening for mental disorders has been demonstrated in a primary care setting [25] as well as among refugee populations [26], and specifically using the PHQ-2 followed by the PHQ-8 among post-partum women [27] and an Arabic-speaking primary care population [28].

The objective of this study is to compare the performance of the PHQ-2 and the simulated PHQ-2/8 sequential screening process to classify symptoms consistent with MDD among a sample of Syrian refugees in Greece.

Methods

Data sources

The detailed methods of this study have been previously reported [29]. Briefly, this is an analysis of data collected during a face-to-face cross-sectional survey in a camp designated for Syrian refugees located in the Attica region of Greece in 2017. A mixed sampling procedure, consisting of two phases, was used to enroll a representative sample of 135 participants who were fluent in Arabic. In the first phase of sampling—designed to build trust—camp management announced that a research study was being undertaken on the topic of migrant health and adults were invited to volunteer to participate. Then, all eligible adults from half the housing units were recruited such that an even geographic distribution of the camp population was sampled. A standardized survey, including mental health measures and sociodemographic and displacement characteristics, was administered via a face-to-face interview by a member of the research team paired with Arabic–English interpreters. The survey was translated to and back-translated from Arabic prior to the interview. Participants that reported depressive symptoms in the last  two weeks were referred for assessment by an on-site psychologist.

Major depressive disorder screening

The PHQ-8 is used as a reference standard for MDD classification in this study [19]. The PHQ-8 omits the ninth item of the PHQ-9 assessing suicidal ideation, but has been established to have similar validity in large-scale validation studies [19]. In the most recent validation study of the PHQ-9 in Arabic, the suicidal ideation item was the only item that increased instrument reliability if deleted [30].

The presence of depressive symptoms over the last  two weeks was evaluated by calculating severity scores for each item. On a four-point Likert scale ranging from “not at all” to “nearly every day,” respondents were asked to rate the degree to which each symptom applied to them over the last  two weeks. Items are scored from 0 (not present at all) to 3 (present nearly every day) and with a summary score ranging from 0 to 24. A cut-off score of ≥ 10 is used to classify the presence of MDD; this cut-off score was selected based on the findings of the Arabic validation study of the PHQ-9 [31] and evidence that identical scoring thresholds for depression severity may be used for the PHQ-9 and PHQ-8 [19].

Two approaches to minimize the response burden were simulated: the PHQ-2 and the PHQ-2/8 sequential screening process. The PHQ-2 consists of the first two items of the PHQ-8 and was developed for use in high-volume settings, such as humanitarian emergencies [17]. The PHQ-2 has the same response format as the PHQ-8, with summary scores ranging from 0 to 6 [17]. A previous validation study of the PHQ-2 in Arabic used the cut-off score of ≥ 3 based on the initial validation study [28]. Consistent with the recommendation that screening instrument thresholds be adjusted according to program objectives and capacity for reappraisal of all positive results [13], we examined possible cut-off scores of ≥ 2 and ≥ 3 in order to optimize the positive and negative percent agreement (PPA and NPA, respectively) relative to the PHQ-8 classification using the maximal Youden index for MDD [18, 20, 32].

Sequential screening process

Major depressive disorder screening using the PHQ-2/8 sequential process was simulated with empirical data. The sequential screening process is as follows: (1) Responses to the PHQ-2 are evaluated for all participants. Participants who score below thresholds identified in previous validation studies in the general population in Arabic [28] and English [17] exit the screening process and are classified as “unaffected.” Participants who score above the threshold are considered at risk for symptoms consistent with MDD. (2) Responses to the remaining six items are scored for participants determined to be at risk for symptoms consistent with MDD by the PHQ-2, and are classified according to the PHQ-8 threshold standards.

Statistical analysis

Descriptive statistics were calculated to summarize the psychometric properties. Floor or ceiling effects were defined as > 95% endorsement or < 5% endorsement, respectively. Reliability was measured as internal consistency captured within the PHQ-8 and PHQ-2 with Cronbach’s alpha.

Item response rate was described as the proportion of responses completed per item. Overall response rate was assessed as the proportion of respondents who completed all items in the instrument. Response burden refers to the strain placed on the respondent, often defined by factors such as the cognitive load, response fatigue, the format and mode of administration of the instrument, and the length of the instrument [33]. In this analysis, response burden is operationalized as the number of responses required to complete the screening method.

Respondents for whom four or more (≥ 50%) responses were missing were excluded from further analyses. Multivariate imputation by chained equations, in which missing values are imputed based on an individual’s observed outcome values and degree of similarity to demographic data observed in other participants, was performed for remaining missing values under the missing at random assumption [34].

Validity

This study analyzed aspects of validity relevant to comparisons of subscales with the full instrument, i.e., convergent and concurrent validity, in three ways. First, convergent validity was measured by assessing the likelihood ratio between the PHQ-2 summary score and the binary PHQ-8 classification. Second, concurrent validity, or the degrees to which the nominal MDD classifications obtained by the PHQ-2 and PHQ-2/8 sequential screening process were consistent with the PHQ-8 MDD classifications, was evaluated using Cohen’s kappa [35]. Finally, concurrent validity was assessed as the power of the two items in the PHQ-2 to predict the PHQ-8 classification using the deviance goodness of fit test. The deviance goodness of fit test accounts for the conditional dependence between the MDD classifications produced by the PHQ-2 and PHQ-8 as follows: a saturated logistic model in which the PHQ-8 score predicted the binary PHQ-8 MDD classification is built; then, the fit of a logistic model for the binary PHQ-8 MDD classification predicted by the PHQ-2 summary score is compared against the saturated model with the deviance goodness of fit test. By comparing the residual deviance against the χ2 distribution, the deviance goodness of fit test evaluates the fitted model against the saturated model [36]. The deviance test null hypothesis is that the PHQ-2 summary score adequately predicts MDD classification while the alternative hypothesis is that the model lacks an essential predictor. The deviance test accounted for the imperfect nature of the reference test and the assumed conditional dependence between the PHQ-2 and the reference test results.

We assessed systematic error in MDD classification between the PHQ-2 and PHQ-2/8 sequential screening process and the PHQ-8 with McNemar’s test. To compare the PHQ-2 and PHQ-2/8 sequential screening process, we evaluated their discriminate validity relative to the PHQ-8 MDD classifications. To this end, we calculated validity indices including the PPA and NPA, as recommended over sensitivity and specificity for comparisons with imperfect reference standards [37]. The PPA and NPA were used to calculate theoretical positive- and negative-predictive values (PPV and NPV, respectively) and estimates of the area under the curve (AUC) for ROC analysis of each screening method. Finally, the PPV and NPV were calculated for representative prevalence levels of (a) 5%, the level of depression worldwide [38]; (b) 35%, the prevalence reported in a metanalysis of depression among refugees [39], and (c) 81%, the highest reported depression prevalence among refugees [40].

Sensitivity analyses

We compared the characteristics of individuals who had missing responses to the sample characteristics to evaluate the potential for biased estimates. We used bivariate analyses (χ2 and Kruskal–Wallis tests) to compare these groups on gender, age, marital status, education, total time spent in displacement, and time spent seeking asylum in Greece.

Statistical analyses were conducted in Stata SE (v15·1) [41]. The reporting of our findings is consistent with the recommendations of the Guidelines for Reporting Reliability and Agreement Studies [42].

Results

This analysis includes data from a total sample of 135 participants, representing 40% of the adult population residing in the refugee camp at the time of the survey. The mean age of the participants was 30 years (18–61 years); women comprised 41% of the sample; 74% of the participants had ever married; 67% had children; and 33% of participants had not attended secondary school, including 11% who had never attended school.

Item and instrument descriptive statistics and reliability indices are presented in Table 1. No floor or ceiling effects were detected. The most common symptom endorsed was related to feeling tired (p4, 75%), followed by feeling down or depressed, changes in sleep, and changes in appetite (items p2, p3, and p5, respectively, 72% each). The internal consistency of the items was low for the PHQ-2 (α = 0.45) and acceptable for the PHQ-8 (α = 0.78).

Table 1 Item and instrument descriptive statistics and reliability indices (n = 135)
Full size table

Overall, 91%, 87%, and 84% of respondents completed the entirety of the PHQ-2, sequential screening process, and PHQ-8, respectively. Items related to feeling bad about oneself and changes in movement had the highest proportion of missing responses (items p6 and p8, 7% each). Six observations were missing four or more items and were excluded from the following analyses. A total of 114 respondents had no missing responses, while missing responses were interpolated for 15 respondents.

PHQ-2 cut-off points of ≥ 2 and ≥ 3 had Youden indices of 0.39 and 0.43, respectively, while the optimal empirical cut-off was calculated to be 2.5. A threshold of ≥ 2 for the PHQ-2 and sequential screening simulation was used to maximize sensitivity.

A schematic of the simulated screening measures is presented in Fig. 1.

Fig. 1
figure 1

Simulated screening measures

Full size image

A total of 129 respondents were included in the comparative validity analyses. Nearly half of respondents were classified with MDD using the PHQ-8 (47%), 68% using the PHQ-2, and 42% using sequential screening. Two-by-two tables are presented in Additional file 1: Table S1. The response burden consisted of a total of 258 and 786 items for the PHQ-2 and sequential simulation, respectively, compared to 1032 for the PHQ-8.

Instrument validity

The performance indices of the PHQ-2 and sequential screening methods against the PHQ-8 classifications are presented in Table 2. Cohen’s kappa values of 0.42 and 0.70 demonstrated weak agreement between the PHQ-2 and PHQ-8 and moderate agreement between the PHQ-2/8 sequential screening simulation and the PHQ-8, respectively, using recognized thresholds for agreement. Overall percent agreement with the PHQ-8 classification was 68% and 95% for the PHQ-2 and the PHQ-2/8 sequential screening simulation, respectively.

Table 2 Validity of the screening methods relative to the PHQ-8 MDD classification (n = 129)
Full size table

Classifications from both the PHQ-2 and the PHQ-2/8 sequential screening simulation were highly correlated with the binary PHQ-8 classification (PHQ-2, p < 0.001; the PHQ-2/8 sequential screening simulation, p < 0.001). The deviance test identified that the PHQ-2 was not missing a predictor relative to the PHQ-8 (p = 0.40).

There is evidence of a systematic difference in MDD classifications between the PHQ-8 and PHQ-2 instruments (McNemar’s test: p = 0.87). There is no evidence of a systematic difference in MDD classifications between the PHQ-8 and the PHQ-2/8 sequential screening instruments (McNemar’s test: p < 0.001).

The PHQ-2 classified MDD with 89% positive agreement and 50% negative agreement, a PPV of 61%, an NPV of 83%, and an AUC of 0.69. The PHQ-2/8 sequential screening simulation had a PPA of 89%, PPV of 100%, NPV of 91%, and AUC of 0.94. The observed NPA between the PHQ-2/8 and the PHQ-8 was 100%, an artifact of the study design.

The effects of different base rates of MDD on the classification accuracy of the PHQ-2 and sequential screening simulation using the calculated positive and negative percent agreement values as proxies for sensitivity and specificity are presented in Table 3.

Table 3 Effects of different base rates on MDD classification accuracy
Full size table

Respondent characteristics associated with missing responses to the PHQ-2, sequential screening process, and PHQ-8 are presented in Additional file 1: Table S2. Trends were observed in the proportion of missing items across sociodemographic factors including gender, education, and marital status.

Discussion

We report the first comparison of a brief and sequential screening method to reduce the response burden while preserving classification accuracy for MDD in a humanitarian emergency setting. Our study suggests that the sequential screening process for the detection of MDD could be a useful strategy for epidemiologic surveillance in humanitarian emergencies where mental health care is available. The sequential screening simulation detected 89% of respondents classified with MDD by the PHQ-8.

Due to the high volume of rapid assessments administered in response to humanitarian emergencies, response fatigue and subsequent low response rates are common. However, the response rate was ≥ 80% for all screening methods evaluated in this study, considered acceptable [43, 44]. The discrepancy in internal consistency of the items for the PHQ-2 (α = 0.45) and the PHQ-8 (α = 0.78) is in part expected due to the difference in the number of items. Nonetheless, the internal consistency of the PHQ-2 is considered unacceptable for an instrument of purportedly single dimensions.

The optimal threshold for the classification of MDD with the PHQ-2 was found to be ≥ 2. This threshold score has advantages over a threshold score of ≥ 3 in that more respondents with MDD are detected: compared to the commonly used threshold of ≥ 3, the threshold of ≥ 2 had superior PPA (89% compared to 69%, respectively) and NPA (100% for both). At a threshold score of ≥ 2, 68% of respondents would continue to complete the full PHQ-8 and 11% of MDD-positive respondents would be misclassified; at a threshold score of ≥ 3 or more, 47% would continue to complete the full PHQ-8 and 31% of MDD-positive respondents would be misclassified. The aim of the shorter screening methods (the PHQ-2 and sequential screening process) is to maximize detection of respondents with MDD while minimizing the response burden. Thus, we find that the threshold score of ≥ 2 has clinical advantages over a threshold score of ≥ 3 in that more respondents with MDD will be detected. This threshold was identified as optimal in previous validation studies of the PHQ-2 in primary care settings in New Zealand [23] and Australia [22].

Overall, 68%, 42%, and 47% of respondents were classified with MDD using the PHQ-2, the sequential screening simulation, and the PHQ-8, respectively. The difference in the proportion of respondents classified with MDD by the PHQ-8 and PHQ-2 was approximately 20%, with evidence of a systematic difference, in contrast to a previous finding that the instruments are equivocal in a Saudi primary care setting [28]. The difference in the proportion of respondents classified with MDD by the PHQ-8 and sequential screening simulation was smaller (5%), yet there was also evidence of a systematic difference between these proportions.

Concurrent validity between the screening instruments was established in several ways: first, agreement between the PHQ-2 and PHQ-8 was established by the deviance test (p = 0.001), accounting for the conditional dependence of the screening results. The sequential screening process had superior agreement with the PHQ-8 classification.

The PHQ-2 was equally sensitive to the positive detection of MDD compared to the sequential screening process (89% positive agreement for both). However, the trade-off for fewer items overall was a low negative percent agreement of 50%, resulting in 34 false-positive classifications. The sequential screening simulation, in comparison, had 100% negative agreement, with no false-positive classifications. Perfect negative agreement between the sequential screening simulation and PHQ-8 classification is an artifact of the sequential screening design, in that a respondent classified as “unaffected” by the PHQ-8 who nonetheless has a score ≥ 2 in the first step of the sequential screening process will ultimately be classified “unaffected”. However, we expect consistency in the classifications of a respondent completing the PHQ-8 after scoring ≥ 2 in the first step of the sequential screening process. Overall, 41 (32%) respondents were misclassified using the PHQ-2 alone, compared to 5% by the sequential screening simulation. While the PHQ-2 was highly sensitive, the large number of false-positive classifications may represent a barrier to implementation in resource-constrained settings. The value of a sequential screening process for MDD, whereby a two-question screen that is positive for depression is followed by the remaining items of the PHQ-8, has been previously demonstrated in a sample of post-partum women [27]. Our results extend the use of the sequential screening process to a humanitarian emergency.

The simulation of the sequential screening process demonstrates efficiencies similar to those described in previous screen-confirm strategies for mental health disorders in the general population [15] as well as among refugees [13]. The number of respondents requiring administration of the full PHQ-8 was reduced by 75% by the PHQ-2 and 24% by the sequential screening process. The sequential screening process was also found to reduce the response burden of screening for MDD, with only 68% of respondents progressing to the PHQ-8. While the reduction in the response burden achieved using the sequential screening process is modest, this reduction may nonetheless be valuable in settings with extreme resource constraints and high assessment burdens, such as humanitarian emergencies.

In addition to simulation with empirical data, we calculated the PPV and NPV with representative prevalence levels of depression. Screening instruments typically have relatively high false-positive rates (60–70%) in settings with a lower prevalence of depression (10%) [45]; however, we found the sequential screening simulation resulted in zero false-positive classifications. In contrast, positive results using the PHQ-2 alone should be confirmed by a full diagnostic given the high false-positive rate at all base rates of depression. In the context of high prevalence, a higher positive-predictive value (i.e., low false-positive classifications) minimizes unnecessary clinical intervention [46]. Both the PPV and NPV of the sequential screening simulation were robust across different base rates, suggesting this screening method represents a feasible and valid trade-off for surveillance.

This study is novel in the use of the deviance test to account for dependency in the comparison of the PHQ-2 and PHQ-8 classifications, a limitation of previous comparisons of these measures analyzed with ordinary least squares regression. An additional strength of this study is the high response rate, reducing the potential for bias due to high attrition observed in other studies [13]. This study also has several limitations. First, criteria for the diagnosis of MDD based on the DSM-V was not used as validation of the PHQ-8 in this study, as the purpose of the study was to compare brief screening instruments and the cost of a clinical diagnostic standard was prohibitive. The comparative method limits reporting of validity to agreement indices. A future study with a three-way comparison between the sequential screening method, the PHQ-8, and a clinical diagnosis would be useful for the calculation of unbiased sensitivity and specificity estimates. Second, the operationalization of response burden as a simple sum of items completed for each screening method could be improved by qualitative research examining in-depth information on the acceptability of the instruments. Third, further testing of the instruments in additional humanitarian contexts would advance our understanding of instrument performance and generalizability.

Recent advances in automating screening with technologies such as mobile phones may facilitate the use of sequential screening in such settings. Evidence that instrument performance is similar regardless of the mode of administration (e.g., patient self-report, interviewer-administered either in-person or by telephone) for self-reported depression measures [47, 48] supports the adoption of adaptive screening processes. Such automated procedures can result in the administration of fewer items without introducing error and thus measurement imprecision.

Conclusions

The benefits of the sequential screening approach for the classification of MDD presented here are twofold: the preservation of classification accuracy relative to the PHQ-8 with a reduced response burden. These results suggest that the sequential screening approach is a pragmatic strategy to streamline MDD surveillance in humanitarian emergencies by reducing the response burden and facilitating the detection of MDD in settings with a scarcity of mental health specialists.

Availability of data and materials

The datasets generated and analyzed during the current study are not publicly available to protect the privacy of the participants, but are available from the corresponding author on reasonable request.

Abbreviations

DSM-V:

Diagnostic and Statistical Manual of Mental Disorders—Fifth Edition

IASC:

Inter-Agency Standing Committee

MDD:

Major depressive disorder

PHQ:

Patient Health Questionnaire

mhGAP-HIG:

Mental Health Gap Action Programme-Humanitarian Intervention Guide

WHO:

World Health Organization

References

  1. United Nations High Commissioner for Refugees (UNHCR). Figures at a Glance. n.d.

  2. Mollica RF, Cardozo BL, Osofsky HJ, Raphael B, Ager A, Salama P. Mental health in complex emergencies. Lancet. 2004;364:2058–67.

    Article  CAS  Google Scholar 

  3. Chen W, Hall BJ, Ling L, Renzaho AM. Pre-migration and post-migration factors associated with mental health in humanitarian migrants in Australia and the moderation effect of post-migration stressors: findings from the first wave data of the BNLA cohort study. Lancet Psychiatry. 2017;4:218–29.

    Article  Google Scholar 

  4. Inter-Agency Standing Committee. IASC guidelines on mental health and psychosocial support in emergency settings. Geneva: Inter-Agency Standing Committee; 2007.

    Google Scholar 

  5. Van Zutphen T. Sphere project—humanitarian charter and minimum standards in humanitarian response. Rugby: Practical Action Publishing; 2011.

    Google Scholar 

  6. World Health Organization. MhGAP humanitarian intervention guide (mhGAP-HIG): clinical management of mental neurological and substance use conditions in humanitarian emergencies. Geneva: World Health Organization; 2015.

    Google Scholar 

  7. Purgato M, Gastaldon C, Papola D, van Ommeren M, Barbui C, Tol WA. Psychological therapies for the treatment of mental disorders in low- and middle-income countries affected by humanitarian crises. Cochrane Database Syst Rev. 2018;7:CD011849. https://doi.org/10.1002/14651858.CD011849.pub2.

    Article  PubMed  Google Scholar 

  8. Bozorgmehr K, Biddle L, Preussler S, Mueller A, Szecsenyi J. Differences in pregnancy outcomes and obstetric care between asylum seeking and resident women: a cross-sectional study in a German federal state, 2010–2016. BMC Pregnancy Childbirth. 2018;18:417. https://doi.org/10.1186/s12884-018-2053-1.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Razum O, Breckenkamp J, Borde T, David M, Bozorgmehr K. Early antenatal care visit as indicator for health equity monitoring. Lancet Glob Health. 2018;6:e35. https://doi.org/10.1016/S2214-109X(17)30465-5.

    Article  PubMed  Google Scholar 

  10. Spiegel PB, Checchi F, Colombo S, Paik E. Health-care needs of people affected by conflict: future trends and changing frameworks. Lancet. 2010;375:341–5.

    Article  Google Scholar 

  11. Kirmayer LJ, Weinfeld M, Burgos G, du Fort GG, Lasry J-C, Young A. Use of health care services for psychological distress by immigrants in an urban multicultural milieu. Can J Psychiatry. 2007;52:295–304. https://doi.org/10.1177/070674370705200504.

    Article  PubMed  Google Scholar 

  12. Hollifield M, Warner TD, Lian N, Krakow B, Jenkins JH, Kesler J, et al. Measuring trauma and health status in refugees: a critical review. JAMA. 2002;288:611–21.

    Article  Google Scholar 

  13. Llosa AE, Van Ommeren M, Kolappa K, Ghantous Z, Souza R, Bastin P, et al. A two-phase approach for the identification of refugees with priority need for mental health care in Lebanon: a validation study. BMC Psychiatry. 2017;17:28. https://doi.org/10.1186/s12888-016-1154-5.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Dowling A, Enticott J, Russell G. Measuring self-rated health status among resettled adult refugee populations to inform practice and policy—a scoping review. BMC Health Serv Res. 2017;17:817.

    Article  Google Scholar 

  15. Dunn G, Pickles A, Tansella M, Vázquez-Barquero JL. Two-phase epidemiological surveys in psychiatric research. Br J Psychiatry. 1999;174:95–100.

    Article  CAS  Google Scholar 

  16. Kelly L, Sizmur S, Käsbauer S, King J, Cooper R, Jenkinson C, et al. The relational aspects of care questionnaire: item reduction and scoring using inpatient and accident and emergency data in England. Patient Relat Outcome Meas. 2018;9:173.

    Article  Google Scholar 

  17. Kroenke K, Spitzer RL, Williams JB. The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care. 2003;41:1284–92.

    Article  Google Scholar 

  18. Löwe B, Kroenke K, Herzog W, Gräfe K. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the Patient Health Questionnaire (PHQ-9). J Affect Disord. 2004;81:61–6.

    Article  Google Scholar 

  19. Kroenke K, Strine TW, Spitzer RL, Williams JB, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord. 2009;114:163–73.

    Article  Google Scholar 

  20. Kroenke K, Spitzer RL, Williams JB, Löwe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32:345–59.

    Article  Google Scholar 

  21. Sijbrandij M, Farooq S, Bryant RA, Dawson K, Hamdani SU, Chiumento A, et al. Problem Management Plus (PM+) for common mental disorders in a humanitarian setting in Pakistan; study protocol for a randomised controlled trial (RCT). BMC Psychiatry. 2015. https://doi.org/10.1186/s12888-015-0602-y.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Carey M, Boyes A, Noble N, Waller A, Inder K. Validation of the PHQ-2 against the PHQ-9 for detecting depression in a large sample of Australian general practice patients. Aust J Prim Health. 2016;22:262–6.

    Article  Google Scholar 

  23. Arroll B, Goodyear-Smith F, Crengle S, Gunn J, Kerse N, Fishman T, et al. Validation of PHQ-2 and PHQ-9 to screen for major depression in the primary care population. Ann Fam Med. 2010;8:348–53.

    Article  Google Scholar 

  24. Smith MV, Gotman N, Lin H, Yonkers KA. Do the PHQ-8 and the PHQ-2 accurately screen for depressive disorders in a sample of pregnant women? Gen Hosp Psychiatry. 2010;32:544–8. https://doi.org/10.1016/j.genhosppsych.2010.04.011.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Lavigne JV, Feldman M, Meyers KM. Screening for mental health problems: addressing the base rate fallacy for a sustainable screening program in integrated primary care. J Pediatr Psychol. 2016;41:1081–90. https://doi.org/10.1093/jpepsy/jsw048.

    Article  PubMed  Google Scholar 

  26. Feyera F, Mihretie G, Bedaso A, Gedle D, Kumera G. Prevalence of depression and associated factors among Somali refugee at Melkadida camp, southeast Ethiopia: a cross-sectional study. BMC Psychiatry. 2015;15:171.

    Article  Google Scholar 

  27. Gjerdingen D, Crow S, McGovern P, Miner M, Center B. Postpartum depression screening at well-child visits: validity of a 2-question screen and the PHQ-9. Ann Fam Med. 2009;7:63–70. https://doi.org/10.1370/afm.933.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Al-Qadhi W, ur Rahman S, Ferwana MS, Abdulmajeed IA. Adult depression screening in Saudi primary care: prevalence, instrument and cost. BMC Psychiatry. 2014;14:190.

    Article  Google Scholar 

  29. Poole DN, Hedt-Gauthier B, Liao S, Raymond NA, Bärnighausen T. Major depressive disorder prevalence and risk factors among Syrian asylum seekers in Greece. BMC Public Health. 2018;18:908. https://doi.org/10.1186/s12889-018-5822-x.

    Article  PubMed  PubMed Central  Google Scholar 

  30. AlHadi AN, AlAteeq DA, Al-Sharif E, Bawazeer HM, Alanazi H, AlShomrani AT, et al. An arabic translation, reliability, and validation of Patient Health Questionnaire in a Saudi sample. Ann Gen Psychiatry. 2017;16:32. https://doi.org/10.1186/s12991-017-0155-1.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Becker S, Al Zaid K, Al FE. Screening for somatization and depression in Saudi Arabia: a validation study of the PHQ in primary care. Int J Psychiatry Med. 2002;32:271–83. https://doi.org/10.2190/XTDD-8L18-P9E0-JYRV.

    Article  PubMed  Google Scholar 

  32. Löwe B, Spitzer RL, Gräfe K, Kroenke K, Quenter A, Zipfel S, et al. Comparative validity of three screening questionnaires for DSM-IV depressive disorders and physicians’ diagnoses. J Affect Disord. 2004;78:131–40.

    Article  Google Scholar 

  33. Rolstad S, Adler J, Rydén A. Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value Health. 2011;14:1101–8. https://doi.org/10.1016/j.jval.2011.06.003.

    Article  PubMed  Google Scholar 

  34. Little RJ, Rubin DB. Statistical analysis with missing data. Hoboken: Wiley; 2014.

    Google Scholar 

  35. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.

    Article  Google Scholar 

  36. Lu Z-H, Chow S-M, Loken E. A comparison of Bayesian and frequentist model selection methods for factor analysis models. Psychol Methods. 2017;22:361–81. https://doi.org/10.1037/met0000145.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Cicchetti DV, Feinstein AR. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990;43:551–8.

    Article  CAS  Google Scholar 

  38. Ferrari AJ, Charlson FJ, Norman RE, Patten SB, Freedman G, Murray CJ, et al. Burden of depressive disorders by country, sex, age, and year: findings from the global burden of disease study 2010. PLoS Med. 2013;10:e1001547.

    Article  Google Scholar 

  39. Lindert J, von Ehrenstein OS, Priebe S, Mielck A, Brähler E. Depression and anxiety in labor migrants and refugees—a systematic review and meta-analysis. Soc Sci Med. 2009;69:246–57.

    Article  Google Scholar 

  40. Lee Y, Lee MK, Chun KH, Lee YK, Yoon SJ. Trauma experience of North Korean refugees in China. Am J Prev Med. 2001;20:225–9. https://doi.org/10.1016/S0749-3797(00)00282-8.

    Article  CAS  PubMed  Google Scholar 

  41. StataCorp. Stata statistical software: release 15.1. College Station: Stata Press; 2016.

    Google Scholar 

  42. Kottner J, Audigé L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A, et al. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64:96–106. https://doi.org/10.1016/j.jclinepi.2010.03.002.

    Article  PubMed  Google Scholar 

  43. Fincham JE. Response rates and responsiveness for surveys, standards, and the journal. Am J Pharm Educ. 2008;72:43.

    Article  Google Scholar 

  44. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53–5. https://doi.org/10.5116/ijme.4dfb.8dfd.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Mitchell AJ, Coyne JC. Do ultra-short screening instruments accurately detect depression in primary care?: a pooled analysis and meta-analysis of 22 studies. Br J Gen Pract. 2007;57:144–51.

    PubMed  PubMed Central  Google Scholar 

  46. Altman DG, Bland JM. Diagnostic tests 2: predictive values. BMJ. 1994;309:102.

    Article  CAS  Google Scholar 

  47. Evans M, Kessler D, Lewis G, Peters TJ, Sharp D. Assessing mental health in primary care research using standardized scales: can it be carried out over the telephone? Psychol Med. 2004;34:157–62.

    Article  CAS  Google Scholar 

  48. Simon GE, Revicki D, VonKorff M. Telephone assessment of depression severity. J Psychiatr Res. 1993;27:247–52.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

The authors thank the individuals who generously shared their time and experiences for the purposes of this study and the International Organization for Migration Greek Country Office. The authors also thank Drs. Marcia Castro and Stéphane Verguet for their critical review. Finally, the authors thank the International Data Responsibility Group fellowship team: Jos Berens, Dr. Mark Latonero, and Julie Ricard.

Funding

None.

Author information

Authors and Affiliations

  1. Department of Global Health and Population, Harvard T.H. Chan School of Public Health, 665 Huntington Avenue, Boston, MA, 02115, USA

    Danielle N. Poole, Elysia Larson & Till Bärnighausen

  2. Harvard Humanitarian Initiative, Harvard T.H. Chan School of Public Health, 14 Story Street, Cambridge, MA, 02138, USA

    Danielle N. Poole

  3. Neukom Institute for Computational Science, Dartmouth College, Hanover, NH, 03755, USA

    Danielle N. Poole

  4. Department of Biostatistics, Harvard T.H. Chan School of Public Health, 665 Huntington Avenue, Boston, MA, 02115, USA

    Shirley Liao, Elysia Larson & Bethany Hedt-Gauthier

  5. Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Avenue, Boston, MA, 02115, USA

    Bethany Hedt-Gauthier & Mary C. Smith Fawzi

  6. Jackson Institute of Global Affairs, Yale University, 55 Hillhouse Avenue, New Haven, CT, 06520, USA

    Nathaniel A. Raymond

  7. Institute for Public Health, Faculty of Medicine, Heidelberg University, Im Neuenheimer Feld 130.3, 69120, Heidelberg, Germany

    Till Bärnighausen

  8. Africa Health Research Institute, Mtubatuba, 3935, KwaZulu-Natal, South Africa

    Till Bärnighausen

Authors
  1. Danielle N. Poole
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shirley Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elysia Larson
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bethany Hedt-Gauthier
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Nathaniel A. Raymond
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Till Bärnighausen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Mary C. Smith Fawzi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

DNP designed the study, collected, analyzed and interpreted the data, and wrote the report. NR helped design the study, interpreted the data, and revised the report. BHG, SL, EL, TB, and MCSF supported data interpretation and revised the report. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Danielle N. Poole.

Ethics declarations

Ethics approval and consent to participate

This study was under ethics review, oversight, and governance both in Greece and in the United States by the International Organization for Migration Greek research ethics advisory board and the Institutional Review Board of the Harvard T. H. Chan School of Public Health (Protocol IRB16-2015), respectively. Informed consent was obtained orally from all participants to avoid the potential risks of collecting participant names.

Consent for publication

All authors have approved the manuscript for publication.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Table S1.

Two-by-two table (n = 129). Table S2. Missingness by respondent characteristics (n = 135).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Poole, D.N., Liao, S., Larson, E. et al. Sequential screening for depression in humanitarian emergencies: a validation study of the Patient Health Questionnaire among Syrian refugees. Ann Gen Psychiatry 19, 5 (2020). https://doi.org/10.1186/s12991-020-0259-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12991-020-0259-x

Keywords

  • Mass screening
  • Validation studies
  • Psychometric
  • Mental health
  • Disaster
  • Armed conflict
  • Refugees

Annals of General Psychiatry

ISSN: 1744-859X