- Primary research
- Open Access
Factor structure and diagnostic efficiency of the Myanmar version BDI-II among substance users
Annals of General Psychiatry volume 18, Article number: 12 (2019)
The Beck Depression Inventory II (BDI-II) has been accepted as one of the most commonly used self-report measures for depression. However, there is no study examining the psychometric properties of the BDI-II among substance users in low- and middle-income countries such as Myanmar. Therefore, this study aimed to evaluate the suitability of using this instrument in substance users and to examine the reliability and diagnostic efficiency to be compared with the International Classification of Diseases (ICD-10) among substance users in Northern Shan State of Myanmar.
A respondent-driven sampling (RDS) method was applied for recruiting the participants in this study, and total 230 substance users were recruited. On the other hand, 50 participants who visited the drop-in center (DIC) were screened for depressive symptoms using ICD-10 during the days when one consultant psychiatrist doctor was presented. These participants were interviewed face-to-face by the consultant psychiatrist using a semi-structured questionnaire including the Myanmar version of the BDI-II (mBDI-II).
The mBDI-II showed moderate accuracy with an area under the curve of 0.68. The optimal cutoff score was 10 with the highest Youden index (0.48), and it had high sensitivity and specificity (0.78 and 0.70). The Cronbach’s alpha coefficients for clinically depressed and non-clinically depressed substance users were 0.91 and 0.93, respectively. Confirmatory factor analysis of the mBDI-II indicated that a three-factor solution (cognitive, affective, and somatic) was the best fit for substance users.
The mBDI-II has sound psychometric properties among substance users with moderate accuracy and range of possible cutoff scores together with sensitivity and specificity.
Depressive symptoms are highly prevalent among substance users and are often a comorbid condition accompanying substance-related disorder [1,2,3]. The 12-month prevalence of major depressive disorder among substance users was 16.1% , and 30 to 45% of substance users seeking treatment are affected . Proper diagnosis of depression in this population is essential for treatment. However, assessing depression in this population is difficult, as the symptoms of substance use or withdrawal, such as changes in appetite and sleep pattern, concentration difficulties, and emotional changes are similar to the symptoms of depression [5, 6]. Therefore, there is a need to develop a reliable and validated screening instrument for depression that is suitable for substance users in the community setting.
Although several depression screening instruments are available, the Beck Depression Inventory II (BDI-II)  is one of the most commonly used and widely accepted self-report instruments for depression. In addition, the BDI-II has been tested and validated widely among both psychiatric patients, and the general population . A variety of population and age groups have been studied using the BDI-II, and many studies have addressed its psychometric properties [9,10,11,12,13].
Moreover, the BDI-II has been used as a screening instrument for depression among low- and middle-income countries. The BDI-II was used in validation studies among adolescents in India [14, 15] and among postpartum women in Malaysia .
In addition, the BDI-II has been validated among substance users [17,18,19,20], most of who were tested in the USA. These studies generally reported that the BDI-II was reliable and valid among substance users [17,18,19,20,21]. However, it is interesting that these studies, in which factor analyses of the BDI-II were conducted, reported that a three-factor model (with factors labeled somatic, affective, and cognitive) was found to “fit” best among substance users [18,19,20,21]. There is no study examining the psychometric properties of BDI-II among substance users in low- and middle-income countries such as Myanmar.
The purpose of this study was to evaluate the suitability of using this instrument and to examine the reliability and diagnostic efficiency to be compared with the International Classification of Diseases (ICD-10) among substance users in Northern Shan State of Myanmar.
Materials and methods
Participants and procedures
Current substance users were recruited for this study, through their contact with a local non-government organization (NGO) providing harm reduction services in Hseni Township, Northern Shan State of Myanmar. The inclusion criteria included being aged 18 years or older, reporting using drugs (opioids, heroin, methamphetamine, etc.) within the past month, and providing informed consent to participate. Participants were recruited from people who came to a services center for accessing harm reduction services. A respondent-driven sampling (RDS) method was applied for the main evaluation study, because RDS is known as an effective data collection method for a hidden population like substance users . First, 11 seeds (initial key persons) with different age groups and residential places were purposely identified from these people in Hseni Township. Each seed was given three coupons to recruit up to three other participants who he/she knew, into the study; each participants recruited by the seed was also given the same number of coupons to recruit further participants. This recruitment chain stopped at the third wave. In total, 750 coupons were distributed, and 230 coupons were returned. On the other hand, 50 participants who visited the drop-in center (DIC) were assessed by a consultant psychiatrist if they had a diagnosis of depressive disorders using ICD-10 criteria. All participants were interviewed face-to-face using a semi-structured questionnaire including the mBDI-II. Participants were provided with some snacks as an incentive, and informed consent was obtained from all.
Beck Depression Inventory II (BDI-II)
The BDI-II is a 21-item self-report measure of depressive symptoms. For each item, participants are asked to select the most appropriate of four self-evaluative statements scored from “0” to “3.” Participants were asked to respond to each item based on their experiences within the past 2 weeks. Responses were summed up to yield the total score, which could range from 0 to 63, with higher scores meaning higher levels of depressive symptoms .
In this study, an already translated Myanmar version BDI-II (mBDI-II) was used. The translation was done by psychiatrists in Myanmar who were currently using the translated version among psychiatric outpatients as a screening instrument in Myanmar (personal communication). However, the translation process did not follow the translation, adaption, and validation of scale guidelines , and the translated scale had not previously been tested for reliability and validity. Before the present study, we conducted a cognitive interview for the scale among 10 substance users who were sampled ad hoc at the DIC. We found that the scale was easily completed by the participants; however, the participants gave feedback that item #21, “loss of interest in sex,” and item #10, “crying,” were difficult to answer.
The clinical interview was done based on the ICD-10  for diagnosing the presence of depression and using clinical diagnostic criteria for the various depressive disorders in the F 32 category of depressive episodes (F32.0, F32.1, and F32.2), and F33 category of recurrent depressive disorders (F33.0, F33.1, and F33.2). The consultant psychiatrist who visited the DIC did the clinical interview using the ICD-10 guidelines mentioned above.
Substance use was measured by the structured questionnaire that was developed by United Nations Office on Drugs and Crime (UNODC). Participants were asked to recall the different kinds of drug(s) used within the past 1 month.
A brief demographic questionnaire was used to collect information on participants’ age, sex, education, occupation, etc.
Data were analyzed using the Statistical Package for Social Science version 21 program (SPSS 21) (IBM Corp., USA). Descriptive analysis was performed to describe the socio-demographic characteristics. Mann–Whitney U test was used to compare the score distribution between the groups. Sensitivity and specificity of the mBDI-II score were plotted against the ICD-10 diagnosis by the psychiatrist as a standard. The performance of the mBDI-II was analyzed using receiver operating characteristics (ROC) curves, and area under the ROC curves (AUC) with 95% confidence intervals was calculated using a nonparametric method. Sensitivity and specificity were calculated for an original cutoff score (10+) , a cutoff score proposed by a previous study of substance users [14,15,16,17,18,19,20,21,22,23,24,25], and the optimal screening cutoff score based on the closest point to the left hand corner, and the Youden index .
To examine the factor structure of the mBDI-II, confirmatory factor analysis (CFA) was done in this study. Using CFA, we compared four distinct models. Model 1 constrained all 21 items to load on a single factor (depression). Model 2 was based on the oblique two-factor solution (somatic–affective and cognitive) reported by Beck et al.  for BDI-II normative data from psychiatric outpatients. Model 3 was based on the oblique two-factor solution (somatic–affective and cognitive) reported by Beck et al.  for the BDI-II normative data from colleague students. For both Models 2 and 3, items were limited to loading only on the models as reported by Beck et al. , variance of each factor was fixed at 1, and the two factors were allowed to correlate. Model 4 was based on a three-factor solution (cognitive, affective, and somatic) reported by Buckley et al.  for substance users currently in chemical dependency treatment. Variance for each factor was fixed at 1, and the three factors were allowed to correlate.
For each of the four models, four indices were used to assess model fit. First, a Chi-square fit index was calculated to compare each given model’s covariance structure with the observed covariance matrix. A relative likelihood ratio (X2/df) (RLP) was calculated in this study. Second, root mean square error of approximation (RMSEA) adjusts for model complexity and provides a measure of predicted and observed model. Third, the Comparative Fit Index (CFI) compares the observed model fit with an independent model that assumes the latent variables are uncorrelated. The last index was the Expected Cross-validation Index (ECVI). Lower ECVI values mean better fitting of the model. The reliability of the mBDI-II was analyzed using the internal consistency coefficient and corrected inter-item correlations.
The present study was conducted from September to November 2016. All 230 substance users were entered into the study. Of these, 4 users were excluded due to incompleteness of the questionnaire. The remaining 226 participants comprised the study sample, out of which 40 were diagnosed with depressive illness based on clinical criteria (based on ICD-10) and the rest (n = 186) were healthy.
The mBDI-II median score for the participants who had been diagnosed based on ICD-10 criteria was 20.00 (0–38), and for the others, the median score was 14.00 (0–40) (p = 0.003) (Table 1). The participants who had been diagnosed based on ICD-10 criteria had significantly higher mBDI-II mean scores than the comparison group (p = 0.003).
The demographic characteristics of clinically depressed substance users and non-clinically depressed substance users are reported in Table 2. The majority of the participants in both groups were male, and 53.8% of the clinically depressed patients were ethnic people; however, 62.9% of non-clinically depressed substance users were Burmese. Non-clinically depressed substance users were slightly older than the clinically depressed group, and 50% of them had never attended school. Regarding drug use history of the participants, 81.0% of the participants reported having used heroin within 30 days, and 45.6% within 24 h and 29.2% of participants reported having used amphetamine-type stimulants (ATS) within 30 days and 10.6% within 24 h). These two drugs were the most commonly used drugs.
The mBDI-II showed moderate accuracy on the AUC, and it had an AUC of 0.69 (95% CI 0.45–0.92) (Fig. 1). The optimal threshold score for screening was obtained from the ROC curves comparing the mBDI-II and ICD-10. Table 3 shows the sensitivity and specificity of cutoff scores for the detection of clinical depression with different cutoff scores from this study and other studies among substance users. According to the highest Youden index of 0.48, the optimal cutoff score was 10 with a sensitivity of 0.78 and a specificity of 0.70. The previous optimal cutoff point of 13 had a lower Youden index, sensitivity, specificity, and likelihood ratio compared to the cutoff point 10 in this study. The left-most point in the ROC curve was also 10 in this study. The likelihood ratio for positive test results (LR+) was 2.6, and likelihood ratio for negative test results (LR−) was 0.31 in this study.
Confirmatory factor analysis
Table 4 describes summary statistics for the CFA of the mBDI-II. The “goodness-of-fit” test indicated that the poorest “fit” was obtained for the one-factor solution. Of the remaining four models, the next poorest “fit” was the two-factor model. Among the remaining two models, the two-factor solution was the poorest “fit.” Therefore, the three-factor solution “fits” the best for these data.
Internal consistency reliability and item analysis
The Cronbach’s alpha for both groups was high, and Cronbach’s alpha for the clinically depressed group was 0.91 and for the non-clinically depressed substance users was 0.93. The item-total correlation ranged from 0.15 to 0.79 for the clinically depressed sample and 0.33 to 0.76 for the non-clinically depressed substance users. Lower item-total correlations were observed for item #9, “suicidal thoughts,” #10, “crying,” and #21, “loss of interest in sex” (0.28, 0.33, and 0.15, respectively).
Summary of findings
In this study, we examined the factor structure and diagnostic accuracy of the mBDI-II among substance users. CFA indicated that a three-factor solution (cognitive, affective, and somatic) was the best fit for these data. To detect depressive symptoms, which we defined the clinically depressed and the non-clinically depressed substance users, the total mBDI-II score had an area under the curve of 0.68. The optimal cutoff score was 10 for the highest Youden index (0.48) and with high sensitivity and specificity (0.78 and 0.70). An acceptable level of internal consistency reliability was obtained: The Cronbach’s alpha coefficients among clinically depressed and non-clinically depressed substance users were 0.91 and 0.93, respectively.
The mean scores for the mBDI-II among the clinically diagnosed and the non-clinically depressed substance users were 19.9 and 14.4, respectively. This finding is similar to the mean scores in other studies among substance users ranging between 14.9 and 20.6 in the USA . The mean score for the mBDI-II is also similar to the mean score for the BDI-II (13.4) in a study conducted in India, in which the study population was school adolescents . The score distribution of the mBDI-II may be similar to that in other countries.
The AUC of the mBDI-II was moderate (0.68). The AUC is smaller than that reported in another study of substance users in the USA (0.82) . The BDI-II may have less effective performance in screening depression among substance users in Myanmar than in high-income countries, such as the USA. In low- and middle-income countries, a smaller AUC was occasionally reported. For instance, the AUC of this study is similar to those in studies among school adolescent in India (0.66–0.67) [14, 15]. However, it should be noted that we did not diagnose depressive disorders among the non-clinically depressed sample; and thus, some of that sample may have depression. This may have resulted in underestimation of the screening performance of mBDI-II in this study.
The proposed optimal cutoff score in this study was 10 (sensitivity of 0.78 and specificity 0.70) for the diagnosis of depression among substance users. This cutoff score was less than the developer recommended cutoff score . In contrast, the results for the clinically depressed substance users study  were between 14 and 25. Other studies of adolescents stated the cutoff score of 18 with sensitivity and specificity of 0.63 and 0.73 . However, the previous studies [15, 20] did not describe the LR+ and LR−. The present LR+ 2.6 is reasonable to use, and it means that more positive test results will occur in the depressed substance users than in non-depressed users. The present LR-0.31 was close to “0,” and thus, it is less likely that the negative test result will occur in depressed substance users than in non-depressed users.
A three-factor solution (cognitive, affective, and somatic) was the best fit model for these data (Table 4). Not all indices, however, indicated an acceptable fit. The RMSEA (0.09) was higher than the values of 0.05, 0.48 and 0.67 obtained in previous studies of substance users [19,20,21]. In addition, the CFI in this study was 0.86, while it was better (0.94) in the other study . The lower fit of the solution in this study may be attributable to some of the items being less correlated with other items, as described later. The discrepancy might also be due to the study population. Our study population may be different from that in other studies in terms of the degree of substance abuse and/or treatment seeking.
The internal consistency of the mBDI-II in this study was acceptably high. This is in agreement with other studies conducted among substance users [17, 18]. A previous literature review reported that the internal consistency for the BDI-II ranged from 0.83 to 0.96 , which is similar to the present findings. We found a low item-total correlation of item #9 (suicidal thought), #10 (crying), and #21 (loss of interest in sex) in this study. The mBDI-II items #10 and #21 were reported in our pretest to be difficult to respond to as well. Suicide is often stigmatized more in some cultures . This may be the case for substance users in Myanmar. The item on crying was reported not to converge with other depression items in some populations [28, 29]. Loss of interest in sex showed a different item functioning in a validation study of BDI-II some samples . These items may be more affected by the culture of the study population and may not reflect depression appropriately.
Several limitations should be acknowledged for this study. Participants in this study were only substance users who identified by themselves; therefore, the result may not generalize to other populations. RDS depends on the social network of sampling population; therefore, it can limit the sample representatives. In addition, the sample size of our study is limited, and especially, the sample of participants who underwent clinical diagnosis was small. Depressive symptoms caused by substance use and withdrawal were not assessed in this study, and it can affect the validity of the instrument. An additional limitation is that we were not able to evaluate the validity of the mBDI-II by comparing responses to other depressive symptomatology instruments. Moreover, there may be clinical depressive cases in the community residents of this study and it can affect the validity of the instrument. Further studies will need to establish convergent validity and factor structure based on substance dependence severity.
In conclusion, despite these limitations, this study has provided evidence that the mBDI-II has sound psychometric properties among substance users in low–middle-income countries such as Myanmar. Our study provided evidence that the diagnostic accuracy of the mBDI-II is moderate and provides a range of possible cutoff score for depression among substance users.
Availability of data and materials
The dataset generated and analyzed during the current study is not publicly available due to confidential assurance of the participants, however is available from the corresponding author on reasonable request.
Beck Depression Inventory II
- ICD 10:
International Classification of Diseases
Myanmar version of the BDI-II
United Nations Office on Drugs and Crime
receiver operating characteristics
area under the ROC curves
confirmatory factor analysis
relative likelihood ratio
root mean square error of approximation
Comparative Fit Index
Expected Cross-validation Index
Grant BF, Stinson FS, Dawson DA, Chou SP, Dufour MC, Compton W, et al. Prevalence and co-occurrence of substance use disorders and independent mood and anxiety disorders: results from the National Epidemiologic Survey on Alcohol and Related Conditions. Arch Gen Psychiatry. 2004;61(8):807–16.
Lai HMX, Cleary M, Sitharthan T, Hunt GE. Prevalence of comorbid substance use, anxiety and mood disorders in epidemiological surveys, 1990–2014: a systematic review and meta-analysis. Drug Alcohol Depend. 2015;154(2):1–13.
Regier DA, Farmer ME, Rae DS, Locke BZ, Keith SJ, Judd LL, et al. Comorbidity of mental disorders with alcohol and other drug abuse. Results from the Epidemiologic Catchment Area (ECA) Study. JAMA. 1990;264(19):2511–8.
Currie SR, Patten SB, Williams JV, Wang J, Beck CA, El-Guebaly N, et al. Comorbidity of major depression with substance use disorders. Can J Psychiatry. 2005;50(10):660–6.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-5®). Philadelphia: American Psychiatric; 2013.
Hasin D, Samet S, Nunes E, Meydan J, Matseoane K, Waxman R. Diagnosis of comorbid psychiatric disorders in substance users assessed with the Psychiatric Research Interview for Substance and Mental Disorders for DSM-IV. Am J Psychiatry. 2006;163(4):689–96.
Beck AT, Steer RA, Brown GK. Beck depression inventory-II. San Antonio. 1996;78(2):490–8.
McDowell I. Measuring health: a guide to rating scales and questionnaires. Oxford: Oxford University Press; 2006.
Gomes-Oliveira MH, Gorenstein C, Lotufo Neto F, Andrade LH, Wang YP. Validation of the Brazilian Portuguese version of the Beck Depression Inventory-II in a community sample. Rev Bras Psiquiatr. 2012;34(4):389–94.
Hobkirk AL, Starosta AJ, De Leo JA, Marra CM, Heaton RK, Earleywine M, et al. Psychometric validation of the BDI-II among HIV-positive CHARTER study participants. Psychol Assess. 2015;27(2):457–66.
Joe S, Woolley ME, Brown GK, Ghahramanlou-Holloway M, Beck AT. Psychometric properties of the Beck Depression Inventory-II in low-income, African American suicide attempters. J Pers Assess. 2008;90(5):521–3.
Kim MH, Mazenga AC, Devandra A, Ahmed S, Kazembe PN, Yu X, et al. Prevalence of depression and validation of the Beck Depression Inventory-II and the Children’s Depression Inventory-Short amongst HIV-positive adolescents in Malawi. J Int AIDS Soc. 2014;17(1):18965.
Arnarson O, Olason D, Smari J, Sigurdsson JF. The Beck Depression Inventory Second Edition (BDI-II): psychometric properties in Icelandic student and patient populations. Nordic J Psychiatry. 2008;62(5):360–5.
Basker M, Moses PD, Russell S, Russell PSS. The psychometric properties of Beck Depression Inventory for adolescent depression in a primary-care paediatric setting in India. Child Adolesc Psychiatr Mental Health. 2007;1(1):8.
Russell PS, Basker M, Russell S, Moses PD, Nair MKC, Minju KA. Comparison of a self-rated and a clinician-rated measure for identifying depression among adolescents in a primary-care setting. Indian J Pediatr. 2012;79(1):45–51.
Mahmud WMRW, Awang A, Herman I, Mohamed MN. Analysis of the psychometric properties of the Malay version of Beck Depression Inventory II (BDI-II) among postpartum women in Kedah, North West of Peninsular Malaysia. MJMS. 2004;11(2):19.
Dum M, Pickren J, Sobell LC, Sobell MB. Comparing the BDI-II and the PHQ-9 with outpatient substance abusers. Addict Behav. 2008;33(2):381–7.
Hepner KA, Hunter SB, Edelen MO, Zhou AJ, Watkins K. A comparison of two depressive symptomatology measures in residential substance abuse treatment clients. J Subst Abuse Treat. 2009;37(3):318–25.
Johnson ME, Neal DB, Brems C, Fisher DG. Depression as measured by the Beck Depression Inventory-II among injecting drug users. Assessment. 2006;13(2):168–77.
Seignourel PJ, Green C, Schmitz JM. Factor structure and diagnostic efficiency of the BDI-II in treatment-seeking substance users. Drug Alcohol Depend. 2008;93(3):271–8.
Buckley TC, Parker JD, Heggie J. A psychometric evaluation of the BDI-II in treatment-seeking substance abusers. J Subst Abuse Treat. 2001;20(3):197–204.
McCreesh N, Frost SD, Seeley J, Katongole J, Tarsh MN, Ndunguse R, et al. Evaluation of respondent-driven sampling. Epidemiology. 2012;23(1):138–47.
Beck AT, Steer RA, Brown GK. BDI-II, Beck depression inventory: manual. San Antonio: Psychological Corp.; 1996.
Isaac M, Janca A, Sartorius N, Organization WH. ICD-10 symptom glossary for mental disorders: a glossary of symptoms used in the definition of criteria for the classification of mental and behavioural disorders in the 10th revision of the International Classification of Diseases (ICD-10). Geneva: World Health Organization; 1994.
Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3(1):32–5.
Wang Y, Gorenstein C. Psychometric properties of the Beck Depression Inventory-II: a comprehensive review. Revista Brasileira De Psiquiatria. 2013;35(4):416–31.
Siddiqui S, Ali Shah SA. Siddiqui-shah depression scale (SSDS): development and validation. Psychol Dev Soc. 1997;9(2):245–62.
Kim G, Chiriboga DA, Jang Y. Cultural equivalence in depressive symptoms in older white, black, and Mexican–American adults. J Am Geriatr Soc. 2009;57(5):790–6.
Lerdal A, Kottorp A, Gay CL, Grov EK, Lee KA. Rasch analysis of the Beck Depression Inventory-II in stroke survivors: a cross-sectional study. J Affect Disord. 2014;158:48–52.
Wang YP, Gorenstein C. Assessment of depression in medical patients: a systematic review of the utility of the Beck Depression Inventory-II. Clinics (Sao Paulo). 2013;68(9):1274–87.
We wish to acknowledge the help of Dr. Martin Joseph, Dr. Nyan Win Kyaw, and Hseni field staffs of Substance Abuse Research Association (SARA) in completing this project.
This study was partly supported by JSPS KAKENHI Grant Number JP 16K15371.
Ethics approval and consent to participate
The Research Ethics Review Board of the University of Tokyo, Graduate School of Medicine (no. 10196(1)), approved the study procedures. In addition, the Ethical Committee on Medical Research involving Human Subjects, Department of Mental Health, Defense Services Medical Academy (no. 1/2016/09), also approved this research. The aims and procedures of the study were explained to participants and included the information that non-participation would have no effect on their obtaining further services from the local NGO. We assured the confidentiality of the data. Participants voluntarily participated and provided written informed consent.
Consent for publication
Dr. Win has nothing to disclose. Dr. Kawakami reports personal fees from Junpukai Foundation, Softbank, etc., and grants from Info soft Technologies, etc., outside the submitted work; Dr. Gyaw Htet Doe has nothing to disclose.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.