- Primary research
- Open Access
Assessing the burden of caregivers of patients with mental disorders: translating and validating the involvement evaluation questionnaire into Greek
Annals of General Psychiatry volume 12, Article number: 3 (2013)
The changes in the organization of mental health care services have made the role of the family even more important in caring for patients with mental disorders. Caring may have serious consequences for family caregivers, with a great impact on the quality of family life. This study reports on the translation, cultural adaptation, and validation of the Involvement Evaluation Questionnaire-European Union (IEQ-EU) into the Greek language.
Caregivers of patients with major mental disorders were interviewed to test a modified version of the IEQ-EU questionnaire. Psychometric measurements included reliability coefficients, exploratory factor analysis and confirmatory analysis by linear structural relations. To measure the concurrent validity we used the Nottingham Health Profile (NHP).
Most caregivers were female (83%), mainly mothers living with the patient (80%), with quite a high level of burden. The Greek version of the IEQ-EU (G-IEQ-EU) demonstrated a good reliability with high internal consistency (α = 0.88), Guttman split-half correlation of 0.71, high test-retest reliability (ICC = 0.82) and good concurrent validity with the NHP. A four-factor structure was confirmed for the G-IEQ-EU, slightly different from the original IEQ. The confirmatory factor analysis demonstrated that the four-factor model offered modest fit to our data.
The G-IEQ-EU is a reasonably valid and reliable tool for use in both clinical and research contexts in order to assess the burden of caregivers of patients with mental disorders.
Mental disorders are an important public health issue that leaves an enormous burden on healthcare services in modern day societies . Deinstitutionalization of mental health care services led to a more important role for primary care practitioners and informal caregivers [1, 2]. In Greece, a major attempt for mental health services reform has been undertaken since 1984 ; however, integrated primary health care is still a missing issue in the current Greek health policy agenda , especially in the light of the current economic recession and its subsequent social implications.
The limited resources of community care in this country result in insufficient support of people with mental disorders, which is frequently provided by family members who are usually inadequately trained for that purpose . As a result of the caregiving consequences and the extra financial burden due to the economic crisis, family members are made vulnerable for extra burden and distress [6–8].
The Involvement Evaluation Questionnaire (IEQ) is an instrument designed to measure the burden of caregivers of patients with mental disorders. Although this questionnaire was originally developed in Dutch, it has been translated and validated for non-Dutch speaking populations in different language versions in cross-national research [9–13]. It has been observed through many validation studies that there is cultural variation in the expression of burden of caregivers of patients with mental disorders [11, 13–15], which may result in differences in the psychometric characteristics of the IEQ. However, not all validation studies have provided evidence regarding estimation of significance of factor loadings, orthogonality of factors and goodness-of-fit by confirmatory factor analysis [10–15]. This paper reports on the development of a Greek version of the IEQ-EU. Among the specific objectives were to (a) examine the reliability and validity of the Greek version of the IEQ-EU and (b) determine the factor structure of the Greek version of the IEQ-EU.
Study design and participants
The translated culturally adapted version of IEQ was validated in a group of caregivers of patients with major mental disorders (ICD-10: F20 schizophrenia, F31 bipolar affective disorder, and F32 depressive episode) who were registered in the Hospital of Mental Health of Chania, Crete in 1999. Two hundred and thirty (230) patients fulfilled those criteria. Caregivers who served those patients were eligible when (a) they were living in a household with a patient for at least 6 months during the past year and (b) they were older than 18 years of age.
Validation activities were undertaken from April to July. Two instruments, IEQ-EU  and Nottingham Health Profile (NHP) , were administered to participants during personal interviews by the first author at their home after telephone communication. The eligible caregivers had been orally invited. Moreover, questionnaires were accompanied by a cover letter explaining the purpose of the study, the researchers’ affiliation and contact information, while clearly stating that answers would be confidential and that anonymity would be guaranteed in the final data reports. There was an attempt to contact all families served by the participating caregivers by telephone. Of the 230 eligible patients, 165 were excluded (Figure 1). A total of 65 caregivers were finally included. There were no significant differences in what concerns age, gender, or duration of mental disorders between the subjects interviewed and those who were not.
Two weeks later, 21 of the initial 65 respondents were randomly selected to answer the questionnaire for a second time (retest response rate, 100%). The size of the retest sample (n = 21) was sufficient as suggested by Walter et al.  and Dafermos .
The approval for translation and use of the tool for research purposes was granted by the original author of the IEQ, Professor AH Schene. The study was approved by the Scientific Committee of the Mental Health Hospital of Chania, Crete (protocol number 5/6-12-2004). All patients who are willing to participate were informed of the purpose of the study and signed an informed consent form.
Involvement evaluation questionnaire-European version
The IEQ-EU  consists of seven distinct modules. Module 2 is the IEQ-EU core module. It consists of 31 items relevant to caregiving consequences of psychiatric disorders as well to all kinds of encouragement and care that the caregiver has to provide to the patient. These items can be summarized in a total score and in four subscales: supervision of dangerous behaviors of the patient, interpersonal problems between the patient and the caregiver, caregiver’s worrying, and caregiver’s coping with the relevant and subjective burden. IEQ can be used both as a research and clinical instrument. In the case of research use, all items are scored on a 5-point Likert scale. In the case of clinical use, items scores are dichotomized. An overview of the IEQ-EU core module is given in the ‘Results’ section.
The remaining six modules of IEQ-EU are as follows: module 1 consists of 15 items of sociodemographics of patients, of family and contact variables; module 3 consists of eight questions on extra financial expenses incurred on behalf of the patient; module 4 consists of the General Health Questionnaire 12 ; module 5 contains three questions for professional help which the caregivers used; and module 6 consists of eleven questions on the consequences for the patient’s children. In the last section of the questionnaire, module 7 is composed of an open question that gives an opportunity to the respondent to make further additions and comments.
Nottingham Health Profile
The NHP is an instrument to assess quality of life . In our study, it served to assess the construct validity of the Greek IEQ-EU. It consists of two parts. Part 1 contains 38 yes/no items in six dimensions: pain, physical mobility, emotional reactions, energy, social isolation, and sleep. Part 2 contains seven general yes/no questions concerning daily living problems. The two parts may be used independently. Part I was scored using weighted values which give a range of possible scores from 0 (no problems at all) to 100 (presence of all problems within a dimension).
Translation and cultural adaptation
The 81 items of IEQ-EU were translated by two independent bilingual translators. Another native English speaker who did not have knowledge of the original instrument back then translated the reconciliated Greek version. The expert panel reviewed the modified version.
Next, a cognitive debriefing process was used to identify any problems with language and to assess the degree to which a respondent’s understanding of each item matched the content that was meant to be elicited . As part of this process, the reconciliated Greek version of the IEQ-EU was pilot tested on eight caregivers who had relatives with mental disorders and who had been admitted to the Clinic of Psychiatry of the University Hospital of Heraklion for treatment. Written comments provided by them in the cognitive debriefing report were included in the final Greek version. Translation and back-translation did not reveal substantial problems. During the cultural adaptation process, the questionnaire was found to be overall comprehensible and easy to fill out according to most caregivers’ comments.
Statistical analysis was performed using SPSS v. 20.0 for windows (IBM SPSS Statistics 20.0, Chicago, IL, USA, 2011), and linear structural relations (LISREL) 8.80 (Scientific Software International, Inc., USA, 2006) for the confirmatory factor analysis. Descriptive characteristics (including means, standard deviations, frequencies, and percentages) and the assumptions of normality, homogeneity, and independent cases of the sample were checked. The χ2 test was used for categorical data, and independent sample t tests were applied for normally distributed variables. Statistical significance was set at p < 0.05. Where corrections for multiple comparisons were required, Bonferroni adjustments were made, in which case a value of p < 0.001 was accreted as statistically significant.
Internal consistency and reproducibility (test-retest reliability) were measured as part of the reliability analysis of the translated instrument. Internal consistency was determined by Cronbach’s alpha and Guttman split-half coefficients . The interclass correlation coefficient (ICC) was used to calculate the test-retest reliability between the subscales and Cohen’s kappa for individual items .
Face and content validity
The meaning and acceptability of the items by the caregivers were investigated by the first author during the administration of the scale in semi-structured interviews in order to assess whether, on the face of it, the questionnaire appeared to be measuring the desired conceptual domains (face validity) and to assess whether the questionnaire attempts to measure all of the relevant and important elements of complex conceptual domains that do not lend themselves to being measured directly (content validity).
Convergent validity explores to what extent the Greek IEQ-EU subscales correlate towards expected direction with conceptually relevant variables as, for example, those of the NHP. Correlation coefficients (Pearson and Spearman’s rho) between total scores of the Greek IEQ-EU and total scores on the NHP were calculated in order to determine the magnitude of the relationship between the two scales; correlation data for the four subscales, which were revealed by factor analysis, were also analyzed in order to examine the construct validity of the Greek IEQ-EU.
The underlying dimensions of the scale were examined using factor analysis with principal components and varimax rotation as a common exploratory method for analyzing grouped data . This dimension reduction technique was carried out to determine the structure of the Greek IEQ-EU using the following criteria: (a) Only factors with eigenvalue >1 were considered ; (b) items should have primary loadings >0.50 and secondary loadings <0.40; (c) the interpretation of the factor structure should be meaningful; and (d) scree plot is accurate in the case where the means of communalities are above 0.60 . Computations were based on covariance matrix, as all variables were receiving values from the same measurement scale ; Bartlett’s test of sphericity with p < 0.05 and a Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy of 0.60 were used in performing this factor analysis . A forced four-factor solution was chosen in order to provide comparable results with previous research, in line with the authors of the original scale . As factor analysis revealed four independent subscales, subsequent Cronbach’s alphas were separately carried out for each subscale, highlighting how the items group together. Additionally, a confirmatory analysis - also known as structural equation modeling - was conducted using LISREL in order to confirm that the scale items principally load on the expected factor and correlate weakly with other factors to obtain tests of significance of factor loadings and of the orthogonality of factors [23, 25, 28]. A model based on a priori information from the exploratory factor analysis conducted earlier was built in order to specify latent factors, their component variables, and the intercorrelations of the response variables. The maximum likelihood LISREL estimates, t values, error terms, correlation of independent variables, and goodness-of-fit tests for the specified model were performed.
Most of the informal caregivers were female 54 (83%), mainly mothers, with a mean age of 62.6 (SD = 10.9 years) and lived with a patient with a mental disorder in the same household (Table 1). The mean age of the patients was 44.4 (SD = 12.5) years. Approximately two thirds of patients were men (61.5%) and they had a diagnosis of schizophrenia (86%) or bipolar affective disorder (24%).The majority of caregivers were worried about a patient’s future (83%), his/her financial status (75%), ensured medication intake (72%), and general health (52%). Descriptive statistics of the Greek IEQ-EU core module are presented in Table 2.
Psychometric properties of the Greek IEQ-EU core module
Internal consistency and test-retest reliability
The Greek IEQ-EU core module showed a high overall internal consistency. The Cronbach’s alpha for the whole scale was 0.88 ranging between 0.68 (factor 2) and 0.88 (factor 1) (Table 3). The Spearman-Brown coefficient was 0.76 and the Guttman split-half coefficient was 0.71. The test-retest reliability was 0.95 (bias, −0.005; SE = 0.051) with 95% confidence interval (CI) of 0.84 to 1.00 (p < 0.001) for individual items and with an ICC of 0.82 (95% CI, 0.75 to 0.88; p < 0.001) for the total score.
Face and content validity
The Greek version of the IEQ-EU was well accepted by the caregivers. It was simple and quick, approximately 15 min of completion for the IEQ-EU module alone (the entire set of questions took about 30 to 40 min to complete). The open question in the last section of the questionnaire, which gives an opportunity to the caregivers to make further comments, did not show that any significant domains in terms of care experience were missing. The questionnaire appeared to be measuring the desired conceptual domains and attempted to measure all of the relevant and important elements of domains of the caring consequences.
The Greek IEQ-EU total score correlated positively (Pearson r = 0.62, p value of Spearman = 0.67, p < 0.001) with the validated Greek version of NHP measuring quality of life. Moreover, the Greek IEQ-EU total score showed significant positive correlations with the NHP subscales as follows: pain (r = 0.57, p value of Spearman = 0.60, p < 0.001), emotional reaction (r = 0.55, p value of Spearman = 0.54, p < 0.001), social isolation (r = 0.47, p value of Spearman = 0.45, p < 0.001), physical mobility (r = 0.40, p value of Spearman = 0.49, p < 0.001), and energy (r = 0.53, p value of Spearman = 0.57, p < 0.001).
Exploratory factor analysis
On the basis of the eigenvalues and the scree test, the exploratory principal component analysis of the 31 items of the Greek IEQ-EU core module revealed four orthogonal factors (KMO measure of sampling adequacy = 0.60; Bartlett’s test of sphericity = 1,428.5, df = 465, p < 0.0005). Those factors explained 58.2% of variance, as presented in Table 3. The factor structure is presented in detail in Table 2. The first factor (F1) includes the following items: 16, 17, 18, 19, 20, 21, 24, 27, and 29. These are specific questions for encouragement and care to motivate and activate the patients to do things for themselves; therefore this subscale was named Urging. The second factor (F2) is composed of items 22, 25, 31, 32, 34, 35, and 45. These questions are relevant to the interpersonal atmosphere between the patient and the caregiver; therefore we named this subscale Tension. The third factor (F3) is composed of items 37, 38, 39, 40, and 41. These are specific questions for caregiver’s worrying, coping and subjective burden; therefore we named this subscale Worrying. The forth factor (F4) is composed of items 30, 42, 43, 44, and 46 (Table 4). Therefore F4 represents worrying for the ‘common future’ of the caregivers and patients. Table 3 presents the means, standard deviations, and intercorrelations of the four factors of the Greek IEQ-EU. A repeated measures analysis of variance of the four factor scores with subsequent pairwise comparisons using the Bonferroni post hoc test showed that participants scored the highest on F, Worrying (mean = 3.30, SD = 1.07), then on F1, Urging (mean = 2.59, SD = 1.07) and F4, Common future (mean = 2.79, SD = 0.83), and the lowest on F2, Tension (mean = 1.78, SD = 0.70), with multivariate F(3, 62) = 41, 99 and p < 0.001. The intercorrelations between the four factors were significant, though of medium size, indicating that these factors measure distinct domains of a general construct (Table 3).
Confirmatory factor analysis
Confirmatory factor analysis was conducted in order to determine whether data are consistent with the specified model that has been suggested by the exploratory factor analysis and by the factor structure of the European version of the instrument. The four-factor model was based on the factors obtained from the exploratory principal component analysis with varimax rotation presented earlier in this section. The confirmatory factor analysis using maximum likelihood method showed that the four latent variables, i.e., Urging, Tension, Worrying, and Common future, were correlated (r = 0.42, p < 0.05). The LISREL estimates and fit indices of the model tested are presented at Figure 2. Goodness-of-fit statistics were as follows: (1) chi-square = 509.31, df = 293, p < 0.001; (2) chi-square / df = 1.73; (3) root mean square error of approximation (RMSEA) = 0.11 (90% CI 0.09 to 0.12); (4) expected cross-validation index (ECVI) = 9.77 (90% CI: 8.85-10.81) < ECVI for saturated model = 10.97; (5) Akaike’s information criterion model (AIC) = 625.31 < saturated AIC = 702.00; (6) consistent Akaike’s information criterion model (CAIC) = 809.42 < saturated CAIC = 1,816.21; (7) non-normed fit index (NNFI) = 0.80; (8) comparative fit index (CFI) = 0.82; (9) incremental fit index (IFI) = 0.82; and (10) root mean square residual (RMR) = 0.20. These coefficients indicate a modest fit of our data to the hypothesized model.
In this study the concurrent, face, and content validity of the Greek IEQ-EU were grounded on quality assurance of the translation. Standardized Cronbach’s alphas for the Greek IEQ-EU core module were found similar to those reported by Schene et al. in the first validation study , by van Wijngaarden et al. in the five European Psychiatric Services: Inputs Linked to Outcome Domains and Needs (EPSILON) sites , and by Bernert et al. in the German validation study  of the IEQ-EU. Also, the Cronbach’s alpha and Spearman-Brown coefficients were found similar to those reported by Tang et al. in the Chinese validation study . ICC on test-retest was relatively high, indicating excellent test-retest reliability for the Greek version of the IEQ-EU core module.
The exploratory factor analysis of the Greek IEQ-EU core module revealed the shared variance of four separate factors according to the EPSILON convention . A number of studies that have investigated its structure have found that the IEQ-EU core module consists of four distinct factors [13–15]. Our findings partially replicate these results, as they demonstrate the same four-factor structure but with similar loadings only for the three factors and with more substantial differences in the fourth factor. Thus, items 22 and 25 are loaded on tension instead of supervision, while items 24 and 29 are loaded on urging instead of supervision. Items 30, 42, and 43, which are originally loaded on the tension subscale, are now loaded on the forth factor, together with items 44 and 46. These findings may be explained by different cultural backgrounds. Although the functions of the family, which are related to hierarchy and power, are changing gradually in the context of globalization, some behaviors of family members (especially relevant to relationships and emotional bonds) are constant over time, a phenomenon which suggests that some human psychological needs resist social change . Family has always been and still is the core element of the Greek society and in most cases it is willing to embrace and care for a member with mental health problems . Of course, nowadays, the exposure of Greek families to the consequences of the severe financial crisis threatens the traditional family functions for people with mental health problems. So caregivers should be supported through financial benefits and practical assistance. The above conclusion may be valid for the Greek families in general, since socioeconomical changes over the last three decades have led to a relatively homogenous cultural background of Cretans (i.e., the participants of our study) with the rest of Greece .
The confirmatory factor analysis demonstrated that the four-factor model tested did not offer the most desirable fit to our data, although the fit indices of this analysis were not disappointing. For example, RMSEA (0.11) is close to the suggested cutoff point of 0.08, while NNFI (0.80), CFI (0.82), and IFI (0.82) approach the suggested value of 0.90 [33–36]. Furthermore, the value of chi-square / df equals to 1.73 < 2 and thus it is indicative of a good model fit . The above mixed results suggest that there is room for further research in this area in order to replicate our findings.
Of the four subscales of the G-IEQ-EU, worrying scored the highest. This is in accordance to reports from other recent studies [7, 37–39], and it can be considered as a further indication of validity. The percentages of worries about a patient’s future, his/her financial issues, general health, and the kind of help/treatment that s/he received were higher in our study than in reference studies [37–44]. This pattern of findings can be attributed to the structural differences in mental health care provided in Greece, as compared to other countries, or to the cultural factors. Although deinstitutionalization of large numbers of long-stay hospital patients is an undeniable achievement, the re-provision of community-based services for those with severe mental illness is not yet adequate and there have been serious delays . Van Wijngaarden et al. in 2003 reported that the influence of cultural characteristics cannot be ruled out; for that reason, researchers should compose their own national norm groups and use them as a local standard. The results of this validation study provide some evidence about caregiving consequences on the caregivers’ quality of life and some understanding of the needs of the families of patients with mental disorders. They raise attention and claim actions in order to alleviate the caregivers’ and patients’ burden. This is a clear task for health policy makers, which becomes more imperative in contemporary Greece that struggles against a major financial crisis. To that direction, the Greek IEQ-EU can be a useful tool to assess the caregivers’ burden and identify their needs.
Limitations of the study
Certain limitations should be discussed prior any attempts to interpret the study results. The study sample was small and full-scale validation requires application of the scale in larger samples. Another concern derives from the selection of caregivers. In our study the caregivers were selected from the patients’ records available at a mental health hospital; it is not known to what extent this may have affected the external validity of the study. Another concern addresses the use of a ‘gold standard’ to examine the concurrent validity of instruments measuring the burden of caregivers. In our study, this role was assigned to NHP, an instrument that assesses quality of life and daily living problems.
The Greek version of the core module of the IEQ-EU appears to be quite reliable and reasonably valid tool. However, additional research is necessary before these findings can be corroborated. The Greek IEQ-EU will facilitate the assessment and detection of the impact of caring on families with a relative with a mental disorder. Instruments of this kind may contribute to a better understanding of the needs of families and, therefore, to the development of policies in support of this vulnerable population group.
Greek version of the IEQ-EU
Interclass correlation coefficient
Involvement Evaluation Questionnaire-European Union
Linear Structural Relations
Nottingham Health Profile
World Health Organization (WHO): The World Health Report 2001: Mental Health: New Understanding, New Hope. 2001, Geneva: World Health Organization
Thornicroft G, Tansella M: Growing recognition of the importance of service user involvement in mental health service planning and evaluation. Epidemiol Psichiatr Soc. 2005, 14: 1-3. 10.1017/S1121189X00001858.
Stylianidis SF, Pantelidou SM, Chondros PC: Evaluation of the rehabilitation process in Greek community residential homes: resettlement from Greek psychiatric hospitals. Int J Psychosoc Rehabil. 2008, 13: 31-38.
Lionis C, Symvoulakis E, Markaki A, Vardavas C, Papadakaki M, Danilidou N, Souliotis K, Kyriopoulos I: Special series: integrated primary health care: integrated primary health care in Greece, a missing issue in the current health policy agenda: a systematic review. Int J Integr Care. 2009, 9: e88-
Madianos M, Economou M, Dafni O, Koukia E, Palli A, Rogakou E: Family disruption, economic hardship and psychological distress in schizophrenia: can they be measured?. Eur Psychiatry. 2004, 19: 408-414. 10.1016/j.eurpsy.2004.06.028.
van Wijngaarden B, Schene AH, Koeter M: Family caregiving in depression: impact on caregivers’ daily life, distress, and help seeking. J Affect Disord. 2004, 81: 211-222. 10.1016/S0165-0327(03)00168-X.
Madianos M, Economou M, Alexiou T, Stefanis C: Depression and economic hardship across Greece in 2008 and 2009: two cross-sectional surveys nationwide. Soc Psychiatry Psychiatr Epidemiol. 2011, 46: 943-952. 10.1007/s00127-010-0265-4.
Economou M, Madianos M, Theleristis C, Peppou L, Stefanis C: Increased suicidality amid economic crisis in Greece. Lancet. 2011, 378: 1459-
Gonçalves-Pereira M, van Wijngaarden B, Xavier M, Papoila AL, Caldas-de-Almeida JM, Schene AH: Caregiving in severe mental illness: the psychometric properties of the Involvement Evaluation Questionnaire in Portugal. Ann Gen Psychiatry. 2012, 11: 8-10.1186/1744-859X-11-8.
Schene AH, Koeter M, van Wijngaarden B, Knudsen HC, Leese M, Ruggeri M, White IR, Vásquez-Barquero JL: Methodology of a multi-site reliability study. EPSILON Study 3. European Psychiatric Services: Inputs Linked to Outcome Domains and Needs. Br J Psychiatry Suppl. 2000, 39: s15-s20.
van Wijngaarden B, Schene AH: Cross-national research: caregiver consequences. Psychiatr Times. 2004, 21: 5-
Schene AH, van Wijngaarden B, Koeter MWJ: Involvement Evaluation Questionnaire-European Version. 2001, Academic Medical Center, Amsterdam, The Netherlands: Department of Psychiatry
van Wijngaarden B, Schene AH, Koeter M, Vasquez-Barquero JL, Knudsen HC, Lasalvia A, McCrone P, EPSILON Study Group: Caregiving in schizophrenia: development, internal consistency and reliability of the Involvement Evaluation Questionnaire. European Version. EPSILON Study 4. Br J Psychiatry. 2000, 177: 21-27. 10.1192/bjp.177.39.s21.
Bernert S, Reinhold K, Matschinger H, Mory C, Roick C, Angermeyer M: Die Erfassung der Belastung der Angehorigen psychisch erkrankter Menschen. Psychiat Prax. 2001, 28 (Sonderheft 2): 97-101.
Tang VWK, Leung SK, Law LCW: Validation of the Chinese version of the involvement evaluation questionnaire. Hong Kong J Psychiatry. 2008, 18: 6-14.
Vidalis A, Syngelakis M, Papathanasiou M, Whalley D, Mc Kenna SP: The Greek version of the Nottingham Health Profile. Hippokratia. 2002, 1: 79-82.
Walter SD, Eliasziw M, Donner A: Sample size and optimal designs for reliability studies. Stat Med. 1998, 17: 101-110. 10.1002/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>3.0.CO;2-E.
Dafermos V: Repeated Measures Models. 2002, Athens: Leader Books, in Greek
Schene AH, van Wijngaarden B, Koeter MWJ: Involvement Evaluation Questionnaire. 2002, Amsterdam: Department of Psychiatry, Academic Medical Center, doc: IEQ-INFO-2002-1 (19-06-02)
Bowling A: Research Methods in Health: Investigating Health and Health Services. 2002, Maidenhead: Open University, 2
DeVellis RF: Scale Development: Theory and applications. 1991, Newbury Park: Sage
de Vet HC, Bouter V, Bezemer PD, Beurskens AJ: Reproducibility and responsiveness of evaluative outcome measures. Theoretical considerations illustrated by an empirical example. Int J Technol Assess Health Care. 2001, 17: 479-487.
Tabachnick B, Fidell L: Using Multivariate Statistics. 2007, New York: Addison-Wesley-Longman, 3
Kaiser HF: The application of electronic computers to factor analysis. Educ Psychol Meas. 1960, 20: 141-151. 10.1177/001316446002000116.
Hakstian AR, Rogers WD, Cattell RB: The behaviour of numbers factors rules with simulated data. Multivariate Behav Res. 1982, 17: 193-219. 10.1207/s15327906mbr1702_3.
Morrison DF: Multivariate Statistical Methods. 1976, New York: McGraw-Hill, 2
Kaiser HF: An index of factorial simplicity. Psychometrika. 1974, 39: 31-36. 10.1007/BF02291575.
Jöreskog KG, Sorbom D: LISREL VI: Analysis of Linear Structural Relationships by Maximum Likelihood, Instrumental Variables, and Least Squares Methods. 1986, Mooresville: Scientific Software
Schene AH, van Wijngaarden B, Koeter MWJ: Family caregiving in schizophrenia: domains and distress. Schizophr Bull. 1998, 24: 609-618. 10.1093/oxfordjournals.schbul.a033352.
Georgas J, Berry WJ, van de Vijver F, Kagitcibasi C, Poortinga Y: Families Across Cultures: A 30-nation Psychological Study. 2006, Cambridge: Cambridge University Press
Karastergiou A, Mastrogianni A, Georgiadou E, Kotrotsios S, Mauratziotou K: The reform of the Greek mental health services. J Ment Health. 2005, 14 (2): 197-203. 10.1080/09638230500060516.
Vivilaki V, Dafermos V, Kogevinas M, Bitsios P, Lionis C: The Edinburgh Postnatal Depression Scale: translation and validation for a Greek sample. BMC Public Health. 2009, 9: 329-10.1186/1471-2458-9-329.
Ullman JB: Structural equation modeling. Using Multivariate Statistics. Edited by: Tabachnick BG, Fidell LS. 2001, Boston: Allyn & Bacon, 653-771. 4
Joreskog K, Sorbom D: LISREL 8: Structural Equation Modeling with the SIMPLIS Command Language. 1993, Lincolnwood: SSI
Tanaka JS: Multifaceted conceptions of fit in structural equation models. Testing Structural Models. Edited by: Bollen KA, Long JS. 1993, Newbury Park: Sage
Bentler PM: Comparative fit indexes in structural equation models. Psychol Bull. 1988, 107: 238-246.
Hadrys T, Adamowski T, Kiejna A: Mental disorder in Polish families: is diagnosis a predictor of caregiver’s burden?. Soc Psychiatry Psychiatr Epidemiol. 2011, 46: 363-372. 10.1007/s00127-010-0200-8.
van Wijngaarden B, Koeter M, Knapp M, Tansella M, Thornicroft G, Va’zquez-Barquero JL, Schene AH: Caring for people with depression or with schizophrenia: are the consequences different?. Psychiatry Res. 2009, 169 (1): 62-69. 10.1016/j.psychres.2008.06.013.
Cleary M, Freeman A, Hunt GE, Walter G: Patient and carer perceptions of need and associations with care-giving burden in an integrated adult mental health service. Soc Psychiatry Psychiatr Epidemiol. 2006, 41 (3): 208-214. 10.1007/s00127-005-0017-z.
van Wijngaarden B, Schene AH, Koeter MJW, Becker T, Knapp MRJ, Knudsen HC, Tansella M, Thornicroft G, Va’zquez-Barquero JL, Lasalvia A, Leese M, EPSILON study group: People with schizophrenia in five countries: conceptual similarities and intercultural differences in family caregiving. Schizophr Bull. 2003, 29 (3): 573-586. 10.1093/oxfordjournals.schbul.a007029.
Wing Kay Tang V, Leung SK, Chiu-Wa Lam L: Clinical correlates of the caregiving experience for Chinese caregivers of patients with schizophrenia. Soc Psychiatry Psychiatr Epidemiol. 2008, 43 (9): 720-726. 10.1007/s00127-008-0357-6.
Magne-Ingvar U, Ojehagen A: Significant others of persons with mental health problems: the testing of a questionnaire on the burden of significant others. Nord J Psychiatry. 2005, 59 (6): 441-447. 10.1080/08039480500364841.
Page A, Hooke G, O’Brien N, de Felice N: Assessment of distress and burden in Australian private psychiatric inpatients. Australas Psychiatry. 2006, 14 (3): 285-290.
Rose LE, Mallinson RK, Gerson LD: Mastery, burden, and areas of concern among family caregivers of mentally ill persons. Arch Psychiatr Nurs. 2006, 20 (1): 41-45. 10.1016/j.apnu.2005.08.009.
The authors would like to thank Dr. Pavlos Theodorakis for fruitful discussion on the importance of this study prior translation and validation process, as well as to express their gratitude to Josephine Mannion-Kapsali for linguistic assistance. The authors also would like to thank the caregivers who kindly consented to participate in this study. This research has been funded by a grant from the State Mental Health Hospital of Chania, Crete, Greece through the University of Crete.
The authors declare that they have no competing interests.
VS participated in study design, translation, adaptation and validation of the questionnaire, carried out data collection and data entry, participated in the analysis, and wrote the final draft of the manuscript, while she contributed to the revision of the manuscript. VD participated in study design, carried out the statistical analysis, and co-wrote the final draft of the manuscript, while he contributed to the revision of the manuscript. MCH, VV, and PB provided consultation during translation/adaptation/validation process and commented on the writing of the final draft of the manuscript, while they contributed to the revised manuscript. AHS kindly granted permission to translate the IEQ and co-wrote the final draft of the manuscript, while he contributed to the revised manuscript. CL conceived the study design, coordinated in the translation/adaptation/validation process, and co-wrote the final draft of the manuscript, while he contributed to the revision of the manuscript. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Sapouna, V., Dafermos, V., Chatziarsenis, M. et al. Assessing the burden of caregivers of patients with mental disorders: translating and validating the involvement evaluation questionnaire into Greek. Ann Gen Psychiatry 12, 3 (2013). https://doi.org/10.1186/1744-859X-12-3
- Mental disorders