Validation study of HSCL-10, HSCL-6, WHO-5 and 3-key questions in 14–16 year ethnic minority adolescents
© Sirpal et al. 2016
Received: 15 July 2014
Accepted: 19 January 2016
Published: 27 January 2016
There is a lack of validated instruments for detection of depression in ethnic minority adolescent patients in primary care. This study aimed to compare a subgroup of the bilingual, ethnic minority adolescents with the rest of the population using Hscl-10, Hscl-6, WHO-5 and 3-Key Questions for detection of depression in primary care.
This is a cross-sectional, multicenter study conducted in General Practice in Norway and Denmark. A minor bilingual non-aggregated heterogenic ethnic minority group from non-European countries was compared with a major ethnic group of Norwegian/Danish adolescents. Participants completed questionnaires which were either mailed to them or found on our website. The Composite International Diagnostic Interview was used as gold standard. Depression classified by the International Classification of Diseases - 10. The Internal and external validity of the four questionnaires were examined. Optimal cut-off point for major depressive disorder was calculated using the Youden Index.
294 (77 %) were interviewed; mean age was 15 years. The ethnic group comprised 44 (64 % girls and 36 % boys). Chronbach’s alpha was above 0. 70 and area under curve was 0.80 or above for all instruments in the ethnic minority group. Cut-off points for major depressive disorder had sensitivities of 81 % (Hscl-10), 82 % (Hscl-6), 91 % (Who-5) and 81 % (3-key questions) in the ethnic minority group. Corresponding specificities were 80 % (Hscl-10), 77 % (Hscl-6), 80 % (Who-5) and 67 % (3-key questions). Cut-off points were the same Hscl-10, Who-5, the 3-key questions but differed for Hscl-6.
Hscl-10, Hscl-6, WHO-5 and 3-key questions seem to be valid instruments for detection of depression in bilingual, ethnic minority adolescents in primary care.
KeywordsAdolescent General practice Depression Diagnostic instrument
There is a lack of validated instruments for detecting depression in ethnic minority adolescents in primary health care. Primary care physicians are the first line of contact with the health care system in Scandinavian and most other European countries [1, 2]. Minority groups often seek help for mental illness from primary care physicians [3, 4] over specialist mental health services , because they find that choice less stigmatizing . However, Borowsky et al.  notes that primary care physicians are less likely to identify depression in various ethnic minority groups.
Primary care phenomenology differs considerably from specialist mental health: problems are presented in the form of unfiltered and unrecognized symptoms, not readily identifiable as mental health illness . Symptom presentations in clinical settings depend upon subjective perception of somatic and psychological symptoms, which seem to be closely linked to ethnic background . Asian adolescents demonstrate a tendency to somatize depressive symptoms  and African-American adolescents to express depressive symptoms as anger, aggression or irritability rather than hopelessness, sadness or depressive mood [9, 10] – expressions often misinterpreted and diagnosed as problem behaviour . Similarly, Hispanic Americans use a variety of expressions to describe emotional distress: bad in the brain or in the mind, spiritually weak, craziness (locura), and losing control of oneself (perdiendo) . Undoubtedly these culture bound expressions present a considerable challenge in diagnosis of depression.
Black adolescents are less likely to receive depression treatment than are their white counterparts  and ethnic minority adolescents living in western countries are at higher risk for depression [14–16] than are their majority peers. It is therefore crucial to improve diagnosis of depression in ethnic adolescents, as this condition is effectively treatable in this group [17, 18]. Detection of depression is improved by appropriate use of symptom rating scales in primary care in adolescent patients . The National Institute for Health and Clinical Excellence (NICE; www.nice.org.uk/pdf/CG023quickrefguide.pdf) guidelines recommend the use of short questionnaires in primary care, for adults and adolescents.
The four instruments validated in the study
Sudden fear for no reason
I have felt cheerful and in good spirits
During the past month you often been bothered by feeling down, depressed or hopeless?
Afraid & anxious
Feeling little worth
I have felt calm and relaxed
During the past month have you often been bothered by little interest or pleasure in doing things?
Faint & dizzy
Thoughts of taking your life
I have felt active and vigorous
Is this something you would like help with?
Tense & harassed
Feeling of being trapped
I woke up feeling fresh and rested
Feeling of loneliness
My daily life has been filed with things that interest me
Useless, of little worth
Everything is a burden
Hopelessness for the future
The aim of this paper was to compare the subgroup of the bilingual, ethnic minority adolescents with the rest of the population using Hscl-10, Hscl-6, WHO-5 and 3-Key Questions for detection of depression in primary care.
Internal Validation of Hscl-10/6, who-5 and 3 key questions with the CIDI: Mokken scla e analysis and cronbach’s alpha for ethnic minority population
HScl - 10
Hscl - 6
Who - 5
Responses were recognized by the login code and participation number. Participants were required to provide a telephone number by which they could be contacted (but not their names). This number was used to conduct The Composite International Diagnostic Interview (CIDI) by two members of the study group, who also conducted all CIDI interviews. The dates of receipt of the questionnaire and agreement form and of the telephone interview were recorded.
CIDI Version 2, 1 was used as the gold standard interview. CIDI is a widely accepted clinical instrument for measuring depression [22, 23], and also validated in ethnic minority populations . A diagnosis within the last two weeks was defined as ongoing diagnosis. CIDI is a fully structured, standardized diagnostic interview that has been subjected to reliability and validity tests, and demonstrates good feasibility and high interrater reliability [25, 26]. The Demographic and Depression modules were used. In the CIDI interview we also registered if participants were mono- or bilingual and the second language was from Non-European countries (ethnic minority). The three key questions were asked before the CIDI interview.
Website data were collected directly in a data bank, and paper questionnaire and telephone interview date were also fed into the data bank. The data files were analysed by STATA version 11. The Danish Research Ethics Committee in Denmark (2006-2.0/44); and The National Committee for Research Ethics in Norway (S-06293a) approved this study.
Internal validity was examined using Cronbach’s alpha and the Mokken Scale Analysis, and Feldt’s W to test the equality of Cronbach’s alpha between the minor and the major ethnic population. The Mokken Scale was used to test that the questionnaires were unidimensional. External validity was analysed through Receiver Operating Characteristic curve (ROC), with specifying measurement for sensitivity, specificity and predictive values. Using the Youden Index optimal cut-off point for each instrument is decided, depicting the highest sensitivity and specificity values for the instruments validated. We used International Classification of Diseases 10 (ICD-10) diagnosis for mild depressive episode (F32.0), moderate depressive episode (F32.1), severe depressive episode without psychotic symptoms (F32.2), recurrent depressive disorder, current episode moderate (F33.1), recurrent depressive disorder, current episode severe without psychotic symptoms (F33.2) and Dysthymia (F34.1).
Mean age of the 2374 adolescents invited to participate was 15 years; 384 (16 %) returned the questionnaire), 294 (77 %) of which were interviewed. The ethnic minority group comprised 44 adolescents (64 % girls and 36 % boys). Questionnaires were returned an average of 23.5 days after receipt; 84 % of the ethnic minority group and 86 % of the majority group used the paper version. Among those interviewed on the CIDI, 25 % of ethnic adolescents and 11 % of majority adolescents met the ICD-10 criteria for major depression. All ethnic minority adolescents who completed CIDI also answered all three questionnaires and the 3-key questions.
The cutoff point for Hscl-10 was 16 for both ethnic and majority groups (sensitivity – ethnic 81 %, majority 90 %; specificity – ethnic 80 %, majority 79 %). Cutoff point for Hscl-6 was 11 for ethnic and 9 for majority (sensitivity – ethnic 82 %, majority 80 %; specificity – ethnic 77 %, majority 80 %). Cutoff point for Who-5 was 11 for both ethnic and majority (sensitivity – ethnic 91 %, majority 85 %; specificity – 80 % for both groups). For the three key questions, cutoff point was 1 for both groups (sensitivity – ethnic 81 %, majority 80 %; specificity – ethnic 67 %, majority 78. 5 %). The cutoff points were similar for girls and boys in the ethnic group.
For identification of depression in ethnic minority adolescents in primary care, 14–16 year olds in this study substantiate that Hscl-10, Hscl-6, WHO-5 and 3- key questions are all valid instruments. To our knowledge this is the first study to compare the validity of diagnostic instruments used for depression diagnosis in non-aggregated heterogenic ethnic minority adolescent population in primary care.
Our findings suggest equality in understanding and ability to relate to depression symptoms cross culturally in adolescents. Recent studies [27, 28] also report that the difference in expressing depression symptoms is less in bilingual adolescences cross culturally as compared to bilingual adults. As the cut-off points are the same for both genders, it makes questionnaires validated easily applicable in primary care. We found a higher percentage of adolescents with depression in the ethnic minority group than in the majority group. This finding is similar those of earlier studies  in emphasizing that ethnic minority adolescents may have a higher risk for depression .
These results provide primary care clinicians with the opportunity to use less time-consuming questionnaires to improve the diagnosis of depression in ethnic minority adolescents though it must be stressed that these instruments are merely an aid to clinical assessment 
This study has some limitations. First, the ethnic adolescent sub-group is small, so the results may differ concerning both validation and the cut-off points if studied in a larger population. However the method designed with the questionnaires are tested against a gold standard test (CIDI) on the same participant. It is a kind of individual test-retest method where the individual has a greater effect on the outcome than the sample. The area under the curve is not significantly different for the four questionnaires suggesting that the instruments show a positive tendency to be valid for use in the ethnic minority population studied. Second because the Questionnaires validated were not translated into the participants’ native languages, our results can only be applicable for bilingual adolescents.
We speculate that the ethnic minority adolescents in our study are highly acculturated. Third, the study did not include a clinical interview because the adolescents were interviewed by telephone; yet acceptable agreement between telephone and face-to-face assessment using an observer-rated depression scale has been found (30). CIDI is a fully structured interview that can be administered by trained lay interviewers , and these CIDI interviewers were two experienced GPs, trained and certified for CIDI.
In summary, we conclude that Hscl-10, Hscl-6, Who-5 and the 3-key questions are valid instruments for detecting depression in ethnic minority adolescents from non-european countries in primary care when the language barrier is eliminated. Due to the small size of the ethnic minority population further research in larger populations is recommended.
The use of these short instruments together with diagnostic dialogue can help primary health clinicians to translate patients’ narrative into medically accepted terminology. The use of questionnaires will also enhance accurate diagnosis of depression in ethnic minority adolescents, leading to better treatment, better outcome and aids in communication with other health services. We recommend use of standardized validated instruments in future research studies concerning depression in ethnic minority adolescents.
We thank Nina Colwill for editing the final version of the paper. This editing was funded upon a minor pre-agreed amount. All authors are funded through fixed pay from the institutions they belong. The fund for quality insurance of Primary Health Care by the Norwegian Medical Association also granted this research.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Haavet OR, Straand J, Hjortdahl P, Saugstad OD. Do negative life experiences predict the health-care-seeking of adolescents? A study of 10th- year students in Oslo, Norway. J Adolesc Health. 2005;37(2):128–34.PubMedView ArticleGoogle Scholar
- Mauerhofer A, Berchtold A, Michaud PA, Suris JC. GPs’ role in the detection of psychological problems of young people: a population-based study. Br J Gen Pract. 2009;59(566):e308–14.PubMedPubMed CentralView ArticleGoogle Scholar
- Burroughs H, Lovell K, Morley M, Baldwin R, Burns A, Chew-Graham C. ‘Justifiable depression’: how primary care professionals and patients view late-life depression? A qualitative study. Fam Pract. 2006;23(3):369–77.PubMedView ArticleGoogle Scholar
- Hu TW, Snowden LR, Jerrell JM, Nguyen TD. Ethnic populations in public mental health: services choice and level of use. Am J Public Health. 1991;81(11):1429–34.PubMedPubMed CentralView ArticleGoogle Scholar
- Bradby H, Varyani M, Oglethorpe R, Raine W, White I, Helen M. British Asian families and the use of child and adolescent mental health services: a qualitative study of a hard to reach group. Soc Sci Med. 2007;65(12):2413–24.PubMedView ArticleGoogle Scholar
- Hwang WC, Myers HF, Abe-Kim J, Ting JY. A conceptual paradigm for understanding culture’s impact on mental health: the cultural influences on mental health (CIMH) model. Clin Psychol Rev. 2008;28(2):211–27.PubMedView ArticleGoogle Scholar
- Borowsky SJ, Rubenstein LV, Meredith LS, Camp P, Jackson-Triche M, Wells KB. Who is at risk of nondetection of mental health problems in primary care? J Gen Intern Med. 2000;15(6):381–8.PubMedPubMed CentralView ArticleGoogle Scholar
- Gask L, Klinkman M, Fortes S, Dowrick C. Capturing complexity: the case for a new classification system for mental disorders in primary care. Eur Psychiatry. 2008;23(7):469–76.PubMedView ArticleGoogle Scholar
- Jones BE, Gray BA. Problems in diagnosing schizophrenia and affective disorders among blacks. Hosp Community Psychiatry. 1986;37(1):61–5.PubMedGoogle Scholar
- Baker FM. Diagnosing depression in African Americans. Community Ment Health J. 2001;37(1):31–8.PubMedView ArticleGoogle Scholar
- Rosenblatt A, Rosenblatt JA. Assessing the effectiveness of care for youth with severe emotional disturbances: is there agreement between popular outcome measures? J Behav Health Serv Res. 2002;29(3):259–73.PubMedView ArticleGoogle Scholar
- Bayles BP, Katerndahl DA. Culture-bound syndromes in Hispanic primary care patients. Int J Psychiatry Med. 2009;39(1):15–31.PubMedView ArticleGoogle Scholar
- Cuffe SP, Waller JL, Cuccaro ML, Pumariega AJ, Garrison CZ. Race and gender differences in the treatment of psychiatric disorders in young adolescents. J Am Acad Child Adolesc Psychiatry. 1995;34(11):1536–43.PubMedView ArticleGoogle Scholar
- Potochnick SR, Perreira KM. Depression and anxiety among first- generation immigrant Latino youth: key correlates and implications for future research. J Nerv Ment Dis. 2010;198(7):470–7.PubMedPubMed CentralView ArticleGoogle Scholar
- McLeod JD, Shanahan MJ. Trajectories of poverty and children’s mental health. J Health Soc Behav. 1996;37(3):207–20.PubMedView ArticleGoogle Scholar
- Bhui K, Stansfeld S, Head J, Haines M, Hillier S, Taylor S, et al. Cultural identity, acculturation, and mental health among adolescents in east London’s multiethnic community. J Epidemiol Community Health. 2005;59(4):296–302.PubMedPubMed CentralView ArticleGoogle Scholar
- Roy-Byrne PP, Perera P, Pitts CD, Christi JA. Paroxetine response and tolerability among ethnic minority patients with mood or anxiety disorders: a pooled analysis. J Clin Psychiatry. 2005;66(10):1228–33.PubMedView ArticleGoogle Scholar
- Rossello J, Bernal G, Rivera-Medina C. Individual and group CBT and IPT for Puerto Rican adolescents with depressive symptoms. Cultur Divers Ethnic Minor Psychol. 2008;14(3):234–45.PubMedView ArticleGoogle Scholar
- Zuckerbrot RA, Jensen PS. Improving recognition of adolescent depression in primary care. Arch Pediatr Adolesc Med. 2006;160(7):694–704.PubMedView ArticleGoogle Scholar
- Haavet OR, Sirpal MK, Haugen W, Christensen KS. Diagnosis of depressed young people in primary health care--a validation of HSCL-10. Fam Pract. 2010. doi: 10.1093/fampra/cmq078Google Scholar
- Arroll B, Goodyear-Smith F, Kerse N, Fishman T, Gunn J. Effect of the addition of a “help” question to two screening questions on specificity for diagnosis of depression in general practice: diagnostic validity study. BMJ. 2005;331(7521):884.PubMedPubMed CentralView ArticleGoogle Scholar
- Kessler RC, Ustun TB. The World Mental Health (WMH) Survey Initiative Version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI). Int J Methods Psychiatr Res. 2004;13(2):93–121.PubMedView ArticleGoogle Scholar
- Green JG, Gruber MJ, Kessler RC, Lin JY, McLaughlin KA, Sampson NA, et al. Diagnostic validity across racial and ethnic groups in the assessment of adolescent DSM-IV disorders. Int J Methods Psychiatr Res. 2012;21(4):311–20.PubMedPubMed CentralView ArticleGoogle Scholar
- Andrews G, Peters L, Guzman AM, Bird K. A comparison of two structured diagnostic interviews: CIDI and SCAN. Aust N Z J Psychiatry. 1995;29(1):124–32.PubMedView ArticleGoogle Scholar
- Wittchen HU. Reliability and validity studies of the WHO—Composite International Diagnostic Interview (CIDI): a critical review. J Psychiatr Res. 1994;28(1):57–84.PubMedView ArticleGoogle Scholar
- Schrier AC, de Wit MA, Rijmen F, Tuinebreijer WC, Verhoeff AP, Kupka RW, et al. Similarity in depressive symptom profile in a populationbased study of migrants in the Netherlands. Soc Psychiatry Psychiatr Epidemiol. 2010;45(10):941–51.PubMedView ArticleGoogle Scholar
- Chandra A, Scott MM, Jaycox LH, Meredith LS, Tanielian T, Burnam A. Racial/ethnic differences in teen and parent perspectives toward depression treatment. J Adolesc Health. 2009;44(6):546–53.PubMedView ArticleGoogle Scholar
- Saluja G, Iachan R, Scheidt PC, Overpeck MD, Sun W, Giedd JN. Prevalence of and risk factors for depressive symptoms among young adolescents. Arch Pediatr Adolesc Med. 2004;158(8):760–5.PubMedView ArticleGoogle Scholar
- Hermens ML, Ader HJ, van Hout HP, Terluin B, van DR, de HM. Administering the MADRS by telephone or face-to-face: a validity study. Ann Gen Psychiatry. 2006;5:3.PubMedPubMed CentralView ArticleGoogle Scholar