Scientific output on validation and adaptation of depression screening instruments in peruvian population

ABSTRACT

The aim of the research was to describe the scientific output of psychometric studies on screening instruments for depression in the Peruvian population. We carried out a descriptive study of the scientific literature in Scopus, Web of Science, PubMed and SciELO, with descriptors for depression, psychometric properties, and Peru. After the review process, we included 22 studies. We found validations of screening instruments for older adults, adults, adults with depression, adult women, pregnant women, health professionals, university students, high school students and children. The Patient Health Questionnaire (PHQ-9) was the most widely used instrument. Psychometric studies cover most populations; however, native people and clinical populations remain to be studied. The PHQ-9, due to its characteristics, could be implemented in mental health policies in Peru.

Keywords:
Depression; Depressive Disorder; Validation; Psychometrics; Peru

KEY MESSAGES

  1. Motivation for the study: it is necessary to identify the instruments on depression that have been adapted or validated in Peru in order to plan programs for the detection, prevention, and treatment of depression.
  2. Main findings: 22 studies were found carried out on university students, health personnel, patients with depression, pregnant women, adults, older adults and children. No studies were found in native languages and clinical populations.
  3. Implications: policies for the care, evaluation and follow-up of depression should consider psychometric studies for evidence-based practice.

Keywords:
Depression; Depressive Disorder; Validation; Psychometrics; Peru

INTRODUCTION

The World Health Organization 11. World Health Organization. Depression. WHO. 2021 [citado el 5 de julio de 2022]. Disponible en: https://www.who.int/health-topics/depression.
https://www.who.int/health-topics/depres...
states that by 2030 depression will be the leading cause of morbidity worldwide. The proportion of the world population with this mental health problem is estimated at 4.4%, and is more common in women than in men 22. Sandmire D, Gorham S, Rankin N, Grimm D. The Influence of Art Making on Anxiety: A Pilot Study. J Am Art Ther Assoc. 2012;29(2):68-73. doi: 10.1080/07421656.2012.683748.
https://doi.org/10.1080/07421656.2012.68...
. In Peru, it has been reported that 15.6% of people treated in hospitals have some level of depression 33. Instituto Nacional de Salud Mental. Estudio Epidemiológico de Salud Mental en Hospitales Regionales - 2015. An Salud Ment. 2018;XXXV(1):100-50. Disponible en: https://www.insm.gob.pe/investigacion/estudios.html.
https://www.insm.gob.pe/investigacion/es...
. It is recognized as a public health problem 44. Navarro-Loli JS, Moscoso M, Calderón-De la Cruz G. La investigación de la depresión en adolescentes en el Perú: una revisión sistemática. Liberabit. 2017;23(1):57-74. doi: 10.24265/liberabit.2017.v23n1.04.
https://doi.org/10.24265/liberabit.2017....
) and has a significant impact on people’s quality of life88. Ministerio de Educación. En el Perú hay 47 lenguas originarias que son habladas por cuatro millones de personas. 2017 [citado el 28 de marzo de 2022]. Disponible en: http://www.minedu.gob.pe/n/noticia.php?id=42914.
http://www.minedu.gob.pe/n/noticia.php?i...
. For this reason, health systems should implement or strengthen their professional services to offer psychological treatment and adapted screening instruments.

Screening and prevention tools are useful to accurately identify patients with depressive disorders and initiate treatment 55. MacMillan HL, Patterson CJS, Wathen CN. Screening for depression in primary care: recommendation statement from the Canadian Task Force on Preventive Health Care. CMAJ. 2005;172(1):33-5. doi: 10.1503/cmaj.1030823.
https://doi.org/10.1503/cmaj.1030823...
. There are several screening tools for depression 66. Lloyd-Williams M, Shiels C, Dowrick C, Kissane D. Socio-Economic Deprivation and Symptom Burden in UK Hospice Patients with Advanced Cancer-Findings from a Longitudinal Study. Cancers. enero de 2021;13(11):2537. doi: 10.3390/cancers13112537.
https://doi.org/10.3390/cancers13112537...
, but they should be selected based on methodological aspects in terms of validity and reliability, considering the advances in measurement theory and its theoretical foundations 77. Muñiz J. La medición de lo psicológico. Psicothema. 1998;10(1):1-21. Disponible en: https://reunido.uniovi.es/index.php/PST/article/view/7442.
https://reunido.uniovi.es/index.php/PST/...
. In this context, knowing the aspects of the scientific production of psychometric studies, regarding depression screening instruments in the Peruvian context, is important because it shows the process of calibration of the instruments in different age groups, geographical regions, and cultural contexts; especially in a country with a wide cultural diversity, languages, and native languages such as Peru 88. Ministerio de Educación. En el Perú hay 47 lenguas originarias que son habladas por cuatro millones de personas. 2017 [citado el 28 de marzo de 2022]. Disponible en: http://www.minedu.gob.pe/n/noticia.php?id=42914.
http://www.minedu.gob.pe/n/noticia.php?i...
. Therefore, this study aimed at describing the scientific output of psychometric studies on depression instruments adapted or validated in the Peruvian context.

THE STUDY

This is a descriptive study. We searched for literature published in in PubMed, Web Of Science, Scopus and SciELO between 1993 and August 2022, either in Spanish or English. The search strategy included terms and descriptors for depression 99. Cjuno J, Figueroa-Quiñones J, Marca-Dueñas GG, Esteban RFC. Producción científica sobre depresión en poblaciones quechua hablantes: una revisión narrativa. Ter Psicológica. 2021;163-74. doi: 10.4067/s0718-48082021000200163.
https://doi.org/10.4067/s0718-4808202100...
, psychometric properties and Peruvian population; the system was validated by an expert in bibliometrics for better search precision (Supplementary Material).

The search was conducted by four independent reviewers, the results were organized in Microsoft Excel 2016. We found 200 results in Scopus, 158 in Web Of Science, 132 in PubMed and 47 in SciELO. The titles and abstracts were reviewed, seeking to include studies that aimed to validate or adapt depression assessment instruments in Peruvian populations, either as a primary or secondary objective. Original articles, brief reports, short communications, and letters to the editor were selected. Fifteen studies were eligible from Scopus, 10 from Web Of Science, 8 from SciELO (core collection) and 3 from PubMed. After eliminating duplicate items, 22 studies were selected. Works considered as gray literature (undergraduate and graduate theses and studies published in journals with indexing different from the databases mentioned) were not included (Supplementary material).

Once the list of selected articles was obtained, we carried out the analysis of the complete document and compiled the data. The variables considered were: year of publication, type of article, language, quartile of the journal according to Scimago Journal & Country Rank at the date of data collection, country of the corresponding author, affiliation of the corresponding author, city of the Peruvian corresponding author, profession of the Peruvian corresponding author at the time of data collection according to the registry of degrees and titles of the National Superintendence of University Higher Education (SUNEDU), funding of the study, scientific output for ten-year periods, population in which the instrument was evaluated, language of origin and target language in the translations of the instruments and psychometric properties evaluated.

The statistical analysis was descriptive; frequencies and percentages were estimated because the variables were categorical. We used the SPSS version 26 statistical program.

Regarding ethical aspects, the principle of scientific integrity was respected, since the study analyzed scientific articles published in peer-reviewed journals.

FINDINGS

When assessing the scientific output on validation or adaptation of instruments that assess depression in the Peruvian population, we found that 12 articles (54.6%) were published in Spanish; 20 (91.0%) were original articles; 9 (40.9%) were published in Q1 journals and 10 (45.0%) in English-speaking journals. Likewise, 15 (68.2%) studies were led by Peruvian researchers, of which 5 (22.8%) were affiliated with the Universidad Peruana Cayetano Heredia; 13 (59.1%) Peruvian correspondent researchers reside in Lima, in which physicians specializing in psychiatry (5) and psychologists 55. MacMillan HL, Patterson CJS, Wathen CN. Screening for depression in primary care: recommendation statement from the Canadian Task Force on Preventive Health Care. CMAJ. 2005;172(1):33-5. doi: 10.1503/cmaj.1030823.
https://doi.org/10.1503/cmaj.1030823...
took the lead, each accounting for 22.7%. In addition, 15 (68.2%) studies came from research projects funded by the researchers; 16 (72.7%) were published between 2013 and 2022, and 17 (77.2%) studies were published in international journals (Table 1).

Table 1
Characteristics of psychometric scientific production on depression in Peru (n=22).

Validations or adaptations were carried out on adults (4 of 22); adults with depression (3 of 22); adult women (4 of 22); pregnant women (4 of 22); health professionals (1 of 22); college students (2 of 22); high school students (1 of 22); and children (1 of 22). In addition, 17 (72.2%) of the validations or adaptations were conducted on nonclinical samples, and most instruments (13 of 22) were translated from English to Spanish (Table 2).

Table 2
Population where the adaptation was carried out and source and target language of translation.

The psychometric studies analyzed reliability (20 of 22); construct validity (20 of 22); sensitivity and specificity (15 of 22) (Table 3). On the other hand, most studies (9 out of 22) adapted the Patient Health Questionnaire (PHQ-9) in university students, health personnel, pregnant women, adults, and older adults (Table 4).

Table 3
Psychometric properties evaluated in the instruments that measure depression in Peru.

Table 4
Instruments adapted to assess depression in Peru.

DISCUSSION

In the last ten years (2013 - 2022), most studies adapting or validating screening instruments for depression were found in English-language, quartile 1 journals. The preference for international, English-language, quartile 1 journals may be due to researchers seeking the highest visibility and impact of their work in the scientific community 1010. Cjuno J, Taype-Rondan A. Latin American psychology journals in Scopus. Medwave. 2016;16(09). doi: 10.5867/medwave.2016.09.6579.
https://doi.org/10.5867/medwave.2016.09....
.

International scientific journals may be preferred by researchers because Peruvian scientific journals have not yet reached the first or second quartile 1111. Scimago Journal & Country Rank. Journal Rankings. 2022 [Citado el 24 de setiembre del 2022]. Disponible en: https://www.scimagojr.com/journalrank.php.
https://www.scimagojr.com/journalrank.ph...
. However, there has been an increased interest in the adaptation and validation of depression screening tests, possibly driven by the quality policies of Peruvian universities that started hiring researchers as part of the teaching staff 1212. Mamani O, Verastegui-Diaz A, Mejía C, Caycho-Rodríguez T. Scientific publication of psychology thesis advisors from 30 Peruvian universities. Rev Interam Psicol J Psychol. 2020;54(1):e1124. doi: 10.30849/ripijp.v54i1.1124.
https://doi.org/10.30849/ripijp.v54i1.11...
and licensing process.

Instruments have been validated in populations of older adults, adults, adults with depression, adult women, pregnant women, health professionals, university students, high school students and children, reflecting the diversity of the age groups. A pending task is to adapt or construct instruments in native languages, because our country, due to its cultural and linguistic richness, has more than 50 native languages 1313. Ministerio de Cultura del Perú. Lista de pueblos indígenas u originarios. 2021 [citado el 8 de octubre de 2021]. Disponible en: https://bdpi.cultura.gob.pe/pueblos-indigenas.
https://bdpi.cultura.gob.pe/pueblos-indi...
, a cultural and linguistic difference that starts from the same theoretical construction of how this population perceives depression; therefore, instruments adapted to this context are needed 77. Muñiz J. La medición de lo psicológico. Psicothema. 1998;10(1):1-21. Disponible en: https://reunido.uniovi.es/index.php/PST/article/view/7442.
https://reunido.uniovi.es/index.php/PST/...
. Another reason to encourage the adaptation of instruments to native people is the prevalence of depression in Quechua people, which reaches 38.9% 99. Cjuno J, Figueroa-Quiñones J, Marca-Dueñas GG, Esteban RFC. Producción científica sobre depresión en poblaciones quechua hablantes: una revisión narrativa. Ter Psicológica. 2021;163-74. doi: 10.4067/s0718-48082021000200163.
https://doi.org/10.4067/s0718-4808202100...
, and is seven times higher than the worldwide prevalence in adults 11. World Health Organization. Depression. WHO. 2021 [citado el 5 de julio de 2022]. Disponible en: https://www.who.int/health-topics/depression.
https://www.who.int/health-topics/depres...
.

Most studies showed reliability, construct validity, sensitivity/specificity, and content validity analyses. The validity and reliability of the studies show that the appropriate statistical and psychometric processes are being followed for the adaptation and construction of instruments 77. Muñiz J. La medición de lo psicológico. Psicothema. 1998;10(1):1-21. Disponible en: https://reunido.uniovi.es/index.php/PST/article/view/7442.
https://reunido.uniovi.es/index.php/PST/...
, since content validity makes it possible to adapt or correct the wording to the cultural-linguistic context and evaluates the relevance of the content related to the theoretical construct 1414. Hambleton R, Merenda M, Spielberger C. Adapting Educational and Psychological Tests for Cross-Cultural Assessment [Internet]. Vol. 1. Psychology Press; 2005 [citado el 21 de mayo de 2021]. Disponible en: https://www.routledge.com/Adapting-Educational-and-Psychological-Tests-for-Cross-Cultural-Assessment/Hambleton-Merenda-Spielberger/p/book/9780805861761.
https://www.routledge.com/Adapting-Educa...
. Construct validity analyzes the factors that explain the construct from its internal structure, reliability determines how accurate the scores of the instrument are under certain conditions, while specificity and sensitivity determine the diagnostic capacity with which an instrument will efficiently score among participants who have or do not have the problem being assessed 1414. Hambleton R, Merenda M, Spielberger C. Adapting Educational and Psychological Tests for Cross-Cultural Assessment [Internet]. Vol. 1. Psychology Press; 2005 [citado el 21 de mayo de 2021]. Disponible en: https://www.routledge.com/Adapting-Educational-and-Psychological-Tests-for-Cross-Cultural-Assessment/Hambleton-Merenda-Spielberger/p/book/9780805861761.
https://www.routledge.com/Adapting-Educa...
.

Instruments that do not imply biases are necessary due to bio-sociodemographic diversity of the Peruvian population; therefore, the analysis of invariance is important, even if only a few instruments have this characteristic. This procedure verifies whether the instrument could be transversal to the characteristics of the population under study, such as age groups, sex, place of residence, clinical/non-clinical populations, and other similar ones 77. Muñiz J. La medición de lo psicológico. Psicothema. 1998;10(1):1-21. Disponible en: https://reunido.uniovi.es/index.php/PST/article/view/7442.
https://reunido.uniovi.es/index.php/PST/...
. Therefore, not all instruments would be suitable for use in different populations or groups.

Most adaptation or validation studies analyzed the PHQ-9, which can be used in university students, health personnel, adults of both sexes, pregnant women in primary health care, and older adults. This preference may be due to its adequate psychometric properties and adaptations to more than 20 languages, being the most widely used screening instrument worldwide and chosen in an international consensus among 15 instruments evaluated for depression screening 1515. El-Den S, Chen TF, Gan YL, Wong E, O'Reilly CL. The psychometric properties of depression screening tools in primary healthcare settings: A systematic review. J Affect Disord. 2018;225(1):503-22. doi: 10.1016/j.jad.2017.08.060.
https://doi.org/10.1016/j.jad.2017.08.06...
. In Peru, the PHQ-9 has been culturally adapted by experts, and its validity, reliability and invariance have been analyzed 1616. Villarreal-Zegarra D, Copez-Lonzoy A, Bernabé-Ortiz A, Melendez-Torres GJ, Bazo-Alvarez JC. Valid group comparisons can be made with the Patient Health Questionnaire (PHQ-9): A measurement invariance study across groups by demographic characteristics. PLOS ONE. el 9 de septiembre de 2019;14(9):e0221717. doi: 10.1371/journal.pone.0221717.
https://doi.org/10.1371/journal.pone.022...
, which determines its eligibility over other instruments.

In this context, Peruvian agencies responsible for mental health care could implement the PHQ-9 in their depression care guidelines in populations where it already has solid psychometric evidence. Especially, because some official documents such as the technical guideline for mental health care of health personnel in the context of COVID-19 of the Ministry of Health, recommends the Self-Reporting Questionnaire (SRQ) 1717. Ministerio de Salud del Perú. Guía técnica para el cuidado de la salud mental del personal de la salud en el contexto del COVID-19. MINSA. 180, R.M. 180-2020-MINSA abr 6, 2020 p. 44. Disponible en: http://bvs.minsa.gob.pe/local/MINSA/5000.pdf.
http://bvs.minsa.gob.pe/local/MINSA/5000...
which, to date, has been validated only in women, while the Hamilton Depression Rating Scale (HDRS) 1818. Ministerio de Salud del Perú. Guía de práctica Clínica en depresión. 2008. Disponible en: http://bvs.minsa.gob.pe/local/MINSA/1084_DGSP261.pdf.
http://bvs.minsa.gob.pe/local/MINSA/1084...
is recommended for screening in primary health care, with no evidence of validation in Peru, and the Abbreviated Yesavage Scale 1919. Ministerio de Salud. Norma Técnica de Salud para la atención Integral de Salud de las personas adultas mayores. MINSA; 2010. Disponible en: http://bvs.minsa.gob.pe/local/MINSA/3132.pdf.
http://bvs.minsa.gob.pe/local/MINSA/3132...
is implemented in the Technical Health Standard for the Comprehensive Health Care of the Elderly 1919. Ministerio de Salud. Norma Técnica de Salud para la atención Integral de Salud de las personas adultas mayores. MINSA; 2010. Disponible en: http://bvs.minsa.gob.pe/local/MINSA/3132.pdf.
http://bvs.minsa.gob.pe/local/MINSA/3132...
. The latter is not recommended for use because even though it has initial validity of its internal structure, it lacks reliability 2020. Arias W, Muños Del Carpio A, Rivera R. Análisis psicométrico de la Escala de Depresión Geriátrica de Yesavage en adultos mayores de la Macroregión Sur del Perú. Rev Enfermeria Hered. 2019;12(2):11-9. doi: 10.20453/renh.v12i0.3960.
https://doi.org/10.20453/renh.v12i0.3960...
. This is of concern, since the selection of screening instruments should be made considering the best evidence of their psychometric properties.

A limitation of this study is that we did not include publications from journals indexed in other regional databases or from the gray literature. However, by searching Scopus, Web of Science, PubMed and SciELO, we included the largest refereed literature on the validity or construction of tests assessing depression in the Peruvian population.

In conclusion, we found 22 studies including adaptations and validations of instruments that assess depression in the Peruvian population. They have been adapted for university students, health personnel, patients with depression, pregnant women, adults of both sexes, older adults, and children. Instrumental studies in native languages and in clinical populations are still needed. Due to its characteristics, the PHQ-9 could be implemented in policies of care, evaluation, and follow-up of depression in populations where psychometric studies have been carried out.

References

  • Funding:

    self-funded by the investigators.

  • Cite as:

    Cjuno J, Moya A, Calderón-Pérez E, Quispe-Ilizarbe C, Mayon L, Livia J. Scientific output on validation and adaptation of depression screening instruments in peruvian population. Rev Peru Med Exp Salud Publica. 2022;39(3):357-61. doi: https://doi.org/10.17843/rpmesp.2022.393.11197.

Publication Dates

  • Publication in this collection
    05 Dec 2022
  • Date of issue
    Jul-Sep 2022

History

  • Received
    17 Apr 2022
  • Accepted
    02 Sept 2022
Instituto Nacional de Salud Lima - Lima - Peru
E-mail: revmedex@ins.gob.pe