Neurological and neuropsychological sequelae of Zika virus infection in children in León, Nicaragua

Secuelas neurológicas y neuropsicológicas de la infección por el virus del Zika en niños y niñas en León, Nicaragua

Sequelas neurológicas e neuropsicológicas da infecção pelo vírus zika em crianças em León, Nicarágua

Jill F. Lebov Stephen R. Hooper Norma Pugh Sylvia Becker-Dreps Natalie M. Bowman Linda M. Brown Pia D.M. MacDonald Premkumar Lakshmanane Ramesh Jadi Filemon Bucardo Tatiana Chevez Andrés Herrera Rodriguez Teresa de Jesús Aleman Rivera About the authors

ABSTRACT

Objectives.

To describe the presence and persistence of neurological and neuropsychological sequelae among children with acquired Zika virus infection and assess whether those sequelae were more common in children infected with Zika virus compared to uninfected children.

Methods.

We conducted a prospective cohort study of children with and without Zika virus infection in León, Nicaragua, using a standard clinical assessment tool and questionnaire to collect data on symptoms at three visits, about 6 months apart, and a battery of standardized instruments to evaluate neurocognitive function, behavior, depression, and anxiety at the last two visits.

Results.

Sixty-two children were enrolled, with no significant differences in demographics by infection group. Children infected with Zika virus had a range of neurological symptoms, some of which persisted for 6 to 12 months; however, no consistent pattern of symptoms was observed. At baseline a small percentage of children infected with Zika virus had an abnormal finger-to-nose test (13%), cold touch response (13%), and vibration response (15%) versus 0% in the uninfected group. Neurocognitive deficits and behavioral problems were common in both groups, with no significant differences between the groups. Children infected with Zika virus had lower cognitive efficiency scores at the 6-month visit. Anxiety and depression were infrequent in both groups.

Conclusions.

Larger studies are needed to definitively investigate the relationship between Zika virus infection and neurological symptoms and neurocognitive problems, with adjustment for factors affecting cognition and behavior, including mood and sleep disorders, home learning environment, history of neuroinvasive infections, and detailed family history of neuropsychological problems.

Keywords
Zika virus infection; child; nervous system diseases; neuropsychological tests; Nicaragua

RESUMEN

Objetivos.

Describir la presencia y persistencia de secuelas neurológicas y neuropsicológicas en pacientes pediátricos que contrajeron la infección por el virus del Zika y evaluar si dichas secuelas fueron más comunes en los infectados con el virus del Zika en comparación con los no infectados.

Métodos.

Se realizó un estudio de cohorte prospectivo en pacientes pediátricos con y sin infección por el virus del Zika en León (Nicaragua), con una herramienta de evaluación clínica estándar y un cuestionario para recopilar datos sobre los síntomas en tres visitas, con aproximadamente seis meses de diferencia, y un conjunto de instrumentos estandarizados para evaluar la función neurocognitiva, el comportamiento, la depresión y la ansiedad en las últimas dos visitas.

Resultados.

Participaron 62 niños y niñas sin diferencias significativas en la demografía por grupo de infección. Los participantes infectados con el virus del Zika mostraron una variedad de síntomas neurológicos, algunos de los cuales persistieron entre 6 y 12 meses; no obstante, no se observó un patrón sistemático en los síntomas. Al inicio del estudio, un pequeño porcentaje de participantes infectados con el virus del Zika mostró resultados anormales a las pruebas dedo-nariz (13%), respuesta al tacto (frío) (13%) y respuesta a la vibración (15%), frente a un 0% en el grupo no infectado. Los déficits neurocognitivos y los problemas de comportamiento fueron comunes en ambos grupos, sin diferencias significativas entre los grupos. Los participantes infectados con el virus del Zika mostraron puntuaciones de eficiencia cognitiva más bajas en la visita a los 6 meses. La ansiedad y la depresión fueron poco frecuentes en ambos grupos.

Conclusiones.

Son necesarios estudios más amplios para investigar definitivamente la relación entre la infección por el virus del Zika y los síntomas neurológicos y los problemas neurocognitivos, haciendo ajustes para los factores relacionados con la cognición y el comportamiento, incluidos los trastornos del estado de ánimo y el sueño, el entorno de aprendizaje en el hogar, los antecedentes de infecciones neuroinvasivas y los antecedentes familiares detallados de problemas neuropsicológicos.

Palabras clave
Infección por el virus Zika; niño; enfermedades del sistema nervioso; pruebas neuropsicológicas; Nicaragua

RESUMO

Objetivos.

Descrever a presença e a persistência de sequelas neurológicas e neuropsicológicas em crianças com infecção pelo vírus zika e avaliar se essas sequelas foram mais comuns em crianças infectadas pelo vírus zika em comparação com crianças não infectadas.

Métodos.

Realizamos um estudo de coorte prospectivo em crianças com e sem infecção pelo vírus zika em León, Nicarágua, usando uma ferramenta de avaliação clínica padrão e um questionário para coletar dados de sintomas em três consultas, com cerca de 6 meses de intervalo, além de um conjunto de ferramentas padronizadas para avaliar função neurocognitiva, comportamento, depressão e ansiedade nas duas últimas consultas.

Resultados.

Foram incluídas 62 crianças, sem diferenças significativas nas características demográficas por grupo de infecção. As crianças infectadas pelo vírus zika tinham uma gama de sintomas neurológicos, alguns dos quais persistiram por 6 a 12 meses. Entretanto, não se observou nenhum padrão consistente de sintomas. No início do estudo, uma pequena porcentagem de crianças infectadas com o vírus zika apresentou resultado anormal na prova índex-nariz (13%), resposta ao toque frio (13%) e sensibilidade vibratória (15%), em comparação a 0% no grupo não infectado. Déficits neurocognitivos e problemas comportamentais foram frequentes em ambos os grupos, mas sem diferenças significativas entre eles. As crianças infectadas com o vírus zika tiveram resultados mais baixos de eficiência cognitiva na consulta de 6 meses. Ansiedade e depressão não foram observadas com frequência em ambos os grupos.

Conclusões.

São necessários estudos mais amplos para investigar a relação exata entre a infecção pelo vírus zika e sintomas neurológicos e problemas neurocognitivos, com ajuste para fatores que afetam a cognição e o comportamento, incluindo distúrbios do humor e do sono, ambiente de aprendizagem em casa, história de infecções neuroinvasivas e história familiar detalhada de problemas neuropsicológicos.

Palavras-chave
Infecção por Zika virus; criança; doenças do sistema nervoso; testes neuropsicológicos; Nicarágua

Zika virus (ZIKV) is a mosquito-borne flavivirus that infected millions of people in the Americas and across the globe in 2015 and 2016 (11. Zika situation report. Zika and potential complications, 12 February 2016. Geneva: World Health Organization; 2016.). Although ZIKV infection typically presents with mild symptoms, the World Health Organization declared ZIKV infection a Public Health Emergency of International Concern because of its apparent association with severe central nervous system anomalies in fetuses and neonates with congenital exposure to ZIKV (22. Fifth meeting of the Emergency Committee under the International Health Regulations (2005) regarding microcephaly, other neurological disorders and Zika virus, 18 November 2016 [Internet]. Geneva: World Health Organization; 2016., 33. Brasil P, Pereira JP Jr, Moreira ME, Ribeiro Nogueira RM, Damasceno L, Wakimoto M, et al. Zika virus infection in pregnant women in Rio de Janeiro. New Engl J Med. 2016;375(24):2321–34.). Although studies have evaluated the biological pathways and outcomes of congenital ZIKV infection, research into postnatally acquired ZIKV infection in children is limited (44. Freitas DA, Souza-Santos R, Carvalho LMA, Barros WB, Neves LM, Brasil P, et al. Congenital Zika syndrome: a systematic review. PLoS One. 2020;15(12):e0242367., 55. Lebov JF, Brown LM, MacDonald PDM, Robertson K, Bowman NM, Hooper SR, et al. Review: evidence of neurological sequelae in children with acquired Zika virus infection. Pediatr Neurol. 2018;85:16–20.).

While symptomatic ZIKV infection in postnatally exposed children appears to be mild (66. Burger-Calderon R, Bustos Carrillo F, Gresh L, Ojeda S, Sanchez N, Plazaola M, et al. Age-dependent manifestations and case definitions of paediatric Zika: a prospective cohort study. Lancet Infect Dis. 2020;20(3):371–80.), severe neurological complications have been described in case reports (77. Acosta-Ampudia Y, Monsalve DM, Castillo-Medina LF, Rodríguez Y, Pacheco Y, Halstead S, et al. Autoimmune neurological conditions associated with Zika virus infection. Front Mol Neurosci. 2018;11:116.), epidemiological studies (88. Salgado DM, Vega R, Rodríguez JA, Niño Á, Rodríguez R, Ortiz Á, et al. Clinical, laboratory and immune aspects of Zika virus-associated encephalitis in children. Int J Infect Dis. 2020;90:104–10.1010. Lannuzel A, Ferge JL, Lobjois Q, Signate A, Roze B, Tressieres B, et al. Long-term outcome in neuroZika: when biological diagnosis matters. Neurology. 2019;92(21):e2406–e20.), and in postnatally exposed animals (1111. Li H, Saucedo-Cuevas L, Regla-Nava JA, Chai G, Sheets N, Tang W, et al. Zika virus infects neural progenitors in the adult mouse brain and alters proliferation. Cell Stem Cell. 2016;19(5):593–8., 1212. Wang J, Liu J, Zhou R, Ding X, Zhang Q, Zhang C, et al. Zika virus infected primary microglia impairs NPCs proliferation and differentiation. Biochem Biophys Res Commun. 2018;497(2):619–25.). However, information about neurological complications is limited. The only study to date to evaluate neurocognitive functioning among children with acquired ZIKV infection assessed 37 people infected with ZIKV, aged 12 years and older, and found that they had lower memory scores compared to a dengue-infected group (1313. Belaunzarán-Zamudio PF, Ortega-Villa AM, Mimenza-Alvarado AJ, Guerra-De-Blas PDC, Aguilar-Navarro SG, Sepúlveda-Delgado J, et al. Comparison of the impact of Zika and dengue virus infection, and other acute illnesses of unidentified origin on cognitive functions in a prospective cohort in Chiapas Mexico. Front Neurol. 2021;12(347):631801.).

Like many Latin American countries, Nicaragua experienced epidemic spread of ZIKV throughout the country during 2016 (1313. Belaunzarán-Zamudio PF, Ortega-Villa AM, Mimenza-Alvarado AJ, Guerra-De-Blas PDC, Aguilar-Navarro SG, Sepúlveda-Delgado J, et al. Comparison of the impact of Zika and dengue virus infection, and other acute illnesses of unidentified origin on cognitive functions in a prospective cohort in Chiapas Mexico. Front Neurol. 2021;12(347):631801., 1414. Nicaragua. In: The World Factbook. Washington, DC: United States Central Intelligence Agency; 2021.). To better understand the potential impacts of ZIKV infection, we conducted a prospective cohort study of neurological symptoms and neuropsychological functioning in ZIKV-infected children and uninfected children in León, Nicaragua.

METHODS

Study population

Nicaragua, a Central American nation with a population of 6.1 million in 2016, is among the lowest-income countries in Latin America (1414. Nicaragua. In: The World Factbook. Washington, DC: United States Central Intelligence Agency; 2021.). The department of León is an economically and geographically diverse region with a high intensity of Aedes aegypti mosquito-transmitted arboviruses. Between January 2016 and August 2017, researchers at the University of North Carolina, Chapel Hill and the Universidad Nacional Autónoma de Nicaragua, León conducted a ZIKV transmission study that included patients aged 2 years and older seeking care at the Perla Maria de Nori Health Center for fever, maculopapular rash, or non-suppurative conjunctivitis of less than 1 week’s duration and asymptomatic household members (1515. Bowman NM, Bucardo F, Collins MH, Reyes Y, Centeno Cuadra E, Blette B, et al. Clinical and epidemiological features of acute Zika virus infections in León, Nicaragua. Am J Trop Med Hyg. 2021;105(4):924–30.). Thirty-five per cent of those enrolled in the study were children.

Between November 2016 and March 2018, children aged 2–17 years from the transmission study were recruited to participate in a study of neurological symptoms and neuropsychological functioning. Eligibility criteria included: complete data on age, sex, and ZIKV status; and parental permission/assent to participate in three study visits, conducted about 6 months apart.

Definition of Zika-infected and uninfected children

Convalescent serum specimens collected from participants at the second and third visits were stored temporarily in the laboratory of the Universidad Nacional Autónoma de Nicaragua, León before shipment to the University of North Carolina for testing. ZIKV infection was defined as a positive result in one or both specimens using a modified version of a validated serological assay based on Z-EDIII antigen (1616. Premkumar L, Collins M, Graham S, Liou G-JA, Lopez CA, Jadi R, et al. Development of envelope protein antigens to serologically differentiate Zika virus infection from Dengue virus infection. J Clin Microbiol. 2018;56(3):e01504–17.). The assay has been validated with a larger panel of samples shown to be highly specific for ZIKV infection in convalescent samples collected after 2 months. Based on well characterized samples, an optical density cut-off of 0.34 was used to indicate prior ZIKV infection. Participants without convalescent specimens were tested in the transmission study by a reverse transcriptase quantitative polymerase chain reaction (RT-qPCR) test using a Roche LightCycler 96 at the Universidad Nacional Autónoma de Nicaragua, León laboratory, using previously described methods (1515. Bowman NM, Bucardo F, Collins MH, Reyes Y, Centeno Cuadra E, Blette B, et al. Clinical and epidemiological features of acute Zika virus infections in León, Nicaragua. Am J Trop Med Hyg. 2021;105(4):924–30., 1717. Lanciotti RS Kosoy OL, Laven JJ, Velez JO, Lambert AJ, Johnson AJ, et al. Genetic and serologic properties of Zika virus associated with an epidemic, Yap State, Micronesia, 2007. Emerg Infect Dis. 2008;14(8):1232–9.). Participants with positive PCR results were also included in the ZIKV-infected group. Participants with a negative RT-qPCR but no serology were excluded due to uncertainty about their ZIKV status; all other participants were characterized as Zika-uninfected.

Study assessments

A study physician was trained by a neurology professor from University of North Carolina-Chapel Hill to conduct the neurological examination. At each visit, the physician conducted a clinical assessment of a standard set of neurological signs and symptoms and administered a questionnaire to the participant or the participant’s parent/guardian about recent changes in function that could be associated with neurological deficits. The clinical assessment included evaluation of: awareness level; general speech/language; visual acuity; ocular movement; facial and upper and lower extremity strength; bicep, knee, and ankle reflexes; a finger-to-nose test; cold and vibration touch response; and gait. The questionnaire assessed: current energy level (fatigue); interest in social activities; experience of memory loss or confusion; problems with speed of thought or concentration; headache or seizure in the previous 4 weeks; recent problems with hearing, vision, walking, use of hands and arms, bladder control, or numbness, tingling, or loss of feeling in any part of the body. For any indicated abnormality, additional questions sought information about the severity of the problem and timing (i.e., started 1 week, 2 weeks, 1 month, 1–6 months, or more than 6 months before).

At the second and third visits, about 6 and 12 months, respectively, after the baseline visit, a trained psychologist or physician conducted a battery of age-appropriate neuropsychological assessments – Woodcock Muñoz III Cognitive Battery (1818. Wendling BJ, Mather N, Schrank FA. Woodcock-Johnson III tests of cognitive abilities. In: Naglieri JA, Goldstein S, editors. Practitioner's guide to assessing intelligence and achievement. Hoboken, NJ: John Wiley & Sons Inc; 2009:191–229., 1919. Schrank FA, McGrew KS., Ruef ML, Alvarado CG, Muñoz-Sandoval AF, Woodcock RW. Overview and technical supplement (Batería III Woodcock-Muñoz Assessment Service Bulletin No. 1). Rolling Meadows, IL: Riverside Publishing; 2005.), Test of Nonverbal Intelligence 4 (2020. Brown L, Sherbenou RJ, Johnsen SK. Test of nonverbal intelligence-4 (TONI-4). Austin, TX: PRO-ED; 2010.), the Child Behavior Checklist (2121. Achenbach TM, Ruffle TM. The Child Behavior Checklist and related forms for assessing behavioral/emotional problems and competencies. Pediatr Rev. 2000;21(8):265–71.), and depression and anxiety questionnaires as appropriate for age group, i.e., Children’s Depression Inventory (2222. Davanzo P, Kerwin L, Nikore V, Esparza C, Forness S, Murrelle L. Spanish translation and reliability testing of the Child Depression Inventory. Child Psychiatry Hum Dev. 2004;35(1):75–92.), Beck Depression Inventory (2323. Beck AT, Steer RA, Carbin MG. Psychometric properties of the Beck Depression Inventory: twenty-five years of evaluation. Clin Psychol Rev. 1988;8(1):77–100.), Spence Child Anxiety Scale (2424. Orgilés M, Méndez X, Spence SH, Huedo-Medina TB, Espada JP. Spanish validation of the Spence Children's Anxiety Scale. Child Psychiatry Hum Dev. 2012;43(2):271–81.), and Beck Anxiety Scale (2525. Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol. 1988;56(6):893–7.). For the Woodcock Muñoz III Cognitive Battery, raw scores from all reported subtests and composite variables were converted to age-based standard scores. Two composite scores are reported: cognitive efficiency (visual matching and numbers reversed) and working memory (numbers reversed and auditory working memory). Overall raw scores of the Test of Nonverbal Intelligence 4 were converted to age-based standard scores. The standard score scale for the Woodcock Muñoz III Cognitive Battery and Test of Nonverbal Intelligence 4 is based on a mean of 100 and standard deviation (SD) of 15. For the Child Behavior Checklist, raw scores for all reported items and composite domains were converted to age-based t-scores. The standard score scale is based on a mean of 50 and SD of 10. The t-tests of parent response score distributions across age group (2–5 years and 6–18 years) indicated that compilation of form data into a single dataset was appropriate. For all other instruments, we examined the total summed score.

Children are considered at risk for diagnosable cognitive, behavioral, and/or mood disorders if their score falls above or below a certain threshold. Additional details about these instruments, including the definition of at-risk scores, are outlined in Table 1. To ensure that terminology was locally appropriate to the Nicaraguan context, we pilot tested all instruments among a small number of children and their parents.

TABLE 1.
Description of assessments included in the neuropsychological assessment battery

Statistical analyses

We calculated descriptive summary statistics overall and by ZIKV infection for baseline characteristics of interest and performed chi-squared tests to determine if there were any differences between groups.

To investigate the long-term sequelae in children with ZIKV infection, we describe self-reported and physician-observed neurological symptoms and neuropsychiatric deficits in children who had their baseline visit within 60 days of enrollment into the transmission study.

Because all participants were asked to provide information about the estimated timing of the start of neurological symptoms, we compared that to the timing of infection to determine whether the reported problem began after or before ZIKV infection, or whether the timing was unknown. Only post-infection symptoms are reported for the baseline, 6-month, and 12-month visits in this descriptive analysis.

Finally, we examined neuropsychological functioning at the 6- and 12-month visits by ZIKV infection. For each test and select subtests, we generated descriptive summary statistics and the prevalence of children at risk. We calculated difference in prevalence at risk between the infected and uninfected groups, including 95% confidence intervals (CIs), using SAS version 9.4 (SAS Institute Inc., Cary, NC, USA).

Ethics statement

The Institutional Review Board of RTI International reviewed and approved this study. Study staff read consent forms to parents or guardians accompanying minors who participated in this study, and read assent forms to minors aged 7–17 years. Parents/guardians and minors aged 7–17 years had the opportunity to ask questions about the study before signing the consent and assent forms or declining to participate. Copies of the consent and assent forms were provided to participants. Parents or guardians of participating minors were provided with a monetary reimbursement to cover their time and transportation. All participant information was kept confidential by securing paper records locked in the study coordinator’s office and entering data into a password-protected web-based REDCap electronic database hosted by RTI International (2626. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208.).

RESULTS

Sample characteristics

Of 77 children enrolled in the transmission study at the time of suspected ZIKV infection, 71 consented to enroll in our study. Nine participants were excluded from the analysis because of unconfirmed age (one child) or ZIKV testing results (seven children), and a preexisting neurological condition, focal seizures (one child). There was a delay between enrollment into the transmission study and subsequent enrollment in our follow-up study: the first assessment (baseline visit) occurred 2–217 days (median 32; interquartile range (IQR) 16–146 days) after enrollment in the transmission study; the last assessment occurred 220–761 days (median 408; IQR 378–561 days) after enrollment in the follow-up study. All 62 children for whom baseline visit data were collected participated in a follow-up visit about 6 months later (6-month visit) and 60 participated in a second follow-up visit (12-month visit). Laboratory results confirmed that 40 children had ZIKV infection and 22 had not.

No significant demographic differences were seen between the ZIKV-infected and -uninfected groups (Table 2). In children aged 13 years and older, no drug use was reported and no children were at risk of alcohol abuse (data not shown).

TABLE 2.
Baseline characteristics of the participants, by Zika virus infection, León, Nicaragua

Neurological observations

Twenty ZIKV-infected children had their baseline visit within 60 days of enrollment in the transmission study. These children displayed a range of neurological symptoms, some persisting for 6 to 12 months after infection, although no consistent pattern of symptoms was observed. Some of the more severe or persistent problems experienced included: a 13-year-old male with persistent memory difficulty and cognitive slowness accompanied by sensory loss; a 7-year-old female exhibiting abnormal awareness at all three visits; a 13-year-old female with severe headache and memory difficulty at two consecutive visits; a 16-year-old male with persistent headache and sensory loss; and a 13-year-old male with moderate sensory loss at baseline and persistent self-reported forgetfulness and cognitive slowness. Full descriptive information about the neurological outcomes of these children is available upon request to the authors.

When comparing the ZIKV-infected and -uninfected cohort, hallmark signs of neurological problems (e.g., fatigue, memory loss/confusion, difficulty concentrating/reduced speed of thought, and sensory problems) were self-reported by children or their parents in both groups (Table 3). At baseline, the most commonly reported symptoms were headache, lethargy, myalgia, and arthralgia; these symptoms were more frequently reported in ZIKV-infected children at the baseline and 6-month visits.

Clinically observed abnormal awareness and speech/language abnormalities were observed in both groups and varied over time (data not shown). At baseline, a small percentage of children with ZIKV infection had an abnormal finger-to-nose test (13%), cold touch response (13%), and vibration response (15%) versus 0% in the uninfected group (data not shown). No seizures, paralysis, or walking problems were reported (data not shown). At all time points, ZIKV-infected children were more likely to experience more than two strength or reflex problems compared to children who were not exposed – baseline: 15% versus 0%; 6-month: 7.5% versus 0%; 12-month: 10% versus 4.5%. Detailed data are available upon request.

Neuropsychological and behavioral findings

Descriptive statistics for the cognitive, behavior, anxiety, and depression assessments are shown in Table 4. Low scores on the neurocognitive tests were common in both groups. The 95% CIs of the difference in the at-risk prevalence were wide, with the CIs crossing zero for most domains (Figure 1). The proportion of children with an at-risk cognitive efficiency composite score was significantly greater in the infected group than the uninfected group at 6 months, but this difference was smaller at the 12-month visit. This observed difference in the cognitive efficiency composite score is driven mainly by the fact that 100% of infected children at 6 months had an at-risk score for the visual matching subtest (data not shown). At the 6-month visit, a larger proportion of children in the uninfected group had caregiver-reported behavior problems as assessed by the Child Behavior Checklist, compared to the infected group. This pattern was also seen at the 12-month visit, although CIs were wide due to fewer participant responses. We did not see any difference in depression or anxiety by infection. In general, the small sample sizes precluded drawing any solid conclusions about differences in neuropsychological deficits and behavioral problems between ZIKV-infected and -uninfected children.

DISCUSSION

We conducted an evaluation of neurological, neurocognitive, and neuropsychiatric outcomes following ZIKV infection in children and included children without ZIKV infection for comparison. Although our study is small, it builds on emergent findings suggesting possible neurological involvement of ZIKV in children postnatally exposed to the virus, with long-term impacts in some cases. Neurocognitive and behavioral problems, some reflecting clear deficits, were common in both groups, while anxiety and depression were observed infrequently in both groups.

Although case reports have described central nervous system and peripheral nervous system sequelae following ZIKV infection, characterization of neurological symptoms of acquired ZIKV infection among children is limited (77. Acosta-Ampudia Y, Monsalve DM, Castillo-Medina LF, Rodríguez Y, Pacheco Y, Halstead S, et al. Autoimmune neurological conditions associated with Zika virus infection. Front Mol Neurosci. 2018;11:116., 2727. Ramond A, Lobkowicz L, Clemente NS, Vaughan A, Turchi MD, Wilder-Smith A, et al. Postnatal symptomatic Zika virus infections in children and adolescents: a systematic review. PLoS Negl Trop Dis. 2020;14(10):e0008612.). The largest pediatric case series to date included 18 756 suspected pediatric cases of ZIKV infection reported to Colombia’s national surveillance system. Ninety-six instances of neurological manifestations secondary to ZIKV were reported, including peripheral nervous system disorders and degenerative and inflammatory diseases of the central nervous system (99. Tolosa N, Tinker SC, Pacheco O, Valencia D, Botero DS, Tong VT, et al. Zika virus disease in children in Colombia, August 2015 to May 2016. Paediatr Perinat Epidemiol. 2017;31(6):537–45.). However, only 25 of the 96 suspected cases were tested for ZIKV, and only 12 of those had laboratory evidence of ZIKV. In a recent systematic review, six of 34 pediatric ZIKV case reports included descriptions of neurological complications, including acute myelitis, encephalitis, peripheral neuropathy, left middle cerebral artery infarct with right hemiparesis, seizures and diffuse neurological manifestations, and Alice in Wonderland syndrome (2727. Ramond A, Lobkowicz L, Clemente NS, Vaughan A, Turchi MD, Wilder-Smith A, et al. Postnatal symptomatic Zika virus infections in children and adolescents: a systematic review. PLoS Negl Trop Dis. 2020;14(10):e0008612.).

TABLE 3.
Self-reported symptoms (by the children or their parents) experienced by Zika virus infection at baseline, 6-month, and 12-month visits, León, Nicaragua

The most comprehensive study of neurological manifestations associated with ZIKV infection to date identified 87 laboratory-confirmed ZIKV virus patients during the 2016 outbreak in the French West Indies with diverse clinical manifestations in the central nervous system and peripheral nervous system, and associated findings in magnetic resonance imaging (1010. Lannuzel A, Ferge JL, Lobjois Q, Signate A, Roze B, Tressieres B, et al. Long-term outcome in neuroZika: when biological diagnosis matters. Neurology. 2019;92(21):e2406–e20.). This study only included six children, with diagnoses of Guillain–Barré syndrome, meningoencephalitis, stroke, and myeloradiculitis and neurological symptoms including headaches, myalgia, ataxia, bilateral motor weakness, areflexia, sensory problems, and seizures. Although our study physicians conducted a detailed assessment of neurological signs and symptoms, diagnosis of neurological conditions (e.g., myelitis and encephalitis) was beyond the scope of our study. Similar to Lannuzel et al. (1010. Lannuzel A, Ferge JL, Lobjois Q, Signate A, Roze B, Tressieres B, et al. Long-term outcome in neuroZika: when biological diagnosis matters. Neurology. 2019;92(21):e2406–e20.), our study observed headache, myalgia, ataxia, strength and reflex abnormalities, and sensory problems, but most of these symptoms were reported by both infected and uninfected children.

TABLE 4.
Neuropsychological and behavioral functioning at 6-month and 12-month visits by Zika virus infection, León, Nicaragua

It is also important to understand the longer-term consequences of acquired ZIKV infection. A study by Salgado et al. (88. Salgado DM, Vega R, Rodríguez JA, Niño Á, Rodríguez R, Ortiz Á, et al. Clinical, laboratory and immune aspects of Zika virus-associated encephalitis in children. Int J Infect Dis. 2020;90:104–10.) included 20 pediatric patients with suspected encephalitis, six of whom were confirmed to have ZIKV infection. Compared to children with other causes of encephalitis, children with ZIKV-associated encephalitis experienced shorter duration of hospitalization, with a maximum recovery time of 10 days. No sequelae were found during clinical follow-up of unknown duration (88. Salgado DM, Vega R, Rodríguez JA, Niño Á, Rodríguez R, Ortiz Á, et al. Clinical, laboratory and immune aspects of Zika virus-associated encephalitis in children. Int J Infect Dis. 2020;90:104–10.). Of the six children followed for over a year in the French West Indies study, only the one child with myeloradiculitis had persistent neurological problems (1010. Lannuzel A, Ferge JL, Lobjois Q, Signate A, Roze B, Tressieres B, et al. Long-term outcome in neuroZika: when biological diagnosis matters. Neurology. 2019;92(21):e2406–e20.). In our study, the reflex problems and limb weakness observed at baseline mostly resolved over time, although for several children reflex issues were reported at all visits. Other symptoms reported at multiple visits were headache and fatigue.

FIGURE 1.
Difference in at-risk prevalence and 95% confidence interval of neuropsychological problems at 6-month and 12-month visits between children with Zika virus infection and uninfected children, León, Nicaragua

Our study found an array of neurocognitive concerns. To our knowledge, the only other study to include any measure of neurocognition among children infected with ZIKV postnatally was conducted in Chiapas, Mexico using the Montreal Cognitive Assessment (1313. Belaunzarán-Zamudio PF, Ortega-Villa AM, Mimenza-Alvarado AJ, Guerra-De-Blas PDC, Aguilar-Navarro SG, Sepúlveda-Delgado J, et al. Comparison of the impact of Zika and dengue virus infection, and other acute illnesses of unidentified origin on cognitive functions in a prospective cohort in Chiapas Mexico. Front Neurol. 2021;12(347):631801.). Investigators saw no improvement in cognitive scores between 0 to 7 days but did see improved cognitive scores from 7 to 28 days, likely related to better overall health and ability to function. No significant changes in function overall or in any cognitive subdomains were observed long term, between 28 and 108 days postinfection (1313. Belaunzarán-Zamudio PF, Ortega-Villa AM, Mimenza-Alvarado AJ, Guerra-De-Blas PDC, Aguilar-Navarro SG, Sepúlveda-Delgado J, et al. Comparison of the impact of Zika and dengue virus infection, and other acute illnesses of unidentified origin on cognitive functions in a prospective cohort in Chiapas Mexico. Front Neurol. 2021;12(347):631801.). In cognitive functioning assessments, we observed a higher prevalence of scores in the at-risk range among children infected with ZIKV compared to uninfected children on the visual matching subtest, which is a measure of processing speed. This finding may be explained by the damaging effects of ZIKV on myelination processes and axonal functioning in the white matter structures of humans, areas of the brain thought to be foundational to processing speed across the lifespan (2828. Schultz V, Cumberworth SL, Gu Q, Johnson N, Donald CL, McCanney GA, et al. Zika virus infection leads to demyelination and axonal injury in mature CNS cultures. Viruses. 2021;13(1):91.3030. Madden DJ, Bennett IJ, Song AW. Cerebral white matter integrity and cognitive aging: contributions from diffusion tensor imaging. Neuropsychol Rev. 2009;19(4):415–35.).

Although behavioral problems have been reported in infants and toddlers exposed to ZIKV in utero, to our knowledge, no behavioral assessments of children with postnatal ZIKV infection have been conducted. The only study contributing evidence to the hypothesized link between postnatal ZIKV infection and behavioral outcomes was conducted among six rhesus macaques infected with ZIKV postnatally (3131. Mavigner M, Raper J, Kovacs-Balint Z, Gumber S, O'Neal JT, Bhaumik SK, et al. Postnatal Zika virus infection is associated with persistent abnormalities in brain structure, function, and behavior in infant macaques. Sci Transl Med. 2018;10(435):eaao6975.). Neuroimaging revealed virus neuroinvasion, with a pattern of astrogliosis also seen in in utero ZIKV infection in humans and mice (3232. Chimelli L, Moura Pone S, Avvad-Portari E, Farias Meira Vasconcelos Z, Araújo Zin A, Prado Cunha D, et al. Persistence of Zika virus after birth: clinical, virological, neuroimaging, and neuropathological documentation in a 5-month infant with congenital Zika syndrome. J Neuropathol Exp Neurol. 2018;77(3):193–8., 3333. Tang H, Hammack C, Ogden SC, Wen Z, Qian X, Li Y, et al. Zika virus infects human cortical neural progenitors and attenuates their growth. Cell Stem Cell. 2016;18(5):587–90.). Magnetic resonance imaging conducted at 3 and 6 months of age revealed enlargement of lateral ventricles and blunted increases in hippocampal volume. Altered functional connectivity between brain regions that regulate emotional behavior and arousal functions was also seen (e.g., between amygdala and hippocampus) and corresponded with observed abnormal emotional behavior during intruder threat testing. In our study, the prevalence of behavioral issues measured by the Child Behavior Checklist was not significantly greater in the ZIKV-infected group. Longitudinal follow-up of the aforementioned rhesus macaques observed persistent structural and functional changes of the hippocampus at 12 months of age associated with memory deficits in ZIKV-infected macaques compared to controls (3434. Raper J, Kovacs-Balint Z, Mavigner M, Gumber S, Burke MW, Habib J, et al. Long-term alterations in brain and behavior after postnatal Zika virus infection in infant macaques. Nat Commun. 2020;11(1):2534.). We did not see significant differences in memory between infection groups in our small study.

The high prevalence of at-risk scores for cognitive and behavioral issues may be the result of high rates of poverty in León, a general lack of access to remedial resources for learning deficits or disabilities, and the environment of violent civil and social unrest occurring during the course of study follow-up (3535. Stephens H. Fears of a civil war have faded, but Nicaragua's crisis is far from over. World Politics Review. 1 February 2019., 3636. Peña R, Pérez W, Meléndez M, Källestål C, Persson LÅ. The Nicaraguan health and demographic surveillance site, HDSS-Leon: a platform for public health research. Scand J Public Health. 2008;36(3):318–25.). About 15–20% of children aged 7–12 years had elevated anxiety levels, a finding that deserves further attention, particularly with respect to studying the impact of anxiety on cognition and behavior.

Our study had some limitations. Although our goal was to include a group of children unaffected by ZIKV against which to compare outcomes in the ZIKV-infected group, the small number of children recruited precluded statistical comparisons and stratification by age. Furthermore, because children in the study only had mild ZIKV infections, our study was underpowered to detect significant differences in neurological and neuropsychological sequelae between groups. We also lacked neurocognitive and neuropsychiatric data on the children before infection to help determine whether observed deficits existed before the Zika epidemic. Some neurological symptoms are difficult to assess in small children; we may therefore have missed important neurological sequelae, but the inclusion of both parent-reported observations and a clinician evaluation attempted to reduce the effect of this potential limitation.

The strength of this study is that we were able to implement for research purposes a standardized clinical neurological evaluation and a standardized neurocognitive and neuropsychiatric assessment battery in this resource-constrained Spanish-speaking population. We selected measures that minimized the potential influence of cultural and language factors on the standardized scores. For example, we used the Woodcock Muñoz III Cognitive Battery, a Spanish version of the Woodcock Johnson III. Norms were calibrated based on validation testing among Spanish-speaking children within and outside of the United States, including from Central America (1919. Schrank FA, McGrew KS., Ruef ML, Alvarado CG, Muñoz-Sandoval AF, Woodcock RW. Overview and technical supplement (Batería III Woodcock-Muñoz Assessment Service Bulletin No. 1). Rolling Meadows, IL: Riverside Publishing; 2005.). The Test of Nonverbal Intelligence 4 uses shapes that are not culturally specific and avoids any need for verbal communication. The Child Behavior Checklist has been used in previous behavior studies in Nicaragua, and we selected the Children’s Depression Inventory, Beck Depression Inventory, and Spence Child Anxiety Scale depression and anxiety instruments for this study because they were already in use in the family clinic at the study site (3737. Isaksson J, Hogberg U, Valladares E, Lindblad F. Associations between psychiatric symptoms and cortisol levels in Nicaraguan young school-age children. Psychiatry Res. 2016;240:376–80., 3838. Isaksson J, Lindblad F, Valladares E, Hogberg U. High maternal cortisol levels during pregnancy are associated with more psychiatric symptoms in offspring at age of nine – a prospective study from Nicaragua. J Psychiatr Res. 2015;71:97–102.). The feasibility of implementing such a comprehensive testing battery is particularly important in the context of Nicaragua, where a shortage of medical specialists including neurologists has been further worsened by the recent political crisis (3939. Agren D. Criminalisation of health care in Nicaragua's political crisis. Lancet. 2018;392(10150):807–8., 4040. Vargas-Palacios E, Pineda R, Galán-Rodas E. The politicised and crumbling Nicaraguan health system. Lancet. 2018;392(10165):2694–5.). The fact that general physicians and psychologists can be successfully trained to implement pediatric neurological, neurocognitive, and neuropsychiatric assessments is encouraging for supporting research in underserved populations in Nicaragua.

Conclusion

Although we observed neurological symptoms and neurocognitive problems among children exposed to ZIKV, these outcomes were not significantly more common in these children compared to uninfected individuals. While we developed a successful protocol for evaluating neurocognitive and neurobehavioral sequelae of ZIKV, larger studies are needed to definitively investigate this relationship to allow for stratification by age and adjustment for factors affecting neurocognition, e.g., mood and sleep disorders, child’s home learning environment, history of other neuroinvasive infections such as dengue and severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), and a detailed family history of neurological and neurocognitive problems. Nevertheless, our study protocol can inform larger studies of neurological complications of ZIKV in the still-developing brains of children, particularly in resource-constrained settings where sequelae may be obscured by the effects of other sociopolitical and health-system challenges.

Disclaimer.

Authors hold sole responsibility for the views expressed in the manuscript, which may not necessarily reflect the opinion or policy of the Revista Panamericana de Salud Pública / Pan American Journal of Public Health and/or those of the Pan American Health Organization.

Acknowledgements.

We thank: the participants and their families for contributing to this important research; Dr Aravinda da Silva and the Microbiology and Immunology Laboratory at the University of North Carolina at Chapel Hill for conducting the serological testing and the Microbiology Laboratory at Universidad Nacional Autónoma de Nicaragua, León for the molecular testing for this study; Ryan Max (Department of Epidemiology, University of North Carolina at Chapel Hill) for assisting with the review of samples at Dr da Silva’s laboratory; Jamie Allison (Triangle Learning and Development Resources) for conducting training on the neuropsychological assessment battery; and Dr Kevin R. Robertson (Department of Neurology, University of North Carolina at Chapel Hill, died June 2019) for his contributions to the selection of and training on the neurological assessment instruments. We are also grateful to the Center for Demographic and Health Research at Universidad Nacional Autónoma de Nicaragua, León for providing space and other resources to conduct this study.

  • Author contributions.
    All authors conceived the original idea and designed the research project. JFL, SRH, AHR, and TJAR selected the study assessments. TC, AHR, and TJAR collected the data. RJ and NP analyzed the data. JFL, SRH, NMB, SBD, and PL interpreted results and drafted the paper. LB, SRH, and PDMM edited and commented on drafts. All authors reviewed and approved the final version.
  • Conflicts of interest.
    None declared.
  • Funding.
    RTI International provided funding to support the development and implementation of the study protocol and the data analysis. The transmission study from which participants were recruited was supported by R21AI129532 from the National Institutes of Allergy and Infectious Diseases, United States. Collaborator Sylvia Becker-Dreps is supported by K24AI141744 from the National Institutes of Allergy and Infectious Diseases. The laboratory work at the University of North Carolina was supported by grants from the US Centers for Disease Control and Prevention (BAA 2017-N-18041). The sponsors did not influence in any way the design, data collection, analysis, writing, and decision to publish these results.

REFERENCES

  • 1.
    Zika situation report. Zika and potential complications, 12 February 2016. Geneva: World Health Organization; 2016.
  • 2.
    Fifth meeting of the Emergency Committee under the International Health Regulations (2005) regarding microcephaly, other neurological disorders and Zika virus, 18 November 2016 [Internet]. Geneva: World Health Organization; 2016.
  • 3.
    Brasil P, Pereira JP Jr, Moreira ME, Ribeiro Nogueira RM, Damasceno L, Wakimoto M, et al. Zika virus infection in pregnant women in Rio de Janeiro. New Engl J Med. 2016;375(24):2321–34.
  • 4.
    Freitas DA, Souza-Santos R, Carvalho LMA, Barros WB, Neves LM, Brasil P, et al. Congenital Zika syndrome: a systematic review. PLoS One. 2020;15(12):e0242367.
  • 5.
    Lebov JF, Brown LM, MacDonald PDM, Robertson K, Bowman NM, Hooper SR, et al. Review: evidence of neurological sequelae in children with acquired Zika virus infection. Pediatr Neurol. 2018;85:16–20.
  • 6.
    Burger-Calderon R, Bustos Carrillo F, Gresh L, Ojeda S, Sanchez N, Plazaola M, et al. Age-dependent manifestations and case definitions of paediatric Zika: a prospective cohort study. Lancet Infect Dis. 2020;20(3):371–80.
  • 7.
    Acosta-Ampudia Y, Monsalve DM, Castillo-Medina LF, Rodríguez Y, Pacheco Y, Halstead S, et al. Autoimmune neurological conditions associated with Zika virus infection. Front Mol Neurosci. 2018;11:116.
  • 8.
    Salgado DM, Vega R, Rodríguez JA, Niño Á, Rodríguez R, Ortiz Á, et al. Clinical, laboratory and immune aspects of Zika virus-associated encephalitis in children. Int J Infect Dis. 2020;90:104–10.
  • 9.
    Tolosa N, Tinker SC, Pacheco O, Valencia D, Botero DS, Tong VT, et al. Zika virus disease in children in Colombia, August 2015 to May 2016. Paediatr Perinat Epidemiol. 2017;31(6):537–45.
  • 10.
    Lannuzel A, Ferge JL, Lobjois Q, Signate A, Roze B, Tressieres B, et al. Long-term outcome in neuroZika: when biological diagnosis matters. Neurology. 2019;92(21):e2406–e20.
  • 11.
    Li H, Saucedo-Cuevas L, Regla-Nava JA, Chai G, Sheets N, Tang W, et al. Zika virus infects neural progenitors in the adult mouse brain and alters proliferation. Cell Stem Cell. 2016;19(5):593–8.
  • 12.
    Wang J, Liu J, Zhou R, Ding X, Zhang Q, Zhang C, et al. Zika virus infected primary microglia impairs NPCs proliferation and differentiation. Biochem Biophys Res Commun. 2018;497(2):619–25.
  • 13.
    Belaunzarán-Zamudio PF, Ortega-Villa AM, Mimenza-Alvarado AJ, Guerra-De-Blas PDC, Aguilar-Navarro SG, Sepúlveda-Delgado J, et al. Comparison of the impact of Zika and dengue virus infection, and other acute illnesses of unidentified origin on cognitive functions in a prospective cohort in Chiapas Mexico. Front Neurol. 2021;12(347):631801.
  • 14.
    Nicaragua. In: The World Factbook. Washington, DC: United States Central Intelligence Agency; 2021.
  • 15.
    Bowman NM, Bucardo F, Collins MH, Reyes Y, Centeno Cuadra E, Blette B, et al. Clinical and epidemiological features of acute Zika virus infections in León, Nicaragua. Am J Trop Med Hyg. 2021;105(4):924–30.
  • 16.
    Premkumar L, Collins M, Graham S, Liou G-JA, Lopez CA, Jadi R, et al. Development of envelope protein antigens to serologically differentiate Zika virus infection from Dengue virus infection. J Clin Microbiol. 2018;56(3):e01504–17.
  • 17.
    Lanciotti RS Kosoy OL, Laven JJ, Velez JO, Lambert AJ, Johnson AJ, et al. Genetic and serologic properties of Zika virus associated with an epidemic, Yap State, Micronesia, 2007. Emerg Infect Dis. 2008;14(8):1232–9.
  • 18.
    Wendling BJ, Mather N, Schrank FA. Woodcock-Johnson III tests of cognitive abilities. In: Naglieri JA, Goldstein S, editors. Practitioner's guide to assessing intelligence and achievement. Hoboken, NJ: John Wiley & Sons Inc; 2009:191–229.
  • 19.
    Schrank FA, McGrew KS., Ruef ML, Alvarado CG, Muñoz-Sandoval AF, Woodcock RW. Overview and technical supplement (Batería III Woodcock-Muñoz Assessment Service Bulletin No. 1). Rolling Meadows, IL: Riverside Publishing; 2005.
  • 20.
    Brown L, Sherbenou RJ, Johnsen SK. Test of nonverbal intelligence-4 (TONI-4). Austin, TX: PRO-ED; 2010.
  • 21.
    Achenbach TM, Ruffle TM. The Child Behavior Checklist and related forms for assessing behavioral/emotional problems and competencies. Pediatr Rev. 2000;21(8):265–71.
  • 22.
    Davanzo P, Kerwin L, Nikore V, Esparza C, Forness S, Murrelle L. Spanish translation and reliability testing of the Child Depression Inventory. Child Psychiatry Hum Dev. 2004;35(1):75–92.
  • 23.
    Beck AT, Steer RA, Carbin MG. Psychometric properties of the Beck Depression Inventory: twenty-five years of evaluation. Clin Psychol Rev. 1988;8(1):77–100.
  • 24.
    Orgilés M, Méndez X, Spence SH, Huedo-Medina TB, Espada JP. Spanish validation of the Spence Children's Anxiety Scale. Child Psychiatry Hum Dev. 2012;43(2):271–81.
  • 25.
    Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol. 1988;56(6):893–7.
  • 26.
    Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208.
  • 27.
    Ramond A, Lobkowicz L, Clemente NS, Vaughan A, Turchi MD, Wilder-Smith A, et al. Postnatal symptomatic Zika virus infections in children and adolescents: a systematic review. PLoS Negl Trop Dis. 2020;14(10):e0008612.
  • 28.
    Schultz V, Cumberworth SL, Gu Q, Johnson N, Donald CL, McCanney GA, et al. Zika virus infection leads to demyelination and axonal injury in mature CNS cultures. Viruses. 2021;13(1):91.
  • 29.
    Magistro D, Takeuchi H, Nejad KK, Taki Y, Sekiguchi A, Nouchi R, et al. The relationship between processing speed and regional white matter volume in healthy young people. PLoS One. 2015;10(9):e0136386.
  • 30.
    Madden DJ, Bennett IJ, Song AW. Cerebral white matter integrity and cognitive aging: contributions from diffusion tensor imaging. Neuropsychol Rev. 2009;19(4):415–35.
  • 31.
    Mavigner M, Raper J, Kovacs-Balint Z, Gumber S, O'Neal JT, Bhaumik SK, et al. Postnatal Zika virus infection is associated with persistent abnormalities in brain structure, function, and behavior in infant macaques. Sci Transl Med. 2018;10(435):eaao6975.
  • 32.
    Chimelli L, Moura Pone S, Avvad-Portari E, Farias Meira Vasconcelos Z, Araújo Zin A, Prado Cunha D, et al. Persistence of Zika virus after birth: clinical, virological, neuroimaging, and neuropathological documentation in a 5-month infant with congenital Zika syndrome. J Neuropathol Exp Neurol. 2018;77(3):193–8.
  • 33.
    Tang H, Hammack C, Ogden SC, Wen Z, Qian X, Li Y, et al. Zika virus infects human cortical neural progenitors and attenuates their growth. Cell Stem Cell. 2016;18(5):587–90.
  • 34.
    Raper J, Kovacs-Balint Z, Mavigner M, Gumber S, Burke MW, Habib J, et al. Long-term alterations in brain and behavior after postnatal Zika virus infection in infant macaques. Nat Commun. 2020;11(1):2534.
  • 35.
    Stephens H. Fears of a civil war have faded, but Nicaragua's crisis is far from over. World Politics Review. 1 February 2019.
  • 36.
    Peña R, Pérez W, Meléndez M, Källestål C, Persson LÅ. The Nicaraguan health and demographic surveillance site, HDSS-Leon: a platform for public health research. Scand J Public Health. 2008;36(3):318–25.
  • 37.
    Isaksson J, Hogberg U, Valladares E, Lindblad F. Associations between psychiatric symptoms and cortisol levels in Nicaraguan young school-age children. Psychiatry Res. 2016;240:376–80.
  • 38.
    Isaksson J, Lindblad F, Valladares E, Hogberg U. High maternal cortisol levels during pregnancy are associated with more psychiatric symptoms in offspring at age of nine – a prospective study from Nicaragua. J Psychiatr Res. 2015;71:97–102.
  • 39.
    Agren D. Criminalisation of health care in Nicaragua's political crisis. Lancet. 2018;392(10150):807–8.
  • 40.
    Vargas-Palacios E, Pineda R, Galán-Rodas E. The politicised and crumbling Nicaraguan health system. Lancet. 2018;392(10165):2694–5.

Publication Dates

  • Publication in this collection
    14 Apr 2023
  • Date of issue
    2022

History

  • Received
    29 Sept 2021
  • Accepted
    16 Mar 2022
Organización Panamericana de la Salud Washington - Washington - United States
E-mail: contacto_rpsp@paho.org