Effects of gendered racial microaggressions on the mental health of black women

Tafnes Varela Martins Tiago Jessé Souza de Lima Walberto Silva Santos About the authors

Abstract

This study aims to evaluate the effects of gendered racial microaggressions on the mental health of black women, specifically the influence of the variables identity and self-esteem on the relationship between the frequency of gendered racial microaggressions and mental health. 76 women participated in the study. The mean age was 24.62 years (SD = 6.3). Participants answered four instruments in addition to sociodemographic questions: Gendered Racial Microaggression Scale, Goldberg General Health Questionnaire, Group Identification Scale, and Rosenberg Self-Esteem Scale. The results indicate that the high frequency of gendered racial microaggressions predicts worse levels of mental health and self-esteem. Self-esteem mediates the relationship between microaggressions and general health. It is a protective factor of mental health. Identity moderates this relationship, so that a high identification as a black woman is related to lower levels of mental health when faced with a high frequency of discriminatory events. Despite some limitations, the objectives were achieved. Future studies should contribute with explanations of the relationship between gendered racial microaggressions and mental health.

Key words
Racism; Sexism; Mental Health; Identity; Self-image

Introduction

Mental health is the result of multiple and complex relationships between biological, psychological and social factors that depends on a dynamic balance between the individual’s interactions and the interaction of other people, taking into account organic characteristics and personal and family backgrounds. In this sense, exposure to traumatic and stressful life events, such as unstable family environments, experiences of gendered violence, discrimination, and social exclusion, in a single or systematic way, is a preponderant factor for negative emotional changes in the mental health of individuals and their lives in general11 Alves AA, Rodrigues NF. Determinantes sociais e econômicos da Saúde Mental. Rev Port Saúde Pública 2010; 28(2):127-131.,22 Helms JL, Nicolas G, Green CE. Racism and Ethnoviolence as Trauma: Enhancing Professional Training. Traumatology 2010; 16(4):53-62..

Stressors related to racial discrimination33 Wei M, Liao KY, Chao RC, Mallinckrodt B, Tsai PC, Botello-Zamarron R. Minority stress, perceived bicultural competence, and depressive symptoms among ethnic minority college students. J Couseling Psychol 2010; 57(4):411-422. may affect mental health by multiple ways. For example, asymmetrical power relations between discriminant and discriminated groups related to different socioeconomic status and access to goods and services, as well as the perception of discrimination experiences at an individual level, may culminate in high levels of psychological stress and physical and mental health problems44 Paradies Y, Ben J, Denson N, Elias A, Priest N, Pieterse A, Gupta A, Kelaher M, Gee G. Racism as a determinant of health: a systematic review and meta-analysis. PloS One 2015; 10(9):e0138511.. This situation is aggravated when a large number of stressful events are perceived in individual or social contexts in a daily basis55 Mata VP, Pelisoli CL. Expressões do racismo como fator desencadeante de estresse agudo pós-traumático. Rev Bras Psicol 2016; 3:128-140., such as intentional or non-intentional verbal or behavioral verbal abuse, which communicate hostile, derogatory, or negative offensive racial offenses towards a person or a target group66 Sue DW, Capodilupo CM, Torino GC, Bucceri JM, Holder A, Nadal KL, Esquilin M. Racial microaggressions in everyday life: implications for clinical practice. Am Psychol 2007; 62(4):271-286..

Indeed, studies have suggested that exposure to certain types of discrimination frequently has negative repercussions on the mental health of black individuals77 Lambert SF, Herman KC, Bynum MS, Ialongo NS. Perceptions of racism and depressive symptoms in African American adolescents: The role of perceived academic and social control. J Youth Adolesc 2009; 38(4):519-531.. Racist experiences, for example, are related to abusive use of substances88 Clark TT, Salas-Wright CP, Vaughn MG, Whitfield KE. Everyday discrimination and mood and substance use disorders: a latent profile analysis with African Americans and Caribbean Blacks. Addict Behav 2015; 40:119-125., low self-esteem99 Molina KM, James D. Discrimination, internalized racism, and depression: A comparative study of African American and Afro-Caribbean adults in the US. Group Process Intergroup Relat 2016; 19(4):439-461., mental disorders44 Paradies Y, Ben J, Denson N, Elias A, Priest N, Pieterse A, Gupta A, Kelaher M, Gee G. Racism as a determinant of health: a systematic review and meta-analysis. PloS One 2015; 10(9):e0138511., and general depressive symptoms1010 Shulz AJ, Gravlee CC, Williams DR, Israel BA, Mentz G, Rowe Z. Discrimination, symptoms of depression, and self-rated health among African American women in Detroit: results from longitudinal analysis. Am J Public Health 2006; 96(7):1265-1270.. Studies have also pointed out the effects of racism on mental health and, consequently, on physical health. These studies indicate strong correlations with stress, depression and decline of physical health, which leads to a high prevalence of cardiovascular diseases and obesity1111 Davis GY, Stevenson HC. Racial socialization and symptoms of depression among black youth. J Child Fam Stud 2006; 15:293-307.,1212 Lambert SF, Herman KC, Bynum MS, Ialongo NS. Perceptions of racism and depressive symptoms in African American adolescents: The role of perceived academic and social control. J Youth Adolesc 2009; 38(4):519-531..

Despite consistent findings relating skin color and mental health, little is known about how other dimensions of social categorization, such as gender and social class, interfere with this relationship. Research on racism has often treated black people as a monolithic group. Such treatment creates gaps with regard to potential gender differences in experiences of discrimination and the possible effects on mental health, for example. Specifically in the field of study of microaggressions, a frequent criticism is that most studies evaluate only how microaggressions are triggered by a single identity of an individual separately (for example, women or black people). Such studies do not seek to understand how intersections among multiple identities can affect an individual’s microaggression experiences, such as being a woman and a black woman1313 Nadal KL, Davidoff KC, Davis LS, Wong Y, Marshall D, McKenzie V. A quantitative approach to intersectional microaggressions: Understanding influences of race, ethnicity, gender, sexuality, and religion. Qualit Psychol 2015; 2:147-163..

Corroborating this perspective, studies have suggested that exposure to certain types of discrimination may vary according to gender1414 Greer TM, Laseter A, Asiamah D. Gender as a moderator of the relation between race-related stress and mental health symptoms for african americans. Am Psychol Assoc 2009; 33(3):295-307.. For example, black men are often associated with crime. Thus, they are more likely to suffer physical and verbal assaults by police officers1414 Greer TM, Laseter A, Asiamah D. Gender as a moderator of the relation between race-related stress and mental health symptoms for african americans. Am Psychol Assoc 2009; 33(3):295-307.. Black women, on the other hand, are more susceptible to rape and domestic violence1515 Esqueda CW, Harrison LA. The influence of gender role stereotypes, the woman’s race and level of provocation and resistance on domestic culpability atributions. Sex Roles 2005; 53:821-834., as well as suffering indifference from the police as regards their individual and respective community protection1616 Brunson RK, Miller J. Young Black men and urban policing in the United States. Br J Criminol 2006; 46(4):613-640..

Lewis et al.1717 Lewis JA, Mendenhall R, Harwood SA, Huntt MB. Coping with gendered racial microaggressions among Black women college students. J African Am Stud 2013; 17:51-73. argue that experiences of discrimination of black women differ from the discrimination experienced by black men and white women. This is because black experience a hybrid phenomenon resulting from the combination of racism and sexism. Such experiences, called gendered racial microaggressions, also include processes of marginalization, silencing, and objectification1818 Lewis JA, Neville HA. Construction and Initial Validation of the Gendered Racial Microaggressions Scale for Black Women. J Couns Psychol 2015; 62(2):289-302.. They may impact interpersonal relationships, leading to suppression of emotions and negative effects on mental health that differ from those experienced by white women1414 Greer TM, Laseter A, Asiamah D. Gender as a moderator of the relation between race-related stress and mental health symptoms for african americans. Am Psychol Assoc 2009; 33(3):295-307.. Data obtained by Stevens-Watkins et al.1919 Stevens-Watkins D, Perry B, Pullen E, Jewell J, Oser CB. Examining the associations of racism, sexism, and stressful life events on psychological distress among African-American women. Cultur Divers Ethnic Minor Psychol 2014; 20(4):561-569. corroborate this perspective. The authors note that African-American women, for example, report twenty times more psychological stress than white women do. In addition, the Center for Disease Control and Prevention in the USA2020 Centers fo Disease Control and Prevention (CDC). Summary of Health Statistics for U.S. Adults: National Health Interview Survey 2010. Washington: CDC; 2012. also points out higher rates of sadness and hopelessness among black women, which leads to suicide ideation and planning2121 Teng CT, Humes EC, Demetrio FN. Depressão e comorbidades clínicas. Rev Psiquiatr Clínica 2005; 32(3):149-159..

In Brazil, data from the Ministry of Health2222 Brasil. Política Nacional de Atenção Integral à Saúde da Mulher: Princípios e Diretrizes. Brasília: Editora MS; 2004. indicate that, when the main causes of death among women are taken into account, black women die more than white women due to homicides, suicides, and ill-defined deaths. By analyzing common mental disorders (CMD) according to sociodemographic characteristics, Araújo et al.2323 Araújo TM, Pinho PS, Almeida MM. Prevalência de transtornos mentais comuns em mulheres e sua relação com as características sociodemográficas e o trabalho doméstico. Rev Bras Saúde Mater Infant 2005; 5(3):337-348. observed a higher prevalence of CMD among black or brown women. These women had a low level of schooling, did not live with their companions, had an average income of up to one minimum wage, had children, and were heads of households.

Based on the above, it can be inferred that the knowledge on the social and personal determinants of health, as well as the way these variables are related, is fundamental for the establishment of a predictive perspective of mental health of black women. In addition to clarifying the relationship between the stress resulting from racial and gendered microaggressions and mental health, it is necessary to understand possible intervening factors in this relationship that act as a protector or potentiator of impacts of microaggressions on mental health. Individuals do not react to negative experiences in the same way (such as discrimination) due to personal, social and environmental variables2424 Panchanadeswaran S, Dawson BA. How discrimination and stress affects self-esteem among Dominican immigrant women: an exploratory study. Soc Work Public Health 2011; 26(1):60-77.. For example, some studies have pointed out that the level of social identity2525 Szymanski DM, Lewis JA. Gendered racism, coping, identity centrality, and African American college women’s psychological distress. Psychol Women Quarterly 2016; 40(2):229-243. and self-esteem2626 Crabtree JW, Haslam SA, Postmes T, Haslam C. Mental health support groups, stigma, and self-esteem: positive and negative implications of group identification. J Soc Issues 2010; 66(3):553-569. may act as intervening variables in the effects of discrimination on mental health.

Individual aspects, consciousness of belonging to a social group, and the emotional value and meaning of such belonging define social identity2727 Tajfel H, Turner JC. An integrative theory of intergroup conflict. Soc Psychol Interg Relat 1979; 33:33-47.. In this sense, racial identity is a multidimensional construct that includes a sense of belonging or proximity to a group and the importance attributed to skin color regarding the self-concept and the self-image of individuals2828 Sellers RM, Rowley SA, Chavous TM, Shelton JN, Smith MA. Multidimensional Inventory of Black Identity: A preliminary investigation of reliability and construct validity. J Personal Soc Psychol 1997; 73(4):805-815.,2929 Pascoe EA, Smart-Richman L. Perceived discrimination and health: A meta-analytic review. Psychol Bull 2009; 135(4):531-554.. Indeed, identity may influence individual beliefs and the expectation that individuals have with regard to the treatment they will be given in different contexts2828 Sellers RM, Rowley SA, Chavous TM, Shelton JN, Smith MA. Multidimensional Inventory of Black Identity: A preliminary investigation of reliability and construct validity. J Personal Soc Psychol 1997; 73(4):805-815.,2929 Pascoe EA, Smart-Richman L. Perceived discrimination and health: A meta-analytic review. Psychol Bull 2009; 135(4):531-554., which influences the perception of discriminationexperiences2828 Sellers RM, Rowley SA, Chavous TM, Shelton JN, Smith MA. Multidimensional Inventory of Black Identity: A preliminary investigation of reliability and construct validity. J Personal Soc Psychol 1997; 73(4):805-815.,3030 Crocker J, Major B. Social stigma and self-esteem: The self-protective properties of stigma. Psychol Rev 1989; 96(4):608-630.,3131 MacCoy SK, Major B. Group identification moderates emotional response to perceived prejudice. Pers Soc Psychol Bull 2003; 29(8):1005-1017.. Corroborating this view, Sellers and Shelton3232 Sellers RM, Shelton JN. The role of racial identity in perceived racial discrimination. J Pers Soc Psychol 2003; 84(5):1079-1092. have pointed to a significant association between racial identity and perceived racial discrimination, so that the greater the importance attributed to being black for the formation of self-concept, the greater the frequency with which experiences of discrimination are perceived.

In spite of contributions of studies on identity, there is a literature gap on individuals who identify themselves with multiple social categories since more than one social category may interact for the formation of self-concept. For example, Thomas et al.3333 Thomas AJ, Hacker JD, Hoxha D. Gendered racial identity of Black young women. Sex Roles 2011; 64(7-8):530-542. conducted a study with African-Americans who stated that racial gender identity was more important to their self-concept than their racial and gender identity considered in isolation. According to this perspective, it is necessary to understand the implications of the intersection between both identities (being female and being black) for the experiences of discrimination and its consequences.

In addressing specifically the implications of the intersection between racial and gender identities, some studies have pointed out that such intersection may be both a risk factor (by increasing the perception of discrimination experiences) and a protective factor (lessening the negative impacts of mental health discrimination)3434 Neblett EW, Rivas-Drake D, Umaña-Taylor AJ. The promise of racial and ethnic protective factors in promoting ethnic minority youth development. Child Develop Pers 2012; 6(3):295-303.,3535 Sellers RM, Caldwell CH, Schmeelk-Cone KH, Zimmerman MA. Racial identity, racial discrimination, perceived stress, and psychological distress, and psychological distress among African American young adults. J Health Soc Behav 2003; 44(3):302-317.. In fact, the woman identifying herself as a black woman may raise awareness for discrimination experiences3636 Seaton EK, Caldwell CH, Sellers RM, Jackson JS. The prevalence of perceived discrimination among African American and Caribbean Black youth. Dev Psychol 2008; 44(5):1288-1297.. On the other hand, it may contribute with coping strategies to such situations, such as the ability to feel better by focusing on positive aspects of belonging to a group and less internalization of negative messages about themselves3434 Neblett EW, Rivas-Drake D, Umaña-Taylor AJ. The promise of racial and ethnic protective factors in promoting ethnic minority youth development. Child Develop Pers 2012; 6(3):295-303.,3737 DeBlaere C, Bertsch KN. Perceived sexist events and psychological distress of sexual minority women of color: The moderating role of womanism. Psychol Women Quarterly 2013; 37(2):167-178..

In this sense, the centrality of racial and gender identity may also interact with self-esteem since there may be a lower probability of internalization of negative messages about being a black woman3838 Szymanski DM, Lewis JA. Race-related stress and racial identity as predictors of African American activism. J Black Psychol 2015; 41(2):170-191.. Self-esteem refers to global assessments of personal value we make about ourselves3939 Orth U, Robins RW. The development of self-esteem. Current Directions Psychol Sci 2014; 23(5):381-387.,4040 Rosenbeg M. Conceiving the self. Int J Aging Human Dev 1989; 38:221-235.. Some theorists recognize it as a central aspect of psychological well-being and a predictor of satisfaction with life4141 Diener ED, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess 1985; 49(1):71-75.. In addition, self-esteem is strongly associated with how individuals relate to themselves and with society. Thus, individuals with high levels of self-esteem tend to have a more positive view of themselves and their abilities4242 Crocker J, Luhtanen R, Blaine B, Broadnax S. Collective self-esteem and psychological well-being among White, Black, and Asian college students. Personality Soc Psychol Bull 1994; 20(5):503-513..

Although individual aspects are important for the conformation of self-esteem, feelings of self-worth also seem to suffer the influence of collective aspects. In light of the theory of social identity2727 Tajfel H, Turner JC. An integrative theory of intergroup conflict. Soc Psychol Interg Relat 1979; 33:33-47., this happens because there is a part of our identity that is influenced by participation in social groups and by the value and emotional importance attributed to them. It involves how the individual evaluates his/her belonging group, perceptions about the assessments that others make about it, and how much the individual identifies with that group. In fact, presenting a strong sense of belonging to a group may contribute to the psychological well-being of individuals, such as improving self-esteem4343 Xu Y, Farver JA, Pauker K. Ethnic identity and self-esteem among Asian and European Americans: When a minority is the majority and the majority is a minority. Eur J Soc Psychol 205; 45(1):62-76.. However, some studies have pointed out that experiences of discrimination are associated with low self-esteem3030 Crocker J, Major B. Social stigma and self-esteem: The self-protective properties of stigma. Psychol Rev 1989; 96(4):608-630.,3636 Seaton EK, Caldwell CH, Sellers RM, Jackson JS. The prevalence of perceived discrimination among African American and Caribbean Black youth. Dev Psychol 2008; 44(5):1288-1297.,4444 Mereish EH, N’cho HS, Green CE, Jernigan MM, Helms JE. Discrimination and Depressive Symptoms Among Black American Men: Moderated-Mediation Effects of Ethnicity and Self-Esteem. Behav Med 2016; 42(3):190-196.. In addition, self-esteem has been pointed out as a possible mediator of the relationship between discrimination and depressive symptoms among people in minority groups99 Molina KM, James D. Discrimination, internalized racism, and depression: A comparative study of African American and Afro-Caribbean adults in the US. Group Process Intergroup Relat 2016; 19(4):439-461.,4444 Mereish EH, N’cho HS, Green CE, Jernigan MM, Helms JE. Discrimination and Depressive Symptoms Among Black American Men: Moderated-Mediation Effects of Ethnicity and Self-Esteem. Behav Med 2016; 42(3):190-196.,4545 Liang CT, Fassinger RE. The role of collective self-esteem for Asian Americans experiencing racism-related stress: A test of moderator and mediator hypotheses. Cultur Divers Ethnic Minor Psychol 2008; 14(1):19-28., i.e., self-esteem may lessen the negative effects of discrimination experiences on mental health.

Through this contextualization, the main objective of this article is to evaluate the impacts of gendered racial microaggressions on the mental health of black women. This study also tests the moderating role of social identity and the mediator role of self-esteem in this relation. Based on the theoretical review, four hypotheses were proposed. The Hypothesis 1 (H1) states that a high frequency of microaggressions leads to a worse mental health. The Hypothesis 2 (H2) proposes that a high frequency of microaggressions leads to low levels of self-esteem. In fact, some international studies have indicated that the most frequent perception of discrimination is related to worse mental health levels33 Wei M, Liao KY, Chao RC, Mallinckrodt B, Tsai PC, Botello-Zamarron R. Minority stress, perceived bicultural competence, and depressive symptoms among ethnic minority college students. J Couseling Psychol 2010; 57(4):411-422. and lower levels of self-esteem4646 Nadal KL, Wong Y, Griffin KE, Davidoff K, Sriken J. The adverse impact of racial microaggressions on college students’ self-esteem. J College Student Dev 2014; 55(5):461-474..

In addition, this study proposes that the effects of the frequency of microaggressions on general health are mediated by self-esteem (Hypothesis 3, H3) and moderated by social identity (Hypothesis 4, H4). Some studies have already indicated that a lowering of self-esteem may be the explanatory factor of the impacts of microaggressions on the health of individuals4747 Wong-Padoongpatt G, Zane N, Okazaki S, Saw A. Decreases in implicit self-esteem explain the racial impact of microaggressions among Asian Americans. J Couns Psychol 2017; 64(5):574-583.. On the other hand, the results on the moderating role of social identity are conflicting. Some studies have pointed out that a greater social identification with the belonging group is a protective factor4848 Torres L, Taknint JT. Ethnic microaggression, traumatic stress symptoms, and Latino depression: A moderated mediational model. J Couns Psychol 2015; 62(3):393-401., thus lessening the effects of discrimination on mental health. Other studies suggest that a greater identification has an amplifying effect, increasing the perception of discrimination situations and the consequent negative effects on mental health2525 Szymanski DM, Lewis JA. Gendered racism, coping, identity centrality, and African American college women’s psychological distress. Psychol Women Quarterly 2016; 40(2):229-243..

Method

Sample

The criterion of inclusion was only women who identified themselves as black, excluding those who did not fit this profile. The sample consisted of 76 black women, aged between 18 and 56 years (M = 24.62; SD = 6.23). Among women reporting socioeconomic data, the majority reported being heterosexual (69.7%), single (53.9%), with incomplete higher education (47.4%), and having a family income above four minimum wages (36.8%). Because it is a convenience sample (non-probabilistic), only women who agreed to contribute to the study participated in it.

Instruments

In addition to reporting data on sociodemographic variables, participants answered the following instruments:

Gendered Racial Microaggression Scale (GRMS). Originally developed by Lewis and Neville1818 Lewis JA, Neville HA. Construction and Initial Validation of the Gendered Racial Microaggressions Scale for Black Women. J Couns Psychol 2015; 62(2):289-302., it comprises 39 items. Participants report frequencies (0 = Never, 5 = Once a week or more) and how much the event was experienced as stressful (0 = This never happened to me; 5 = Extremely stressful). For this study, this instrument was translated and adapted to Portuguese. Initially, two English-speaking researchers performed the translation, and a synthesis of the translated versions was then conducted. This synthesis has been translated back into English to evaluate whether original contents were preserved. To test its construct validity, a factorial analysis using the main axes method indicated the extraction of a general factor, which explained 50.2% of the variance. The factorial loads varied between 0.90 and 0.49. An analysis of the internal consistency of the measurement pointed out that it can be used as a unifactorial instrument (Cronbach’s alpha = 0.97).

Goldberg General Health Questionnaire (GHQ-12). The instrument comprises 12 items that measure mental health and social dysfunction. It was developed by Goldberg4949 Goldberg D. The detection of psychiatric illness by questionnaire. Londres: Oxford University Press; 1972. and adapted for Brazil by Gouveia et al.5050 Gouveia VV, Lima TJ, Gouveia RS, Freires LA, Barbosa LH. Questionário de Saúde Geral (QSG-12): o efeito de itens negativos em sua estrutura fatorial. Cad Saúde Pública 2012; 28(2):375-384.. Due to the focus of this study, only items referring to mental health were used. Participants answered using a four-point Likert scale. For the inverted items, the response alternatives ranged from 1 = Absolutely not, and 4 = Much more than usual. In case of affirmative items, responses ranged from 1 = More than usual to 4 = Much less than usual. For practical purposes, the scores obtained were reversed, so that higher scores are the indication of a better level of mental health. The mental health factor had an α of 0.85.

Group Identification Scale. Originally produced for the Brazilian context by Wachelke5151 Wachelke JF. Identificação com o grupo: adaptação e validação de uma medida geral para o contexto brasileiro. Psicol Saber Soc 2013; 1(2):187-200., this scale is a one-dimensional measure of group identification. It can be used to assess identification with different social groups. It comprises six items that can be adapted to any reference group. The following is an example of an item: “Being a ___ is an important part of how I see myself”. For this study, being a “black woman” was used as reference group (for example: Being a black woman is an important part of how I see myself). The items were answered using a Likert scale ranging from 1 = strongly disagree to 7 = strongly agree. The higher the score, the higher the level of identification with the group. The scale had a Cronbach’s alpha of 0.86.

Rosenberg Self-Esteem Scale (RSES). This scale was originally developed by Rosenberg4040 Rosenbeg M. Conceiving the self. Int J Aging Human Dev 1989; 38:221-235. and validated for the Brazilian context by Hutz5252 Hutz CS, Zanon C. Revisão da adaptação, validação e normatização da escala de autoestima de Rosenberg. Avaliação Psicológica 2011; 10(1):41-49.. It comprises ten statements that evaluate global self-esteem, that is, the set of thoughts and feelings referring to oneself (for example: I feel that I am a person of value, at least as much as other people; taking everything into account, I think I am a failure). The items were answered using a Likert scale ranging from 1 = strongly disagree to 7 = strongly agree. In this sense, the higher the score, the higher the level of overall self-esteem. The RSES had a Cronbach’s alpha of 0.86.

Procedure

The instruments were applied electronically by online dissemination, and also using printed questionnaires. For the online application, the questionnaire link was sent to specific groups of black women, murals, and message boxes from Facebook users. Upon accessing the questionnaire in this version, the respondent was requested to access the Informed Consent that presented the objectives of the study and emphasized the anonymous and voluntary nature of the participation. By agreeing to participate, the respondent should click “Proceed” to be directed to the questionnaire. On average, it took thirty minutes to complete the filling of the form. The printed questionnaires were distributed in public places in the city of Fortaleza (CE), such as squares and shopping malls, where groups of women gather for specific events related to Afro-Brazilian culture. A prior appointment was arranged with organizers of events through social networks. Additionally, the questionnaires were distributed at a public university located in a municipality in the countryside of Ceará.

Data analysis

Initially, Pearson correlations were performed to evaluate the correlation between the variables identity, self-esteem, depression, and the frequency of gendered racial microaggressions. Then, a regression analysis (Enter method) was performed to test the relations between the variables of Hypotheses 1 and 2. For the mediation and moderation analyses (H3 and H4), the PROCESS macro (version 2.16) developed for SPSS by Hayes5353 Hayes AF. Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. Nova York: Guilford Publication; 2017. was used. To evaluate the significance of mediation, specifically the reliability of indirect effects, the bootstrapping and the Sobel5454 Sobel ME. Some new results on indirect effects and their standard errors in covariance structure models. Am Psychol Assoc 1986; 16:159-186. test were used. Bootstrapping is a computational method involving repeated samplings drawn from a dataset to estimate the indirect effects on each of them5555 Souza LA, Torres AR, Barbosa GA, Lima TJ, Souza LE. Subjective Well-Being and Burnout in Military Cadets: the mediating role of self-efficacy. Psicol Reflex Crít 2015; 28(4):744-752.. The mediation hypothesis is accepted if the confidence intervals obtained through bootstrapping do not contain the value zero, that is, the indirect effects would have a value other than zero5656 MacKinnon DP, Lockwood CM, Williams J. Confidence limits for the indirect effect: Distribution of the product and resampling methods. Multivariate Behav Res 2004; 39(1):99-128.. One thousand samples of bootstrapping were computed, and the adopted confidence interval was 90%, which was calculated through the method bias corrected and accelerated (BCa). To test the existence of moderation, a significant interaction effect must be obtained between the moderating variable and the independent variable, indicating that the effects of the independent variable on the dependent variable vary according to the moderator levels5353 Hayes AF. Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. Nova York: Guilford Publication; 2017..

Results

Initially, correlation analyses were performed between the study variables. As can be seen in Table 1, the frequency of microaggressions correlated positively with the stress level and negatively with mental health and self-esteem (p < 0.01). In addition, the stress of microaggressions had a negative correlation (p < 0.01) with mental health and self-esteem, and a positive correlation with the identity of women. There was also a negative correlation (p < 0.01) between mental health and identification as a black woman, and a positive correlation (p < 0.01) between mental health and self-esteem.

Table 1
Correlations between microaggressions frequency and stress with mental health, identity and self-esteem.

Subsequently, regression analyses were carried out in order to understand the predictive power of the frequency of gendered racial microaggressions to explain the mental health indicators (H1). As can be seen in Table 2, in the first step, mental health was regressed in relation to frequency of microaggressions. The frequency of microaggressions significantly explains 6% of the mental health variance (F(1.74) = 5.07, R = 0.26, R2adjusted = 0.06). Regression weights allow verifying that the variable frequency of microaggressions has an inverse and significant relation with mental health (b = -0.14; p < 0.05), so that a higher frequency of microaggressions predicts worse levels of mental health, corroborating H1. In the second step, with the objective of knowing the predictive power of the frequency of gendered racial microaggressions on the self-esteem (H2), another analysis was performed in which self-esteem was regressed in relation to microaggressions. Considering the self-esteem, the frequency of microaggressions explained 10% of the variance (F(1.74) = 8.08, p <0.01, R = 0.31, R2adjusted = 0.10). Similarly, a higher frequency of microaggressions predicts lower levels of self-esteem (b = -0.35, p < 0.01), corroborating H2. Considering that microaggressions significantly predict both self-esteem and mental health, it was possible to test the hypothesis of self-esteem mediation (H3) in the third step, in which mental health was reduced in relation to microaggression and self-esteem.

Table 2
Regression analyzes.

The results observed in Table 2 indicate that, by adding the self-esteem to the model, microaggressions fail to predict mental health significantly. The total effect of microaggressions on mental health, which was b = -0.14 (p < 0.05), was composed of a direct, non-significant effect (b = 0.05 (p = 0.40)) and self-esteem was composed of an indirect effect (b = -0.09 (p < 0.01)). This indirect effect presents a confidence interval that does not include the zero value (90%CI [-0.17; -0.04]), indicating a significant mediation effect, corroborated by Sobel’s test (Z = -2.47, p < 0.01). As the direct effect of microaggressions on mental health became insignificant after considering self-esteem, we can state that mediation is complete, corroborating the H3. That is, the effects of microaggressions on mental health were completely mediated by self-esteem.

Having been corroborated by the mediation effect of self-esteem, the H4 was tested in sequence (i.e., identity moderates the effects of microaggressions on mental health). To do so, in the fourth step, we regressed mental health in relation to microaggressions, self-esteem, identity, and the interaction term between microaggressions and identity. To calculate the interaction term, the variables microaggression and identity were centered (subtracted from their mean). The results indicate that the main effects of microaggression and identity were not significant, while the effects of self-esteem remained significant. When we interpret the main effects of self-esteem, we observe that a higher self-esteem is related to better levels of mental health (b = 0.27; p < 0.001;η2 p = 0.34).

The most relevant for the moderation analysis was the effects of microaggression interaction term and identity. Thus, they were a significant prediction of mental health (b = -0.13; p < 0.001; η2 p = 0.22). This result points out that the effects of microaggressions on mental health are moderated by identity. By decomposing the effects and evaluating the impacts of conditioned microaggressions on identity levels, we observed that in participants with low identity (1 SD below the mean), microaggressions do not predict mental health (b = 0.09; p = 0.12). On the other hand, for participants with a high identity (1 SD above the mean), microaggressions predict mental health significantly (b = -0.19; p < 0.001). Therefore, the effects of microaggressions on mental health only occur among participants who present a higher identity value, which configures a conditioned effect to the values of the identity, thus corroborating Hypothesis 4.

Discussion

The main objective of this study was to evaluate the impacts of gendered racial microaggressions on the mental health of black women, as well as to test the moderating role of social identity and the mediator of self-esteem in this relation. The results obtained provided satisfactory evidence to corroborate the hypotheses, obtaining consistent results with the literature in the area. Next, the results observed for each hypothesis will be discussed.

The Hypothesis 1 states that a higher frequency of gendered racial microaggressions predicts a lower level of mental health. The results observed in this study corroborate the findings of the meta-analysis performed by Paradies et al.44 Paradies Y, Ben J, Denson N, Elias A, Priest N, Pieterse A, Gupta A, Kelaher M, Gee G. Racism as a determinant of health: a systematic review and meta-analysis. PloS One 2015; 10(9):e0138511. of the impacts of discrimination on physical and mental health. The authors reported correlations between experiences of discrimination, mental disorders, stress, and general depressive symptoms. In addition, Stevens-Watkins et al.1919 Stevens-Watkins D, Perry B, Pullen E, Jewell J, Oser CB. Examining the associations of racism, sexism, and stressful life events on psychological distress among African-American women. Cultur Divers Ethnic Minor Psychol 2014; 20(4):561-569. and Teng et al.2121 Teng CT, Humes EC, Demetrio FN. Depressão e comorbidades clínicas. Rev Psiquiatr Clínica 2005; 32(3):149-159. pointed to the negative consequences of a high frequency of discriminatory experiences on mental health, suggesting that, in fact, coexistence with chronic environmental stressors predicts worse rates of mental health. It should be noted that the low variance observed between microaggression frequency and mental health may be related to the central role of other variables, such as self-esteem and social identity, in the explanation of mental health.

The Hypothesis 3 seeks to assess whether the impacts of gendered racial microaggressions on mental health is mediated by self-esteem. The results indicate that the direct effects of microaggressions on general health are not significant, but that the indirect effects, mediated by self-esteem, are significant. These results allow inferring that the effects of microaggression on mental health are completely mediated by self-esteem, that is, self-esteem is an important protective factor for mental health in the context of discrimination. These results are consistent with those observed in other studies that also tested the mediating role of self-esteem99 Molina KM, James D. Discrimination, internalized racism, and depression: A comparative study of African American and Afro-Caribbean adults in the US. Group Process Intergroup Relat 2016; 19(4):439-461.,4444 Mereish EH, N’cho HS, Green CE, Jernigan MM, Helms JE. Discrimination and Depressive Symptoms Among Black American Men: Moderated-Mediation Effects of Ethnicity and Self-Esteem. Behav Med 2016; 42(3):190-196.,4545 Liang CT, Fassinger RE. The role of collective self-esteem for Asian Americans experiencing racism-related stress: A test of moderator and mediator hypotheses. Cultur Divers Ethnic Minor Psychol 2008; 14(1):19-28.. Mereish et al.4444 Mereish EH, N’cho HS, Green CE, Jernigan MM, Helms JE. Discrimination and Depressive Symptoms Among Black American Men: Moderated-Mediation Effects of Ethnicity and Self-Esteem. Behav Med 2016; 42(3):190-196., for example, obtained similar results in a study with American and Caribbean blacks in the United States, pointing out that self-esteem plays a moderating role in the impacts of daily discrimination on the indicators of depression in the study’s sample.

Finally, the moderating role of social identity in the relationship between racial microaggression and mental health is tested in the Hypothesis 4. Data indicated that social identity acts as moderator in this relationship. By decomposing the effects, we observe that microaggressions do not predict significantly mental health of participants with a low identity, so that the effects of microaggressions on mental health only occurs among participants with a high identity. This result is consistent with other studies that seek to clarify the role of identity in discriminationexperiences2828 Sellers RM, Rowley SA, Chavous TM, Shelton JN, Smith MA. Multidimensional Inventory of Black Identity: A preliminary investigation of reliability and construct validity. J Personal Soc Psychol 1997; 73(4):805-815.,3030 Crocker J, Major B. Social stigma and self-esteem: The self-protective properties of stigma. Psychol Rev 1989; 96(4):608-630.,5757 Kahn KB, Lee JK, Renauer B, Henning KR, Stewart G. The effects of perceived phenotypic racial stereotypicality and social identity threat on racial minorities’ attitudes about police. J Soc Psychol 2017; 157(4):416-428.. Crocker and Major3030 Crocker J, Major B. Social stigma and self-esteem: The self-protective properties of stigma. Psychol Rev 1989; 96(4):608-630., for example, reported that identification with minority groups may facilitate the perception of negative treatments as discriminatory behavior depending on group belonging. Similarly, Shelton and Sellers3232 Sellers RM, Shelton JN. The role of racial identity in perceived racial discrimination. J Pers Soc Psychol 2003; 84(5):1079-1092. observed that black people who considered skin color a central component of their identity were more likely to perceive situations with ambiguous interpretations as a result of discrimination. Major et al.5858 Major B, Gramzow RH, McCoy SK, Levin S, Schmader T, Sidanius J. Perceiving personal discrimination: the role of group status and legitimizing ideology. J Pers Soc Psychol 2002; 82(3):269-282., for example, also noted that high levels of racial identification are associated with a greater perception of vulnerability to discrimination, culminating in chronic stress that may lead to lower rates of mental health5959 Ahmed AT, Mohammed SA, Williams DR. Racial discrimination & health: Pathways & evidence. Indian J Med Res 2007; 126(4):318-327.. Therefore, a greater group identification has an amplifying effect, increasing the perception of situations of discrimination and the consequent negative effects on mental health2525 Szymanski DM, Lewis JA. Gendered racism, coping, identity centrality, and African American college women’s psychological distress. Psychol Women Quarterly 2016; 40(2):229-243..

Although the results presented here provide satisfactory evidence for the hypotheses tested, some limitations may be pointed out. The cross-sectional design adopted does not contemplate the cumulative effects of gendered racial microaggressions on the mental health of black women, nor does it allow establishing causal relationships. Longitudinal studies could provide stronger evidence for the predictive relationships observed between discrimination, identity, self-esteem, and mental health. Social identity may function as a buffer in the relationship between racial and gender microaggressions. However, this result should be interpreted with caution, since a low social identity may prevent individuals from detecting and reporting gendered racism when they experience it. That does not mean, however, that such experiences cannot negatively affect psychological well-being at an auto-processing level2525 Szymanski DM, Lewis JA. Gendered racism, coping, identity centrality, and African American college women’s psychological distress. Psychol Women Quarterly 2016; 40(2):229-243..

Another limitation concerns the reduced sample size, a fact that may have occurred because the women invited to answer the survey did not identify themselves as black, but as brunettes or brown, which may have led to the exclusion of many participants from the final sample. The final sample obtained also presents different sociodemographic characteristics of the majority of black women in Brazil, which reduces the possibility of generalization of the results obtained here. In addition, most participants were engaged in groups or activities that emphasized the identity of black women, which may imply a higher average group identification compared to other black women who do not participate in such groups. Future studies on gendered racism should include samples with a greater sociodemographic diversity, which could provide a greater variability in possible gendered racial experiences. Other variables may also include mediators/moderators of the relationship between gendered racial microaggressions and mental health, such as social support and involvement with social movements.

Final considerations

This study provides empirical evidence of the effects of gendered racial microaggressions on the mental health of black women, as well as of the role of social identity and self-esteem as intervening variables in this relationship, which may aid in measures to promote mental health and well-being among this population. The findings emphasize the importance of incorporating general psychological processes in understanding the relations between discrimination and psychic suffering among people in socially marginalized groups.

References

  • 1
    Alves AA, Rodrigues NF. Determinantes sociais e econômicos da Saúde Mental. Rev Port Saúde Pública 2010; 28(2):127-131.
  • 2
    Helms JL, Nicolas G, Green CE. Racism and Ethnoviolence as Trauma: Enhancing Professional Training. Traumatology 2010; 16(4):53-62.
  • 3
    Wei M, Liao KY, Chao RC, Mallinckrodt B, Tsai PC, Botello-Zamarron R. Minority stress, perceived bicultural competence, and depressive symptoms among ethnic minority college students. J Couseling Psychol 2010; 57(4):411-422.
  • 4
    Paradies Y, Ben J, Denson N, Elias A, Priest N, Pieterse A, Gupta A, Kelaher M, Gee G. Racism as a determinant of health: a systematic review and meta-analysis. PloS One 2015; 10(9):e0138511.
  • 5
    Mata VP, Pelisoli CL. Expressões do racismo como fator desencadeante de estresse agudo pós-traumático. Rev Bras Psicol 2016; 3:128-140.
  • 6
    Sue DW, Capodilupo CM, Torino GC, Bucceri JM, Holder A, Nadal KL, Esquilin M. Racial microaggressions in everyday life: implications for clinical practice. Am Psychol 2007; 62(4):271-286.
  • 7
    Lambert SF, Herman KC, Bynum MS, Ialongo NS. Perceptions of racism and depressive symptoms in African American adolescents: The role of perceived academic and social control. J Youth Adolesc 2009; 38(4):519-531.
  • 8
    Clark TT, Salas-Wright CP, Vaughn MG, Whitfield KE. Everyday discrimination and mood and substance use disorders: a latent profile analysis with African Americans and Caribbean Blacks. Addict Behav 2015; 40:119-125.
  • 9
    Molina KM, James D. Discrimination, internalized racism, and depression: A comparative study of African American and Afro-Caribbean adults in the US. Group Process Intergroup Relat 2016; 19(4):439-461.
  • 10
    Shulz AJ, Gravlee CC, Williams DR, Israel BA, Mentz G, Rowe Z. Discrimination, symptoms of depression, and self-rated health among African American women in Detroit: results from longitudinal analysis. Am J Public Health 2006; 96(7):1265-1270.
  • 11
    Davis GY, Stevenson HC. Racial socialization and symptoms of depression among black youth. J Child Fam Stud 2006; 15:293-307.
  • 12
    Lambert SF, Herman KC, Bynum MS, Ialongo NS. Perceptions of racism and depressive symptoms in African American adolescents: The role of perceived academic and social control. J Youth Adolesc 2009; 38(4):519-531.
  • 13
    Nadal KL, Davidoff KC, Davis LS, Wong Y, Marshall D, McKenzie V. A quantitative approach to intersectional microaggressions: Understanding influences of race, ethnicity, gender, sexuality, and religion. Qualit Psychol 2015; 2:147-163.
  • 14
    Greer TM, Laseter A, Asiamah D. Gender as a moderator of the relation between race-related stress and mental health symptoms for african americans. Am Psychol Assoc 2009; 33(3):295-307.
  • 15
    Esqueda CW, Harrison LA. The influence of gender role stereotypes, the woman’s race and level of provocation and resistance on domestic culpability atributions. Sex Roles 2005; 53:821-834.
  • 16
    Brunson RK, Miller J. Young Black men and urban policing in the United States. Br J Criminol 2006; 46(4):613-640.
  • 17
    Lewis JA, Mendenhall R, Harwood SA, Huntt MB. Coping with gendered racial microaggressions among Black women college students. J African Am Stud 2013; 17:51-73.
  • 18
    Lewis JA, Neville HA. Construction and Initial Validation of the Gendered Racial Microaggressions Scale for Black Women. J Couns Psychol 2015; 62(2):289-302.
  • 19
    Stevens-Watkins D, Perry B, Pullen E, Jewell J, Oser CB. Examining the associations of racism, sexism, and stressful life events on psychological distress among African-American women. Cultur Divers Ethnic Minor Psychol 2014; 20(4):561-569.
  • 20
    Centers fo Disease Control and Prevention (CDC). Summary of Health Statistics for U.S. Adults: National Health Interview Survey 2010 Washington: CDC; 2012.
  • 21
    Teng CT, Humes EC, Demetrio FN. Depressão e comorbidades clínicas. Rev Psiquiatr Clínica 2005; 32(3):149-159.
  • 22
    Brasil. Política Nacional de Atenção Integral à Saúde da Mulher: Princípios e Diretrizes Brasília: Editora MS; 2004.
  • 23
    Araújo TM, Pinho PS, Almeida MM. Prevalência de transtornos mentais comuns em mulheres e sua relação com as características sociodemográficas e o trabalho doméstico. Rev Bras Saúde Mater Infant 2005; 5(3):337-348.
  • 24
    Panchanadeswaran S, Dawson BA. How discrimination and stress affects self-esteem among Dominican immigrant women: an exploratory study. Soc Work Public Health 2011; 26(1):60-77.
  • 25
    Szymanski DM, Lewis JA. Gendered racism, coping, identity centrality, and African American college women’s psychological distress. Psychol Women Quarterly 2016; 40(2):229-243.
  • 26
    Crabtree JW, Haslam SA, Postmes T, Haslam C. Mental health support groups, stigma, and self-esteem: positive and negative implications of group identification. J Soc Issues 2010; 66(3):553-569.
  • 27
    Tajfel H, Turner JC. An integrative theory of intergroup conflict. Soc Psychol Interg Relat 1979; 33:33-47.
  • 28
    Sellers RM, Rowley SA, Chavous TM, Shelton JN, Smith MA. Multidimensional Inventory of Black Identity: A preliminary investigation of reliability and construct validity. J Personal Soc Psychol 1997; 73(4):805-815.
  • 29
    Pascoe EA, Smart-Richman L. Perceived discrimination and health: A meta-analytic review. Psychol Bull 2009; 135(4):531-554.
  • 30
    Crocker J, Major B. Social stigma and self-esteem: The self-protective properties of stigma. Psychol Rev 1989; 96(4):608-630.
  • 31
    MacCoy SK, Major B. Group identification moderates emotional response to perceived prejudice. Pers Soc Psychol Bull 2003; 29(8):1005-1017.
  • 32
    Sellers RM, Shelton JN. The role of racial identity in perceived racial discrimination. J Pers Soc Psychol 2003; 84(5):1079-1092.
  • 33
    Thomas AJ, Hacker JD, Hoxha D. Gendered racial identity of Black young women. Sex Roles 2011; 64(7-8):530-542.
  • 34
    Neblett EW, Rivas-Drake D, Umaña-Taylor AJ. The promise of racial and ethnic protective factors in promoting ethnic minority youth development. Child Develop Pers 2012; 6(3):295-303.
  • 35
    Sellers RM, Caldwell CH, Schmeelk-Cone KH, Zimmerman MA. Racial identity, racial discrimination, perceived stress, and psychological distress, and psychological distress among African American young adults. J Health Soc Behav 2003; 44(3):302-317.
  • 36
    Seaton EK, Caldwell CH, Sellers RM, Jackson JS. The prevalence of perceived discrimination among African American and Caribbean Black youth. Dev Psychol 2008; 44(5):1288-1297.
  • 37
    DeBlaere C, Bertsch KN. Perceived sexist events and psychological distress of sexual minority women of color: The moderating role of womanism. Psychol Women Quarterly 2013; 37(2):167-178.
  • 38
    Szymanski DM, Lewis JA. Race-related stress and racial identity as predictors of African American activism. J Black Psychol 2015; 41(2):170-191.
  • 39
    Orth U, Robins RW. The development of self-esteem. Current Directions Psychol Sci 2014; 23(5):381-387.
  • 40
    Rosenbeg M. Conceiving the self. Int J Aging Human Dev 1989; 38:221-235.
  • 41
    Diener ED, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess 1985; 49(1):71-75.
  • 42
    Crocker J, Luhtanen R, Blaine B, Broadnax S. Collective self-esteem and psychological well-being among White, Black, and Asian college students. Personality Soc Psychol Bull 1994; 20(5):503-513.
  • 43
    Xu Y, Farver JA, Pauker K. Ethnic identity and self-esteem among Asian and European Americans: When a minority is the majority and the majority is a minority. Eur J Soc Psychol 205; 45(1):62-76.
  • 44
    Mereish EH, N’cho HS, Green CE, Jernigan MM, Helms JE. Discrimination and Depressive Symptoms Among Black American Men: Moderated-Mediation Effects of Ethnicity and Self-Esteem. Behav Med 2016; 42(3):190-196.
  • 45
    Liang CT, Fassinger RE. The role of collective self-esteem for Asian Americans experiencing racism-related stress: A test of moderator and mediator hypotheses. Cultur Divers Ethnic Minor Psychol 2008; 14(1):19-28.
  • 46
    Nadal KL, Wong Y, Griffin KE, Davidoff K, Sriken J. The adverse impact of racial microaggressions on college students’ self-esteem. J College Student Dev 2014; 55(5):461-474.
  • 47
    Wong-Padoongpatt G, Zane N, Okazaki S, Saw A. Decreases in implicit self-esteem explain the racial impact of microaggressions among Asian Americans. J Couns Psychol 2017; 64(5):574-583.
  • 48
    Torres L, Taknint JT. Ethnic microaggression, traumatic stress symptoms, and Latino depression: A moderated mediational model. J Couns Psychol 2015; 62(3):393-401.
  • 49
    Goldberg D. The detection of psychiatric illness by questionnaire Londres: Oxford University Press; 1972.
  • 50
    Gouveia VV, Lima TJ, Gouveia RS, Freires LA, Barbosa LH. Questionário de Saúde Geral (QSG-12): o efeito de itens negativos em sua estrutura fatorial. Cad Saúde Pública 2012; 28(2):375-384.
  • 51
    Wachelke JF. Identificação com o grupo: adaptação e validação de uma medida geral para o contexto brasileiro. Psicol Saber Soc 2013; 1(2):187-200.
  • 52
    Hutz CS, Zanon C. Revisão da adaptação, validação e normatização da escala de autoestima de Rosenberg. Avaliação Psicológica 2011; 10(1):41-49.
  • 53
    Hayes AF. Introduction to mediation, moderation, and conditional process analysis: A regression-based approach Nova York: Guilford Publication; 2017.
  • 54
    Sobel ME. Some new results on indirect effects and their standard errors in covariance structure models. Am Psychol Assoc 1986; 16:159-186.
  • 55
    Souza LA, Torres AR, Barbosa GA, Lima TJ, Souza LE. Subjective Well-Being and Burnout in Military Cadets: the mediating role of self-efficacy. Psicol Reflex Crít 2015; 28(4):744-752.
  • 56
    MacKinnon DP, Lockwood CM, Williams J. Confidence limits for the indirect effect: Distribution of the product and resampling methods. Multivariate Behav Res 2004; 39(1):99-128.
  • 57
    Kahn KB, Lee JK, Renauer B, Henning KR, Stewart G. The effects of perceived phenotypic racial stereotypicality and social identity threat on racial minorities’ attitudes about police. J Soc Psychol 2017; 157(4):416-428.
  • 58
    Major B, Gramzow RH, McCoy SK, Levin S, Schmader T, Sidanius J. Perceiving personal discrimination: the role of group status and legitimizing ideology. J Pers Soc Psychol 2002; 82(3):269-282.
  • 59
    Ahmed AT, Mohammed SA, Williams DR. Racial discrimination & health: Pathways & evidence. Indian J Med Res 2007; 126(4):318-327.

Publication Dates

  • Publication in this collection
    08 July 2020
  • Date of issue
    July 2020

History

  • Received
    24 July 2018
  • Accepted
    05 Nov 2018
  • Published
    07 Nov 2018
ABRASCO - Associação Brasileira de Saúde Coletiva Rio de Janeiro - RJ - Brazil
E-mail: revscol@fiocruz.br