Ways to explain bullying: dimensional analysis of the conceptions held by adolescents

Wanderlei Abadio de Oliveira Jorge Luiz da Silva Iara Falleiros Braga Claudio Romualdo Simona Carla Silvia Caravita Marta Angélica Iossi Silva About the authors

Abstract

This study unveils the meaning attributed by students to bullying and contributes to the approach of student health. The objective was to identify the dimensions of the conceptions of students regarding bullying. A total of 55 students from 11 public schools participated by answering semi-structured interviews. Dimensional analysis was used to treat data and a matrix was constructed with the dimensions identified. The Grounded Theory was adopted as the methodological and theoretical framework. The adolescents were aware of the main dimensions of bullying but explained it descriptively and from individual perspectives. The following dimensions were identified: type, nature, examples, motivation and consequences. The type of violence was a dimension with greater explanatory power in relation to the remaining dimensions. Verbal violence and its different manifestations stood out. Aspects of the literature that define bullying were identified, indicating how the topic is diffused, its occurrence and how it is understood by students. The innovative nature of this study is its focus on the identification of the dimensions of bullying present in the narrative of Brazilian students. It is an approach that contributes to the organization of healthcare programs and interventions in different fields.

School health; Violence; Bullying; Adolescent health; Qualitative research

Introduction

Bullying is understood as a problem in the peer relations characterized by the imbalance of power between the parties, by the intentionality and repetitiveness of aggressive acts11. Olweus D. School Bullying: Development and some important challenges. Annu. Rev. Clin Psychol 2013; 9:751-780.. It can also be examined in relation to the type of aggression - physical, verbal or psychological – as well as the nature of its manifestations, regarding the behaviors, actions and methods adopted in the aggressions, such as hitting or name-calling, for example22. Schultz NCW, Duque DF, Silva CF, Souza CD, Assini LC, Carneiro MGM. A compreensão sistêmica do bullying. Psicol. estud. 2012; 17(2):247-254.,33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.. Conceptually, bullying has been defined in most studies from the perspective of adults or researchers.

In Brazil this phenomenon is a reality for many students. The cross-national research project School Health Survey (PeNSE) conducted in 2012 with a sample of 109,104 students from throughout the country showed that 20.8% of the participants practiced some type of bullying, and the victims totaled 7.2%44. Malta DC, Porto DL, Crespo CD, Silva MMA, Andrade SSC, Mello FCM, Monteiro R, Silva MA. Bullying in Brazilian school children: analysis of the National Adolescent School-based Health Survey (PeNSE 2012). Rev. bras. epidemiol. 2014; 17(Supl. 1):92-105.. Compared with data from the first version of the study developed in 2009, the authors indicated that the historical series points to an increase in reports of bullying among Brazilian students in recent years. In 2009, the percentage of students who reported having suffered bullying was 5.4%44. Malta DC, Porto DL, Crespo CD, Silva MMA, Andrade SSC, Mello FCM, Monteiro R, Silva MA. Bullying in Brazilian school children: analysis of the National Adolescent School-based Health Survey (PeNSE 2012). Rev. bras. epidemiol. 2014; 17(Supl. 1):92-105.,55. Malta DC, Silva MAI, Mello FCM, Monteiro RA, Sardinha LMV, Crespo C, Carvalho MGO, Silva MMA, Porto DL. Bullying nas escolas brasileiras: resultados da Pesquisa Nacional de Saúde do Escolar (PeNSE), 2009. Cien Saude Colet 2010; 15(Supl. 2):3065-3076..

All those involved in the episodes of bullying, whether as bully only, bullied only, both bully and bullied coincidentally (students who suffer but also practice bullying), or witnesses suffer the psychological and social consequences of the phenomenon throughout human development22. Schultz NCW, Duque DF, Silva CF, Souza CD, Assini LC, Carneiro MGM. A compreensão sistêmica do bullying. Psicol. estud. 2012; 17(2):247-254.,33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.. Research has shown that school-age children and adolescents who suffer or witness bullying are more likely to develop mental suffering and psychosocial problems33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,66. Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psico 2014; 45(2):147-156.. In turn, aggressors may get involved in situations of violence or infractions66. Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psico 2014; 45(2):147-156.,77. Zaine I, Reis MJD, Padovani RC. Comportamentos de bullying e conflito com a lei. Estud. psicol. (Campinas) 2010; 27(3):375-382.. These data on the high prevalence of the phenomenon in different cultures and its characteristics demonstrate that the bullying is a problem of public health concern88. Silva MAI, Silva JL, Pereira BO, Oliveira WA, Medeiros M. The view of teachers on bullying and implications for nursing. Rev. esc. enferm. USP 2014; 48(4):723-730.

9. Minayo MCS. Violência e educação: impactos e tendências. Revista Pedagógica 2013; 15(31):249-264.
-1010. Brasil. Ministério da Saúde (MS). Linha de cuidado para a atenção integral à saúde de crianças, adolescentes e suas famílias em situação de violência. Brasília: MS; 2010..

This type of violence at school is the result of different social determinants. Studies have consistently indicated factors that may be related to bullying, and explain it. Family interactions and climate1111. Zottis GA, Salum GA, Isolan LR, Manfro GG, Heldt E. Associations between child disciplinary practices and bullying behavior in adolescents. J Pediatr 2014; 90(4):408-414.,1212. Malta DC, Prado RR, Dias AJR, Mello FCM, Silva MAI, Costa MR, Caiaffa WT. Bullying and associated factors among Brazilian adolescents: analysis of the National Adolescent School-based Health Survey (PeNSE 2012). Rev. bras. epidemiol. 2014; 17(Supl. 1):131-145., issues of moral engagement 1313. Caravita SCS, Gini G, Pozzoli T. Main and Moderated Effects of Moral Cognition and Status on Bullying and Defending. Aggressive Behavior. 2012; 38(6):456-468.,1414. Thornberg R, Thornberg UB, Alamaa R, Daud N. Children’s conceptions of bullying and repeated conventional transgressions: moral, conventional, structuring and personal-choice reasoning. Educational Psychology 2014; 36(1):1-17., socioeconomic conditions1515. Lien L, Welander-Vatn A. Factors Associated with the Persistence of Bullying Victimization From 10th grade to 13th Grade: A Longitudinal Study. Clin Pract Epidemiol Ment Health 2013; 9:243-250., health risk behaviors1212. Malta DC, Prado RR, Dias AJR, Mello FCM, Silva MAI, Costa MR, Caiaffa WT. Bullying and associated factors among Brazilian adolescents: analysis of the National Adolescent School-based Health Survey (PeNSE 2012). Rev. bras. epidemiol. 2014; 17(Supl. 1):131-145., and characteristics of group relations1616. Salmivalli C. Participant Roles in Bullying: How Can Peer Bystanders Be Utilized in Interventions? Theory Into Practice 2014; 53(4):286-292. are some of the aspects associated with the phenomenon.

The literature also shows that bullying is a multidimensional, complex and dynamic experience whose dimensions are difficult to grasp22. Schultz NCW, Duque DF, Silva CF, Souza CD, Assini LC, Carneiro MGM. A compreensão sistêmica do bullying. Psicol. estud. 2012; 17(2):247-254.,1717. Araújo LS, Coutinho MPL, Miranda RS, Saraiva ERA. Universo consensual de adolescentes acerca da violência escolar. Psico-USF 2012; 17(2):243-251.. In this sense, prevention and intervention programs should consider the symbolic and conceptual value that bullying has in the view of students33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,1818. Salgado FS, Senra LX, Lourenço LM. Effectiveness indicators of bullying intervention programs: A systematic review of the international literature. Estud. psicol. (Campinas) 2014; 31(2):179-190.,1919. Mendes CS. Prevenção da violência escolar: avaliação de um programa de intervenção. Rev. esc. enferm. USP 2011; 45(3):581-588.. This level of approach requires the operationalization of qualitative studies that offer diverse options to identify variables that are significant for the phenomenon, such as motivations, causes, implicit situations such as social exclusion, prejudice and fear, as well as specific aspects of group relationships among students that are less visible in large-scale investigations. Furthermore, an additional and contextual contribution of studies in this perspective is the discovery of specificities of the forms and conceptualizations of bullying in Brazil based on the students’ own understanding, and not only on the definitions and assumptions of literature.

For example, a qualitative study focusing on the social representations that adolescents have of school violence revealed the typical manifestations of the phenomenon and its psychosocial impacts on those involved1717. Araújo LS, Coutinho MPL, Miranda RS, Saraiva ERA. Universo consensual de adolescentes acerca da violência escolar. Psico-USF 2012; 17(2):243-251.. In the view of the participants of this study, bullying is a multifaceted phenomenon and expression of different types of violence in the school environment1717. Araújo LS, Coutinho MPL, Miranda RS, Saraiva ERA. Universo consensual de adolescentes acerca da violência escolar. Psico-USF 2012; 17(2):243-251.. Another research with qualitative design conducted with adolescents revealed that bullying is, first of all, a phenomenon discursively organized and related to different social contexts, including the family cotext2020. Bibou-Nakou I, Tsiantis J, Assimopoulos H, Chatzilambou P. Bullying/victimization from a family perspective: a qualitative study of secondary school students’ views. European Journal of Psychology of Education 2013; 28(1):53-71..

This type of approach broadens the view of the phenomenon. However, the focus of most studies emphasizes other facets of the phenomenon, such as prevalence2121. Rech RR, Halpern R, Tedesco A, Santos DF. Prevalence and characteristics of victims and perpetrators of bullying. J Pediatr 2013; 89(2):164-170. and related factors2222. Cassiani-Miranda CA, Gómez-Alhach J, Cubides-Munévar AM, Hernández-Carrillo M. Prevalencia de bullying y factores relacionados en estudiantes de bachillerato de una institución educativa de Cali, Colombia, 2011. Revista de Salud Pública 2014; 16(1):13-24., or from the perspective of other protagonists of the school context66. Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psico 2014; 45(2):147-156.,88. Silva MAI, Silva JL, Pereira BO, Oliveira WA, Medeiros M. The view of teachers on bullying and implications for nursing. Rev. esc. enferm. USP 2014; 48(4):723-730.. Little attention is paid to the narrative elements of students about bullying33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,2020. Bibou-Nakou I, Tsiantis J, Assimopoulos H, Chatzilambou P. Bullying/victimization from a family perspective: a qualitative study of secondary school students’ views. European Journal of Psychology of Education 2013; 28(1):53-71..

Thus, the proposed dimensional analysis allows the construction or reconstruction of knowledge about a given social phenomenon, with the purpose of explaining and understanding it from the concrete problem and its protagonists. It is a way of understanding processes and foreseeing how to intervene considering their different dimensions2323. Wuest J. Grounded theory: the method. In: Munhall PL, editor. Nursing research: a qualitative perspective. Sudbury: Jones & Bartlett Learning; 2010. p. 239-271. A dimension is a descriptive and decomposed concept of the object under analysis that interacts with other dimensions, revealing the context and the strongest elements used by a group to explain a given phenomenon2424. Leite JL, Silva LJ, Oliveira RMP, Stipp MAC. Reflexões sobre o pesquisador nas trilhas da Teoria Fundamentada nos Dados. Rev. esc. enferm. USP 2012; 46(3):772-777.. Therefore, this work adopted the Grounded Theory as a methodological and theoretical reference based on a constructivist stance33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,2323. Wuest J. Grounded theory: the method. In: Munhall PL, editor. Nursing research: a qualitative perspective. Sudbury: Jones & Bartlett Learning; 2010. p. 239-271,2424. Leite JL, Silva LJ, Oliveira RMP, Stipp MAC. Reflexões sobre o pesquisador nas trilhas da Teoria Fundamentada nos Dados. Rev. esc. enferm. USP 2012; 46(3):772-777.. This constructivist stance assumes the preservation of the social complexity of the phenomena analyzed during the research process, encouraging the development of new understandings and theoretical interpretations33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,2323. Wuest J. Grounded theory: the method. In: Munhall PL, editor. Nursing research: a qualitative perspective. Sudbury: Jones & Bartlett Learning; 2010. p. 239-271,2424. Leite JL, Silva LJ, Oliveira RMP, Stipp MAC. Reflexões sobre o pesquisador nas trilhas da Teoria Fundamentada nos Dados. Rev. esc. enferm. USP 2012; 46(3):772-777..

In this sense, this study seeks the identification of factors that compose or justify bullying among students, being an important starting point for care actions in different areas such as education and health. The objective was to know the conceptual dimensions of bullying in the view of students of a Brazilian city, offering an interpretative representation of the phenomenon studied.

Method

Participants

This study presents qualitative elements of a research with a mixed design. All students from 11 schools (N = 2,354), from the 6th grade of elementary school through the 3rd grade of high school, who were present at the dates of data collection in 2014, answered scales on involvement in situations of bullying (Victimization and Peer Aggression Scale - VPAS)2525. Cunha JM, Weber LND, Steiner Neto P. Escala de Vitimização e Agressão entre Pares (EVAP). In: Weber LND, Dessen MA, organizadores. Pesquisando a família - instrumentos para coleta e análise de dados. Curitiba: Juruá; 2009. p. 103-114. and quality of family interactions (Family Interaction Quality Scale - FIQS)2626. Weber LND, Salvador APV, Brandenburg OJ. Escalas de Qualidade na Interação Familiar. In: Weber LND, Dessen MA, organizadores. Pesquisando a família - instrumentos para coleta e análise de dados. Curitiba: Juruá; 2009. p. 61-72.. The VPAS comprises 18 statements describing specific aggressive behaviors that may occur in the school and allows the identification of bullies and bullied2525. Cunha JM, Weber LND, Steiner Neto P. Escala de Vitimização e Agressão entre Pares (EVAP). In: Weber LND, Dessen MA, organizadores. Pesquisando a família - instrumentos para coleta e análise de dados. Curitiba: Juruá; 2009. p. 103-114.. The FIQS is composed of 40 questions and allows the evaluation of nine dimensions of family interaction (involvement, rules and monitoring, positive communication, negative communication, positive conjugal climate, negative conjugal climate, parental model, corporal punishment, and children’s feelings) through the children’s report2626. Weber LND, Salvador APV, Brandenburg OJ. Escalas de Qualidade na Interação Familiar. In: Weber LND, Dessen MA, organizadores. Pesquisando a família - instrumentos para coleta e análise de dados. Curitiba: Juruá; 2009. p. 61-72.. Students were randomly selected from the sampling universe (N) of respondents of these scales to participate in the qualitative stage of the research (n = 55), from which the present analysis takes place. All the students who were randomly chosen accepted to participate in the study.

At this stage, the selection of participants was guided by the sampling strategy of maximum variation2323. Wuest J. Grounded theory: the method. In: Munhall PL, editor. Nursing research: a qualitative perspective. Sudbury: Jones & Bartlett Learning; 2010. p. 239-271, which allows the documentation of the greatest possible amount of information, number of experiences, dimensions and properties of the investigated phenomenon and context. This strategy allowed the definition of the total number of participants necessary to guarantee a good representativeness of the sampling universe (N). Thus, 55 students (54.5% boys, mean age M = 15 years, SD = 2 years - standard deviation) were randomly selected from 11 public and urban schools of a medium-sized municipality in the countryside of the state of Minas Gerais. The selection of students obeyed the following inclusion criteria: being enrolled in one of the chosen schools, regularly attending classes, having answered the other two scales in the study, and being present in the class on the day of data collection. In order to protect the identity of the participants, they will henceforth be identified by a code composed of the letter A followed by a number assigned to each adolescent, and by the letter S followed by a number corresponding to the school of origin (Adolescent 1, School 1 = A1S1; Adolescent 2, School 1 = A2S1, and so on).

Data collection

Data collection took place in 2014 through individual and script-guided semi-structured interviews. Examples of questions: What is bullying in your opinion? Have you ever been threatened, humiliated, excluded or beaten in school? What did they do to you? Have you ever threatened, mistreated, humiliated, excluded, or beaten another classmate in school? What did you do? Have you ever witnessed any of your colleagues being threatened, mistreated, humiliated, excluded or beaten at school? What did you do? Follow-up questions were also used (How so? Could you tell me more about it? What do you mean? Could you give me examples?) to clarify or illustrate and deepen the answers. The mean time of each interview was 12 minutes, ranging from 6 to 26 minutes. All interviews were conducted in the students’ schools, in private rooms, without the presence of teachers or other students. The interviews were recorded and transcribed verbatim.

Data Analysis

Data analysis was performed according to the dimensional analysis method, which includes three main steps: sizing, differentiating and integrating of elements33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,2424. Leite JL, Silva LJ, Oliveira RMP, Stipp MAC. Reflexões sobre o pesquisador nas trilhas da Teoria Fundamentada nos Dados. Rev. esc. enferm. USP 2012; 46(3):772-777.. The first step of this method consists in a codification by means of the selection of words, phrases or accounts that indicate outstanding dimensions in the transcribed texts and its main themes. This design allows the creation of synopses describing the signification attributed by the participants to the social phenomenon. The analytical questions that guided this moment of the study were: What information is present in the data? How do participants explain bullying? What do the data convey? Then, general and divergent concepts in the narratives were explored and compared, and finally, aspects of the literature were integrated to interpret and indicate the dimensions with greater explanatory power for the study group or its alternative perspectives33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,2424. Leite JL, Silva LJ, Oliveira RMP, Stipp MAC. Reflexões sobre o pesquisador nas trilhas da Teoria Fundamentada nos Dados. Rev. esc. enferm. USP 2012; 46(3):772-777.. A matrix with the identified dimensions was created on the basis of this picture.

Ethical issues

Ethical precepts were observed in all phases of the study, as well as the guidelines of Resolution 466/20122727. Brasil. Resolução Nº 466, de 12 de dezembro de 2012. Brasília: CNS, 2013.. The research project was submitted and approved by a research ethics committee.

Results

Most of the study participants reported involvement in bullying only as witnesses or observers (44%, n = 24). Victims accounted for 29% (n = 16) of the participants, and the aggressor victims for 5% (n = 3). Only 9% of the participants declared themselves to be aggressors (n = 5), corresponding to three boys and two girls. Bullied only (n = 10), bullies and bullied (n = 4), and bullies only (n = 4) also reported having witnessed bullying at school. On the other hand, 13% of the students (n = 7) did not report any type of involvement in bullying situations. The experiences of the participants performing these roles are exemplified in Chart 1 through excerpts from the interviews.

Chart 1
Excerpts of interviews according to the type of involvement in bullying situations. Ribeirão Preto, 2015.

In cases of bullying, many of the students reported not intervening in the situation to avoid being attacked either as they did not see possibilities for solving the problem, because they were alone, did not know the victims, or because the victims had characteristics that, in their opinion, justified the aggressions. Students who have adopted some behavior of intervening to defend the bullied did so by putting themselves in the other’s shoes because they found the use of violence to be wrong, or because they were colleagues of the victims or because they had cases in the family of people who had suffered prejudice or discrimination.

In the narratives of the adolescents, violence is recognized as suffering from different sorts, but verbal aggression stands out, with a predominance of pejorative names and offenses over the victim’s characteristics. Psychological violence is manifested in situations of shunning from the peer group, threats of aggression, and in the establishment of fear as a strong element of social relations. No situations of theft of peer belongings or sexual assaults were mentioned.

From the perspective of the bullies, physical violence and the intentional character of the aggressions were more explicit. In addition, aspects such as satisfaction in causing pain and suffering to the victim were mentioned without there being an apparent justification or motivation. Aspects related to the imbalance of power between the parties in bullying situations were also identified.

The analysis of the dimensions related to bullying in the narratives of the adolescents revealed that the type of violence is the central perspective to define and explain the phenomenon in relation to the other dimensions identified (Figure 1). All other verified dimensions were listed in the matrix with respective nature (how they describe bullying - offering it as a response a behavior, an action or a method adopted in the aggressions), examples, motivation and consequences.

Figure 1
Matrix of the dimensions of conceptions of bullying among students. Ribeirão Preto, 2015.

As it was observed, violence type was the dimension with the greatest explanatory power for bullying among participants, with emphasis on verbal violence, followed by psychological and physical violence. The nature or expression of aggressions - direct or indirect - as well as the examples provided by the adolescents were the most outstanding dimensions and the ones closer to the central perspective. Chart 2 presents examples of excerpts from the interviews related to the identified conceptual dimensions.

Chart 2
Excerpts of the interviews that exemplify the conceptual dimensions identified in the study. Ribeirão Preto, 2015.

Bullying is mainly defined as verbal aggression. In the narratives, name-calling, imposition of pejorative names, and verbal abuses were the strongest conceptions quoted to explain the phenomenon. This is a direct manifestation of bullying in everyday school life; however, indirect forms such as shunning and oppression were also identified. It is notable that episodes of physical aggression were little mentioned, summarized to the act of “hitting”, for example. In this context, there is also an extension of the concept when adolescents explicitly refer to situations of prejudice and discrimination.

Different justifications were found in the dimension related to the motivations for the practice of bullying as attributed by the students, regardless of the role played. In short, envy, intolerance to diversity, subjective issues of aggressors, characteristics of the victims that differ from the peer group, as well as the desire to cause suffering to the victim are some possible motivations for the acts of bullying. The actions and the way the interactions occur seem to be driven by these specific conditions.

As a result of this process and its dimensions, the consequences of bullying for those involved is an approach that can also guide actions and intervention programs. In this sense, it is observed that the consequences and impacts of bullying in the view of students are well defined and relate to feelings of impotence, dissatisfaction, fear and low self-esteem.

Discussion

One objective of this study was to know the narratives of adolescents about experiences and situations of bullying in order to access the conceptual dimensions of this social phenomenon from the point of view of students themselves. This perspective favored the emergence of subjective and spontaneous answers about the complexity that surrounds bullying from the perspective of the students and that can help researchers and educators to broaden their conceptualization. First, students involved in episodes of the phenomenon and those who did not report any type of participation were represented. In this topic, we highlight the high number of students who had already witnessed some sort of bullying and the prevalence of verbal aggression in the definition of the phenomenon. Subsequently, the dimensional analysis was used to identify the dimensions and significations of bullying in the students’ narratives. The dimension that typifies violence was the most used to explain the phenomenon.

A first finding of the study is that bullying is a phenomenon that encompasses other actors and not only the aggressor/victim dyad1616. Salmivalli C. Participant Roles in Bullying: How Can Peer Bystanders Be Utilized in Interventions? Theory Into Practice 2014; 53(4):286-292.. Witnesses are important characters in violence episodes, as they may assume behaviors to defend the victims, as well as to become an accomplice or reinforce the aggressors’ behavior1616. Salmivalli C. Participant Roles in Bullying: How Can Peer Bystanders Be Utilized in Interventions? Theory Into Practice 2014; 53(4):286-292.,2828. Thornberg R, Tenenbaum L, Varjas K, Meyers J, Jungert T, Vanegas G. Bystander motivation in bullying incidents: to intervene or not to intervene? Western Journal of Emergency Medicine 2012; 13(3):247-252.. Students with this type of involvement in situations of bullying tend to act in defense of the victim based on previous personal experiences as victims, solidarity or observation to rules of coexistence. However, the peer group exerts a strong influence in this segment, being determinant for the actions of defense or apathy in the face of situations of violence1616. Salmivalli C. Participant Roles in Bullying: How Can Peer Bystanders Be Utilized in Interventions? Theory Into Practice 2014; 53(4):286-292.,2828. Thornberg R, Tenenbaum L, Varjas K, Meyers J, Jungert T, Vanegas G. Bystander motivation in bullying incidents: to intervene or not to intervene? Western Journal of Emergency Medicine 2012; 13(3):247-252..

In the case of victims, there was a prevalence of reports of verbal violence. This can be explained by the stage of development of the participants; aggressions tend to be more veiled or difficult to identify during the adolescence22. Schultz NCW, Duque DF, Silva CF, Souza CD, Assini LC, Carneiro MGM. A compreensão sistêmica do bullying. Psicol. estud. 2012; 17(2):247-254.,1414. Thornberg R, Thornberg UB, Alamaa R, Daud N. Children’s conceptions of bullying and repeated conventional transgressions: moral, conventional, structuring and personal-choice reasoning. Educational Psychology 2014; 36(1):1-17.. In this case, verbal violence, which is also a direct manifestation, is confused with games typical of the age66. Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psico 2014; 45(2):147-156.,2929. Santos JA, Cabral-Xavier AF, Paiva SM, Leite-Cavalcanti A. Prevalência e Tipos de Bullying em Escolares Brasileiros de 13 a 17 anos. Revista de Salud Pública 2014; 16(2):173-183.. However, as the participants report, the severity of this type of bullying is as intense as physical aggression, also causing harm to the victim, as other studies have indicated33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,2121. Rech RR, Halpern R, Tedesco A, Santos DF. Prevalence and characteristics of victims and perpetrators of bullying. J Pediatr 2013; 89(2):164-170..

On the other hand, physical aggression was emphasized by bullies, suggesting that verbal forms of violence are not seen as bullying3030. Esteve CEA, Arruda ALMM. Bullying: quando a brincadeira fica seria, causas e consequências. Revista Eletrônica Saberes da Educação 2014; 5(1):1-36.. In this group, content that the literature presents as essential for conceptualizing bullying, related to the intentionality of actions and the symbolic imbalance of power among peers11. Olweus D. School Bullying: Development and some important challenges. Annu. Rev. Clin Psychol 2013; 9:751-780., was also mentioned. These understandings are consistent with the view of bullying, linked to reasons regarding the positions of dominance adopted by the bullies among their peers. The notion of intentionality, either manifested or latent, refers to the aggressor’s conscious desire to practice a certain behavior that is recognized as morally and socially wrong.

Repeatability of the actions, another aspect used in the literature to define and characterize bullying, however, appeared explicitly in only one account. Meanwhile, a recent survey on the development of research and approach on the phenomenon clarified that the criterion of repetition may not be absolutely necessary to characterize bullying11. Olweus D. School Bullying: Development and some important challenges. Annu. Rev. Clin Psychol 2013; 9:751-780.. Moreover, it is worth highlighting that the qualitative perspective adopted in the present article is characterized by seeking to understand what students conceive and how they explain bullying. It is an approach that provides us the “look” of the participants regarding this form of violence and not the search for confirmation or refutation of literature, as a rule. In this sense, for a student, a single experience of violence can be as remarkable, or even more remarkable, than repeated episodes. This is a fact that the student may qualify as bullying and is currently considered valid by specialized literature11. Olweus D. School Bullying: Development and some important challenges. Annu. Rev. Clin Psychol 2013; 9:751-780.. It should be pointed out, however, that even considering these questions, the follow-up questions used during interviews allowed us to exclude occasional violence or other situations that were not characterized as bullying. This control allowed only bullying situations to be included and analyzed in the study.

On the whole, the results revealed a convergence in the way bullying is explained by students and the literature, contemplating the proposed criteria to characterize it11. Olweus D. School Bullying: Development and some important challenges. Annu. Rev. Clin Psychol 2013; 9:751-780.. In addition, regarding the conceptual dimension with greater explanatory power for bullying, among the participants, it was noticed that this refers to the more widespread concept of the phenomenon: bullying is a type of violence. From the social point of view, it is exclusively a type of violence related to the decision-making processes of the aggressors and the characteristics of the victim11. Olweus D. School Bullying: Development and some important challenges. Annu. Rev. Clin Psychol 2013; 9:751-780.,66. Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psico 2014; 45(2):147-156.. The multiple factors and their different levels of manifestation are measured from this widely diffused definition11. Olweus D. School Bullying: Development and some important challenges. Annu. Rev. Clin Psychol 2013; 9:751-780.,1616. Salmivalli C. Participant Roles in Bullying: How Can Peer Bystanders Be Utilized in Interventions? Theory Into Practice 2014; 53(4):286-292.,1919. Mendes CS. Prevenção da violência escolar: avaliação de um programa de intervenção. Rev. esc. enferm. USP 2011; 45(3):581-588..

However, this dimension of conception alone does not reflect the complexity of bullying. For example, the understanding of the phenomenon may be circumscribed to it, ignoring other issues inherent to the phenomenon, as its causes and consequences. Moreover, this typification of episodes of violence is more associated with individual aspects that often reject contextual variables22. Schultz NCW, Duque DF, Silva CF, Souza CD, Assini LC, Carneiro MGM. A compreensão sistêmica do bullying. Psicol. estud. 2012; 17(2):247-254.,66. Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psico 2014; 45(2):147-156.. In this perspective, the construction of a culture of non-violence is associated with a broad understanding of the phenomenon. Previous studies have suggested that the level of perception, knowledge and beliefs about bullying among school-age youth, teachers and the school community significantly affect the prevalence rates of the phenomenon33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,88. Silva MAI, Silva JL, Pereira BO, Oliveira WA, Medeiros M. The view of teachers on bullying and implications for nursing. Rev. esc. enferm. USP 2014; 48(4):723-730.,1818. Salgado FS, Senra LX, Lourenço LM. Effectiveness indicators of bullying intervention programs: A systematic review of the international literature. Estud. psicol. (Campinas) 2014; 31(2):179-190.,1919. Mendes CS. Prevenção da violência escolar: avaliação de um programa de intervenção. Rev. esc. enferm. USP 2011; 45(3):581-588..

In the same direction, the dimensions that are most related to the central perspective, related to the manifestations of the phenomenon and exemplifications, reflect the real experience of the daily life, or are hypothesized as the best resource to explain how adolescents interpret bullying. This dimension of the direct or indirect nature of the aggressions explicitly indicates how a bullying situation can be recognized, meanwhile tends to reflect a common confusion between jokes and violence. On the other hand, the few mentions of physical aggression indicate that this type of behavior is not, in general, directly related to bullying1717. Araújo LS, Coutinho MPL, Miranda RS, Saraiva ERA. Universo consensual de adolescentes acerca da violência escolar. Psico-USF 2012; 17(2):243-251.,3030. Esteve CEA, Arruda ALMM. Bullying: quando a brincadeira fica seria, causas e consequências. Revista Eletrônica Saberes da Educação 2014; 5(1):1-36.. These results reveal the process of naturalization of violence in schools, which is considered as a form of game, as well as the importance of raising awareness among students and the school community about the problem3131. Bandeira CM, Hutz CS. Bullying: prevalência, implicações e diferenças entre os gêneros. Psicol. esc. educ 2012; 16(1):35-44..

At the same time, depending on the nature, acts of violence may indicate that there will be some kind of intervention. For example, as there is a frequent mention of verbal expressions of violence, thus counseling and professional help are used to counteract the situations or help the victims66. Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psico 2014; 45(2):147-156.,2828. Thornberg R, Tenenbaum L, Varjas K, Meyers J, Jungert T, Vanegas G. Bystander motivation in bullying incidents: to intervene or not to intervene? Western Journal of Emergency Medicine 2012; 13(3):247-252..

In the data set also revealed a tendency to expand the concept of bullying insofar as the adolescents express their concerns with tolerance to inequality and against different forms of discrimination. This positivity has its foundation in the incorporation of broad aspects such as the recognition of human rights and the promotion of diversity as themes related to violence. This is true specifically in the case of macro-structural plots present in the different manifestations of violence in society and which are responsible for high morbidity and mortality rates and interfere in the quality of life of children and adolescents, in the case of violence experienced in the school environment99. Minayo MCS. Violência e educação: impactos e tendências. Revista Pedagógica 2013; 15(31):249-264..

Regarding the motivations that lead to bullying, the participants indicated that the aggressors present personal reasons to act aggressively or act according to the characteristics of the victims, considered negative. This approach indicates the emotional use of force as an interactive resource between peers33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,3232. Oliveira WA, Silva MAI, Mello FCM, Porto DL, Yoshinaga ACM, Malta DC. Causas do bullying: resultados da Pesquisa Nacional de Saúde do Escolar. Rev. Latino-Am Enfermagem 2015; 23(2):1-8.. Bullying has also been identified as a matter of morality, insofar as it involves the intention to cause harm to others and justifications based on the characteristics of the victims, for example1313. Caravita SCS, Gini G, Pozzoli T. Main and Moderated Effects of Moral Cognition and Status on Bullying and Defending. Aggressive Behavior. 2012; 38(6):456-468.. These justifications indicate components of the passivity of the bullied, as blamed for the aggressions by having their characteristics, and not actively, when victimized by being unpleasant, unfriendly or bad with colleagues1313. Caravita SCS, Gini G, Pozzoli T. Main and Moderated Effects of Moral Cognition and Status on Bullying and Defending. Aggressive Behavior. 2012; 38(6):456-468..

It is important to note that the participants identified individual factors as reasons for victimization, such as physical or sexual characteristics that are different or deviant from social standards. Being ugly, fat, wearing strange clothes, having an ethnic origin, or sexual orientation different from hegemonic patterns were some of the factors mentioned. What these factors seem to have in common is that they are psychosocial processes and are poorly addressed in intervention programs33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,2626. Weber LND, Salvador APV, Brandenburg OJ. Escalas de Qualidade na Interação Familiar. In: Weber LND, Dessen MA, organizadores. Pesquisando a família - instrumentos para coleta e análise de dados. Curitiba: Juruá; 2009. p. 61-72.,3131. Bandeira CM, Hutz CS. Bullying: prevalência, implicações e diferenças entre os gêneros. Psicol. esc. educ 2012; 16(1):35-44.. In this sense, by offering a broader approach to the concept of bullying, with aspects of valorization of human rights and tolerance of differences, one can think of actions aimed at the development of assertive behaviors or social skills necessary to make friends, and accept and be accepted by the peer group, for example33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,99. Minayo MCS. Violência e educação: impactos e tendências. Revista Pedagógica 2013; 15(31):249-264.,1919. Mendes CS. Prevenção da violência escolar: avaliação de um programa de intervenção. Rev. esc. enferm. USP 2011; 45(3):581-588..

As for the real impact of bullying, research33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,66. Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psico 2014; 45(2):147-156.,77. Zaine I, Reis MJD, Padovani RC. Comportamentos de bullying e conflito com a lei. Estud. psicol. (Campinas) 2010; 27(3):375-382.,1414. Thornberg R, Thornberg UB, Alamaa R, Daud N. Children’s conceptions of bullying and repeated conventional transgressions: moral, conventional, structuring and personal-choice reasoning. Educational Psychology 2014; 36(1):1-17. has indicated that bullying is a problem that affects the whole school community. Aggressors can be repeatedly rejected by the peer group and are at greater risk to develop behavioral problems during adolescence and maladjustment in adulthood. As demonstrated in this study, victims may have problems to relate with others, and internalize problems related to anxiety, depression and low self-esteem. Likewise, problems in the teaching-learning process, failure and school drop-out are other consequences of the processes of violent peer relationships.

In this sense, the narratives of the youth provided some important insights on the issues that must be taken into account while planning intervention programs and confronting bullying. The multidimensionality and complexity explain the importance of intersectoral strategies capable of improving individual social interaction skills, the adoption of healthy living habits, means of solving conflicts, and the approach to human rights and anti-prejudice content.

Strategies aimed at good social interaction and encouragement to friend-making, solidarity, inclusion and social acceptance can be included in the classroom, as well as clarifications about the different forms that the phenomenon can assume in everyday life, as for example, verbal or indirect violence. This would open channels for the topic to be considered and to the situations of violence to be reported to adults66. Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psico 2014; 45(2):147-156.. In another direction, as a social problem, the resolution of the matter requires an approach to socially diffused values and moral issues. Creating positive climates in the schools and fighting violent acts and behaviors could counteract the culture of violence33. Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.,1313. Caravita SCS, Gini G, Pozzoli T. Main and Moderated Effects of Moral Cognition and Status on Bullying and Defending. Aggressive Behavior. 2012; 38(6):456-468.. In practical terms, schools should establish rules against bullying, enable staff to detect and deal with bullying during intervals, and offer playful activities (games, structured activities, drama techniques, etc.) for these moments, to mediate conflicts between students.

In the area of school health, one can think of actions focused on health promotion and education with cross-sectional themes (violence, conflict resolution, and tolerance to diversity, for example)88. Silva MAI, Silva JL, Pereira BO, Oliveira WA, Medeiros M. The view of teachers on bullying and implications for nursing. Rev. esc. enferm. USP 2014; 48(4):723-730.,1919. Mendes CS. Prevenção da violência escolar: avaliação de um programa de intervenção. Rev. esc. enferm. USP 2011; 45(3):581-588.. Furthermore, in Brazil, the “Care Line for comprehensive health care for children, adolescents and their families in situations of violence” of the Ministry of Health advices the performance of primary health care teams in schools. This work should be aimed at identifying the problem, i.e. risk behaviors and symptoms (hematomas, bruises and scratches without reason or convincing explanation, constant sadness, loss of appetite, irritability, headaches, stomach ache, and constant appearance of canker sores, among others), counseling families, and contributing to the implementation of intervention and prevention programs to combat bullying1010. Brasil. Ministério da Saúde (MS). Linha de cuidado para a atenção integral à saúde de crianças, adolescentes e suas famílias em situação de violência. Brasília: MS; 2010.. In this sense, health teams can, for example, propose informative actions in schools to explain what bullying and its consequences are, besides helping to include families in the recognition and coping of the issue through home visits.

Finally, there were a small number of students without any involvement with bullying. This data points two urgent aspects. First, it indicates that violence has become naturalized and incorporated into the daily lives of school-age youth. In fact, it is understood as a justifiable and effective strategy to solve conflicts and cope with problematic situations. Therefore, the recognition of bullying as a negative phenomenon by the majority of students has not contributed to the reduction of episodes of violence in schools. There is a greater maturity in the view of bullying and a greater dissemination of the phenomenon, but these aspects have not been enough to eliminate or to reduce its manifestations.

Final considerations

With a constructivist stance, this study demonstrated that adolescents know the main conceptual dimensions of bullying, but they explain it in a descriptive way and based on individual issues. In their view, bullying can be explained mainly by the type of violence practiced, as well as by their forms of manifestation in everyday life. It is noteworthy that the bullied mentioned more frequently verbal violence, while the bullies emphasized violence in their narratives. The participants also did not underestimate the motivations for the practice of bullying and its consequences for the health, development and the teaching-learning process of all those involved. The original contribution of this study is the construction of an interpretative, comprehensive and explanatory representation of the investigated phenomenon from the perspective of students. It is essential to discuss their experiences, i.e. how they define bullying and what they say about it, for the organization of care and effective intervention programs, broadening the technical logics of literature or of adults.

Meanwhile, the presented data should be examined bearing in mind three main limitations of the study. First, this was a cross-sectional study; thus inferences about causal links related to bullying and the dimensions analyzed are not possible. Second, although qualitative data provide the senses and meanings of bullying attributed by adolescents, the conclusions drawn from them should be considered contextual and temporary. Finally, the collection of quantitative data prior to the qualitative interviews may have sensitized the students to some extent towards the subject studied. Additional research may support the concepts discussed here, expand the reflections on the students’ experiences in bullying situations and how they interpret it, investigating the conceptual dimensions present in different groups and samples, with different designs and methodological techniques.

We conclude that the analysis of conceptual dimensions is useful to describe, understand and intervene in bullying among school-age youth in the specific Brazilian reality. In addition, the use of qualitative methods and the approach of the adolescents’ narratives about bullying are beneficial for they complement the existing knowledge and point to paths for intervention as indicated by the students themselves. As noted, this is a complex problem whose priorities must take into account its main protagonists and what they say about the issue.

Acknowledgments

This manuscript was financially supported by São Paulo Research Foundation, and CAPES.

References

  • 1
    Olweus D. School Bullying: Development and some important challenges. Annu. Rev. Clin Psychol 2013; 9:751-780.
  • 2
    Schultz NCW, Duque DF, Silva CF, Souza CD, Assini LC, Carneiro MGM. A compreensão sistêmica do bullying. Psicol. estud. 2012; 17(2):247-254.
  • 3
    Thornberg R, Halldin K, Bolmsjo N, Petersson A. Victimising of school bullying: a grounded theory. Research Papers in Education 2013; 28(3):309-329.
  • 4
    Malta DC, Porto DL, Crespo CD, Silva MMA, Andrade SSC, Mello FCM, Monteiro R, Silva MA. Bullying in Brazilian school children: analysis of the National Adolescent School-based Health Survey (PeNSE 2012). Rev. bras. epidemiol. 2014; 17(Supl. 1):92-105.
  • 5
    Malta DC, Silva MAI, Mello FCM, Monteiro RA, Sardinha LMV, Crespo C, Carvalho MGO, Silva MMA, Porto DL. Bullying nas escolas brasileiras: resultados da Pesquisa Nacional de Saúde do Escolar (PeNSE), 2009. Cien Saude Colet 2010; 15(Supl. 2):3065-3076.
  • 6
    Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psico 2014; 45(2):147-156.
  • 7
    Zaine I, Reis MJD, Padovani RC. Comportamentos de bullying e conflito com a lei. Estud. psicol. (Campinas) 2010; 27(3):375-382.
  • 8
    Silva MAI, Silva JL, Pereira BO, Oliveira WA, Medeiros M. The view of teachers on bullying and implications for nursing. Rev. esc. enferm. USP 2014; 48(4):723-730.
  • 9
    Minayo MCS. Violência e educação: impactos e tendências. Revista Pedagógica 2013; 15(31):249-264.
  • 10
    Brasil. Ministério da Saúde (MS). Linha de cuidado para a atenção integral à saúde de crianças, adolescentes e suas famílias em situação de violência Brasília: MS; 2010.
  • 11
    Zottis GA, Salum GA, Isolan LR, Manfro GG, Heldt E. Associations between child disciplinary practices and bullying behavior in adolescents. J Pediatr 2014; 90(4):408-414.
  • 12
    Malta DC, Prado RR, Dias AJR, Mello FCM, Silva MAI, Costa MR, Caiaffa WT. Bullying and associated factors among Brazilian adolescents: analysis of the National Adolescent School-based Health Survey (PeNSE 2012). Rev. bras. epidemiol. 2014; 17(Supl. 1):131-145.
  • 13
    Caravita SCS, Gini G, Pozzoli T. Main and Moderated Effects of Moral Cognition and Status on Bullying and Defending. Aggressive Behavior 2012; 38(6):456-468.
  • 14
    Thornberg R, Thornberg UB, Alamaa R, Daud N. Children’s conceptions of bullying and repeated conventional transgressions: moral, conventional, structuring and personal-choice reasoning. Educational Psychology 2014; 36(1):1-17.
  • 15
    Lien L, Welander-Vatn A. Factors Associated with the Persistence of Bullying Victimization From 10th grade to 13th Grade: A Longitudinal Study. Clin Pract Epidemiol Ment Health 2013; 9:243-250.
  • 16
    Salmivalli C. Participant Roles in Bullying: How Can Peer Bystanders Be Utilized in Interventions? Theory Into Practice 2014; 53(4):286-292.
  • 17
    Araújo LS, Coutinho MPL, Miranda RS, Saraiva ERA. Universo consensual de adolescentes acerca da violência escolar. Psico-USF 2012; 17(2):243-251.
  • 18
    Salgado FS, Senra LX, Lourenço LM. Effectiveness indicators of bullying intervention programs: A systematic review of the international literature. Estud. psicol. (Campinas) 2014; 31(2):179-190.
  • 19
    Mendes CS. Prevenção da violência escolar: avaliação de um programa de intervenção. Rev. esc. enferm. USP 2011; 45(3):581-588.
  • 20
    Bibou-Nakou I, Tsiantis J, Assimopoulos H, Chatzilambou P. Bullying/victimization from a family perspective: a qualitative study of secondary school students’ views. European Journal of Psychology of Education 2013; 28(1):53-71.
  • 21
    Rech RR, Halpern R, Tedesco A, Santos DF. Prevalence and characteristics of victims and perpetrators of bullying. J Pediatr 2013; 89(2):164-170.
  • 22
    Cassiani-Miranda CA, Gómez-Alhach J, Cubides-Munévar AM, Hernández-Carrillo M. Prevalencia de bullying y factores relacionados en estudiantes de bachillerato de una institución educativa de Cali, Colombia, 2011. Revista de Salud Pública 2014; 16(1):13-24.
  • 23
    Wuest J. Grounded theory: the method. In: Munhall PL, editor. Nursing research: a qualitative perspective. Sudbury: Jones & Bartlett Learning; 2010. p. 239-271
  • 24
    Leite JL, Silva LJ, Oliveira RMP, Stipp MAC. Reflexões sobre o pesquisador nas trilhas da Teoria Fundamentada nos Dados. Rev. esc. enferm. USP 2012; 46(3):772-777.
  • 25
    Cunha JM, Weber LND, Steiner Neto P. Escala de Vitimização e Agressão entre Pares (EVAP). In: Weber LND, Dessen MA, organizadores. Pesquisando a família - instrumentos para coleta e análise de dados Curitiba: Juruá; 2009. p. 103-114.
  • 26
    Weber LND, Salvador APV, Brandenburg OJ. Escalas de Qualidade na Interação Familiar. In: Weber LND, Dessen MA, organizadores. Pesquisando a família - instrumentos para coleta e análise de dados Curitiba: Juruá; 2009. p. 61-72.
  • 27
    Brasil. Resolução Nº 466, de 12 de dezembro de 2012. Brasília: CNS, 2013.
  • 28
    Thornberg R, Tenenbaum L, Varjas K, Meyers J, Jungert T, Vanegas G. Bystander motivation in bullying incidents: to intervene or not to intervene? Western Journal of Emergency Medicine 2012; 13(3):247-252.
  • 29
    Santos JA, Cabral-Xavier AF, Paiva SM, Leite-Cavalcanti A. Prevalência e Tipos de Bullying em Escolares Brasileiros de 13 a 17 anos. Revista de Salud Pública 2014; 16(2):173-183.
  • 30
    Esteve CEA, Arruda ALMM. Bullying: quando a brincadeira fica seria, causas e consequências. Revista Eletrônica Saberes da Educação 2014; 5(1):1-36.
  • 31
    Bandeira CM, Hutz CS. Bullying: prevalência, implicações e diferenças entre os gêneros. Psicol. esc. educ 2012; 16(1):35-44.
  • 32
    Oliveira WA, Silva MAI, Mello FCM, Porto DL, Yoshinaga ACM, Malta DC. Causas do bullying: resultados da Pesquisa Nacional de Saúde do Escolar. Rev. Latino-Am Enfermagem 2015; 23(2):1-8.

Publication Dates

  • Publication in this collection
    Mar 2018

History

  • Received
    10 Mar 2015
  • Reviewed
    21 June 2016
  • Accepted
    23 June 2016
ABRASCO - Associação Brasileira de Saúde Coletiva Rio de Janeiro - RJ - Brazil
E-mail: revscol@fiocruz.br