Analysis of possible factors of vocal interference during the teaching activity

Bárbara Gabriela Silva Tiago Visacre Chammas Marcia Simões Zenari Renata Rodrigues Moreira Alessandra Giannella Samelli Kátia Nemr About the authors

ABSTRACT

OBJECTIVE

To measure the risk of dysphonia in teachers, as well as investigate whether the perceptual-auditory and acoustic aspects of the voice of teachers in situations of silence and noise, the signal-to-noise ratio, and the noise levels in the classroom are associated with the presence of dysphonia.

METHODS

This is an observational cross-sectional research with 23 primary and secondary school teachers from a private school in the municipality of São Paulo, Brazil, divided into the groups without dysphonia and with dysphonia. We performed the following procedures: general Dysphonia Risk Screening Protocol (General-DRSP) and complementary to speaking voice - teacher (Specific-DRSP), voice recording during class and in an individual situation in a silent room, and measurement of the signal-to-noise ratio and noise levels of classrooms.

RESULTS

We have found differences between groups regarding physical activity (General-DRSP) and particularities of the profession (Specific-DRSP), as well as in all aspects of the perceptual-auditory vocal analysis. We have found signs of voice wear in the group without dysphonia. Regarding the vocal resources in the situations of noise and silence, we have identified a difference for the production of abrupt vocal attack and the tendency of a more precise speech in the situation of noise. Both the signal-to-noise ratio and the room noise levels during class were high in both groups.

CONCLUSIONS

Teachers in both groups are at high risk for developing dysphonia and have negative vocal signals to a greater or lesser extent. Signal-to-noise ratio was inadequate in most classrooms, considering the standards for both children with normal hearing and with hearing loss, as well as equivalent noise levels.

DESCRIPTORS
School Teachers; Voice Disorders; epidemiology; Noise; adverse effects; Hearing Loss; Risk Factors; Working Conditions

INTRODUCTION

Studies on the voices of teachers show a high rate of dysphonia in this professional class33. Behlau M, Zambon F, Guerrieri AC, Roy N. Epidemiology of voice disorders in teachers and nonteachers in Brazil: prevalence and adverse effects. J Voice. 2012;26(5):665.e9-18. https://doi.org/10.1016/j.jvoice.2011.09.010
https://doi.org/10.1016/j.jvoice.2011.09...
,1010. Houtte V, Claeys S, Wuyts F, Van Lierde KV. The impact of voice disorders among teachers: vocal complaints, treatment-seeking behavior, knowledge of vocal care, and voice-related absenteeism. J Voice. 2011;25(5):571-5. https://doi.org/10.1016/j.jvoice.2010.04.008
https://doi.org/10.1016/j.jvoice.2010.04...
,2424. Simões-Zenari M, Bitar ML, Nemr NK. Efeito do ruído na voz de educadoras de instituições de educação infantil. Rev Saude Publica. 2012;46(4):657-64. https://doi.org/10.1590/S0034-89102012005000038
https://doi.org/10.1590/S0034-8910201200...
. The severity of dysphonia can negatively interfere in the viability of the teaching work, with consequent hindering of the comprehension of students2222. Servilha EAM, Correia JM. Correlações entre condições do ambiente, organização do trabalho, sintomas vocais autorreferidos por professores universitários e avaliação fonoaudiológica. Disturb Comun. 2014 [cited 2017 Sep 30];26(3):452-62. Available from: https://revistas.pucsp.br/index.php/dic/article/view/16222
https://revistas.pucsp.br/index.php/dic/...
and, in more serious cases, the medical leave of these professionals from their duties1919. Provenzano LCFA, Sampaio TMM. Prevalência de disfonia em professores do ensino púbico estadual afastados de sala de aula. Rev CEFAC. 2010;12(1):97-108.https://doi.org/10.1590/S1516-18462010000100013
https://doi.org/10.1590/S1516-1846201000...
.

Among the working conditions that permeate the health-disease process of teachers, we highlight the long working hours, prolonged and excessive vocal use55. Biserra MP, Giannini SPP, Paparelli R, Ferreira LP. Voz e trabalho: estudo dos condicionantes das mudanças a partir do discurso de docentes. Saude Soc. 2014;23(3):966-78. https://doi.org/10.1590/S0104-12902014000300019
https://doi.org/10.1590/S0104-1290201400...
, and the high and constant levels of noise in classrooms1111. Libardi A, Gonçalves CGO, Vieira TPG, Silverio KCA, Rossi D, Penteado RZ. O ruído em sala de aula e a percepção dos professores de uma escola de ensino fundamental de Piracicaba. Disturb Comun. 2006 [cited 2017 Sep 30];18(2):167-78. Available from: https://revistas.pucsp.br/index.php/dic/article/view/11782
https://revistas.pucsp.br/index.php/dic/...
, which are above that recommended by regulation NBR 10152, between 40 dB and 50 dB(A)aaAssociação Brasileira de Normas Técnicas. NBR 10152: níveis de ruído para conforto acústico. Rio de Janeiro: ABNT; 2000.

During classes, excessive noise, in addition to interfering with the attention and concentration of teachers1111. Libardi A, Gonçalves CGO, Vieira TPG, Silverio KCA, Rossi D, Penteado RZ. O ruído em sala de aula e a percepção dos professores de uma escola de ensino fundamental de Piracicaba. Disturb Comun. 2006 [cited 2017 Sep 30];18(2):167-78. Available from: https://revistas.pucsp.br/index.php/dic/article/view/11782
https://revistas.pucsp.br/index.php/dic/...
and hindering the auditory processing of essential information for the development of activities, competes with the vocal production, which may lead to inappropriate voice adjustments, increasing the risk of dysphonia2020. Rantala LM, Hakala S, Holmqvist S, Sala E. Classroom noise and teacher's voice production. J Speech Lang Hear Res. 2015;58(5):1397-406. https://doi.org/10.1044/2015_ISLHR-S-14-0248
https://doi.org/10.1044/2015_ISLHR-S-14-...
,2424. Simões-Zenari M, Bitar ML, Nemr NK. Efeito do ruído na voz de educadoras de instituições de educação infantil. Rev Saude Publica. 2012;46(4):657-64. https://doi.org/10.1590/S0034-89102012005000038
https://doi.org/10.1590/S0034-8910201200...
.

An acoustic interference factor in the classroom, and an important tool to monitor both the noise and the voices of teachers, is the signal-to-noise ratio (SNR)44. Bentler RA. List equivalency and test-retest reliability of the speech in noise test. Am J Audiol. 2000;9(2):84-100. https://doi.org/10.1044/1059-0889(2000/010)
https://doi.org/10.1044/1059-0889(2000/0...
, calculated from the difference, in decibels (dB), between the level of the signal of interest (in this case, the voice of the teacher) and the background noise intensity of the environment; it can vary according to the distance and intensity of the signal of interest, the reverberation of the environment, and the background noise88. Dreossi RCF, Momensohn-Santos T. Noise and its interference over students in a classroom environment: literature review. Pro-Fono Rev Atual Cient. 2005;17(2):251-8. https://doi.org/10.1590/S0104-56872005000200014
https://doi.org/10.1590/S0104-5687200500...
.

The investigation of both the risk of dysphonia and the noise during the teaching activity aims to assist in the targeting of programs and activities for the promotion and prevention of vocal disorders, as well as the necessary modifications in the organization and conditions of the work to reduce the number of medical leaves and also to improve the teaching and the quality of life of those involved.

The objective of this study is to measure the risk of dysphonia in teachers, as well as investigate whether the perceptual-auditory and acoustic aspects of the voice of teachers in the situation of silence and noise, the signal-to-noise ratio, and the noise levels in the classroom are associated with the presence of dysphonia.

METHODS

This is an observational cross-sectional research approved by the Research Ethics Committee of the Faculdade de Medicina of the Universidade de São Paulo (Process 169/15), carried out in a private primary and secondary school in the municipality of São Paulo.

Twenty-three female teachers, with a mean age of 37.26 years (SD = 7.0), signed the informed consent.

We carried out the following procedures at the school itself:

  • Application of the General Dysphonia Risk Screening Protocol (General-DRSP)1515. Nemr K, Simões-Zenari M, Duarte JMT, Lobrigate KE, Bagatini FA. Dysphonia risk screening protocol. Clinics. 2016;71(3):114-27. https://doi.org/10.6061/clinics/2016(03)01
    https://doi.org/10.6061/clinics/2016(03)...
    and the Complementary Dysphonia Risk Screening Protocol for Speaking Voice Professional, Teacher (Specific-DRSP)bbSampaio AP, Simões-Zenari M, Nemr NK. Aplicabilidade de protocolo de rastreio de risco de disfonia em professores. São Paulo: Faculdade de Medicina da Universidade de São Paulo; 2015. Trabalho de Conclusão de Curso de Fonoaudiologia., for the identification of vocal complaints, general and occupational life habits, among others. The protocols were explained by the researchers and filled out by the teachers in their presence.

  • Recording of the voice in a silent environment (situation of silence) for later perceptive- auditory and acoustic vocal analysis: sustained vowels, phrases, and spontaneous speech according to the CAPE-V protocolccAmerican Speech-Language Hearing Association, ASHA Division 3 - Voice and Voice Disorders; University of Pittisburg, Department of Communication Science and Disorders. A Consensus Auditory - Perceptual Evaluation of Voice (CAPE -V). Pittisburgh: ASHA; 2002 [cited 2017 Oct 23]. Available from: https://csd.wisc.edu/slpgames/capev_activities/capev_Instructions.pdf . We used the equipment ZOOM H4 placed perpendicularly at 30 cm from the mouth of the teacher.

  • Voice recording with the ZOOM H4 recorder positioned in the middle of the classroom (situation of noise) for 15 minutes of effective speech (situation of expository class).

  • Together with the recording of the teachers in the classrooms, we used a dosimeter, SVANTEK (model SV102, Poland), in the middle of the classroom, to measure the sound pressure levels (maximum, minimum, and equivalent noise levels [Leq]), for 15 minutes.

Data Analysis

We obtained a final score from the screening protocols, which consists in adding the values of the partial scores of each subitem; the General-DRSP ranges from zero to 131 and the Specific-DRSP ranges from zero to 56 for men and from zero to 60 for women1515. Nemr K, Simões-Zenari M, Duarte JMT, Lobrigate KE, Bagatini FA. Dysphonia risk screening protocol. Clinics. 2016;71(3):114-27. https://doi.org/10.6061/clinics/2016(03)01
https://doi.org/10.6061/clinics/2016(03)...
. The higher the value obtained, the greater the risk of dysphonia1515. Nemr K, Simões-Zenari M, Duarte JMT, Lobrigate KE, Bagatini FA. Dysphonia risk screening protocol. Clinics. 2016;71(3):114-27. https://doi.org/10.6061/clinics/2016(03)01
https://doi.org/10.6061/clinics/2016(03)...
,bbSampaio AP, Simões-Zenari M, Nemr NK. Aplicabilidade de protocolo de rastreio de risco de disfonia em professores. São Paulo: Faculdade de Medicina da Universidade de São Paulo; 2015. Trabalho de Conclusão de Curso de Fonoaudiologia..

The perceptual-auditory analysis of the voice recordings obtained in silence was carried out by a speech-language voice expert with extensive experience in evaluations with CAPE-V and high internal reliability of judgment, as measured in an earlier study1515. Nemr K, Simões-Zenari M, Duarte JMT, Lobrigate KE, Bagatini FA. Dysphonia risk screening protocol. Clinics. 2016;71(3):114-27. https://doi.org/10.6061/clinics/2016(03)01
https://doi.org/10.6061/clinics/2016(03)...
. From the value of the general degree of vocal change, teachers were divided into two groups: without dysphonia (GWOD), for values between zero and 34, or with dysphonia (GWD), for values greater than 341212. Martins PC, Couto TE, Gama ACC. Avaliação perceptivo-auditiva do grau de desvio vocal: correlação entre escala visual analógica e escala numérica. CoDAS. 2015;27(3):279-84. https://doi.org/10.1590/2317-1782/20152014167
https://doi.org/10.1590/2317-1782/201520...
. We carried out the acoustic evaluation of the same sample using the free program Praat, considering the automatic measurements of fundamental frequency (normality: 150 Hz to 250 Hz), jitter (0.30% to 0.50%), shimmer (3% and 5%), and harmonics-to-noise ratio (22 dB)22. Behlau M, Madazio G, Feijó D, Pontes P. Avaliação da voz. In: Behlau M, organizadora. Voz: o livro do especialista. Rio de Janeiro: Revinter; 2001. v. 1, p.91-113.,1717. Pinho SMR, Tsuji DH. Fundamentos em laringología e voz. Rio de Janeiro: Revinter; 2006.,ddLeão SHS. Análise espectrográfica acústica de vozes rugosas, soprosas e tensas [dissertação]. São Paulo: Universidade Federal de São Paulo - UNIFESP; 2008.

The voices captured in the situation of silence and situation of noise were analyzed by two of the researchers by consensus, being classified from the vocal resources99. Feijó D. Avaliando a comunicação oral. In: Kyrillos LR, organizadora. Fonoaudiologia e telejornalismo. São Paulo: Revinter; 2003. p.75-88.: type of voice (neutral, altered), vocal attack (isochronic, abrupt, aspirated), loudness (very loud, average, soft), pitch (low, average, high), resonance (balanced, oral, laryngopharyngeal, nasal, hyponasal), articulation (precise, reduced), speed of the speech (slow, average, accelerated), and pneumophonoarticulatory coordination (presence, absence).

With the voice recorded in class, we measured the SNR of each classroom using the program Audacity 2.0.6, the Canadian protocol E-Ramp-Inc. In order to classify the SNR as adequate or inadequate, we considered the cutoff values of +15 dB for classrooms of children with normal hearing (ASHA, 2000)eeCrandell CC, Smaldino JJ. Classroom acoustics for children with normal hearing and with hearing impairment. Lang Speech Hear Serv Sch. 2000;31(4):362- 70. https://doi.org/10.1044/0161-1461.3104.362 and +20 dB for children with hearing loss (British Association of Teachers of the Deaf, 2009)ffGlasgow M. Classroom acoustics: recommended standards: classroom acoustic standards for children with sensori-neural hearing loss. Cheshire (UK): The British Association of Teachers of the Deaf; 2009..

In relation to the classification as adequate or increased of the sound pressure levels in the classroom, we used the NBR 10152 (ABNT, 2000)aaAssociação Brasileira de Normas Técnicas. NBR 10152: níveis de ruído para conforto acústico. Rio de Janeiro: ABNT; 2000, which considers ambient noise of 40 to 50 dB(A) as acceptable for classrooms.

Statistical Analysis

We used descriptive measures and the unpaired ANOVA and chi-square tests (exact test mid P) with a significance level of 0.05.

RESULTS

As for the division of the groups from the values of the General Degree of the CAPE-V, we obtained the GWOD with eleven participants (mean score of 20.81, SD = 10.1) and the GWD with twelve individuals (mean score of 52.91, SD = 12.43).

Regarding the General-DRSP, we found a difference only for the partial score of the subitem of regular physical activity (Table 1), with a lower occurrence in the GWD. For Specific-DRSP, we found a difference in the subitem of specificities of the profession (Table 1), in which GWOD had a higher score. There was no difference between the groups for the final score of General-DRSP and Specific-DRSP.

Table 1
Mean, standard deviation, minimum, and maximum for the scores of the General-DRSP and Specific-DRSP for the groups with and without dysphonia.

We found no differences between the groups in any of the acoustic vocal aspects evaluated. Regarding CAPE-V, there was a difference between groups in all aspects, with a greater change for the GWD (Table 2).

Table 2
Mean, standard deviation, minimum, and maximum for acoustic and perceptual-auditory analysis for groups with and without dysphonia.

As for the averages of the SNR obtained during classes, we verified a tendency to a difference between groups (p = 0.096), with a higher average for the GWD (Table 3). When evaluating each classroom separately, we verified that the SNR was altered in nine of them (39%), considering the standard for normal hearing, and in 23 classrooms (95%), considering the standard for hearing loss.

Table 3
Mean, standard deviation, minimum, and maximum for the signal-to-noise ratio for groups with and without dysphonia.

When we evaluated the vocal resources in the two different situations (noise and silence), we observed that a greater number of teachers performed an abrupt vocal attack in the situation of noise when compared to the situation of silence. In addition, teachers showed a tendency to make a more accurate articulation of speech sounds in the situation of noise (p = 0.052) (Table 4).

Table 4
Number of teachers (n) in each situation (silence and noise) and in each classification of vocal resources.

Based on the relationship between noise exposure and abrupt vocal attack, we carried out a risk analysis for this factor. We identified that the risk of a vocal attack in the situation of noise corresponds to 21.7% (95%CI 9.2-42.3). In the silent environment, the risk was non-existent (95%CI 0-16.9).

As for the average noise levels measured in the classrooms, we identified no difference between the groups for any measure, even though the values in the classrooms of the GWD were higher. The averages of Leq for both groups demonstrate that classroom noise is not suitable for most of them. Only two classrooms (8.7%) in the GWOD had noise below 50 dB(A) during class.

Table 5
Mean and standard deviation for noise levels (Leq, minimum, and maximum in dBA) for groups with and without dysphonia.

DISCUSSION

The voice of teachers is a much-researched subject, but few studies relate environmental issues to the risk of dysphonia77. Cutiva LC, Vogel I, Burdorf A. Voice disorders in teachers and their associations with work-related factors: a systematic review. J Commun Disord. 2013;46(2):143-55. https://doi.org/10.1016/j.jcomdis.2013.01.001
https://doi.org/10.1016/j.jcomdis.2013.0...
,1313. Medeiros AM, Barreto SM, Assunção AA. Voice disorders (dysphonia) in public school female teachers working in Belo Horizonte: prevalence and associated factors. J Voice. 2008;22(6):676-87. https://doi.org/10.1016/j.jvoice.2007.03.008
https://doi.org/10.1016/j.jvoice.2007.03...
. The evaluation of this risk is an important tool for actions that promote health in the school environment, which can guide a process of awareness of those involved, as well as change habits and the environment to improve the quality of life. In addition, actions to promote health in this environment favor the earlier diagnosis of dysphonia11. Bassi IB, Assunção AA, Gama ACC, Gonçalves LG. Características clínicas, sócio demográficas e ocupacional de professoras com disfonia. Disturb Comun. 2011 [cited 2017 Sep 30];23(2):173-80. Available from: https://revistas.pucsp.br/index.php/dic/article/view/8273
https://revistas.pucsp.br/index.php/dic/...
.

The group of participants in this research was composed of female teachers with a mean age of 37.26 years. It is known that there is a greater frequency of women in this profession; however, the age group is quite varied33. Behlau M, Zambon F, Guerrieri AC, Roy N. Epidemiology of voice disorders in teachers and nonteachers in Brazil: prevalence and adverse effects. J Voice. 2012;26(5):665.e9-18. https://doi.org/10.1016/j.jvoice.2011.09.010
https://doi.org/10.1016/j.jvoice.2011.09...
,55. Biserra MP, Giannini SPP, Paparelli R, Ferreira LP. Voz e trabalho: estudo dos condicionantes das mudanças a partir do discurso de docentes. Saude Soc. 2014;23(3):966-78. https://doi.org/10.1590/S0104-12902014000300019
https://doi.org/10.1590/S0104-1290201400...
,77. Cutiva LC, Vogel I, Burdorf A. Voice disorders in teachers and their associations with work-related factors: a systematic review. J Commun Disord. 2013;46(2):143-55. https://doi.org/10.1016/j.jcomdis.2013.01.001
https://doi.org/10.1016/j.jcomdis.2013.0...
,1010. Houtte V, Claeys S, Wuyts F, Van Lierde KV. The impact of voice disorders among teachers: vocal complaints, treatment-seeking behavior, knowledge of vocal care, and voice-related absenteeism. J Voice. 2011;25(5):571-5. https://doi.org/10.1016/j.jvoice.2010.04.008
https://doi.org/10.1016/j.jvoice.2010.04...
,1919. Provenzano LCFA, Sampaio TMM. Prevalência de disfonia em professores do ensino púbico estadual afastados de sala de aula. Rev CEFAC. 2010;12(1):97-108.https://doi.org/10.1590/S1516-18462010000100013
https://doi.org/10.1590/S1516-1846201000...
,2222. Servilha EAM, Correia JM. Correlações entre condições do ambiente, organização do trabalho, sintomas vocais autorreferidos por professores universitários e avaliação fonoaudiológica. Disturb Comun. 2014 [cited 2017 Sep 30];26(3):452-62. Available from: https://revistas.pucsp.br/index.php/dic/article/view/16222
https://revistas.pucsp.br/index.php/dic/...
,2424. Simões-Zenari M, Bitar ML, Nemr NK. Efeito do ruído na voz de educadoras de instituições de educação infantil. Rev Saude Publica. 2012;46(4):657-64. https://doi.org/10.1590/S0034-89102012005000038
https://doi.org/10.1590/S0034-8910201200...
,bbSampaio AP, Simões-Zenari M, Nemr NK. Aplicabilidade de protocolo de rastreio de risco de disfonia em professores. São Paulo: Faculdade de Medicina da Universidade de São Paulo; 2015. Trabalho de Conclusão de Curso de Fonoaudiologia.. When compared to men, women are more prone to vocal disorders because of the laryngeal configuration1313. Medeiros AM, Barreto SM, Assunção AA. Voice disorders (dysphonia) in public school female teachers working in Belo Horizonte: prevalence and associated factors. J Voice. 2008;22(6):676-87. https://doi.org/10.1016/j.jvoice.2007.03.008
https://doi.org/10.1016/j.jvoice.2007.03...
,1818. Pontes P, Kyrillos L, Behlau M, De Biase N, Pontes A. Vocal nodules and laryngeal morphology. J Voice. 2002;16(3):408-14. https://doi.org/10.1016/S0892-1997(02)00112-1
https://doi.org/10.1016/S0892-1997(02)00...
.

Using the General-DRSP and the Specific-DRSP, we observed in this study that, regardless of dysphonia, teachers are exposed to similar risks for dysphonia, as found in a previous studybbSampaio AP, Simões-Zenari M, Nemr NK. Aplicabilidade de protocolo de rastreio de risco de disfonia em professores. São Paulo: Faculdade de Medicina da Universidade de São Paulo; 2015. Trabalho de Conclusão de Curso de Fonoaudiologia..

Regarding General-DRSP, there was a difference between the groups only for the regular practice of physical activity, greater in the group without dysphonia. Vocal strain was lower in the group without dysphonia. Those who practice physical activity may have lower levels of stress and body strain1414. Mello MT, Lemos VA, Antunes HKM, Bittencourt L, Santos-Silva R, Tufik S. Relationship between physical activity and depression and anxiety symptoms: a population study. J Affect Disord. 2013;149(1-3):241-6.https://doi.org/10.1016/j.jad.2013.01.035
https://doi.org/10.1016/j.jad.2013.01.03...
and, consequently, vocal strain, which suggests a relationship between physical inactivity and dysphonia11. Bassi IB, Assunção AA, Gama ACC, Gonçalves LG. Características clínicas, sócio demográficas e ocupacional de professoras com disfonia. Disturb Comun. 2011 [cited 2017 Sep 30];23(2):173-80. Available from: https://revistas.pucsp.br/index.php/dic/article/view/8273
https://revistas.pucsp.br/index.php/dic/...
. In addition, the practice of physical exercises reduces the symptoms of depression and anxiety1414. Mello MT, Lemos VA, Antunes HKM, Bittencourt L, Santos-Silva R, Tufik S. Relationship between physical activity and depression and anxiety symptoms: a population study. J Affect Disord. 2013;149(1-3):241-6.https://doi.org/10.1016/j.jad.2013.01.035
https://doi.org/10.1016/j.jad.2013.01.03...
, which would positively impact the vocal production without strain and the quality of life of teachers. We emphasize that the practice of physical activity depends on the routine and life habits established by the individual and can be reinforced in actions of health promotion.

Regarding Specific-DRSP, the groups differed in the particularities of the current profession, and the GWOD had the highest score. Looking more closely at these data, we noted that only teachers considered as regents were present in the GWOD and expert teachers (arts, music, and computer science) were present only in the GWD. When calculating the score, the regent teacher receives one more point than the expert because it is often considered that the expert allocates part of the class time to the practice of the students and, therefore, they supposedly have less expository lesson time than the regent teacher, which would be positive for vocal well-being. However, if all the expert teachers were in the GWD, this factor may be being minimized by other factors of higher risk for dysphonia. We should also consider that children can get more agitated in these classes, which could lead the expert teacher to retake the limits using the voice. Studies with other schools will allow for broader analyses and may even indicate the need to revise the calculation of the score for Specific-DRSP.

Another aspect of this subitem that had a higher score in the GWOD was the number of years working as a teacher at the current level of education. Contrary to what we can find in the literature1515. Nemr K, Simões-Zenari M, Duarte JMT, Lobrigate KE, Bagatini FA. Dysphonia risk screening protocol. Clinics. 2016;71(3):114-27. https://doi.org/10.6061/clinics/2016(03)01
https://doi.org/10.6061/clinics/2016(03)...
,2525. Souza CL, Carvalho FM, Araújo TM, Reis EJFB, Lima VMC, Porto LA. Fatores associados a patologias de pregas vocais em professores. Rev Saude Publica. 2011;45(5):914-21. https://doi.org/10.1590/S0034-89102011005000055
https://doi.org/10.1590/S0034-8910201100...
, teachers with no vocal disorder indicated more years teaching in the classroom when compared to teachers of the GWD. This data was also observed in another study77. Cutiva LC, Vogel I, Burdorf A. Voice disorders in teachers and their associations with work-related factors: a systematic review. J Commun Disord. 2013;46(2):143-55. https://doi.org/10.1016/j.jcomdis.2013.01.001
https://doi.org/10.1016/j.jcomdis.2013.0...
, in the characterization of the sample, in which only 33% of the teachers with vocal disorders had more than ten years of work. This finding may indicate a positive adaptation of these professionals over time or even some training received, which can also be better explored in future studies. Regarding the level of education, most teachers of the GWOD work in secondary education and half of the teachers of the GWD work in primary education. A study carried out with primary teachers2323. Simões M, Latorre MRDO. Prevalência de alteração vocal em educadoras e sua relação com a auto-percepção. Rev Saude Publica. 2006;40(6):1013-8. https://doi.org/10.1590/S0034-89102006000700008
https://doi.org/10.1590/S0034-8910200600...
has found a higher prevalence of dysphonia compared to other studies with teachers of secondary education, high school, and college, which may indicate that the particularities of the work along this age group should be one more factor to be considered.

Thus, taking into account the particularities of the work, the changes that can occur each semester in the schedule of teachers regarding the hours/class and that would justify a periodic monitoring to evaluate possible tendencies of increase or decrease of risks must be considered; in addition, this control could contribute with the analyses about possible vocal fatigue at the end of each semester.

Although we observed no differences between the groups regarding the final score of the General-DRSP and Specific-DRSP, we observed a higher mean in the score of the GWD, which could be better evidenced in studies with larger samples.

The averages obtained in the score for General-DRSP for both groups were above the cutoff point for women, which is 29.251515. Nemr K, Simões-Zenari M, Duarte JMT, Lobrigate KE, Bagatini FA. Dysphonia risk screening protocol. Clinics. 2016;71(3):114-27. https://doi.org/10.6061/clinics/2016(03)01
https://doi.org/10.6061/clinics/2016(03)...
. This represents a high risk of dysphonia for teachers with and without a vocal disorder, corroborating other studies11. Bassi IB, Assunção AA, Gama ACC, Gonçalves LG. Características clínicas, sócio demográficas e ocupacional de professoras com disfonia. Disturb Comun. 2011 [cited 2017 Sep 30];23(2):173-80. Available from: https://revistas.pucsp.br/index.php/dic/article/view/8273
https://revistas.pucsp.br/index.php/dic/...
,bbSampaio AP, Simões-Zenari M, Nemr NK. Aplicabilidade de protocolo de rastreio de risco de disfonia em professores. São Paulo: Faculdade de Medicina da Universidade de São Paulo; 2015. Trabalho de Conclusão de Curso de Fonoaudiologia..

The reduction of risks requires changes in the conditions and organization of the work and depends on mobilizations from higher instances55. Biserra MP, Giannini SPP, Paparelli R, Ferreira LP. Voz e trabalho: estudo dos condicionantes das mudanças a partir do discurso de docentes. Saude Soc. 2014;23(3):966-78. https://doi.org/10.1590/S0104-12902014000300019
https://doi.org/10.1590/S0104-1290201400...
. From this study, we observed that, regardless of the presence and degree of vocal change, teachers are daily exposed to high occupational risks for dysphonia11. Bassi IB, Assunção AA, Gama ACC, Gonçalves LG. Características clínicas, sócio demográficas e ocupacional de professoras com disfonia. Disturb Comun. 2011 [cited 2017 Sep 30];23(2):173-80. Available from: https://revistas.pucsp.br/index.php/dic/article/view/8273
https://revistas.pucsp.br/index.php/dic/...
,77. Cutiva LC, Vogel I, Burdorf A. Voice disorders in teachers and their associations with work-related factors: a systematic review. J Commun Disord. 2013;46(2):143-55. https://doi.org/10.1016/j.jcomdis.2013.01.001
https://doi.org/10.1016/j.jcomdis.2013.0...
,bbSampaio AP, Simões-Zenari M, Nemr NK. Aplicabilidade de protocolo de rastreio de risco de disfonia em professores. São Paulo: Faculdade de Medicina da Universidade de São Paulo; 2015. Trabalho de Conclusão de Curso de Fonoaudiologia..

Concerning the acoustic analysis of voices recorded in a quiet environment, according to the parameters evaluated, no differences were found between the groups. In a pre-study with 28 educators, with acoustic vocal analysis performed using the same software, groups of teachers with adequate voices, voices altered to a mild degree, and voices altered to a moderate degree were compared2424. Simões-Zenari M, Bitar ML, Nemr NK. Efeito do ruído na voz de educadoras de instituições de educação infantil. Rev Saude Publica. 2012;46(4):657-64. https://doi.org/10.1590/S0034-89102012005000038
https://doi.org/10.1590/S0034-8910201200...
. As in this research, the authors2424. Simões-Zenari M, Bitar ML, Nemr NK. Efeito do ruído na voz de educadoras de instituições de educação infantil. Rev Saude Publica. 2012;46(4):657-64. https://doi.org/10.1590/S0034-89102012005000038
https://doi.org/10.1590/S0034-8910201200...
have not observed differences for acoustic parameters of fundamental frequency, shimmer, and harmonics-to-noise ratio. However, they have found differences in jitter. In this study, although there was no difference between the groups in relation to the vocal parameters in the acoustic analysis, the average found in the GWD was below the reference values. A research with 99 teachers, with acoustic analysis of voices made using another software (Multi-Dimensional Voice Program Advanced), has found measures of jitter, shimmer, and fundamental frequency above normality2121. Ribeiro VV, Cielo CA. Medidas vocais perceptivo-auditivas e acústicas, queixas vocais e características profissionais de professoras de Santa Maria (RS). Audiol Commun Res. 2014;19(4):387-98. https://doi.org/10.1590/S2317-64312014000400001395
https://doi.org/10.1590/S2317-6431201400...
. The values of harmonics-to-noise ratio were lower than expected in the two groups, which indicate that voices considered as unchanged in the GWOD are presenting more noise than expected, which may be a sign of vocal fatigue2424. Simões-Zenari M, Bitar ML, Nemr NK. Efeito do ruído na voz de educadoras de instituições de educação infantil. Rev Saude Publica. 2012;46(4):657-64. https://doi.org/10.1590/S0034-89102012005000038
https://doi.org/10.1590/S0034-8910201200...
. This data shows the importance of combining perceptual-auditory and acoustic analysis for greater detail.

In the perceptual-auditory vocal analysis using the CAPE-V, we found differences in all aspects evaluated when comparing the two groups, with changes in the GWD. Nevertheless, the GWOD presented breathiness and roughness, although reduced and not configuring dysphonia, which may be associated with the changes observed in the acoustic measures such as jitter and harmonics-to-noise ratio discussed above.

The greater presence of roughness in teachers with dysphonia may be related to mass changes in the vocal folds, such as vocal nodules that are commonly found in this professional category2222. Servilha EAM, Correia JM. Correlações entre condições do ambiente, organização do trabalho, sintomas vocais autorreferidos por professores universitários e avaliação fonoaudiológica. Disturb Comun. 2014 [cited 2017 Sep 30];26(3):452-62. Available from: https://revistas.pucsp.br/index.php/dic/article/view/16222
https://revistas.pucsp.br/index.php/dic/...
and more frequently in women, as well as breathiness, because of the laryngeal configuration in itself, prone to existence of glottic chink1818. Pontes P, Kyrillos L, Behlau M, De Biase N, Pontes A. Vocal nodules and laryngeal morphology. J Voice. 2002;16(3):408-14. https://doi.org/10.1016/S0892-1997(02)00112-1
https://doi.org/10.1016/S0892-1997(02)00...
. These data emphasize the importance of evaluating the laryngeal conditions of teachers with dysphonia.

The vocal changes found reinforce the findings of other studies2121. Ribeiro VV, Cielo CA. Medidas vocais perceptivo-auditivas e acústicas, queixas vocais e características profissionais de professoras de Santa Maria (RS). Audiol Commun Res. 2014;19(4):387-98. https://doi.org/10.1590/S2317-64312014000400001395
https://doi.org/10.1590/S2317-6431201400...
,2222. Servilha EAM, Correia JM. Correlações entre condições do ambiente, organização do trabalho, sintomas vocais autorreferidos por professores universitários e avaliação fonoaudiológica. Disturb Comun. 2014 [cited 2017 Sep 30];26(3):452-62. Available from: https://revistas.pucsp.br/index.php/dic/article/view/16222
https://revistas.pucsp.br/index.php/dic/...
and justify the actions of health promotion and vocal well-being that improve the voice quality of these professionals. Simple interventions, such as vocal warm-up practice and respiratory training, have positive results1616. Pereira LPP, Masson MLV, Carvalho FM. Aquecimento vocal e treino respiratório em professores: ensaio clínico randomizado. Rev Saude Publica. 2015;49:67. https://doi.org/10.1590/S0034-8910.2015049005716
https://doi.org/10.1590/S0034-8910.20150...
.

Regarding the SNR, there was a higher average tendency in the GWD, suggesting that the voice is more intense in the classrooms of teachers with dysphonia than in the other classrooms. This data is similar to other studies2020. Rantala LM, Hakala S, Holmqvist S, Sala E. Classroom noise and teacher's voice production. J Speech Lang Hear Res. 2015;58(5):1397-406. https://doi.org/10.1044/2015_ISLHR-S-14-0248
https://doi.org/10.1044/2015_ISLHR-S-14-...
,2424. Simões-Zenari M, Bitar ML, Nemr NK. Efeito do ruído na voz de educadoras de instituições de educação infantil. Rev Saude Publica. 2012;46(4):657-64. https://doi.org/10.1590/S0034-89102012005000038
https://doi.org/10.1590/S0034-8910201200...
and represents an important occupational risk factor for these professionals.

In the situation of noise, we observed the use of abrupt vocal attack, with a risk of 21.7% in its use in classes. The abrupt vocal attack consists of an inadequate vocal pattern related to phonotrauma, in which there is a rapid and complete adduction of the vocal folds at the beginning of phonation. This condition may be followed by muscle strain and it signals increased effort when frequent22. Behlau M, Madazio G, Feijó D, Pontes P. Avaliação da voz. In: Behlau M, organizadora. Voz: o livro do especialista. Rio de Janeiro: Revinter; 2001. v. 1, p.91-113.. In order to be understood in classrooms, teachers can change their habitual vocal pattern, not always with adequate adjustment for their laryngeal conditions, as is the case of abrupt vocal attack2020. Rantala LM, Hakala S, Holmqvist S, Sala E. Classroom noise and teacher's voice production. J Speech Lang Hear Res. 2015;58(5):1397-406. https://doi.org/10.1044/2015_ISLHR-S-14-0248
https://doi.org/10.1044/2015_ISLHR-S-14-...
,2424. Simões-Zenari M, Bitar ML, Nemr NK. Efeito do ruído na voz de educadoras de instituições de educação infantil. Rev Saude Publica. 2012;46(4):657-64. https://doi.org/10.1590/S0034-89102012005000038
https://doi.org/10.1590/S0034-8910201200...
.

A protective factor observed in both groups was the tendency to articulate speech sounds more accurately in the situation of noise. In addition, both groups maintained adequate pitch, speed of the speech, and speech-breathing coordination when exposed to noise. Both results suggest a natural positive adjustment or prior training.

Among the possible occupational risks, this study emphasized the investigation of the noise levels present in classrooms, as well as the analysis of the signal-to-noise ratio. The monitoring of these two measures in the school context is fundamental to guide actions that minimize damage to the voice of teachers. In addition, these levels, when above recommended, may interfere not only with teacher performance but also with student learning1111. Libardi A, Gonçalves CGO, Vieira TPG, Silverio KCA, Rossi D, Penteado RZ. O ruído em sala de aula e a percepção dos professores de uma escola de ensino fundamental de Piracicaba. Disturb Comun. 2006 [cited 2017 Sep 30];18(2):167-78. Available from: https://revistas.pucsp.br/index.php/dic/article/view/11782
https://revistas.pucsp.br/index.php/dic/...
.

Regarding the noise present in classrooms, there was no difference between the groups for the averages of equivalent noise, although the values of the classrooms of the GWD were higher. Moreover, only two classrooms (8.7%) presented noise below what is proposed during classes in the GWOD77. Cutiva LC, Vogel I, Burdorf A. Voice disorders in teachers and their associations with work-related factors: a systematic review. J Commun Disord. 2013;46(2):143-55. https://doi.org/10.1016/j.jcomdis.2013.01.001
https://doi.org/10.1016/j.jcomdis.2013.0...
,aaAssociação Brasileira de Normas Técnicas. NBR 10152: níveis de ruído para conforto acústico. Rio de Janeiro: ABNT; 2000. The signal-to-noise ratio was lower than that recommended for children with normal hearingeeCrandell CC, Smaldino JJ. Classroom acoustics for children with normal hearing and with hearing impairment. Lang Speech Hear Serv Sch. 2000;31(4):362- 70. https://doi.org/10.1044/0161-1461.3104.362 in approximately 39% of the classrooms, and for children with hearing lossffGlasgow M. Classroom acoustics: recommended standards: classroom acoustic standards for children with sensori-neural hearing loss. Cheshire (UK): The British Association of Teachers of the Deaf; 2009. in approximately 95% of them. The high levels of noise found reinforce the current situation of schools in Brazil77. Cutiva LC, Vogel I, Burdorf A. Voice disorders in teachers and their associations with work-related factors: a systematic review. J Commun Disord. 2013;46(2):143-55. https://doi.org/10.1016/j.jcomdis.2013.01.001
https://doi.org/10.1016/j.jcomdis.2013.0...
,1111. Libardi A, Gonçalves CGO, Vieira TPG, Silverio KCA, Rossi D, Penteado RZ. O ruído em sala de aula e a percepção dos professores de uma escola de ensino fundamental de Piracicaba. Disturb Comun. 2006 [cited 2017 Sep 30];18(2):167-78. Available from: https://revistas.pucsp.br/index.php/dic/article/view/11782
https://revistas.pucsp.br/index.php/dic/...
,1313. Medeiros AM, Barreto SM, Assunção AA. Voice disorders (dysphonia) in public school female teachers working in Belo Horizonte: prevalence and associated factors. J Voice. 2008;22(6):676-87. https://doi.org/10.1016/j.jvoice.2007.03.008
https://doi.org/10.1016/j.jvoice.2007.03...
.

With the reduction of noise levels in classrooms, the signal-to-noise ratio increases without the teacher having to make adjustments in the vocal pattern, which facilitates the understanding of students and decreases the risk of dysphonia.

It is important to point out the need for new research to investigate and emphasize the importance of the signal-to-noise ratio also in the monitoring of vocal problems, since the signal-to-noise ratio can be an important ally to control the noise intensity and listening situation offered in classrooms.

Programs in this direction could enable preventive measures, as well as the development of strategies that would empower teachers and school staff as health promoters.

  • a
    Associação Brasileira de Normas Técnicas. NBR 10152: níveis de ruído para conforto acústico. Rio de Janeiro: ABNT; 2000
  • b
    Sampaio AP, Simões-Zenari M, Nemr NK. Aplicabilidade de protocolo de rastreio de risco de disfonia em professores. São Paulo: Faculdade de Medicina da Universidade de São Paulo; 2015. Trabalho de Conclusão de Curso de Fonoaudiologia.
  • c
    American Speech-Language Hearing Association, ASHA Division 3 - Voice and Voice Disorders; University of Pittisburg, Department of Communication Science and Disorders. A Consensus Auditory - Perceptual Evaluation of Voice (CAPE -V). Pittisburgh: ASHA; 2002 [cited 2017 Oct 23]. Available from: https://csd.wisc.edu/slpgames/capev_activities/capev_Instructions.pdf
  • d
    Leão SHS. Análise espectrográfica acústica de vozes rugosas, soprosas e tensas [dissertação]. São Paulo: Universidade Federal de São Paulo - UNIFESP; 2008
  • e
    Crandell CC, Smaldino JJ. Classroom acoustics for children with normal hearing and with hearing impairment. Lang Speech Hear Serv Sch. 2000;31(4):362- 70. https://doi.org/10.1044/0161-1461.3104.362
  • f
    Glasgow M. Classroom acoustics: recommended standards: classroom acoustic standards for children with sensori-neural hearing loss. Cheshire (UK): The British Association of Teachers of the Deaf; 2009.

REFERENCES

  • 1
    Bassi IB, Assunção AA, Gama ACC, Gonçalves LG. Características clínicas, sócio demográficas e ocupacional de professoras com disfonia. Disturb Comun. 2011 [cited 2017 Sep 30];23(2):173-80. Available from: https://revistas.pucsp.br/index.php/dic/article/view/8273
    » https://revistas.pucsp.br/index.php/dic/article/view/8273
  • 2
    Behlau M, Madazio G, Feijó D, Pontes P. Avaliação da voz. In: Behlau M, organizadora. Voz: o livro do especialista. Rio de Janeiro: Revinter; 2001. v. 1, p.91-113.
  • 3
    Behlau M, Zambon F, Guerrieri AC, Roy N. Epidemiology of voice disorders in teachers and nonteachers in Brazil: prevalence and adverse effects. J Voice. 2012;26(5):665.e9-18. https://doi.org/10.1016/j.jvoice.2011.09.010
    » https://doi.org/10.1016/j.jvoice.2011.09.010
  • 4
    Bentler RA. List equivalency and test-retest reliability of the speech in noise test. Am J Audiol. 2000;9(2):84-100. https://doi.org/10.1044/1059-0889(2000/010)
    » https://doi.org/10.1044/1059-0889(2000/010)
  • 5
    Biserra MP, Giannini SPP, Paparelli R, Ferreira LP. Voz e trabalho: estudo dos condicionantes das mudanças a partir do discurso de docentes. Saude Soc. 2014;23(3):966-78. https://doi.org/10.1590/S0104-12902014000300019
    » https://doi.org/10.1590/S0104-12902014000300019
  • 6
    Chen SH, Chiang SC, Chung YM, Hsiao LC, Hsiao TY. Risk factors and effects of voice problems for teachers. J Voice. 2010;24(2):183-92. https://doi.org/10.1016/j.jvoice.2008.07.008
    » https://doi.org/10.1016/j.jvoice.2008.07.008
  • 7
    Cutiva LC, Vogel I, Burdorf A. Voice disorders in teachers and their associations with work-related factors: a systematic review. J Commun Disord. 2013;46(2):143-55. https://doi.org/10.1016/j.jcomdis.2013.01.001
    » https://doi.org/10.1016/j.jcomdis.2013.01.001
  • 8
    Dreossi RCF, Momensohn-Santos T. Noise and its interference over students in a classroom environment: literature review. Pro-Fono Rev Atual Cient. 2005;17(2):251-8. https://doi.org/10.1590/S0104-56872005000200014
    » https://doi.org/10.1590/S0104-56872005000200014
  • 9
    Feijó D. Avaliando a comunicação oral. In: Kyrillos LR, organizadora. Fonoaudiologia e telejornalismo. São Paulo: Revinter; 2003. p.75-88.
  • 10
    Houtte V, Claeys S, Wuyts F, Van Lierde KV. The impact of voice disorders among teachers: vocal complaints, treatment-seeking behavior, knowledge of vocal care, and voice-related absenteeism. J Voice. 2011;25(5):571-5. https://doi.org/10.1016/j.jvoice.2010.04.008
    » https://doi.org/10.1016/j.jvoice.2010.04.008
  • 11
    Libardi A, Gonçalves CGO, Vieira TPG, Silverio KCA, Rossi D, Penteado RZ. O ruído em sala de aula e a percepção dos professores de uma escola de ensino fundamental de Piracicaba. Disturb Comun. 2006 [cited 2017 Sep 30];18(2):167-78. Available from: https://revistas.pucsp.br/index.php/dic/article/view/11782
    » https://revistas.pucsp.br/index.php/dic/article/view/11782
  • 12
    Martins PC, Couto TE, Gama ACC. Avaliação perceptivo-auditiva do grau de desvio vocal: correlação entre escala visual analógica e escala numérica. CoDAS. 2015;27(3):279-84. https://doi.org/10.1590/2317-1782/20152014167
    » https://doi.org/10.1590/2317-1782/20152014167
  • 13
    Medeiros AM, Barreto SM, Assunção AA. Voice disorders (dysphonia) in public school female teachers working in Belo Horizonte: prevalence and associated factors. J Voice. 2008;22(6):676-87. https://doi.org/10.1016/j.jvoice.2007.03.008
    » https://doi.org/10.1016/j.jvoice.2007.03.008
  • 14
    Mello MT, Lemos VA, Antunes HKM, Bittencourt L, Santos-Silva R, Tufik S. Relationship between physical activity and depression and anxiety symptoms: a population study. J Affect Disord. 2013;149(1-3):241-6.https://doi.org/10.1016/j.jad.2013.01.035
    » https://doi.org/10.1016/j.jad.2013.01.035
  • 15
    Nemr K, Simões-Zenari M, Duarte JMT, Lobrigate KE, Bagatini FA. Dysphonia risk screening protocol. Clinics. 2016;71(3):114-27. https://doi.org/10.6061/clinics/2016(03)01
    » https://doi.org/10.6061/clinics/2016(03)01
  • 16
    Pereira LPP, Masson MLV, Carvalho FM. Aquecimento vocal e treino respiratório em professores: ensaio clínico randomizado. Rev Saude Publica. 2015;49:67. https://doi.org/10.1590/S0034-8910.2015049005716
    » https://doi.org/10.1590/S0034-8910.2015049005716
  • 17
    Pinho SMR, Tsuji DH. Fundamentos em laringología e voz. Rio de Janeiro: Revinter; 2006.
  • 18
    Pontes P, Kyrillos L, Behlau M, De Biase N, Pontes A. Vocal nodules and laryngeal morphology. J Voice. 2002;16(3):408-14. https://doi.org/10.1016/S0892-1997(02)00112-1
    » https://doi.org/10.1016/S0892-1997(02)00112-1
  • 19
    Provenzano LCFA, Sampaio TMM. Prevalência de disfonia em professores do ensino púbico estadual afastados de sala de aula. Rev CEFAC. 2010;12(1):97-108.https://doi.org/10.1590/S1516-18462010000100013
    » https://doi.org/10.1590/S1516-18462010000100013
  • 20
    Rantala LM, Hakala S, Holmqvist S, Sala E. Classroom noise and teacher's voice production. J Speech Lang Hear Res. 2015;58(5):1397-406. https://doi.org/10.1044/2015_ISLHR-S-14-0248
    » https://doi.org/10.1044/2015_ISLHR-S-14-0248
  • 21
    Ribeiro VV, Cielo CA. Medidas vocais perceptivo-auditivas e acústicas, queixas vocais e características profissionais de professoras de Santa Maria (RS). Audiol Commun Res. 2014;19(4):387-98. https://doi.org/10.1590/S2317-64312014000400001395
    » https://doi.org/10.1590/S2317-64312014000400001395
  • 22
    Servilha EAM, Correia JM. Correlações entre condições do ambiente, organização do trabalho, sintomas vocais autorreferidos por professores universitários e avaliação fonoaudiológica. Disturb Comun. 2014 [cited 2017 Sep 30];26(3):452-62. Available from: https://revistas.pucsp.br/index.php/dic/article/view/16222
    » https://revistas.pucsp.br/index.php/dic/article/view/16222
  • 23
    Simões M, Latorre MRDO. Prevalência de alteração vocal em educadoras e sua relação com a auto-percepção. Rev Saude Publica. 2006;40(6):1013-8. https://doi.org/10.1590/S0034-89102006000700008
    » https://doi.org/10.1590/S0034-89102006000700008
  • 24
    Simões-Zenari M, Bitar ML, Nemr NK. Efeito do ruído na voz de educadoras de instituições de educação infantil. Rev Saude Publica. 2012;46(4):657-64. https://doi.org/10.1590/S0034-89102012005000038
    » https://doi.org/10.1590/S0034-89102012005000038
  • 25
    Souza CL, Carvalho FM, Araújo TM, Reis EJFB, Lima VMC, Porto LA. Fatores associados a patologias de pregas vocais em professores. Rev Saude Publica. 2011;45(5):914-21. https://doi.org/10.1590/S0034-89102011005000055
    » https://doi.org/10.1590/S0034-89102011005000055

Publication Dates

  • Publication in this collection
    11 Dec 2017

History

  • Received
    22 June 2016
  • Accepted
    24 Jan 2017
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br