Avaliação das propriedades psicométricas do OHIP-14 e da prevalência dos impactos da saúde bucal, em população rural ribeirinha no Amazonas, Brasil
Flávia Cohen-CarneiroI; Maria Augusta Bessa RebeloI; Reinaldo Souza-SantosII; Gláucia Maria Bovi AmbrosanoIII; Alessandra Valle SalinoIV; Danielson Guedes PontesIV, V
IFaculdade de Odontologia, Universidade Federal do Amazonas, Manaus, Brasil
IIEscola Nacional de Saúde Pública Sergio Arouca, Fundação Oswaldo Cruz, Rio de Janeiro, Brasil
IIIFaculdade de Odontologia de Piracicaba, Universidade Estadual de Campinas, Campinas, Brasil
IVEscola Superior de Ciências da Saúde, Universidade do Estado do Amazonas, Manaus, Brasil
VCentro Universitário Nilton Lins, Manaus, Brasil
The objectives of this study were: (1) test the psychometric properties of OHIP-14 in a rural population; and (2) compare the oral health impacts in two riverine communities in the Brazilian Amazon that were living at different distances from an urban center. Data were obtained from a cross-sectional study in a consecutive sample (n = 126). The validity was assessed through the association of OHIP with clinical and subjective variables, which showed a more significant association with: pain, caries, need of extraction or endodontic treatment; than with tooth loss, periodontal disease or need of prostheses. The stability and internal consistency were good (ICC = 0.97; Cronbach's α = 0.89). The prevalence of oral impacts was greater in the community far from the urban center [70.3 (59.9-80.7)] than in the community closer to it [44.3 (30.7-57.7)], and in women [66.7 (56.0-77.3)] in comparison with men [49.1 (35.3-62.7)]. The OHIP-14 adapted to rural populations in Amazonas State was valid, reproducible, and consistent. There was high prevalence of impacts, especially for riverine communities that lived far from urban centers.
Rural Population; Quality of Life; Oral Health
Os objetivos do trabalho foram: (1) testar as propriedades psicométricas do OHIP-14 em população rural e (2) comparar os impactos da saúde bucal em duas comunidades ribeirinhas amazônicas, com diferentes distâncias do centro urbano. Os dados foram obtidos de uma amostra consecutiva de pacientes (n = 126) em estudo de corte transversal. A validade do instrumento foi testada pela associação do OHIP com variáveis clínicas e subjetivas, sendo mais significativa para as variáveis: dor, cárie, necessidade de extração e de endodontia que para perda dentária, doença periodontal e necessidade de prótese. Estabilidade e consistência interna foram boas (CCI = 0,97; α Cronbach = 0,89). A prevalência de impactos foi maior na comunidade mais distante do centro urbano [70,3 (59,9-80,7)] que na mais próxima [44,3 (30,7-57,7)], e nas mulheres [66,7 (56,0-77,3)] comparadas aos homens [49,1 (35,3-62,7)]. O OHIP-14 adaptado às populações rurais da Amazônia foi válido, reproduzível e consistente. A prevalência dos impactos foi alta, especialmente para ribeirinhos que vivem distante dos centros urbanos.
População Rural; Qualidade de Vida; Saúde Bucal
Defining the dental treatment needs of a specific population is an essential step in health policy planning. However, the traditional clinical indicators of oral health, such as the decayed, missing and filled teeth (DMFT) index, the number of missing teeth, or the need for prostheses or endodontic treatment, do not clearly indicate the subjective conditions of individuals with regard to some elements of oral health, such as mastication problems, esthetic limitations and presence of pain 1.
The socio-dental indicators were developed to assess the subjective impacts on quality of life caused by the oral condition in individuals or populations 2,3. Among these indicators, the Oral Health Impact Profile (OHIP) is an instrument that assesses seven subjective dimensions through structured questions, with answers in a Likert type scale of impact frequency during a certain period of time 4. The reduced version of this instrument, the OHIP-14, was developed by Slade in 1997, and validated for use in an elderly population in Australia 5, and in an adult population in England 6 and Scotland 7. Furthermore, it was translated and trans-culturally adapted in ten languages 8,9,10,11,12,13,14,15,16,17, including Portuguese 12. Its validation however, was tested specially on elderly individuals and urban populations, and its use has not been validated for rural populations speaking Latin languages.
Rural populations, living in isolation from urban centers and with limited access to dental treatment, can perceive the impacts of tooth losses in peculiarly ways. The riverine populations that live along the banks of rivers in the countryside of the Amazonas State, Brazil, were recently characterized for their lack of access to urban centers, low levels of education, a low frequency of using oral health services, an elevated edentulism rate among the young and adult population, and a high prevalence of tooth pain 18,19. These factors, in addition to cultural and linguistic differences, can reduce the validation of an instrument designed in a different context from the one existent in these populations.
The present study therefore had the following objectives: (1) to test the psychometric properties of the Brazilian version of the OHIP-14 in a rural riverine population, with a low educational level; and (2) to compare the prevalence, severity and extent of the oral health impacts perceived in two rural riverine communities of the Brazilian Amazon, with different degrees of access to oral health services.
The data were obtained from a cross-sectional study designed to describe and compare the oral health conditions in two rural riverine communities in the state of Amazonas, each within a different distance from and accesses to the urban center (The Isidoro community is situated 8km from the municipal center, and the Lauro Sodré community 65km from the urban center). The study was approved by the Research Ethics Committee at the Federal University of Amazonas (process #130/2004), and all the participants signed the Terms of Informed Consent. The sample was composed of individuals over the age of 18 selected from both communities. Due to the impossibility of performing sample randomization (inexact universe quantification and absence of registration of individuals and addresses), the sample was acquired by means of convenience of access, including the individuals who appeared to the exam location on the previously informed days. The invitation to undergo dental exams was extended to every riverine family, in a personal visit made by the local Community Health Agents, without any expectation of receiving dental treatment.
The study was developed in two steps: a pilot study (January, 2006), and main study (March, 2006). During the pilot study, the logistics for clinical exams were tested and the language used in the original Portuguese questionnaire 12 was adapted by application of the instrument in a group of riverine individuals and discussing it with them (n = 10; 4 men and 6 women; mean age: 31.2; mean years of education: 2.89). Small alterations such as replacing the word "stressed" with "nervous", and "relax" with "rest" were made in the final version of the instrument used in the research (Figure 1), because of a lack of understanding of the original terms on the part of the respondents, and adopting their suggestions for changes. Additionally, there were some problems with understanding the options of answers. Hence, standardized explanations were adopted for the frequency scale: never (never in the last six months), rarely (once or twice in the last six months), sometimes (every month or every week in the last six months), usually (almost every day, or twice or more per week in the last six months), always (all the time, or every time that the event in question occurred in the last six months).
During the main study, two types of data collection were performed: clinical exams and interviews. The interviews included the OHIP-14 questionnaire and a structured questionnaire for socio-economic variables. The individuals were clinically examined in accordance with the World Health Organization (WHO) guidelines for epidemiological oral health surveys 20 by one single researcher (F.C.C.) previously trained in a calibration exercise with 20 repeated exams (kappa for crown condition: 0.97; kappa for treatment need: 0.98; kappa for prostheses need: 1.0; kappa for CPI: 0.75), under an artificial light condition (portable head lighting). The dental condition was recorded in accordance with the WHO standardizations for the crown (codes - 0: sound; 1: decayed; 2: filled, with decay; 3: filled, no decay; 4: missing, as a result of caries; 5: missing, any other reason; 6: fissure sealant; 7: bridge abutment, special crown or veneer/implant; 8: unerupted tooth; T: trauma; 9: not recorded), and for the treatment need (codes - 0: none; 1: one surface filling; 2: two or more surface fillings; 3: crown for any reason; 4: veneer or laminate; 5: pulp care and restoration; 6: extraction; 7: white spot remineralization; 8: fissure sealant; 9: not recorded) 20. Thus, the DMFT index was calculated. Additionally, the periodontal condition was assessed by the CPI score (codes - 0: healthy; 1: bleeding; 2: calculus; 3: shallow pockets 4-5mm; 4: deep pockets > 6mm; X: excluded), and the need for prostheses was recorded (codes - 0: no prosthesis needed; 1: need for one-unit prosthesis; 2: need for multi-unit prosthesis; 3: need for a combination of one- and/or multi-unit prostheses; 4: need for full prosthesis; 9: not recorded).
The socio-economic questionnaire, as well as the OHIP-14 was administered by another researcher (M.A.B.R.) in an interview format, due to the sample population's low educational level. The questionnaire also included the subjective variables: oral health perception (in a single question: "How do you think your oral health is?" 0: did not know/did not inform; 1: very bad; 2: bad; 3: regular; 4: good; 5: very good), oral pain in the last six months (codes - 0: none; 1: little pain; 2: median pain; 3: lot of pain), and perceived treatment need (codes - 0: needed; 1: not needed).
In order to test the reliability of the OHIP-14 by means of the Intraclass Correlation Coefficient (ICC), repeated interviews were performed on a group of individuals, through the test-retest method. The internal consistency of the instrument and the homogeneity of its seven dimensions were determined using Cronbach's alpha coefficient. Furthermore, the inter-item score correlation and the item-total score correlation were assessed 21.
OHIP-14 validity and association with
clinical and subjective variables
The instrument validity was evaluated by verifying the association between the OHIP scores and the designed variables that either objectively or subjectively indicated the oral condition of the riverine populations studied.
The convergent construct validity was assessed by association of the OHIP scores with the following objective clinical parameters: prostheses need (yes, any type of oral prostheses, codes 1 to 4; no, not needed, code 0); dental treatment need (yes, presence of at least one tooth classified between 1 and 8 in the treatment code; no, all the teeth with codes 0 or 9); need of high impact treatment (yes, presence of at least one tooth classified as 3, 5 or 6 in the treatment code; no, absence of teeth with the conditions 3, 5 or 6); presence of untreated dental caries (yes, component "D" of the DMFT index differing from zero; no, component "D" equal to zero); missing teeth (yes, component "M" of the DMFT index differing from zero; no, component "M" equal to zero); periodontal condition (according to the CPI index scores). The non-parametric test of Mann-Whitney was used for comparing the OHIP scores with the dichotomic nominal variables described above (after exploratory data analysis using the PROCLAB of the statistic software SAS). For comparing the CPI index and OHIP scores, Spearman's correlation coefficient (rs) was used.
Further to the convergent construct validity, the association of the OHIP scores with the subjective parameters was also evaluated: presence of pain in the last six months (yes: codes 1, 2 or 3; or no: code 0), and perceived need of treatment (yes: code 0; or no: code 1) - Mann-Whitney test.
The concurrent criterion validity was determined by the correlation between the OHIP-14 scores and the single question of self-perceived oral health, using Spearman's correlation coefficient. For the analysis, the answers "did not know/did not inform" were excluded.
Description of OHIP scores
The OHIP answers were coded in ordinal values from 0 (never) to 4 (always). After this, the scores were described for prevalence, extent and severity, according to the system established by Slade et al. 22 in 2005:
a) Prevalence: percentage of individuals who answered one or more items with "fairly often" or "very often";
b) Extent: number of items reported as "fairly often" or "very often";
c) Severity: the sum of the ordinal answers that considered the "occasionally" or "hardly ever" experimented impacts, which could range from 0 to 56.
For each community, prevalence, extent and severity were described with 95% confidence intervals.
The distribution of sex, mean age and years of education in the two communities were compared by the chi-square and Mann-Whitney tests, respectively.
In order to test the OHIP-14 reliability and validity, 126 individuals were tested (52 in Isidoro and 74 in Lauro Sodré), in which 61 of them answered the exams in duplicate for the ICC. All of the individuals who appeared at the exam location agreed to participate to the research. The sex distribution in the two communities was not statistically different (proportion of women in Isidoro and Lauro Sodré: 59.62% and 59.46% respectively, p = 0.986). The same occurred when evaluating years of education (mean number of years of schooling in Isidoro: 4.58 ± 3.43; and in Lauro Sodré: 3.99 ± 3.80; p = 0.15). The mean age was higher in Lauro Sodré (35.70 ± 12.57) than in Isidoro (30.50 ± 12.61), p = 0.0091.Psychometric properties of OHIP-14 and its association with clinical and subjective variables
The OHIP-14 stability, determined by the ICC, was excellent [0.97 (0.96-0.98)], varying from good to excellent in the 14 items (Table 1).
The internal consistency for the 14 items of the scale was good (0.89; lower limit 95%CI: 0.86). When evaluated separately, three of the seven dimensions had α values under 0.70 (Table 2). The scale items were moderately correlated among each other, however the item-total correlation was equal to or under 0.20 for questions P9, 11, 12 and 14 (Table 3).
The OHIP validity was assessed by association of the OHIP scores with the clinical and subjective parameters of each individual. The clinical parameters: need for prostheses, need of treatment, need of high impact treatment, presence of untreated caries and missing teeth; and the subjective parameters: presence of pain in the last six months and self-perceived need of treatment; presented significant association with the OHIP scores (p < 0.05), determining the convergent construct validity (Table 4).
The convergent construct validity was also determined by the weak, but significant, positive correlation between the OHIP-14 scores and the CPI index scores: rs = 0.1921 (p = 0.0312) - Spearman Correlation Coefficient.
The concurrent criterion validity was determined by the negative correlation between the OHIP-14 scores and the single question of oral health self-perception: rs = -0.4157 (p < 0.0001) - Spearman Correlation Coefficient.
Prevalence, severity and extent of the OHIP-14 scores in the riverine communities
The prevalence, extent and severity of the negative impacts of oral health on the individuals' quality of life were greater in Lauro Sodré than in Isidoro, although only the prevalence and the severity had shown statistical significance (Table 5).
Comparison between the sexes in the two communities showed a significantly greater prevalence of impacts on women [66.7 (56.0-77.3)] than in men [49.1 (35.3-62.7)]. Although the extent of impacts showed no statistical significance between sexes (p = 0.1074, Mann-Whitney test), the severity was greater in women than in men (p = 0.0338, Mann-Whitney test).
Discussion and conclusions
The psychometric properties of the Brazilian version of OHIP-14, applied to riverine rural populations in the Brazilian Amazon, were acceptable considering the validity obtained, the scale Cronbach's alpha coefficient above the satisfactory level (0.70) for group comparisons 23 and the high ICC. As regards some of the scale dimensions, an α coefficient under 0.70 also occurred in the validation of short versions of the OHIP that used this evaluation methodology 10,12 and in the original description of the instrument 4. This can be justified by the smaller number of items in the short instruments 24. The moderate correlation among the scale items is desirable, because it reveals colinearity between them. However, items 9 (difficulty to rest), 11 (being a bit irritable), 12 (difficulty to perform your daily activities) and 14 (unable to perform your daily activities) presented a correlation with the total scores of the scale equal to or under 0.20, which suggests that they did not significantly contribute to the perception of oral health impacts on the lives of these populations. According to Streiner & Norman 21 an item-total scale correlation under 0.20 suggests the need for removing or rephrasing these items. However, before eliminating the items with low correlation, it is prudent to consider what may have happened. The scale items evaluate more than one dimension of the construct that they represent, therefore weaker correlations between item-total scores can be found. Another plausible explanation for the bad performance of items 9, 11, 12 and 14, would be the composition of the samples. It is strange that in a population with high rates of illnesses - tooth pain prevalence, untreated caries and tooth loss 19 - precisely the items that evaluated the most severe impacts 25 had had less correlation with the total scores of the scale. Perhaps, the riverine populations with little access to and scarcely any dental treatment 18 had learned to live with the oral health impacts on their lives, and even the most severe of these are not considered reasons for psychological or social disability.
The association of the OHIP-14 scores with the clinical and subjective variables obtained for the questionnaire validation, is in accordance with studies of OHIP validation in other populations 12,26,27. However, one additional item of information resulting from the present study was the more significant association with clinical variables defined as being of high impact on the patients. For the interviewed riverine individuals, the presence of pain, untreated caries, teeth requiring extraction or the need for endodontic treatment, were more significant oral conditions for the perception of negative impacts on their lives than tooth loss, the periodontal condition, or the need for prostheses. This result points out the remarkable contribution of pain and the variables related to it, on the quality of life related to oral health in these populations. A less significant association with tooth losses can be expected in a population in which the consequences of these losses could be minimized by the use of prostheses 28. However, this was not the case in the studied riverine populations, since the majority of individuals with tooth losses are in need of prostheses 29.
The mean OHIP found in the riverine populations was higher than the values found in representative samples in Australia (7.4 ± 0.13) and in England (5.1 ± 0.11) 30, and in Brazilian adolescents (3.95 ± 4.88) 31; and equivalent to the value found in individuals with low frequency of visits to the dentist in Australia 32. Furthermore, the prevalence and extent of the impacts on the riverine individuals were significantly greater when compared with those on populations in Australia and England 22. It is worth pointing out that the convenience sample design used in the present study means that it is not possible to make generalizations. However, obtainment of a random and representative sample of the riverine communities would come up against the difficulties of absence of records and registration of residents, as well as the dispersion of homes along the rivers, which would greatly increase the time and cost of research that included the development of these records in its preliminary stage.
The limited access to oral health services 18 can be a reason for the greater prevalence of the impacts on Lauro Sodré when compared with Isidoro. Sanders et al. 32 described more OHIP impacts on individuals with low frequency of visits to the dentist, when compared with individuals that visited with moderate or high frequency. Another possible explanation is the higher mean age in the population sample of Lauro Sodré. Although the association between age and OHIP scores was not tested in the present study, the supposition of oral problems being more concentrated in older persons and that these problems would have more impacts on their lives than they would have on the lives of younger persons, has been mentioned in the literature 33. However one review of the subject pointed out the possibility of interaction or confusion between age and clinical variables such as prostheses use, tooth loss and xerostomia 34.
The greater prevalence of impacts on women sustains the hypothesis that women are usually more concerned with their oral health, and perceive either the negative or positive impacts more than men do 34.
The results of this study showed that the Brazilian version of the OHIP-14 adapted to these riverine rural populations of the Amazon was valid, reproducible and consistent; allowing the definition of oral conditions with greater impact on the quality of life in these populations. However, some items related to psychological and social disability and handicap presented a poor correlation with the total score of the scale. Moreover, a high prevalence was found of negative oral health impacts on the lives of the riverine individuals, especially for the community located further away from the urban center. These findings corroborate the importance of using self-perceiving methods of oral health as a complement to the traditional methods of treatment need, and for planning public policies adapted to the specificities of these populations.
F. Cohen-Carneiro contributed to the study conception, methodological design, data collection and analysis, and writing of the article. M. A. B. Rebelo contributed to the methodological design, data collection and critical review of the manuscript. R. Souza-Santos contributed to the methodological design, data analysis, and critical review of the manuscript. G. M. B. Ambrosano worked on the statistical data analysis, and critical review of the manuscript. A. V. Salino worked on the data collection and critical review of the manuscript. D. G. Pontes worked on the data collection and critical review of the manuscript.
This study was financed by the Funding Agency of the Amazon State (FAPEAM), through the edictal Amazonas' Program to Support Research for Public Policies in Strategic Areas (PPOPE), process # 1350/05, and through a scholarship fund of the program RH-INTERINSTITUTIONAL-FAPEAM.
1. Sheiham A, Steele JG, Marcenes W, Tsakos G, Finch S, Walls AWG. Prevalence of impacts of dental and oral disorders and their effects on eating among older people; a national survey in Great Britain. Community Dent Oral Epidemiol 2001; 29:195-203.
2. Cohen LK, Jago JD. Toward the formulation of sociodental indicators. Int J Health Serv 1976; 6:681-98.
3. Locker D. Measuring oral health: a conceptual framework. Community Dent Health 1988; 5:3-18.
4. Slade GD, Spencer AJ. Development and evaluation of the Oral Health Impact Proûle. Community Dent Health 1994; 11:3-11.
5. Slade GD. Derivation and validation of a short-form oral health impact profile. Community Dent Oral Epidemiol 1997; 25:284-90.
6. Robinson PG, Gibson B, Khan FA, Birnbaum W. Validity of two oral health-related quality of life measures. Community Dent Oral Epidemiol 2003; 31:90-9.
7. Fernandes MJ, Ruta DA, Ogden GR, Pitts NB, Ogston SA. Assessing oral health-related quality of life in general dental practice in Scotland: validation of the OHIP-14. Community Dent Oral Epidemiol 2006; 34:53-62.
8. Wong MC, Lo EC, McMillan AS. Validation of a Chinese version of the Oral Health Impact Proûle (OHIP). Community Dent Oral Epidemiol 2002; 30:423-30.
9. Perera I, Ekanayake L. Prevalence of oral impacts in a Sinhala-speaking older population in urban Sri Lanka. Community Dental Health 2003; 20:236-40.
10. Kushnir D, Zusman SP, Robinson PG. Validation of a Hebrew version of the oral health impact profile 14. J Public Health Dent 2004; 64:71-5.
11. Ikebe K, Watkins CA, Ettinger RL, Sajima H, Nokubi T. Application of short-form oral health impact profile on elderly Japanese. Gerodontology 2004; 21:167-76.
12. Oliveira BH, Nadanovsky P. Psychometric properties of the Brazilian version of the Oral Health Impact Profile - Short form. Community Dent Oral Epidemiol 2005; 33:307-14.
13. Saub R, Locker D, Allison P. Derivation and validation of the short version of the Malaysian Oral Health Impact Proûle. Community Dent Oral Epidemiol 2005; 33:378-83.
14. John MT, Miglioretti DL, LeResche L, Koepsell TD, Hujoel P, Micheelis W. German short forms of the Oral Health Impact Proûle. Community Dent Oral Epidemiol 2006; 34:277-88.
15. Hägglin C, Berggren U, Hakeberg M, Edvardsson A, Eriksson M. Evaluation of a Swedish version of the OHIP-14 among patients in general and specialist dental care. Swed Dent J 2007; 31:91-101.
16. Bae KH, Kim HD, Jung SH, Park DY, Kim JB, Paik DI, et al. Validation of the Korean version of the oral health impact proûle among the Korean elderly. Community Dent Oral Epidemiol 2007; 35:73-9.
17. Rener-Sitar K, Petrievi N, elebi A, Marion L. Psychometric properties of Croatian and Slovenian short form of Oral Health Impact Profile Questionnaires. Croat Med J 2008; 49:536-44.
18. Cohen-Carneiro F, Souza-Santos R, Pontes DG, Salino AV, Rebelo MAB. Oferta e utilização de serviços de saúde bucal no Amazonas, Brasil: estudo de caso em população ribeirinha do Município de Coari. Cad Saúde Pública 2009; 25:1827-38.
19. Cohen-Carneiro F. Condição de saúde bucal em populações ribeirinhas no Estado do Amazonas: estudo de caso [Doctoral Dissertation]. Rio de Janeiro: Escola Nacional de Saúde Pública Sergio Arouca, Fundação Oswaldo Cruz; 2009.
20. World Health Organization. Oral Health Surveys - basic methods. Geneva: World Health Organization; 1997.
21. Streiner D, Norman G. Health measurement scales. A practical guide to their development and use. Oxford: Oxford University Press; 1995.
22. Slade GD, Nuttall N, Sanders AE, Steele JG, Allen PF, Lahti S. Impacts of oral disorders in the United Kingdom and Australia. Br Dent J 2005; 198:489-93.
23. Bland JM, Altman DG. Statistics notes - Cronbach's alpha. BMJ 1997; 314:572.
24. Awad M, Al-Shamrany M, Locker D, Allen F, Feine J. Effect of reducing the number of items of the Oral Health Impact Proûle on responsiveness, validity and reliability in edentulous populations. Community Dent Oral Epidemiol 2008; 36:12-20.
25. Locker D, Allen PF. Developing short-form measures of oral health-related quality of life. J Public Health Dent 2002; 62:13-20.
26. Soe KK, Gelbier S, Robinson PG. Reliability and validity of two oral health related quality of life measures in Myanmar adolescents. Community Dental Health 2004; 21:306-11.
27. Brennan DS, Spencer AJ. Comparison of a generic and a specific measure of oral health related quality of life. Community Dental Health 2005; 22:11-8.
28. Locker D, Matear D, Stephens M, Lawrence H, Fayne B. Comparison of the GOHAI and OHIP-14 as measures of the oral health-related quality of life of the elderly. Community Dent Oral Epidemiol 2001; 29:373-81.
29. Cohen-Carneiro F, Pontes DG, Salino AV, Parente RCO, Souza-Santos R, Rebelo MAB. Prevalência de cárie dental e necessidade de prótese em uma população ribeirinha de Coari-AM: Comunidade Isidoro. Braz Oral Res 2006; 20 Suppl:32.
30. Steele JG, Sanders AE, Slade GD, Allen PF, Lahti S, Nuttall N, et al. How do age and tooth loss affect oral health impacts and quality of life? A study comparing two national samples. Community Dent Oral Epidemiol 2004; 32:107-14.
31. Biazevic MG, Rissotto RR, Michel-Crosato E, Mendes LA, Mendes MOA. Relationship between oral health and its impact on quality of life among adolescents. Braz Oral Res 2008; 22:36-42.
32. Sanders AE, Spencer AJ, Slade GD. Evaluating the role of dental behaviour in oral health inequalities. Community Dent Oral Epidemiol 2006; 34:71-9.
33. Locker D. The burden of oral disorders in a population of older adults. Community Dental Health 1992; 9:109-24.
34. Cohen-Carneiro F, Souza-Santos R, Rebelo MAB. Quality of life related to oral health - contribution from social factors. Ciênc Saúde Coletiva; in press.
Faculdade de Odontologia
Universidade Federal do Amazonas
Rua Rio Mar 1203, apto. 901
Manaus, AM. 69053-120, Brasil
Submitted on 22/Sep/2009
Final version resubmitted on 04/Jan/2010
Approved on 12/Mar/2010