INVESTIGACIÓN ORIGINAL ORIGINAL RESEARCH
Geographic information system and multilevel analysis: gingival status among 12-year-old schoolchildren in São Paulo, Brazil
Sistema de información geográfica y análisis de niveles múltiples: estado gingival en escolares de 12 años de edad en São Paulo, Brasil
Stela Márcia PereiraI; Vanessa PardiII; Karine L. CortellazziIII; Glaucia Maria Bovi AmbrosanoIII; Carlos Alberto VettorazziIV; Sílvio F.B. FerrazIV; Marcelo de Castro MeneghimIII; Antonio Carlos PereiraIII
IUniversidade Federal de Lavras, Área de Epidemiologia e Saúde Pública/Setor de Preventiva, Lavras, Minas Gerais, Brazil. Send correspondence to Stela Márcia Pereira, email: email@example.com
IIHerman Ostrow School of Dentistry, University of Southern California, Division of Periodontology, Diagnostic Sciences and Dental Hygiene, Los Angeles, California, United States of America
IIIFaculdade de Odontologia de Piracicaba, Universidade Estadual de Campinas, Piracicaba, São Paulo, Brazil
IVUniversidade de São Paulo, Departamento de Engenharia Rural, Piracicaba, São Paulo, Brazil
OBJECTIVE: To evaluate gingival and calculus status among schoolchildren 12 years of age using a geographic information system and multilevel analysis.
METHODS: A total of 1 002 schoolchildren were selected from 18 municipal districts by means of cluster sampling, from among 25 public and private schools in Piracicaba, São Paulo, Brazil, in 2005. Examinations were carried out by a single calibrated examiner utilizing the criteria of the World Health Organization, as well as the Community Periodontal Index. Social, economic, and behavioral variables were recorded with the use of a questionnaire and were used in the individual analysis (first level). The variables "percentage of heads of families without income" and "percentage of illiterate heads of families" were used in the contextual analysis (second level).
RESULTS: A geographic information system was constructed for mapping the distribution of gingival bleeding. The variables were visually distinguished in the maps and demonstrated a tendency toward better gingival health in the central areas of the city, which are recognized as more privileged. On the contextual level, only the "percentage of illiterate heads of families" was significantly associated to gingival bleeding.
CONCLUSIONS: The study confirms better oral health status among schoolchildren from privileged families, but does not confirm the data regarding "income." The individuals from areas in which the heads of family did not have income were not associated to a higher prevalence of gingival problems. This suggests that these individuals are reasonably protected from the impact of social privation due to the actions of public health care services in the municipality.
Keywords: Geographic Information Systems; gingivitis; preventive dentistry; oral health; Brazil.
OBJETIVO: Evaluar el estado gingival y la presencia de sarro en escolares de 12 años de edad mediante el empleo de un sistema de información geográfica y análisis de niveles múltiples.
MÉTODOS: En el año 2005, se seleccionó a un total de 1 002 escolares de 18 distritos municipales mediante muestreo por grupos, con la participación de 25 escuelas públicas y privadas de Piracicaba, en el estado de São Paulo, Brasil. Un único examinador calibrado, que utilizó los criterios de la Organización Mundial de la Salud, así como el Índice Periodontal Comunitario, llevó a cabo los exámenes. Mediante un cuestionario, se registraron las variables sociales, económicas y conductuales, y estas se emplearon en el análisis individual (primer nivel). En el análisis contextual (segundo nivel), se utilizaron las variables "porcentaje de cabezas de familia sin ingresos" y "porcentaje de cabezas de familia analfabetas".
RESULTADOS: Se construyó un sistema de información geográfica para elaborar mapas de la distribución de la hemorragia gingival. Los mapas, donde se pueden distinguir visualmente las variables, demostraron una tendencia hacia una mejor salud gingival en las zonas del centro de la ciudad, consideradas como privilegiadas. En el nivel contextual, únicamente el "porcentaje de cabezas de familia analfabetas" se asoció significativamente con el sangrado gingival.
CONCLUSIONES: El presente estudio confirma una mejor salud bucodental en los escolares pertenecientes a familias privilegiadas, pero no confirma los datos en cuanto a "ingresos". Las personas residentes en zonas donde las cabezas de familia no tenían ingresos no presentaron una mayor prevalencia de problemas gingivales. Esto indica que estas personas, como consecuencia de las actividades de los servicios de atención de salud pública del municipio, están razonablemente protegidas de la repercusión de la privación social.
Palabras clave: Sistemas de información geográfica; gingivitis; odontología preventiva; salud bucal; Brasil.
Studies on oral health have long kept their focus on the evaluation of individual factors in the determination of disease. However, such studies are limited with regard to the comprehension of the complexity of real-life social processes (1). As our senses are not able to grasp the world in its totality, the construction of models that can explain reality is necessary. Maps constitute explanatory, representative models of the real worldmore specifically, real space (2). Moreover, multilevel analysis can be employed to address the interrelationships between the environment and individuals through the simultaneous analysis of individual and contextual variables (3).
Geographic information systems (GIS) are used to aggregate and analyze variables necessary for ecological studies. This type of system recognizes the relationship between the distribution and impact of diseases in the spaces in which they occur. It also helps clarify phenomena that cannot be adequately visualized using data displayed in tables, thus reaffirming the relationship between epidemiology and cartography (4).
Isolated efforts have characterized the recognized centuries-long relationship between geography and human health. In the last 10 years, international interest in this relationship has been renewed in academic and health care management fields. Such interest stresses the positive, progressive impact of the use of spatial analysis in public health care, as well as the pertinence of a prudent, careful way of evaluating results (5).
The aim of the present study was to evaluate gingival status in 12-year-old schoolchildren in the city of Piracicaba using a GIS and multilevel analysis.
MATERIALS AND METHODS
This study received approval from the Research Ethics Committee of the Piracicaba Dental School, State University of Campinas (UNICAMP), Piracicaba, São Paulo, Brazil) (protocols #148/2003; #098/2006). Children were given an informed consent form to be taken home for their parent's signature; only those with signed forms were permitted to participate in the study.
The city of Piracicaba (São Paulo state, Brazil) has a population of 385 287 inhabitants, and a city area of 1 3 78 501 km2. The Human Development Index (HDI) is 0.785 and monthly income per capita for the urban area population is around R$ 755 (approximately US$ 324) (6).
Prior to the exams, a questionnaire addressing socioeconomic status and the child's behavioral habits was sent to the parents. The questionnaire consisted of items on monthly household income, number of people living in the household, home ownership, mother's education, father's education, car ownership, toothbrushing habits, and access to oral health care (7).
The sample size was calculated based on a prior study (8), considering a statistical power of 0.80, significance level of 0.05, and odds ratio of 1.5. Cluster sampling was employed to select 1 100 student 12 years of age from public and private schools in 18 districts of the municipality of Piracicaba, São Paulo, Brazil, based on geographic location. The proportion between public and private schools in the municipality was taken into account. Twenty-five public and private schools took part in the present study and the sample was made up of 1 002 students (loss < 10%).
The city has an Oral Health Program called "Sorria Piracicaba" ("Smile Piracicaba") for children of 0 10 years of age registered in public schools. Four times a year the children brush their teeth under supervision of dental hygienists or dentists from Brazil's Family Health Program, and receive oral hygiene kits with toothpaste, toothbrush, and floss. Furthermore, an educational program in oral health, recreational, theatrical activities, and presentations are provided. During the annual meetings, school teachers are given oral health training and education. The schoolchildren from the present study had received preventive care and oral health education in the years leading up to the study.
Piracicaba has two water treatment stations. Since 1971, the community water supply is fluoridated and the control of the optimum levels (0.60.8 ppm F, considering the highest temperature of 37.5ÂºC and the lowest 18ÂºC) are done by continuously monitoring the levels and making necessary adjustments when needed.
The exams were carried out by a single examiner who followed the criteria recommended by the World Health Organization (WHO) (9). The exams were conducted in an outdoor setting under natural light immediately after tooth brushing and flossing to remove dental biofilm, using a Community Periodontal Index (CPI) probe with a diameter of 0.5 mm (ballpoint). The students received a tooth brushing kit (a regular toothbrush, toothpaste, and floss) and performed the tooth brushing and flossing under the supervision of a dental hygienist.
The examiner was previously trained (calibrated) by a "gold standard" expert epidemiologist. The examiner was calibrated at the beginning of the 12-month study regarding gingival evaluation and dental caries diagnosis (10). The five calibration exercises (baseline 3, 6, 9, and 12 months) were performed during the exam of the schoolchildren, as well as the calculation of the agreement rate and Kappa statistics.
In the present study, approximately 10% of the sample was reexamined in order to determine intra-examiner reproducibility; the mean Kappa value for the periodontal exam was > 0.86.
The gingival status of the students was evaluated using the Community Periodontal Index (CPI) to detect gingival bleeding and dental calculus. Based on WHO criteria for individuals less than 20 years of age, only six index teeth (#16, #11, #26, #36, #31, and #46) were examined. Six sites were evaluated on each tooth. The periodontal pocket was not included in the evaluations due to the age of the individuals. The DMFS index (Decayed, Missing, and Filled surfaces of the tooth index) was used to evaluate dental cavities and the WHO criteria (9) was applied.
The presence or absence of bleeding sites and gingival calculus were used as dependent variables. The chi-square test was used to compare these variables to the dental caries index, socioeconomic, and behavioral variables. Multilevel statistical modeling was performed to identify variables associated with areas of social privation on two levelsindividual and contextual (districts) at a 5% level of significance. The socioeconomic and behavior variables were the independent variables for the individual level; for the contextual level, the following demographic variables were the independent variables: percentage of heads of families without income and percentage of illiterate heads of families. In the present study, areas with heads of family with no income (No. > 4) and percentage of illiterate heads of families (> 3) were considered social deprivation areas. The cluster variables were obtained from the Research and Planning Institute of Piracicaba (IPPLAP, Piracicaba, São Paulo, Brazil) (11). Odds ratios and respective 95% confidence intervals (95%CI) were estimated. Associations between the independent variables were evaluated in order to avoid the multicollinearity during the chi-square test. All the statistics were performed using SAS 9.1.2 (SAS Institute Inc., Cary, North Carolina, United States).
A GIS was constructed using the entire urban area of the municipality of Piracicaba, including a district 21.8 km from Piracicaba. Eighteen neighborhoods were sampled. The data were geo-referenced using thematic maps. The system was constructed to map the data using ArcView 3.1 software (Environmental Systems Research Institute Inc., Redlands, California, United States). First, the districts were drawn with the aid of satellite photographs and maps of the municipality of Piracicaba. A georeferenced database was then created to construct the GIS (system composed of database, variables, themes, and maps). Areas at risk for gingival bleeding were identified and mapped. Due to low frequency of calculus in the present sample, the results were presented only in tables.
Associations were found in the present study between dental caries (DMFS Index) (P < 0.0001), monthly household income (P < 0.0001), father's education (P < 0.0001), mother's education (P < 0.0001), car ownership (P = 0.027), tooth brushing frequency (P = 0.0305), age at first tooth brushing (P = 0.0046), and absence or presence of gingival bleeding sites (Table 1).
The DMFS index was 1.88 for the overall sample, and 0.63 and 2.05 for private and public schools, respectively. Independent variables with a P-value < 0.15 were included in the multilevel model.
On the individual level, the schoolchildren with caries experience (presence of dental caries in the past, i.e., filled or missing teeth, and/or current presence of dental caries DMFS > 0 (Odds Ratio [[OR] = 4.68; 95%CI = 3.536.20) and those who began tooth brushing at a later age (OR = 1.49; 95%CI = 1.042.14) had a greater chance of exhibiting gingival bleeding sites. On the contextual level, only the variable "percentage of illiterate heads of families" was associated to gingival bleeding (Table 2).
There was a significant association between the presence or absence of sites with calculus and the following variables: gender (P = 0.030), visits to the dentist (P = 0.061), car ownership (P = 0.072), and home ownership (P = 0.050) (Table 3). To avoid multicollinearity in this data, an association analysis was performed and a highly significant association was found between car ownership and home ownership. Thus, only the latter was tested in the multivariate model (Table 3).
Calculus was associated to the variables "gender" (OR = 1.64; 95%CI = 1.04 2.58) and "home ownership" (OR = 1.76;f 95%CI = 1.112.78) on the individual level (P < 0.05), whereas calculus was only associated to the variable "percentage of illiterate heads of families" on the contextual level (Table 4).
The maps allow the visualization of a tendency toward better oral health (lower scores of gingival bleeding) in the downtown area of the municipality, which is considered to be a privileged area with the highest percentage of individuals earning a higher income and more years of education (Figure 1). However, on the contextual level of the multilevel analysis, only "percentage of illiterate heads of families" was significantly associated to both outcomes, whereas "income" was not statistically associated to these oral heath problems.
Analysis of the social and spatial phenomena involved in the health and disease processes can be done in the more important ecological studies conducted in recent years. These phenomena are complex and methodological refining is needed not to simplify them, but reproduce the static, isolated notion of space (2).
The use of geoprocessing can identify relationships between the distribution of health problems and environmental conditioning factors by aggregating and mapping variables from different sources (4). Determining associations between space and health problems has been investigated in the non-dental literature (12, 13). In dentistry, however, studies on this subject are scarce (14).
A geographic vision is a key aspect in public health. The population and communities tend to have their own characteristics according to their geographical distribution. Factors that influence the health of a community are classified into four groups: inherited conditions; environment (air and water quality, soil characteristics, radiation, and socioeconomic conditions); lifestyle; and health care (15).
GIS provides a broad source of tools for exploring data. These systems can be defined as a set of tools for the acquisition, storage, retrieval, analysis, and interpretation of spatial data (16, 17). The incorporation of mapping revealed inequalities in relation to the oral health status in the municipality studied. This tool is useful for evaluating and easily visualizing the areas that should receive more attention from health care managers. GIS applied to track the oral health of a population has been extremely effective at revealing the distribution of oral health problems and assisting in the planning and evaluation of the effectiveness of tailored health promotion and preventive care in underprivileged areas (14, 1821).
It should be stressed that oral health actions should be considered, discussed, and carried out by different sectors. Moreover, actions directed at oral health alone are unable to solve problems related to the distribution of disease. The territory is a reflection of the socioeconomic condition of its inhabitants and is influenced by social and political inequalities. Thus, a territory can adversely influence the health status of its inhabitants and perpetuate poverty (2).
In Brazil, as well as the municipality studied here, most of the individuals enrolled in public schools are from underprivileged families that live in areas of social deprivation and do not have financial resources to afford private school (7). These individuals are distinguished by having a greater number of caries and lower access to the health services (7, 21). Although social inequality in Brazil is evident (22, 23), especially the contrast between very wealthy families extremely poor families, and this inequality is visible in the data from the map constructed of the area studied (Figure 1)this social difference is not always statistically significant from a geographical standpoint, as people with different socioeconomic levels often occupy the same area. It is possible to find rich and poor individuals living in the same geographical space due to fast urban growth, as well as the growth of inequality itself.
This complexity of social factors is related to oral health problems, which means that analysis and actions that respect this complexity are required. Careful analysis is, therefore, important and should unify all the tools that can clearly different populations. The application of geographical and multilevel analysis can offer more consistency and reliability to epidemiological data. The latest periodontal studies have used Multilevel Modeling (24), which results in a better comprehension of the structure of the complex data found in health, such as the complexity of the progression of periodontal disease and the factors predicting (25, 26) its impact on general health and the importance of surveillance regarding periodontal disease (26, 27).
Further studies that take geographical areas into account are needed in order to enhance the understanding of social inequalities in oral health and lead to the development of interventions for diminishing these inequalities. Progress in understanding the causes of social inequalities will remain limited unless there is a general change in the manner in which health is measured (28). This complexity was first recognized in the 1990s (29) by a study that considered caries to be a complex disease, with a number of social characteristics that may influence its distribution. This suggests that a detailed analysis of the data found in literature is necessary in order to identify groups that are more exposed to disease.
The present study used spatial analysis and statistical model analysis on multiple levels with the purpose of obtaining a better understanding of the data. Bivariate analysis (chi-square test) was used to determine associations between the variables studied (social, economic, and behavioral) and gingival and calculus status. From the data of this first analysis, multilevel models were constructed, in which only the variables that were associated to the outcomes were included. The mapping of the areas at risk for gingival problems was then carried out by means of a GIS.
From the data evaluated in the different analyses, social, economic, and behavioral variables are directly associated to levels of disease (chi-square test, Tables 1 and 3). This can be seen on the map (Figure 1), which shows a tendency toward better oral health in the privileged downtown areas. Regarding multilevel analysis, on the individual level, the experience with caries and age at first tooth brushing were associated to gingival bleeding, whereas gender and home ownership were associated to calculus. However, on the contextual level (districts), only the percentage of illiterate heads of families was statistically significant in both outcomes, and income was not associated with these oral health problems. These results suggest that individuals who live in places in which the percentage of illiterate heads of families is higher will have a greater proneness toward gingival problems (Tables 2 and 4). However, areas in which the income of the head of family is low were not associated to worse oral health status. This result disagrees with a large number of previous studies, which have found income to be a major factor of social deprivation and strongly associated to oral health problems, especially in Brazil (3033). However, income alone is insufficient to test materialist theories regarding health inequalities (28).
This disagreement can be related to the presence of an oral health program directed at schoolchildren that involves a partnership between the dental school, a local company, city hall, and the state dentistry association. Treatment, along with preventive and educative measures, is offered to 5 000 students from the public schools administered by the local Board of Education of Piracicaba, São Paulo. The schoolchildren examined in the present study were enrolled in preventive and educational oral health programs during the years preceding this study. In addition, the community water supply has been treated with fluoride since 1971. These procedures reach the less privileged and minimize the impact of social and environmental factors on individuals. They help to reduce the existing differences regarding oral health between schoolchildren from low-income and high-income families. The study suggests that these individuals are reasonably protected from the impact of social deprivation by the municipality's public health care services and actions regarding the oral health prevention and treatment. The approach taken in the study reveals an understanding that certain socioeconomic inequalities may be sidestepped by means of oral health care programs that reach the socially underprivileged. It is important to report the efforts of the public health care services in the municipality studied.
The results of the present study could be better explained by long-term prospective ecological studies in which there are a greater number of groups and individuals (3). An authentic causal relationship could only be confirmed by randomized, controlled, prospective studies (24) that test the predictive value of variables associated to gum disease and onset of lesions with the aim of finding viable mechanisms of disease surveillance (27). The distribution of disease is commonly determined by three pillars: person, time, and space (15, 34).
Another study limitation is that in some areas, the physical environment of the municipality does not present a clear division between the different social strata. Disorderly expansion of urban areas gives rise to areas where luxury condominiums coexist with areas of social deprivation. This panorama is still evolving; however, it can already be seen as a limitation of this study.
The present study confirms better oral health status among schoolchildren from privileged families, but it does not confirm data regarding the socioeconomic cluster variable "income." Individuals whose head of family had no income were not associated to a higher prevalence of gingival problems. From the findings of the present study, it is possible to conclude that, on the individual level, socioeconomic variables were associated with a higher prevalence of the gingival bleeding and calculus, but this relationship was not observed in the multilevel model. By means of multilevel analysis and the use of a geographic information system, it was possible to better evaluate oral health status and construct a panorama of this condition in a small area.
Conflict of interests. None
1. Newton JT, Bower EJ. The social determinants of oral health: new approaches to conceptualizing and researching complex causal networks. Community Dent Oral Epidemiol. 2005;33(1):2534.
2. Moreira RF, Nico LS, Tomita NE. A relação entre o espaço e a saúde bucal coletiva: por uma epidemiologia georreferenciada. Cien Saude Colet. 2007;12(1):27584.
3. Bower E, Gulliford M, Steele J, Newton T. Area deprivation and oral health in Scottish adults: a multilevel study. Community Dent Oral Epidemiol. 2007;35(2):11829.
4. Lopes FS, Ribeiro H. Mapping of hospitalizations due to respiratory problems and possible associations to human exposure to burnt sugar-cane straw products in the state of São Paulo. Rev Bras Epidemiol. 2006;9(2): 21525.
5. Rojas LI, Barcellos C. Geografía y salud en américa latina: evolución y tendências. Rev Cubana Salud Pública. 2003;29(4):33043.
6. Brazilian Institute of Geography and Statistics. Available at: http://www.ibge.gov.br/english/disseminacao/eventos/missao/default.shtm Accessed 13 December 2013.
7. Pereira SM, Tagliaferro EPS, Ambrosano GMB, Cortellazzi KL, Meneghim MC, Pereira AC. Dental caries in 12-year-old schoolchildren and its relationship with socioeconomic and behavioral. Oral Health Prev Dent. 2007;5(4):299306.
8. Demidenko E. Sample size and optimal design for logistic regression with binary interaction. Stat Med. 2008; 27(1):3646.
9. World Health Organization. Oral health surveys: basic methods. 4th ed. Geneva: WHO; 1997.
10. Assaf AV, de Castro Meneghim M, Zanin L, Tengan C, Pereira AC. Effect of different diagnostic thresholds on dental caries calibration a 12 month evaluation. Community Dent Oral Epidemiol. 2006;34(3):2139.
11. Instituto de Pesquisas e Planejamento de Piracicaba. Available at: http://www.ipplap.com.br. Accessed 16 December 2013.
12. Tiwari N, Adhikari CMS, Tewari A, Kandpal V. Investigation of geospatial hotspots for the occurrence of tuberculosis in Almora district, India, using GIS and spatial scan statistic. Int J Health Geogr. 2006;10;5:33.
13. Harris DE, Aboueissa A, Hartley D. Myocardial infarction and heart failure hospitalization rates in Maine, USAvariability along the urban-rural continuum. Rural Remote Health. 2008;8(2):980.
14. Antunes JLF, Frazão P, Narvai PC, Bispo CM, Pegoretti T. Spatial analysis to identify differentials in dental needs by area-based measures. Community Dent Oral Epidemiol. 2002;30(2):13342.
15. Maheswaran R, Craglia M. GIS in public health practice. 1st ed. Boca Raton: CRC Press; 2004.
16. Graham AJ, Atkinson PM, Danson FM. Spatial analysis for epidemiology. Acta Trop. 2004;91(3):21925.
17. Ruankaew N. GIS and epidemiology. J Med Assoc Thai. 2005; 88(11):17358.
18. Carvalho ML, Moysés SJ, Bueno RE, Shimakura S, Moysés ST. A geographical population analysis of dental trauma in school-children aged 12 and 15 in the city of Curitiba-Brazil. BMC Health Serv Res. 2010;13(10):203.
19. Strömberg U, Holmn A, Magnusson K, Twetman S. Geo-mapping of time trends in childhood caries riska method for assessment of preventive care. BMC Oral Health. 2012; 12:9.
20. Chiang CT, Lian IeB, Su CC, Tsai KY, Lin YP, Chang TK. Spatiotemporal trends in oral cancer mortality and potential risks associated with heavy metal content in Taiwan soil. Int J Environ Res Public Health. 2010;7(11): 391628.
21. Lopes RM, Domingues GG, Junqueira SR, Araujo ME, Frias AC. Conditional factors for untreated caries in 12-year-old children in the city of São Paulo. Braz Oral Res. 2013;27(4):37681.
22. Antunes JL, Peres MA, de Campos Mello TR, Waldman EA. Multilevel assessment of determinants of dental caries experience in Brazil. Community Dent Oral Epidemiol. 2006;34(2):14652.
23. Pabayo R, Chiavegatto Filho AD, Lebrão ML, Kawachi I. Income inequality and mortality: results from a longitudinal study of older residents of São Paulo, Brazil. Am J Public Health. 2013;103(9):439.
24. Tu YK, Gilthorpe MS, Griffiths GS, Maddick IH, Eaton KA, Johnson NW. The application of multilevel modeling in the analysis of longitudinal periodontal datapart II: Changes in disease levels over time. J Periodontol. 2004;75(1):13745.
25. Gilthorpe MS, Griffiths GS, Maddick IH, Zamzuri AT. An application of multilevel modelling to longitudinal periodontal research data. Community Dental Health. 2001;18(2):7986.
26. Wan CP, Leung WK, Wong MC, Wong RM, Wan P, Lo EC, Corbet EF. Effects of smoking on healing response to non-surgical periodontal therapy: a multilevel modelling analysis. J Clin Periodontol. 2009;36(3):22939.
27. Tomar SL. Public health perspectives on surveillance for periodontal disease. J Periodontol. 2007;78(7):13806.
28. Sisson KL. Theoretical explanations for social inequalities in oral health. Community Dent Oral Epidemiol. 2007;35(2):818.
29. Ellwood RP, O'Mullane DM. Identification of areas with high levels of untreated dental caries. Community Dent Oral Epidemiol. 1996; 24(1):16.
30. Peres KGA, Bastos JRM, Latorre MRDO. Relationship between severity of dental caries and social and behavioral factors in children. Rev Saude Publica. 2000;34(4):4028.
31. Pattussi MP, Marcenes W, Croucher R, Sheiham A. Social deprivation, income inequality, social cohesion and dental caries in Brazilian school children. Soc Sci Med. 2001;53(7):91525.
32. Cortellazzi KL, Pereira SM, Tagliaferro EP, Ambrosano GM, Zanin L, Meneghim MC, et al. Risk indicators of gingivitis in 5-year-old Brazilian children. Oral Health Prev Dent. 2008;6(2):1317.
33. Antunes JL, Peres MA, Frias AC, Crosato EM, Biazevic MG. Gingival health of adolescents and the utilization of dental services, state of São Paulo, Brazil. Rev Saude Publica. 2008;42(2):1919.
34. Werneck GL, Struchiner CJ. Studies on spacetime disease clusters: concepts, techniques, and challenges. Cad. Saude Publ. 1997;13: 61124.
Manuscript received on 30 November 2012;
Revised version accepted for publication on 29 January 2014