Two validity evidences of the ESQUADA and Brazilians’ dietary quality levels

Thanise Sabrina Souza Santos Pedro Henrique de Moura Araújo Dalton Francisco de Andrade Maria Laura da Costa Louzada Maria Alice Altenburg de Assis Betzabeth Slater About the authors

ABSTRACT

OBJECTIVE

Assess two validity evidences of the diet quality scale (ESQUADA) for the selection of items with better discrimination of the Brazilians’ diet quality and propose a description in score levels.

METHODS

Brazilian adolescents and adults residing in the country (n = 2,059) answered an online questionnaire with 52 items, shared on social networks and email lists between March and April 2018. Statistical tests were applied to analyze the validity and reliability of the instrument’s evidence. Factor analysis was applied to study the dimensionality of the questionnaire items. Item response theory was applied to identify the discrimination and location of items on the continuum, construct the scale and assess the differential item functioning in terms of sex and age.

RESULTS

Among the 52 items of the questionnaire, 25 had greater measurement accuracy, with adequate adjustment and reliability. The item on the habit of eating ultra-processed foods at home showed the best discrimination of diet quality. No item showed differential functioning regarding sex and age. In the construction of the ESQUADA, five diet quality levels were identified: very poor, poor, good, very good and excellent. It was observed that while breakfast cereals and/or cereal bars are more frequently consumed by individuals with “very poor” diet quality; nuts and/or walnuts are most often consumed by those individuals with “excellent” diet quality.

CONCLUSION

The ESQUADA consists of 25 precise items with no differential functioning to assess the quality of Brazilians’ diet. The construction of the ESQUADA made it possible to recognize food consumption and dietary practices characteristic of each level of diet quality.

Adolescent; Adult; Young Adult; Validation Studies; Surveys and Questionnaires; Food Guide; Diet Surveys

INTRODUCTION

Many health problems that affect the world population today are related to unhealthy eating habits. In 2017, inadequate nutrition was the main global risk factor for mortality and the second main factor for years of life lost due to disability11. GBD 2017 Risk Factor Collaborators. Global, regional, and national comparative risk assessment of 84 behavioral, environmental and occupational, and metabolic risks or clusters of risks for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2018;392(10159):1923-4. https://doi.org/10.1016/S0140-6736(18)32225-6
https://doi.org/10.1016/S0140-6736(18)32...
. Its effect on a country’s food system is also observed. In Brazil, the increase in the production and availability of ultra-processed foods has influenced the consumption and health of the population22. Monteiro CA, Cannon G. The impact of transnational “Big Food” companies on the South: a view from Brazil. PLoS Med. 2012;9(7):e1001252. https://doi.org/10.1371/journal.pmed.1001252
https://doi.org/10.1371/journal.pmed.100...
.

Based on this, in 2014, the Ministry of Health published the second edition of the Dietary Guidelines for the Brazilian Population , which brings principles and recommendations for healthy and sustainable eating. The Guideline’s recommendations consider food more than a means of obtaining nutrients, incorporating messages that take into account food processing, combinations of meals, modes of eating, as well as the impact on the environment and the society33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Guia alimentar para a população brasileira. 2. ed. Brasília, DF; 2014. .

It is still a challenge to assess and monitor food considering the Guidelines33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Guia alimentar para a população brasileira. 2. ed. Brasília, DF; 2014. , due to the lack of instruments. Nutrition has been evaluated by applying diet quality indices based on previous recommendations, which depend on the use of diet surveys and require time for analysis44. Morais DC, Moraes LFS, Silva DCG, Pinto CA, Novaes JF, et al. Methodological aspects of dietary quality assessment in Brazil: systematic review. Cienc Saude Coletiva. 2017;22(8):2671-80. https://doi.org/10.1590/1413-81232017228.23502015
https://doi.org/10.1590/1413-81232017228...
. Furthermore, these indices are supported by a subjective definition of cutoff points for classification, giving the same importance to items with different impacts on health. Item Response Theory (IRT) is an analysis proposal to overcome this limitation when considering the characteristics of the questionnaire items regarding the ability to discriminate the variable of interest and location in the respective continuum and a probabilistic model to calculate and describe the scores55. Andrade DF, Tavares HR, Valle RC. Teoria de resposta ao item: conceitos e aplicações. São Paulo: Associação Brasileira de Estatística; 2000. .

Given this gap, the diet quality scale (ESQUADA) was developed based on the Guidelines’ recommendations33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Guia alimentar para a população brasileira. 2. ed. Brasília, DF; 2014. , including, for example, the habit of having main meals and consuming foods such as fruits and sweetened beverages66. Santos TSS, Sato PM, Carriero MR, Lopes CP, Segura IE, Scagliusi FB, et al. Qualitative and quantitative analysis of the relevance, clarity, and comprehensibility of the Scale of Quality of Diet (ESQUADA). Arch Latinoam Nutr. 2018;68(4):303-12. . The present study sought to assess two validity evidences of the ESQUADA for the selection of items with better discrimination of the diet quality and to propose a description in score levels.

METHODS

This is a psychometric study to assess the validity of the ESQUADA regarding its internal structure and differential functioning, identifying the final set of items, with IRT’s application.

In a previous study66. Santos TSS, Sato PM, Carriero MR, Lopes CP, Segura IE, Scagliusi FB, et al. Qualitative and quantitative analysis of the relevance, clarity, and comprehensibility of the Scale of Quality of Diet (ESQUADA). Arch Latinoam Nutr. 2018;68(4):303-12. , experts were asked to assess the items for relevance to measuring the diet’s quality, for consistency with the Guidelines’ recommendations33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Guia alimentar para a população brasileira. 2. ed. Brasília, DF; 2014. and for writing’s clarity for adolescents and adults77. Furr RM, Bacharach VR. Pshychometrics: an introduction. 2. ed. Los Angeles: SAGE Publications; 2014. . After analyzing the experts’ suggestions, the understanding of the items by Brazilian adolescents and adults was assessed66. Santos TSS, Sato PM, Carriero MR, Lopes CP, Segura IE, Scagliusi FB, et al. Qualitative and quantitative analysis of the relevance, clarity, and comprehensibility of the Scale of Quality of Diet (ESQUADA). Arch Latinoam Nutr. 2018;68(4):303-12. . Subsequently, a total of 52 items were considered for the analysis of the internal structure and differential functioning, presented in this study, which, for better organization, was divided into two phases, described below ( Figure 1 ).

Figure 1
Description of the study phases of two validity evidences of the diet quality scale (ESQUADA).

Data Collection for the Validation Study

The sample of respondents sought to be representative of the latent trait under study88. Bortolotti SLV, Tezza R, Andrade DF, Bornia AC, Sousa Júnior AF. Relevance and advantages of using the item response theory. Qual Quant. 2013;47:2341-60. https://doi.org/10.1007/s11135-012-9684-5
https://doi.org/10.1007/s11135-012-9684-...
(diet quality), including individuals of different levels.

To minimize boredom when answering the questionnaire, the items were organized into thirteen forms with application of the balanced incomplete block design66. Santos TSS, Sato PM, Carriero MR, Lopes CP, Segura IE, Scagliusi FB, et al. Qualitative and quantitative analysis of the relevance, clarity, and comprehensibility of the Scale of Quality of Diet (ESQUADA). Arch Latinoam Nutr. 2018;68(4):303-12. , 99. Bekman RM. Aplicação dos blocos incompletos balanceados na Teoria da Resposta ao Item. Estud Aval Educ. 2001;(24):119-38. https://doi.org/10.18222/eae02420012202
https://doi.org/10.18222/eae02420012202...
. Each form consisted of sixteen items on diet quality and others on sociodemographic characteristics, such as date of birth, sex, education level and country (of birth and current residence).

The order of presentation of items on the forms was also changed to minimize the influence of position and boredom on the responses’ quality. The forms were entered into the Survey Monkey platform and numbered in ascending order from one to thirteen. The access was made through an electronic address with a programming system to ensure the sequential presentation of the questionnaires, in order to ensure an equal distribution of respondents per form. This electronic address was shared on social networks, email lists and the University of São Paulo’s internal communication network.

During collection, the need to direct the forms’ application to individuals with a certain level of diet quality was evaluated, which is still underrepresented. To meet this representativeness of the latent trait, a complementary collection was made with students from public schools in the state of São Paulo, with the authorization of the State Secretariat, using the computer laboratory and with the presence of a researcher.

Data collection was carried out between March and April 2018, including Brazilian adolescents and adults, aged between 15 and 50, residing in Brazil. All individuals signed a consent term, registering their desire to participate. The study was approved by the Ethics Committee on Human Research of the School of Public Health (protocol number 1,943,099).

Among the individuals who accessed the forms (n = 2,373), those who did not meet the inclusion criteria (n = 270), did not answer or answered only one of the items on diet quality (n = 11) and those who accessed the forms more than once (n = 33) were excluded. The final sample included 2,059 individuals.

Data Analysis for the Scale Construction

The categories of responses were numbered in ascending order from number one, consistent with the cumulative characteristic of the latent trait. In this sense, number 1 identified the answer option whose habit suggests a poorer diet quality. For example, the item about replacing snacks for lunch or dinner had five response options: “I am not used to”, “Yes, sometimes”, “Yes, I usually replace it one or two days a week”, “Yes, I usually replace it three or more days a week” e “Yes, I usually replace it five or more days a week”. While the highest frequency of replacement, which suggests poorer diet quality, was identified as number one; the unusual was identified as number five.

Analysis of the internal structure of the item set

The study of dimensionality was carried out with full-information factor analysis, considering unidimensionality when the first factor explains 20% or more of the variance1010. Reckase MD. Unifactor latent trait models applied to multifactor tests: results and implications. J Educ Stat. 1979;4(3):207-30. https://doi.org/10.2307/1164671
https://doi.org/10.2307/1164671...
. Items with commonality less than 0.20 and factor loading less than 0.301111. Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Análise multivariada de dados. 6. ed. Porto Alegre, RS: Bookman; 2009. Capítulo 3, Análise fatorial; p. 100-48. were excluded from the following analyses.

Next, the probability of individuals choosing category k for each item was calculated using the Samejima graded response model, represented by equation (1)1212. Samejima FA. Estimation of latent ability using a response pattern of graded scores. Psychometrika. 1969;34:1-97. https://doi.org/10.1007/BF03372160
https://doi.org/10.1007/BF03372160...
:

Pi,kθj=11+expaiθjbi,k11+expaiθjbi,k+1(1)

Where:

θj – IRT score for individual j ;

Pi,kj) – probability of individual j choosing category k when answering item i ;

ai – item i discrimination parameter;

bi,k – location parameter of category k of item i , with bi,2 ≤ bi,3 ≤ bi,4 ≤ ….

The discrimination parameter (ai) indicates the ability of each item to discriminate individuals with different levels of the latent trait. Items with higher values of this parameter show better discrimination of the latent trait55. Andrade DF, Tavares HR, Valle RC. Teoria de resposta ao item: conceitos e aplicações. São Paulo: Associação Brasileira de Estatística; 2000. . Items with low discrimination, that is, with ai parameter equal to or less than 0.70, were excluded from the analyses88. Bortolotti SLV, Tezza R, Andrade DF, Bornia AC, Sousa Júnior AF. Relevance and advantages of using the item response theory. Qual Quant. 2013;47:2341-60. https://doi.org/10.1007/s11135-012-9684-5
https://doi.org/10.1007/s11135-012-9684-...
.

The location parameter (bi,k) identifies the location of each item’s response categories across the continuum of the latent trait55. Andrade DF, Tavares HR, Valle RC. Teoria de resposta ao item: conceitos e aplicações. São Paulo: Associação Brasileira de Estatística; 2000. . Items with estimates of bi,k with high standard errors, when compared to other items1313. Chernyshenko OS, Stark S, Chan KY, Drasgow F, Williams B. Fitting Item Response Theory Models to two personality inventories: issues and insights. Multivariate Behav Res. 2001;36(4):523-62. https://doi.org/10.1207/S15327906MBR3604_03
https://doi.org/10.1207/S15327906MBR3604...
, and with overlap in the item characteristic curve (ICC), the graphical representation of the model above, were recategorized. Those items that maintained high standard error values even after recategorization were excluded from the analyses.

The adjustment of the model was evaluated by the root mean square error of approximation (RMSEA), standardized root mean square residual (SRMSR), comparative fit index (CFI) e Tucker–Lewis index (TLI)1414. Maydeu-Olivares A. Goodness-of-fit assessment of item response theory models. Measurement (Mahwah N J). 2013;11(3):71-101. https://doi.org/10.1080/15366367.2013.831680
https://doi.org/10.1080/15366367.2013.83...
, 1515. Browne MW, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, editors. Testing structural equation models. Newbury Park, CA: SAGE; 1993. p.136-62. (SAGE Focus; nº 154). . The goodness-of-fit is confirmed when RMSEA and SRMSR values are less than or equal to 0.05 and CFI and TLI values are greater than 0.901616. Brown TA. Confirmatory factor analysis for applied research. 2. ed. New York: The Guilford Press; 2015. (Methodology in the Social Sciences). . The accuracy of the ESQUADA was also analyzed using the test information curve (TIC), which represents the sum of the information on the items that compose it. The study of empirical reliability, a measure analogous to Cronbach’s α, allowed us to identify the reliability of the ESQUADA, accepted when reached a value greater than 0.701111. Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Análise multivariada de dados. 6. ed. Porto Alegre, RS: Bookman; 2009. Capítulo 3, Análise fatorial; p. 100-48. .

Analysis of consequence of use

Considering that age and sex can influence the probability of individual j choosing category k for item i , the differential item functioning (DIF) was evaluated according to these variables. A p-value less than 0.05 was adopted as the level of significance. DIF detection was also evaluated in the TIC analysis1717. Zumbo BD. Three generations of DIF analyses: considering where it has been, where it is now, and where it is going. Lang Assess Q. 2007;4(2):223-33. https://doi.org/10.1080/15434300701375832
https://doi.org/10.1080/1543430070137583...
.

Construction of the scale

The probability of choosing category k was calculated for each item at different diet quality scores. The item was placed in the score where this probability was greater than or equal to 0.5. Items with better discrimination of diet quality (ai ≥ 1.00) were considered anchors for the description of dietary practices and consumption of foods characteristic of each score. The scores were grouped into levels indicative of the cumulative characteristic of diet quality, allowing to identify that the higher the score, the lower the frequency of replacing meals with snacks, for example. This step was carried out by four nutritionists (TSSS, MLCL, MAAA and BSV). For better interpretability of the ESQUADA55. Andrade DF, Tavares HR, Valle RC. Teoria de resposta ao item: conceitos e aplicações. São Paulo: Associação Brasileira de Estatística; 2000. , the scores estimated on a scale with a mean equal to 0 and a standard deviation equal to 1 were later transformed to a scale with a mean equal to 250 and a standard deviation equal to 50.

Analyses were performed using the R software (crossdes and mirt packages) and Microsoft Excel version 2013.

RESULTS

Respondents represented the variability of the latent trait in order to guarantee the estimation of the parameters ai and bi,k. Most of these respondents were female (70%), had no higher education (58%) and lived in the Southeast region of Brazil (79%). Filling out the forms took between six and eight minutes.

The 52 items (I-01 to I-52) considered for the analysis explained 0.20 of the variance, but 15 of them were excluded due to the low values of commonality, factor loading and discrimination parameter (I-06, I-17, I-18, I-19, I-20, I-23, I-26, I-27, I-28, I-30, I-33, I-34, I-38, I-45 and I-49). Analyses were repeated without these items (n = 37), recategorizing those with estimates with high standard error values for the parameter bi,k and overlap in the ICC. In the subsequent analyses, 12 of these items had low values of commonality, factor loading and discrimination parameter and were excluded (I-05, I-07, I-10, I-12, I-14, I-15, I-16, I-29, I-35, I-37, I-39 and I-47).

The remaining 25 items presented adequate values for the parameter ai and bi,k and respective standard errors, explaining 0.34 of the variance. The values of commonality, factor loading and parameters ai and bi,k are described in Table 1 . The next results focus on the 25 items that remained in the final set, making up the ESQUADA. Items and response options are shown in Figure 2 .

Table 1
Description of commonality, factor loading and discrimination and location parameters values and respective standard errors of each item of the diet quality scale (ESQUADA) (n = 2,059).

Figure 2
Questionnaire with items and answer options that make up the diet quality scale (ESQUADA).

The item on the places where individuals usually buy fruits and vegetables showed the lowest discrimination of diet quality (a11 = 0.786). On the other hand, the item on the habit of eating ultra-processed foods at home had the best discrimination (a52 = 2.237).

The item on the habit of eating breakfast cereals and/or cereal bars had the lowest value for the location parameter (b42,2 = -3.738), suggesting that these foods are more frequently consumed by individuals with lower levels of diet quality. On the other hand, the items on the habit of eating nuts and/or walnuts (b31,4 = 3.080) and whole-grain rice/pasta (b21,4 = 2.932) had the highest values of bi,k, suggesting that these foods are consumed more frequently by individuals with higher levels of diet quality.

ESQUADA presented an excellent goodness-of-fit (RMSEA = 0.01; SRMSR = 0.02; CIF = 0.99 and TLI = 0.99), with better accuracy between the -2 and +2 scores ( Figure 3 ) and an adequate empirical reliability (0.70). Differential functioning was not identified for any item, considering both age and sex.

Figure 3
Diet quality scale (ESQUADA) information curve (n = 2,059).

For better interpretability of the ESQUADA, the transformation of the scores for a scale with a mean equal to 250 and a standard deviation equal to 50 was obtained by the constant: θ(250,50) = 59.09 × θ(0,1) + 250.12. The scores were grouped to present the five interpretation levels of the ESQUADA: “very poor”, “poor”, “good”, “very good” and “excellent” ( Chart 1 ). The items and respective answer options that make up each level are shown in Figure 4 .

Chart 1
Brief description of the levels of the diet quality scale (ESQUADA).

Figure 4
Positioning of items and respective response options in the five levels of the diet quality scale (ESQUADA).

DISCUSSION

In this study, two validity evidences of the ESQUADA, a diet quality scale that includes consumption of natural and minimally processed and ultra-processed foods and dietary practices (such as eating breakfast, cooking and replacing meals with snacks), were evaluated. The IRT usage allowed the selection of items with better diet quality discrimination and the results of the analysis of the goodness-of-fit and reliability support the accuracy of the measure presented by the ESQUADA. The TIC allowed us to visualize the measurement error in the entire scale, suggesting that the ESQUADA presents better accuracy between the -2 and +2 scores. In addition, the differential item functioning analysis indicated that the measure is valid in different samples. In other words, the ESQUADA measures with the same precision the diet quality of individuals regardless of sex and age. The absence of DIF highlights the previous study regarding the clarity of the items for Brazilian adolescents and adults66. Santos TSS, Sato PM, Carriero MR, Lopes CP, Segura IE, Scagliusi FB, et al. Qualitative and quantitative analysis of the relevance, clarity, and comprehensibility of the Scale of Quality of Diet (ESQUADA). Arch Latinoam Nutr. 2018;68(4):303-12. . The analyses also allowed the proposal to describe dietary practices and food consumption at five levels.

After the Guidelines publication33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Guia alimentar para a população brasileira. 2. ed. Brasília, DF; 2014. , three aspects were highlighted: (1) the understanding that foods are not just sources of nutrients; (2) the importance of considering not only food consumption but also dietary practices; and (3) the methodological limitations of the statistics used in the development of diet quality indices. ESQUADA aims to assess the diet quality in accordance with the Guidelines recommendations33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Guia alimentar para a população brasileira. 2. ed. Brasília, DF; 2014. , considering other dietary characteristics than just the nutritional factor, with the application of more robust statistics. ESQUADA presents itself, then, as the first scale that assesses the diet quality in accordance with the Guidelines33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Guia alimentar para a população brasileira. 2. ed. Brasília, DF; 2014. , with the application of the IRT, an analysis centered on the items and not just on the score.

Studies in the field of Nutrition express in a hegemonic way the biomedical paradigm according to the logic of natural sciences, limiting the understanding of the multiple ways in which food interferes in people’s lives. The meaning of eating has been undergoing changes, that is, from a reductionist concept, in the sense of an exclusive supply of energy and nutrients, it expresses the experiences of human beings, marked by nature and culture. In this sense, eating is a natural act, which is expressed in the most cultural ways: in the modes of eating and preparing food, in food choices and preferences, in commensality and in all transformations from food to consumption2020. Freitas MCS, Minayo MCS, Fontes GAV. Sobre o campo da Alimentação e Nutrição na perspectiva das teorias compreensivas. Cienc Saude Coletiva. 2011;16(1):31-8. https://doi.org/10.1590/S1413-81232011000100008
https://doi.org/10.1590/S1413-8123201100...
, 2121. Bernal J. La ciencia en la historia. Ciudad de México: Nueva Imagen; 1979. .

In ESQUADA, the habit of cooking at least one day a week, assessed by I-09, identified a better diet quality, indicating the care taken in reserving some time to cook during the week, even with the intense work routine. Considering that the population is cooking at home less frequently2222. Menezes MFG, Maldonado LA. Do nutricionismo à comida: a culinária como estratégia metodológica de educação alimentar e nutricional. Rev HUPE. 2015;14(3):82-90. https://doi.org/10.12957/rhupe.2015.19950
https://doi.org/10.12957/rhupe.2015.1995...
, although one day a week is still insufficient, the item is able to discriminate the diet quality.

Items on the consumption of vegetables (I-24) and fruit (I-25) and place of purchase of these foods (I-11) adhered to the criteria for maintenance in the final set. The consumption of vegetables is an important point for healthy eating and a global strategy for the prevention and control of chronic noncommunicable diseases2323. World Health Organization. Global action plan for the prevention and control of noncommunicable diseases 2013-2020. Geneva (CH): WHO; 2013. . The Guidelines recommends preferring the consumption of fruits to drinking natural juice, as well as buying food in places where there is greater availability of natural food33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Guia alimentar para a população brasileira. 2. ed. Brasília, DF; 2014. . The place where the population supplies itself with fruits and vegetables can also indicate the diet quality. In Brazil, purchases at street markets, small markets or directly from the producer were related to lower consumption of ultra-processed foods2424. Machado PP, Claro RM, Martins APB, Costa JC, Levy RB. Is food store type associated with the consumption of ultra-processed food and drink products in Brazil? Public Health Nutr. 2017;21(1):201-9. https://doi.org/10.1017/S1368980017001410
https://doi.org/10.1017/S136898001700141...
.

One of the ESQUADA’s items (I-32) sought to investigate the beverage ingested by individuals when they are thirsty: water, natural fruit juice or sweetened beverages. It presented an adequate discrimination of diet quality, with low values for the location parameter, that is: individuals with low diet quality scores drink water when they are thirsty. In accordance with the recommendations for diet quality indicators2525. Gallup. Seeking indicators of healthy diets. Bern (CH): Swiss Agency for Development and Cooperation; 2016. 64 p. , ESQUADA does not quantify water intake in milliliters or cups but assesses a habit that is directly related to healthy eating and inversely to the obesity incidence2626. Fresán U, Gea A, Bes-Rastrollo M, Ruiz-Canela M, Martinez-Gonzalez MA. Substitution models of water for other beverages, and the incidence of obesity and weight gain in the SUN cohort. Nutrients. 2016;8(11):688. https://doi.org/10.3390/nu8110688
https://doi.org/10.3390/nu8110688...
. The presence of this item in the ESQUADA highlights its importance in assessing the diet quality.

Scientific evidence points to the importance of breakfast for nutrition and health2727. Baltar VT, Cunha DB, Santos RO, Maechioini DM, Sichieri R. Breakfast patterns and their association with body mass index in Brazilian adults. Cad Saude Publica. 2018;34(6):e00111917. https://doi.org/10.1590/0102-311x00111917
https://doi.org/10.1590/0102-311x0011191...
. ESQUADA’s description ( Chart 1 ) indicates that the diet quality increases as individuals adopt the habit of eating breakfast, lunch and not replacing meals with snacks. It must be considered that food intake is a complex behavior. For example, at a “very poor” level of diet quality, individuals tend to eat a traditional meal (with rice, beans, meat or a vegetarian option and/or salad) for lunch and substitute meals for snacks and consume ultra-processed foods. On the other hand, the habit of eating breakfast was only observed from the level of “good” diet quality, in which there is a lower frequency of substitution of meals for snacks and consumption of ultra-processed foods. In other words, the habit of eating breakfast is present at a level of diet quality in which individuals tend to have lunch and consume ultra-processed products less frequently.

Among the 25 items in the ESQUADA, 11 assess the consumption of ultra-processed foods. The item that investigates the consumption of breakfast cereals and cereal bars (I-42) had the lowest value for the location parameter (b42,2 = -3.738), suggesting that these foods are frequently consumed at the lowest levels of diet quality. Frequent consumption of ultra-processed foods was associated with a worse nutritional profile in adolescents and adults2828. Louzada MLC, Ricardo CZ, Steele EM, Levy RB, Cannon G, Monteiro CA. The share of ultra-processed foods determines the overall nutritional quality of diets in Brazil. Public Health Nutr. 2018 21(1):94-102. https://doi.org/10.1017/S1368980017001434
https://doi.org/10.1017/S136898001700143...
. This consumption has been stimulated by marketing strategies, such as the use of terms on product labels, for example: traditional and homemade2929. Machado PCI, Santos AM, Uggioni PL, Fabri RK, Müller J. Labeling of packaged foods in Brazil: use of terms such as homemade, traditional, and the like. Rev Nutr. 2018;31(1):83-96. https://doi.org/10.1590/1678-98652018000100008
https://doi.org/10.1590/1678-98652018000...
. Contemplating some of this influence, ESQUADA includes an item that assesses the habit of choosing the largest portion of foods when the price difference is small in relation to the smallest portion (I-13).

In the description of the ESQUADA ( Chart 1 ), it is observed that individuals stop consuming some ultra-processed foods at the same level of diet quality as they start consuming whole-grain cereals (I-21, I-22) and oilseeds (I-31). Ultra-processed foods only cease to be part of the diet at the last two levels of the ESQUADA, when it is also observed that natural and minimally processed foods are incorporated into the diet. These results reinforce the complexity of assessing diet quality. Thus, individuals with median scores, that is, with a “good” diet quality, present healthy and unhealthy eating habits at the same time. Given this complexity, the application of IRT allowed to identify the items that best discriminate the diet quality55. Andrade DF, Tavares HR, Valle RC. Teoria de resposta ao item: conceitos e aplicações. São Paulo: Associação Brasileira de Estatística; 2000. .

Therefore, the ESQUADA is presented as a new measure to accurately assess the diet quality in future studies. To this end, the discrimination and location parameters and the transformation constant presented here should be considered in the next applications of the ESQUADA. With the equalization technique55. Andrade DF, Tavares HR, Valle RC. Teoria de resposta ao item: conceitos e aplicações. São Paulo: Associação Brasileira de Estatística; 2000. , researchers will be able to include other items in the measurement, estimating their parameters based on the discrimination and location of those that make up the ESQUADA and expanding the assessment of the diet quality. Additionally, the ESQUADA is easy to apply and analyze and, with its reapplication, it is possible to assess the scores of the same group of individuals, for example, after an intervention in health and nutrition.

Some positive aspects and limitations of this study should be pointed out. Even though the ESQUADA assesses different aspects of diet quality, the final set of items is more related to issues related to food consumption. Furthermore, the analyses indicated the need to recategorize some answer options due to the smaller number of individuals who selected them as answers. However, the number of respondents was sufficient to obtain adequate estimates of the item’s parameters, as well as accurate information on the diet quality. The study features highlights: ESQUADA is based on current recommendations for the nutrition of the Brazilian population and in more robust analyses for selection of items with better discrimination of diet quality, allowing to locate and describe consumption and food practices in its continuum.

CONCLUSION

The ESQUADA consists of 25 items that assess food consumption and dietary practices in accordance with the Guidelines. The exclusions do not contradict current recommendations, allowing the selection of the most accurate items to assess the diet quality in future studies and contribute to the state of the art in nutritional epidemiology.

In this sense, items on the habit of cooking, eating breakfast, where individuals buy fruits and vegetables, and consumption of natural and ultra-processed foods exemplify the final set that makes up the ESQUADA. The analyses also provided a breakdown of food consumption and dietary practices characteristic of each level of diet quality. In order to complement the study of the two validity evidences of the ESQUADA presented, future articles will be able to investigate the associations between the scores and other measures related to health and nutrition.

REFERENCES

  • 1
    GBD 2017 Risk Factor Collaborators. Global, regional, and national comparative risk assessment of 84 behavioral, environmental and occupational, and metabolic risks or clusters of risks for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2018;392(10159):1923-4. https://doi.org/10.1016/S0140-6736(18)32225-6
    » https://doi.org/10.1016/S0140-6736(18)32225-6
  • 2
    Monteiro CA, Cannon G. The impact of transnational “Big Food” companies on the South: a view from Brazil. PLoS Med. 2012;9(7):e1001252. https://doi.org/10.1371/journal.pmed.1001252
    » https://doi.org/10.1371/journal.pmed.1001252
  • 3
    Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Guia alimentar para a população brasileira. 2. ed. Brasília, DF; 2014.
  • 4
    Morais DC, Moraes LFS, Silva DCG, Pinto CA, Novaes JF, et al. Methodological aspects of dietary quality assessment in Brazil: systematic review. Cienc Saude Coletiva. 2017;22(8):2671-80. https://doi.org/10.1590/1413-81232017228.23502015
    » https://doi.org/10.1590/1413-81232017228.23502015
  • 5
    Andrade DF, Tavares HR, Valle RC. Teoria de resposta ao item: conceitos e aplicações. São Paulo: Associação Brasileira de Estatística; 2000.
  • 6
    Santos TSS, Sato PM, Carriero MR, Lopes CP, Segura IE, Scagliusi FB, et al. Qualitative and quantitative analysis of the relevance, clarity, and comprehensibility of the Scale of Quality of Diet (ESQUADA). Arch Latinoam Nutr. 2018;68(4):303-12.
  • 7
    Furr RM, Bacharach VR. Pshychometrics: an introduction. 2. ed. Los Angeles: SAGE Publications; 2014.
  • 8
    Bortolotti SLV, Tezza R, Andrade DF, Bornia AC, Sousa Júnior AF. Relevance and advantages of using the item response theory. Qual Quant. 2013;47:2341-60. https://doi.org/10.1007/s11135-012-9684-5
    » https://doi.org/10.1007/s11135-012-9684-5
  • 9
    Bekman RM. Aplicação dos blocos incompletos balanceados na Teoria da Resposta ao Item. Estud Aval Educ. 2001;(24):119-38. https://doi.org/10.18222/eae02420012202
    » https://doi.org/10.18222/eae02420012202
  • 10
    Reckase MD. Unifactor latent trait models applied to multifactor tests: results and implications. J Educ Stat. 1979;4(3):207-30. https://doi.org/10.2307/1164671
    » https://doi.org/10.2307/1164671
  • 11
    Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Análise multivariada de dados. 6. ed. Porto Alegre, RS: Bookman; 2009. Capítulo 3, Análise fatorial; p. 100-48.
  • 12
    Samejima FA. Estimation of latent ability using a response pattern of graded scores. Psychometrika. 1969;34:1-97. https://doi.org/10.1007/BF03372160
    » https://doi.org/10.1007/BF03372160
  • 13
    Chernyshenko OS, Stark S, Chan KY, Drasgow F, Williams B. Fitting Item Response Theory Models to two personality inventories: issues and insights. Multivariate Behav Res. 2001;36(4):523-62. https://doi.org/10.1207/S15327906MBR3604_03
    » https://doi.org/10.1207/S15327906MBR3604_03
  • 14
    Maydeu-Olivares A. Goodness-of-fit assessment of item response theory models. Measurement (Mahwah N J). 2013;11(3):71-101. https://doi.org/10.1080/15366367.2013.831680
    » https://doi.org/10.1080/15366367.2013.831680
  • 15
    Browne MW, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, editors. Testing structural equation models. Newbury Park, CA: SAGE; 1993. p.136-62. (SAGE Focus; nº 154).
  • 16
    Brown TA. Confirmatory factor analysis for applied research. 2. ed. New York: The Guilford Press; 2015. (Methodology in the Social Sciences).
  • 17
    Zumbo BD. Three generations of DIF analyses: considering where it has been, where it is now, and where it is going. Lang Assess Q. 2007;4(2):223-33. https://doi.org/10.1080/15434300701375832
    » https://doi.org/10.1080/15434300701375832
  • 18
    De Beer M. Use of Differential Item Functioning (DIF) analysis for bias analysis in test construction. J Ind Psychol. 2004;30(4):52-8. https://doi.org/10.4102/sajip.v30i4.175
    » https://doi.org/10.4102/sajip.v30i4.175
  • 19
    Thissen D, Steinberg L, Gerrard M. Beyond group-mean differences: the concept of item bias. Psychol Bull. 1986;99(1):118-28. https://doi.org/10.1037/0033-2909.99.1.118
    » https://doi.org/10.1037/0033-2909.99.1.118
  • 20
    Freitas MCS, Minayo MCS, Fontes GAV. Sobre o campo da Alimentação e Nutrição na perspectiva das teorias compreensivas. Cienc Saude Coletiva. 2011;16(1):31-8. https://doi.org/10.1590/S1413-81232011000100008
    » https://doi.org/10.1590/S1413-81232011000100008
  • 21
    Bernal J. La ciencia en la historia. Ciudad de México: Nueva Imagen; 1979.
  • 22
    Menezes MFG, Maldonado LA. Do nutricionismo à comida: a culinária como estratégia metodológica de educação alimentar e nutricional. Rev HUPE. 2015;14(3):82-90. https://doi.org/10.12957/rhupe.2015.19950
    » https://doi.org/10.12957/rhupe.2015.19950
  • 23
    World Health Organization. Global action plan for the prevention and control of noncommunicable diseases 2013-2020. Geneva (CH): WHO; 2013.
  • 24
    Machado PP, Claro RM, Martins APB, Costa JC, Levy RB. Is food store type associated with the consumption of ultra-processed food and drink products in Brazil? Public Health Nutr. 2017;21(1):201-9. https://doi.org/10.1017/S1368980017001410
    » https://doi.org/10.1017/S1368980017001410
  • 25
    Gallup. Seeking indicators of healthy diets. Bern (CH): Swiss Agency for Development and Cooperation; 2016. 64 p.
  • 26
    Fresán U, Gea A, Bes-Rastrollo M, Ruiz-Canela M, Martinez-Gonzalez MA. Substitution models of water for other beverages, and the incidence of obesity and weight gain in the SUN cohort. Nutrients. 2016;8(11):688. https://doi.org/10.3390/nu8110688
    » https://doi.org/10.3390/nu8110688
  • 27
    Baltar VT, Cunha DB, Santos RO, Maechioini DM, Sichieri R. Breakfast patterns and their association with body mass index in Brazilian adults. Cad Saude Publica. 2018;34(6):e00111917. https://doi.org/10.1590/0102-311x00111917
    » https://doi.org/10.1590/0102-311x00111917
  • 28
    Louzada MLC, Ricardo CZ, Steele EM, Levy RB, Cannon G, Monteiro CA. The share of ultra-processed foods determines the overall nutritional quality of diets in Brazil. Public Health Nutr. 2018 21(1):94-102. https://doi.org/10.1017/S1368980017001434
    » https://doi.org/10.1017/S1368980017001434
  • 29
    Machado PCI, Santos AM, Uggioni PL, Fabri RK, Müller J. Labeling of packaged foods in Brazil: use of terms such as homemade, traditional, and the like. Rev Nutr. 2018;31(1):83-96. https://doi.org/10.1590/1678-98652018000100008
    » https://doi.org/10.1590/1678-98652018000100008

  • Financing: This article was carried out with the support of the Coordination for the Improvement of Higher Education Personnel – Brazil (Capes – Financing Code 001).
  • Erratum

    In the article “ Two validity evidences of the ESQUADA and Brazilians’ dietary quality levels ”, DOI https://doi.org/10.11606/s1518-8787.2021055002397, published on the Revista de Saúde Pública.2021;55:39, on page 10, the RSP corrects an excerpt in the last paragraph of the results section.
    Where it reads:
    θ(250,50) = 59,09 × θ(0,1) + 250.12
    It should read:
    θ(250,50) = 50 × θ(0,1) + 250.12

Publication Dates

  • Publication in this collection
    16 Aug 2021
  • Date of issue
    2021

History

  • Received
    19 Feb 2020
  • Accepted
    21 Oct 2020
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br