Cross-cultural adaptation, content validity, and feasibility of the school physical activity and nutrition environment tool

Adaptación transcultural, validación de contenido y factibilidad de una herramienta para evaluar los entornos de actividad física y nutrición en las escuelas

Ana María Arcila-Agudelo Carmen Ferrer-Svoboda Deborah H John Andreu Farran-Codina About the authors

Abstract

Objective:

To perform a cross-cultural adaptation, content validity and feasibility of The School Physical Activity and Nutrition Environment Tool (SPAN-ET) for the Spanish context. It is a valuable tool for making comprehensive assessments of school environments in three environmental categories: policy, situation/social, and physical.

Method:

We followed the cross-cultural adaptation guidelines which consist of a five-stage methodological approach: 1) forward translation, 2) synthesis, 3) back translation, 4) adaptation to the Spanish context, and 5) pilot testing. In addition, an expert panel performed a content validity analysis to assess the level of comprehensibility, applicability, and cultural appropriateness of the SPAN-ET for its use in Spain. The pilot test was carried out in five schools to assess the feasibility of the tool in the Spanish context.

Results:

After applying the guidelines for the translation and cultural adaptation of the SPAN-ET into the Spanish context, the new tool (SPAN-ET-ES) preserves the main dimensions of the original document to evaluate school environments in Spain. The evaluation of the SPAN-ET-ES, done by an expert panel, concluded that items included in the revised version of the SPAN-ET-ES were relevant (S-CVI/Ave=0.96), clear (S-CVI/Ave=0.96), simple (S-CVI/Ave=0.98), and non-ambiguous (S-CVI/Ave=0.98) for the Spanish context. Finally, the pilot test offered empirical evidence for the feasibility and content validity of the SPAN-ET-ES at assessing school environments in Spain.

Conclusions:

SPAN-ET-ES is a feasible tool for assessing nutrition and physical activity environments at schools in Spain.

Keywords:
Cross-cultural adaptation; SPAN-ET; School environment; Evaluation

Resumen

Objetivo:

Realizar una adaptación transcultural, validación de contenido y factibilidad de una herramienta para evaluar los entornos de actividad física y nutrición en las escuelas (SPAN-ET, School Physical Activity and Nutrition Environment Tool) en el contexto español. Se trata de una valiosa herramienta para realizar evaluaciones exhaustivas del microentorno escolar en tres categorías: física, situacional y de políticas.

Método:

A partir de las directrices de adaptación transcultural se aplicó un enfoque metodológico de cinco etapas: 1) traducción, 2) síntesis, 3) retrotraducción, 4) adaptación al contexto español, y 5) prueba piloto. Además, un panel de expertos realizó un análisis de validez del contenido para evaluar el nivel de comprensibilidad, aplicabilidad y adecuación cultural de la SPAN-ET para su uso en España. Finalmente, se realizó una prueba piloto en cinco escuelas para evaluar la factibilidad de la herramienta en el contexto español.

Resultados:

Tras seguir las directrices para la traducción y la adaptación cultural de SPAN-ET, la nueva herramienta (SPAN-ET-ES) conserva las principales dimensiones del documento original para evaluar los entornos escolares en España. La validación de contenido de SPAN-ET-ES, realizada por un panel de expertos, concluyó que los elementos incluidos eran relevantes (S-CVI/Ave=0,96), claros (S-CVI/Ave=0,96), simples (S-CVI/Ave=0,98) y no ambiguos (S-CVI/Ave=0,98) para el contexto español. Finalmente, la prueba piloto ofreció evidencia empírica de su factibilidad para evaluar los microentornos escolares en España.

Conclusiones:

SPAN-ET-ES es una herramienta factible para evaluar los entornos de nutrición y actividad física en las escuelas en España.

Palabras clave:
Adaptación transcultural; SPAN-ET; Entorno escolar; Evaluación

Introduction

Environmental and policy interventions based on boosting environments that emphasize healthy behaviours within school-age populations have been identified as the most promising strategies for creating population-wide improvements in dietary and physical activity patterns, as well as weight status.11. Glanz K, Sallis JF, Saelens BE, et al. Healthy nutrition environments: concepts and measures. Am J Heal Promot. 2005;19:330-3. These strategies often take place within the school, where children spend considerable daylight time and consume between one-third to one-half of their meals, making this environment critical in forming and reinforcing healthy lifestyle habits.22. Mozaffarian D, Afshin A, Benowitz NL, et al. Population approaches to improve diet, physical activity, and smoking habits: a scientific statement from the American Heart Association. Circulation. 2012;126:1514-63.

Multiple scholars have documented the effectiveness of school-based interventions aimed at nutrition33. Micha R, Karageorgou D, Bakogianni I, et al. Effectiveness of school food environment policies on children's dietary behaviors: a systematic review and meta-analysis. PLoS One. 2018;13:e0194555. and physical activity environments,44. Story M, Nanney MS, Schwartz M. Schools and obesity prevention: creating school environments and policies to promote healthy eating and physical activity. Milbank Q. 2009;87:71-100.,55. Ridgers ND, Salmon J, Parrish AM, et al. Physical activity during school recess: a systematic review. Am J Prev Med. 2012;43:320-8. yet there is still a dearth of understanding on the actual mechanisms through which those interventions might modify, or not, behavioural patterns at the student level. In this context, several researchers have developed tools for assessing school environments relevant to food and/or physical activity.66. Saluja K, Rawal T, Bassi S, et al. School environment assessment tools to address behavioural risk factors of non-communicable diseases: a scoping review. Prev Med Reports. 2018;10:1-8.,77. Lane HG, Calvert HG, Deitch R, et al. A systematic review of existing observational tools to measure the food and physical activity environment in schools. Health Place. 2020;66:102388. Nonetheless, in a recent systematic review of 23 different tools, Lane et al.77. Lane HG, Calvert HG, Deitch R, et al. A systematic review of existing observational tools to measure the food and physical activity environment in schools. Health Place. 2020;66:102388. concluded that many of these instruments do not provide enough evidence for its relevance and usability, which lead to an important obstacle for future replication and implementation in other context. Furthermore, they often focused only on one dimension (physical activity or nutrition), or they did not include aspects such as situational or policy environments.77. Lane HG, Calvert HG, Deitch R, et al. A systematic review of existing observational tools to measure the food and physical activity environment in schools. Health Place. 2020;66:102388.

Among the validated tools with both dimensions (physical activity and nutrition), the School Physical Activity and Nutrition Environment Tool (SPAN-ET) stand out among the rest because of its comprehensively assessment of the school environment's role in terms of nutrition and physical activities along three environmental categories: physical, situational, and policy related.88. John DH, Gunter K, Jackson JA, et al. Developing the School Physical Activity and Nutrition Environment Tool to measure qualities of the obesogenic context. J Sch Health. 2016;86:39-47. Using several methods of collecting data and triangulating confirmed data criteria, the SPAN-ET surveys and scores school resources and readiness to improve nutrition and physical activity environments. SPAN-ET was created and validated for the US elementary school context and in English by Oregon State University researchers.88. John DH, Gunter K, Jackson JA, et al. Developing the School Physical Activity and Nutrition Environment Tool to measure qualities of the obesogenic context. J Sch Health. 2016;86:39-47. Despite its methodology and content are relevant, a simple language translation does not make it ready for use in other countries, as legal regulations and cultural contexts might vary among them.

This paper aims at performing a cross-cultural adaptation, content validity and feasibility of SPAN-ET for the Spanish context. By following the guidelines of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) on how to achieve a translation and cultural adaptation, perform a content validation,99. Beaton DE, Bombardier C, Guillemin F, et al. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186-91. and apply pilot testing, we purvey a full new version of the SPAN-ET in Spanish (SPAN-ET-ES, hereafter).

Method

Baseline instrument: School Physical Activity and Nutrition Environment Tool (SPAN-ET)

The SPAN-ET is a standardized instrument that provides a comprehensive observational assessment of the features, practices, and policies within the school environment that might affect the physical activity and nutrition habits in elementary school children.88. John DH, Gunter K, Jackson JA, et al. Developing the School Physical Activity and Nutrition Environment Tool to measure qualities of the obesogenic context. J Sch Health. 2016;86:39-47. As a result, the SPAN-ET identifies the critical areas within the school that are in need of improvement, specifically the environments that promote healthy nutrition and/or physical activity habits, enhance student learning outcomes, and support core competences of partnerships and learning strategies.88. John DH, Gunter K, Jackson JA, et al. Developing the School Physical Activity and Nutrition Environment Tool to measure qualities of the obesogenic context. J Sch Health. 2016;86:39-47.

The SPAN-ET evaluates the school's physical activity and nutrition contexts through 27 items, referred to as “areas of interest” (AI), which are organized within three environmental categories: physical, situational, and policy.Figure 1 visualizes the multidimensional and interactive framework of the SPAN-ET model for quantifying the quality of the school's physical activity and nutrition contexts across the three environmental categories.88. John DH, Gunter K, Jackson JA, et al. Developing the School Physical Activity and Nutrition Environment Tool to measure qualities of the obesogenic context. J Sch Health. 2016;86:39-47.

Figure 1.
Schema explaining the multidimensional and interactive framework of the SPAN-ET.

In order to evaluate each AI, the SPAN-ET provides a set of criteria that describes evidence-based best practices for each AI. If a school under evaluation fulfils at least 75% of the set criteria, we can conclude that this institution uses the best practices of this given AI. If, in contrast, it only fulfils 25% or less of the criteria, we conclude that this institution has poor practices. Table I in the online Appendix A shows the entire set of evaluations for each AI or environment.

The set of criteria for each AI might cover different types of aspects that require different types of information. Thereby, the use of the SPAN-ET implies the triangulation of different qualitative and quantitative information using direct observation, photography, interviews, document review, among others. During the school visit, two auditors observe physical and situational environments and interview all informants necessary to adequately assess each AI (Table II in the online Appendix A).

Schools are asked to provide two main sources of information: 1) institutional documentation (secondary data), and 2) interviews of key informants listed in Table II in the online Appendix A (primary data). The two auditors independently code each item. Before doing the interviews and physical visits, the auditors review in detail all the documentation, making an initial assessment of each AI. These data sources are complemented with systematic direct observations of physical and situational environments that are conducted before, during, and after the school day.

After the completion of data collection, auditors review the data, item by item, to identify the level of agreement. When a disagreement occurs between the auditors, they re-review all the available evidence as well as their perceptions to come to an agreement. Thus, the final scoring of a given AI assessment is the result of a consensus between the two auditors. Finally, a comprehensive report is delivered to each school to provide them with a set of recommendations.

Cross-cultural adaptation, content validation, and feasibility

Cross-cultural adaptation was conducted from September 2018 to August 2019. Based on the Guideline for Process of Cross-cultural Adaptation proposed by Beaton et al.,99. Beaton DE, Bombardier C, Guillemin F, et al. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186-91. we followed a five-stage methodological process that contains the standard stages suggested by the authors as well as a content validity analysis to obtain a better adapted version for the Spanish context. Figure 2 describes each stage. As a result, we provided a new version of the SPAN-ET for the Spanish context, which we have called SPAN-ET-ES. Both the translation and cross-cultural adaptation were conducted using the English version of the SPAN-ET, provided directly by the original developers.

Figure 2.
Global schema illustrating the different phases of cross-cultural adaptation and validation of the SPAN-ET questionnaire to the Spanish context. Stages proposed by Beaton et al.99. Beaton DE, Bombardier C, Guillemin F, et al. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186-91. for cross-cultural adaptation are indicated as Stages I to V. The content validity analysis was performed by a panel of five experts just before the pilot testing. FT, forward translation; BT, back translation.

1) Stages I and II: forward translation and synthesis

The first step for the cross-cultural validation was the initial translation from English into Spanish. In order to identify translation discrepancies and the absence of equivalent wording in specific questions as well as other theoretical or cultural differences, two independent translators with proficient English and different backgrounds were selected.99. Beaton DE, Bombardier C, Guillemin F, et al. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186-91. Our research team compared the translations in order to identify the main agreements and disagreements. In most cases, both translators agreed on the wording and phrasing of the translation. The SPAN-ET developers clarified a few disagreements in the Spanish translation. After their feedback and discussion, the synthesis version of the SPAN-ET-ES was completed.

2) Stage III: back translation

Thereafter, two independent professional English translators with no knowledge of the original SPAN-ET were asked to translate the SPAN-ET-ES back from Spanish to English. These two new versions of the SPAN-ET were again reviewed and refined. The reviewed version was sent to the original developers to analyse the accuracy and proximity of this new version with respect to the original. Based on the final feedback and discussion, a second version of the SPAN-ET-ES was concluded.

3) Stage IV: context adaptation

Starting with the new version, our research team performed a comprehensive context adaptation in two main areas. In the first area, as the original instrument was based on US legislation, we used the Spanish regulation counterpart. In the second area, we incorporated the Spanish equivalences of all references related to the US education system. All these adaptations required an extensive revision of Spanish legislation, regulations, and guides on different issues and, in some cases, their comparison with their US counterparts. All the literature consulted can be found in the Appendix B online.

After the context validation, SPAN-ET-ES was tested to assess the level of comprehensibility, applicability, and cultural appropriateness in the Spanish context. To do this, we performed a content validity analysis1010. Yaghmale F. Content validity and its estimation. J Med Educ. 2003;3:25-7. where a panel of five experts with different backgrounds were invited to evaluate each AI of the SPAN-ET-ES1111. Mastaglia B, Toye C, Kristjanson LJ. Ensuring content validity in instrument development: challenges and innovative approaches. Contemp Nurse. 2003;14:281-91.,1212. Lynn M. Determination and quantification of content validity. Nurs Res. 1986;35:382-6.. Using a four-point scale, each expert was asked to evaluate four dimensions of each AI: relevance, clarity, simplicity, and ambiguity (Table 1).

Table 1.
Criteria for measuring content validity.10.10. Yaghmale F. Content validity and its estimation. J Med Educ. 2003;3:25-7.

The panel of experts was made up of five professionals from different fields: a doctor in Physical Activity and Exercise Sciences specialized in motor learning in childhood, a doctor in Food Science and Technology specialized in Food Hygiene, a dietitian and doctor in medicine specialized in collective catering a dietitian-nutritionist responsible for the program for the revision of school menus of the Generalitat de Catalunya, and a dietitian and anthropologist specialized in nutrition in childhood and adolescence.

Based on the expert assessment, we computed the content validity of each individual item (I-CVI), which is the share of experts giving a rating of either 3 or 4 for each dimension:1212. Lynn M. Determination and quantification of content validity. Nurs Res. 1986;35:382-6.

I-CVI=i=1NCVIiN

Once the I-CVI was calculated for each AI, we estimated an aggregated approach of content validity by environment and by the entire instrument.1313. Polit DF, Beck CT. Focus on research methods handling missing data in self-report measures. Res Nurs Heal. 2006;29:489-97. For doing this, we estimated the content validity of the overall scale average (S-CVI/Ave):

S-CVI/Ave= j=1II-CVIiI

We developed an online tool using Open Data Kit 8 (opendatakit.org) in order to facilitate the review by the experts. Once collected, the information was analysed using Stata 14 (StataCorp LLC, Texas, USA).

4) Stage V: pilot testing

Once the new version of the SPAN-ET-ES was obtained from the content validity analysis, we performed a pilot test. This was carried out in Santa Coloma de Gramenet, a city close to Barcelona, in Catalonia, Spain. According to the latest national registry in 2019,1414. Instituto Nacional de Estadística. Population of the Continuous Municipal Register. The INE Statistical Organisation in Spain. 2019. Available from: https://www.ine.es/nomen2/index.do?accion=busquedaDesdeHome&nombrePoblacion=Santa+Coloma&x=0&y=0.
https://www.ine.es/nomen2/index.do?accio...
Santa Coloma was estimated to have 119,215 inhabitants and have a per capita gross income of €22,539 per capita. In total, we visited five public schools (four public schools and one sponsored by a public voucher system). Two well-trained researchers performed the evaluations, following the guidelines provided by the original developers.88. John DH, Gunter K, Jackson JA, et al. Developing the School Physical Activity and Nutrition Environment Tool to measure qualities of the obesogenic context. J Sch Health. 2016;86:39-47.

Results

SPAN-ET translation and cross-cultural adaptation

After the forward and back translations were done, a revised version was discussed with the original developers who agreed on the new wording and re-rephrasing. Once our research team had the certainty that the SPAN-ET-ES preserved the main dimensions of the original instrument, the context adaptation was performed in order to make the SPAN-ET-ES compatible with the legislation and other particularities of the Spanish context. In this process we added three items and deleted one. First, in order to gather information about the participation in various physical activity programs,1515. Aranceta Bartrina J, Pérez Rodrigo C, Campos Amado J, et al. Proyecto PERSEO: diseño y metodología del estudio de evaluación. Rev Esp Nutr Comun. 2013;19:76-87.

16. Santos SFG, Santiago RE, Gil-Antuñano NP, et al. Programa Thao-Salud Infantil: intervención de base comunitaria de promoción de estilos de vida saludables en la población infantil y las familias. Resultados de un estudio de cohorte. Nutr Hosp. 2015;32:2584-7.
-1717. Arcila-Agudelo AM, Ferrer-Svoboda C, Torres-Fernandez T, et al. Determinants of adherence to healthy eating patterns in a population of children and adolescents: evidence on the Mediterranean diet in the city of Mataró (Catalonia, Spain). Nutrients. 2019;11:854. we included a new item in AI-12 (Table 2). Additionally, we added two items in AI 16 and AI 27 that refer to the use of new technologies and their potential effects on the physical activity (AI-16) and nutrition (AI-27) of children. Second, as the item related to the presence of a health and nutrition educator did not apply to the Spanish context, we deleted item H in AI-27.

Table 2.
Number of items and changes made to them during the translation and cross-cultural validation process for the SPAN-ET-ES.

Furthermore, the new version underwent small changes in format, phrasing, and content, in order to simplify its application in Spain. In total, we made 38 changes throughout the instrument; no changes were made to the answer scale (Table 2). A detailed report on the changes are available upon request. An example of an extract of preliminary instructions and some AI translated to Spanish can be found in the Appendix C and Appendix D online.

Content validity analysis

After the translation and cross-cultural adaptation process, as well as the feedback from and discussion with the original developers, a content validity analysis was performed. Overall, the expert panel considered that, on average, items included in the revised version of the SPAN-ET-ES were found relevant (S-CVI/Ave=0.96), clear (S-CVI/Ave=0.96), simple (S-CVI/Ave=0.98), and non-ambiguous (S-CVI/Ave=0.98). When looking at the environmental level, we found that whereas the AI contained within the physical activity environment was considered very relevant, we had to implement minor changes to four AIs (relevance CVI <0.8) within the nutrition environment, as the experts considered them not applicable to the Spanish context. Table 3 summarizes the content analysis results for the SPAN-ET-ES.

Table 3.
Overall scale average (S-CVI/Ave) for each area of interest in the SPAN-ET-ES.

Pilot testing

Table 4 presents the results of the SPAN-ET-ES pilot testing phase for five Spanish schools located in Santa Coloma de Gramenet. Following the SPAN-ET-ES field work guidelines, the two trained auditors collected the documentation needed to assess the 27 AIs for each school. In all cases, they confirmed the existence of each data source as well as its accessibility. Besides small changes for the field work guidelines, the SPAN-ET-ES is based on information that is available in the Spanish context, which allows for a proper assessment of each AI. The auditors also indicated that the items included in the different AIs were easily understandable. On average, contacting schools, collecting, organizing, assessing the agreement and analyzing all the required information (primary and secondary data) for the SPAN-ET-ES took around 15 hours per school.

Table 4.
Level of accomplishment of each item and area of interest after applying the SPAN-ET-ES to the pre-pilot sample.

Overall, we found a 93% of agreement in the item scores between the two auditors when evaluating each AI. We only found two main disagreements in AI 1 and 23, which were easily resolved after reviewing complementary data sources. This high level of agreement between auditors was due to previous training in the administration of SPAN-ET-ES and the homogeneity achieved in the evaluation criteria. Table 4 presents the results of the assessment after applying the SPAN-ET-ES to the pilot testing sample.

Discussion

Prior work has documented the effectiveness of school-based interventions for promoting nutrition and physical activity among children and adolescents.33. Micha R, Karageorgou D, Bakogianni I, et al. Effectiveness of school food environment policies on children's dietary behaviors: a systematic review and meta-analysis. PLoS One. 2018;13:e0194555.,1818. Van Sluijs EMF, McMinn AM, Griffin SJ. Effectiveness of interventions to promote physical activity in children and adolescents: systematic review of controlled trials. Br J Sports Med. 2008;42:653-7. Such programs are developed within complex school behavioural environments which in turn involve physical, situational, and policy environments that can either facilitate or obstruct the effectiveness of any initiative to promote healthy habits among school-age populations.33. Micha R, Karageorgou D, Bakogianni I, et al. Effectiveness of school food environment policies on children's dietary behaviors: a systematic review and meta-analysis. PLoS One. 2018;13:e0194555.,88. John DH, Gunter K, Jackson JA, et al. Developing the School Physical Activity and Nutrition Environment Tool to measure qualities of the obesogenic context. J Sch Health. 2016;86:39-47. In this setting, it is important to be able to count on standardized tools that allow for the comprehensive understanding of the complexity of the school environment in its role in supporting healthy nutrition and physical activities. In this study, we adapted and partially validated the SPAN-ET, a tool developed in the US context, to be able to evaluate the school environment in its different contextual dimensions in the Spanish context.

Although we found some studies of cross-cultural translation and adaptation to the Spanish context of instruments related to nutritional outcomes of school age population,1919. Ortiz-Gutiérrez S, Pérez-Cruz E, Lara-Pompa NE, et al. Validation and adaptation of the Spanish version of the STRONGkids Nutrition Screening Tool. Nutr Clin Pract. 2019;34:589-96. we did not find previous experiences of tools like the SPAN-ET. In our work on the Spanish version of the SPAN-ET, apart from modifying some criteria phrasing, we have incorporated important changes in some features related to specificities in legislation and the cultural context. These changes are essential because the cross-cultural adaptation includes not only a correct translation that preserves the meaning of each test item, but also, if necessary, replaces items in order to make them relevant and valid in the new context.99. Beaton DE, Bombardier C, Guillemin F, et al. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186-91.,2020. Herdman M, Fox-Rushby J, Badia X. Equivalence and the translation and adaptation of health-related quality of life questionnaires. Qual Life Res. 1997;6:237-47.

Face validity was assessed by our research team at both the cross-cultural adaptation and the review stages.2121. Lytle LA. Measuring the food environment: state of the science. Am J Prev Med. 2009;36:S134-44. Additionally, the extensive literature and documentation review that was done, ensured that all significant aspects in the assessment of nutrition and physical activity environments were included. The final version of the SPAN-ET-ES includes more precise wording in some cases, as well as extensive instructions that also accompanied the original SPAN-ET, which were translated and adapted with the help of the original developers.

Content validity was studied with the collaboration of an expert panel that used content validity indexes to evaluate the comprehensiveness and representativeness of the SPAN-ET-ES's content.2121. Lytle LA. Measuring the food environment: state of the science. Am J Prev Med. 2009;36:S134-44. The results obtained indicated the relevance of the items included. Content validity facilitates the interpretation of the results obtained by the questionnaire and ensures construct validity.

Employing the SPAN-ET-ES in the pilot study confirmed its feasibility in the Spanish context. One important advantage of the SPAN-ET (and its Spanish version) is that it assesses simultaneously the two main school behavioural environments (i.e. nutrition and physical activity), integrates documentation, observations, and interviews with key school actors, and assesses multiple aspects of the physical, situational, and policy environment allowing for a comprehensive description of the school environment.2222. Jones NR, Jones A, van Sluijs EMF, et al. School environments and physical activity: the development and testing of an audit tool. Health Place. 2010;16:776-83. Other similar tools do not offer such coverage and describe only some aspects of the school environment,2323. Centers for Disease Control and Prevention. Community Health Assessment and Group Evaluation (CHANGE). 2018. Available at: https://www.cdc.gov/nccdphp/dch/programs/healthycommunitiesprogram/tools/change.htm.
https://www.cdc.gov/nccdphp/dch/programs...
rely mainly on interviews with administrators,2424. Scholtens S, Middelbeek L, Rutz SI, et al. Differences in school environment, school policy and actions regarding overweight prevention between Dutch schools. A nationwide survey. BMC Public Health. 2010;10:42. or include only food or physical activity environments.2222. Jones NR, Jones A, van Sluijs EMF, et al. School environments and physical activity: the development and testing of an audit tool. Health Place. 2010;16:776-83.

In a recent systematic review, Micha et al.33. Micha R, Karageorgou D, Bakogianni I, et al. Effectiveness of school food environment policies on children's dietary behaviors: a systematic review and meta-analysis. PLoS One. 2018;13:e0194555. found that there is strong evidence that nutritional programs and policies such as direct provision policies, competitive food/beverage standards, and school meal standards increasing fruit and vegetable intake, reduce the consumption of unhealthy snacks, as well as reduce total and saturated fat intake. Ridgers et al.55. Ridgers ND, Salmon J, Parrish AM, et al. Physical activity during school recess: a systematic review. Am J Prev Med. 2012;43:320-8. provide a systematic review of one of the most documented interventions within the school environment: the role of recess on physical activity. These authors conclude that this type of intervention makes a small contribution to daily moderate-to-vigorous intensity physical activity.

Even though these school-based interventions have well established effects on several outcomes, there is an important lack of understanding on the actual mechanisms through which these interventions produce changes in individual outcomes.33. Micha R, Karageorgou D, Bakogianni I, et al. Effectiveness of school food environment policies on children's dietary behaviors: a systematic review and meta-analysis. PLoS One. 2018;13:e0194555. Likewise, the unintended structural effects produced by a specific intervention on dimensions such as school policies or situational environments, are often neglected in school environment assessment tools.88. John DH, Gunter K, Jackson JA, et al. Developing the School Physical Activity and Nutrition Environment Tool to measure qualities of the obesogenic context. J Sch Health. 2016;86:39-47.,2525. Frumkin H, Geller R, Rubin IL, et al. Safe and healthy school environments. New York, NY: Oxford University Press; 2006. p. 462. In this context, the SPAN-ET (and its Spanish version) provides a valuable tool to assess school environments, which can work either as a baseline for an intervention or as an end-line for measuring effects.88. John DH, Gunter K, Jackson JA, et al. Developing the School Physical Activity and Nutrition Environment Tool to measure qualities of the obesogenic context. J Sch Health. 2016;86:39-47. Additionally, the SPAN-ET can be helpful in collecting data to assess school environments and then designing appropriate community policies aimed at improving them. This is the first study to our knowledge that assesses a standardized tool for evaluating school nutrition and physical activity environments in the Spanish context.

The scientific evidence on school-based interventions or assessments of school environments is scarce in Spain. In the framework of diverse initiatives of health promotion in schools led by various international organizations,2626. Unesco. International Union of Health Promotion and Education (IUHPE). Achieving health promoting schools?: guidelines for promoting health in school. 2009. Available at: https://healtheducationresources.unesco.org/library/documents/achieving-health-promoting-schools-guidelines-promoting-health-schools
https://healtheducationresources.unesco....
some authors have assessed the implementation of these initiatives in a sample of schools in different regions of Spain.2727. García-Vázquez J, Blanco Orvíz AG, García Alas N, et al. Evaluación de las escuelas promotoras de salud en Asturias (España). Glob Health Promot. 2009;16:96-106.,2828. Ramos P, Pasarín MI, Artazcoz L, et al. Escuelas saludables y participativas: evaluación de una estrategia de salud pública. Gac Sanit. 2013;27:104-10. They had a general health promotion focus and did not evaluate the school environment in detail in the aforementioned aspects. Additionally, some education-based interventions have shown some preliminary evidence of their actual effects on nutrition related to outcomes such as obesity.2929. Quiles Izquierdo J, Rodrigo Pérez C, Serra Lluis M, et al. Situación de la obesidad en España y estrategias de intervención. Rev Esp Nutr Comun. 2008;1414(33).,3030. Oliva Rodríguez R, Tous Romero M, Gil Barcenilla B, et al. Impacto de una intervención educativa breve a escolares sobre nutrición y hábitos saludables impartida por un profesional sanitario. Nutr Hosp. 2013;28:1567-73. None of this research provides any detailed baseline or end-line assessment of the actual conditions of environments within schools, probably due to its difficulty and the lack of adequate tools.

Although this study has completed a proper translation of the SPAN-ET for the Spanish context and included the assessment of some psychometric characteristics, there are some others that still remain undetermined. Additional research is now in process to complete the study of criterion validity, reliability (internal consistency, stability, and inter-auditor agreement), and the establishment of construct validity using a representative sample of Spanish schools. Once this validation process is finished, we will be able to assess the validity of the SPAN-ET-ES for the entire Spanish scholar system. Additional research could also examine the extent to which the use of the SPAN-ET-ES can provide new data for understanding the mechanisms through which school-based interventions could lead to structural transformations within the school.

In sum, the results from the cross-cultural adaptation and content validity analysis, allow us to conclude that SPAN-ET-ES is a feasible tool for assessing nutrition and physical activity environments at schools in the Spanish context. Likewise, our results are limited to the country setting of Spain. In order to use this tool in other Spanish-speaking contexts like those of Latin America, the SPAN-ET-ES should be adapted in terms of language, legislation, and other context-specific characteristics in each dimension, and then correspondingly validated.

What is known about the topic?

It is well stablished the effectiveness of school-based interventions for promoting nutrition and physical activity among children and adolescents. However, there is a lack of standardized tools, especially in non-English speaking countries, that allow a comprehensive understanding of the complexity of the school micro-environment in its role in supporting healthy nutrition and physical activities.

What does this study add to the literature?

This paper reports the cross-cultural adaptation and the validation of the content and feasibility of an instrument for assessing the school micro-environment in the Spanish context, which can work either as a baseline for school-based interventions or as an end-line for measuring effects in promoting the adoption of lifelong healthy habits in school-age populations.

What are the implications of the results?

The SPAN-ET-ES is a new tool that can work either as a baseline for school-based interventions or as an end-line for measuring effects in promoting the adoption of lifelong healthy habits in school-age populations in Spain. Moreover, it might also improve the design of evidenced-based policies and the development of institutional standards for promoting the nutrition and physical activity among Spanish schools.

Transparency declaration

The corresponding author on behalf of the other authors guarantee the accuracy, transparency and honesty of the data and information contained in the study, that no relevant information has been omitted and that all discrepancies between authors have been adequately resolved and described.

Acknowledgements

We thank Santa Coloma de Gramenet Town Hall for its support for this project. Likewise, we thank the five schools (Banus, Beethoven, Ferran de Sagarra, Las Palmeras, and Sagrada Familia School) whom participated in our pilot study. We also want to thank Elisabet Saravia Terricabras (Faculty of Education, UAB) for her assistance with the SPAN-ET back translation.

References

  • 1
    Glanz K, Sallis JF, Saelens BE, et al. Healthy nutrition environments: concepts and measures. Am J Heal Promot. 2005;19:330-3.
  • 2
    Mozaffarian D, Afshin A, Benowitz NL, et al. Population approaches to improve diet, physical activity, and smoking habits: a scientific statement from the American Heart Association. Circulation. 2012;126:1514-63.
  • 3
    Micha R, Karageorgou D, Bakogianni I, et al. Effectiveness of school food environment policies on children's dietary behaviors: a systematic review and meta-analysis. PLoS One. 2018;13:e0194555.
  • 4
    Story M, Nanney MS, Schwartz M. Schools and obesity prevention: creating school environments and policies to promote healthy eating and physical activity. Milbank Q. 2009;87:71-100.
  • 5
    Ridgers ND, Salmon J, Parrish AM, et al. Physical activity during school recess: a systematic review. Am J Prev Med. 2012;43:320-8.
  • 6
    Saluja K, Rawal T, Bassi S, et al. School environment assessment tools to address behavioural risk factors of non-communicable diseases: a scoping review. Prev Med Reports. 2018;10:1-8.
  • 7
    Lane HG, Calvert HG, Deitch R, et al. A systematic review of existing observational tools to measure the food and physical activity environment in schools. Health Place. 2020;66:102388.
  • 8
    John DH, Gunter K, Jackson JA, et al. Developing the School Physical Activity and Nutrition Environment Tool to measure qualities of the obesogenic context. J Sch Health. 2016;86:39-47.
  • 9
    Beaton DE, Bombardier C, Guillemin F, et al. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186-91.
  • 10
    Yaghmale F. Content validity and its estimation. J Med Educ. 2003;3:25-7.
  • 11
    Mastaglia B, Toye C, Kristjanson LJ. Ensuring content validity in instrument development: challenges and innovative approaches. Contemp Nurse. 2003;14:281-91.
  • 12
    Lynn M. Determination and quantification of content validity. Nurs Res. 1986;35:382-6.
  • 13
    Polit DF, Beck CT. Focus on research methods handling missing data in self-report measures. Res Nurs Heal. 2006;29:489-97.
  • 14
    Instituto Nacional de Estadística. Population of the Continuous Municipal Register. The INE Statistical Organisation in Spain. 2019. Available from: https://www.ine.es/nomen2/index.do?accion=busquedaDesdeHome&nombrePoblacion=Santa+Coloma&x=0&y=0
    » https://www.ine.es/nomen2/index.do?accion=busquedaDesdeHome&nombrePoblacion=Santa+Coloma&x=0&y=0
  • 15
    Aranceta Bartrina J, Pérez Rodrigo C, Campos Amado J, et al. Proyecto PERSEO: diseño y metodología del estudio de evaluación. Rev Esp Nutr Comun. 2013;19:76-87.
  • 16
    Santos SFG, Santiago RE, Gil-Antuñano NP, et al. Programa Thao-Salud Infantil: intervención de base comunitaria de promoción de estilos de vida saludables en la población infantil y las familias. Resultados de un estudio de cohorte. Nutr Hosp. 2015;32:2584-7.
  • 17
    Arcila-Agudelo AM, Ferrer-Svoboda C, Torres-Fernandez T, et al. Determinants of adherence to healthy eating patterns in a population of children and adolescents: evidence on the Mediterranean diet in the city of Mataró (Catalonia, Spain). Nutrients. 2019;11:854.
  • 18
    Van Sluijs EMF, McMinn AM, Griffin SJ. Effectiveness of interventions to promote physical activity in children and adolescents: systematic review of controlled trials. Br J Sports Med. 2008;42:653-7.
  • 19
    Ortiz-Gutiérrez S, Pérez-Cruz E, Lara-Pompa NE, et al. Validation and adaptation of the Spanish version of the STRONGkids Nutrition Screening Tool. Nutr Clin Pract. 2019;34:589-96.
  • 20
    Herdman M, Fox-Rushby J, Badia X. Equivalence and the translation and adaptation of health-related quality of life questionnaires. Qual Life Res. 1997;6:237-47.
  • 21
    Lytle LA. Measuring the food environment: state of the science. Am J Prev Med. 2009;36:S134-44.
  • 22
    Jones NR, Jones A, van Sluijs EMF, et al. School environments and physical activity: the development and testing of an audit tool. Health Place. 2010;16:776-83.
  • 23
    Centers for Disease Control and Prevention. Community Health Assessment and Group Evaluation (CHANGE). 2018. Available at: https://www.cdc.gov/nccdphp/dch/programs/healthycommunitiesprogram/tools/change.htm
    » https://www.cdc.gov/nccdphp/dch/programs/healthycommunitiesprogram/tools/change.htm
  • 24
    Scholtens S, Middelbeek L, Rutz SI, et al. Differences in school environment, school policy and actions regarding overweight prevention between Dutch schools. A nationwide survey. BMC Public Health. 2010;10:42.
  • 25
    Frumkin H, Geller R, Rubin IL, et al. Safe and healthy school environments. New York, NY: Oxford University Press; 2006. p. 462.
  • 26
    Unesco. International Union of Health Promotion and Education (IUHPE). Achieving health promoting schools?: guidelines for promoting health in school. 2009. Available at: https://healtheducationresources.unesco.org/library/documents/achieving-health-promoting-schools-guidelines-promoting-health-schools
    » https://healtheducationresources.unesco.org/library/documents/achieving-health-promoting-schools-guidelines-promoting-health-schools
  • 27
    García-Vázquez J, Blanco Orvíz AG, García Alas N, et al. Evaluación de las escuelas promotoras de salud en Asturias (España). Glob Health Promot. 2009;16:96-106.
  • 28
    Ramos P, Pasarín MI, Artazcoz L, et al. Escuelas saludables y participativas: evaluación de una estrategia de salud pública. Gac Sanit. 2013;27:104-10.
  • 29
    Quiles Izquierdo J, Rodrigo Pérez C, Serra Lluis M, et al. Situación de la obesidad en España y estrategias de intervención. Rev Esp Nutr Comun. 2008;1414(33).
  • 30
    Oliva Rodríguez R, Tous Romero M, Gil Barcenilla B, et al. Impacto de una intervención educativa breve a escolares sobre nutrición y hábitos saludables impartida por un profesional sanitario. Nutr Hosp. 2013;28:1567-73.

Appendix A. Supplementary data

Supplementary data associated with this article can be found, in the online version, at doi:10.1016/j.gaceta.2021.03.007.

  • Funding

    This research project received no external funding. A.M. Arcila-Agudelo received a grant from the Colombian government COLCIENCIAS (#679) to study her PhD in Food and Nutrition at the Universitat de Barcelona in Spain.

Publication Dates

  • Publication in this collection
    22 May 2023
  • Date of issue
    Sep-Oct 2022

History

  • Received
    21 Jan 2021
  • Accepted
    19 Mar 2021
  • Published
    23 June 2021
Sociedad Española de Salud Pública y Administración Sanitaria (SESPAS) Barcelona - Barcelona - Spain
E-mail: gs@elsevier.com