Print version ISSN 0034-8910
Rev. Saúde Pública vol.43 n.3 São Paulo May./Jun. 2009 Epub Apr 03, 2009
Validez y confiabilidad de la versión brasilera del Índice de Capacidad para el Trabajo
Maria Carmen MartinezI; Maria do Rosário Dias de Oliveira LatorreII; Frida Marina FischerIII
de Epidemiologia. Hospital Samaritano de São Paulo. São Paulo,
IIDepartamento de Epidemiologia. Faculdade de Saúde Pública. Universidade de São Paulo (FSP-USP). São Paulo, SP, Brasil
IIIDepartamento de Saúde Ambiental. FSP-USP. São Paulo, SP, Brasil
To evaluate the validity and reliability of the Portuguese language version
of a work ability index.
METHODS: Cross sectional survey of a sample of 475 workers from an electrical company in the state of Sao Paulo, Southeastern Brazil (spread across ten municipalities in the Campinas area), carried out in 2005. The following aspects of the Brazilian version of the Work Ability Index were evaluated: construct validity, using factorial exploratory analysis, and discriminant capacity, by comparing mean Work Ability Index scores in two groups with different absenteeism levels; criterion validity, by determining the correlation between self-reported health and Work Ability Index score; and reliability, using Cronbach's alpha to determine the internal consistency of the questionnaire.
RESULTS: Factorial analysis indicated three factors in the work ability construct: issues pertaining to "mental resources" (20.6% of the variance), self-perceived work ability (18.9% of the variance), and presence of diseases and health-related limitations (18.4% of the variance). The index was capable of discriminating workers according to levels of absenteeism, identifying a significantly lower (p<0.0001) mean score among subjects with high absenteeism (37.2 points) when compared to those with low absenteeism (42.3 points). Criterion validity analysis showed a correlation between the index and all dimensions of health status analyzed (p<0.0001). Reliability of the index was high, with a Cronbach's alpha of 0.72.
CONCLUSIONS: The Brazilian version of the Work Ability Index showed satisfactory psychometric properties with respect to construct validity, thus constituting an appropriate option for evaluating work ability in both individual and population-based settings.
Descriptors: Work Capacity Evaluation. Working Conditions. Questionnaires. Translations. Validity of Tests. Reproducibility of Results. Occupational Health.
Evaluar la validez y la confiabilidad de la versión brasilera del índice
de capacidad para el trabajo.
MÉTODOS:Estudio transversal con muestra de 475 trabajadores de empresa del sector eléctrico en el estado de Sao Paulo (fueron diez municipios en Campinas y región, en Sureste de Brasil), realizado en 2005. Se evaluaron los siguientes aspectos de la versión brasilera del Índice de Capacidad para el trabajo: validez del constructo, por medio del análisis factorial confirmatorio y de la capacidad discriminante, validez del criterio, correlacionado el puntaje del Índice con medidas de salud auto-referidas; y confiabilidad, por medio del análisis de la consistencia interna utilizando el coeficiente alfa de Cronbach.
RESULTADOS:El análisis factorial indicó tres factores de constructo habilidad para el trabajo: cuestiones relativas a los "recursos mentales" (20,6% de la varianza), a la autopercepción de la habilidad para el trabajo (18,9% de la varianza). El índice discriminó los trabajadores según el nivel de ausentismo, identificando promedio estadísticamente significativa (p<0,001) entre aquellos con ausentismo elevado (37,2 puntos) y bajo (42,3 puntos). El análisis de criterio mostró correlación del índice con todas las dimensiones del estado de salud analizadas (p<0,0001). El índice presentó buena confiabilidad con coeficiente alfa de Cronbach (0,72).
CONCLUSIONES: La versión brasilera del Índice de Capacidad para el Trabajo mostró propiedades psicométricas satisfactorias con relación a la validez del constructo, de criterio y de confiabilidad, representando una opción adecuada para evaluación de la habilidad para el trabajo en abordajes individuales e investigaciones poblacionales.
Descriptores: Evaluación de Capacidad de Trabajo. Condiciones de Trabajo. Cuestionario. Traducción (Producto). Validez de las Pruebas. Reproducibilidad de Resultados. Salud Laboral.
Beginning in the 1980's, as a result of the ageing of the working population in the context of a restructuring of the production process, issues pertaining to functional ageing have become a priority in the field of worker health.6,a Work ability has since then become an important indicator, for it encompasses aspects of physical health, psychosocial wellbeing, individual competence, and work conditions.b
The concept of work ability results from the combination of human resources in the context of the physical, mental, and social demands of work, organizational culture, and work environment.7 This concept can be formulated as "how well a worker is or will be in the present or near future, and how capable this worker is of performing work given the demands of the job and the health status and mental and physical capabilities of the worker."18 Functional ageing is understood as a reduction in work ability, and may precede chronological ageing, depending on the level of demand.17
The Work Ability Index (WAI) is an instrument that allows for the evaluation of work ability from the perspective of the worker's own perception, based on ten questions that address seven dimensions: (1) "current work ability compared with the lifetime best," with a score ranging from 0 to 10 points; (2) "work ability in relation to the demands of the job," based on two questions on the nature of work (physical, mental, or mixed) that, when weighted, yield a score ranging from 2 to 10 points; (3) "number of current diseases diagnosed by physician," obtained based on a list of 51 diseases that defines a score ranging from 1 to 7 points; (4) "estimated work impairment due to diseases," based on a question with a score ranging from 1 to 6 points; (5) "sick leave during the past year (12 months)," based on a question on the number of absences, categorized into five groups with score ranging from 1 to 5 points; (6) "own prognosis of work ability two years from now," based on a question with a score ranging from 1 to 4 points; and (7) "mental resources," based on a score ranging from 1 to 4 points obtained by weighting the answers to three questions. The results of these seven dimensions provide a measure of work ability that ranges from 7 to 49 points. Instructions for calculating the score are available in Tuomi et al (2005).18
This questionnaire was elaborated based on studies carried out in Finland, where a cohort of workers was followed between 1981 and 1992 to investigate issues of work ability based on the stress-strain theoretical model.9 According to this model, the distress generated by the physical and mental demands of work can lead to a reduction in work ability and trigger diseases.9,20 These studies have consolidated the theoretical bases of the major determinants, consequences, and interventions of work ability and served as a basis for the development of the underlying structure of WAI, which allows for evaluation and early detection of alterations and can subsidize the design of preventive measures.6,7,16
In Brazil, studies of work ability began to be conducted following the translation and adaptation of the WAI questionnaire for use in this country.18 Certain alterations were made to the text of the instrument as an attempt to ensure that all questions would be understood and that the questionnaire could be self-administered by any subject who completed at least the fourth-grade of elementary education.18 The Brazilian version of WAI can be found in Tuomi et al (2005).18
Since its adaptation for use in Brazil in the late 1990's, the WAI questionnaire has been employed in several population-based surveys.1,5,13,19 However, the psychometric properties of the Brazilian version have not yet been investigated.
The present study was aimed at assessing the validity and reliability of the psychometric properties of the Brazilian version of the Work Ability Index.
We conducted a cross-sectional study whose target population comprised individuals working in the energy transmission, advanced energy distribution stations, and human resources sectors of an electrical utility company in the area of the municipality of Campinas, Southeastern Brazil.
Of the 582 workers that constituted the target population, 39 (6.7%) workers who were on leave, changing function, or on vacation at the time of data collection were excluded. Of the 543 remaining subjects, 22 were in training outside the company, travelling on business, or could not be located, totaling 521 available workers (89.5% of the original population). Of these, 21 either did not respond or refused to participate in the study - a refusal rate of 4.0% - and 25 questionnaires were left incomplete. Our final sample thus included 475 (87.5%) out of 543 eligible workers.
An analysis of losses showed no difference in terms of sex (8.5% losses among women and 12.9% among men; p=0.385), work sector (14.6% in the administrative sector; 12.5% in the energy distribution sector, and 10.5% in the energy transmission sector; p=0.703), and time in the job (mean 12.9 years in the company among participants and 12.4 years among losses; p=0.548). There was a statistically significant difference in age between participants and losses (mean age 37.5 and 39.7 years, respectively; p=0.030). We believe that this difference would be unlikely to influence our results, and therefore regard the sample as representative of the studied population.
Data collection was carried out at the workplace, between August and September 2005. For data collection, we employed a questionnaire with items addressing demographic and functional characteristics in addition to the WAI and the Medical Outcomes Study 36 - Item short form health survey (SF-36) questionnaires.
To determine the psychometric properties of this version of WAI, we chose to evaluate validity of construct and criterion. Content validity was not evaluated, since this was addressed during the stages of translation and transcultural adaptation of WAI for use in Brazil.
To determine construct validity, we carried out confirmatory factor analysis through principal component analysis, selecting factors with eigenvalues greater than 1 and correlation coefficients greater than 0.50, using the varimax method for matrix rotation. This analysis was aimed at determining whether predicted WAI dimensions would be confirmed in this population.
We carried out discriminant validity analysis by comparing mean scores of groups of workers with high or low sickness-related absenteeism, using the Mann-Whitney test. Information on absenteeism was obtained from the "sickness-related work absence" dimension of WAI. We considered as with low absenteeism workers who reported up to nine missed workdays in a 12-month period, and as with high absenteeism workers who reported missing ten or more days in the same period. These cutoff points were determined based on the question's response categories (zero days, up to nine days, ten to 24 days, 25 to 99 days, and 100 to 365 days), defined in the structure of the questionnaire.22
Criterion validity was evaluated by determining the correlation between WAI scores and health-related variables measured using SF-36, using the Spearman correlation coefficient. WAI includes health-related variables within its scope, and is a predictor of medium and long-term worker health.18,c We chose SF-36 as our standard criterion because it allows for an evaluation of overall health based on the subject's own perception, generating eight scores that range from 0 to 100 points, representing the concepts most frequently measured in health surveys: physical functioning, role-physical, bodily pain, general health, vitality, social functioning, role-emotional, and mental health.3
WAI reliability was determined by analysis of internal consistency among its items, using Cronbach's alpha coefficient.
We carried out Kolmogorv-Smirnov analysis to determine adherence of the WAI score to normal distribution, and subsequent statistical tests were chosen based on the result of this analysis. For all analyses, we adopted the 5% significance level. All calculations were performed using SPSS version 10.0 software.
This study was approved by the Ethics Committee of the Faculdade de Saúde Pública da Universidade de São Paulo. Worker participation was voluntary and all subjects signed a term of free informed consent.
The study population consisted predominantly of males (90.9%), married or with partner (75.2%), and with complete secondary (64.6%) or university education (26.7%). Mean age was 36.8 years (sd=8.0), ranging from 18.0 to 56.0 years, with a median of 37.0 years. Work was predominantly of mixed nature (77.9%), with no workers carrying out predominantly physical tasks.
Mean WAI score was 41.8 points (sd=5.1), ranging from 13.0 to 49.0 points and with a median of 43.0 points. This variable was not normally distributed (p<0.0001, Kolmogorov-Smirnov test), determining the use of nonparametric tests in subsequent analyses.
Table 1 shows the following results for the different WAI dimensions: for "current work ability compared with the lifetime best," 86.3% of workers classified themselves in the three highest scores. For "work ability in relation to the demands of the job," 86.1% of workers placed themselves in the three highest scores. For "number of current diseases diagnosed by physician," 36.6% of workers reported absence of disease (7 points) and 8.4% reported five or more diseases (1 point). For "estimated work impairment due to diseases," 57.5% of workers reported no hindrance/disease affecting their work ability (6 points). For "sick leave during the past year (12 months)," 59.8% of workers reported no absence from work due to disease in the last 12 months (5 points). For "own prognosis of work ability two years from now," 89.1% of workers considered themselves very likely to be able to perform their current activities in two years time (7 points). For "mental resources," 65.1% of workers were in the highest score in the three mental resources scales (ability to appreciate daily activities, perception of being active and alert, feeling of hope for the future).
Table 2 shows that principal component analysis selected three factors with a cumulative total variance of 57.9%. The first factor (20.6% of total variance) consisted of questions H, I, and J, which represent the "mental resources" dimension. The second factor (18.9% of variance) comprised questions A, B, and C, on the worker's perception of his or her work ability. The third factor (18.4% of variance) was composed of questions D, E, F, and G, which assess the presence of diseases and health-related restrictions.
Mean WAI score was higher among workers with low absenteeism (42.3 points) than among those with high absenteeism (37.2 points), and this difference was statistically significant (p<0.001), distinguishing groups of workers as to their level of disease-related work absenteeism.
WAI showed a statistically significant correlation with the eight dimensions of health status analyzed (p<0.001), with better health status being correlated with higher WAI score (Table 3).
The Cronbach's alpha coefficient for WAI was 0.72. Exclusion of any of the questions did not alter this result (Table 4).
Issues pertaining to work ability have gained in importance in the field of public health due to their individual, social, and economic implications.a The contribution of WAI to the study of work ability is related to its predictive value in terms of disability, health/disease, and mortality.17,d
Our evaluation of construct validity using factorial analysis showed that the questions included in WAI can be grouped into three components that empirically confirm the work ability construct, understood as the ability a worker has to carry out his or her duties, and which is strongly influenced by the worker's physical and mental health.18,c
An evaluation of the psychometric properties of WAI in a population of about 38 thousand nurses from ten European countries showed that the factorial structure of WAI had two principal components in eight countries and one principal component in one country. The authors considered the first of these components to represent the subjective evaluation of work ability and the worker's mental resources, and the second to represent self-perceived health status and sickness-related absenteeism.c
Still with regard to construct validity, in this study we evaluated discriminant validity based on a comparison between groups with different absenteeism patterns. Workers with limitations in work ability showed greater absenteeism than other workers.10
Our results indicate that WAI is capable of discriminating between groups with different patterns of absenteeism. Workers with greater absenteeism showed worse work ability scores than other workers, confirming the validity of the Brazilian version. However, our results differ from those reported in the study of European nurses, where there was no relationship between sickness-related absenteeism and work ability.c
Construct validity is considered as the primary form of validation of an instrument designed to measure qualitative data, given that it tests the hypothesis of legitimate and appropriate representation of the construct by the instrument.8,14 In the present study, the Brazilian version of WAI showed satisfactory construct validity, and higher discriminatory power than versions from other countries.
The greatest difficulty with respect to criterion validity is obtaining a criterion for comparison considered valid for measuring subjective aspects.8,14 We regarded health status as a proxy for work ability given its major role in determining such ability. Deterioration and improvement in health status represent, respectively, a risk and the possibility of further developing work ability.c,b We chose to use a self-evaluated measure of health that is a validated strategy for representing health status.11,16
All dimensions of health were statistically correlated with WAI. This result is consistent with the theoretical framework of work ability, which is represented as health based on functional ability and presence of diseases, expanded to encompass a global view of health.16 Though significant, the weak correlations may be justified by the fact that each dimension in itself is not capable of explaining the behavior of the overall WAI score, since they are unable to portray the totality of the health-disease process. Furthermore, work ability can be influenced by a multifactorial process in which several elements interact with each other, often in a complex fashion.6,7
In SF-36, health dimensions "physical functioning," "role-physical," "bodily pain," and "general health" are representative of physical health, the remaining dimensions representing mental health.20 Dimensions of physical health were in general more strongly correlated with WAI than dimensions of mental health. Physical health, represented by physical functioning, is regarded as a basis for work ability given its significant role in worker impairment, since it reflects the worker's performance in light of the demands made by his or her work.15,c Mental health is considered as more relevant to work in which demands are predominantly mental in nature.15
The criterion validity analysis of the original instrument showed an association between WAI and the adopted parameters.4 A study of administrative workers in Brazil found statistically significant correlations between work ability and all dimensions of health evaluated.13 In the European nurse study, evaluation of construct validity using self-reported measures of physical and mental wellbeing showed that WAI score correlated with self-perceived general health status, emotional exhaustion, and disability.d
In the present study, the reliability of the WAI questionnaire was determined using Cronbach's alpha coefficient. This approach yielded a coefficient of 0.72, considered as satisfactory.2 Another WAI reliability study carried out among German workers aged 40 years or older showed acceptable reliability based on a test-retest strategy with a four-week interval between each administration.21 The mean Cronbach's alpha coefficient in the European nurse study was 0.72, indicating satisfactory internal consistency, with the exception of Slovakia (0.54), possibly due to biased sampling.b Other Brazilian studies showed Cronbach's alpha coefficients for WAI of 0.73 among administrative workers13 and 0.90 among nursing staff.5
The socio-occupational profile of the population of the present study differs from that of the general population in that our subjects have higher levels of schooling and income, are relatively younger, and perform predominantly physical and mental activities. The final mean WAI score was 41.8 points, indicating a high level of work ability, although this result is subject to the "healthy worker" bias.
Since this population displays very specific characteristics in terms of demographic profile, health status, and occupational placement, the psychometric ability of WAI in this context may not be valid for other Brazilian worker populations, and our results should be generalized with caution.
From this perspective, WAI reliability should be reevaluated prior to each administration of the instrument. Such precaution is aimed at identifying variations in questionnaire reliability, which may be affected by the breadth the of the variable being measured, by the characteristics of the study population, or by the conditions under which measurement is carried out.12
One of the limitations of the present study is the definition of cutoff points for the WAI score, which is based on results obtained from Finnish workers aged 45-58 years, using the following criteria: the 15% of workers with worst scores were considered as with "poor" ability, the 15% workers with best scores were considered as with "excellent" ability, and workers with "moderate" and "good" ability were divided by the median score.9,18 Since Brazilian workers have a different demographic composition, are exposed to working and living conditions that differ from those of Finland, and are likely to be subject to a different pattern of functional ageing, the original cutoff points proposed in the Finnish study may not be valid, and were therefore not adopted in the present study. Thus, we recommend that WAI results be regarded as a score until studies aimed at validating these cutoff points are carried out in the Brazilian setting.
Another aspect to be considered is that current WAI categories may not be valid for young workers, since current reference values may lead to overestimation of results among younger subjects.9 Another categorization is available that is based on Finnish workers in their 30's; however, follow-up studies will be required to verify the predictive value of WAI among younger workers.9
WAI results can be used at both the individual and collective levels. At the individual level, to identify workers whose functional capacity is compromised, so that support measures can be adopted. At the collective level, to trace the general profile of work ability and to identify factors affecting this profile, so that corrective initiatives may be undertaken.18 Other positive aspects of WAI are the ease and the short time required for its administration, and its low cost.18
In the present study, WAI showed satisfactory psychometric properties, with good performance in terms of construct and criterion validity, and reliability, constituting an appropriate option for evaluating work ability among Brazilian workers, both at the individual level and in population-based settings.
Further studies should be carried out with other groups of workers in order to increase our knowledge of the behavior of the psychometric properties of the Brazilian version of WAI in different age groups. Until this is done, it will be prudent to evaluate the reliability of this instrument before each use.
1. Bellusci SM, Fischer FM. Envelhecimento funcional e condições de trabalho em servidores forenses. Rev Saude Publica. 1999;33(6):602-9. DOI: 10.1590/S0034-89101999000600012 [ Links ]
2. Bland JMB, Altman DG. Cronbach's alpha. BMJ. 1997;314(7080):572. [ Links ]
3. Ciconelli RM, Ferraz MB, Santos W, Meirão I, Quaresma MR. Tradução para a lingual portuguesa e validação do questionário genérico de avaliação de qualidade de vida SF-36 (Brasil SF-36). Rev Bras Reumatol. 1999;39(3):143-50. [ Links ]
4. Eskelinen L, Kohvakka A, Merisalo T, Hurri H, Wågar G. Relationship between the self-assessment and clinical assessment of health status and workability. Scand J Work Environ Health. 1991;17(Suppl 1):40-7. [ Links ]
5. Fischer FM, Borges FN, Rotenberg L, Latorre MR, Soares NS, Rosa PL, et al. Workability of health care shift workers: what matters? Chronobiol Int. 2006;23(6):1165-79. DOI:10.1080/07420520601065083 [ Links ]
6. Ilmarinen J, Tuomi K, Eskelinen L, Nygård C-H, Huuhtanen P, Klockars M. Background and objectives of the Finnish research project on aging workers in municipal occupations. Scand J Work Environ Health. 1991;17(Suppl 1):7-11. [ Links ]
7. Ilmarinen J. Aging and work. Occup Environ Med. 2001;58(8):546-51. DOI:10.1136/oem.58.8.546 [ Links ]
8. Kerlinger FN. Foundations of behavioral research. New York: CBS College Publishing; 1986. p.404-15. [ Links ]
9. Kujala V, Remes J, Ek E, Tammelin T, Laitinen J. Classification on work ability index among young employees. Occup Med (Lond). 2005;55(5):399-401. DOI:10.1093/occmed/kqi075 [ Links ]
10. Lindberg P, Vingård E, Josephson M, Alfredsson L. Retaining the ability to work - associated factors at work. Eur J Public Health. 2006;16(5):470-5. DOI:10.1093/eurpub/cki190 [ Links ]
11. Lundberg O, Manderbacka K. Assessing reliability of a measure of self-rated health. Scand J Soc Med. 1996;24(3):218-24. [ Links ]
12. Lynn MR. Reliability estimates: use and disuse. In: Downs FS, editor. Readings in research methodology. 2.ed. Philadelphia: Lippincott; 1999. p.236-8. [ Links ]
13. Martinez MC, Latorre MRDO. Saúde e capacidade para o trabalho em trabalhadores de área administrativa. Rev Saude Publica. 2006;40(5):851-8. DOI:10.1590/S0034-89102006000600015 [ Links ]
14. Nunnally JC, Bernstein IH. Psychometric theory. 3.ed. New York: McGraw-Hill; 1994. p.83-113. [ Links ]
15. Nygård CH, Eskelinen L, Suvanto S, Tuomi K, Ilmarinen J. Associations between functional capacity and work ability among elderly municipal employees. Scand J Work Environ Health. 1991;17(Suppl 1):122-7. [ Links ]
16. Tuomi K, Ilmarinen J, Klockars M, Nygård CH, Seitsamo J, Huuhtanen P, et al. Finnish research project on aging workers in 1981-1992. Scand J Work Environ Health. 1997;23(Suppl 1):7-11. [ Links ]
17. Tuomi K, Ilmarinen J, Seitsamo J, Huuhtanen P, Martikainen R, Nygård CH, et al. Summary of the Finnish research project (1981-1992) to promote the health and work ability of aging workers. Scand J Work Environ Health. 1997;23(Suppl 1):66-71. [ Links ]
18. Tuomi K, Ilmarinen J, Jahkola A, Katajarinne L, Tulkki A. Índice de capacidade para o trabalho. São Carlos: EDUFSCAR; 2005. [ Links ]
19. Walsh IAP, Corral S, Franco RN, Canetti EEF, Alem MER, Coury HJCG. Capacidade para o trabalho em indivíduos com lesões músculo-esqueléticas crônicas. Rev Saude Publica. 2004;38(2):149-56. DOI:10.1590/S0034-89102004000200001 [ Links ]
20. Ware JE Jr. SF-36 health survey update. Spine. 2000;25(24):3130-9. DOI:10.1097/00007632-200012150-00008 [ Links ]
21. Zwart BC, Frings-Dresen MH, van Duivenbooden JC. Test-retest reliability of the Work Ability Index questionnaire. Occup Med (Lond). 2002;52(4):177-81. DOI:10.1093/occmed/52.4.177 [ Links ]
Maria Carmen Martinez
Av. Conselheiro Brotero, 1505, cj. 32 - Higienópolis
01232-010 São Paulo, SP, Brasil
Costa G. Some considerations about aging, shift work and work ability. In: Costa
G, Goedhard WJA, Ilmarinen J, editors. International Congress Series. Proceedings
of the 2nd International Symposium in work ability: assessment and promotion
of work ability, health and well-being of ageing workers; 2004 Oct 18-20; Verona,
Italy. Amsterdam: Elsevier. 2005; 1280:67-72.
b Ilmarinen J. Towards a longer worklife! Ageing and the quality of worklife in the European Union. Helsinki: Finnish Institute of Occupational Health. Ministry of Social Affairs and Health; 2006. p.132-48
c Ilmarinen J, Tuomi K, Seitsamo J. New dimensions of work ability. In: Costa G, Goedhard WJA, Ilmarinen J, editors. International Congress Series. Proceedings of the 2nd International Symposium in work ability: assessment and promotion of work ability, health and well-being of ageing workers; 2004 Oct 18-20; Verona, Italy. Amsterdam: Elsevier. 2005; 1280:3-7.
d Radkiewicz P, Widerszal-Bazyl M. Psychometric properties of Work Ability Index in the light of comparative survey study. In: Costa G, Goedhard WJA, Ilmarinen J, editors. International Congress Series. Proceedings of the 2nd International Symposium in work ability: assessment and promotion of work ability, health and well-being of ageing workers; 2004 Oct 18-20; Verona, Italy. Amsterdam: Elsevier. 2005; 1280:304-9.