Print version ISSN 0213-9111
Gac Sanit vol.22 n.4 Barcelona Jul./Aug. 2008
Cost-outcome analysis of joint replacement: evidence from a Spanish public hospital
Análisis coste-resultado del remplazo de articulaciones. Evidencia de un hospital público español
José Luis Navarro Espigares, Elisa Hernández Torres
Subdirección Económica de Control de Gestión, Hospital Universitario Virgen de Las Nieves, Departamento de Economía Internacional y de España, Facultad de Ciencias Económicas y Empresariales, Campus La Cartuja, Granada, España.
Background and objectives: Efficiency-based healthcare decision-making has been widely accepted for some time, with cost per quality-adjusted life year (QALY) as the main outcome measure. Nevertheless, for numerous medical procedures, little data are available on the cost per QALY gained. The aim of the present study was to calculate the cost per QALY gained with primary hip and knee replacement and to compare the result with the cost per QALY for other medical procedures, as well as with the maximum threshold cost considered acceptable in Spain.
Methods: We performed a prospective cohort pre-test/post-test study of patients undergoing primary hip or knee arthroplasty. Age, sex, and clinical variables were recorded. Functional status and quality of life were measured by means of the WOMAC and EuroQol instruments, respectively, before the intervention and 6 months later. The direct costs of the intervention were calculated, with length of hospital stay and the prosthesis as the main cost drivers.
Results: A total of 80 patients, 40 from each intervention, were included in this study. Both functional and perceived health status improved after the intervention. The number of QALYs gained in the knee cohort was 4.64, while that in the hip cohort was 0.86. The total cost of knee replacement was lower (6,865.52 ) than that of hip replacement (7,891.21 ). The cost per QALY gained was 1,275.84 and 7,936.12 for knee and hip interventions, respectively. The calculations performed included a 6% discount rate for health outcomes, a 3% inflation rate for costs, and a success rate of 95% at 15 years.
Conclusions: The costs of both knee and hip replacement were lower than the threshold of 30,000 per QALY considered acceptable in Spain, and compared favorably with other medical and surgical procedures.
Palabras clave: Cost-utility analysis. Hip arthroplasty. Knee arthroplasty. Quality of life.
Fundamento y objetivos: Está ampliamente aceptada la toma de decisiones sanitarias basada en la eficiencia, con el coste por año de vida ajustado por la calidad (AVAC) como medida de resultado. No obstante, aún es escasa la disponibilidad de datos de coste por AVAC de las intervenciones. El objetivo de este trabajo es calcular el coste por AVAC ganado en artroplastia de cadera y rodilla, y compararlo con los costes por AVAC de otras intervenciones, así como con el umbral máximo establecido.
Métodos: Estudio de cohortes prospectivo pre-test post-test de pacientes intervenidos de prótesis primaria de cadera o rodilla. Se recogieron variables demográficas, clínicas, funcionales y del estado de salud percibida antes de la intervención y 6 meses después de ésta, mediante los cuestionarios WOMAC y EuroQol, respectivamente. Se calcularon los costes directos de la intervención, considerando la prótesis y la duración de la estancia como determinantes principales del gasto.
Resultados: Se incluyeron 80 pacientes, 40 por cada articulación. El estado funcional y la salud autopercibida mejoraron tras la intervención. Se ganaron 4,64 y 0,86 AVAC en intervenciones de rodilla y cadera, respectivamente. El coste por proceso de prótesis de rodilla fue de 6.865,52 y de cadera de 7.891,21 . El coste por AVAC ganado es de 1.275,84 y 7.936,12 para las intervenciones de rodilla y cadera, respectivamente. Se ha tenido en cuenta una tasa de descuento para los resultados en salud del 6%, una inflación del 3% y una tasa de éxito de las intervenciones del 95% a 15 años.
Conclusiones: El coste por AVAC ganado tras artroplastia de rodilla y cadera está dentro del límite considerado aceptable en España (30.000 por AVAC) y resulta bien posicionado en comparación con otras intervenciones.
Keywords: Análisis coste-utilidad. Artroplastia de cadera. Artroplastia de rodilla. Calidad de vida.
During the last 3 decades, total hip and knee replacement (arthroplasty) have become very common throughout the world, and are procedures that present low mortality rates. This type of surgery is considered an effective treatment, even one of the most successful surgical treatments. In fact, it is generally accepted that in these processes functional benefits outweigh clinical risks and costs. However, since this is a major surgical procedure, its application is generally restricted to patients who, while showing different pathologies, suffer severe pain and functional disability, as well as in cases where other treatments have already failed.
The objective of these medical interventions is to improve the condition of functional disabilities and relieve pain caused by the deterioration of joints. A further aim is to restore the necessary mobility for patients, so they are able to maintain their functional independence and appropriate performance of daily-living activities, thereby improving their quality of life.
The efficacy of hip and knee arthroplasty has been assessed from several points of view. The most widely extended analysis, from a clinical perspective, has indicated that arthroplasty of both hip1-3 and knee4,5 are effective procedures in lessening pain and improving functionality of joints. More recently a new assessment perspective based on related health quality of life is becoming widespread, which reports good results as well6,7.
Various studies in different health contexts have consistently shown that the cost-effectiveness of both knee and hip prosthetic surgery is comparable to that of other medical and surgical interventions commonly implemented, e.g. bypass surgery and renal dialysis8-10.
During the last 15 years, the number of published investigations on economic evaluation of arthroplasties, mainly those performed as cost-effectiveness analyses (CEA), has noticeably increased10. Nevertheless, since the typical measurements of outcomes in CEA usually have a limited scope11 that is different for each type of intervention evaluated, the results of cost-effectiveness analysis, when used as an instrument for decision-making of healthcare resources allocation, present certain limitations.
In the current scenario with increasing pressures regarding healthcare costs, decision-making about health-care resources allocation based on explicit and objective criteria has become critically important.
In accordance with previous statements, methodological guidelines for performance of pharmacoeconomic evaluations, aligned with the well-known information necessities of decision-makers, show preferences more and more oriented towards the realisation of cost-utility assessments12,13. Nonetheless, this technique has been, up to now, the least applied and published technique of economic assessments in Spain and at the international level as well. Although the absolute number of studies using this approach has risen, the relative share of economic evaluations using QALYs or life-years gained fell from 1986 to 199614. Consequently, at present, the availability of cost-effectiveness data expressed in terms of quality adjusted life years (QALY) is still scarce.
The objective of this paper is to estimate the cost-utility of primary hip and knee arthroplasty and to assess its monetary value with general criteria of acceptability indicating an efficient cost-utility relationship.
This is a partially stochastic cost-outcome description, where effectiveness data were collected by means of a prospective cohort study of patients undergoing primary, total or partial, hip or knee arthroplasty, and costs data are deterministic.
Patients and methods
A sample of 80 patients was selected by a stratified random sampling method, 40 patients of each intervention under study, at the University Hospital Virgen de las Nieves of Granada during the year 2005. Patients were selected from the waiting list for primary hip and knee replacement surgery. Exclusion criteria were revision surgery, emergencies, as well as patients lacking mental capability to give informed consent for the surgical intervention or to participate in the study plus also lacking relatives to give such legal consent. Before admission to the hospital for the intervention, selected patients were seen in consultations in which they were informed about the project and the procedures included in it. Informed consent by the patients for voluntary participation in the study was requested.
Sociodemographic (age, sex), clinical and some healthcare characteristics (duration of stay, diagnosis indicating arthroplasty according to the International Classification of Diseases, IDC-9, and medical processes carried out) were obtained from hospital records (clinical and administrative).
Functional status related to the joints under study was assessed. We measured specific characteristics of the joint operated on (pain, disability and stiffness of joint) by means of the WOMAC Index, the most commonly used tool for assessing the osteoarticular health related quality of life, especially in reference to patients with hip or knee arthrosis.
Health related quality of life was analysed with the Medical Outcomes Study 36-item Short-Form Health Survey (SF-36).
Finally, QALYs gained were estimated by using the EuroQol instrument. In this study we used the social Spanish Euroqol tariff associated with the time trade-off (TTO) method15,16.
In accordance with surgeons' practice, patients were called again for consultations six months after surgery. We took advantage of these ordinary revisions to reassess functional and health related quality of life status by using the same questionnaires.
The final impact of the intervention was assessed as pre-test and post-test changes in the specific variables under study and by means of QALYs gained after interventions.
Costs were analysed from the perspective of the hospital. Thus we have considered the hospital's direct costs incurred from interventions for hip and knee arthroplasties (stays, prostheses, drugs).
Costs data source was the hospital's Analytical Accounting System. In order to calculate the cost per patient, we considered the 2 main short-term cost drivers in hip and knee arthroplasties: stays and prostheses (table 1). Costs of prosthesis are very similar between hip and knee patients groups, but stays show high variability. Then, we calculated the average cost of each procedure considering the average stay, and a range of maximum and minimum cost with regard to the highest and lowest in stays.
A standard statistical analysis was carried out, by means of both univariate (descriptive analysis of variables) and bivariate (analysis of statistical significant differences between pre-test and post-test scores in the evaluated characteristics) analysis. The statistical significance level was 1% in all cases. Analyses were performed using the statistical software SPSS 12.
In addition to the statistical significance, we evaluated the changes in scale scores estimating the «effect size». The effect size standardises the measurement units so that all the various changes observed can be compared17. By using the effect size measurement it is possible to know not only whether an experiment has a statistically significant effect, but also the size of any observed effects. Within the context of a pre-test and post-test study, effect size (hypothetical effect sizes for the population) was calculated as the absolute value of the mean difference divided by the standard deviation of the differences. In this framework, .2, .5, and .8 are small, medium, and large effect sizes, respectively18.
Cost-utility ratios were calculated for knee and hip replacement. Since this is a cost-outcome description of hip and knee replacements, there is no comparative analysis, so incremental cost-utility ratios have not been calculated.
It must be pointed out that this work is not an economic evaluation, as it does not fulfil one of the defining characteristics of such studies: i.e. to have an implicit election11. Actually, this paper offers a description of the cost-outcome of 2 health interventions in an independent way. Although we compare their results in terms of cost-effectiveness ratios (CER), we are not performing an incremental analysis between both interventions, nor is an incremental cost-effectiveness ratio (ICER) calculated.
Since the scope of the results is considered from the moment of the replacement to 15 years later, discount rates were applied for both costs and effectiveness. Following the recommendations of the working group for standardisation of economic evaluations of health technologies in Spain19, a 6% discount rate for effectiveness and costs has been utilised. Also a 3% annual inflation rate was applied in estimating future costs.
We performed a two-dimensional deterministic sensitivity analysis by considering the worst (lowest effectiveness and highest costs) and the best (highest effectiveness and lowest costs) scenarios.
Forty patients who received surgery for knee arthroplasty, as well as 40 patients for hip arthroplasty, were included in the study.
Demographic and clinical characteristics show statistically significant differences between hip and knee groups in relation to age, sex, stays and diagnosis. Regarding afflictions in other joints and previous surgery of other joints, there are no such differences (table 2).
The WOMAC Index of arthrosis in knee patients reported a statistically significant functional improvement after intervention. Taking each of the 3 dimensions of the WOMAC Index separately, statistically significant improvements in all of them were found, except in the area of stiffness. The SF-36 questionnaire reveals improvements in both physical and mental dimensions, statistically significant only in the former. Regarding the effect size, changes in WOMAC are «high» or «medium» in all cases. Changes in SF-36 are «medium» for the 2 aspects considered, although much higher for the physical than for the psychological dimension (table 3).
Similar results were obtained for the hip cohort, although in this case improvements were generally more moderate. The WOMAC Index for this group shows differences not considered statistically significant. Regarding the three WOMAC dimensions, as in the case of the knee cohort, statistically significant improvements were found for pain and disability, while the improvement in stiffness of joints was not statistically significant. Again, as with the knee cohort, in the assessment of the health related quality of life, a statistically significant improvement was reported in the physical dimension. For the mental aspect, a mild decrease, while not statistically significant, was observed. The effect size in the WOMAC questionnaire ranked «high» in all cases, for dimensions and total score as well. The SF-36 showed a «medium» change in the physical aspect and a «small» one in the psychological dimension (table 3).
Costs of interventions are calculated considering the two main determinants of arthroplasties: stays and prosthesis. Knee arthroplasty costs 6,865.52 (range, 6,426.60-7,309.43) while the total cost of hip arthroplasty is 7,891.21 (range, 7,407.40-8,380.00) (table 1).
Assuming a survival rate of the prosthesis of 15 years in 95% of the cases20, the total gains of QALYs were 4.64 (95% CI, 2.23-6.72) in the knee cohort and 0.86 (95% CI, 0.15-1.51) in the hip cohort, both statistically significant (p < 0.05) (table 4).
Regarding the number of QALYs gained and the discounted total costs for each intervention, the cost per QALY gained in knee arthroplasties is 1,275.84 , and the cost per QALY gained in hip arthroplasty is 7,936.12 (table 4).
Sensitivity analysis shows that changes in the effectiveness and costs considered have an important effect on the cost-utility ratio for each intervention. In the case of knee arthroplasty, the cost per QALY in the worst scenario is more than twice the baseline cost-utility ratio, and the cost per QALY in the best scenario is almost half of the baseline. This situation is more evident in hip arthroplasties, where the worst scenario is six times the baseline cost-utility and the best scenario is almost half of the baseline value (table 4).
Total hip and knee arthroplasty are not new surgical procedures, but their widespread application is relatively recent. In the last decades both indications and effective age range were extended, with a reduced or null mortality rate and good clinical outcomes. The results realised in this work describe positive outcomes for both interventions, from an objective clinical point of view as well as from the health perceived quality of life expressed by the patients. In other words, the two perspectives were similar, although those aspects did not always converge21. These results bear out those obtained in previous studies6,22-24. Nevertheless, due to the variety of instruments used and the different periods of time under study in each investigation, the results can hardly be considered comparable regarding effect size. At any rate, the effect size measurement allows us to observe the direction of certain trends.
Cost-utility analysis, although regarded as the most suitable economic evaluation method for healthcare resources allocation, still represents a very small percentage of the economic evaluation published in healthcare technologies in general and in particular in the field of orthopaedic surgery. Reviews including economic evaluations of both knee and hip arthroplasty corroborate this observation. Thus, a review of economic evaluations of knee arthroplasty published between 1966 and 1996 found that only 2.5% of the reviewed papers were cost utility analyses, the majority being cost-minimisation analyses25. On the other hand, reviews including economic evaluations of hip arthroplasty carried out between 1966-199626 and 1966-200210 as well, found that 5.88% of the former and 16% of the latter were cost-utility analyses, the majority being cost-effectiveness analyses. Furthermore, even though the developers of the EuroQol recommend it as a complementary instrument27, there are only a few studies on the outcome of arthroplasty in which the EuroQol was employed28.
Direct costs and cost per QALY of hip and knee arthroplasties are lower than previously reported costs estimated for other countries9. But our present costs, compared with results of a prior Spanish study, in the case of total hip arthroplasty are higher than before24. This difference is mainly due more to the difference in QALYs gained between both studies (45% higher in the former) than to the difference in costs (16% higher in our study), although differences in the periods of time considered make direct comparisons of outcomes inadvisable.
A great difference of cost per QALY gained is observed between hip and knee interventions. As in other studies6, patients suffering knee dysfunctions report worse pre-operative results in quality of life than patients with hip dysfunctions, but 6 months later, knee patients report better results than do patients of hip surgery. Besides the higher cost per process of hip arthroplasty, we obtained a more favourable cost per QALY relationship for knee arthroplasties than for hip. This result is the opposite of that obtained by Rässänen et al (2007), where total hip arthroplasty emerged as more cost-effective than total knee arthroplasty with a cost per QALY of 4,517 and 9,421 , respectively29. Alternatively, Chang, Pellissier, and Hazen (1996) report a cost per QALY of 4,637 30 and Segal et al (2004) suggest a cost per QALY of 3,639 for knee replacement31. In all the previous analyses, the time horizon considered up to the post-test assessment was 1 year, against 6 months considered in the present work. This is the main methodological difference that we have found between our study and those previously published. In our opinion this circumstance could explain the higher cost per QALY calculated for hip arthroplasty.
From an extended point of view, comparing the analysed interventions with «doing nothing» (zero outcomes and costs), we can consider the cost-effectiveness ratios as incremental cost effectiveness ratios (ICER). With this assumption, the processes under investigation are well positioned in cost-utility acceptability values regarding the generally accepted cost-effectiveness threshold (30,000 per QALY gained in Spain32 and around 50,000 per QALY gained accepted in other contexts33,34). If we take as comparative environment other technologies considered to be cost-effectives in Spain as point of reference, the range of acceptability is between 57.76 and 6,783.07 32 (2007 euros) and thus knee arthroplasty can be considered cost-effective whereas hip arthroplasty exceeds this range. The sensitivity analysis on extreme scenarios shows that, in the worst possible case, the cost-utility ratio for hip arthroplasties would exceed the Spanish efficiency threshold, but remain within the boundaries of international acceptability. From the global perspective, the cost-utility ratios published from 1976 to 200135 in general report higher cost per QALY gained than the ones obtained in our study for several diseases (table 5).
Previous results should be considered with certain limitations taken into account. First of all, the small sample size together with the analysis of only one hospital greatly reduce the possibility of generalising the results obtained. Secondly, we do not consider the long term costs of hip and knee arthroplasties, e.g. revision surgery costs. This fact can lead to an undervaluation of cost per QALY gained with the analysed interventions.
It is worth mentioning that comparison by means of league tables, at national and international levels, has a limited scope when the structure of costs is not known. Still, in order to facilitate comparisons between cross-national and cross-care interventions, we do agree with the advice of guidelines encouraging researchers to report the results of economic evaluations of healthcare technologies in QALYs.
1. Martí-Valls J, Alonso J. Clinical results and perceived health among patients with hip prosthesis. Med Clin (Barc). 1997; 108:691-5. [ Links ]
2. Fortin PR, Clarke AE, Joseph L, Liang MH, Tanzer M, Fer-land D, et al. Outcomes of total hip and knee replacement: preoperative functional status predicts outcomes at six months after surgery. Arthritis Rheum. 1999;42:1722-8. [ Links ]
3. Espehaug B, Havelin LI, Engesaeter LB, Langeland N, Vollset SE. Patient satisfaction and function after primary and revision total hip replacement. Clin Orthop Relat Res. 1998;351:135-48. [ Links ]
4. Gross AE, Hutchison CR, Alexeeff M, Mahomed N, Leitch K, Morsi E. Proximal femoral allografts for reconstruction of bone stock in revision arthroplasty of the hip. Clin Orthop Relat Res. 1995;319:151-8. [ Links ]
5. Dawson J, Fitzpatrick R, Murray D, Carr A. Questionnaire on the perceptions of patients about total knee replacement. J Bone Joint Surg Br. 1998;80:63-9. [ Links ]
6. Lizaur A, Miralles F, Elías R. La calidad de vida tras las artroplastias totales de cadera y rodilla. Rev. Ortop. Trauma-tol. 2002;46:31-5. [ Links ]
7. Räsänen P, Roine E, Sintonen H, Semberg-Konttinen V, Ryynanen O, Roine R. Use of quality-adjusted life years for the estimation of effectiveness of health care: a systematic literature review. Finota's Report 29/2006. [ Links ]
8. Pons Rafols, Joan MV, Martí-Valls J, Granados A. La efectividad y la eficiencia en la cirugía protésica de cadera: elementos para su mejora. Barcelona: Agencia de Evaluación de Tecnologías Médicas de Cataluña; 1999. BR99006. [ Links ]
9. Lavernia CJ, Guzmán JF, Gachupin-García A. Cost effectiveness and quality of life in knee arthroplasty. Clin Orthop Relat Res. 1997;345:134-9. [ Links ]
10. Bozic KJ, Saleh KJ, Rosenberg AG, Rubash HE. Economic evaluation in total hip arthroplasty. Analysis and review of the literature. J Arthroplasty. 2004;19:180-9. [ Links ]
11. Drummond M, Sculpher M, Torrance G, O'Brien B, Stoddart G. Methods for the economic evaluation of health care programmes. 3rd ed. Oxford: Oxford University Press; 2005. [ Links ]
12. Hjelmgren J, Berggren F, Andersson F. Health economic guidelines. Similarities, differences and some implications. Value Health. 2001;4:225-50. [ Links ]
13. Tarn TY, Smith MD. Pharmacoeconomic guidelines around the world. ISPOR Connections. 2004;10:5-15. [ Links ]
14. Larsen R, Asmussen M, Christensen T, Olsen J, Poulsen P, Sorensen J. Economic evaluations in international health technology assessment. A study of methodologies. Danish Centre for Evaluation and Health Technology Assessment. 2003;5:1. [ Links ]
15. Badia X, Roset M, Herdman M, Segura A. La versión española del EuroQol: descripción y aplicaciones. Med Clin (Barc). 1999;112:79-86. [ Links ]
16. EuroQol Group. Guía del usuario EQ-5D. 1999. [ Links ]
17. Casado A, Prieto L, Alonso J. El tamaño del efecto de la diferencia entre dos medias: ¿estadísticamente significativo o clínicamente relevante? Med Clin (Barc). 1999;112:584-8. [ Links ]
18. Cohen JW. Statistical power analysis for the behavioural sciences. Hillsdale: Erlbaum; 1988. [ Links ]
19. Rovira J, Antoñanzas F. Economic analysis of health technologies and programmes. A Spanish proposal for methodological standardisation. Pharmacoeconomics. 1995;8:245-52. [ Links ]
20. Emery P. Treatment of rheumatoid arthritis. BMJ. 2006; 332:152-5. [ Links ]
21. Lieberman JR, Dorey F, Shekelle P, Schumacher L, Thomas BJ, Kilgus DJ, et al. Differences between patients' and physicians' evaluations of outcome after total hip arthroplasty. J Bone Joint Surg Am. 2007;78:835-8. [ Links ]
22. Ostendorf M, Van Stel HF, Buskens E, Schrijvers AJ, Marting LN, Verbout AJ, et al. Patient-reported outcome in total hip replacement: a comparison of five instruments of health status. J Bone Joint Surg Br. 2004;86:801-8. [ Links ]
23. Kane RL, Saleh KJ, Wilt TJ, Bershadsky B. The functional outcomes of total knee arthroplasty. J Bone Joint Surg Am. 2005;87:1719-24. [ Links ]
24. Martí-Valls J, Alonso J, Lamarca R, Pinto JL, Auleda J, Gir-vent R, et al. Efectividad y costes de la intevención de prótesis total de cadera en siete hospitales de Cataluña. Med Clin (Barc). 2000;114:34-9. [ Links ]
25. Saleh KJ, Gafni A, Saleh L, Gross AE, Schatzker J, Tile M. Economic evaluations in the hip arthroplasty literature: lessons to be learned. J Arthroplasty. 1999;14:527-32. [ Links ]
26. Saleh KJ, Gafni A, Macaulay WB, Miric A, Saleh L, Schatzker J. Understanding economic evaluations: a review of the knee arthroplasty literature. Am J Knee Surg. 1999;12:155-60. [ Links ]
27. Brooks R. EuroQol: the current state of play. Health Policy. 1996;37:53-72. [ Links ]
28. Dawson J, Fitzpatrick R, Frost S, Gundle R, McLardy-Smith P, Murray D. Evidence for the validity of a patient-based instrument for assessment of outcome after revision hip replacement. J Bone Joint Surg Br. 2001;83:1125-9. [ Links ]
29. Räsänen P, Paavolainen P, Sintonen H, Koivisto A, Blom M, Ryynänen O, et al. Effectiveness of hip or knee replacement surgery in terms of quality-adjusted life years and costs. Acta Orthop. 2007;78:108-15. [ Links ]
30. Chang RW, Pellissier JM, Hazen GB. A cost-effective analysis of total hip arthroplasty for osteoarthritis of the hip. JAMA. 1996;275:858-65. [ Links ]
31. Segal L, Day SE, Chapman AB, Osborne RH. Can we reduce disease burden from osteoarthritis? Med J Aust. 2004;180 Suppl 5:11-7. [ Links ]
32. Sacristán JA, Oliva J, Del Llano J, Prieto L, Pinto JL. ¿Qué es una tecnología sanitaria eficiente en España? Gac Sanit. 2002;16:334-43. [ Links ]
33. Laupacis A, Feeny D, Detsky A, Tutgell PX. How attractive does a new technology have to be to warrant adoption and utilization? Tentative guidelines for using clinical and economic evaluations. CMAJ. 1992;146:473-81. [ Links ]
34. Buxton M. How much are health-care systems prepared to pay to produce a QALY? Eur J Health Econ. 2005;6:285-7. [ Links ]
35. Center on the Evaluation of Value and Risk in Health. The Cost-Effectiveness Analysis Registry [Internet]. Boston: Tufts-New England Medical Center, ICRHPS [accessed 1 Nov 2007]. Available from:http://www.tufts-nemc.org/cearegistry/ [ Links ]
José Luis Navarro Espigares.
Departamento de Economía Internacional y de España
Facultad de Ciencias Económicas y Empresariales.
Campus La Cartuja.
Hospital Universitario Virgen de Las Nieves.
Avda. Fuerzas Armadas, 2. 18014 Granada. España.
Received: 1 de agosto de 2007.
Accepted: 13 de febrero de 2008.