Estimating the effectiveness of a hospital's interventions in India: impact of the choice of disability weights

Évaluation de l'efficacité des interventions pratiquées dans un hôpital indien: impact du choix des coefficients de pondération servant au calcul des années d'incapacité

Estimación de la eficacia de las intervenciones de un hospital de la India. Impacto de la elección de los pesos de discapacidad

تقدير فاعلية تدخلات المستشفى في الهند: تأثير اختيار أوزان العجز

估测在印度境内医院采取干预措施的有效性: 对残疾权重的选择的影响

Оценка эффективности больничных мероприятий в Индии: влияние выбора весовых коэффициентов по инвалидности

Susmita Chatterjee Richard A Gosselin About the authors

Abstract

Objective

To calculate the effect of using two different sets of disability weights for estimates of disability-adjusted life-years (DALYs) averted by interventions delivered in one hospital in India.

Methods

DALYs averted by surgical and non-surgical interventions were estimated for 3445 patients who were admitted to a 106-bed private hospital in a semi-urban area of northern India in 2012-2013. Disability weights were taken from global burden of disease (GBD) studies. We used the GBD 1990 disability weights and then repeated all of our calculations using the corresponding GBD 2010 weights. DALYs averted were estimated for surgical and non-surgical interventions using disability weight, risk of death and/or disability, and effectiveness of treatment.

Findings

The disability weights assigned in the GBD 1990 study to the sequelae of conditions such as cataract, cancer and injuries were substantially different to those assigned in the GBD 2010 study. These differences in weights led to large differences in estimates of DALYs averted. For all surgical interventions delivered to this patient cohort, 11 517 DALYs were averted if we used the GDB 1990 weights and 9401 DALYs were averted if we used the GDB 2010 disability weights. For non-surgical interventions 5168 DALYs were averted using the GDB 1990 disability weights and 5537 DALYS were averted using the GDB 2010 disability weights.

Conclusion

Estimates of the effectiveness of hospital interventions depend upon the disability weighting used. Researchers and resource allocators need to be very cautious when comparing results from studies that have used different sets of disability weights.

Résumé

Objectif

Calculer l'impact de l'utilisation de deux séries différentes de coefficients de pondération pour le calcul des années d'incapacité sur les estimations relatives aux années de vie ajustées sur l'incapacité (DALY) évitées par des interventions pratiquées dans un hôpital indien.

Méthodes

L'estimation des DALY évitées par des interventions chirurgicales et non chirurgicales a reposé sur 3445 patients admis en 2012-2013 dans un hôpital privé de 106 lits situé dans une zone semi-urbaine du nord de l'Inde. Les coefficients de pondération servant au calcul des années d'incapacité ont été tirés des études sur la charge mondiale de morbidité (CMM). Nous avons utilisé les coefficients de pondération de l'étude sur la CMM de 1990, puis refait tous nos calculs avec les coefficients de pondération de l'étude sur la CMM de 2010. L'estimation des DALY évitées grâce à des interventions chirurgicales et non chirurgicales s'est basée sur les coefficients de pondération servant au calcul des années d'incapacité, le risque de décès et/ou de handicap et l'efficacité du traitement.

Résultats

Les coefficients de pondération appliqués dans l'étude sur la CMM de 1990 aux séquelles de maladies telles que la cataracte, le cancer et les traumatismes étaient nettement différents de ceux appliqués dans l'étude sur la CMM de 2010. Ces différences de coefficients de pondération ont entraîné des différences notables dans l'estimation des DALY évitées. En ce qui concerne l'ensemble des interventions chirurgicales subies par cette cohorte de patients, le nombre de DALY évitées s'élève à 11517 si l'on applique les coefficients de pondération de l'étude sur la CMM de 1990 contre 9401 si l'on applique ceux de l'étude sur la CMM de 2010. En ce qui concerne les interventions non chirurgicales, le nombre de DALY évitées s'élève à 5168 si l'on applique les coefficients de pondération de l'étude sur la CMM de 1990 contre 5537 si l'on applique ceux de l'étude sur la CMM de 2010.

Conclusion

L'évaluation de l'efficacité des interventions hospitalières dépend des coefficients de pondération utilisés pour le calcul des années d'incapacité. Les chercheurs et les responsables de l'affectation des ressources doivent faire preuve de prudence lorsqu'ils comparent les résultats d'études dans lesquelles différentes séries de coefficients de pondération ont été appliquées pour calculer les années d'incapacité.

Resumen

Objetivo

Calcular el efecto del uso de dos grupos diferentes de pesos de discapacidad para estimaciones de años de vida ajustados en función de la discapacidad (AVAD) evitados por intervenciones llevadas a cabo en un hospital de la India.

Métodos

los AVAD evitados por intervenciones quirúrgicas y no quirúrgicas se estimaron para 3445 pacientes que fueron ingresados en un hospital privado de 106 camas de un área semiurbana del norte de la India en 2012-2013.Los pesos de discapacidad se tomaron de estudios de carga mundial de morbilidad. Se utilizaron los pesos de discapacidad de 1990 de la carga mundial de morbilidad y a continuación se repitieron todos los cálculos utilizando los pesos de 2010 correspondientes. Los AVAD evitados se estimaron para intervenciones quirúrgicas y no quirúrgicas utilizando el peso de discapacidad, el riesgo de muerte o discapacidad y la eficacia del tratamiento.

Resultados

Los pesos de discapacidad asignados en el estudio de 1990 de carga mundial de morbilidad a las secuelas de enfermedades como cataratas, cáncer y lesiones eran sustancialmente diferentes a los asignados en el estudio de 2010. Estas diferencias en los pesos provocaron grandes diferencias en las estimaciones de los AVAD evitados. Para todas las intervenciones quirúrgicas realizadas a esta cohorte de pacientes, se evitaron 11517 AVAD si usamos los pesos de discapacidad de 1990 de carga mundial de morbilidad y 9401 si usamos los de 2010. Para las intervenciones no quirúrgicas, se evitaron 5168 AVAD si se utilizan los pesos de discapacidad de 1990 de carga mundial de morbilidad y 5537 si se utilizan los pesos de 2010.

Conclusión

Las estimaciones de la eficacia de las intervenciones hospitalarias dependen del peso de discapacidad utilizado. Los investigadores y los asignadores de recursos deben ser muy cautos al comparar los resultados de los estudios que han utilizado diferentes grupos de pesos de discapacidad.

ملخص

الغرض

حساب تأثير استخدام مجموعتين مختلفتين من أوزان العجز لتقديرات سنوات العمر المصححة باحتساب مدد العجز (DALYs) التي تم تفاديها بواسطة التدخلات المقدمة في مستشفى واحد في الهند.

الطريقة

تم تقدير سنوات العمر المصححة باحتساب مدد العجز (DALYs) التي تم تفاديها بتدخلات جراحية وتدخلات غير جراحية لـ 3445 مريضًا تم إدخالهم إلى مستشفى بسعة 106 أسرّة في منطقة شبه حضرية في شمال الهند في الفترة من عام 2012 إلى عام 2013. ولقد تم أخذ أوزان العجز من دراسات العبء العالمي للمرض (GBD). لقد استخدمنا أوزان العجز للعبء العالمي للمرض في عام 1990 ثم قمنا بتكرار جميع حساباتنا باستخدام ما يقابلها من أوزان العبء العالمي للمرض في عام 2010. وقد تم تقدير سنوات العمر المصححة باحتساب مدد العجز (DALYs) التي تم تفاديها للتدخلات الجراحية والتدخلات غير الجراحية باستخدام أوزان العجز، ومخاطر الوفاة و/أو العجز، وفاعلية العلاج.

النتائج

كانت أوزان العجز المخصصة في دراسة العبء العالمي للمرض في عام 1990 لعقابيل الحالات المرضية مثل إعتام عدسة العين والسرطان والإصابات مختلفة إلى حد كبير بالمقارنة مع تلك الأوزان المخصصة في دراسة العبء العالمي للمرض في عام 2010. وقد أدت هذه الاختلافات في الأوزان إلى وجود اختلافات كبيرة في تقديرات سنوات العمر المصححة باحتساب مدد العجز (DALYs) التي تم تفاديها. وبالنسبة لجميع التدخلات الجراحية المقدمة إلى هذه المجموعة من المرضى، فقد تم تفادي 11517 حالة من سنوات العمر المصححة باحتساب مدد العجز إذا استخدمنا أوزان العبء العالمي للمرض في عام 1990، كما تم تفادي 9401 حالة من سنوات العمر المصححة باحتساب مدد العجز إذا استخدمنا أوزان العجز للعبء العالمي للمرض في عام 2010. وبالنسبة للتدخلات غير الجراحية، فقد تم تفادي 5168 من سنوات العمر المصححة باحتساب مدد العجز باستخدام أوزان العجز للعبء العالمي للمرض في عام 1990 وتم تفادي 5537 من سنوات العمر المصححة باحتساب مدد العجز باستخدام أوزان العجز للعبء العالمي للمرض في عام 2010.

الاستنتاج

تعتمد تقديرات فاعلية تدخلات المستشفى على أوزان العجز المستخدمة. ينبغي أن يكون الباحثون ومحصصو الموارد حذرين جدًا عند مقارنة نتائج الدراسات التي استخدمت مجموعات مختلفة من أوزان العجز.

摘要

目的

旨在针对一家印度医院采取干预措施而避免的残疾调整生命年 (DALY) 的估测,核算出采用两组不同的残疾权重所产生的影响。

方法

通过外科和非外科干预措施而避免的残疾调整生命年 (DALY) 是针对 3445 名患者做出的估测,而这些患者均在 2012-2013 年间收治于印度北部近郊地区一家设有 106 个病床的私立医院。残疾权重取自全球疾病负担 (GBD) 研究。 我们采用了 1990 年 GBD 的残疾权重,然后采用 2010 年 GBD 的相应权重重复进行我们所有的计算。 所避免的残疾调整生命年 (DALY) 是通过采用残疾权重、死亡和/或残疾风险以及治疗的有效性而针对外科和非外科干预措施做出的估测。

结果

1990 年 GBD 研究中为白内障、癌症和伤病等疾病后遗症而分配的残疾权重与 2010 年 GBD 研究中分配的大不相同。 这些权重方面的差别让对所避免的残疾调整生命年 (DALY) 的估测产生了巨大差异。 关于提供至该种患者队列的所有外科干预措施,如果我们采用 1990 年的 GDB 权重,则避免了 11517 例残疾调整生命年 (DALY);如果我们采用 2010 年的 GDB 残疾权重,则避免了 9401 例残疾调整生命年 (DALY)。 关于非外科干预措施,我们采用 1990 年的 GDB 残疾权重时避免了 5168 例残疾调整生命年 (DALY),而在采用 2010 年的 GDB 残疾权重时则避免了 5537 例残疾调整生命年 (DALY)。

结论

对医院所采取干预措施之有效性的估测取决于所采用的残疾权重。 在对比采用的多组不同残疾权重的研究结果时,研究人员和资源分配人员需要非常谨慎。

Резюме

Цель.

Рассчитать эффект от использования двух различных наборов весовых коэффициентов для оценки количества лет жизни, потерю которых в связи с инвалидностью удалось предотвратить в результате мероприятий, проводимых в одной из больниц Индии.

Методы.

В частной больнице на 106 мест в полугородской зоне в северной Индии в 2012-2013 гг. была проведена оценка скорректированного с поправкой на инвалидность количества лет жизни для 3445 пациентов, потерю которых удалось предотвратить посредством хирургических и нехирургических вмешательств (спасенных лет жизни). Весовые коэффициенты были взяты из исследований глобального бремени заболеваний (ГБЗ). Сначала использовались весовые коэффициенты по инвалидности из исследований ГБЗ за 1990 год, а затем все расчеты были повторены с использованием аналогичных коэффициентов из исследований ГБЗ за 2010 год. Количество спасенных лет жизни оценивалось для хирургических и нехирургических вмешательств с использованием весовых коэффициентов по инвалидности, риску летального исхода и (или) инвалидности, а также по эффективности лечения.

Результаты.

Весовые коэффициенты по инвалидности, присвоенные в исследованиях ГБЗ от 1990 г. последствиям таких заболеваний и состояний, как катаракта, рак или травмы, значительно отличались от значений, присвоенных им в исследовании ГБЗ от 2010 г. Такое различие в весовых коэффициентах привело к значительной разнице при оценке количества спасенных лет жизни. Для всех случаев хирургических вмешательств, проведенных в отношении данной когорты пациентов, количество спасенных лет жизни составило 11 517, если пользоваться коэффициентами из исследования ГБЗ от 1990 г., и 9401 при использовании коэффициентов от 2010 г. Для нехирургических вмешательств количество спасенных лет жизни при использовании коэффициентов ГБЗ по инвалидности от 1990 г. составило 5168, а при использовании коэффициентов от 2010 г. - 5537.

Вывод.

Оценка эффективности больничных мероприятий зависит от используемых весовых коэффициентов по инвалидности. Исследователи и лица, отвечающие за выделение ресурсов, должны проявлять осмотрительность при сравнении результатов исследований, в которых использовались разные весовые коэффициенты.

Introduction

Comprehensive summary measures of population health were estimated in the global burden of disease (GBD) 1990, 2004 and 2010 studies.11.  Murray CJL, Lopez AD, editors. The global burden of disease: a comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020. Cambridge: Harvard University Press; 1996. 33.  Murray CJL, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990-2010: a systematic analysis for the global burden of disease study 2010. Lancet. 2012 Dec 15;380(9859):2197-223. http://dx.doi.org/10.1016/S0140-6736(12)61689-4PMID:23245608
http://dx.doi.org/10.1016/S0140-6736(12)...
The GBD 1990 study was commissioned by the World Bank and quantified the health effects of more than 100 diseases and injuries in each of eight regions of the world.11.  Murray CJL, Lopez AD, editors. The global burden of disease: a comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020. Cambridge: Harvard University Press; 1996. The disability-adjusted life-year (DALY) was used to facilitate comparisons of health outcomes and measures of the effectiveness and cost-effectiveness of various interventions.11.  Murray CJL, Lopez AD, editors. The global burden of disease: a comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020. Cambridge: Harvard University Press; 1996. Subsequently, there has been extensive debate on many of the variables that affect estimates of DALYs, such as the number of years lost on death, disability and age weights and time discounting.44.  Anand S, Hanson K. Disability-adjusted life years: a critical review. J Health Econ. 1997 Dec;16(6):685-702. http://dx.doi.org/10.1016/S0167-6296(97)00005-2PMID:10176779
http://dx.doi.org/10.1016/S0167-6296(97)...
99.  Bognar G. Age-weighting. Econ Philos. 2008;24(2):167-89. http://dx.doi.org/10.1017/S026626710800179X
http://dx.doi.org/10.1017/S0266267108001...

In the GBD 1990 study, an expert panel arbitrarily assigned disability weights to a comprehensive set of disease conditions, by using the so-called person trade-off method.11.  Murray CJL, Lopez AD, editors. The global burden of disease: a comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020. Cambridge: Harvard University Press; 1996. After the results of the study were published, apparent inconsistencies in the derivation of these weights were noted.1010.  Gosselin R, Ozgediz D, Poenaru D. A square peg in a round hole? Challenges with DALY-based "burden of disease" calculations in surgery and a call for alternative metrics. World J Surg. 2013 Nov;37(11):2507-11. http://dx.doi.org/10.1007/s00268-013-2182-7PMID:23949200
http://dx.doi.org/10.1007/s00268-013-218...

The GBD 2004 study,22.  Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJL, editors. Global burden of disease and risk factors. Washington: World Bank; 2006. http://dx.doi.org/10.1596/978-0-8213-6262-4
http://dx.doi.org/10.1596/978-0-8213-626...
which focused mainly on injuries, was also criticized as the disability weights for several injuries appeared illogical.1010.  Gosselin R, Ozgediz D, Poenaru D. A square peg in a round hole? Challenges with DALY-based "burden of disease" calculations in surgery and a call for alternative metrics. World J Surg. 2013 Nov;37(11):2507-11. http://dx.doi.org/10.1007/s00268-013-2182-7PMID:23949200
http://dx.doi.org/10.1007/s00268-013-218...
Such inconsistencies led to the appropriateness and usefulness of many disability weights being questioned.1010.  Gosselin R, Ozgediz D, Poenaru D. A square peg in a round hole? Challenges with DALY-based "burden of disease" calculations in surgery and a call for alternative metrics. World J Surg. 2013 Nov;37(11):2507-11. http://dx.doi.org/10.1007/s00268-013-2182-7PMID:23949200
http://dx.doi.org/10.1007/s00268-013-218...
The GBD 2010 study33.  Murray CJL, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990-2010: a systematic analysis for the global burden of disease study 2010. Lancet. 2012 Dec 15;380(9859):2197-223. http://dx.doi.org/10.1016/S0140-6736(12)61689-4PMID:23245608
http://dx.doi.org/10.1016/S0140-6736(12)...
tried to address these criticisms using multinational community and web-based surveys. In these surveys, more than 30 000 respondents were asked to choose the healthier of two hypothetical health states.1111.  Salomon JA, Vos T, Hogan DR, Gagnon M, Naghavi M, Mokdad A, et al. Common values in assessing health outcomes from disease and injury: disability weights measurement study for the global burden of disease study 2010.. Lancet 2012 Dec 15;380(9859):2129-43. http://dx.doi.org/10.1016/S0140-6736(12)61680-8PMID:23245605
http://dx.doi.org/10.1016/S0140-6736(12)...
Several researchers have pointed out that some of the disability weights estimated in the GBD 2010 study still do not make much sense.1010.  Gosselin R, Ozgediz D, Poenaru D. A square peg in a round hole? Challenges with DALY-based "burden of disease" calculations in surgery and a call for alternative metrics. World J Surg. 2013 Nov;37(11):2507-11. http://dx.doi.org/10.1007/s00268-013-2182-7PMID:23949200
http://dx.doi.org/10.1007/s00268-013-218...
1212.  Taylor HR, Jonas JB, Keeffe J, Leasher J, Naidoo K, Pesudovs K, et al. Disability weights for vision disorders in global burden of disease study.. Lancet 2013 Jan 5;381(9860):23. http://dx.doi.org/10.1016/S0140-6736(12)62081-9PMID:23266227
http://dx.doi.org/10.1016/S0140-6736(12)...

In spite of the numerous criticisms that the GBD team have tried to address, the DALY has been widely used by researchers, policy-makers and several other stakeholders since its inception. Here we estimate the DALYs averted for several surgical and non-surgical interventions among patients admitted to a hospital in India. We investigate the effect of using alternative disability weighting on the results.

Methods

A 106-bed private hospital covering a semi-urban population in Uttar Pradesh, in northern India, was chosen for the study because its staff maintained a comprehensive computerized patient database and agreed to cooperate with the research team. As confidentiality issues prevented us from extracting data directly from the hospital's paper-based records, we only extracted data from the computerized database. To calculate DALYs, we gathered data on each surgical admission to the hospital between 1 April 2012 and 31 March 2013. Because the hospital only began digitizing the records of non-surgical admissions at the start of 2013, we included patients admitted for a non-surgical intervention between 1 January 2013 and 31 March 2013. At the time of our study, the hospital did not keep records for outpatient and emergency services. We collected data on age, sex, length of stay, diagnosis and/or procedure for 3865 inpatients, which represented 43% of the 8936 patients who were admitted in the year beginning 1 April 2012. After excluding the 420 inpatients who had only been admitted for pain management or childbirth, we assigned disability weights to the remaining 3445 inpatients.

For each patient, we estimated the DALYs associated with conditions for which they were admitted and the DALYs averted by the surgical and non-surgical interventions that were carried out. First, we used the GBD 1990 disability weights and then repeated the analyses using the GBD 2010 weights. For injuries only, we did another set of calculations using the disability weights from the GBD 2004 study - which, with a few exceptions, were essentially based on the GBD 1990 weights.22.  Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJL, editors. Global burden of disease and risk factors. Washington: World Bank; 2006. http://dx.doi.org/10.1596/978-0-8213-6262-4
http://dx.doi.org/10.1596/978-0-8213-626...
In each set of calculations we used identical scores for disease severity and the likelihood of treatment success.

We calculated DALYs averted using the method originally developed by McCord and Chowdhury13 but with slightly simplified estimates of the risks of death and disability and the effectiveness of treatment.1414.  Gosselin RA, Thind A, Bellardinelli A. Cost/DALY averted in a small hospital in Sierra Leone: what is the relative contribution of different services?. World J Surg 2006 Apr;30(4):505-11. http://dx.doi.org/10.1007/s00268-005-0609-5PMID:16528459
http://dx.doi.org/10.1007/s00268-005-060...
1616.  Gosselin RA, Maldonado A, Elder G. Comparative cost-effectiveness analysis of two MSF surgical trauma centers.. World J Surg 2010 Mar;34(3):415-9. http://dx.doi.org/10.1007/s00268-009-0230-0PMID:19771466
http://dx.doi.org/10.1007/s00268-009-023...
Box 1 shows examples of our estimations of DALYs averted. These estimations were made without age weighting or discounting.

Box 1. Examples of DALY-averted estimation
  • A 30-year-old female with appendicitis has a disease severity score of 1 (i.e. more than 95% chance of being fatal or disabling without surgery) and effectiveness-of-treatment score of 1 (i.e. more than 95% chance of being cured after surgery) with 54 years of life-to-live (life expectancy as per 2010 life table). A successful appendectomy will avert 54 × 1 × 1 × 0.326 = 18 DALYs using the 2010 disability weights.

  • A one-year-old boy with septicaemia has more than 95% chance of death or disability without treatment and a chance of cure between 50% and 95% and 83.63 years of life-to-live. Successful medical treatment will avert 83.63 × 1 × 0.7 × 0.210 = 12 DALYs using the 2010 disability weights.

Results

Specific disability weights were available in both the GBD 1990 and 2010 studies for 12 of the conditions for which our study inpatients were admitted (Table 1). For another 10 conditions, we were able to find a disability weight in the GBD 1990 study that appeared to be a potential match to one in the GBD 2010 study - or vice versa (Table 1).

Table 1
Disability weights assigned in the global burden of disease 1990 and 2010 studies

In the GBD 2010 study, disability weights for some surgical interventions differed markedly from those assigned in the GBD 1990 study. In consequence, our estimates of the total DALYs averted using GBD 1990 disability weights resulted in 11 517 DALYs, while using the GBD 2010 disability weights resulted in 9401 DALYs (Table 2). For example, our estimates of the numbers of DALYs averted by an abortion were 1649 when we used the disability weight given for abortion in the GBD 1990 study but 111 when we used the corresponding weight from the GBD 2010 study.

Table 2
Disability weights and disability-adjusted life-years averted for surgical interventions delivered in one hospital in India, April 2012-March 2013

There were several conditions for which disability weights were not available in both the GBD 1990 and 2010 studies (e.g. hypertension). Further, in the GBD 2010 study, for example, no individual weights were given for peptic ulcer, kidney stone or appendicitis - although these conditions were loosely covered by the disability weights for abdominopelvic problems: mild, moderate or severe. Similarly, although the GBD 1990 study provided a specific disability weight for acute lower respiratory infection, no corresponding weight was included in the reported results of the GBD 2010 study. In our calculations based on the disability weights from the latter study, we used the weight given for infectious disease: acute episode, severe, as the weight for acute lower respiratory infection - assuming that all patients admitted for acute lower respiratory infection had a severe form of the infection.

Our estimates based on the GBD 1990 and GBD 2010 disability weights indicated that, over our study period, non-surgical interventions averted totalled 5168 and 5537 DALYs, respectively (Table 3). For a few non-surgical interventions, differences between the sets of disability weights that we used led to substantial differences in our estimates of the DALYs averted (Table 3). For example, our estimates of the numbers of DALYs averted by treating chronic nephritic syndrome with dialysis were 281 when we used the GBD 1990 disability weight but 1866 when we used the GBD 2010 weight.

Table 3
Disability weights and disability-adjusted life-years averted for non-surgical interventions delivered in one hospital in India, Jan 2013-March 2013

Our estimates based on the GBD 1990 disability weights indicated that, among the 3445 inpatients included in our analyses, total DALYs were 23 829. The corresponding value based on the GBD 2010 weights - 21 908 - was about 8% lower.

The GBD 2004 disability weights for fractures of the femur, radius or ulna, tibia and facial bones are the same as the corresponding GBD 1990 weights. For some procedures, however, the GBD 2004 disability weights were markedly different from those given in either the GBD 1990 study or the GBD 2010 study and these differences had an impact on our estimates of the DALYs averted by the procedures. For example, when we based our estimates on the disability weights assigned in the GBD 1990, 2004 and 2010 studies, it appeared that our study hospital had averted 245, 273 and 110 DALYs, respectively, by treating fractures of the clavicle, scapula and/or humerus. The corresponding estimates for treatment of intracranial injuries were 84, 86 and 64 DALYs averted, respectively.

Discussion

We found that, for some conditions, our estimates of DALYs averted differed substantially according to which set of disability weights we used. It was not always possible to find perfect matches between the categories used in the GBD 1990 and 2010 studies. For example, cataract was given a GBD 1990 disability weight of 0.600 - under a cataract blindness category - but the most appropriate category in the GBD 2010 study appeared to be distance vision: moderate impairment, which had a much lower disability weight of 0.033. The GBD 2010 disability weights for more severe visual impairment, in the categories distance vision: severe impairment (0.191) or distance vision: blindness (0.195) were also much lower than the corresponding GBD 1990 values, as discussed elsewhere.1212.  Taylor HR, Jonas JB, Keeffe J, Leasher J, Naidoo K, Pesudovs K, et al. Disability weights for vision disorders in global burden of disease study.. Lancet 2013 Jan 5;381(9860):23. http://dx.doi.org/10.1016/S0140-6736(12)62081-9PMID:23266227
http://dx.doi.org/10.1016/S0140-6736(12)...
Our estimates of the numbers of DALYs averted by abscess drainage, among 50 inpatients, were 231 when we used the GBD 1990 disability weights but only 17 when we used the GBD 2010 weights. For both of these estimates we had to use the disability weight for open wound - i.e. the most appropriate category that was common to the GBD 1990 and 2010 studies - while acknowledging that not all open wounds are drained abscesses. The GBD 1990 disability weight for open wound (0.108) was 22-fold higher than the corresponding GBD 2010 weight (0.005). Surgical treatment of anal fissure, wound debridement and some non-surgical conditions - e.g. diarrhoea, septicaemia, hypothyroidism and neonatal respiratory distress - also have GBD 2010 disability weights that were very different from their GBD 1990 equivalents.

The findings raise two important questions. First, which set of disability weights is most accurate? Second, does the best set of weights vary depending on the intervention or condition being investigated? As the method used to generate the GBD 1990 disability weights was completely different to that used to generate the GBD 2010 weights, it is perhaps not surprising that the two sets of weights show some differences. Although most studies on the cost-effectiveness of surgery and other conditions in low- and middle-income countries have used the GBD 1990 disability weights, future studies on the same topic are much more likely to use the GBD 2010 weights. As information on the cost of an intervention per DALY averted can be an important policy tool for resource allocation, researchers and resource allocators need to be very cautious when comparing results from studies that have used different sets of disability weights. Therefore, we are now evaluating whether the different sets of disability weights will affect the cost-effectiveness of the interventions available in the study hospital.

In the evaluation of disability weights, both the expert-panel approach of the GBD 1990 study and the survey approach of the GBD 2010 study led to some surprising and inconsistent results. We suspect that the respondents investigated in the GBD 2010 study were more biased towards acute pain and disability than to chronic impairment, and that some of them may have misunderstood what was meant by some of the conditions being investigated. The long-term impact of some interventions will vary substantially across countries. Leg amputation, for example, may impair function much less in settings where a prosthesis is available than in other settings. Although stratifying by geographical area or socioeconomic status might be preferable in theory, it would make the estimation process more complicated. In the design of a new set of disability weights, perhaps we should ask different questions and focus on the treatment required rather than the diagnosis. Is the disease or condition curable, treatable or only requiring palliation? Does it require medication only, minor surgery or major surgery? Does medication, if needed at all, need to be temporary or lifelong? Does the disease or condition affect cognition? Does it affect function or ability to work? After giving a severity weighting to the answers to these questions, a new measure of burden could be developed. However, we should keep in mind that DALYs were developed to measure disease burden not the burden of treatment. If future disability weights are based on surveys of lay people, they should be critically reviewed by experts to reduce inconsistencies.

Although we followed the same method to calculate DALYs as used by other researchers,1313.  McCord C, Chowdhury Q. A cost effective small hospital in Bangladesh: what it can mean for emergency obstetric care. Int J Gynaecol Obstet. 2003 Apr;81(1):83-92. http://dx.doi.org/10.1016/S0020-7292(03)00072-9PMID:12676406
http://dx.doi.org/10.1016/S0020-7292(03)...
1616.  Gosselin RA, Maldonado A, Elder G. Comparative cost-effectiveness analysis of two MSF surgical trauma centers.. World J Surg 2010 Mar;34(3):415-9. http://dx.doi.org/10.1007/s00268-009-0230-0PMID:19771466
http://dx.doi.org/10.1007/s00268-009-023...
our study has four major limitations. First, some of our inpatients' admission diagnoses were not covered by specific GBD 1990 or GBD 2010 disability weights. For most of these diagnoses, we used the closest possible weights. Second, whenever there were separate disability weights for mild, moderate and severe forms of an admission diagnosis, we tended to be conservative and chose the weight for the moderate form. In the Indian context, mild cases are rarely admitted to hospital. Third, the digitized records of the study hospital often indicated a fracture as humerus/tibia without specifying whether the fracture was of the humerus, the tibia or both. Without access to radiographs and the patient's charts, we had no way of distinguishing between arms and legs. In such cases, we were again conservative and used the disability weight for a fracture of the humerus - which, in both the GBD 1990 study and the GBD 2010 study, is lower than the disability weight for a fracture of the tibia. In consequence, our analyses included more fractures of the humerus than of the tibia - even though the latter are much more common in India. Whatever the scale of our misclassification bias, it remained unaltered by our choice of which set of disability weights to use. Finally, we had to assume that diagnoses were correct and that interventions were appropriate. Again, any related bias should not have been affected by our choice of which set of disability weights to use.

The evaluation of disability weights, which represent key components in the calculation of DALYs, remains very controversial. Though the GBD 2010 study attempted to respond to criticisms of the earlier GBD studies, many issues remain: the subjectivity in assigning disability weights to many given conditions, the many disability weights that make no medical sense, the non-inclusion of some conditions in the GBD studies and the difficulty in comparing studies that used different sets of disability weights. Perhaps some form of harmonization or consolidation of the GBD 1990 and GBD 2010 sets of disability weights should be considered. Although relatively few disability weights would require drastic adjustments, this would still lead to a third or, for some conditions, a fourth set of disability weights. While researchers, policy-makers and other stakeholders wait for the next set of disability weights, they need to keep in mind the limited comparability of studies based on the GBD 1990 disability weights and those based on the GBD 2010 weights.

Acknowledgements

We thank the Indo-US Science and Technology Forum, the University of California's Institute for Global Orthopaedics and Traumatology and the staff at the study hospital.

References

  • 1.
    Murray CJL, Lopez AD, editors. The global burden of disease: a comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020. Cambridge: Harvard University Press; 1996.
  • 2.
    Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJL, editors. Global burden of disease and risk factors. Washington: World Bank; 2006. http://dx.doi.org/10.1596/978-0-8213-6262-4
    » http://dx.doi.org/10.1596/978-0-8213-6262-4
  • 3.
    Murray CJL, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990-2010: a systematic analysis for the global burden of disease study 2010. Lancet. 2012 Dec 15;380(9859):2197-223. http://dx.doi.org/10.1016/S0140-6736(12)61689-4PMID:23245608
    » http://dx.doi.org/10.1016/S0140-6736(12)61689-4
  • 4.
    Anand S, Hanson K. Disability-adjusted life years: a critical review. J Health Econ. 1997 Dec;16(6):685-702. http://dx.doi.org/10.1016/S0167-6296(97)00005-2PMID:10176779
    » http://dx.doi.org/10.1016/S0167-6296(97)00005-2
  • 5.
    Williams A. Calculating the global burden of disease: time for a strategic reappraisal? Health Econ. 1999 Feb;8(1):1-8. http://dx.doi.org/10.1002/(SICI)1099-1050(199902)8:1<1::AID-HEC399>3.0.CO;2-BPMID:10082139
    » http://dx.doi.org/10.1002/(SICI)1099-1050(199902)8:1<1::AID-HEC399>3.0.CO;2-B
  • 6.
    Murray C, Acharya A. Age weights and discounting in health gaps reconsidered. In: Murray CJL, Salomon JA, Mathers CD, Lopez AD, editors. Summary measures of population health: concepts, ethics, measurement and applications. Geneva: World Health Organization; 2002. pp. 677-84.
  • 7.
    Lyttkens CH. Time to disable DALYs? On the use of disability-adjusted life-years in health policy. Eur. J Health Econ 2003 Sep;4(3):195-202. http://dx.doi.org/10.1007/s10198-003-0169-2PMID:15609185
    » http://dx.doi.org/10.1007/s10198-003-0169-2
  • 8.
    Arnesen T, Kapiriri L. Can the value choices in DALYs influence global priority-setting? Health Policy. 2004 Nov;70(2):137-49. http://dx.doi.org/10.1016/j.healthpol.2003.08.004PMID:15364144
    » http://dx.doi.org/10.1016/j.healthpol.2003.08.004
  • 9.
    Bognar G. Age-weighting. Econ Philos. 2008;24(2):167-89. http://dx.doi.org/10.1017/S026626710800179X
    » http://dx.doi.org/10.1017/S026626710800179X
  • 10.
    Gosselin R, Ozgediz D, Poenaru D. A square peg in a round hole? Challenges with DALY-based "burden of disease" calculations in surgery and a call for alternative metrics. World J Surg. 2013 Nov;37(11):2507-11. http://dx.doi.org/10.1007/s00268-013-2182-7PMID:23949200
    » http://dx.doi.org/10.1007/s00268-013-2182-7
  • 11.
    Salomon JA, Vos T, Hogan DR, Gagnon M, Naghavi M, Mokdad A, et al. Common values in assessing health outcomes from disease and injury: disability weights measurement study for the global burden of disease study 2010.. Lancet 2012 Dec 15;380(9859):2129-43. http://dx.doi.org/10.1016/S0140-6736(12)61680-8PMID:23245605
    » http://dx.doi.org/10.1016/S0140-6736(12)61680-8
  • 12.
    Taylor HR, Jonas JB, Keeffe J, Leasher J, Naidoo K, Pesudovs K, et al. Disability weights for vision disorders in global burden of disease study.. Lancet 2013 Jan 5;381(9860):23. http://dx.doi.org/10.1016/S0140-6736(12)62081-9PMID:23266227
    » http://dx.doi.org/10.1016/S0140-6736(12)62081-9
  • 13.
    McCord C, Chowdhury Q. A cost effective small hospital in Bangladesh: what it can mean for emergency obstetric care. Int J Gynaecol Obstet. 2003 Apr;81(1):83-92. http://dx.doi.org/10.1016/S0020-7292(03)00072-9PMID:12676406
    » http://dx.doi.org/10.1016/S0020-7292(03)00072-9
  • 14.
    Gosselin RA, Thind A, Bellardinelli A. Cost/DALY averted in a small hospital in Sierra Leone: what is the relative contribution of different services?. World J Surg 2006 Apr;30(4):505-11. http://dx.doi.org/10.1007/s00268-005-0609-5PMID:16528459
    » http://dx.doi.org/10.1007/s00268-005-0609-5
  • 15.
    Gosselin RA, Heitto M. Cost-effectiveness of a district trauma hospital in Battambang, Cambodia.. World J Surg 2008 Nov;32(11):2450-3. http://dx.doi.org/10.1007/s00268-008-9708-4PMID:18716830
    » http://dx.doi.org/10.1007/s00268-008-9708-4
  • 16.
    Gosselin RA, Maldonado A, Elder G. Comparative cost-effectiveness analysis of two MSF surgical trauma centers.. World J Surg 2010 Mar;34(3):415-9. http://dx.doi.org/10.1007/s00268-009-0230-0PMID:19771466
    » http://dx.doi.org/10.1007/s00268-009-0230-0

  • Funding: The study reported here forms part of a research project funded by an Indo-US Public Health Fellowship awarded to SC.

Publication Dates

  • Publication in this collection
    July 2015

History

  • Received
    25 Sept 2014
  • Reviewed
    09 Mar 2015
  • Accepted
    17 Mar 2015
Creative Common - by 3.0 igo
This is an open access article distributed under the terms of the Creative Commons Attribution IGO License (http://creativecommons.org/licenses/by/3.0/igo/legalcode), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. In any reproduction of this article there should not be any suggestion that WHO or this article endorse any specific organization or products. The use of the WHO logo is not permitted. This notice should be preserved along with the article's original URL.
World Health Organization Genebra - Genebra - Switzerland
E-mail: bulletin@who.int