RESEARCH

Economic evaluation of hepatitis B vaccination in low-income countries: using cost-effectiveness affordability curves

Evaluation économique de la vaccination contre lhépatite B dans les pays à faible revenu à partir de courbes coût/efficacité-accessibilité économique

Evaluación económica de la vacunación contra la hepatitis B en países de ingresos bajos: uso de curvas de costoeficacia/capacidad de pago

Sun-Young KimI; Joshua A SalomonII; Sue J GoldieI,1

IProgram in Health Decision Science, Health Policy and Management Department, Harvard School of Public Health, 718 Huntington Avenue, Boston, MA 02115, USA
IIPopulation and International Health Department, Harvard School of Public Health, Boston, MA, USA

ABSTRACT

OBJECTIVE: We sought to describe a method that explicitly considers both a health-care programmes cost-effectiveness and its affordability. For illustration, we apply the method to the programme to vaccinate infants against hepatitis B in the Gambia.
METHODS: We synthesized selected data and developed a computer-based model from the societal and payer perspectives to evaluate the cost-effectiveness of routine infant vaccination against hepatitis B in the Gambia compared with no vaccination. The primary outcome measure was cost per averted disability-adjusted life year (DALY), which was expressed in 2002 US dollars. We used Monte Carlo methods for uncertainty analysis to examine the affordability of the programme from the payers perspective, and we derived an affordability curve and cost-effectiveness affordability curves for the programme.
FINDINGS: In the Gambia, vaccinating infants against hepatitis B is highly cost-effective. Compared with offering no intervention, the vaccination programme would cost US$28 per DALY averted from the societal perspective or US$ 47 per DALY averted from the payers perspective. The programme also has the potential to be affordable, starting at a relatively low budget of US$160 000 per year. Combining the two dimensions of the outcome measure, the probability that vaccinating infants would be both cost-effective and affordable is 40% at an annual programme budget of US$ 182 000 (the estimated total programme cost from the payers perspective), given a threshold cost-effectiveness value of US$47 per DALY averted. CONCLUSION: In the face of uncertainties about both the health and economic consequences of a vaccine programme, as well as the availability and magnitude of resources needed to fund the programme, cost-effectiveness affordability curves can provide information to decision-makers about the probability that a programme will be both cost-effective and affordable: these are distinct but equally relevant considerations in resource-poor settings. RÉSUMÉ OBJECTIF: Nous avons recherché une méthode permettant de prendre en compte explicitement à la fois le rapport coût/efficacité dun programme et son accessibilité économique. A titre illustratif, nous avons appliqué cette méthode au programme de vaccination des nourrissons contre lhépatite B en Gambie. MÉTHODES: Nous avons fait la synthèse de données sélectionnées et mis au point un modèle informatique pour évaluer le rapport coût/efficacité pour la société dune part et pour ceux qui financent le programme dautre part de la vaccination systématique des nourrissons contre lhépatite B en Gambie par rapport à labsence de vaccination. La principale mesure des résultats programmatiques est le coût par année de vie corrigée de lincapacité évitée (DALY), exprimé en US$ de 2002. Dans le cadre de lanalyse dincertitude, nous avons étudié laccessibilité économique du programme pour ceux qui le financent par des méthodes de Monte Carlo, ce qui nous a permis détablir une courbe daccessibilité économique et des courbes rapport coût/efficacité en fonction de laccessibilité économique pour ce programme.
RÉSULTATS: En Gambie, le rapport coût/efficacité de la vaccination des nourrissons contre lhépatite B est très bon. Par comparaison avec la situation en labsence dintervention, ce programme vaccinal devrait coûter US$28 par DALY évitée pour la société ou US$ 47 par DALY évitée pour ceux qui le financent. Ce programme pourrait aussi être abordable économiquement en débutant avec un budget relativement faible de US$160 000 par an. Si lon combine ces deux dimensions de la mesure de résultats, la probabilité que cette vaccination des nourrissons soit à la fois dun bon rapport coût/efficacité et abordable économiquement est de 40 % pour un budget annuel du programme de US$ 182 000 (coût total estimé du programme pour ceux qui le financent), sachant que la valeur seuil du rapport coût/efficacité est de US$47 par DALY évitée. CONCLUSION: Face aux incertitudes quant aux conséquences tant sanitaires quéconomiques dun programme de vaccination et quant à la disponibilité et à lampleur des ressources nécessaires pour financer ce programme, les présentes courbes coût/efficacité fonction de laccessibilité économique peuvent fournir aux décideurs des indications sur la probabilité quil soit à la fois dun bon rapport coût/efficacité et abordable, ces deux aspects étant distincts, mais tout aussi pertinents lun que lautre dans les pays à faible revenu. RESUMEN OBJETIVO: Describir un método que considerase explícitamente tanto la costoeficacia de un programa de atención sanitaria como los recursos disponibles para llevarlo a cabo. A modo de ejemplo, se aplicó el método al programa de vacunación de los lactantes contra la hepatitis B en Gambia. MÉTODOS: Se sintetizaron datos seleccionados y se elaboró un modelo computadorizado desde las perspectivas de la sociedad y del pagador para evaluar la costoeficacia de la vacunación sistemática de los lactantes contra la hepatitis B en Gambia en comparación con la ausencia de vacunación. La medida de resultado principal fue el costo por año de vida ajustado en función de la discapacidad (AVAD) evitado, que se expresó en US$ de 2002. Se utilizaron métodos de Monte Carlo de análisis de incertidumbre para examinar la capacidad de pago del programa desde la perspectiva del pagador, y se obtuvieron una curva de la capacidad de pago y curvas de costoeficacia/capacidad de pago para el programa.
RESULTADOS: En Gambia, la vacunación de los lactantes contra la hepatitis B es muy costoeficaz. En comparación con la no intervención, el programa de vacunación costaría US$28 por AVAD evitado desde el punto de vista de la sociedad o US$ 47 por AVAD evitado desde la perspectiva del pagador. El programa puede también ser asequible, comenzando por un presupuesto relativamente bajo de US$160 000 al año. Combinando las dos dimensiones de la medida de resultados, la probabilidad de que la vacunación de los lactantes sea tanto costoeficaz como asequible es del 40% para un presupuesto programático anual de US$ 182 000 (costo total estimado del programa desde la perspectiva del pagador), considerando un valor de costoeficacia umbral de US$47 por AVAD evitado. CONCLUSIÓN: Ante las incertidumbres asociadas a las consecuencias sanitarias y económicas de un programa de vacunación, así como a la disponibilidad y magnitud de los recursos necesarios para financiar el programa, las curvas de costoeficacia/capacidad de pago pueden aportar a los responsables de la toma de decisiones información de interés sobre la probabilidad de que un programa sea tanto costoeficaz como asequible, conceptos éstos distintos pero igualmente pertinentes en los entornos de recursos escasos. Introduction Hepatitis B virus (HBV) infection remains a global public health challenge that causes significant morbidity and mortality,1 and the burden of disease is especially high in less-developed countries.2 Since 2000, the GAVI Alliance (formerly the Global Alliance for Vaccines and Immunisation) and the Vaccine Fund have accelerated the introduction of HBV vaccines in low-income countries by providing five years of funding for new and underused vaccines, including HBV vaccines.3 As of April 2005, mainly as a result of these efforts, 158 of 192 WHO Member States had adopted routine infant or childhood vaccination against HBV (GAVI Working Group, unpublished data, 2005). Moreover, building on the success of phase 1 of the programme (20002005), more resources were mobilized, and the GAVI Alliance decided to extend its support for the 72 poorest countries for phase 2 (20062015).4 However, there is no guarantee of long-term support for HBV vaccines, and each recipient country is required to cofinance its immunization programme, gradually increasing its contribution to a self-sustainable level at the end of the current grant.4 Therefore, despite the GAVI Alliances extended support, each recipient country needs to be conscious of the financial sustainability of its HBV vaccination programme and, accordingly, each country will need information on the total amount of resources required to fund the programme. The introduction of other new and underused vaccines  for example, those against Haemophilus influenzae type b (Hib) and yellow fever  in an increasing number of countries may intensify competition for limited resources. Finally, there will inevitably be uncertainty surrounding the real-world benefits of vaccination (for example, the ability to achieve adequate vaccine coverage) and the resources required to implement and sustain programmes,5 particularly in settings with weak health infrastructure, which will further complicate budget-related decisions. In this context, decision-makers will likely benefit from additional information about whether an HBV vaccination programme is affordable and cost-effective. In addition, decision-makers will benefit from an explicit recognition that the information will be uncertain and from analyses that take into account this uncertainty. In part, this has been addressed by summarizing cost-effectiveness results using cost-effectiveness acceptability curves; these curves show the probability that a programme will be cost-effective as a function of different thresholds for acceptable costeffectiveness ratios.6 However, one limitation of this approach is that the total amount of resources required to fund a programme is not considered.7 The cost-effectiveness affordability curve proposed by Sendi and Briggs overcomes this limitation because it presents the probabilities that a programme is simultaneously cost-effective and affordable as a function of both the threshold costeffectiveness ratio and budgetary constraints.8 To illustrate the usefulness of providing decision-makers with information on affordability and cost-effectiveness while formally accounting for uncertainty, we applied this approach to a real-world policy example: the programme to vaccinate infants against HBV in the Gambia. Methods Analytical overview Using the example, we first evaluated the programmes cost-effectiveness and derived cost-effectiveness acceptability curves. The cost-effectiveness of a programme was benchmarked in reference to specified thresholds, such as per-capita gross domestic product (GDP). A cost-effectiveness acceptability curve, constructed in the context of a multivariate uncertainty analysis, presents the probability that a programme will be cost-effective in relation to a range of different cost-effectiveness thresholds. We next assessed affordability at country level in terms of the annual expected cost for the vaccination programme compared with a specified programme budget. We considered a range of circumstances under which the programme might be assigned a single fixed budget. An affordability curve  also derived within a multivariate uncertainty analysis  presents the probability that a programme will be affordable under various programme budgets. The cost-effectiveness analysis was conducted from both a societal perspective and a payer perspective; the affordability analysis was conducted from the payers perspective. The societal perspective was chosen so that the cost-effectiveness results would be comparable with other studies; the payer perspective was chosen in order to explicitly consider affordability, since the payer is likely to play an important part in making decisions about the budget. Finally, we simultaneously considered both cost-effectiveness and affordability, combining these results graphically in cost-effectiveness affordability curves. These curves depict the probabilities that a programme will be both cost-effective and affordable under different annual budgets and at different threshold values of cost-effectiveness. A policy example The Gambia  which has a per capita income of around US$ 300 and high HBV endemicity  first introduced the HBV vaccine in 1990, depending heavily on external aid (Gambian government, unpublished data, 2001) and eventually began offering it routinely to all infants. Since 2003, the Gambia has been receiving support from the Vaccine Fund for HBV vaccines and two other new and underused vaccines, Hib and yellow fever (Gambian government, unpublished data, 2004); nonetheless, the Gambia faces potential financial challenges. Extending earlier work,9 we assessed the cost-effectiveness of the routine vaccination of infants against HBV compared with no vaccination, reflecting recent changes in cost and new data on long-term vaccine efficacy and the incidence of liver cancer. We followed published guidelines for conducting cost-effectiveness analyses.1012

We developed a computer-based model for a birth cohort of 56 000 Gambian infants born in 2002 and simulated the health and economic consequences associated with HBV infection. The model takes into account the mothers HBV infection status, the risk of transmission to the infant and the consequences resulting from HBV infection over the course of the cohorts lifetime. The models outcomes include lifetime costs, cases of new HBV infection, primary liver cancer, disease-specific deaths and disability-adjusted life years (DALYs). A technical appendix (available from the authors upon request) includes details of the model schematic and assumptions, the natural history model of HBV infection and data sources. Tables 1 and 2 present baseline values, ranges and imposed distributions of epidemiological parameters.

For the analysis from a societal perspective, we estimated the direct medical costs  including programme costs (vaccine, injection supplies, delivery) and averted costs of medical treatment  and direct non-medical costs (travel, parents time spent immunizing children, patients time). In our analysis from the payers perspective, only programme costs were included. We adjusted for inflation using the Gambian GDP deflators,13 and expressed costs in 2002 US dollars. Table 3 summarizes the assumptions on costs (further detail is given in the technical appendix). The primary outcome measure was cost-effectiveness, expressed as the incremental cost per DALY averted for vaccination compared with no intervention. For the base case, all outcomes were discounted at 3% per year based on WHO guidelines,10 although other rates were used in the sensitivity analyses.

To explore parameter uncertainty, we conducted univariate sensitivity analyses (reported in the technical appendix) and multivariate probabilistic sensitivity analysis. For the latter, we specified distributions around uncertain parameters (Tables 1, 2 and 3, and technical appendix) and performed 1000 Monte Carlo simulations for each perspective. Results of the probabilistic sensitivity analyses were used in the subsequent derivation of cost-effectiveness acceptability curves and affordability curves.

Assumptions for the affordability consideration

We intentionally made simplifying assumptions to demonstrate the application of our analytical framework in the most transparent manner possible. These include the assumption that coverage for traditional vaccines used in the Expanded Programme on Immunization (measles, diphtheriatetanuspertussis, oral polio vaccine and bacille CalmetteGuérin) is already high (> 90% as of 2002) in the Gambia, so that investment in new and underused vaccines (HBV, Hib and yellow fever) are justified (Gambian government, unpublished data, 2003). Also, each routine infant vaccination programme is indivisible  meaning vaccination cannot be administered to only a fraction of infants  based on arguments that this would be inequitable. If there were a deficit in the funding for the national immunization programme, less-expensive monovalent vaccines would be used; and based on previous analyses,14,15 the childhood vaccination programmes would be assigned priority in the following order: traditional vaccines plus tetanus toxoid, HBV vaccine, other new and underused vaccines.

Derivation of an affordability curve and cost-effectiveness affordability curves

We evaluated programme affordability based on the joint distribution of simulated incremental health gains and the costs of HBV vaccination from the payers perspective. If we plot the simulated outcomes on a cost-effectiveness plane (which has net costs on the vertical axis and net health outcomes on the horizontal), an affordability curve captures the proportion of points in this plane that fall below the horizontal lines corresponding to different budget levels.8 A set of cost-effectiveness affordability curves combines the information from a cost-effectiveness acceptability curve and an affordability curve to capture the proportion of points that fall below both the diagonal line representing a particular cost-effectiveness threshold and the horizontal line representing a particular budget level.8

Findings

Table 4 presents the incremental costeffectiveness ratio of vaccinating infants against HBV compared with no vaccination from the payers perspective. The point estimate provides information on the cost-effectiveness of the HBV programme, allowing the programmes value-for-money to be compared with various benchmarks. For example, the programmes incremental costeffectiveness ratio of US$47 per DALY averted is lower than the Gambias per-capita GDP (around US$ 300), a measure often used as a surrogate indicator of the cost-effectiveness threshold below which a programme would be considered highly cost-effective.16 However, the point estimate does not consider uncertainty around the programmes costs and effects.

The cost-effectiveness acceptability curve in Fig. 1 incorporates such uncertainty and presents the probability that the HBV vaccination programme is cost-effective in relation to different threshold values for cost-per-DALY ratios. The curve was constructed by plotting the proportion of simulated outcomes on a cost-effectiveness plane that fall below the diagonal lines through the origin of which slopes represent various cost-effectiveness cut-off points. The curve shows that the programme would not be considered cost-effective at thresholds < US$25 per DALY averted but would always be considered cost-effective at thresholds > US$ 97 per DALY averted. The curve also indicates that if the programmes payer is willing to pay US$47 per DALY averted, there is a 65% probability the programme will be cost-effective. A cost-effectiveness acceptability curve provides an intuitive visual summary of uncertainty about cost-effectiveness, but it does not explicitly account for potential constraints on total resources.7,8 On the other hand, an affordability curve does account for this constraint in presenting the probability that the total costs of a programme fall below a specified budget level. In our policy example (Fig. 2), the probability that the HBV programme is affordable is 0% up to a budget of US$ 157 000 but increases as the budget increases, reaching 100% when the budget increases to US$207 000. Accordingly, US$ 157 000 can be considered the lower boundary and US$207 000 the upper boundary of the amount of resources required for the programme. The curve also indicates that if the programme budget were set at US$ 182 000 per year based on the estimated average programme costs (Table 4), the probability that the programme will be affordable is only 58% because of the uncertainty surrounding the programmes costs.

Fig. 3 combines the information provided by the cost-effectiveness acceptability curve and the affordability curve and presents a set of cost-effectiveness affordability curves for the three different levels of programme budget examined in Fig. 2. In the graph, each curve represents the probability that the HBV programme is both cost-effective and affordable at each combination of a cost-effectiveness threshold (horizontal axis) and a programme budget (indicated by legends for each curve). The bottom curve indicates that under programme budgets < US$157 000 (the lower bound of the resources required), the probability that the programme is simultaneously cost-effective and affordable is 0% regardless of the levels of willingness-to-pay since the probability that the programme is affordable is 0% under such low budgets. The middle curve shows that under the US$ 182 000 budget (the average programme cost), the probability that the programme is both affordable and cost-effective would increase as the cost-effectiveness threshold increases, reaching a maximum of 68% at the threshold of US$97 per DALY averted (the minimum threshold above which the probability that the programme is cost-effective is 100%). Similarly, the upper curve shows that the corresponding probability under the US$ 207 000 budget (the upper bound of the resources required) would reach 100% at the same threshold of US$97 per DALY averted. The curve under "no budget constraint" is identical to the curve under the US$ 207 000 budget. This implies that setting a programme budget above the upper bound of the resources required for the programme (US$207 000) would not add any further health benefits. It is also noteworthy that the curve under "no budget constraint" is by definition identical to the cost-effectiveness acceptability curve shown in Fig. 1. From a different angle, with a cost-effectiveness threshold set at US$ 47 per DALY averted (the point estimate of the incremental costeffectiveness ratio) the probabilities that the programme is simultaneously cost effective and affordable are 0% under an annual budget of US$157 000, 40% under a budget of US$ 182 000, and 65% under a budget of US$207 000. Discussion We found from the policy example that vaccinating infants against HBV reduces the burden of HBV-related diseases by > 80%, and it is a highly cost-effective health intervention in the Gambia (Table 4). Our findings also showed that the programme has the potential to be affordable even with a relatively low annual budget of US$ 160 000 (Fig. 2).

Our example illustrates how cost-effectiveness affordability curves can enhance the information provided by traditional analyses of cost-effectiveness. While cost-effectiveness acceptability curves provide a valuable heuristic for summarizing the distribution of expected health and economic consequences in the setting of multivariate uncertainty, they do not distinguish between joint distributions of costs and effects that share the same correlations between these two dimensions but differ in scale.7,8 Cost-effectiveness affordability curves provide one way to address this limitation. When all points in the joint distribution of costs and benefits are positive on both dimensions (as is likely with most childhood vaccines), the consideration of budget constraints in addition to cost-effectiveness thresholds in analyses of multivariate uncertainty enhances the information available to guide real-world decisions.

Limitations

There are several limitations to this analysis. First, our modelling of a single birth cohort for the example does not reflect the indirect effects of vaccination on the force of infection (the rate at which susceptible individuals become infected) over time, and estimated benefits may be higher. Second, because our analysis is intended to demonstrate the framework of how one may add the dimension of affordability to cost-effectiveness analyses, we focused on the affordability of the HBV programme. We did not evaluate the affordability of all competing interventions, so this example provides only qualitative insight into the potential impact of the affordability of the HBV programme. We cannot draw conclusions that depend on the affordability of other programmes delivering new and underused vaccines that are competing for resources. Finally, we could not take into account the potential impact of technological changes that may considerably affect the programmes cost-effectiveness, such as the introduction of pre-filled auto-disable devices or multivalent vaccines.

Implications

Despite the favourable cost-effectiveness profile of HBV vaccination programmes, without adequate long-term funding when the GAVI Alliances support is terminated, low-income countries such as the Gambia may face difficult decisions over how to set priorities and allocate limited resources among different childhood vaccines, and in particular new vaccines. In this context, the importance of examining affordability as well as cost-effectiveness when considering introducing a new vaccine should be increasingly emphasized.17,18 Few studies have explicitly examined the affordability of new vaccines under such circumstances, and no specific guidelines for evaluating affordability have been suggested.

In this regard, our study provides guidance relevant to policy-making in two respects. First, in the face of uncertainties about both the health and economic consequences of a programme, as well as the availability and magnitude of resources needed to fund the programme, policy-makers can use affordability curves to discern the probability that a new programme will be affordable under a specified budget or can project the consequences of assigning different amounts of funding to the programme over a range of programme budgets. Although economic studies that compare a programmes annual per-capita cost with annual per-capita government health expenditure or compare a programmes estimated annual average cost with its annual budget are useful, the approach suggested here takes into account uncertainty in the estimates of costs and benefits.19 Second, the cost-effectiveness acceptability curves may serve as tools to communicate results of complex probabilistic cost-effectiveness analyses to policy-makers. When policy-makers need information on affordability in addition to the cost-effectiveness of a new vaccine, a single illustration that combines the cost-effectiveness and affordability profile of the vaccine may allow for easier interpretation.

The usefulness of cost-effectiveness affordability curves is limited when a resource allocation problem needs to be addressed generally because it focuses on a single new programmes fixed budget. In our example, we assumed that before support from the GAVI Alliance ended, low-income countries would be likely to secure sufficient resources to fund the traditional vaccines and might want to set a separate budget for the increased use of new and underused vaccines. We also assumed that there may not be sufficient resources available to fund all of the relatively expensive new and underused vaccines, and that if so, HBV vaccines would be assigned priority, based on the cost-effectiveness profiles reported in studies.14,15 If this is not the case, fully evaluating the HBV vaccination programmes affordability requires a more comprehensive approach that explicitly considers the affordability of other competing vaccination programmes under a shared budget. For example, for the case in which the budget constraint is the total portfolio cost, Sendi and colleagues propose calculating the probability that each portfolio would be affordable over a range of budget levels by iterating Monte Carlo simulations of all relevant interventions and then calculating the joint distribution of the total portfolio costs and effectiveness through summation of each programmes cost and effectiveness.20 However, if HBV vaccines are to be used in multivalent presentations (for example, diphtheriatetanuspertussis with HBV vaccine, or diphtheriatetanuspertussis with Hib and HBV vaccine) then an optimal mix of antigens should be identified, taking into account the fact that the cost of a combined vaccine would not be the sum of the costs of each monovalent vaccine. Additional research is needed to solve resource allocation problems and it should consider all relevant programmes under a shared budget and incorporate complicated constraints.

Nevertheless, given that such research would require an enormous amount of effort in a real-world setting, and that HBV vaccines might reasonably satisfy the assumptions necessary for the existence of a fixed budget based on the vaccines favourable cost-effectiveness profiles, an approach that considers cost-effectiveness, affordability and uncertainty can serve as a practical tool to provide valuable information to decision-makers in low-income countries who might face severe budget constraints for their HBV programmes or programmes for other new and underused vaccines.

Acknowledgements

We are grateful to Milton Weinstein and Tracy Lieu for their valuable suggestions regarding the analysis. We also greatly appreciate helpful comments from anonymous reviewers.

Funding and competing interests: Sun-Young Kim was supported in part by a Harvard Graduate Society Fellowship. The funding source did not have any involvement in conducting the study or deciding to submit the manuscript for publication.

References

1. Beutels P. Economic evaluations of hepatitis B immunization: a global review of recent studies (1994-2000). Health Econ 2001;10:751-74.

2. Kao JH, Chen DS. Global control of hepatitis B virus infection. Lancet Infect Dis 2002;2:395-403.

3. Martin JF, Marshal J. New tendencies and strategies in international immunization: GAVI and The Vaccine Fund. Vaccine 2003;21:587-92.

4. GAVI, the Vaccine Fund. Progress and challenges 2004. Geneva: GAVI; 2004.

5. Brisson M, Edmunds WJ. Impact of model, mathodological, and parameter uncertainty in the economic analysis of vaccination programmes. Med Decis Making 2006;26:434-46.

6. Briggs AH, OBrien BJ, Blackhouse G. Thinking outside the box: recent advances in the analysis and presentation of uncertainty in cost-effectiveness studies. Annu Rev Public Health 2002;23:377-401.

7. Groot KB, Hunink MGM, Stijnen T, Hammitt JK, Kuntz KM, Weinstein MC. Limitations of acceptability curves for presenting uncertainty in cost-effectiveness analysis. Med Decis Making 2007;27:101-11.

8. Sendi PP, Briggs AH. Affordability and cost-effectiveness: decision-making on the cost-effectiveness plane. Health Econ 2001;10:675-80.

9. Hall AJ, Roberston RL, Crivelli PE, Lowe Y, Inskip H, Snow SK, et al. Cost-effectiveness of hepatitis B vaccine in The Gambia. Trans R Soc Trop Med Hyg 1993;87:333-6.

10. Edejer TT, Baltussen R, Adam T, Hutubessy R, Acharya A, Evans DB, et al, eds. Making choices in health: WHO guide to cost-effectiveness analysis. Geneva: WHO; 2003.

11. Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-effectiveness in health and medicine. New York: Oxford University Press; 1996.

12. Beutels P, Edmunds WJ, Antonanzas F, De Wit GA, Evans D, Feilden R, et al. Economic evaluation of vaccination programmes: a consensus statement focusing on viral hepatitis. Pharmacoeconomics 2002;20:1-7.

13. Jamison DT, Breman JG, Measham AR, Alleyne G, Claeson M, Evans DB et al. Disease Control Priorities Project. In: Disease control priorities in developing countries. 2nd edition. New York: Oxford University Press; 2006.

14. Miller MA, McCann L. Policy analysis of the use of hepatitis B, Haemophilus influenzae type b, Streptococcus pneumoniae-conjugate and rotavirus vaccines in national immunization schedules. Health Econ 2000;9:19-35.

15. Shepard DS, Walsh JA, Kleinau E, Stansfield S, Bhalotra S. Setting priorities for the Childrens Vaccine Initiative: a cost-effectiveness approach. Vaccine 1995;13:707-14.

16. Commission on Macroeconomics and Health. Macroeconomics and health: investing in health for economic development. Report of the Commission on Macroeconomics and Health. Geneva: WHO; 2001.

17. Cost effectiveness of rotavirus vaccines and other interventions for diarrhoeal diseases: meeting report 2006. Wkly Epidemiol Rec 2006;81:350-3.

18. Adding a vaccine to a national immunization programme: decision and implementation. Geneva: WHO; 2005 (WHO/IVB/05.18). Available at: http://www.who.int/ vaccines-documents/ DocsPDF05/777_screen.pdf

19. Walker D, Fox-Rushby JA. Economic evaluation of communicable disease interventions in developing countries: a critical review of the published literature. Health Econ 2000;9:681-98.

20. Sendi P, Gafni A, Birch S. Opportunity costs and uncertainty in the economic evaluation of health care interventions. Health Econ 2002;11:23-31.

21. Whittle H, Jaffar S, Wansbrough M, Mendy M, Dumpis U, Collinson A, et al. Observational study of vaccine efficacy 14 years after trial of hepatitis B vaccination in Gambian children. BMJ 2002;325:569.

22. Yuen MF, Lim WL, Chan AO, Wong DK, Sum SS, Lai CL. 18-year follow-up study of a prospective randomized trial of hepatitis b vaccinations without booster doses in children. Clin Gastroenterol Hepatol 2004;2:941-5.

23. Edmunds WJ, Medley GF, Nokes DJ, OCallaghan CJ, Whittle HC, Hall AJ. Epidemiological patterns of hepatitis B virus (HBV) in highly endemic areas. Epidemiol Infect 1996;117:313-25.

24. Edmunds WJ, Medley GF, Nokes DJ. The transmission dynamics and control of hepatitis B virus in The Gambia. Stat Med 1996;15:2215-33.

25. Margolis HS, Coleman PJ, Brown RE, Mast EE, Sheingold SH, Arevalo JA. Prevention of hepatitis B virus transmission by immunization. An economic analysis of current recommendations. JAMA 1995;274:1201-8.

26. de Franchis R, Hadengue A, Lau G, Lavanchy D, Lok A, McIntyre N, Mele A, et al. EASL international consensus conference on hepatitis B. 13-14 September, 2002 Geneva, Switzerland. Consensus statement (long version). J Hepatol 2003;39 Suppl 1:S3-25.

27. Edmunds WJ, Medley GF, Nokes DJ, Hall AJ, Whittle HC. The influence of age on the development of the hepatitis B carrier state. Proc R Soc Lond B Biol Sci 1993;253:197-201.

28. Chang MH. Decreasing incidence of hepatocellular carcinoma among children following universal hepatitis B immunization. Liver Int 2003;23:309-14.

29. Wong JB, Koff RS, Tine F, Pauker SG. Cost-effectiveness of interferon-alpha2b treatment for hepatitis B e antigen-positive chronic hepatitis B. Ann Intern Med 1995;122:664-75.

30. Broderick AL, Jonas MM. Hepatitis B in children. Semin Liver Dis 2003;23:59-68.

31. Lin X, Robinson NJ, Thursz M, Ronsenberg DM. Chronic hepatitis B virus infection in the Asia-Pacific region and Africa: Review of disease progression. J Gastroenterol Hepatol 2005;20:833-43.

32. Bortolotti F, Jara P, Crivellaro C, Hierro L, Cadrobbi P, Frauca E, et al. Outcome of chronic hepatitis B in Caucasian children during a 20-year observation period. J Hepatol 1998;29:184-90.

33. Goldstein ST, Zhow F, Hadler SC, Bell BP, Mast EE, Margolis HS. A mathematical model to estimate global hepatitis B disease burden and vaccination impact. Int J Epidemiol 2005;34:1329-39.

34. Mathers CD, Stein C, Ma Fat D, Rao C, Inoue M, Tomijima N, et al. Global Burden of Disease 2000: version 2 methods and results. Geneva: WHO; 2002. Available at: http://www.who.int/healthinfo/paper50.pdf

35. UNICEF. 2002 Vaccine projections: quantities and pricing. Available at: http://www.unicef.org/ supply/files/2002_Vaccine_Projection.pdf

36. Kou U. Guidelines for estimating costs of introducing new vaccines into the national immunization system. Geneva: World Health Organization; 2002.

37. Ekwueme DU, Weniger BG, Chen RT. Model-based estimates of risks of disease transmission and economic costs of seven injection devices in sub-Saharan Africa. Bull World Health Organ 2002;80:859-70.

38. Fox-Rushby J, Foord F. Costs, effects and cost-effectiveness analysis of a mobile maternal health care service in West Kiang, The Gambia. Heatlh Policy 1996;35:123-43.

39. Government of the Gambia. Health map: final report. Banjul: The Republic of The Gambia; 1999.

(Submitted: 20 November 2006  Final revised version submitted: 4 April 2007  Accepted: 10 April 2007  Published online: 21 September 2007)

1 Correspondence to Sue J Goldie (e-mail: sue_goldie@harvard.edu)

World Health Organization Genebra - Genebra - Switzerland
E-mail: bulletin@who.int