Drivers of federal spending in pharmaceuticals of the Specialized Component: measurement and analysis

Fabiola Sulpino Vieira About the author

ABSTRACT

OBJECTIVES:

Quantify and analyze the contribution of the main drivers of federal spending in pharmaceuticals purchase from the Specialized Component of Pharmaceutical Care (CEAF) in the period from 2010 to 2019.

METHODS:

An analysis of the annual expenditure's decomposition of the Brazilian Ministry of Health (MS) in pharmaceuticals from group 1A of the CEAF was carried out in order to isolate the contribution of its main drivers, price, quantity and residual, which involves therapeutic choices. This contribution's quantification was made with the support of the RStudio software version 1.3.1056 and the IndexNumR statistical package.

RESULTS:

The main driver of increased expenditure between 2011 and 2018 was the quantity of overlapping pharmaceuticals, 55% and 34%. In turn, the main driver in 2013 and 2015 was the residual, 33.2% and 57.9%. However, the expenditure in 2019 decreased by 30.4% compared with 2010. There was a decrease in the prices of daily treatments throughout the period. Among the years in which there was a reduction in expenditure, the residual was the main driver of the decrease in 2012 (-19.6%) and 2019 (-11.9%), while prices had the greatest impact on the decrease in expenditure in 2014 (-12%). There was also a reduction in the quantity of overlapping pharmaceuticals in three consecutive years, being -11% in 2015, -4% in 2016 and -11% in 2017. Lastly, in 2019 the reduction was -4%.

CONCLUSIONS:

The contribution of drivers to MS expenditure in the CEAF's 1A group fluctuated between 2010 and 2019. However, the expenditure decrease in recent years was induced by the three main drivers: price, quantity and residual. The decrease in the quantity purchased may have reduced the availability of some pharmaceuticals in the Brazilian Unified Health System (SUS).

DESCRIPTORS:
Drugs from the Specialized Component of Pharmaceutical Care; Drug Costs; Health Expenditures; Pharmaceutical Services; Unified Health System

INTRODUCTION

Pharmaceutical spending is one of the main components of health expenditure and has concerned public administrators due to its growing trend, often higher than the rates observed for total health expenditures. This motivated several countries to implement policies to contain it, especially in recent years marked by economic and fiscal crisis11 Belloni A, Morgan D, Paris V. Pharmaceutical expenditure and policies: past trends and future challenges. Paris: OECD; 2016. (OECD Health Working Papers; n° 87). https://doi.org/10.1787/5jm0q1f4cdq7-en
https://doi.org/10.1787/5jm0q1f4cdq7-en...
.

Factors such as the population's age structure, quantity consumed, prices, type of used medicines (generic or not), epidemiological profile, among others, determine expenditure on these products and are determinants of pharmaceutical spending. When these determinants induce changes in expenses between two periods, they are called expense drivers22 Canada. Patented Medicine Prices Review Board. The drivers of prescription drug expenditures: a methodological report. Ottawa (CA): PMPRB; 2013 [cited 2020 Aug 29]. Available from: https://bit.ly/3jxpLFN.
https://bit.ly/3jxpLFN...
.

Pharmaceutical care in the Brazilian Unified Health System (SUS) got strengthened in recent decades with the resources allocation expansion for medicines supply, and its financing was organized into three components: basic, strategic and specialized33 Vieira FS. Evolução do gasto com medicamentos do Sistema Único de Saúde no período de 2010 a 2016. Rio de Janeiro: Ipea; 2018 [cited 2020 Aug 29]. (Texto para Discussão; n° 2356). Available from: https://bit.ly/2YLGxIw.
https://bit.ly/2YLGxIw...
. The Specialized Component of Pharmaceutical Care (CEAF) covers pharmaceuticals used in the treatment of rare and chronic diseases, generally of high cost, whose use is foreseen in lines of care contained in clinical protocols and therapeutic guidelines44 Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Assistência Farmacêutica e Insumos Estratégicos. Componente Especializado da Assistência Farmacêutica: inovação para a garantia do acesso a medicamentos no SUS. Brasília, DF; 2014 [cited 2020 Aug 20]. Available from: https://bit.ly/31wLPZ0.
https://bit.ly/31wLPZ0...
. CEAF is divided into three groups: 1A – pharmaceuticals financed and purchased by the Brazilian Ministry of Health (MS) –; 1B – financed by the MS and by the state health departments (SES) and acquired by the SES –; and 2 – financed and acquired by the SES and municipal health departments (SMS)55 Ministério da Saúde (BR). Portaria de Consolidação n° 2, de 28 de setembro de 2017. Consolidação das normas sobre as políticas nacionais de saúde do Sistema Único de Saúde. Anexo XXVIII: Título IV. Dispõe sobre as regras de financiamento e execução do Componente Especializado da Assistência Farmacêutica no âmbito do Sistema Único de Saúde. Brasília, DF; 2017 [cited 2020 Aug 29]. Available from: https://bit.ly/2SzdF6x
https://bit.ly/2SzdF6x...
. Expenditure on this component has a high participation in the MS's pharmaceutical budget33 Vieira FS. Evolução do gasto com medicamentos do Sistema Único de Saúde no período de 2010 a 2016. Rio de Janeiro: Ipea; 2018 [cited 2020 Aug 29]. (Texto para Discussão; n° 2356). Available from: https://bit.ly/2YLGxIw.
https://bit.ly/2YLGxIw...
.

In the last decade, there was a reduction in the participation of the government's three spheres in the final consumption of medicines: from 10% to 8% between 2010 and 201766 Instituto Brasileiro de Geografia e Estatística. Conta-Satélite de Saúde Brasil: 2010-2017. Rio de Janeiro: IBGE; 2019 [cited 2020 Aug 29]. (Contas Nacionais; n° 71). Available from: https://bit.ly/3c2DWyi.
https://bit.ly/3c2DWyi...
. In addition, a 9.9% decrease in the MS's budget execution for pharmaceuticals between 2016 and 201777 Vieira FS. Desafios do Estado quanto à incorporação de medicamentos no Sistema Único de Saúde. Brasília, DF: Ipea; 2019 [cited 2020 Aug 29]. (Texto para Discussão; n. 2500). Available from: https://bit.ly/34KZmzm.
https://bit.ly/34KZmzm...
, breaking a virtually continuous growth trajectory between 2010 and 201633 Vieira FS. Evolução do gasto com medicamentos do Sistema Único de Saúde no período de 2010 a 2016. Rio de Janeiro: Ipea; 2018 [cited 2020 Aug 29]. (Texto para Discussão; n° 2356). Available from: https://bit.ly/2YLGxIw.
https://bit.ly/2YLGxIw...
. The public expenditure's participation in the total expenditure on health or pharmaceuticas is an indicator related to public financing and shows the State's effort to guarantee availability and access to health goods and services by the population88 Piola SF, Paiva AB, Sá EB, Servo LMS. Financiamento público da saúde: uma história à procura de rumo. Rio de Janeiro: Ipea; 2013 [cited 2020 Dec 14]. (Texto para Discussão; n° 1846). Available from: https://bit.ly/2UzozqE .
https://bit.ly/2UzozqE...
.

Therefore, analyzes of the pharmaceutical expenditure evolution are important both for the public administration and for society, especially in countries that have not yet reached a high level of the public pharmaceutical supply, as is the case in Brazil. In the country, out-of-pocket payment is still the main access medium to these products66 Instituto Brasileiro de Geografia e Estatística. Conta-Satélite de Saúde Brasil: 2010-2017. Rio de Janeiro: IBGE; 2019 [cited 2020 Aug 29]. (Contas Nacionais; n° 71). Available from: https://bit.ly/3c2DWyi.
https://bit.ly/3c2DWyi...
, proportionally burdening the budget of lower income households99 Boing AC, Bertoldi AD, Posenato LG, Peres KG. Influência dos gastos em saúde no empobrecimento de domicílios no Brasil. Rev Saude Publica. 2014;48(5):797-807. https://doi.org/10.1590/S0034-8910.2014048005113
https://doi.org/10.1590/S0034-8910.20140...
. However, despite the relevance of these analyses, they are limited to a more comprehensive understanding of expenditures because they do not identify their drivers, which would help to clarify whether variations in annual expenditure are being driven by changes in prices, quantities and/or by therapeutic choices22 Canada. Patented Medicine Prices Review Board. The drivers of prescription drug expenditures: a methodological report. Ottawa (CA): PMPRB; 2013 [cited 2020 Aug 29]. Available from: https://bit.ly/3jxpLFN.
https://bit.ly/3jxpLFN...
.

Thus, considering this information gap, the relevance of pharmaceuticals for health care and CEAF's budgetary impact for the MS, this article aims to quantify and analyze the contribution of the main drivers of federal spending in pharmaceutical purchase from the Specialized Component of Pharmaceutical Care in the period from 2010 to 2019.

METHODS

A decomposition analysis of the MS's annual expenditure on pharmaceuticals from CEAF's 1A group was carried out in order to isolate the contribution of its main drivers22 Canada. Patented Medicine Prices Review Board. The drivers of prescription drug expenditures: a methodological report. Ottawa (CA): PMPRB; 2013 [cited 2020 Aug 29]. Available from: https://bit.ly/3jxpLFN.
https://bit.ly/3jxpLFN...
. This type of analysis is based on the theory of index numbers, which establishes that the expenditure variation on a given basket of goods or services between two periods can be explained by variations in the price and quantity of goods and services that make up that basket1010 Boer P, Rodrigues JFD. Decomposition analysis: when to use which method? Econ Syst Res. 2019;32(1):1-28. https://doi.org/10.1080/09535314.2019.1652571.
https://doi.org/10.1080/09535314.2019.16...
.

For pharmaceuticals, some adjustments need to be made in this theory's application, as the list offered between two periods usually varies with the exclusion or inclusion of products. Furthermore, the consumption pattern can be altered by changes in clinical practice. Thus, changes involving the quality of the medicines offered that are inadequately captured by changes in quantity are happening and, therefore, a third variable needs to be used, in addition to price and quantity, in order to explain all the variation on these products’ spending1111 Gerdtham UG, Johannesson M, Gunnarsson B, Marcusson M, Henriksson F. The effect of changes in treatment patterns on drug expenditure. Pharmacoeconomics. 1998;13(1 Pt 2):127-34. https://doi.org/10.2165/00019053-199813010-00012
https://doi.org/10.2165/00019053-1998130...
,1212 Morgan SG. Quantifying components of drug expenditure inflation: the British Columbia seniors’ drug benefit plan. Health Serv Res. 2002;37(5):1243-66. https://doi.org/10.1111%2F1475-6773.01058.
https://doi.org/10.1111%2F1475-6773.0105...
.

Gerdtham et al1111 Gerdtham UG, Johannesson M, Gunnarsson B, Marcusson M, Henriksson F. The effect of changes in treatment patterns on drug expenditure. Pharmacoeconomics. 1998;13(1 Pt 2):127-34. https://doi.org/10.2165/00019053-199813010-00012
https://doi.org/10.2165/00019053-1998130...
called this third variable a residual. On the other hand, in later studies, other authors called it therapeutic choices22 Canada. Patented Medicine Prices Review Board. The drivers of prescription drug expenditures: a methodological report. Ottawa (CA): PMPRB; 2013 [cited 2020 Aug 29]. Available from: https://bit.ly/3jxpLFN.
https://bit.ly/3jxpLFN...
,1212 Morgan SG. Quantifying components of drug expenditure inflation: the British Columbia seniors’ drug benefit plan. Health Serv Res. 2002;37(5):1243-66. https://doi.org/10.1111%2F1475-6773.01058.
https://doi.org/10.1111%2F1475-6773.0105...
,1313 Mousnad MA, Shafie AA, Ibrahim MI. Systematic review of factors affecting pharmaceutical expenditures. Health Policy. 2014;116(2-3):137-46. https://doi.org/10.1016/j.healthpol.2014.03.010.
https://doi.org/10.1016/j.healthpol.2014...
. The residual is influenced by changes in the pattern use of overlapping pharmaceuticals between two periods, that is, the use of medicines that are available in the two years analyzed, as well as by the exclusion and inclusion of medicines. Considering the three variables mentioned, the expenditure decomposition on pharmaceuticals can be performed as follows1111 Gerdtham UG, Johannesson M, Gunnarsson B, Marcusson M, Henriksson F. The effect of changes in treatment patterns on drug expenditure. Pharmacoeconomics. 1998;13(1 Pt 2):127-34. https://doi.org/10.2165/00019053-199813010-00012
https://doi.org/10.2165/00019053-1998130...
: IG=IP.IQ.IR, where:

IG = pharmaceutical spending index (measures the real change in expenditure between two periods);

IP = price index per treatment/day (measures the effect of the real change in medication prices from an overlapping list between two periods on expenditure);

IQ = quantity index expressed in daily treatments (measures the effect of the quantities variation in an overlapping list between two periods on expenditure);

IR = residual index (measures the effect of variation in the care standard, therapeutic choices, between two periods on expenditure).

Data on pharmaceutical purchase by the MS were extracted from the Integrated System of General Services Administration (SIASG), which contains information on the goods purchased and the amounts allocated to purchases by pharmaceutical unit and the total. The data mentioned above were made available for the study to be carried out by a member of the agency's technical team.

The pharmaceuticals that are part of the CEAF list were identified, and purchases to meet legal demands were excluded, so that purchases made for SES’ distribution and subsequent dispensing in SUS units remained on the list. In SIASG, pharmaceuticals are designated by the drug name (active ingredient). Each drug on the CEAF list was further identified by its code and therapeutic subgroup of the ATC/DDD system (Anatomical Therapeutic Chemical Classification System/Defined Daily Doses), maintained by the World Health Organization (WHO), and the defined daily dose (DDD) was included for drugs that have established them1414 WHO Collaborating Centre for Drug Statistics Methodology. The Anatomical Therapeutic Chemical Classification System with Defined Daily Doses (ATC/DDD). Oslo (NO); 2003 [cited 2020 Aug 29]. Available from: https://bit.ly/3iI4eMT
https://bit.ly/3iI4eMT...
.

The physical quantity of each medicine in different concentrations and presentations were converted to DDD numbers per drug. Therefore, pharmaceuticals that contain the same drug are considered only one product, and their quantity is measured in DDD numbers made available in the year1111 Gerdtham UG, Johannesson M, Gunnarsson B, Marcusson M, Henriksson F. The effect of changes in treatment patterns on drug expenditure. Pharmacoeconomics. 1998;13(1 Pt 2):127-34. https://doi.org/10.2165/00019053-199813010-00012
https://doi.org/10.2165/00019053-1998130...
. Lastly, only pharmaceuticals with established DDD were included in the analysis.

The amount allocated to the purchase of each medicine was divided by the number of DDDs to obtain the value or price per DDD, monetarily updated to 2019 values by the Broad Consumer Price Index (IPCA), the official inflation measurer in Brazil1515 Banco Central do Brasil. Índices de preços no Brasil. Brasília, DF; 2016 [cited 2020 Aug 29]. (Série Perguntas Mais Frequentes). Available from: https://bit.ly/2CP3wL4.
https://bit.ly/2CP3wL4...
. For pharmaceuticals with more than one purchase in the year, the average price weighted by DDD number was calculated. The annual expenditure consists of the sum of the expenditure on each drug in the year updated by the IPCA and the expenditure index was calculated considering the variation between the expenditure in one year and that carried out in the immediately preceding year.

The price and quantity indices were measured with the support of the RStudio software version 1.3.1056 and the IndexNumR package, applying the Fisher method1616 White G. IndexNumR: a package for index number calculation. Wien (AT): CRAN - The Comprehensive R Archive Network; 2021 [cited 2021 Jun 15]. Available from: https://bit.ly/3jBQ3qL.
https://bit.ly/3jBQ3qL...

17 White G. Package ‘IndexNumR’: Index Number Calculation. Wien (AT): CRAN - The Comprehensive R Archive Network; 2021. [cited 2021 Jun 15]. Available from: https://bit.ly/2XH5CUA
https://bit.ly/2XH5CUA...
-1818 Vieira FS. Indutores do gasto direto do Ministério da Saúde em medicamentos (2010-2019). Brasília, DF: Ipea; 2021 [cited 2021 Jun 15]. (Texto para Discussão; n° 2634). Available from: https://bit.ly/3iIZBlM
https://bit.ly/3iIZBlM...
. Other functions of this package were used to identify the overlap of pharmaceuticals between the years analyzed and to analyze the contribution of the price and quantity variables in monetary terms to the annual variation in expenditure1818 Vieira FS. Indutores do gasto direto do Ministério da Saúde em medicamentos (2010-2019). Brasília, DF: Ipea; 2021 [cited 2021 Jun 15]. (Texto para Discussão; n° 2634). Available from: https://bit.ly/3iIZBlM
https://bit.ly/3iIZBlM...
. Lastly, the residual index was calculated using the formula proposed by Gerdtham et al1111 Gerdtham UG, Johannesson M, Gunnarsson B, Marcusson M, Henriksson F. The effect of changes in treatment patterns on drug expenditure. Pharmacoeconomics. 1998;13(1 Pt 2):127-34. https://doi.org/10.2165/00019053-199813010-00012
https://doi.org/10.2165/00019053-1998130...
, where: IR=IG/(IP.IQ).

RESULTS

Between 2010 and 2019, the MS acquired 83 different drugs that were or are part of CEAF's 1A group. Of this total, 20 drugs (24.1%) do not have a DDD established by the WHO and totaled R$ 3.77 billion in 2019 values in the period spent. The other drugs (n = 63; 75.9%) have an established DDD and compose the pharmaceuticals list analyzed in this study, totaling expenditure of R$ 31.31 billion. Figure 1 shows the annual expenditure of the MS in this list, according to the main therapeutic subgroups in terms of spending.

Figure 1
Expenditure (in millions of R$ in 2019) of the Brazilian Ministry of Health on pharmaceuticals of the CEAF's 1A groupa by therapeutic subgroups (2010–2019).

Immunosuppressants constitute the subgroup with the highest expenditure until 2018. In 2019, the expenses of this subgroup lose the first position for products that integrate other therapeutic subgroups, meaning a reduction of 47.6% compared with 2018. Also highlighted in this Figure is the growth in expenditure on immunosuppressants and antivirals for systemic use between 2014 and 2015, the successive reductions in expenses with these subgroups in 2016 and 2017 and the increase in expenses with other therapeutic subgroups in 2018 and 2019.

Table 1 shows the result of the overlapping analysis of pharmaceuticals purchased in two periods (overlapping medication list), comparing purchases made in one year in relation to the immediately preceding year. Of the 17 drugs purchased in 2011, 12 had been purchased in 2010, representing an overlap of 70.6% of drugs. In terms of expenditure, out of the total expenditure carried out in 2011 (R$ 3.96 billion), R$ 3.57 billion were allocated to the purchase of these 12 drugs, which is equivalent to 89.9% of that year's expenditure.

Table 1
Drugs purchased and pharmaceutical expenditure from CEAF'sa 1A group by the Brazilian Ministry of Health in the current year and in the previous year (2010–2019).

The year in which there was the greatest overlap in drug purchases was 2016 compared with 2015 (85.2%), whose expenditure on overlapping pharmaceuticals was 91.0% (R$ 2.83 billion out of R$ 3.11 billion). The smallest overlaps of drugs purchased compared with the previous year occurred in 2013 (45.0%) and 2018 (58.3%), with expenditures on overlapping pharmaceuticals of R$ 2.2 billion (64.4% of R$ 3.4 billion) and R$ 1.7 billion (68.6% of R$ 1.9 billion) respectively. As for expenditure on overlapping items, a significant reduction is still present (-57.7%) in the comparison between the amount allocated in 2011 (R$ 3.57 billion) and the amount allocated in 2019 (R$ 1.51 billion).

Table 2 shows the portion of the expenditure allocated to the purchase of overlapping pharmaceuticals and the one allocated to the purchase of non-overlapping ones. While expenditure on overlapping drugs showed a decreasing tendency, expenditure on non-overlapping drugs varied significantly, registering the highest value in 2015, when it reached the level of R$ 2.31 billion, representing 51.9% of the annual expenditure. The lowest expenses with non-overlapping pharmaceuticals occurred in 2016 (R$ 279.32 million) and in 2011 (R$ 399.29 million).

Table 2
Brazilian Ministry of Health's expenditure on pharmaceuticals of CEAF'sa 1A group, according to a list of overlapping pharmaceuticals between the current year and the previous year, and a list of non-overlapping pharmaceuticals (2010–2019).

The annual variation of the pharmaceuticals expenditure's main drivers in CEAF's 1A group is shown in Figure 2. As shown, expenditure was reduced compared with the previous year in 2012 (-31.1%), 2014 (-1.4%), 2016 (-30.1%), 2017 (-27.7%) and 2019 (-20.5%), and increased in 2011 (27.4%), 2013 (25.3%), 2015 (32.1%) and 2018 (20.8%). The prices of overlapping pharmaceuticals decreased to a greater or lesser extent throughout the period. In turn, the quantity of these purchased medications varied. In 2011 and 2018, the main driver of the increase in annual expenditure was the quantity of overlapping items compared with the previous year, 55% and 34% respectively. In 2013 and 2015, the main driver was the residual, 33.2% and 57.9% respectively.

Figure 2
Annual variation (in relation to the immediately preceding year - %) of expenditure on pharmaceuticals of CEAF'sa 1A group and its drivers (2011–2019).

In the years that had a reduction in expenditure, the residual was the main driver of the reduction in 2012 (-19.6%) and 2019 (-11.9%), while prices had the greatest impact on the decrease in expenditure in 2014 (-12%). We highlight the reductions in the quantity of overlapping items in three consecutive years, 2015 (-11%), 2016 (-4%) and 2017 (-11%), and in 2019 (-4%). Over the past three years, the main drivers of expenditure, price, quantity and residual, have contributed to the decrease in expenses on pharmaceuticals, however, the reduction in quantity draws more attention.

In Table 3 it is possible to observe the contribution of drivers, price and quantity to the annual variation of expenditure in monetary terms. The decrease in the prices of overlapping items between 2010 and 2011 generated savings of R$ 942.75 million. However, the increase in the quantity purchased of these items generated an additional expense of R$ 1.48 billion, which caused the expenses on overlapping items to produce a balance of R$ 540.20 million. Expenditure on overlapping items between 2010 and 2011 was R$ 3.57 billion and expenditure on non-overlapping pharmaceuticals contributed R$ 399.29 million, totaling annual expenditure of R$ 3.96 billion in 2011.

Table 3
Expenditure decomposition of the Brazilian Ministry of Health on pharmaceuticals of CEAF'sa 1A group, for the variables price and quantity of overlapping pharmaceuticals (2011–2019). (In R$ of 2019)

Furthermore, it can be seen in Table 3 that, due to the reduction in prices, the biggest savings occurred in 2011 and 2016. Reduced values also occurred due to the decrease in quantities in 2015 (R$ 270.53 million), 2016 (R$ 139.08 million), 2017 (R$ 240.36 million) and 2019 (R$ 62.47 million).

DISCUSSION

The results show a great impact of some therapeutic subgroups on the expenditure of the MS. In almost every year, immunosuppressants were the biggest expense. In an analysis that considered all purchases of pharmaceuticals from this subgroup by federal bodies, it was identified that the main driver of the spending was the amount purchased in the period of 2010 to 20151919 Alves JC, Osorio-de-Castro CGS, Wettermark B, Luz TCB. Immunosuppressants in Brazil: underlying drivers of spending trends, 2010-2015. Expert Rev Pharmacoecon Outcomes Res. 2018;18(5):565-572. https://doi.org/10.1080/14737167.2018.1485098.
https://doi.org/10.1080/14737167.2018.14...
. The increase on the expenditure on immunosuppressants is related to the increase in organ and bone marrow transplants in Brazil2020 Associação Brasileira de Transplantes de Órgãos. Dimensionamento dos transplantes no Brasil e em cada estado (2012-2019). Registro Brasileiro de Transplantes. 2019;25(4):1-88 [cited 2020 Dec 14]. Available from: https://bit.ly/38hDrjJ
https://bit.ly/38hDrjJ...
, with the expansion of access and with a possible increase in autoimmune diseases2121 Lerner A, Jeremias P, Matthias T. The world incidence and prevalence of autoimmune diseases is increasing. Int J Celiac Dis. 2015;3(4):151-5. https://doi.org/10.12691/IJCD-3-4-8.
https://doi.org/10.12691/IJCD-3-4-8...
. The reduction in expenditure identified in 2019 compared with 2018, considering that the number of transplants has continued to grow in recent years2020 Associação Brasileira de Transplantes de Órgãos. Dimensionamento dos transplantes no Brasil e em cada estado (2012-2019). Registro Brasileiro de Transplantes. 2019;25(4):1-88 [cited 2020 Dec 14]. Available from: https://bit.ly/38hDrjJ
https://bit.ly/38hDrjJ...
, may be related to the reduction in the availability of these medicines for the treatment of autoimmune diseases and the reduction in the prices of these products in general.

It is noteworthy the growth of expenditure on antivirals for systemic use used in the treatment of hepatitis B and C between 2014 and 2016 and its reduction as of 2017. During this period, there were changes in the pattern of treatment for hepatitis C. In 2015, three medications were incorporated: sofosbuvir, daclatasvir and simeprevir2222 Ministério da Saúde (BR), Comissão Nacional de Incorporação de Tecnologia no SUS. Simeprevir, sofosbuvir e daclatasvir no tratamento da hepatite crônica tipo C e coinfecções. Brasília, DF: Conitec; 2015 [cited Aug 29]. (Relatório de Recomendação; n° 30). Available from: https://bit.ly/2RX62GN
https://bit.ly/2RX62GN...
. Data from 2016 shows that there was a patent granted for simeprevir and that, although the other two drugs were not protected by patents, they were exclusively marketed in Brazil by transnational pharmaceutical companies2323 Chaves GC, Vieira MCF, Costa RDF, Vianna MNS. Medicamentos em situação de exclusividade financiados pelo Ministério da Saúde: análise da situação patentária e das compras públicas. Rio de Janeiro: Fiocruz, ENSP; 2018. [cited 2020 Aug 29]. Available from: https://bit.ly/3j6HDqc.
https://bit.ly/3j6HDqc...
. The exclusivity of supply in both cases usually leads to the offer of products at high prices. Also in 2016, the National Commission for Technology Incorporation at SUS (Conitec) recommended the exclusion of the medications telaprevir and boceprevir2424 Ministério da Saúde (BR), Comissão Nacional de Incorporação de Tecnologias no SUS -Conitec. Inibidores de protease (telaprevir e boceprevir) para o tratamento da hepatite crônica C. Brasília, DF; 2016 [cited 2020 Aug 29]. (Relatório de Recomendação; n° 222). Available from: https://bit.ly/2D4HJiy.
https://bit.ly/2D4HJiy...
. Furthermore, several antivirals used in the treatment of hepatitis C were objects of Partnerships for Productive Development and this may have contributed to the reduction of product prices over time2323 Chaves GC, Vieira MCF, Costa RDF, Vianna MNS. Medicamentos em situação de exclusividade financiados pelo Ministério da Saúde: análise da situação patentária e das compras públicas. Rio de Janeiro: Fiocruz, ENSP; 2018. [cited 2020 Aug 29]. Available from: https://bit.ly/3j6HDqc.
https://bit.ly/3j6HDqc...
. These events help to explain the observed movement of expenditure in this therapeutic subgroup.

As for the number of drugs, there was an expansion of the list acquired centrally by the MS, as shown in Table 1. Two situations justify this increase. The first is the agreement between SUS managers so that the federal government assumes the acquisition of pharmaceuticals already incorporated into the system44 Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Assistência Farmacêutica e Insumos Estratégicos. Componente Especializado da Assistência Farmacêutica: inovação para a garantia do acesso a medicamentos no SUS. Brasília, DF; 2014 [cited 2020 Aug 20]. Available from: https://bit.ly/31wLPZ0.
https://bit.ly/31wLPZ0...
. The second situation is the incorporation of medicines, which increased with the institution of Conitec in 20112525 Caetano R, Silva RM, Pedro EM, Oliveira IAG, Biz AN, Santana P. Incorporação de novos medicamentos pela Comissão Nacional de Incorporação de Tecnologias do SUS, 2012 a junho de 2016. Cienc Saude Coletiva. 2017;22(8):2513-25. https://doi.org/10.1590/1413-81232017228.02002017.
https://doi.org/10.1590/1413-81232017228...
and which have already entered SUS under the purchase responsibility by the MS2626 Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Assistência Farmacêutica e Insumos Estratégicos. Pactuação da responsabilidade de financiamento de medicamentos incorporados e transferência entre grupos no elenco do CEAF [apresentação]. Brasília, DF: Departamento de Assistência Farmacêutica e Insumos Estratégicos; 2019 [cited 2020 Aug 20]. Available from: https://bit.ly/3hAXblK
https://bit.ly/3hAXblK...
. A joint analysis of data from the Ambulatory Care Information System (SIA) and CEAF's pharmaceuticals lists reveals that between 2012 and 2018 the balance of incorporations and disembodiments in 1A group was 17 drugs and that centralized purchase in the MS increased by 26 drugs (from 30 to 56)2727 Conselho de Monitoramento e Avaliação de Políticas Públicas (BR). Relatório de avaliação: Componente Especializado da Assistência Farmacêutica (CEAF). Brasília, DF; 2020. [cited 2021 Jun 15]. Available from: https://www.gov.br/economia/pt-br/acesso-a-informacao/participacao-social/conselhos-e-orgaos-colegiados/cmap/politicas/2019/gastos-diretos/nota-imprensa-ceaf
https://www.gov.br/economia/pt-br/acesso...
.

It is also interesting to note in Table 1 the percentage of overlapping of the purchased drugs’ list between two consecutive years. As in no year there was an overlap of 100% and the number of drugs purchased increased in most years, these facts indicate centralization, incorporation and purchase of an item that was already under the responsibility of the MS that was not purchased in the previous year. In addition, as drug overlap occurs in a smaller number in the current year compared with the total of drugs purchased in the previous year, evidence that purchase rarely occurs annually for several drugs exists, as it is unlikely that most of them are no longer purchased for having been excluded from SUS2828 Caetano R, Silva RM, Steffen RE, Biz NA, Pedro EM, Oliveira IAG et al. Desincorporação de tecnologias pela comissão nacional de incorporação de tecnologias, 2012 a junho/2016: um processo ainda incipiente no âmbito do SUS. In: Anais do 8. Congresso Brasileiro de Ciências Sociais e Humanas em Saúde, 2019; João Pessoa, Brasil. João Pessoa, PB: ABRASCO; 2019 [cited 2020 Aug 29]. Available from: https://bit.ly/3gF5tIx.
https://bit.ly/3gF5tIx...
and for the occurrence of drug transfer from 1A group to 1B group2626 Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Assistência Farmacêutica e Insumos Estratégicos. Pactuação da responsabilidade de financiamento de medicamentos incorporados e transferência entre grupos no elenco do CEAF [apresentação]. Brasília, DF: Departamento de Assistência Farmacêutica e Insumos Estratégicos; 2019 [cited 2020 Aug 20]. Available from: https://bit.ly/3hAXblK
https://bit.ly/3hAXblK...
. For example, in 2019, 25 drugs were purchased that were also purchased in 2018. But the total of drugs purchased in 2018 was 36, so 11 drugs purchased in 2018 were not purchased in 2019.

Expenditure on non-overlapping drugs between consecutive years was particularly high in 2015 (R$ 2.3 billion), as shown in Table 2. This fact is associated with decisions to centralize the purchase and the incorporation of medicines between 2014 and 2015. After the incorporation decision, SUS has up to 180 days to make the pharmaceuticals available in its pharmacies2929 Brasil. Lei N° 12.401, de 28 de abril de 2011. Altera a Lei N° 8.080, de 19 de setembro de 1990, para dispor sobre a assistência terapêutica e a incorporação de tecnologia em saúde no âmbito do Sistema Único de Saúde – SUS. Brasília, DF; 2011 [cited 2020 Aug 29]. Available from: http://twixar.me/JzQn.
http://twixar.me/JzQn...
. Another element that stands out in this table is the reduction in expenditure on the group of overlapping pharmaceuticals from 2016 and on non-overlapping pharmaceuticals in 2016 compared with 2015. In the first group, the variation of expenses between 2016 and 2019 was -46.8% and, in the second group, -71.7% between 2015 and 2019. Obviously, the medicines list in the second group differs each year and the centralization or incorporation of more or less expensive products can influence expenditure. However, it cannot be ruled out that the reduction is the result of budgetary restrictions, aggravated by the approval of the Expenditure Ceiling Amendment in 2016 (EC 95). Between 2016 and 2017, the expenses of the MS with CEAF decreased by 21.7%, from R$ 6.9 billion to R$ 5.4 billion at 2017 prices77 Vieira FS. Desafios do Estado quanto à incorporação de medicamentos no Sistema Único de Saúde. Brasília, DF: Ipea; 2019 [cited 2020 Aug 29]. (Texto para Discussão; n. 2500). Available from: https://bit.ly/34KZmzm.
https://bit.ly/34KZmzm...
.

More worrying is the reduction in the first group. If between 2010 and 2019 there was an increase in the drugs purchased by the MS, either through centralization or incorporation, an increase in expenditure was to be expected, unless the prices of the products significantly reduced. Furthermore, if the quantity of daily treatments per therapeutic subgroup was constant, there would be an indication that the new medications replaced the older ones. In fact, prices decreased in all the years observed, as shown in Figure 2, because of increasing the purchasing power of the MS due to its capacity to negotiate with exclusive suppliers and the scale of acquisition in the bids. However, the quantity of daily treatments made available also reduced from 2015 to 2017 and in 2019 compared with the previous year. Table 3 makes the effect of the decrease in quantity on expenditure clear in these years.

In summary, MS expenditure on the purchase of CEAF's pharmaceuticals that have an established DDD fluctuated in the period from 2010 to 2019, with a significant increase in the middle of that decade. However, it registered a decrease of 30.4% in the comparison between 2019 in relation to 2010, despite the purchase's centralization and the medicines’ incorporation having supplanted the exclusion or the transfer of responsibility for the purchase to the SES2727 Conselho de Monitoramento e Avaliação de Políticas Públicas (BR). Relatório de avaliação: Componente Especializado da Assistência Farmacêutica (CEAF). Brasília, DF; 2020. [cited 2021 Jun 15]. Available from: https://www.gov.br/economia/pt-br/acesso-a-informacao/participacao-social/conselhos-e-orgaos-colegiados/cmap/politicas/2019/gastos-diretos/nota-imprensa-ceaf
https://www.gov.br/economia/pt-br/acesso...
. The reduction in the prices of daily treatments with overlapping drugs for two consecutive years contributed to this reduction throughout the period. Nevertheless, there was also a reduction in the purchase of daily treatments in recent years, with a probable impairment of availability in SUS for those who had reduced the quantity, considering the reports of lack of CEAF's pharmaceuticals under the responsibility of the MS in SUS3030 Conselho Nacional de Secretários de Saúde. Ofício Conass N° 138. Regularização de entregas de medicamentos referentes à Assistência Farmacêutica (Grupo 1A do CEAF). Brasília, DF: Conass; 2019 [cited 2020 Aug 29]. Available from: https://bit.ly/34O0D8K.
https://bit.ly/34O0D8K...
,3131 Ministério da Saúde (BR), Conselho Nacional de Saúde. Falta de medicamentos no SUS é tema discutido em reunião ordinária do CNS. Brasília, DF: CNS; 2019 [cited 2020 Aug 20]. Available from: https://bit.ly/3fBVAKv.
https://bit.ly/3fBVAKv...
. The increase in residual in two years of the analyzed series was the main driver of the increase in expenditure in those years, which is mainly due to the centralization of purchase and incorporation of medications.

This study has, of course, some limitations. The first is that the methodology used makes it impossible to analyze pharmaceuticals that do not have an established DDD and, therefore, 10.8% of the expenditure on CEAF's 1A group was not analyzed. The second is that, since the database used only includes public procurement data, only the effects of the main drivers on expenditure were estimated. With the use of complementary data, for example, from the Authorization for High-Complexity Procedures (APACs) and from medicine registrations, it is possible to decompose the main indexes into other indexes, measuring the contribution of drivers such as the purchase of generics, volume and extension of prescriptions, among others, that impact the main drivers22 Canada. Patented Medicine Prices Review Board. The drivers of prescription drug expenditures: a methodological report. Ottawa (CA): PMPRB; 2013 [cited 2020 Aug 29]. Available from: https://bit.ly/3jxpLFN.
https://bit.ly/3jxpLFN...
,3232 Morgan SG. Drug spending in Canada: recent trends and causes. Med Care. 2004;42(7):635-42. https://doi.org/10.1097/01.mlr.0000129494.36245.4b
https://doi.org/10.1097/01.mlr.000012949...
. Lastly, the third limitation involves information on the quantity purchased and, consequently, on the total value, as, in the methodology applied in this study, the cost of each medication is calculated from the multiplication of the unit price and the quantity negotiated or expected in the purchase, contained in the SIASG. The annual expenditure is the sum of the expenses with pharmaceuticals purchased in the year. Although the Brazilian Federal Government Purchasing Panel contains information on the budget-financial execution of the MS by contract, information on the expense committed, settled and paid per medication item with the respective quantity was not disclosed. Therefore, we worked with the amount foreseen in the purchase.

However, despite these limitations, the study makes a significant contribution to the understanding of the main factors that impact most of the MS's expenditure in the CEAF's 1A group. The analysis of the drivers of pharmaceutical expenditure proves to be a useful tool for the management of pharmaceutical care, as it produces information that enables a broader understanding of the behavior of variables that impact expenditure and can guide the adoption of measures aimed at guaranteeing the population's access to medicines and the rational use of financial resources.

REFERENCES

  • 1
    Belloni A, Morgan D, Paris V. Pharmaceutical expenditure and policies: past trends and future challenges. Paris: OECD; 2016. (OECD Health Working Papers; n° 87). https://doi.org/10.1787/5jm0q1f4cdq7-en
    » https://doi.org/10.1787/5jm0q1f4cdq7-en
  • 2
    Canada. Patented Medicine Prices Review Board. The drivers of prescription drug expenditures: a methodological report. Ottawa (CA): PMPRB; 2013 [cited 2020 Aug 29]. Available from: https://bit.ly/3jxpLFN
    » https://bit.ly/3jxpLFN
  • 3
    Vieira FS. Evolução do gasto com medicamentos do Sistema Único de Saúde no período de 2010 a 2016. Rio de Janeiro: Ipea; 2018 [cited 2020 Aug 29]. (Texto para Discussão; n° 2356). Available from: https://bit.ly/2YLGxIw
    » https://bit.ly/2YLGxIw
  • 4
    Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Assistência Farmacêutica e Insumos Estratégicos. Componente Especializado da Assistência Farmacêutica: inovação para a garantia do acesso a medicamentos no SUS. Brasília, DF; 2014 [cited 2020 Aug 20]. Available from: https://bit.ly/31wLPZ0
    » https://bit.ly/31wLPZ0
  • 5
    Ministério da Saúde (BR). Portaria de Consolidação n° 2, de 28 de setembro de 2017. Consolidação das normas sobre as políticas nacionais de saúde do Sistema Único de Saúde. Anexo XXVIII: Título IV. Dispõe sobre as regras de financiamento e execução do Componente Especializado da Assistência Farmacêutica no âmbito do Sistema Único de Saúde. Brasília, DF; 2017 [cited 2020 Aug 29]. Available from: https://bit.ly/2SzdF6x
    » https://bit.ly/2SzdF6x
  • 6
    Instituto Brasileiro de Geografia e Estatística. Conta-Satélite de Saúde Brasil: 2010-2017. Rio de Janeiro: IBGE; 2019 [cited 2020 Aug 29]. (Contas Nacionais; n° 71). Available from: https://bit.ly/3c2DWyi
    » https://bit.ly/3c2DWyi
  • 7
    Vieira FS. Desafios do Estado quanto à incorporação de medicamentos no Sistema Único de Saúde. Brasília, DF: Ipea; 2019 [cited 2020 Aug 29]. (Texto para Discussão; n. 2500). Available from: https://bit.ly/34KZmzm
    » https://bit.ly/34KZmzm
  • 8
    Piola SF, Paiva AB, Sá EB, Servo LMS. Financiamento público da saúde: uma história à procura de rumo. Rio de Janeiro: Ipea; 2013 [cited 2020 Dec 14]. (Texto para Discussão; n° 1846). Available from: https://bit.ly/2UzozqE .
    » https://bit.ly/2UzozqE
  • 9
    Boing AC, Bertoldi AD, Posenato LG, Peres KG. Influência dos gastos em saúde no empobrecimento de domicílios no Brasil. Rev Saude Publica. 2014;48(5):797-807. https://doi.org/10.1590/S0034-8910.2014048005113
    » https://doi.org/10.1590/S0034-8910.2014048005113
  • 10
    Boer P, Rodrigues JFD. Decomposition analysis: when to use which method? Econ Syst Res. 2019;32(1):1-28. https://doi.org/10.1080/09535314.2019.1652571
    » https://doi.org/10.1080/09535314.2019.1652571
  • 11
    Gerdtham UG, Johannesson M, Gunnarsson B, Marcusson M, Henriksson F. The effect of changes in treatment patterns on drug expenditure. Pharmacoeconomics. 1998;13(1 Pt 2):127-34. https://doi.org/10.2165/00019053-199813010-00012
    » https://doi.org/10.2165/00019053-199813010-00012
  • 12
    Morgan SG. Quantifying components of drug expenditure inflation: the British Columbia seniors’ drug benefit plan. Health Serv Res. 2002;37(5):1243-66. https://doi.org/10.1111%2F1475-6773.01058
    » https://doi.org/10.1111%2F1475-6773.01058
  • 13
    Mousnad MA, Shafie AA, Ibrahim MI. Systematic review of factors affecting pharmaceutical expenditures. Health Policy. 2014;116(2-3):137-46. https://doi.org/10.1016/j.healthpol.2014.03.010
    » https://doi.org/10.1016/j.healthpol.2014.03.010
  • 14
    WHO Collaborating Centre for Drug Statistics Methodology. The Anatomical Therapeutic Chemical Classification System with Defined Daily Doses (ATC/DDD). Oslo (NO); 2003 [cited 2020 Aug 29]. Available from: https://bit.ly/3iI4eMT
    » https://bit.ly/3iI4eMT
  • 15
    Banco Central do Brasil. Índices de preços no Brasil. Brasília, DF; 2016 [cited 2020 Aug 29]. (Série Perguntas Mais Frequentes). Available from: https://bit.ly/2CP3wL4
    » https://bit.ly/2CP3wL4
  • 16
    White G. IndexNumR: a package for index number calculation. Wien (AT): CRAN - The Comprehensive R Archive Network; 2021 [cited 2021 Jun 15]. Available from: https://bit.ly/3jBQ3qL
    » https://bit.ly/3jBQ3qL
  • 17
    White G. Package ‘IndexNumR’: Index Number Calculation. Wien (AT): CRAN - The Comprehensive R Archive Network; 2021. [cited 2021 Jun 15]. Available from: https://bit.ly/2XH5CUA
    » https://bit.ly/2XH5CUA
  • 18
    Vieira FS. Indutores do gasto direto do Ministério da Saúde em medicamentos (2010-2019). Brasília, DF: Ipea; 2021 [cited 2021 Jun 15]. (Texto para Discussão; n° 2634). Available from: https://bit.ly/3iIZBlM
    » https://bit.ly/3iIZBlM
  • 19
    Alves JC, Osorio-de-Castro CGS, Wettermark B, Luz TCB. Immunosuppressants in Brazil: underlying drivers of spending trends, 2010-2015. Expert Rev Pharmacoecon Outcomes Res. 2018;18(5):565-572. https://doi.org/10.1080/14737167.2018.1485098
    » https://doi.org/10.1080/14737167.2018.1485098
  • 20
    Associação Brasileira de Transplantes de Órgãos. Dimensionamento dos transplantes no Brasil e em cada estado (2012-2019). Registro Brasileiro de Transplantes. 2019;25(4):1-88 [cited 2020 Dec 14]. Available from: https://bit.ly/38hDrjJ
    » https://bit.ly/38hDrjJ
  • 21
    Lerner A, Jeremias P, Matthias T. The world incidence and prevalence of autoimmune diseases is increasing. Int J Celiac Dis. 2015;3(4):151-5. https://doi.org/10.12691/IJCD-3-4-8
    » https://doi.org/10.12691/IJCD-3-4-8
  • 22
    Ministério da Saúde (BR), Comissão Nacional de Incorporação de Tecnologia no SUS. Simeprevir, sofosbuvir e daclatasvir no tratamento da hepatite crônica tipo C e coinfecções. Brasília, DF: Conitec; 2015 [cited Aug 29]. (Relatório de Recomendação; n° 30). Available from: https://bit.ly/2RX62GN
    » https://bit.ly/2RX62GN
  • 23
    Chaves GC, Vieira MCF, Costa RDF, Vianna MNS. Medicamentos em situação de exclusividade financiados pelo Ministério da Saúde: análise da situação patentária e das compras públicas. Rio de Janeiro: Fiocruz, ENSP; 2018. [cited 2020 Aug 29]. Available from: https://bit.ly/3j6HDqc
    » https://bit.ly/3j6HDqc
  • 24
    Ministério da Saúde (BR), Comissão Nacional de Incorporação de Tecnologias no SUS -Conitec. Inibidores de protease (telaprevir e boceprevir) para o tratamento da hepatite crônica C. Brasília, DF; 2016 [cited 2020 Aug 29]. (Relatório de Recomendação; n° 222). Available from: https://bit.ly/2D4HJiy
    » https://bit.ly/2D4HJiy
  • 25
    Caetano R, Silva RM, Pedro EM, Oliveira IAG, Biz AN, Santana P. Incorporação de novos medicamentos pela Comissão Nacional de Incorporação de Tecnologias do SUS, 2012 a junho de 2016. Cienc Saude Coletiva. 2017;22(8):2513-25. https://doi.org/10.1590/1413-81232017228.02002017
    » https://doi.org/10.1590/1413-81232017228.02002017
  • 26
    Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Assistência Farmacêutica e Insumos Estratégicos. Pactuação da responsabilidade de financiamento de medicamentos incorporados e transferência entre grupos no elenco do CEAF [apresentação]. Brasília, DF: Departamento de Assistência Farmacêutica e Insumos Estratégicos; 2019 [cited 2020 Aug 20]. Available from: https://bit.ly/3hAXblK
    » https://bit.ly/3hAXblK
  • 27
    Conselho de Monitoramento e Avaliação de Políticas Públicas (BR). Relatório de avaliação: Componente Especializado da Assistência Farmacêutica (CEAF). Brasília, DF; 2020. [cited 2021 Jun 15]. Available from: https://www.gov.br/economia/pt-br/acesso-a-informacao/participacao-social/conselhos-e-orgaos-colegiados/cmap/politicas/2019/gastos-diretos/nota-imprensa-ceaf
    » https://www.gov.br/economia/pt-br/acesso-a-informacao/participacao-social/conselhos-e-orgaos-colegiados/cmap/politicas/2019/gastos-diretos/nota-imprensa-ceaf
  • 28
    Caetano R, Silva RM, Steffen RE, Biz NA, Pedro EM, Oliveira IAG et al. Desincorporação de tecnologias pela comissão nacional de incorporação de tecnologias, 2012 a junho/2016: um processo ainda incipiente no âmbito do SUS. In: Anais do 8. Congresso Brasileiro de Ciências Sociais e Humanas em Saúde, 2019; João Pessoa, Brasil. João Pessoa, PB: ABRASCO; 2019 [cited 2020 Aug 29]. Available from: https://bit.ly/3gF5tIx
    » https://bit.ly/3gF5tIx
  • 29
    Brasil. Lei N° 12.401, de 28 de abril de 2011. Altera a Lei N° 8.080, de 19 de setembro de 1990, para dispor sobre a assistência terapêutica e a incorporação de tecnologia em saúde no âmbito do Sistema Único de Saúde – SUS. Brasília, DF; 2011 [cited 2020 Aug 29]. Available from: http://twixar.me/JzQn
    » http://twixar.me/JzQn
  • 30
    Conselho Nacional de Secretários de Saúde. Ofício Conass N° 138. Regularização de entregas de medicamentos referentes à Assistência Farmacêutica (Grupo 1A do CEAF). Brasília, DF: Conass; 2019 [cited 2020 Aug 29]. Available from: https://bit.ly/34O0D8K
    » https://bit.ly/34O0D8K
  • 31
    Ministério da Saúde (BR), Conselho Nacional de Saúde. Falta de medicamentos no SUS é tema discutido em reunião ordinária do CNS. Brasília, DF: CNS; 2019 [cited 2020 Aug 20]. Available from: https://bit.ly/3fBVAKv
    » https://bit.ly/3fBVAKv
  • 32
    Morgan SG. Drug spending in Canada: recent trends and causes. Med Care. 2004;42(7):635-42. https://doi.org/10.1097/01.mlr.0000129494.36245.4b
    » https://doi.org/10.1097/01.mlr.0000129494.36245.4b

Publication Dates

  • Publication in this collection
    08 Dec 2021
  • Date of issue
    2021

History

  • Received
    29 Aug 2020
  • Accepted
    16 Dec 2020
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br