Infrastructure and work process in primary health care: PMAQ in Ceará

Anya Pimentel Gomes Fernandes Vieira-Meyer Ana Patrícia Pereira Morais José Maria Ximenes Guimarães Isabella Lima Barbosa Campelo Neiva Francenely Cunha Vieira Maria de Fátima Antero Sousa Machado Paula Sacha Frota Nogueira Sharmênia de Araújo Soares Nuto Roberto Wagner Júnior Freire de Freitas About the authors

ABSTRACT

OBJECTIVE

To analyze the quality of the infrastructure and work process of the Family Health Strategy in the municipalities of Ceará between 2012 and 2014.

METHODS

Cross-sectional study, using secondary data from the external evaluation of the 1st (2012) and 2nd (2014) cycle of the National Program for Improvement of Access and Quality of Primary Care in Ceará. A total of 20 composite indicators were used to verify the quality of infrastructure and work process.

RESULTS

Data from 183 (99.4%) of the 184 municipalities of Ceará were collected in both cycles. A total of 1,441 teams were evaluated for the infrastructure and 800 for the work process. Among the 20 composite indicators evaluated, 18 presented an improvement, but in a non-homogeneous way, ranging between 0.0 and 413.5%. We observed that the lower the initial value of the indicator, the greater the variation in quality between 2012 and 2014. The indicators of infrastructure and work process were influenced by the regional health system and population size of the municipality, being more evident the influence on the variables of the work process.

CONCLUSIONS

We identified that quality improvements related to infrastructure and work process occurred in the period of implementation of the program in the state of Ceará in an equitable manner, being influenced by population size and regional health system, showing the influence of the context in the implementation of public policies of this nature.

Health Care Quality, Access, and Evaluation; Family Health Strategy; Health Infrastructure; Primary Health Care; Outcome and Process Assessment, Health Care

INTRODUCTION

In Brazil, in 1988, the Unified Health System (SUS) was created11. Brasil. Constituição (1988). Constituição da República Federativa do Brasil. Brasília, DF: Senado Federal; 1988., guided by principles such as universality, equity and integrality, which implies the provision of care within the scope of care networks. Therefore, SUS adopts Primary Health Care (PHC) as central in the structuring of the health system, acting as the first contact of the user and the orderly of care network, according to recommendations of the Declaration of Alma-Ata22. Giovanella L, Mendonça MHM. Atenção primária saúde. In: Giovanella L, Escorel S, Lobato LVC, Noronha JC, Carvalho AI, organizadores. Políticas e sistema de saude no Brasil. 2. ed. Rio de Janeiro: FIOCRUZ; 2012. p. 493-546..

In this context, PHC was instituted based on the concept of comprehensive health care, but with gradual implementation, initially in the form of focused programs aimed to at-risk populations, such as the Programa de Agentes Comunitários de Saúde (PACS – Program of Community Health Agents), created in 1991, and the Family Health Program (FHP), established in 1994, which had greater coverage expansion in municipalities with a low human development index (HDI)33. Chaves LA, Jorge AO, Cherchiglia ML, Reis IA, Santos MAC, Santos AF, et al. Integração da atenção básica à rede assistencial: análise de componentes da avaliação externa do PMAQ-AB. Cad Saude Publica. 2018;34(2):e00201515. https://doi.org/10.1590/0102-311x00201515
https://doi.org/10.1590/0102-311x0020151...
,44. Conill EM. Ensaio histórico-conceitual sobre a Atenção Primária à Saúde: desafios para a organização de serviços básicos e da Estratégia Saúde da Família em centros urbanos no Brasil. Cad Saude Publica. 2008;24 Supl 1:s7-16. https://doi.org/10.1590/S0102-311X2008001300002
https://doi.org/10.1590/S0102-311X200800...
. Therefore, contradictions are shown in the organization of PHC in the early 1990s, with discussions on its traits of selective primary care, highlighting the challenges to advance towards the structuring of comprehensive primary care, necessary for the construction of an integrated health system22. Giovanella L, Mendonça MHM. Atenção primária saúde. In: Giovanella L, Escorel S, Lobato LVC, Noronha JC, Carvalho AI, organizadores. Políticas e sistema de saude no Brasil. 2. ed. Rio de Janeiro: FIOCRUZ; 2012. p. 493-546..

With the normative advance that regulates the organization of SUS, it is evident that FHP was established as a model of health care in 1996, with a redefinition of the funding logic by the implementation of the primary care base (PCB). Later, the program was defined as the Family Health Strategy (FHS) in 2006, with the attribution of acting as a reorganizer of PHC, to promote the integration of different levels of health care, materializing, at the local level, principles and guidelines of the SUS55. Andrade OM, Barreto ICHC. SUS passo a passo: história, regulamentação, financiamento, políticas nacionais. 2. ed. rev. ampl. São Paulo: Hucitec; 2007..

The expansion of the FHS throughout the country, over the last 20 years, has been favoring the universalization of primary care and adding basic principles of a comprehensive PHC66. Arantes LJ, Shimizu HE, Merchán-Hamann E. Contribuições e desafios da Estratégia Saúde da Família na Atenção Primária à Saúde no Brasil: revisão da literatura. Cienc Saude Coletiva. 2016;21(5):1499-510. https://doi.org/10.1590/1413-81232015215.19602015
https://doi.org/10.1590/1413-81232015215...
. In 2014, according to data from the Brazilian Ministry of Health, 5,463 (98%) Brazilian municipalities had Family Health Strategy teams (FHST) in their network, covering 60% of the population. In the same period, 184 municipalities of Ceará had 2,303 FHST implemented, with 77.7% of population coverage77. Ministério da Saúde (BR), Sala de Apoio à Gestão Estratégica. Equipes de Saúde da Família. Brasilia, DF; 2019 [cited 2019 May 20]. Available from: http://sage.saude.gov.br/#
http://sage.saude.gov.br/#...
.

This increase in coverage occurred heterogeneously in the different regions of Brazil88. Neves RG, Flores TR, Duro SMS, Nunes BP, Tomasi E. Tendência temporal da cobertura da Estratégia Saúde da Família no Brasil, regiões e Unidades da Federação, 2006-2016. Epidemiol Serv Saude. 2018;27(3):e2017170. https://doi.org/10.5123/s1679-49742018000300008
https://doi.org/10.5123/s1679-4974201800...
. Thus, challenges are identified to the consolidation of FHS related to the financing, planning and organization of care practices, work management and continuing education of professionals, the coordination of care by the difficulty of ensuring access to other levels of care and construction of the integrality of care, which may compromise the quality of services offered66. Arantes LJ, Shimizu HE, Merchán-Hamann E. Contribuições e desafios da Estratégia Saúde da Família na Atenção Primária à Saúde no Brasil: revisão da literatura. Cienc Saude Coletiva. 2016;21(5):1499-510. https://doi.org/10.1590/1413-81232015215.19602015
https://doi.org/10.1590/1413-81232015215...
.

Then federal financial and investments aimed to qualify the primary care network are identified, by the guarantee of access and quality of care offered88. Neves RG, Flores TR, Duro SMS, Nunes BP, Tomasi E. Tendência temporal da cobertura da Estratégia Saúde da Família no Brasil, regiões e Unidades da Federação, 2006-2016. Epidemiol Serv Saude. 2018;27(3):e2017170. https://doi.org/10.5123/s1679-49742018000300008
https://doi.org/10.5123/s1679-4974201800...
, such as the Progama Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica (PMAQ-AB—National Program for Improvement of Access and Quality of Primary Care), established in 2011 by the Brazilian Ministry of Health, being operationalized based on the following phases: adherence, contractualization, development (stage where external evaluation occurs) and recontractualization1010. Ministério da Saúde (BR). Portaria Nº 1.654, de 19 de julho de 2011. Institui, no âmbito do Sistema Único de Saúde, o Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica (PMAQ-AB) e o Incentivo Financeiro do PMAQ-AB, denominado Componente de Qualidade do Piso de Atenção Básica Variável – PAB Variável. Brasília (DF); 2011 [cited 2019 20]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt1654_19_07_2011.html
http://bvsms.saude.gov.br/bvs/saudelegis...
. PMAQ-AB also represents an institutionalization strategy for quality assessment in PHC, whose evaluation model is based on the triad structure, process and results, proposed by Donabedian1111. Donabedian A. The quality of care: how can it be assessed? JAMA. 1988;260(12):1743-8. https://doi.org/10.1001/jama.1988.03410120089033
https://doi.org/10.1001/jama.1988.034101...
.

The option to work with the evaluation of health care in PHC places the researcher in a challenging position, as it requires the choice of policies, actions and territories with various references to Brazil that show efforts and events in the organization of the offer and quality of health services. PMAQ-AB has provided an opportunity for reflections and daily practices of evaluation and self-assessment, which induce improvement planning by teams, thus committing themselves to changes in the infrastructure and work process of the FHS1010. Ministério da Saúde (BR). Portaria Nº 1.654, de 19 de julho de 2011. Institui, no âmbito do Sistema Único de Saúde, o Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica (PMAQ-AB) e o Incentivo Financeiro do PMAQ-AB, denominado Componente de Qualidade do Piso de Atenção Básica Variável – PAB Variável. Brasília (DF); 2011 [cited 2019 20]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt1654_19_07_2011.html
http://bvsms.saude.gov.br/bvs/saudelegis...
. However, the incorporation of evaluative practices in the daily life of the FHS is still incipient, as well as knowledge about the quality of these services, particularly in the state of Ceará, considered a cutting-edge in PHC actions in the country.

Thus, this study aims to analyze the quality of the FHS infrastructure and work process in the municipalities of Ceará between 2012 and 2014, investigating the existence of quality-mediating variables.

METHODS

Cross-sectional study using secondary data from the external evaluation of the 1st (2012) and 2nd (2014) cycle of PMAQ-AB referring to the state of Ceará, Brazil. Three instruments focusing on the FHS team are used for this evaluation: module I – referring to infrastructure, with variables observed directly in the health unit; module II – related to the work process, in which the questions are answered by a member of the FHS team (doctor, nurse or dentist); module III – with questions related to user satisfaction, covering their perception and satisfaction regarding access and use of FHS. In this study, only modules I and II (infrastructure and work process) were used. The questionnaires were composed of 450 questions related to infrastructure and 750 related to the work process.

Data collection was coordinated by a group of researchers from universities and research institutions responsible for the external evaluation of PMAQ-AB, who trained and monitored field interviewers and data collection supervisors, including state research coordinators.

In the first evaluation cycle, a total of 184 (100%) municipalities participated, including 911 teams (46.5% of FHST implemented by 2012). In the second cycle, 183 (99.4%) municipalities participated, including 1,711 teams (74.3% of FHST established by 2014). In 2012, more observations on structure than work process were observed, because in 2012 the Brazilian Ministry of Health was particularly interested in infrastructure; therefore, the module referring to this aspect was applied in all basic health units, even in those that did not adhere to the PMAQ-AB. Out of the 184 municipalities, data from 183 (99.4%) whose teams were evaluated in both cycles were used. A total of 1,441 teams were evaluated for the infrastructure and 800 for the work process. Since some FHST did not answer all the questions of modules I and II, the number of teams ranges according to the outcome and year of evaluation.

Index Creation

The indexes of this study were created based on the national database of the external evaluation of the PMAQ-AB, originally used to evaluate the FHS in Brazil. For this, similar variables included in the 2012 and 2014 cycles were identified. The items were organized into 20 groups (10 for infrastructure and 10 for the work process), based on FHS guidelines1212. Ministério da Saúde (BR). Portaria N° 2.488, de 21 de outubro de 2011. Aprova a Política Nacional de Atenção Básica, estabelecendo a revisão de diretrizes e normas para a organização da Atenção Básica, para a Estratégia Saúde da Família (ESF) e o Programa de Agentes Comunitários de Saúde (PACS). Brasília, DF; 2011 [cited 2019 May 20]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt2488_21_10_2011.html
http://bvsms.saude.gov.br/bvs/saudelegis...
and evaluation themes of the PMAQ-AB1010. Ministério da Saúde (BR). Portaria Nº 1.654, de 19 de julho de 2011. Institui, no âmbito do Sistema Único de Saúde, o Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica (PMAQ-AB) e o Incentivo Financeiro do PMAQ-AB, denominado Componente de Qualidade do Piso de Atenção Básica Variável – PAB Variável. Brasília (DF); 2011 [cited 2019 20]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt1654_19_07_2011.html
http://bvsms.saude.gov.br/bvs/saudelegis...
, excluding those with more than 5,000 missing observations per year of research. The application of a series of tests validated these structured groupings: pair correlation, Cronbach’s alpha and factor analysis. Additionally, each item was scaled from 0 to 1 (1 = most positive result) and the items within a group were estimated to form the composite index (CI). Moreover, the average of all CI in the general category created three general variables of composite index, two for infrastructure and one for the work process. Table 1 describes the CI created.

Table 1
List of variables that composed each composite index created based on the questions of the external evaluation of the National Program for Improvement of Access and Quality of Primary Care in 2012 and 2014.

Statistical Analysis

The level of evaluation is the FHS, but the unit of analysis is the municipality. Thus, the CI of the municipal level was created by the mean of all FHST scores in the municipality. Depending on the size of the municipality, the number of FHST ranged from less than 5 to 120 teams. Comparisons were made to verify whether all CI in both moments were statistically significant, using t-test, one way analysis of variance (ANOVA) and T2 Hotelling test. ANOVA and generalized estimated equation (GEE) were used to compare CI in different regions and sizes of municipalities.

Thus, the variation for each CI was created based on the municipality, being calculated as the result of 2014 CI value minus the 2012 CI value. These values were compared based on the region and population size of the municipality. The percentage of change between the 1st and 2nd cycle for each of the CI was also estimated.

Stratification Variables

Statistical analysis was repeated using two stratification variables: size of the municipality (population) and health region. The municipalities were categorized based on the number of inhabitants, considering the guidelines of the Brazilian Institute of Geography and Statistics (IBGE): level 1 (0 to 5,000), level 2 (5,001 to 10,000), level 3 (10,001 to 20,000), level 4 (20,001 to 50,000) level 5 (50,001 to 100,000), level 6 (100,001 to 500,000), and level 7 (above 500,001)1313. Instituto Brasileiro de Geografia e Estatística. Pesquisa de Informações Básicas Municipais: perfil dos Estados e Municípios 2014. Rio de Janeiro: IBGE; 2014 [cited 2019 18]. Available from: https://ww2.ibge.gov.br/home/estatistica/economia/perfilmunic/2014/default.shtm
https://ww2.ibge.gov.br/home/estatistica...
. However, for this study, levels 1 and 2 were grouped. This stratification was adopted to test the hypothesis that there are differences in quality improvement by population size, since the challenges and management capacity differ according to the size of the municipality.

The state of Ceará is divided into five health macro-regions: Fortaleza (44 municipalities), Sobral (54 municipalities), Cariri (45 municipalities), Sertão Central (20 municipalities) and Litoral Leste/Jaguaribe (21 municipalities). We considered as a hypothesis that quality improvements may differ in the regions of the state, due to the intrinsic characteristics of each one. In the process of health regionalization, the macro-regions of Fortaleza, Sobral and Cariri were the first created, considered the most developed centers, with specialized care network and tertiarian reference hospitals in their respective headquarters. The Sertão Central and Litoral Leste/Jaguaribe macro-regions were created in 2011 and 2014, respectively, due to the dismemberment of the Fortaleza macro-region1414. Secretaria de Estado da Saúde do Ceará. Plano Diretor de Regionalização das Ações e Serviços de Saúde – PDR do Estado do Ceará 2014. Fortaleza; 2014 [cited 2019 May 25]. Available from: https://www.saude.ce.gov.br/download/revisao-do-plano-diretor-de-regionalizacao-das-acoes-e-servicos-de-saude-pdr-do-estado-do-ceara-2014/
https://www.saude.ce.gov.br/download/rev...
.

RESULTS

Most of CI (18 out of 20) was significantly better in the second cycle than in the first (Table 2). Only two CI did not change significantly over time, one related to infrastructure (vaccine available in the basic health unit – PHCU), and the other related to the work process (exams).

Table 2
Comparison of the composite index variable in the years evaluated. Ceará, 2012 and 2014.

The percentage of improvement was not homogeneous in all CI investigated, ranging between 0.0 and 413.5% (Table 2). A negative relationship was observed between the percentage of change (between the two PMAQ-AB cycles) and the initial value (referring to 2012) of the variable, in which the lower the initial value of CI turned into the greater the variation in quality between 2012 and 2014. This was observed when all variables were analyzed together (r = -0.4843; p = 0.0192). When the infrastructure and work process variables were evaluated separately, only the set of work process variables demonstrated this statistically significant negative relationship (infrastructure: r = -0.4624 and p = 0.1785; work process: r = -0.7031 and p = 0.0233).

When studying the CI values for different regions and population size of the municipalities, we observed that, generally, the variables presented improvements in the mean quality of the municipalities in the period, affecting the quality of PHC results (Table 3 and Table 4).

Table 3
Comparison of the values of the variables of infrastructure and work process, according to the population size of the municipalities with external evaluation of the National Program for Improvement of Access and Quality of Primary Care. Ceará, 2012 and 2014.
Table 4
Comparison of the values of the infrastructure variables and work process, according to the health region in the external evaluation of the National Program for Improvement of Access and Quality of Primary Care. Ceará, 2012 and 2014.

When observing quality changes in the infrastructure, based on the size of the municipality, only the CI of diagnostic tests presented significantly different percentages of change between groups (p = 0.036), with a greater positive effect on quality improvement in municipalities with a population of 10,001 to 20,000 inhabitants and 50,001 to 100,000 inhabitants. These data show that municipality size may not influence the improvement of the quality of infrastructure variables during the period studied.

We found that few infrastructure CI were influenced by the health region of the municipality, with only three presenting statistically significant changes: unit identification (p = 0.002), medical equip (p=0.017) and medication (p = 0.045). However, although no statistically significant differences were found between health regions, we observed that the Sertão Central region showed a higher percentage of improvements in most of the infrastructure variables analyzed, namely: unit identification, facility access, services offered, informatic equip, medical equip, health attention equip, vaccine, diagnostic tests, medication and infrastructure quality and infrastructure equality 2 (Table 4).

When observing the CI variables related to the work process, the different population sizes of the municipality were significantly associated with the change in quality improvement in three CI evaluated, in relation to link to service (p = 0.001), exams (p = 0.037) and child attention (p = 0.036). Notably, although it is not always a statistically significant result, the variables health promotion, school health, planning, patient welcome, and work process quality presented greater percentage variation in municipalities from 50,001 to 100,000 inhabitants. Municipalities with a population above 500,000 inhabitants presented negative variation over the years in all CI of the work process, except for home visit (Table 3).

When observing the changes in the work process by region (Table 4 a significant variation was found among them in six CI studied: planning (p = 0.016), city support (p = 0.043), patient welcome (p = 0.001), health promotion (p = 0.023), school health (p = 0.001) and home visit (p = 0.042). The highest increase in CI occurred in the Sertão Central region, with greater positive variation between regions and in 9 of the 11 CI studied, while Litoral Leste/Jaguaribe and Cariri presented higher variations in CI. It is interesting to note that the CI values in 2012 for the Sertão Central region were, in general, the lowest among the different regions.

DISCUSSION

This is the first article evaluating, by composite indexes, the quality of FHS in the state of Ceará, in the dimensions of infrastructure and work process, using data from the external evaluation of the PMAQ-AB of the 1st and 2nd cycle (2012 and 2014). In general, a positive variation in the CI of infrastructure and work process was observed (significant change in 18 of the 20 CI evaluated), which indicates improvement in the quality of the FHS in the period studied. We also verified that this improvement occurred more intensely and in an inverse relationship between CI result in 2012 and the percentage of change occurred (difference in values between 2014 and 2012) – that is, the lower the value in 2012, the greater the improvement of the variable. This fact shows a desirable equitable improvement of CI in the period.

This performance reflects, to some extent, the induction performed by evaluation and monitoring policies, with increased investments and adequate use of resources to meet PHC demands88. Neves RG, Flores TR, Duro SMS, Nunes BP, Tomasi E. Tendência temporal da cobertura da Estratégia Saúde da Família no Brasil, regiões e Unidades da Federação, 2006-2016. Epidemiol Serv Saude. 2018;27(3):e2017170. https://doi.org/10.5123/s1679-49742018000300008
https://doi.org/10.5123/s1679-4974201800...
,1515. Facchini LA, Tomasi E, Dilélio AS. Qualidade da Atenção Primária à Saúde no Brasil: avanços, desafios e perspectivas. Saude Debate. 2018;42 Nº Espe1:208-23. https://doi.org/10.1590/0103-11042018s114
https://doi.org/10.1590/0103-11042018s11...
, as well as the program for requalification of the infrastructure of basic health units of the country (Requalifica UBS–Requalifies BHU)1616. Ministério da Saúde (BR). Portaria nº 340, de 4 de março de 2013. Redefine o Componente Construção do Programa de Requalificação de Unidades Básicas de Saúde (UBS). Brasilia, DF; 2013 [cited 2019 Jun 11]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt0340_04_03_2013.html
http://bvsms.saude.gov.br/bvs/saudelegis...
. A similar study conducted throughout Brazil also showed a fair improvement in the indicators analyzed, especially when evaluating the North and Northeast regions1717. Vieira-Meyer APGF, Machado MFAS, Gubert FA, Morais APP, Sampaio YP, Saintrain MVL, et al. Variation in primary health care services after implementation of quality improvement policy in Brazil. Fam Pract. 2020;37(1):69-80. https://doi.org/10.1093/fampra/cmz040
https://doi.org/10.1093/fampra/cmz040...
. Notably, unlike the nationwide study, which presented a more prominent inverse relationship in CI related to infrastructure1717. Vieira-Meyer APGF, Machado MFAS, Gubert FA, Morais APP, Sampaio YP, Saintrain MVL, et al. Variation in primary health care services after implementation of quality improvement policy in Brazil. Fam Pract. 2020;37(1):69-80. https://doi.org/10.1093/fampra/cmz040
https://doi.org/10.1093/fampra/cmz040...
, in this study such relationship was stronger in CI related to work processes. This may mean that, in general, the Requalifica UBS1616. Ministério da Saúde (BR). Portaria nº 340, de 4 de março de 2013. Redefine o Componente Construção do Programa de Requalificação de Unidades Básicas de Saúde (UBS). Brasilia, DF; 2013 [cited 2019 Jun 11]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt0340_04_03_2013.html
http://bvsms.saude.gov.br/bvs/saudelegis...
was effective, but that, in the state of Ceará, the performance of the teams, as well as the management processes linked to them, was able to respond more strongly than in other regions of the country regarding work processes.

It should be noted that this most prominent inverse relationship in CI related to the work process may be the result of the protagonism of the teams, who have worked these questions more effectively, minimizing the differences in quality between the variables studied and qualifying the work of FHS more equitably. Generally, teams have more autonomy to act on problems related to the work process than in the infrastructure dimension, which demands financial resources that are not always available1212. Ministério da Saúde (BR). Portaria N° 2.488, de 21 de outubro de 2011. Aprova a Política Nacional de Atenção Básica, estabelecendo a revisão de diretrizes e normas para a organização da Atenção Básica, para a Estratégia Saúde da Família (ESF) e o Programa de Agentes Comunitários de Saúde (PACS). Brasília, DF; 2011 [cited 2019 May 20]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt2488_21_10_2011.html
http://bvsms.saude.gov.br/bvs/saudelegis...
,1515. Facchini LA, Tomasi E, Dilélio AS. Qualidade da Atenção Primária à Saúde no Brasil: avanços, desafios e perspectivas. Saude Debate. 2018;42 Nº Espe1:208-23. https://doi.org/10.1590/0103-11042018s114
https://doi.org/10.1590/0103-11042018s11...
. Thus, we observed that the teams participating in the PMAQ-AB effectively expanded their scope of practices, supported by municipal management. Thus, they advanced in the changes related to the work process to qualify the FHS, assuming this transformation process, performing self-assessment and planning, setting goals to be implemented jointly by the teams.

The availability of financial resources has the capacity to induce more rapid improvements in infrastructure, while the transformations of the work process require more time, since they require changes in organizational culture, co-responsibility of managers and professionals, in addition to the reorganization of health practices1818. Fontana KC, Lacerda JT, Machado PMO. O processo de trabalho na Atenção Básica à saúde: avaliação da gestão. Saude Debate. 2016;40(110):64-80. https://doi.org/10.1590/0103-1104201611005
https://doi.org/10.1590/0103-11042016110...
. The fact that the municipalities of Ceará have succeeded in making progress in the organization of work processes of their FHST may be a reflection of the state performance. Its role is associated with the processes of continuing education and the monitoring of indicators developed, and these actions are executed as a strategy for consolidating the regionalization process1414. Secretaria de Estado da Saúde do Ceará. Plano Diretor de Regionalização das Ações e Serviços de Saúde – PDR do Estado do Ceará 2014. Fortaleza; 2014 [cited 2019 May 25]. Available from: https://www.saude.ce.gov.br/download/revisao-do-plano-diretor-de-regionalizacao-das-acoes-e-servicos-de-saude-pdr-do-estado-do-ceara-2014/
https://www.saude.ce.gov.br/download/rev...
. Thus, with the PMAQ, Brazil assumes the responsibility of properly managing the offer of services, so that the results achieved correspond to the established goals or the real needs of the population with a programmed incentive policy1010. Ministério da Saúde (BR). Portaria Nº 1.654, de 19 de julho de 2011. Institui, no âmbito do Sistema Único de Saúde, o Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica (PMAQ-AB) e o Incentivo Financeiro do PMAQ-AB, denominado Componente de Qualidade do Piso de Atenção Básica Variável – PAB Variável. Brasília (DF); 2011 [cited 2019 20]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt1654_19_07_2011.html
http://bvsms.saude.gov.br/bvs/saudelegis...
.

The lowest percentages of change occurred in the variables exams, vaccine and prenatal, which are among the CI with higher initial values. Furthermore, it is important to understand that the supply of vaccines has its logistics structure organized nationally by the Programa Nacional de Imunização (PNI – National Immunization Program )1616. Ministério da Saúde (BR). Portaria nº 340, de 4 de março de 2013. Redefine o Componente Construção do Programa de Requalificação de Unidades Básicas de Saúde (UBS). Brasilia, DF; 2013 [cited 2019 Jun 11]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt0340_04_03_2013.html
http://bvsms.saude.gov.br/bvs/saudelegis...
. Thus, immunobiologicals are acquired by the federal government, and the local/municipal level has to adequate the units according to the technical standards of the Ministry of Health and application in the population1919. Albuquerque LC. Avaliação dos serviços de vacinação nas Unidades Básicas de Saúde do Brasil [dissertação]. São Luís: Universidade Federal do Maranhão; 2017.,2020. Siqueira LG, Martins AMEBL, Versiani CMC, Almeida LAV, Oliveira CS, Nascimento JE, et al. Avaliação da organização e funcionamento das salas de vacina na Atenção Primária à Saúde em Montes Claros, Minas Gerais, 2015. Epidemiol Serv Saude. 2017;26(3):557-68. https://doi.org/10.5123/s1679-49742017000300013
https://doi.org/10.5123/s1679-4974201700...
. Thus, the municipalities have low interference in this variable, which can be verified by the non-influence of population size and health region in this CI.

It is interesting to note that the greatest increase in CI occurred in diagnostic tests, a variable in which municipalities also have little influence. The acquisition of the tests is carried out by the Brazilian Ministry of Health, but it is up to the states and municipalities to structure and organize them effectively. The implementation of rapid tests and exams for the diagnosis of pregnancy, HIV infection and screening of syphilis and viral hepatitis in PHC forms the set of strategies of the Ministry of Health aiming to qualify and to expand the Brazilian population’s access to health2121. Ministerio da Saúde (BR). Ações e programas da Rede Cegonha: testes rápidos de HIV e sífilis na Atenção Básica. Brasília, DF; 2017 [cited 2019 Jun 5]. Available from: http://www.saude.gov.br/acoes-e-programas/rede-cegonha/testes-rapidos
http://www.saude.gov.br/acoes-e-programa...
. The data show that a significant improvement in this indicator occurred in the state, most likely due to the increase in the acquisition of inputs by the federal government, but also by the better organization of the state and municipalities in the distribution and use of such inputs. However, unlike the variable vaccines, the population size and the health region influenced the improvement in diagnostic tests. The explanation for this is not very clear, but it seems to us to be related to the way in which these municipalities organize themselves to carry out the diagnostic tests.

We also observed that the variation of CI did not occur homogeneously in the groups studied, which seems to be influenced by population size and regionalization. The largest variations occurred in the smaller population municipalities, located in the Sertão Central region and with lower CI values in the first external evaluation cycle.

In the process of implementing the Sertão Central macro-region, in 2011, being the penult installed in the state of Ceará1414. Secretaria de Estado da Saúde do Ceará. Plano Diretor de Regionalização das Ações e Serviços de Saúde – PDR do Estado do Ceará 2014. Fortaleza; 2014 [cited 2019 May 25]. Available from: https://www.saude.ce.gov.br/download/revisao-do-plano-diretor-de-regionalizacao-das-acoes-e-servicos-de-saude-pdr-do-estado-do-ceara-2014/
https://www.saude.ce.gov.br/download/rev...
, possibly its organization – by the construction of the Plano Diretor Regional, which was possible with workshops, meetings, training and agreements between municipal managers and state manager – has mobilized efforts of leaders and professionals aimed to the qualification of their work processes and infrastructure, reflecting in the best CI of the region in the 2nd cycle of the PMAQ. This fact corroborates the effect of regional issues on the implementation of national policies.

We emphasized that mediating variables should be considered in the implementation of public health policies. Inter- and intra-regional differences in health systems can occur for several reasons, whether economic, cultural, educational, organizational, infrastructure-related or population profile, including the epidemiological and demographic1717. Vieira-Meyer APGF, Machado MFAS, Gubert FA, Morais APP, Sampaio YP, Saintrain MVL, et al. Variation in primary health care services after implementation of quality improvement policy in Brazil. Fam Pract. 2020;37(1):69-80. https://doi.org/10.1093/fampra/cmz040
https://doi.org/10.1093/fampra/cmz040...
.

In municipalities with more than 500,000 inhabitants, such the state capital, a negative variation was observed in CI results regarding the quality of the work process. This fact may be the effect of the organizational change implemented in PHC of the municipality since 2013, notably in the work process of the FHST. In this context, the following stand out: changes in basic health units managers; change in the work day of professionals, who began a work shift of six direct hours, generating mismatches between team members; discouraged local planning in the FHS; changes in the regulation of users’ access, with a dense schedule of care due to spontaneous demand; among other2222. Rodrigues MIS. Formação dos gestores da Atenção Primária à Saúde: análise da experiência de Fortaleza-CE [dissertação]. Fortaleza: Universidade Estadual do Ceará; 2015.,2323. Secretaria Municipal de Saúde de Fortaleza. Plano Municipal de Saúde de Fortaleza 2014-2017. Fortaleza; 2017 [cited 2019 May 22]. Available from: https://saude.fortaleza.ce.gov.br/images/planodesaude/20142017/Plano-Municipal-de-Saude-de-Fortaleza-2014-2017---FINAL---site-SMS.pdf
https://saude.fortaleza.ce.gov.br/images...
. Such modifications seem to have, to some extent, disarticulated the FHST, distancing them from what is recommended by the Política Nacional de Atenção Básica (PNAB – National Primary Health Care Policy)1212. Ministério da Saúde (BR). Portaria N° 2.488, de 21 de outubro de 2011. Aprova a Política Nacional de Atenção Básica, estabelecendo a revisão de diretrizes e normas para a organização da Atenção Básica, para a Estratégia Saúde da Família (ESF) e o Programa de Agentes Comunitários de Saúde (PACS). Brasília, DF; 2011 [cited 2019 May 20]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt2488_21_10_2011.html
http://bvsms.saude.gov.br/bvs/saudelegis...
. Previous studies have shown a relationship between human development index (HDI), FHS coverage, Bolsa Família Program coverage, population size, FHS planning indicators and institutional support for FHS actions and provision of prenatal care and FHS exams as variables that influence health indicators2424. Vieira-Meyer APGF, Dias MSA, Vasconcelos MIO, Rouberte ESC, Almeida AMB, Pinheiro TXA, et al. What is the relative impact of primary health care quality and conditional cash transfer program in child mortality? Can J Public Health. 2019;110(6):756-67. https://doi.org/10.17269/s41997-019-00246-9
https://doi.org/10.17269/s41997-019-0024...

25. Hone T, Rasella D, Barreto M, Atun R, Majeed A, Millett C. Large reductions in amenable mortality associated with Brazil’s primary care expansion and strong health governance. Health Aff (Millwood). 2017;36(1):149-58. https://doi.org/10.1377/hlthaff.2016.0966
https://doi.org/10.1377/hlthaff.2016.096...
-2626. Rasella D, Harhay MO, Pamponet ML, Aquino R, Barreto ML. Impact of primary health care on mortality from heart and cerebrovascular diseases in Brazil: a nationwide analysis of longitudinal data. BMJ. 2014;349:g4014. https://doi.org/10.1136/bmj.g4014
https://doi.org/10.1136/bmj.g4014...
. Therefore, for the improvement of the quality of health care, it is necessary to undertake efforts aimed to planning and institutional support, aligned with the organizational mission, considering the interests of the collective of workers, with a view to ensuring the provision of services and resolutive actions.

Considering the fact that the greatest positive variation in quality improvement occurred in municipalities and/or regions with lower initial CI, the implementation of PMAQ-AB in Ceará induced the qualification of the FHS in an equitable manner. In fact, this characteristic also occurs in the rest of the country, and in other policies based on the principle of equity, such as the PNAB, which has also provided a reduction in inequalities, benefiting poorer, smaller and low population-density municipalities1717. Vieira-Meyer APGF, Machado MFAS, Gubert FA, Morais APP, Sampaio YP, Saintrain MVL, et al. Variation in primary health care services after implementation of quality improvement policy in Brazil. Fam Pract. 2020;37(1):69-80. https://doi.org/10.1093/fampra/cmz040
https://doi.org/10.1093/fampra/cmz040...
,2424. Vieira-Meyer APGF, Dias MSA, Vasconcelos MIO, Rouberte ESC, Almeida AMB, Pinheiro TXA, et al. What is the relative impact of primary health care quality and conditional cash transfer program in child mortality? Can J Public Health. 2019;110(6):756-67. https://doi.org/10.17269/s41997-019-00246-9
https://doi.org/10.17269/s41997-019-0024...
,2727. Poças KC, Freitas LRS, Duarte EC. Censo de estrutura da Atenção Primária à Saúde no Brasil (2012): estimativas de coberturas potenciais. Epidemiol Serv Saude. 2017;26(2):275-84. https://doi.org/10.5123/s1679-49742017000200005
https://doi.org/10.5123/s1679-4974201700...
.

The implementation of the PMAQ-AB required greater leadership of managers and workers in the restructuring of basic health units and work processes in the FHS than traditionally occurred in Brazilian states. The standards of access and quality are re-signified according to the concrete reality, context, priorities, interests and negotiation with local actors88. Neves RG, Flores TR, Duro SMS, Nunes BP, Tomasi E. Tendência temporal da cobertura da Estratégia Saúde da Família no Brasil, regiões e Unidades da Federação, 2006-2016. Epidemiol Serv Saude. 2018;27(3):e2017170. https://doi.org/10.5123/s1679-49742018000300008
https://doi.org/10.5123/s1679-4974201800...
,2828. Pinto HA, Sousa ANA, Ferla AA. O Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica: várias faces de uma política inovadora. Saude Debate. 2014;38 Nº Espe:358-72. https://doi.org/10.5935/0103-1104.2014S027
https://doi.org/10.5935/0103-1104.2014S0...
. In this sense, health policies that induce evaluation and monitoring also influence the context in which2929. Bezerra MM, Medeiros KJ. Limites do Programa de Melhoria do Acesso e da Qualidade da Atenção Básica (PMAQ-AB): em foco, a gestão do trabalho e a educação na saúde. Saude Debate. 2018;42 Nº Espe 2:188-202. https://doi.org/10.1590/0103-11042018s213
https://doi.org/10.1590/0103-11042018s21...
they are implemented, and they should be considered in the implantation of national public policies, but with local implementation. We believed that part of the differences observed between health regions and population size may have been due to regional issues. Thus, for the full implantation of national policies, additional support is necessary for regions that need greater incentive to achieve quality improvement. Although the analysis of this research occurred in the state of Ceará, its inferences, related to the importance of context issues in the implementation of policies, can be extrapolated to other parts of the country.

The study recognizes that, by the evaluated CI, PMAQ-AB, although recent, promotes the responsibility to adequately manage the provision of services so that the established goals and the real health needs of the population are met and achieved with a programmed incentive policy that directly affects the financing, management of the service network, institutional support, planning and organization of work processes.

CONCLUSION

Quality improvements related to infrastructure and work process occurred equitably during the implementation period of the PMAQ-AB in the state of Ceará. Although the implementation of the program occurred almost universally among the municipalities of the state, the results of this policy were not homogeneous, since they were influenced both by population size and health region. We observed that public policies are appropriate and adapted according to the reality and/or context in which they are implemented, with the flexibility of considering dynamics and complexity of the territories. Thus, these aspects should be considered when national policies are implemented locally.

REFERENCES

  • 1
    Brasil. Constituição (1988). Constituição da República Federativa do Brasil. Brasília, DF: Senado Federal; 1988.
  • 2
    Giovanella L, Mendonça MHM. Atenção primária saúde. In: Giovanella L, Escorel S, Lobato LVC, Noronha JC, Carvalho AI, organizadores. Políticas e sistema de saude no Brasil. 2. ed. Rio de Janeiro: FIOCRUZ; 2012. p. 493-546.
  • 3
    Chaves LA, Jorge AO, Cherchiglia ML, Reis IA, Santos MAC, Santos AF, et al. Integração da atenção básica à rede assistencial: análise de componentes da avaliação externa do PMAQ-AB. Cad Saude Publica. 2018;34(2):e00201515. https://doi.org/10.1590/0102-311x00201515
    » https://doi.org/10.1590/0102-311x00201515
  • 4
    Conill EM. Ensaio histórico-conceitual sobre a Atenção Primária à Saúde: desafios para a organização de serviços básicos e da Estratégia Saúde da Família em centros urbanos no Brasil. Cad Saude Publica. 2008;24 Supl 1:s7-16. https://doi.org/10.1590/S0102-311X2008001300002
    » https://doi.org/10.1590/S0102-311X2008001300002
  • 5
    Andrade OM, Barreto ICHC. SUS passo a passo: história, regulamentação, financiamento, políticas nacionais. 2. ed. rev. ampl. São Paulo: Hucitec; 2007.
  • 6
    Arantes LJ, Shimizu HE, Merchán-Hamann E. Contribuições e desafios da Estratégia Saúde da Família na Atenção Primária à Saúde no Brasil: revisão da literatura. Cienc Saude Coletiva. 2016;21(5):1499-510. https://doi.org/10.1590/1413-81232015215.19602015
    » https://doi.org/10.1590/1413-81232015215.19602015
  • 7
    Ministério da Saúde (BR), Sala de Apoio à Gestão Estratégica. Equipes de Saúde da Família. Brasilia, DF; 2019 [cited 2019 May 20]. Available from: http://sage.saude.gov.br/#
    » http://sage.saude.gov.br/#
  • 8
    Neves RG, Flores TR, Duro SMS, Nunes BP, Tomasi E. Tendência temporal da cobertura da Estratégia Saúde da Família no Brasil, regiões e Unidades da Federação, 2006-2016. Epidemiol Serv Saude. 2018;27(3):e2017170. https://doi.org/10.5123/s1679-49742018000300008
    » https://doi.org/10.5123/s1679-49742018000300008
  • 9
    Souza MF, Santos AF, Reis IA, Santos MAC, Jorge AO, Machado ATGM, et al. Coordenação do cuidado no PMAQ-AB: uma análise baseada na Teoria de Resposta ao Item. Rev Saude Publica. 2017;51:87. https://doi.org/10.11606/s1518-8787.2017051007024
    » https://doi.org/10.11606/s1518-8787.2017051007024
  • 10
    Ministério da Saúde (BR). Portaria Nº 1.654, de 19 de julho de 2011. Institui, no âmbito do Sistema Único de Saúde, o Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica (PMAQ-AB) e o Incentivo Financeiro do PMAQ-AB, denominado Componente de Qualidade do Piso de Atenção Básica Variável – PAB Variável. Brasília (DF); 2011 [cited 2019 20]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt1654_19_07_2011.html
    » http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt1654_19_07_2011.html
  • 11
    Donabedian A. The quality of care: how can it be assessed? JAMA. 1988;260(12):1743-8. https://doi.org/10.1001/jama.1988.03410120089033
    » https://doi.org/10.1001/jama.1988.03410120089033
  • 12
    Ministério da Saúde (BR). Portaria N° 2.488, de 21 de outubro de 2011. Aprova a Política Nacional de Atenção Básica, estabelecendo a revisão de diretrizes e normas para a organização da Atenção Básica, para a Estratégia Saúde da Família (ESF) e o Programa de Agentes Comunitários de Saúde (PACS). Brasília, DF; 2011 [cited 2019 May 20]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt2488_21_10_2011.html
    » http://bvsms.saude.gov.br/bvs/saudelegis/gm/2011/prt2488_21_10_2011.html
  • 13
    Instituto Brasileiro de Geografia e Estatística. Pesquisa de Informações Básicas Municipais: perfil dos Estados e Municípios 2014. Rio de Janeiro: IBGE; 2014 [cited 2019 18]. Available from: https://ww2.ibge.gov.br/home/estatistica/economia/perfilmunic/2014/default.shtm
    » https://ww2.ibge.gov.br/home/estatistica/economia/perfilmunic/2014/default.shtm
  • 14
    Secretaria de Estado da Saúde do Ceará. Plano Diretor de Regionalização das Ações e Serviços de Saúde – PDR do Estado do Ceará 2014. Fortaleza; 2014 [cited 2019 May 25]. Available from: https://www.saude.ce.gov.br/download/revisao-do-plano-diretor-de-regionalizacao-das-acoes-e-servicos-de-saude-pdr-do-estado-do-ceara-2014/
    » https://www.saude.ce.gov.br/download/revisao-do-plano-diretor-de-regionalizacao-das-acoes-e-servicos-de-saude-pdr-do-estado-do-ceara-2014/
  • 15
    Facchini LA, Tomasi E, Dilélio AS. Qualidade da Atenção Primária à Saúde no Brasil: avanços, desafios e perspectivas. Saude Debate. 2018;42 Nº Espe1:208-23. https://doi.org/10.1590/0103-11042018s114
    » https://doi.org/10.1590/0103-11042018s114
  • 16
    Ministério da Saúde (BR). Portaria nº 340, de 4 de março de 2013. Redefine o Componente Construção do Programa de Requalificação de Unidades Básicas de Saúde (UBS). Brasilia, DF; 2013 [cited 2019 Jun 11]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt0340_04_03_2013.html
    » http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt0340_04_03_2013.html
  • 17
    Vieira-Meyer APGF, Machado MFAS, Gubert FA, Morais APP, Sampaio YP, Saintrain MVL, et al. Variation in primary health care services after implementation of quality improvement policy in Brazil. Fam Pract. 2020;37(1):69-80. https://doi.org/10.1093/fampra/cmz040
    » https://doi.org/10.1093/fampra/cmz040
  • 18
    Fontana KC, Lacerda JT, Machado PMO. O processo de trabalho na Atenção Básica à saúde: avaliação da gestão. Saude Debate. 2016;40(110):64-80. https://doi.org/10.1590/0103-1104201611005
    » https://doi.org/10.1590/0103-1104201611005
  • 19
    Albuquerque LC. Avaliação dos serviços de vacinação nas Unidades Básicas de Saúde do Brasil [dissertação]. São Luís: Universidade Federal do Maranhão; 2017.
  • 20
    Siqueira LG, Martins AMEBL, Versiani CMC, Almeida LAV, Oliveira CS, Nascimento JE, et al. Avaliação da organização e funcionamento das salas de vacina na Atenção Primária à Saúde em Montes Claros, Minas Gerais, 2015. Epidemiol Serv Saude. 2017;26(3):557-68. https://doi.org/10.5123/s1679-49742017000300013
    » https://doi.org/10.5123/s1679-49742017000300013
  • 21
    Ministerio da Saúde (BR). Ações e programas da Rede Cegonha: testes rápidos de HIV e sífilis na Atenção Básica. Brasília, DF; 2017 [cited 2019 Jun 5]. Available from: http://www.saude.gov.br/acoes-e-programas/rede-cegonha/testes-rapidos
    » http://www.saude.gov.br/acoes-e-programas/rede-cegonha/testes-rapidos
  • 22
    Rodrigues MIS. Formação dos gestores da Atenção Primária à Saúde: análise da experiência de Fortaleza-CE [dissertação]. Fortaleza: Universidade Estadual do Ceará; 2015.
  • 23
    Secretaria Municipal de Saúde de Fortaleza. Plano Municipal de Saúde de Fortaleza 2014-2017. Fortaleza; 2017 [cited 2019 May 22]. Available from: https://saude.fortaleza.ce.gov.br/images/planodesaude/20142017/Plano-Municipal-de-Saude-de-Fortaleza-2014-2017---FINAL---site-SMS.pdf
    » https://saude.fortaleza.ce.gov.br/images/planodesaude/20142017/Plano-Municipal-de-Saude-de-Fortaleza-2014-2017---FINAL---site-SMS.pdf
  • 24
    Vieira-Meyer APGF, Dias MSA, Vasconcelos MIO, Rouberte ESC, Almeida AMB, Pinheiro TXA, et al. What is the relative impact of primary health care quality and conditional cash transfer program in child mortality? Can J Public Health. 2019;110(6):756-67. https://doi.org/10.17269/s41997-019-00246-9
    » https://doi.org/10.17269/s41997-019-00246-9
  • 25
    Hone T, Rasella D, Barreto M, Atun R, Majeed A, Millett C. Large reductions in amenable mortality associated with Brazil’s primary care expansion and strong health governance. Health Aff (Millwood). 2017;36(1):149-58. https://doi.org/10.1377/hlthaff.2016.0966
    » https://doi.org/10.1377/hlthaff.2016.0966
  • 26
    Rasella D, Harhay MO, Pamponet ML, Aquino R, Barreto ML. Impact of primary health care on mortality from heart and cerebrovascular diseases in Brazil: a nationwide analysis of longitudinal data. BMJ. 2014;349:g4014. https://doi.org/10.1136/bmj.g4014
    » https://doi.org/10.1136/bmj.g4014
  • 27
    Poças KC, Freitas LRS, Duarte EC. Censo de estrutura da Atenção Primária à Saúde no Brasil (2012): estimativas de coberturas potenciais. Epidemiol Serv Saude. 2017;26(2):275-84. https://doi.org/10.5123/s1679-49742017000200005
    » https://doi.org/10.5123/s1679-49742017000200005
  • 28
    Pinto HA, Sousa ANA, Ferla AA. O Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica: várias faces de uma política inovadora. Saude Debate. 2014;38 Nº Espe:358-72. https://doi.org/10.5935/0103-1104.2014S027
    » https://doi.org/10.5935/0103-1104.2014S027
  • 29
    Bezerra MM, Medeiros KJ. Limites do Programa de Melhoria do Acesso e da Qualidade da Atenção Básica (PMAQ-AB): em foco, a gestão do trabalho e a educação na saúde. Saude Debate. 2018;42 Nº Espe 2:188-202. https://doi.org/10.1590/0103-11042018s213
    » https://doi.org/10.1590/0103-11042018s213

Publication Dates

  • Publication in this collection
    10 June 2020
  • Date of issue
    2020

History

  • Received
    25 June 2019
  • Accepted
    10 Sept 2019
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br