The use of the Primary Care Assessment Tool (PCAT): an integrative review and proposed update

Otávio Pereira D’Avila Luiz Felipe da Silva Pinto Lisiane Hauser Marcelo Rodrigues Gonçalves Erno Harzheim About the authors

Abstract

This study proposes an integrative review of the literature based on articles and publications on the use of the Primary Care Assessment Tool (PCAT) as a tool for evaluating these services, discussing the results found in Brazil and in other countries of the world, from the initial matrix conceived by Professor Barbara Starfield’s team and proposing updates for the Brazilian version. We identified 124 studies, of which 42 were selected after full reading and according to the established inclusion criteria. Of this subtotal, 17 (40.5%) were Brazilian studies. There is a need to update items of each tool’s attribute, in particular “access – first contact”, including new forms of doctor-patient communication such as: email, mobile application messages, use of videoconference software for communication and even use of telemedicine, among others. PCAT’s use, application and calculation of scores is simple, which makes it useful and suitable for use in the local management of services, especially in its short version.

Primary Health Care; Health evaluation; Health care; Health services; Outcome assessment

Introduction

In the late 1990s and early 2000s, tools were developed in several countries to assess the quality of Primary Health Care through the experience of users, professionals and/or managers in the daily services. Among these resources are the Components of Primary Care Instrument (CPCI)11. Flocke SA. Measuring attributes of primary care: development of a new instrument. J Fam Pract 1997; 45(1):64-74., Primary Care Assessment Survey (PCAS)22. Safran DG, Kosinski M, Tarlov AR, Rogers WH, Taira DH, Lieberman N, Ware JE. The primary care assessment survey: tests of data quality and measurement performance. Med Care 1998; 36(5):728-739., EUROPEP questionnaire33. Grol R, Wensing M, Mainz J, Jung HP, Ferreira P, Hearnshaw H, Hjortdahl P, Olesen F, Reis S, Ribacke M, Szecsenyi J; European Task Force on Patient Evaluations of General Practice Care (EUROPEP). Patient in Europe evaluate general practice care: an international comparison. Br J Gen Pract 2000; 50(460):882-887., Primary Care Assessment Tool (PCAT)44. Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-164., Interpersonal Processes of Care55. Stewart AL, Nápoles-Springer AM, Gregorich SE, Santoyo-Olsson J. Interpersonal processes of care survey: patient-reported measures for diverse groups. Health Serv Res 2007; 42(3 Pt 1):1235-1256. and Qualicopc66. Schäfer WL, Boerma WG, Kringos DS, De Maeseneer J, Gress S, Heinemann S, Rotar-Pavlic D, Seghieri C, Svab I, Van den Berg MJ, Vainieri M, Westert GP, Willems S, Groenewegen PP. QUALICOPC, a multi-country study evaluating quality, costs and equity in primary care. BMC Fam Pract 2011; 12:115.. PCATool was proposed and validated in the USA by Cassady et al.77. Cassady CE, Starfield B, Hurtado MP, Berk RA, Nanda JP, Friedenberg LA. Measuring consumer experiences with Primary Care. Pediatrics 2000; 105(4 Pt 2):998-1003., led by Professor Barbara Starfield, as a psychometric scale that covers scores for all PHC attributes, as well as two summary measures. Authors compared two national PHC models with samples conducted by phone and e-mail interviews, calculating statistics called “scores” for each of the characteristics that formed a search group of items: (i) extension of affiliation with a service; (ii) first contact access – use; (iii) first contact access – accessibility; (iv) longitudinality; (v) coordination – integration of care; (vi) comprehensiveness – available services, (vii) comprehensiveness – services provided; (viii) family orientation, (ix) community orientation. Initially, the attribute “coordination” contemplated only the perspective of the integration of care, leaving aside the measurement of information systems. This tool has a version for adult and children users, health professionals and managers.

In Brazil, Harzheim et al.88. Harzheim E, Starfield B, Rajmil L, Álvarez-Dardet C, Stein AT. Consistência interna e confiabilidade da versão em português do Instrumento de Avaliação da Atenção Primária (PCATool-Brasil) para serviços de saúde infantil. Cad Saude Publica 2006; 22(8):1649-1659. were the first to adapt the PCATool – children’s version, analyzing their validity and reliability by means of a cross-sectional study in the city of Porto Alegre, performing reverse translation, adaptation, pre-test, construct validity, internal consistency and reliability analysis. Oliveira99. Oliveira MMC. Presença e extensão dos atributos da atenção primária entre os serviços de atenção primária em Porto Alegre: uma análise agregada [dissertação]. Porto Alegre: Universidade Federal do Rio Grande do Sul; 2007. and Trindade1010. Trindade TG. Associação entre a extensão dos atributos de atenção primária e qualidade do manejo da hipertensão arterial em adultos adscritos à rede de atenção primária à saúde de Porto Alegre [dissertação]. Porto Alegre: Universidade Federal do Rio Grande do Sul; 2007. used the same databases of Porto Alegre to develop comparative evaluations between different health care models, associating with the quality of management of hypertension in adults. Simultaneously, in Petrópolis, a highland city in the state of Rio de Janeiro, Macinko et al.1111. Macinko J, Almeida C, Sá PK. A rapid assessment methodology for the evaluation of primary care organization and performance in Brazil. Health Policy Plan. Health Policy Plan 2007; 22(3):167-177. compared facilities with family health teams x facilities with traditional care, validating a version for adult users with small differences in the composition of the items and in the response scale. In 2010, some of these versions were endorsed by the Ministry of Health with the publication of a Manual of said tool1212. Harzheim E, Gonçalves MR, Oliveira MMC, Trindade TG, Agostinho MR, Hauser L. Manual do instrumento de avaliação da atenção primária à saúde: primary care assessment tool PCATool – Brasil. Brasília: Ministério da Saúde; 2010.. Subsequently, a team of researchers linked to the Epidemiology Graduate Program, Faculty of Medicine, Federal University of Rio Grande do Sul (UFRGS) validated the versions for adult users1313. Harzheim E, Oliveira MMC, Agostinho MR, Hauser L, Stein AT, Gonçalves MR, Trindade TG, Berra S, Duncan BB, Starfield B. Validação do instrumento de avaliação da atenção primária à saúde: PCATool-Brasil adultos. Rev Bras Med Fam Comunidade 2013; 8(29):274-284., professionals1414. Hauser L, Castro RCL, Vigo A, Trindade TG, Gonçalves MR, Stein AT, Dunca BB, Harzheim E. Tradução, adaptação, validade e medidas de fidedignidade do Instrumento de Avaliação da Atenção Primária à Saúde (Pcatool) no Brasil: versão profissionais de saúde. Rev Bras Med Fam Comunidade 2013; 8(29):244-255. and the short versions for adults1515. Oliveira MMC, Harzheim E, Riboldi J, Duncan BB. PCATool-adulto-BRASIL: uma versão reduzida. Rev Bras Med Fam Comunidade. 2013; 8(29):256-263. and children1616. Hauser L. Aprimoramento do Instrumento de Avaliação da Atenção Primária à Saúde (PCATool-Brasil) [tese]. Porto Alegre: Universidade Federal do Rio Grande do Sul; 2016..

Since then, several Brazilian authors have started to use PCATool as a resource for the evaluation of Primary Health Care from the perspective of users responsible for children, adolescents and also adult users, in municipalities and cities of different population sizes, combining and complementing, sometimes, with clinical outcomes and use of other questionnaires / protocols in the health area and adapting the local culture to its items. At the global level, researchers from several countries worked on the adaptation and validation of PCATool versions appropriate to their social and health contexts, with increasing use of the tool in several parts of the world.

This study aims to present an integrative review of papers, theses and dissertations available on the internet on the use of PCAT as a tool for evaluating primary health care services through users’ perceptions, discussing the results found in Brazil and in the versions adapted and validated in other countries, from the initial matrix conceived by professor Barbara Starfield’s team, as well as to propose updates for the Brazilian version.

Methodology

The integrative literature review synthesizes information over a specific period on a specific topic. Its main advantage over the revision of the traditional bibliography is that there is a strict method in the selection of papers, with well-defined inclusion and exclusion criteria, period, pre-established languages, bibliographic databases of public domain used and, sometimes, book repositories or theses and dissertations consulted. Its elaboration presupposes detailing to the reader all these choice criteria.

For the review, we consulted Pubmed databases of the National Library of Medicine of the United States, Lilacs (Latin American and Caribbean Literature in Health Sciences), SciELO (Scientific Electronic Library Online), as well as the institutional repositories of scientific production The Sergio Arouca National School of Public Health / Oswaldo Cruz Foundation (ENSP/Fiocruz), the Federal University of Rio Grande do Sul (UFRGS) and the University of São Paulo (USP), as well as research reports with random samples of users, available on the internet. We selected studies published between January 1, 2000 and June 1, 2016. For the search, keywords used were ‘PCATool’ and associations between “PCAT” and “Primary Care Assessment”.

The collection identified 124 papers on the subject. However, after reading them, 42 were selected according to the inclusion criteria: articles published in the period; languages: English, Portuguese and Spanish; types of study: cross-sectional study with results from samples of children or adults users. In a second reading, we searched for publications that listed more than one Primary Health Care attribute and PCAT scores, both for the essential and the derivative characteristics, totaling the same 42 studies. At the end of literature review, scores whose articles were not shown on a scale of 0 to 10 were transformed into this metric in order to standardize the analysis of the observed results. The included studies were characterized by author (s), country / region / city, target audience, data collection period and PCAT calculated scores.

Results

Chart 1 shows the distribution of the 42 national and international studies, all with a cross-sectional design and with the respective attribute scores, retrieved in databases or repositories. Of this total, 17 (40.5%) are from Brazil, four each from Canada and China, three from Argentina, two each from the United States and Hong Kong and one each from South Africa, Colombia, South Korea, Spain, Japan, Paraguay, New Zealand, Thailand, Tibet and Uruguay (Figure 1).

Figure 1
Map of PCAT studies (user’s version) included in the integrative literature review – 2000-2016.

Chart 1
Characteristics of publications on the use of the Primary Care Assessment Tool (PCAT) among primary health care users

Chart 1
continuation

Chart 1
continuation

Chart 1
continuation

The geographic distribution of the works shows concentration of studies in the American and Asian continents. The target audience consisted mostly of adults and/or children living in urban areas of cities of countries studied. Only one was conducted in rural cities. Of the 42 surveys, 35 (83.3%) had a cross-sectional study design. Two were before-and-after type and six more were tool validation in the country or region. Among the works geared to the evaluation of services from population samples, the study developed in the city of Rio de Janeiro using PCAT user version1717. Harzheim E, Hauser L, Pinto LF. Avaliação do grau de orientação para Atenção Primária em Saúde: a experiência dos usuários das Clínicas da Família e Centros Municipais de Saúde na cidade do Rio de Janeiro. Porto Alegre: UFRGS; 2015. (Relatório Final da Pesquisa PCATool -Rio-2014). was the one with the largest sample recorded in a single city in the world, both for children (n = 3,145) and for adults (n = 3,530).

Discussion

As can be seen in Figure 1, PCAT is a tool for assessing PHC services used in various locations worldwide. In order to meet the objectives of measuring different realms of PHC in services with heterogeneous characteristics, it was adapted and validated in different regions, always achieving acceptable psychometric properties44. Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-164.,88. Harzheim E, Starfield B, Rajmil L, Álvarez-Dardet C, Stein AT. Consistência interna e confiabilidade da versão em português do Instrumento de Avaliação da Atenção Primária (PCATool-Brasil) para serviços de saúde infantil. Cad Saude Publica 2006; 22(8):1649-1659.,1717. Harzheim E, Hauser L, Pinto LF. Avaliação do grau de orientação para Atenção Primária em Saúde: a experiência dos usuários das Clínicas da Família e Centros Municipais de Saúde na cidade do Rio de Janeiro. Porto Alegre: UFRGS; 2015. (Relatório Final da Pesquisa PCATool -Rio-2014).

18. Lee JH, Choi YJ, Sung NJ, Kim SY, Chung SH, Kim J, Jeon TH, Park HK. Development of the Korean primary care assessment tool--measuring user experience: tests of data quality and measurement performance. Int J Qual Health Care 2009; 21(2):103-11

19. Berra S, Audisio Y, Mántaras J, Nicora V, Mamondi V, Starfield B. Adaptación cultural y al sistema de salud argentino del conjunto de instrumentos para la evaluación de la Atención Primaria de la Salud. Rev Argent Salud Pública 2011; 2(8):6-14.

20. Berra S, Hauser L, Audisio Y, Mántaras J, Nicora, V, Oliveira MMC, Starfield B, Harzheim E. Validez y fiabilidad de la versión argentina del PCAT-AE para evaluar la atención primaria de salud. Rev Panam Salud Publica 2013; 33(1):30-39.
-2121. Aoki T, Inoue M, Nakayama T. Development and validation of the Japanese version of Primary Care Assessment Tool. Fam Pract 2016; 33(1):112-117.. This gives PCAT an advantageous international comparability feature.

Within the observed period, Brazil was the country that most published studies evaluating services using PCAT. Studies showed as essential scores of PHC – first contact access, longitudinality, comprehensiveness and coordination of care – low values ranging from 3.86 in Ilhéus, Bahia, to 7.37 in the city of Rio de Janeiro. Regarding the general score, which includes the already described family and community orientation attributes, we observed a similar range of values: 3.66 in Ilhéus and 7.01 in Rio de Janeiro. The result may be related to the choice made by the municipality of Rio de Janeiro of scaling-up expansion of PHC services, which increased population coverage from 3.5% in 2008 to 70% in 20162222. Soranz D, Pinto LF, Penna GO. Eixos e a Reforma dos Cuidados em Atenção Primária em Saúde (RCAPS) na cidade do Rio de Janeiro, Brasil. Cien Saude Colet 2016; 21(5):1327-1338.. It also established a family and community medicine residency program, which increased municipal PHC capacity1717. Harzheim E, Hauser L, Pinto LF. Avaliação do grau de orientação para Atenção Primária em Saúde: a experiência dos usuários das Clínicas da Família e Centros Municipais de Saúde na cidade do Rio de Janeiro. Porto Alegre: UFRGS; 2015. (Relatório Final da Pesquisa PCATool -Rio-2014).,2323. Justino ALA, Oliver LL, Melo TP. Implantação do Programa de Residência em Medicina de Família e Comunidade da Secretaria Municipal de Saúde do Rio de Janeiro, Brasil. Cien Saude Colet 2016; 21(5):1471-1480..

International studies have shown that, in relation to the essential / general attributes with a history of investment in PHC, the following locations performed well: Montevideo (7.51 / 6.93), Seoul and metropolitan region (7.63 / 7.45), Department of Santander in Colombia (7.84 / 6.99), Shigatse and Linzi in Tibet (7.36 / 7.41) and Columbia in the USA (6.99 / 6.63). The first study to analyze a city in South Africa also showed essential and general scores close to 6,62424. Bresick G, Sayed A, le Grange C, Bhagwan S, Manga N, Hellenberg D. Western Cape Primary Care Assessment Tool (PCAT) study: Measuring primary care organisation and performance in the Western Cape Province, South Africa (2013). Afr J Prm Health Care Fam Med 2016; 8(1):a1057..

Despite being culturally and organizationally different models, these locations, together with the municipality of Rio de Janeiro, Brazil, evidenced scores that demonstrate that their own health services are PHC-oriented. However, scores enable us to affirm that services listed above are organized from a structured health care network with established flows. The portfolio of services meets the needs of the population and care continuity and facilitated access is in place. As shown in Chart 1, study by Harzheim et al.1717. Harzheim E, Hauser L, Pinto LF. Avaliação do grau de orientação para Atenção Primária em Saúde: a experiência dos usuários das Clínicas da Família e Centros Municipais de Saúde na cidade do Rio de Janeiro. Porto Alegre: UFRGS; 2015. (Relatório Final da Pesquisa PCATool -Rio-2014). obtained a sample for the city of Rio de Janeiro, of 3,145 children and 3,530 adults, totaling 6,675 individuals interviewed in field work in the first half of 2014, with a sub-municipal representative for the so-called “health planning area”, and also for the two types of facilities that provided primary health care at the time. This was the largest sample ever performed in a single city that we located in our research until 2015.

Nevertheless, the large sample, for example, enabled authors of this study to stratify the results of attribute scores in subsamples, according to some complementary variables searched in the tool, such as: “administrative areas of the city”, “social class” , “team implantation time”, “elderly users - people over 60 years”. Authors found higher scores in health facilities with a longer time of implantation of their family health teams (primary care teams in Brazil) and did not find differences between social classes and the subgroup of adult users older than 60 years.

Some studies in Canada and Spain have used part of the PCAT or short version adapted and validated to their reality4343. Rocha KB, Rodríguez-Sanz M, Pasarín MI, Berra S, Gotsens M, Borrell C. Assessment of primary care in health surveys: a population perspective. Eur J Public Health 2012; 22(1):14-19.,4949. Tourigny A, Aubin M, Haggerty J, Bonin L, Morin D, Reinharz D, Leduc Y, St-Pierre M, Houle N, Giguère A, Benounissa Z, Carmichael PH. Patients’ perceptions of the quality of care after primary care reform: Family medicine groups in Quebec. Can Fam Physician 2010; 56(7):e273-e282., especially in the realm of “comprehensiveness”, in which the list of items that compose it is very specific in each country. This data collection tool allows the researcher to use part of the tool as specific items to use as a proxy for a particular outcome, or only items that make up the realms for an attribute of interest. In addition, short versions have been developed with the objective of optimizing the collection of information and pointing out ways from evaluations that can be routine3232. Oliveira VBCA. Avaliação da atenção primária à saúde da criança no município de Colombo – Paraná [dissertação]. Ribeirão Preto: Universidade de São Paulo; 2012.,4343. Rocha KB, Rodríguez-Sanz M, Pasarín MI, Berra S, Gotsens M, Borrell C. Assessment of primary care in health surveys: a population perspective. Eur J Public Health 2012; 22(1):14-19..

Issues to be incorporated into an upcoming version of the tool

After reviewing the literature and fifteen years after its initial proposal, the application and analysis of the observed results suggest the need to update items of each attribute of the tool. This applies in particular to the attribute “First contact access”, which could be tested to evaluate the possibility of including / adapting new items, such as the inclusion of new forms of doctor-patient communication, such as e-mail messages, mobile device applications messages, use of video broadcasting software for communication and even use of telemedicine, among others. In addition, the use of electronic information systems replacing paper medical records has brought to care not only a technological substitute, but also several possibilities for improving the coordination of care that must be incorporated into new versions of the tools. Likewise, change in the epidemiological context raises the need to include new items in the realm of comprehensiveness.

Final considerations

PCAT enables the evaluation of health services from the user’s perspective, observing the extent of PHC attributes in the evaluated services. This tool has been used around the world from different versions validated for local contexts that allow the comparability of findings. In addition, it is simple to use / apply and calculate scores, even when there is a need to impute data1616. Hauser L. Aprimoramento do Instrumento de Avaliação da Atenção Primária à Saúde (PCATool-Brasil) [tese]. Porto Alegre: Universidade Federal do Rio Grande do Sul; 2016., which makes it useful and suitable for use in the local management of services. Short PCAT versions have been shown to be competent to evaluate particular aspects of PHC attributes and are yet another important tool for local management.

References

  • 1
    Flocke SA. Measuring attributes of primary care: development of a new instrument. J Fam Pract 1997; 45(1):64-74.
  • 2
    Safran DG, Kosinski M, Tarlov AR, Rogers WH, Taira DH, Lieberman N, Ware JE. The primary care assessment survey: tests of data quality and measurement performance. Med Care 1998; 36(5):728-739.
  • 3
    Grol R, Wensing M, Mainz J, Jung HP, Ferreira P, Hearnshaw H, Hjortdahl P, Olesen F, Reis S, Ribacke M, Szecsenyi J; European Task Force on Patient Evaluations of General Practice Care (EUROPEP). Patient in Europe evaluate general practice care: an international comparison. Br J Gen Pract 2000; 50(460):882-887.
  • 4
    Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-164.
  • 5
    Stewart AL, Nápoles-Springer AM, Gregorich SE, Santoyo-Olsson J. Interpersonal processes of care survey: patient-reported measures for diverse groups. Health Serv Res 2007; 42(3 Pt 1):1235-1256.
  • 6
    Schäfer WL, Boerma WG, Kringos DS, De Maeseneer J, Gress S, Heinemann S, Rotar-Pavlic D, Seghieri C, Svab I, Van den Berg MJ, Vainieri M, Westert GP, Willems S, Groenewegen PP. QUALICOPC, a multi-country study evaluating quality, costs and equity in primary care. BMC Fam Pract 2011; 12:115.
  • 7
    Cassady CE, Starfield B, Hurtado MP, Berk RA, Nanda JP, Friedenberg LA. Measuring consumer experiences with Primary Care. Pediatrics 2000; 105(4 Pt 2):998-1003.
  • 8
    Harzheim E, Starfield B, Rajmil L, Álvarez-Dardet C, Stein AT. Consistência interna e confiabilidade da versão em português do Instrumento de Avaliação da Atenção Primária (PCATool-Brasil) para serviços de saúde infantil. Cad Saude Publica 2006; 22(8):1649-1659.
  • 9
    Oliveira MMC. Presença e extensão dos atributos da atenção primária entre os serviços de atenção primária em Porto Alegre: uma análise agregada [dissertação]. Porto Alegre: Universidade Federal do Rio Grande do Sul; 2007.
  • 10
    Trindade TG. Associação entre a extensão dos atributos de atenção primária e qualidade do manejo da hipertensão arterial em adultos adscritos à rede de atenção primária à saúde de Porto Alegre [dissertação]. Porto Alegre: Universidade Federal do Rio Grande do Sul; 2007.
  • 11
    Macinko J, Almeida C, Sá PK. A rapid assessment methodology for the evaluation of primary care organization and performance in Brazil. Health Policy Plan. Health Policy Plan 2007; 22(3):167-177.
  • 12
    Harzheim E, Gonçalves MR, Oliveira MMC, Trindade TG, Agostinho MR, Hauser L. Manual do instrumento de avaliação da atenção primária à saúde: primary care assessment tool PCATool – Brasil Brasília: Ministério da Saúde; 2010.
  • 13
    Harzheim E, Oliveira MMC, Agostinho MR, Hauser L, Stein AT, Gonçalves MR, Trindade TG, Berra S, Duncan BB, Starfield B. Validação do instrumento de avaliação da atenção primária à saúde: PCATool-Brasil adultos. Rev Bras Med Fam Comunidade 2013; 8(29):274-284.
  • 14
    Hauser L, Castro RCL, Vigo A, Trindade TG, Gonçalves MR, Stein AT, Dunca BB, Harzheim E. Tradução, adaptação, validade e medidas de fidedignidade do Instrumento de Avaliação da Atenção Primária à Saúde (Pcatool) no Brasil: versão profissionais de saúde. Rev Bras Med Fam Comunidade 2013; 8(29):244-255.
  • 15
    Oliveira MMC, Harzheim E, Riboldi J, Duncan BB. PCATool-adulto-BRASIL: uma versão reduzida. Rev Bras Med Fam Comunidade 2013; 8(29):256-263.
  • 16
    Hauser L. Aprimoramento do Instrumento de Avaliação da Atenção Primária à Saúde (PCATool-Brasil) [tese]. Porto Alegre: Universidade Federal do Rio Grande do Sul; 2016.
  • 17
    Harzheim E, Hauser L, Pinto LF. Avaliação do grau de orientação para Atenção Primária em Saúde: a experiência dos usuários das Clínicas da Família e Centros Municipais de Saúde na cidade do Rio de Janeiro Porto Alegre: UFRGS; 2015. (Relatório Final da Pesquisa PCATool -Rio-2014).
  • 18
    Lee JH, Choi YJ, Sung NJ, Kim SY, Chung SH, Kim J, Jeon TH, Park HK. Development of the Korean primary care assessment tool--measuring user experience: tests of data quality and measurement performance. Int J Qual Health Care 2009; 21(2):103-11
  • 19
    Berra S, Audisio Y, Mántaras J, Nicora V, Mamondi V, Starfield B. Adaptación cultural y al sistema de salud argentino del conjunto de instrumentos para la evaluación de la Atención Primaria de la Salud. Rev Argent Salud Pública 2011; 2(8):6-14.
  • 20
    Berra S, Hauser L, Audisio Y, Mántaras J, Nicora, V, Oliveira MMC, Starfield B, Harzheim E. Validez y fiabilidad de la versión argentina del PCAT-AE para evaluar la atención primaria de salud. Rev Panam Salud Publica 2013; 33(1):30-39.
  • 21
    Aoki T, Inoue M, Nakayama T. Development and validation of the Japanese version of Primary Care Assessment Tool. Fam Pract 2016; 33(1):112-117.
  • 22
    Soranz D, Pinto LF, Penna GO. Eixos e a Reforma dos Cuidados em Atenção Primária em Saúde (RCAPS) na cidade do Rio de Janeiro, Brasil. Cien Saude Colet 2016; 21(5):1327-1338.
  • 23
    Justino ALA, Oliver LL, Melo TP. Implantação do Programa de Residência em Medicina de Família e Comunidade da Secretaria Municipal de Saúde do Rio de Janeiro, Brasil. Cien Saude Colet 2016; 21(5):1471-1480.
  • 24
    Bresick G, Sayed A, le Grange C, Bhagwan S, Manga N, Hellenberg D. Western Cape Primary Care Assessment Tool (PCAT) study: Measuring primary care organisation and performance in the Western Cape Province, South Africa (2013). Afr J Prm Health Care Fam Med 2016; 8(1):a1057.
  • 25
    Ibañez N, Rocha JSY, Castro PC, Ribeiro MCSA, Forster AC, Novaes MHD, Viana ALA. Avaliação do desempenho da atenção básica no Estado de São Paulo. Cien Saude Colet 2006; 11(3):683-703.
  • 26
    Ferrer APS. Avaliação da atenção primária à saúde prestada a crianças e adolescentes na região oeste do município de São Paulo [tese]. São Paulo: Universidade de São Paulo; 2013.
  • 27
    Elias PE, Ferreira CW, Alves MCG, Cohn A, Kishima V, Escrivão Junior A, Gomes A, Bousquat A. Atenção Básica em Saúde: comparação entre PSF e UBS por estrato de exclusão social no município de São Paulo. Cien Saude Colet 2006; 11(3):633-641.
  • 28
    Silva AS. Avaliação dos atributos da atenção primária à saúde na estratégia saúde da família em municípios do sul de Minas Gerais [tese]. São Paulo: Universidade de São Paulo; 2014.
  • 29
    Van Stralen CJ, Belisário SA, van Stralen TBS, Lima AMD, Massote AW, Oliveira CL. Percepção dos usuários e profissionais de saúde sobre atenção básica: comparação entre unidades com e sem saúde da família na Região Centro-Oeste do Brasil. Cad Saude Publica 2008; 24(Supl. 1):s148-s158.
  • 30
    Leão CDA. Avaliação dos atributos da atenção primária: um enfoque sobre a saúde infantil na estratégia saúde da família em Montes Claros - Minas Gerais [dissertação]. Montes Claros: Universidade Estadual de Montes Claros; 2010.
  • 31
    Carvalho VCHS, Rossato SL, Fuchs FD, Harzheim E, Fuchs SC. Assessment of primary health care received by the elderly and health related quality of life: a cross-sectional study. BMC Public Health 2013; 13:605.
  • 32
    Oliveira VBCA. Avaliação da atenção primária à saúde da criança no município de Colombo – Paraná [dissertação]. Ribeirão Preto: Universidade de São Paulo; 2012.
  • 33
    Braz JC. Avaliação da atenção às crianças menores de um ano na Estratégia Saúde da Família em um município da Bahia, sob a ótica dos cuidadores [dissertação]. Ribeirão Preto: Universidade de São Paulo; 2012.
  • 34
    Pieri FM. A atenção aos doentes de hanseníase no sistema de saúde de Londrina, PR [tese]. Ribeirão Preto: Universidade de São Paulo; 2013.
  • 35
    Wolkers PCB. Os cuidados primários à saúde da criança com diabetes mellitus tipo 1 em serviços públicos de saúde: percepção de mães e cuidadores [tese]. Ribeirão Preto: Universidade de São Paulo; 2014.
  • 36
    Mesquita Filho M, Luz BSR, Araújo CS. A Atenção Primária à Saúde e seus atributos: a situação das crianças menores de dois anos segundo suas cuidadoras. Cien Saude Colet 2014; 19(7):2033-2046.
  • 37
    Gómez AS, Paepe P, Conde LL, Stolkiner A. La implementación local de la atención primaria en la Argentina: estudio de caso en el municipio de Lanús, provincia de Buenos Aires. Saúde em Debate 2012; 36(94):436-448.
  • 38
    Rodríguez-Riveros MI, Bursztyn I, Ruoti M, Dullak R, Páez M, Orué E, Sequera M, Lampert N, Giménez G, Velázquez S. Evaluación de la Atención Primaria de Salud en un contexto urbano: percepción de actores involucrados - Bañado Sur - Paraguay, 2011. Saúde Debate 2012; 36(94):449-460.
  • 39
    Berterretche R, Sollazzo A. El abordaje de la Atención Primária de Salud, modelos organizativos y prácticas: caso de un centro de salud público urbano de Montevideo, Uruguay 2011. Saúde em Debate 2012; 36(94):461-472.
  • 40
    Rodríguez-Villamizar LA, Acosta-Ramírez N, Ruiz-Rodríguez M. Evaluación del desempeño de servicios de Atención Primaria en Salud: experiencia en municipios rurales en Santander, Colombia. Rev. Salud Pública 2013; 15(2):167-179.
  • 41
    Yang H, Shi L, Lebrun LA, Zhou X, Liu J, Wang H. Development of the Chinese primary care assessment tool: data quality and measurement properties. Int J Qual Health Care 2013; 5(1):92-105.
  • 42
    Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigues J. Room for improvement: patients’ experiences of primary care in Quebec before major reforms. Can Fam Physician 2007; 53:1057.
  • 43
    Rocha KB, Rodríguez-Sanz M, Pasarín MI, Berra S, Gotsens M, Borrell C. Assessment of primary care in health surveys: a population perspective. Eur J Public Health 2012; 22(1):14-19.
  • 44
    Wang HH, Wong SY, Wong MC, Wang JJ, Wei XL, Li DK, Tang JL, Griffiths SM. Attributes of primary care in community health centres in China and implications for equitable care: a cross-sectional measurement of patients’ experiences. QJM 2015; 108(7):549-560.
  • 45
    Wong SY, Kung K, Griffiths SM, Carthy T, Wong MC, Lo SV, Chung VC, Goggins WB, Starfield B. Comparison of primary care experiences among adults in general outpatient clinics and private general practice clinics in Hong Kong. BMC Public Health 2010; 10:397.
  • 46
    Tsai J, Shi L, Yu WL, Hung LM, Lebrun LA. Physician specialty and the quality of medical care experiences in the context of the Taiwan national health insurance system. J Am Board Fam Med 2010; 23(3):402-412.
  • 47
    Wang W, Shi L, Yin A, Lai Y, Maitland E, Nicholas S. Development and Validation of the Tibetan Primary Care Assessment Tool. Biomed Res Int 2014; 2014:308739.
  • 48
    Wei X, Li H, Yang N, Wong SY, Owolabi O, Xu J, Shi L, Tang J, Li D, Griffiths SM. Comparing quality of public primary care between Hong Kong and Shanghai using validated patient assessment tools. PLoS One 2015; 10(3):e0121269.
  • 49
    Tourigny A, Aubin M, Haggerty J, Bonin L, Morin D, Reinharz D, Leduc Y, St-Pierre M, Houle N, Giguère A, Benounissa Z, Carmichael PH. Patients’ perceptions of the quality of care after primary care reform: Family medicine groups in Quebec. Can Fam Physician 2010; 56(7):e273-e282.
  • 50
    Carrol JC, Talbot Y, Permaul J, Tobin A, Moineddin R, Blaine S, Bloom J, Butt D, Kay K, Telner D. Academic family health teams: Part 1: patient perceptions of core primary care domains. Can Fam Physician 2016; 62(1):e23-30.
  • 51
    Mei J, Liang Y, Shi LY, Zhao JG, Wang YT, Kuang L. The development and validation of a rapid assessment tool of Primary Care in China. BioMed Research Intern 2016; 2016:6019603.

Publication Dates

  • Publication in this collection
    Mar 2017

History

  • Received
    15 Nov 2016
  • Reviewed
    05 Dec 2016
  • Accepted
    07 Dec 2016
ABRASCO - Associação Brasileira de Saúde Coletiva Rio de Janeiro - RJ - Brazil
E-mail: revscol@fiocruz.br