Methodological challenges in the use of focus groups with people with severe mental illness

Desafios metodológicos para o uso de grupos focais com pessoas com doença mental grave

Desafíos metodológicos para el uso de grupos focales con personas que sufren enfermedades mentales graves

Rosana Teresa Onocko-Campos Alberto Rodolfo Giovanello Díaz Catarina Magalhães Dahl Erotildes Maria Leal Octavio Domont de Serpa JuniorAbout the authors

Abstract:

This study addresses the practical, methodological and ethical challenges that were found in three studies that used focus groups with people with severe mental illness, in the context of community mental health services in Brazil. Focus groups are a powerful tool in health research that need to be better discussed in research with people with severe mental illness, in the context of community mental health facilities. This study is based on the authors’ experience of conducting and analyzing focus groups in three different cities - Campinas, Rio de Janeiro and Salvador - between 2006-2010. The implementation of focus groups with people with severe mental illness is discussed in the following categories; planning, group design, sampling, recruitment, group interview guides, and conduction. The importance of connecting mental healthcare providers as part of the research context is emphasized. Ethical issues and challenges are highlighted, as well as the establishment of a sensitive and empathic group atmosphere, wherein mutual respect can facilitate interpersonal relations and enable people diagnosed with severe mental illness to make sense of the experience. We emphasize the relevance of the interaction between clinical and research teams in order to create collaborative work, achieve inquiry aims, and elicit narratives of mental health users and professionals.

Keywords:
Mental Disorders; Community Mental Health Services; Focus Groups; Qualitative Research

Resumo:

O artigo trata dos desafios práticos, metodológicos e éticos identificados em três estudos que utilizaram grupos focais com pessoas com doença mental grave, no contexto dos serviços comunitários de saúde mental no Brasil. Os grupos focais são uma ferramenta poderosa para a pesquisa em saúde que merece uma discussão ampliada nos estudos com portadores de doença mental grave, no contexto dos serviços comunitários de saúde mental. O estudo tem como base as experiências dos autores na realização e análise de grupos focais em três cidades - Campinas, Rio de Janeiro e Salvador - entre 2006 e 2010. Discute-se o uso de grupos focais com pessoas com doença mental grave, de acordo com as seguintes categorias: planejamento, formato do grupo, amostragem, recrutamento, roteiro de entrevista em grupo e condução. O artigo destaca a importância de envolver os profissionais de saúde mental no contexto da pesquisa. Os achados enfatizam as questões e os desafios éticos, além da criação de um ambiente sensível e de empatia dentro do grupo, onde o respeito mútuo facilite as relações interpessoais e permita que as pessoas com diagnóstico de doença mental grave possam construir sentidos para a sua experiência. Os autores destacam a relevância da interação entre as equipes clínicas e de pesquisa para fomentar a colaboração, alcançar as metas da pesquisa e evocar as narrativas dos usuários e profissionais de saúde mental.

Palavras-chave:
Transtornos Mentais; Serviços Comunitários de Saúde Mental; Grupos Focais; Pesquisa Qualitativa

Resumen:

El artículo trata sobre los desafíos prácticos, metodológicos y éticos, identificados en tres estudios que utilizaron grupos focales con personas con una enfermedad mental grave, en el contexto de los servicios comunitarios de salud mental en Brasil. Los grupos focales son una herramienta poderosa para la investigación en salud, que merece una discusión ampliada en los estudios sobre pacientes con enfermedades mentales graves, en el contexto de los servicios comunitarios de salud mental. El estudio tiene como base las experiencias de los autores en la realización y análisis de grupos focales en tres ciudades -Campinas, Río de Janeiro y Salvador- entre 2006 y 2010. Se discute el uso de grupos focales con personas con una enfermedad mental grave, de acuerdo con las siguientes categorías: planeamiento, formato del grupo, muestra, reclutamiento, guía de entrevista en grupo y ejecución. El artículo destaca la importancia de involucrar a los profesionales de salud mental en el contexto de la investigación. Los hallazgos enfatizan cuestiones y desafíos éticos, además de la creación de un ambiente sensible y de empatía dentro del grupo, donde el respeto mutuo facilite las relaciones interpersonales y permita que las personas con un diagnóstico de enfermedad mental grave puedan dar sentido a la experiencia. Los autores destacan la relevancia de la interacción entre los equipos clínicos y de investigación para fomentar la colaboración, alcanzar las metas de la investigación y evocar las narrativas de los usuarios y profesionales de salud mental.

Palabras-clave:
Trastornos Mentales; Servicios Comunitarios de Salud Mental; Grupos Focales; Investigación Cualitativa

Introduction

In the past three decades, we have observed a growing interest regarding service users’ perspectives to better understand medical systems, public health policies, as well as the illness experiences of users and their needs 11. Bury M. Illness narratives: fact or fiction? Sociol Health Illn 2001; 23:263-85.,22. Good B. Medicine, rationality and experience. Cambridge: Cambridge University Press; 1994.,33. Kleinman A, Eisenberg L, Good B. Culture, illness, and care: clinical lessons from anthropologic and cross-cultural research. Focus (Am Psychiatr Publ) 2006; 4:140-9.,44. Pierret J. The illness experience: state of knowledge and perspectives for research. Sociol Health Illn 2003; 25:4-22.. This change has been accompanied by an increasing acceptance of qualitative methods in social and human sciences applied to healthcare, either informed by interpretive or critical paradigms of research 55. Creswell JW. Projeto de pesquisa. Métodos qualitativo, quantitativo e misto. 2ª Ed. Porto Alegre: Editora Artmed; 2010.,66. Creswell JW. Investigação qualitativa e projeto de pesquisa. Escolhendo entre cinco abordagens. 3ª Ed. Porto Alegre: Editora Artmed; 2014.,77. Denzin NL, Lincoln, Y. The Sage handbook of qualitative research. 3rd Ed. Thousand Oaks/London: Sage Publications; 2006.,88. Fossey E, Harvey C, McDermott F, Davidson L. Understanding and evaluating qualitative research. Aust N Z J Psychiatry 2002; 36:717-32..

A wide range of techniques has been used in qualitative health research as methodological strategies for gathering data. These include participant observation; document analysis; life history interviews; open-ended or semi-structured individual interviews; group interviews and focus groups 77. Denzin NL, Lincoln, Y. The Sage handbook of qualitative research. 3rd Ed. Thousand Oaks/London: Sage Publications; 2006.,88. Fossey E, Harvey C, McDermott F, Davidson L. Understanding and evaluating qualitative research. Aust N Z J Psychiatry 2002; 36:717-32.,99. Mogollón Pérez AS, Vázquez Navarrete ML. Técnicas cualitativas aplicadas en salud. In: Vázquez Navarrete ML, Silva MRF, Mogollón Pérez AS, Santos MJFS, Delgado Gallego ME, Lorenzo IV, editors. Introducción a las técnicas cualitativas de investigación aplicadas en salud. Barcelona: Universidad Autónoma de Barcelona; 2006. p. 53-82.. Focus groups are considered a modality of group interview that enables researchers to access meanings, perceptions, opinions and interactions in a shared atmosphere 66. Creswell JW. Investigação qualitativa e projeto de pesquisa. Escolhendo entre cinco abordagens. 3ª Ed. Porto Alegre: Editora Artmed; 2014.,1010. Kitzinger J. Qualitative research: introducing focus groups. BMJ 1995; 311:299-302.. Focus groups can be carried out either in qualitative or mixed methods studies and are considered a powerful tool in health research 1010. Kitzinger J. Qualitative research: introducing focus groups. BMJ 1995; 311:299-302.,1111. Krueger RA, Casey MA. Focus groups. A practical guide for applied research. 4th Ed. Thousand Oaks: Sage Publications; 2009.,1212. Morgan D. Focus groups as qualitative research. Thousand Oaks: Sage Publications; 1997.,1313. Westphal MF, Bogus CM, Mello Faria M. Focus groups: early experiences in health education programs in Brazil. Bol Oficina Sanit Panam 1996; 120:472-82.,1414. Bender DE, Ewbank D. The focus group as a tool for health research: issues in design and analysis. Health Transit Rev 1994; 4:63-80.,1515. Tausch AP, Menold N. Methodological aspects of focus groups in health research: results of qualitative interviews with focus group moderators. Glob Qual Nurs Res 2016; (3):1-12..

Many authors identify the origins of focus groups in the 1940s, with the studies of the sociologist Robert Merton, who researched the reactions to advertisements and radio transmission during the Second World War 11. Bury M. Illness narratives: fact or fiction? Sociol Health Illn 2001; 23:263-85.,22. Good B. Medicine, rationality and experience. Cambridge: Cambridge University Press; 1994.,33. Kleinman A, Eisenberg L, Good B. Culture, illness, and care: clinical lessons from anthropologic and cross-cultural research. Focus (Am Psychiatr Publ) 2006; 4:140-9.,44. Pierret J. The illness experience: state of knowledge and perspectives for research. Sociol Health Illn 2003; 25:4-22.,55. Creswell JW. Projeto de pesquisa. Métodos qualitativo, quantitativo e misto. 2ª Ed. Porto Alegre: Editora Artmed; 2010.,66. Creswell JW. Investigação qualitativa e projeto de pesquisa. Escolhendo entre cinco abordagens. 3ª Ed. Porto Alegre: Editora Artmed; 2014.,77. Denzin NL, Lincoln, Y. The Sage handbook of qualitative research. 3rd Ed. Thousand Oaks/London: Sage Publications; 2006.,88. Fossey E, Harvey C, McDermott F, Davidson L. Understanding and evaluating qualitative research. Aust N Z J Psychiatry 2002; 36:717-32.,99. Mogollón Pérez AS, Vázquez Navarrete ML. Técnicas cualitativas aplicadas en salud. In: Vázquez Navarrete ML, Silva MRF, Mogollón Pérez AS, Santos MJFS, Delgado Gallego ME, Lorenzo IV, editors. Introducción a las técnicas cualitativas de investigación aplicadas en salud. Barcelona: Universidad Autónoma de Barcelona; 2006. p. 53-82.,1010. Kitzinger J. Qualitative research: introducing focus groups. BMJ 1995; 311:299-302.,1111. Krueger RA, Casey MA. Focus groups. A practical guide for applied research. 4th Ed. Thousand Oaks: Sage Publications; 2009.,1212. Morgan D. Focus groups as qualitative research. Thousand Oaks: Sage Publications; 1997.,1616. Kidd PS, Parshall MB. Getting the focus and the group: enhancing analytical rigor in focus group research. Qual Health Res 2000; 10:293-308.. Some years later, focus groups began to be used in marketing research because of their relatively low cost and speed in providing reliable data. In Brazil, focus groups were also of great use to the “dialogic research method,” a method employed by the educator Paulo Freire, who was interested in giving voice to the marginalized groups through knowledge production “with” people and not “about” people 77. Denzin NL, Lincoln, Y. The Sage handbook of qualitative research. 3rd Ed. Thousand Oaks/London: Sage Publications; 2006..

Focus group consists in a group interview wherein participants discuss a certain topic, usually chosen by the researcher 1414. Bender DE, Ewbank D. The focus group as a tool for health research: issues in design and analysis. Health Transit Rev 1994; 4:63-80.. They have been widely employed in health research, aiming to illuminate the subjective and intersubjective experiences of people that suffer from some kind of distress. Focus groups function through interactions among the participants, and provide them with a forum for discussion centered on the subject investigated through conversations conducted by the researcher, playing the role of group moderator. Participants speak about their experiences and listen to each other. This setting allows the narratives to mutually illuminate participants, rendering a deeper and shared exploration of the topic discussed, producing the empirical material in a different way when compared with an individual interview. Focus groups are also used in exploratory research to generate hypotheses, build measures or complement the findings of quantitative studies 1212. Morgan D. Focus groups as qualitative research. Thousand Oaks: Sage Publications; 1997., and to give voice to groups often silenced 1717. Lima RC, Couto MCV, Delgado PGG, Oliveira BCD. Indicadores sobre o cuidado a crianças e adolescentes com autismo na rede de CAPSi da região metropolitana do Rio de Janeiro. Physis (Rio J.) 2014; 24:715-39.. Focus groups are not only about joining people to exchange ideas, but require certain objectives, management skills, guidelines, organization and procedures to function 1010. Kitzinger J. Qualitative research: introducing focus groups. BMJ 1995; 311:299-302.,1111. Krueger RA, Casey MA. Focus groups. A practical guide for applied research. 4th Ed. Thousand Oaks: Sage Publications; 2009.,1212. Morgan D. Focus groups as qualitative research. Thousand Oaks: Sage Publications; 1997..

Patton 1818. Patton M. Utilization-focused evaluation. Thousand Oaks: Sage Publications; 1979. highlights that focus group is a technique of data collection that provides quality control for the data, as participants’ interactions contribute to the control and balance of opinions among them, reducing, therefore, the possibility of false or radical opinions. The group interaction allows the researcher to observe how a controversy comes about and see how problems are solved 1313. Westphal MF, Bogus CM, Mello Faria M. Focus groups: early experiences in health education programs in Brazil. Bol Oficina Sanit Panam 1996; 120:472-82., evidencing different levels of consensus and divergences 1919. Furtado JP. Um método construtivista para a avaliação em saúde. Ciênc Saúde Coletiva 2001; 6:165-81..

Focus groups consider the phenomenon studied in its “naturalistic” context, that is, in the social and cultural context where the phenomenon studied occurs, rather than in experimental research settings 1414. Bender DE, Ewbank D. The focus group as a tool for health research: issues in design and analysis. Health Transit Rev 1994; 4:63-80.,2020. Kroll T, Barbour R, Harris J. Using focus groups in disability research. Qual Health Res 2007; 17:690-8.,2121. Powell RA, Single HM, Lloyd KR. Focus groups in mental health research: enhancing the validity of user and provider questionnaires. Int J Soc Psychiatry 1996; 42:193-206.. They can be used as a single technique or combined with other techniques 2222. Ekblad S, Baarnhielm S. Focus group interview research in transcultural psychiatry: reflections on research experiences. Transcult Psychiatry 2002; 39:484-500., and have been shown as a useful technique in evaluation studies to understand the complexity of participants’ life 2121. Powell RA, Single HM, Lloyd KR. Focus groups in mental health research: enhancing the validity of user and provider questionnaires. Int J Soc Psychiatry 1996; 42:193-206.. Frequently, focus groups are applied to health service evaluations based on the constructivist paradigm that inspired the fourth-generation evaluation studies 2323. Guba EL, Lincoln Y. Fourth generation evaluation. Newbury Park: Sage; 1989.. This perspective assumes that reality is plural, socially constructed by actions and interactions, by different social groups 77. Denzin NL, Lincoln, Y. The Sage handbook of qualitative research. 3rd Ed. Thousand Oaks/London: Sage Publications; 2006.,2323. Guba EL, Lincoln Y. Fourth generation evaluation. Newbury Park: Sage; 1989..

Focus groups can provide an atmosphere of mutual support. Because of that, they have been increasingly used with people living with disabilities, historically stigmatized. In this sense, focus groups have gained popularity in the field of disability research 77. Denzin NL, Lincoln, Y. The Sage handbook of qualitative research. 3rd Ed. Thousand Oaks/London: Sage Publications; 2006. due to their openness, flexibility and potential benefits, such as empowering vulnerable groups, strengthening mutuality and enabling the constitution of social identities 2020. Kroll T, Barbour R, Harris J. Using focus groups in disability research. Qual Health Res 2007; 17:690-8.,2424. Owen S. The practical, methodological and ethical dilemmas of conducting focus groups with vulnerable clients. J Adv Nurs 2001; 36:652-8.. Powell & Single 2525. Powell RA, Single HM. Focus groups. Int J Qual Health Care 1996; 8:499-504. suggest that focus groups have potential benefits, once it enables researchers to access a wide range of perspectives held by the participants.

Although there are supposed benefits, focus groups also have some disadvantages. Comparing with in-depth interviews, focus groups are most likely to access participants’ experiences in a superficial way 2525. Powell RA, Single HM. Focus groups. Int J Qual Health Care 1996; 8:499-504., and they also demand considerable effort for organization and logistics, requiring more time 1515. Tausch AP, Menold N. Methodological aspects of focus groups in health research: results of qualitative interviews with focus group moderators. Glob Qual Nurs Res 2016; (3):1-12. and availability 2626. Wong LP. Focus group discussion: a tool for health and medical research. Singapore Med J 2008; 49:256-60.. Sometimes the discussion goes in an unwanted direction, bringing difficulties for the moderator, who may bias the results by giving cues or inducing responses 2727. Stewart DW, Shamdasani PN. Focus groups: theory & practice. Newbury Park: Sage; 2015.. Moreover, focus groups require complex methods of analysis, considering the interactional context, and the small number of respondents can limit the transferability of findings to other contexts 1515. Tausch AP, Menold N. Methodological aspects of focus groups in health research: results of qualitative interviews with focus group moderators. Glob Qual Nurs Res 2016; (3):1-12.,2525. Powell RA, Single HM. Focus groups. Int J Qual Health Care 1996; 8:499-504..

In the last ten years, focus groups have been increasingly used in mental health research 2020. Kroll T, Barbour R, Harris J. Using focus groups in disability research. Qual Health Res 2007; 17:690-8.,2828. Todd NJ, Jones SH, Lobban FA. What do service users with bipolar disorder want from a web-based self-management intervention? A qualitative focus group study. Clin Psychol Psychother 2013; 20:531-43.,2929. Martin L, Hirdes JP. Exploring the impact of common assessment instrumentation on communication and collaboration in inpatient and community-based mental health settings: a focus group study. BMC Health Serv Res 2014; 14:457.,3030. Whitley R, Campbell RD. Stigma, agency and recovery amongst people with severe mental illness. Soc Sci Med 2014; 107:1-8. to investigate different themes, such as: the illness experience and the recovery process 3030. Whitley R, Campbell RD. Stigma, agency and recovery amongst people with severe mental illness. Soc Sci Med 2014; 107:1-8.,3131. Chernomas WM, Clarke DE, Chisholm FA. Perspectives of women living with schizophrenia. Psychiatr Serv 2000; 51:1517-21.,3232. Lopes TS, Dahl CM, Serpa Jr. OD, Leal EM, Campos RTO, Diaz AG. O processo de restabelecimento na perspectiva de pessoas com diagnóstico de transtornos do espectro esquizofrênico e de psiquiatras na rede pública de atenção psicossocial. Saúde Soc 2012; 21:558-71.,3333. Ng RMK, Pearson V, Lam M, Law CW, Chiu CPY, Chen EYH. What does recovery from schizophrenia mean? Perceptions of long-term patients. Int J Soc Psychiatry 2008; 54:118-30.,3434. Tooth B, Kalyanasundaram V, Glover H, Momenzadah S. Factors consumers identify as important to recovery from schizophrenia. Australas Psychiatry 2003;11:S70-7.,3535. Higgins A, Callaghan P, DeVries J, Keogh B, Morrissey J, Nash M, et al. Evaluation of mental health recovery and wellness recovery action planning education in Ireland: a mixed methods pre-postevaluation. J Adv Nurs 2012; 68:2418-28.; social stigma 2626. Wong LP. Focus group discussion: a tool for health and medical research. Singapore Med J 2008; 49:256-60.,3030. Whitley R, Campbell RD. Stigma, agency and recovery amongst people with severe mental illness. Soc Sci Med 2014; 107:1-8.,3636. Lee S, Lee MT, Chiu MY, Kleinman A. Experience of social stigma by people with schizophrenia in Hong Kong. Br J Psychiatry 2005; 186:153-7.,3737. Schulze B, Angermeyer MC. Subjective experiences of stigma. A focus group study of schizophrenic patients, their relatives and mental health professionals. Soc Sci Med 2003; 56:299-312.; evaluation of psychosocial services/interventions 2828. Todd NJ, Jones SH, Lobban FA. What do service users with bipolar disorder want from a web-based self-management intervention? A qualitative focus group study. Clin Psychol Psychother 2013; 20:531-43.,3838. Onocko Campos RT, Furtado JP, Passos E, Ferrer AL, Miranda L, Gama CAP. Avaliação da rede de centros de atenção psicossocial: entre a saúde coletiva e a saúde mental. Rev Saúde Pública 2009; 43:16-22.,3939. Soares CB, Reale D, Brites CM. Uso de grupo focal como instrumento de avaliação de programa educacional em saúde. Rev Esc Enferm USP 2000; 34:317-22.,4040. Wetzel C, Kantorski LP. Avaliação de serviços em saúde mental no contexto da reforma psiquiátrica. Texto & Contexto Enferm 2004; 13:543-8., of primary care services 4141. Lester H, Tritter JQ, Sorohan H. Patients' and health professionals' views on primary care for people with serious mental illness: focus group study. BMJ 2005; 330:1122. and training programs 4242. Dahl CM, Carvalho MCA, Mendonca JMT, Souza FM, Bustos MWE, Santos JFC, et al. ¿Soy loco, pero estoy en red?: el proceso de capacitación con usuarios de servicios de salud mental para el trabajo de ayuda entre pares en la red de atención psicosocial de Río de Janeiro. Vertex Rev Argent Psiquiatr 2013; XXIV:445-54., for developing measures 4343. Rowe M, Clayton A, Benedict P, Bellamy C, Antunes K, Miller R, et al. Going to the source: creating a citizenship outcome measure by community-based participatory research methods. Psychiatr Serv 2012; 63:445-50.,4444. Sweeney A, Rose D, Clement S, Jichi F, Jones IR, Burns T, et al. Understanding service user-defined continuity of care and its relationship to health and social measures: a cross-sectional study. BMC Health Serv Res 2012; 12:145. or validation of structured questionnaires 2121. Powell RA, Single HM, Lloyd KR. Focus groups in mental health research: enhancing the validity of user and provider questionnaires. Int J Soc Psychiatry 1996; 42:193-206.. However, few studies discuss focus group potentials and limitations when conducted with people with psychosocial disabilities.

This technique presents additional advantages when conducted with mental health service users, once it refers to a population with less contractual power, whose knowledge about their own experiences are not socially legitimated 1010. Kitzinger J. Qualitative research: introducing focus groups. BMJ 1995; 311:299-302. a priori, the group setting can create an ambience of mutual support and recognition. It also permits more freedom for eliciting narratives and can minimize the verticality that usually exists in the relation between researcher and participants, as characterized by the individual interview setting, increasing the reliability of empirical data 4545. Moeke-Maxwell T, Wells D, Mellsop GW. Tangata whaiora/consumers perspectives on current psychiatric classification systems. Int J Ment Health Syst 2008; 2:7.,4646. Kidd PS, Parshall MB. Getting the focus and the group: enhancing analytical rigor in focus group research. Qualit Health Res 2000; 10:293-308.. Furthermore, it allows participants to feel more comfortable, even stimulating the participation of those who have more difficulties to speak about themselves 1010. Kitzinger J. Qualitative research: introducing focus groups. BMJ 1995; 311:299-302..

Because it is a promising technique to elicit narratives and to empower service users in health research, it is necessary to deepen the discussion about what are the challenges, possibilities and limitations we face by conducting focus group with people with serious mental illness 1414. Bender DE, Ewbank D. The focus group as a tool for health research: issues in design and analysis. Health Transit Rev 1994; 4:63-80.,2626. Wong LP. Focus group discussion: a tool for health and medical research. Singapore Med J 2008; 49:256-60.,4747. Colucci E. "Focus groups can be fun": the use of activity-oriented questions in focus group discussions. Qualit Health Res 2007; 17:1422-33.,4848. Goss GL. Focus group interviews: a methodology for socially sensitive research. Clin Excell Nurse Pract 1998; 2:30-4.,4949. Greenwood J, Parsons M. A guide to the use of focus groups in health care research: part 2. Contemp Nurse 2000; 9:181-91.,5050. Parsons M, Greenwood J. A guide to the use of focus groups in health care research: part 1. Contemp Nurse 2000; 9:169-80.,5151. Sharts-Hopko NC. Focus group methodology: when and why? J Assoc Nurses AIDS Care 2001; 12:89-91.,5252. Wiggins GS. The analysis of focus groups in published research articles. Can J Program Eval 2004; 19:12., a group that suffer from stigmatization and that finds unique ways of telling their life story.

This study presents the practical, methodological and ethical challenges that were found in three studies that used focus groups with people with severe mental illness, in the context of community mental health services in Brazil.

Mental health in Brazil and the context of the studies

During the last two decades, the mental health paradigm has changed from hospitals settings to a community and person-centered model in Brazil. The transformations in the mental health care started in the late 1970s, with the Brazilian Psychiatry Reform: a social and political movement that fought for the rights of people with mental health problems. This movement is known to have included the participation and engagement of service users and their families in the health system 5353. Vasconcelos EM. Dispositivos associativos de luta e empoderamento de usuários, familiares e trabalhadores em saúde mental no Brasil. Vivencia 2007; 32:34.,5454. Tenório F. A reforma psiquiátrica brasileira, da década de 1980 aos dias atuais: história e conceito. Hist Ciênc Saúde-Manguinhos 2002; 9:25-59..

From the 1990s to the 2000s, the Brazilian Psychiatric Reform gained more representativeness and legitimacy boosted by Caracas Declaration. The launching of the Brazilian mental health law (Law n. 10,216/2001) and financial reinforcement of public policies have contributed to the development of mental health system 5353. Vasconcelos EM. Dispositivos associativos de luta e empoderamento de usuários, familiares e trabalhadores em saúde mental no Brasil. Vivencia 2007; 32:34.,5454. Tenório F. A reforma psiquiátrica brasileira, da década de 1980 aos dias atuais: história e conceito. Hist Ciênc Saúde-Manguinhos 2002; 9:25-59.,5555. Saraceno B, van Ommeren M, Batniji R, Cohen A, Gureje O, Mahoney J, et al. Barriers to improvement of mental health services in low-income and middle-income countries. Lancet 2007; 370:1164-74. through the implementation of Psychosocial Care Centers (CAPS) 5656. Departamento de Ações Programáticas e Estratégicas, Secretaria de Atenção à Saúde, Ministério da Saúde. Saúde mental em dados. http://www.ccs.saude.gov.br/2015.
http://www.ccs.saude.gov.br/2015...
. This paradigm shift changed the way researchers evaluate mental health services, increasing the value of diverse perspectives, including users’ perspectives.

In this research, we address the authors’ experiences of developing three different studies (Table 1), informed by the theoretical framework of the Brazilian Psychiatric Reform 5454. Tenório F. A reforma psiquiátrica brasileira, da década de 1980 aos dias atuais: história e conceito. Hist Ciênc Saúde-Manguinhos 2002; 9:25-59.,5757. Pitta AMF. Um balanço da reforma psiquiátrica brasileira: instituições, atores e políticas. Ciênc Saúde Coletiva 2011; 16:4579-89. and the interpretative paradigm 77. Denzin NL, Lincoln, Y. The Sage handbook of qualitative research. 3rd Ed. Thousand Oaks/London: Sage Publications; 2006.,99. Mogollón Pérez AS, Vázquez Navarrete ML. Técnicas cualitativas aplicadas en salud. In: Vázquez Navarrete ML, Silva MRF, Mogollón Pérez AS, Santos MJFS, Delgado Gallego ME, Lorenzo IV, editors. Introducción a las técnicas cualitativas de investigación aplicadas en salud. Barcelona: Universidad Autónoma de Barcelona; 2006. p. 53-82., in which focus groups were conducted with people with severe mental illness in community mental health services in three Brazilian cities: Campinas (São Paulo State), Rio de Janeiro and Salvador (Bahia State). The themes studied were the evaluation of community mental health services, and their integration with primary care, as well as the subjective experiences of users and their rights. These themes still need innovative ways of analysis and evaluation 5757. Pitta AMF. Um balanço da reforma psiquiátrica brasileira: instituições, atores e políticas. Ciênc Saúde Coletiva 2011; 16:4579-89..

The aims of the studies were:

Table 1
Studies conducted by the authors using focus groups with people with severe and persistent mental disorders.

(1) Study 1: to evaluate models of healthcare, management, and professional formation in the CAPS network 3838. Onocko Campos RT, Furtado JP, Passos E, Ferrer AL, Miranda L, Gama CAP. Avaliação da rede de centros de atenção psicossocial: entre a saúde coletiva e a saúde mental. Rev Saúde Pública 2009; 43:16-22., performed in 2006-2007 with two focal groups of users diagnosed with severe mental illness, in Campinas.

(2) Study 2: to evaluate the mental health assistance provided by primary care centers situated in high social-vulnerability regions 5858. Onocko-Campos RT, Campos GW, Ferrer AL, Correa CR, Madureira PR, Gama CA, et al. Evaluation of innovative strategies in the organization of primary health care. Rev Saúde Pública 2012; 46:43-50., performed in 2007-2008 with three focal groups of users, in Campinas.

(3) Study 3: to analyze if the experience of people diagnosed with schizophrenia can inform the technical knowledge of psychiatrists and if the technical knowledge of psychiatrists can inform the experience of people diagnosed with schizophrenia 5959. Serpa Junior O, Campos RO, Malajovich N, Pitta AM, Diaz AG, Dahl C, et al. Experiência, narrativa e conhecimento: a perspectiva do psiquiatra e a do usuário. Physis (Rio J.) 2014; 24:1053-77. performed in 2009-2010 with 25 focus groups, in Campinas, Rio de Janeiro and Salvador.

Despite the historical and cultural particularities, as well as differences related to population number and urbanization process, the cities mentioned are large urban centers (metropolis) in which the psychosocial network has been implemented since the 1990s.

Regarding the research mentioned, we performed thirty focus groups conducted with the participation of community mental health service users, who had been diagnosed with severe mental illnesses, such as schizophrenia and mood disorders. The number of participants in the groups ranged from four to twelve people that met the following inclusion criteria: to be enrolled in the referred service for the past six months; to be diagnosed with persistent and severe mental illness, and to have given informed consent to participate. No participant had a previous clinical relationship with any of the researchers. The three studies had approval from ethics committee (approval letters - Study 1: n. 396/2004; Study 2: n. 562/2007; and Study 3: n. 87 Liv-02). In all cases, focus groups were developed in the context of the community mental health services, in each city, and were specially created for research purposes. Further details about the studies are found elsewhere 2828. Todd NJ, Jones SH, Lobban FA. What do service users with bipolar disorder want from a web-based self-management intervention? A qualitative focus group study. Clin Psychol Psychother 2013; 20:531-43.,4848. Goss GL. Focus group interviews: a methodology for socially sensitive research. Clin Excell Nurse Pract 1998; 2:30-4.,5959. Serpa Junior O, Campos RO, Malajovich N, Pitta AM, Diaz AG, Dahl C, et al. Experiência, narrativa e conhecimento: a perspectiva do psiquiatra e a do usuário. Physis (Rio J.) 2014; 24:1053-77..

Method

This study is based on the authors’ experiences of conducting and analyzing focus groups with people with severe mental illness to produce an analytical report that could help other researchers to face the challenges and limitations of this data collection technique. For this purpose, methodological and ethical challenges related to implementing focus groups with the target-population were identified through the research process. We used observation and field reports as techniques for producing information. The groups were audio recorded and transcribed. Data analysis was based on thematic analysis model 6060. Riessman CK. Narrative methods for the human sciences. Boston: Sage; 2008., and included fluctuant reading, codification and categorization. In all cases, two researchers (one that conducted the group and other that did not conduct focus group) read the transcripts independently, and performed the codification process. Data were grouped and organized in the following categories: planning; guide construction; recruitment, and management of the focus groups. We will discuss the changes that we found necessary to introduce to the classical focus group technique to achieve the specific goals of each study dealing with groups of participants. All participants signed the informed consent form.

Findings and discussion

On focus group planning

When comparing the focus groups performed with users of the same service with those that included users from different services, we found that same service groups were more welcoming. They created a familiar atmosphere in a short period, facilitating the participation and interaction among participants. We perceived that the participation and the interaction increased when the group sessions were conducted with the same members. Developing more than one focus group with the same participants also appeared to be useful, that is, it enhanced the considerations and insights of the participants and provided a more detailed description of the illness experience and treatment.

Depending on the author, past research establishes the total number of participants for focus groups between 4 and 12 1111. Krueger RA, Casey MA. Focus groups. A practical guide for applied research. 4th Ed. Thousand Oaks: Sage Publications; 2009.,6161. Krueger R. Focus groups: a practical guide for applied research. Beverly Hills: Sage Publications; 1988.,6262. Linville D, Lambert-Shute J, Fruhauf CA, Piercy FP. Using participatory focus groups of graduate students to improve academic departments: a case example. Qualit Rep 2003; 8:210-23.. However, according to our experiences, it was beneficial to have groups with 3 or 4 participants when the research was exploring subjective experiences of people whose accounts could be very moving. This is especially true when the participants presented difficulties with comprehension and/or speech, or when the disorder was an object of social stigma 2424. Owen S. The practical, methodological and ethical dilemmas of conducting focus groups with vulnerable clients. J Adv Nurs 2001; 36:652-8., as it is the case of people with severe mental illness in the Brazilian context. As many invited users could have psychic or physical health destabilization, which may prevent them from attending the invitation, it was very important to invite more participants than the minimum necessary, to fulfill a minimum of participants in the focus group session.

In Brazil, there is still a gap in social justice, and severely ill mental health users are often affected by inequalities and multiple stigmas, related to poverty, to the lack of education, to mental illness and/or racial discrimination. That is why the planning of focus groups must consider all these barriers in order to facilitate the participants’ attendance in group sessions (e.g., conducting focus groups near their homes or healthcare services, giving them financial compensation for public transportation, and offering them a snack have shown to be very important strategies). We did not give any other type of compensation (monetary or otherwise) to the participants. It was also important to carefully plan all these costs as part of the research budget.

On recruitment: accessing participants

The access of participants to the groups required careful consideration and time to be successful; often there was a need to get in touch again with the participants before the beginning of the group 6363. MacDougall C, Fudge E. Planning and recruiting the sample for focus groups and in-depth interviews. Qualit Health Res 2001; 11:117-26.,6464. Koppelman NF, Bourjolly JN. Conducting focus groups with women with severe psychiatric disabilities: a methodological overview. Psychiatr Rehabil J 2001; 25:142-51.. These moments, usually forgotten in the literature, were of fundamental importance to the success of the research. The reliance established with the CAPS’ teams in relation to the object of study and the researchers, as well as the reliability of the focus group participants, was key for the focus groups to take place.

Discussing the research with the mental health team and planning each activity altogether were necessary conditions for successful research and for the facilitation of access to users. Furthermore, the preliminary meetings with the participants and service teams before the focus groups were strategic elements for the recruitment process. When it was necessary to cancel the focus group for any unexpected reason, for example, the researchers remained in the service establishing contact with CAPS clinical team and with the users to maintain contact with the service.

Morgan 1212. Morgan D. Focus groups as qualitative research. Thousand Oaks: Sage Publications; 1997. recommends recruiting participants that have never met previously, so it is not recommended to use pre-existing groups as research focus groups. Due to the difficulties in recruiting people suffering from mental illness, Owen 2424. Owen S. The practical, methodological and ethical dilemmas of conducting focus groups with vulnerable clients. J Adv Nurs 2001; 36:652-8. and Koppelman & Bourjolly 6464. Koppelman NF, Bourjolly JN. Conducting focus groups with women with severe psychiatric disabilities: a methodological overview. Psychiatr Rehabil J 2001; 25:142-51. decided to use groups that already existed in the services they used for their research. In our investigation, we did not use pre-existing groups; however, in some cases, the focus group participants were treated at the same service and already knew each other. This condition, with the fact that the location where some focus groups were performed was the same where participants were being treated, contributed to a non-invasive atmosphere in a way that facilitated the interaction among participants. It would probably have been different if the group was functioning in an unknown place or with unfamiliar people; this could possibly increase some persecutory feelings, which are not rare among these participants.

On the focus group guide

The thematic guide to be discussed in the focus group is composed by a set of open-ended questions that focus on the research subject and theme of interest, for example, users’ perceptions about the service, illness, and recovery experiences. This guide, usually elaborated according to the research objectives and theoretical framework, should be brief and clear 6565. Barbour R. Doing focus groups. Thousand Oaks: Sage Publications; 2007., and works as a guide for the group moderator 1313. Westphal MF, Bogus CM, Mello Faria M. Focus groups: early experiences in health education programs in Brazil. Bol Oficina Sanit Panam 1996; 120:472-82.. Considered more of a discussion and not a group interview, the guide should be flexible. There is no rigid sequence of topics. Often they can emerge spontaneously during the discussion or can be introduced by the moderator, who will connect one topic to the other and explore the questions discussed.

The guide planned for a unique focus group session may not be integrally addressed during the first meeting because of the participants’ peculiar narratives: nonlinear narratives organize themselves; meanwhile, associative pathways are not explained to the others. In this way, the participants may answer some topics even when they seem to betake to apparently peripheral subjects, demanding more time and flexibility from the focus group moderator.

The most important subjects should not be left until the end of the session, because it is necessary to have time to discuss all the subjects 6666. Miranda L, Figueiredo MD, Ferrer AL, Onocko-Campos RT. Dos grupos focais aos grupos focais narrativos: uma descoberta no caminho da pesquisa. In: Onocko-Campos R, Furtado JP, Passos E, Benevides R, organizadores. Pesquisa avaliativa em saúde mental: desenho participativo e efeitos de narratividade. São Paulo: Aderaldo & Rothschild; 2008. p. 249-77.. People with severe mental illness usually have difficulties in maintaining concentration for longs periods, sometimes because of their medications, so it is very important for the guide construction to be brief and clear and to have enough time to complete the guide’s objectives.

Focus groups management

All focus groups were conducted by at least two researchers: the moderator and the observer who took notes. The role of the moderator was to conduct the discussion and to enable participation of the focus group members. The role of the observer was to take notes of the participants’ reports, body language, context clues, parallel speech, commentaries, and all forms of non-verbal manifestations. These notes helped in the transcription of the audio-recorded material and further codification, thematic analyses, and interpretation.

Seeking to capture the whole process of the groups and fieldwork, all the information was registered in a field diary 2424. Owen S. The practical, methodological and ethical dilemmas of conducting focus groups with vulnerable clients. J Adv Nurs 2001; 36:652-8.. The reports included the position of each participant in the setting and the group duration. The feelings and perceptions of the researchers related to the development of the groups, its contexts and the situation of each participant at the end of the group were also registered.

To effectively prioritize the voice of people who do not have their voice valued, we recommend awareness to not incur in any segregating and/or directive attitude. We also suggest having a flexible research design in order to enable necessary changes in the group trajectory. To conduct research with people diagnosed with severe mental illness means that, most of time, the research team will have to adapt itself to the group functioning and dynamic with the mental health team, as well as to the daily life and users’ singularity and idiosyncrasies. Cancelling groups due to service contingencies (no room availability, emergencies, and others), or the impossibility of developing them because of the absence of service users (barriers of access to the service, emotional instability, crisis) are situations that must be considered in research design.

Apart from these challenges, the lack of concentration, the reduced self-esteem, self-confidence, and emotional and/or hallucinatory states are some of the other difficulties faced by researchers when accessing participants’ perceptions and experiences. Owen 2424. Owen S. The practical, methodological and ethical dilemmas of conducting focus groups with vulnerable clients. J Adv Nurs 2001; 36:652-8. also found these aspects in his study with women with severe mental illness.

Thus, it is difficult to estimate the number of groups necessary for data saturation and have spending time to create a welcoming atmosphere that allows the participant to experience mutuality and to feel comfortable speaking about what his/her thoughts and feels.

Respect, empathy towards participants, knowledge and familiarity to the theme discussed, listening and communication skills, good capacity to control personal opinions and preconceptions, sense of humor, and capacity to deal with unexpected situations are some of the necessary moderator qualities and characteristics highlighted by Krueger & Casey 1111. Krueger RA, Casey MA. Focus groups. A practical guide for applied research. 4th Ed. Thousand Oaks: Sage Publications; 2009.. These abilities are necessary to cope with some difficulties, such as participants who refuse to share their experiences, opinions, and thoughts or even those who find it difficult to express their feelings, to follow social rules practiced in the group and to respect the confidentiality. All these issues can be intensified in people with severe mental illness 6262. Linville D, Lambert-Shute J, Fruhauf CA, Piercy FP. Using participatory focus groups of graduate students to improve academic departments: a case example. Qualit Rep 2003; 8:210-23. and we, therefore, highlight the need for a very well trained research team.

It is also necessary not to tire the participants out. Therefore, the focus group duration in our studies varied from one to one and a half hours, and sometimes, the participants themselves asked to conclude the discussion. This shows the establishment of a welcoming and open atmosphere, allowing for spontaneity and flexibility 6464. Koppelman NF, Bourjolly JN. Conducting focus groups with women with severe psychiatric disabilities: a methodological overview. Psychiatr Rehabil J 2001; 25:142-51. and considering the possibility of not covering all the topics proposed to be discussed in the group session.

At times, there will be the possibility of encountering a moderator that does not integrate well into the research team, who does not have a specific formation, and certain intersubjective abilities, such as knowing how to listen to the participants who do not get involved in the discussion 1111. Krueger RA, Casey MA. Focus groups. A practical guide for applied research. 4th Ed. Thousand Oaks: Sage Publications; 2009.,1212. Morgan D. Focus groups as qualitative research. Thousand Oaks: Sage Publications; 1997.. In our research, the professionals that conducted the focus groups had fieldwork and research experience as well as clinical experience with mental health service users. This allowed us to be aware of the study object and objectives, as well as to reflect on the group dynamic and the interaction between participants and researchers. A group setting where the researcher does not consider the clinical aspect could interfere with the quality of data produced 6565. Barbour R. Doing focus groups. Thousand Oaks: Sage Publications; 2007..

In order to manage and address clinical issues resulting from the discussion in the group, sometimes we also included a mental health team member to provide “clinical support”, being inside the group without any research responsibility, but only in case of any destabilized user in the group context. These clinical supporters never were somebody with clinical responsibilities towards any of the focus group participants. Similar attitudes were outlined by Owen 2424. Owen S. The practical, methodological and ethical dilemmas of conducting focus groups with vulnerable clients. J Adv Nurs 2001; 36:652-8. and Koppelman & Bourjolly 6464. Koppelman NF, Bourjolly JN. Conducting focus groups with women with severe psychiatric disabilities: a methodological overview. Psychiatr Rehabil J 2001; 25:142-51. in focus groups developed for women with severe and persistent mental disease. As Owen 2424. Owen S. The practical, methodological and ethical dilemmas of conducting focus groups with vulnerable clients. J Adv Nurs 2001; 36:652-8. highlighted, we also observed the importance of other arrangements of permanent care, such as discussing periodically with the service teams topics regarding research and clinical issues related to focus group conduction and treatment.

The group moderation needs to be flexible, to balance possible asymmetries between the users’ participation and to include all voices, even the accounts that are apparently out of focus 6767. Franz N. The unfocused focus groups: benefit or bane? Qualit Rep 2011; 6:9.. Management of time and the interaction among participants and the creation of a dialogic atmosphere that allows the emergence of different perspectives about the theme discussed permitted not only the emergence of consensus, but also dissent. This avoids having only an apparently homogeneous view regarding a certain subject 6868. Lehoux P, Poland B, Daudelin G. Focus group research and "the patient's view". Soc Sci Med 2006; 63:2091-104..

In our experience, the mutuality produced in the group with people with severe mental illness resulted much more from the fact that the narratives elicited were coproduced by the participants, the researchers, and the context. That is, mainly from intersubjectivity, rather than from a common trace of identity.

In one study, the focus group constituted for research a regular activity in the service after the study. On the other hand, implementing the group inside the service contributed to raising narratives centered on the symptoms 6969. Nunes ED, Castellanos MEP, Barros NF. A experiência com a doença: da entrevista à narrativa. Physis (Rio J.) 2010; 20:1341-56., on medication and complaints about the service.

It was common that participants addressed demands related to treatment, therapeutic plans, and even information about the psychiatric diagnosis to the group moderator. In such circumstances, it was explicit that the line between research and care was blurred. Such situations did not happen only because the research activities were developed in the treatment setting, but because we inquired about participants’ experiences. The questions asked by the researchers might elicit narratives and reflections referred to the illness-wellness process, giving a new meaning to the experience itself.

The researchers addressed ethical questions resulting from the blurred line between research and care, such as when and in what circumstances should community mental health teams be informed by the demands and complaints directed by the focus group participants to the researchers? Alternatively, what if the researchers perceive a participant is in a psychiatric crisis that requires clinical care? How can the researchers be sensitive to the participants’ clinical conditions while respecting, at the same time, the users, and the ethical principle of confidentiality?

Conclusion

In this study, the authors considered their vast experience in conducting focus groups with people with severe mental illness. The reflections from this experience are the strength of the article, since they allowed us to make some recommendations to other researchers about the need to modify the design and planning of the research when working with this population. Flexibilizations of the classical technique, such as reduction of group duration, establishment of a collaborative work with clinical team, reduction of the number of participants, allowed reaching the studies’ objectives through a respectful and ethical manner.

Joining different researches that used focus groups for different purposes could be considered a weakness of this article. Nevertheless, we hope that this study can stimulate other researchers to use focus groups with this population and thus contribute to give voice to an often-silenced group, as well as to reinforce the legitimacy of mental health users’ participation in evaluative research, overcoming the stigma.

Participative research strategies used with people diagnosed with severe mental illness lead us to look for alternative ways of operationalizing focus groups and to face approaching ethical and methodological challenges. In this sense, we recommend that the research design and tools should be flexible enough to consider the experiences and engagement of users and professionals involved. In this manner, the planning of the focus group should consider the characteristics of the place where they will be developed, the characteristics of the participants, and the time and resources needed to work in the field.

Considering the clinical aspect in this type of group is an ethical imperative. A connection must be established among the research team, clinical staff and the users. This is essential for the development of the focus group, for the quality of narratives elicited and the exchanges produced. In this sense, focus group must be beyond the setting. Planning the conduction of focus group, the time required for work field and the number of meetings are important tasks to deepen group discussions and to pursue research objectives.

The management of the focus group acquires even more importance, requiring empathy, expertise in managing groups, and data saturation. Intersubjective skills, such as listening and moderating without making personal evaluations and/or prejudices, and the capacity to deal with unexpected situations are also needed.

Placing intersubjectivity at the center of attention and accessing participants’ lived experience requires multiple precautions that converge into a common objective: to create a time and space where it is possible to coproduce narratives. This acquires particular importance when considering people with severe mental illness, who still suffer the consequences of prejudice. To approach narratives of people with severe mental illnesses as valuable testimony means to recognize their legitimacy. It is about an ethical position. By considering ethics, we hope to contribute to improving community mental health services, making them more porous to incorporating other values, and looking for flexible mental health services, that is, sensitive to users’ voices.

Acknowledgments

The authors would like to acknowledge the Brazilian National Research Council (CNPq), Brazilian Ministry of Health and the São Paulo State Research Foundation (Fapesp) for financial support and the mental health users and professionals who directly or indirectly participated in the study.

References

  • 1
    Bury M. Illness narratives: fact or fiction? Sociol Health Illn 2001; 23:263-85.
  • 2
    Good B. Medicine, rationality and experience. Cambridge: Cambridge University Press; 1994.
  • 3
    Kleinman A, Eisenberg L, Good B. Culture, illness, and care: clinical lessons from anthropologic and cross-cultural research. Focus (Am Psychiatr Publ) 2006; 4:140-9.
  • 4
    Pierret J. The illness experience: state of knowledge and perspectives for research. Sociol Health Illn 2003; 25:4-22.
  • 5
    Creswell JW. Projeto de pesquisa. Métodos qualitativo, quantitativo e misto. 2ª Ed. Porto Alegre: Editora Artmed; 2010.
  • 6
    Creswell JW. Investigação qualitativa e projeto de pesquisa. Escolhendo entre cinco abordagens. 3ª Ed. Porto Alegre: Editora Artmed; 2014.
  • 7
    Denzin NL, Lincoln, Y. The Sage handbook of qualitative research. 3rd Ed. Thousand Oaks/London: Sage Publications; 2006.
  • 8
    Fossey E, Harvey C, McDermott F, Davidson L. Understanding and evaluating qualitative research. Aust N Z J Psychiatry 2002; 36:717-32.
  • 9
    Mogollón Pérez AS, Vázquez Navarrete ML. Técnicas cualitativas aplicadas en salud. In: Vázquez Navarrete ML, Silva MRF, Mogollón Pérez AS, Santos MJFS, Delgado Gallego ME, Lorenzo IV, editors. Introducción a las técnicas cualitativas de investigación aplicadas en salud. Barcelona: Universidad Autónoma de Barcelona; 2006. p. 53-82.
  • 10
    Kitzinger J. Qualitative research: introducing focus groups. BMJ 1995; 311:299-302.
  • 11
    Krueger RA, Casey MA. Focus groups. A practical guide for applied research. 4th Ed. Thousand Oaks: Sage Publications; 2009.
  • 12
    Morgan D. Focus groups as qualitative research. Thousand Oaks: Sage Publications; 1997.
  • 13
    Westphal MF, Bogus CM, Mello Faria M. Focus groups: early experiences in health education programs in Brazil. Bol Oficina Sanit Panam 1996; 120:472-82.
  • 14
    Bender DE, Ewbank D. The focus group as a tool for health research: issues in design and analysis. Health Transit Rev 1994; 4:63-80.
  • 15
    Tausch AP, Menold N. Methodological aspects of focus groups in health research: results of qualitative interviews with focus group moderators. Glob Qual Nurs Res 2016; (3):1-12.
  • 16
    Kidd PS, Parshall MB. Getting the focus and the group: enhancing analytical rigor in focus group research. Qual Health Res 2000; 10:293-308.
  • 17
    Lima RC, Couto MCV, Delgado PGG, Oliveira BCD. Indicadores sobre o cuidado a crianças e adolescentes com autismo na rede de CAPSi da região metropolitana do Rio de Janeiro. Physis (Rio J.) 2014; 24:715-39.
  • 18
    Patton M. Utilization-focused evaluation. Thousand Oaks: Sage Publications; 1979.
  • 19
    Furtado JP. Um método construtivista para a avaliação em saúde. Ciênc Saúde Coletiva 2001; 6:165-81.
  • 20
    Kroll T, Barbour R, Harris J. Using focus groups in disability research. Qual Health Res 2007; 17:690-8.
  • 21
    Powell RA, Single HM, Lloyd KR. Focus groups in mental health research: enhancing the validity of user and provider questionnaires. Int J Soc Psychiatry 1996; 42:193-206.
  • 22
    Ekblad S, Baarnhielm S. Focus group interview research in transcultural psychiatry: reflections on research experiences. Transcult Psychiatry 2002; 39:484-500.
  • 23
    Guba EL, Lincoln Y. Fourth generation evaluation. Newbury Park: Sage; 1989.
  • 24
    Owen S. The practical, methodological and ethical dilemmas of conducting focus groups with vulnerable clients. J Adv Nurs 2001; 36:652-8.
  • 25
    Powell RA, Single HM. Focus groups. Int J Qual Health Care 1996; 8:499-504.
  • 26
    Wong LP. Focus group discussion: a tool for health and medical research. Singapore Med J 2008; 49:256-60.
  • 27
    Stewart DW, Shamdasani PN. Focus groups: theory & practice. Newbury Park: Sage; 2015.
  • 28
    Todd NJ, Jones SH, Lobban FA. What do service users with bipolar disorder want from a web-based self-management intervention? A qualitative focus group study. Clin Psychol Psychother 2013; 20:531-43.
  • 29
    Martin L, Hirdes JP. Exploring the impact of common assessment instrumentation on communication and collaboration in inpatient and community-based mental health settings: a focus group study. BMC Health Serv Res 2014; 14:457.
  • 30
    Whitley R, Campbell RD. Stigma, agency and recovery amongst people with severe mental illness. Soc Sci Med 2014; 107:1-8.
  • 31
    Chernomas WM, Clarke DE, Chisholm FA. Perspectives of women living with schizophrenia. Psychiatr Serv 2000; 51:1517-21.
  • 32
    Lopes TS, Dahl CM, Serpa Jr. OD, Leal EM, Campos RTO, Diaz AG. O processo de restabelecimento na perspectiva de pessoas com diagnóstico de transtornos do espectro esquizofrênico e de psiquiatras na rede pública de atenção psicossocial. Saúde Soc 2012; 21:558-71.
  • 33
    Ng RMK, Pearson V, Lam M, Law CW, Chiu CPY, Chen EYH. What does recovery from schizophrenia mean? Perceptions of long-term patients. Int J Soc Psychiatry 2008; 54:118-30.
  • 34
    Tooth B, Kalyanasundaram V, Glover H, Momenzadah S. Factors consumers identify as important to recovery from schizophrenia. Australas Psychiatry 2003;11:S70-7.
  • 35
    Higgins A, Callaghan P, DeVries J, Keogh B, Morrissey J, Nash M, et al. Evaluation of mental health recovery and wellness recovery action planning education in Ireland: a mixed methods pre-postevaluation. J Adv Nurs 2012; 68:2418-28.
  • 36
    Lee S, Lee MT, Chiu MY, Kleinman A. Experience of social stigma by people with schizophrenia in Hong Kong. Br J Psychiatry 2005; 186:153-7.
  • 37
    Schulze B, Angermeyer MC. Subjective experiences of stigma. A focus group study of schizophrenic patients, their relatives and mental health professionals. Soc Sci Med 2003; 56:299-312.
  • 38
    Onocko Campos RT, Furtado JP, Passos E, Ferrer AL, Miranda L, Gama CAP. Avaliação da rede de centros de atenção psicossocial: entre a saúde coletiva e a saúde mental. Rev Saúde Pública 2009; 43:16-22.
  • 39
    Soares CB, Reale D, Brites CM. Uso de grupo focal como instrumento de avaliação de programa educacional em saúde. Rev Esc Enferm USP 2000; 34:317-22.
  • 40
    Wetzel C, Kantorski LP. Avaliação de serviços em saúde mental no contexto da reforma psiquiátrica. Texto & Contexto Enferm 2004; 13:543-8.
  • 41
    Lester H, Tritter JQ, Sorohan H. Patients' and health professionals' views on primary care for people with serious mental illness: focus group study. BMJ 2005; 330:1122.
  • 42
    Dahl CM, Carvalho MCA, Mendonca JMT, Souza FM, Bustos MWE, Santos JFC, et al. ¿Soy loco, pero estoy en red?: el proceso de capacitación con usuarios de servicios de salud mental para el trabajo de ayuda entre pares en la red de atención psicosocial de Río de Janeiro. Vertex Rev Argent Psiquiatr 2013; XXIV:445-54.
  • 43
    Rowe M, Clayton A, Benedict P, Bellamy C, Antunes K, Miller R, et al. Going to the source: creating a citizenship outcome measure by community-based participatory research methods. Psychiatr Serv 2012; 63:445-50.
  • 44
    Sweeney A, Rose D, Clement S, Jichi F, Jones IR, Burns T, et al. Understanding service user-defined continuity of care and its relationship to health and social measures: a cross-sectional study. BMC Health Serv Res 2012; 12:145.
  • 45
    Moeke-Maxwell T, Wells D, Mellsop GW. Tangata whaiora/consumers perspectives on current psychiatric classification systems. Int J Ment Health Syst 2008; 2:7.
  • 46
    Kidd PS, Parshall MB. Getting the focus and the group: enhancing analytical rigor in focus group research. Qualit Health Res 2000; 10:293-308.
  • 47
    Colucci E. "Focus groups can be fun": the use of activity-oriented questions in focus group discussions. Qualit Health Res 2007; 17:1422-33.
  • 48
    Goss GL. Focus group interviews: a methodology for socially sensitive research. Clin Excell Nurse Pract 1998; 2:30-4.
  • 49
    Greenwood J, Parsons M. A guide to the use of focus groups in health care research: part 2. Contemp Nurse 2000; 9:181-91.
  • 50
    Parsons M, Greenwood J. A guide to the use of focus groups in health care research: part 1. Contemp Nurse 2000; 9:169-80.
  • 51
    Sharts-Hopko NC. Focus group methodology: when and why? J Assoc Nurses AIDS Care 2001; 12:89-91.
  • 52
    Wiggins GS. The analysis of focus groups in published research articles. Can J Program Eval 2004; 19:12.
  • 53
    Vasconcelos EM. Dispositivos associativos de luta e empoderamento de usuários, familiares e trabalhadores em saúde mental no Brasil. Vivencia 2007; 32:34.
  • 54
    Tenório F. A reforma psiquiátrica brasileira, da década de 1980 aos dias atuais: história e conceito. Hist Ciênc Saúde-Manguinhos 2002; 9:25-59.
  • 55
    Saraceno B, van Ommeren M, Batniji R, Cohen A, Gureje O, Mahoney J, et al. Barriers to improvement of mental health services in low-income and middle-income countries. Lancet 2007; 370:1164-74.
  • 56
    Departamento de Ações Programáticas e Estratégicas, Secretaria de Atenção à Saúde, Ministério da Saúde. Saúde mental em dados. http://www.ccs.saude.gov.br/2015
    » http://www.ccs.saude.gov.br/2015
  • 57
    Pitta AMF. Um balanço da reforma psiquiátrica brasileira: instituições, atores e políticas. Ciênc Saúde Coletiva 2011; 16:4579-89.
  • 58
    Onocko-Campos RT, Campos GW, Ferrer AL, Correa CR, Madureira PR, Gama CA, et al. Evaluation of innovative strategies in the organization of primary health care. Rev Saúde Pública 2012; 46:43-50.
  • 59
    Serpa Junior O, Campos RO, Malajovich N, Pitta AM, Diaz AG, Dahl C, et al. Experiência, narrativa e conhecimento: a perspectiva do psiquiatra e a do usuário. Physis (Rio J.) 2014; 24:1053-77.
  • 60
    Riessman CK. Narrative methods for the human sciences. Boston: Sage; 2008.
  • 61
    Krueger R. Focus groups: a practical guide for applied research. Beverly Hills: Sage Publications; 1988.
  • 62
    Linville D, Lambert-Shute J, Fruhauf CA, Piercy FP. Using participatory focus groups of graduate students to improve academic departments: a case example. Qualit Rep 2003; 8:210-23.
  • 63
    MacDougall C, Fudge E. Planning and recruiting the sample for focus groups and in-depth interviews. Qualit Health Res 2001; 11:117-26.
  • 64
    Koppelman NF, Bourjolly JN. Conducting focus groups with women with severe psychiatric disabilities: a methodological overview. Psychiatr Rehabil J 2001; 25:142-51.
  • 65
    Barbour R. Doing focus groups. Thousand Oaks: Sage Publications; 2007.
  • 66
    Miranda L, Figueiredo MD, Ferrer AL, Onocko-Campos RT. Dos grupos focais aos grupos focais narrativos: uma descoberta no caminho da pesquisa. In: Onocko-Campos R, Furtado JP, Passos E, Benevides R, organizadores. Pesquisa avaliativa em saúde mental: desenho participativo e efeitos de narratividade. São Paulo: Aderaldo & Rothschild; 2008. p. 249-77.
  • 67
    Franz N. The unfocused focus groups: benefit or bane? Qualit Rep 2011; 6:9.
  • 68
    Lehoux P, Poland B, Daudelin G. Focus group research and "the patient's view". Soc Sci Med 2006; 63:2091-104.
  • 69
    Nunes ED, Castellanos MEP, Barros NF. A experiência com a doença: da entrevista à narrativa. Physis (Rio J.) 2010; 20:1341-56.

Publication Dates

  • Publication in this collection
    13 July 2017

History

  • Received
    28 Oct 2016
  • Reviewed
    26 Jan 2017
  • Accepted
    25 Apr 2017
Escola Nacional de Saúde Pública Sergio Arouca, Fundação Oswaldo Cruz Rio de Janeiro - RJ - Brazil
E-mail: cadernos@ensp.fiocruz.br