Cross-cultural adaptation of the Clear Communication Index to Brazilian Portuguese

Angélica Maria Cupertino Lopes Marinho Cynthia Baur Fernanda Morais Ferreira Ana Cristina Borges-Oliveira Mauro Henrique Nogueira Guimarães de Abreu About the authors

ABSTRACT

OBJECTIVE

To perform a cross-cultural adaptation of the Clear Communication Index instrument from the Centers for Disease Control and Prevention (CDC-CCI) from English to Brazilian Portuguese.

METHODS

This study comprised initial discussion about the conceptual equivalence of the instrument by a committee formed by experts on health education. We performed translations, synthesis of translations, back-translations, revision by the committee, and linguistic revision. Semantic equivalence was obtained by analyzing the referential and general meaning of each item by the committee, resulting in a pre-final version of the instrument. Subsequently, thirty professionals with health sciences degrees performed a pre-test. These professionals used the pre-final version of the instrument to assess a health education material. A questionnaire was applied to evaluate the acceptability of the instrument, the understanding of each of the 20 items, as well as the individual and professional variables. We analyzed the scores attributed to the health education material, the variables related to healthcare professionals, the proportions of the acceptability of the instrument, and the comprehension of each item.

RESULTS

After we obtained the conceptual equivalence of the instrument, the committee of experts, the instrument’s main author, and the linguist produced the pre-final version using two translations, a synthesis of the translations, and two back-translations. A general equivalence was maintained in 15 of the 20 items (75%), four of the items were slightly altered (20%), and one item was very altered (5%). Nineteen items presented referential equivalence or near equivalence (95%). We then carried out with the pre-test, in which the professionals used the pre-final version. Two items in the domains of “risks” and “main message” were unclear and needed to be revised.

CONCLUSION

The process of cross-cultural adaptation of the Clear Communication Index provided an adapted version to the Brazilian Portuguese language.

Health communication; Health education; Translations; Validation studies

INTRODUCTION

Healthcare systems should pay attention to the quality of the messages offered to the public in printed and online materials 11. Langbecker D, Janda M. Quality and readability of information materials for people with brain tumors and their families. J Cancer Educ. 2012;27(4):738-43. https://doi.org/10.1007/s13187-012-0401-9
https://doi.org/10.1007/s13187-012-0401-...
. Educational materials must be constructed based on an understanding of the target audience. Evaluations of educational materials, however, have shown several serious problems 11. Langbecker D, Janda M. Quality and readability of information materials for people with brain tumors and their families. J Cancer Educ. 2012;27(4):738-43. https://doi.org/10.1007/s13187-012-0401-9
https://doi.org/10.1007/s13187-012-0401-...
, 22. Maybury C, Horowitz AM, Wang MQ, Kleinman DV. Use of communication techniques by Maryland dentists. J Am Dent Assoc. 2013;144(12):1386-96. https://doi.org/10.14219/jada.archive.2013.0075
https://doi.org/10.14219/jada.archive.20...
, 44. Rowlands G, Protheroe J, Winkley J, Richardson M, Seed PT, Rudd R. A mismatch between population health literacy and the complexity of health information: an observational study. Br J Gen Pract. 2015;65(635):e379-86. https://doi.org/10.3399/bjgp15X685285
https://doi.org/10.3399/bjgp15X685285...
. Hence, it is recommended that the evaluation and validation of health messages should occur prior to their availability to the public 11. Langbecker D, Janda M. Quality and readability of information materials for people with brain tumors and their families. J Cancer Educ. 2012;27(4):738-43. https://doi.org/10.1007/s13187-012-0401-9
https://doi.org/10.1007/s13187-012-0401-...
, 33. Centers for Disease Control and Prevention. Simple put: a guide for creating easy-to-understand materials. 3. ed. Atlanta, GA: CDC; 2009 [cited 2018 Dec 10]. Available from: https://stacks.cdc.gov/view/cdc/11938
https://stacks.cdc.gov/view/cdc/11938...
, 55. Carson SS, Vu M, Danis M, Camhi SL, Scheunemann LP, Cox CE, et al. Development and validation of a printed information brochure for families of chronically critically ill patients. Crit Care Med. 2012;40(1):73-8. https://doi.org/10.1097/CCM.0b013e31822d7901
https://doi.org/10.1097/CCM.0b013e31822d...
.

The North American English language by Baur and Prue 66. Baur C, Prue C. The CDC Clear Communication Index is a new evidence-based tool to prepare and review health information. Health Promot Pract. 2014;15(5):629-37. https://doi.org/10.1177/1524839914538969
https://doi.org/10.1177/1524839914538969...
validated in 2014 the Clear Communication Index from the U.S. Centers for Disease Control and Prevention (CDC-CCI) as one of the instruments available in the literature to evaluate information on health. The CDC-CCI is a tool comprised of a series of questions based on health literacy and communication research. Professionals can use the CDC-CCI to develop new messages and materials about health topics and to evaluate existing ones, regardless of the format or channel of distribution. The CDC’s communication researchers developed the CDC-CCI 66. Baur C, Prue C. The CDC Clear Communication Index is a new evidence-based tool to prepare and review health information. Health Promot Pract. 2014;15(5):629-37. https://doi.org/10.1177/1524839914538969
https://doi.org/10.1177/1524839914538969...
to make sure the agency’s information is accurate, accessible, and actionable for its many different audiences. The instrument was also part of CDC’s implementation of the federal Plain Writing Act 77. The United States Government Print Office. Public Law 111 - 274 - Plain Writing Act of 2010 [cited 2019 Jan 11]. Available from: https://www.gpo.gov/fdsys/pkg/PLAW-111publ274/content-detail.html
https://www.gpo.gov/fdsys/pkg/PLAW-111pu...
, which requires federal government agencies to communicate clearly with the public, and the National Action Plan to Improve Health Literacy 88. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. National Action Plan to Improve Health Literacy. Washington, DC: CDC; 2010. [cited 2019 Feb 20]. Available from: https://health.gov/communication/hlactionplan/pdf/Health_Literacy_Action_Plan.pdf
https://health.gov/communication/hlactio...
. Both the law and action plan aim to establish clear and simple language for communication in health as the norm.

The CDC-CCI tool produces a numeric score that characterizes a message or material and is available in two versions. The full version consists of four open-ended introductory questions and 20 scored items that affect information clarity and audience comprehension, according to scientific literature 66. Baur C, Prue C. The CDC Clear Communication Index is a new evidence-based tool to prepare and review health information. Health Promot Pract. 2014;15(5):629-37. https://doi.org/10.1177/1524839914538969
https://doi.org/10.1177/1524839914538969...
. The full version works best with longer-form print materials, such as handouts, flyers, webpages, and short reports. The modified Index has the same four open-ended introductory questions and only 13 of the 20 scored items. The modified Index can be used for short messages and materials, such as social media posts, infographics, and call center or podcast scripts. The 20 scored items have yes or no response options with an assigned point value. The scoring scale is 0-100 points with 90-100 points total as the recommended scoring range. The score represents how closely the material follows the Index criteria.

Although the CDC-CCI and similar tools were developed in English to evaluate English-language materials, there are few cross-culturally adapted tools for assessing health education materials in other languages and cultural contexts, such as Brazilian Portuguese. The development of better health education materials in the Brazilian Public Health System is of utmost importance for health promotion as well as to enhance access to information in health. We chose this index for four reasons. First, this instrument presents validity and reliability in its original version 66. Baur C, Prue C. The CDC Clear Communication Index is a new evidence-based tool to prepare and review health information. Health Promot Pract. 2014;15(5):629-37. https://doi.org/10.1177/1524839914538969
https://doi.org/10.1177/1524839914538969...
. Second, it has the ability to assess “Main Message and Call to Action,” “Language,” “Information Design,” “State of the Science (scientific knowledge),” “Behavioral Recommendations,” “Numbers,” and “Risk in a short time,” 88. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. National Action Plan to Improve Health Literacy. Washington, DC: CDC; 2010. [cited 2019 Feb 20]. Available from: https://health.gov/communication/hlactionplan/pdf/Health_Literacy_Action_Plan.pdf
https://health.gov/communication/hlactio...
which is a necessary aspect in daily routines at healthcare services. Third, as it was developed to be used by healthcare professionals, mainly in public healthcare services, the index is a good fit for those responsible for health education and health publicity actions in Brazil. Fourth, since it was projected to be used during the creation and evaluation of health communication materials for a wide range of public and communication channels, it affects the general public. Thus, this study sought to conduct a cross-cultural adaptation of the original CDC-CCI instrument in English to the Brazilian Portuguese language (BR-CDC-CCI), evaluating the semantic and conceptual equivalence, acceptability, and comprehension of the items.

METHODS

This study was approved by the Research Ethics Committee of the Universidade Federal de Minas Gerais (UFMG) under protocol CAAE 79108017.9.0000.5149.

We performed a cross-cultural adaptation of the CDC-CCI to help design and assess health messages and materials 99. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2010;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
, 1010. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32. https://doi.org/10.1016/0895-4356 (93)90142-N
https://doi.org/10.1016/0895-4356 (93)90...
. Four translators participated in the development of this research (two Brazilians and two Americans); a committee of experts consisting of Professors from the Schools of Dentistry and Pharmacy of the Universidade Federal de Minas Gerais (UFMG); a linguist; the main author of the original instrument, Cynthia Baur (CB), Professor at the University of Maryland, USA; and 30 primary healthcare professionals in public health, all volunteers, from a small city of the state of Minas Gerais, southeast Brazil. The sample size of 30 was similar to other studies in the cross-cultural adaptation of healthcare instruments 1111. Praxedes MFS, Abreu MHNG, Ribeiro DD, Marcolino MS, Paiva SM, Martins MAP. Adaptação transcultural do Oral Anticoagulation Knowledge Test para o Português do Brasil. Cienc Saude Coletiva. 2017;22(5):1615-29. https://doi.org/10.1590/1413-81232017225.17782015
https://doi.org/10.1590/1413-81232017225...
and consisted of a convenience sample of health professionals with higher education degrees who work at ten Primary Health Care Units in Minas Gerais. We approached these professionals at the Primary Health Care Unit where they work, and they provided written consent to participate in this project.

The CDC-CCI instrument, in its full version, consists of four introductory open-ended questions and 20 close-ended questions, with two answer options: “Yes” (score = 1) or “No” (score = 0), which the person who performs the scoring uses to evaluate the clarity and understanding of the information. The open-ended questions have no quantitative value, and each of the other 20 items is worth 1 point. Total scores vary from zero to 20 and are converted into a score on a scale of 0–100. The recommended minimum score is 90. The 20 questions encompass seven areas: “Main Message and Call to Action,” “Language,” “Information Design,” “State of the Science (scientific knowledge),” “Behavioral Recommendations,” “Numbers,” and “Risk.” 66. Baur C, Prue C. The CDC Clear Communication Index is a new evidence-based tool to prepare and review health information. Health Promot Pract. 2014;15(5):629-37. https://doi.org/10.1177/1524839914538969
https://doi.org/10.1177/1524839914538969...
There is a short version called the “Modified Index,” with 13 questions in the same seven areas described above. For this study, we used the full version.

After consulting the author responsible for validating the instrument (CB), the cross-cultural adaptation process followed the recommendations set forth in international literature, which include conceptual and semantic equivalences 99. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2010;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
, 1010. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32. https://doi.org/10.1016/0895-4356 (93)90142-N
https://doi.org/10.1016/0895-4356 (93)90...
.

Conceptual equivalence refers to the validity of concepts (domains) explored in the instrument being adapted and is obtained through feedback from the group who will use the instrument; in this case, experts in health education. This equivalence establishes whether or not the instrument can be understood and accepted in the new cultural context. The conceptual equivalence establishes if the measurability of the seven domains in both the adapted instrument and the original are similar 1010. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32. https://doi.org/10.1016/0895-4356 (93)90142-N
https://doi.org/10.1016/0895-4356 (93)90...
.

Semantic equivalence depicts the correspondence of the meaning or correct translation of items (terms and words) 99. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2010;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
, 1010. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32. https://doi.org/10.1016/0895-4356 (93)90142-N
https://doi.org/10.1016/0895-4356 (93)90...
by a committee of experts. The semantic equivalence is based on the comparison of the meanings between the original instrument and the back-translations. Semantic equivalence can be evaluated from two aspects: a) the referential meaning that refers to similarities in meanings of items and can signal vocabulary or grammatical mistakes or discrepancies and b) the general meaning of each item that refers to the similarities of the ideas transmitted by the pairs of items.

The conceptual and semantic equivalence was obtained through translations, synthesis of the translations, back-translations, revision by a committee of experts in health, a linguist, and pre-tests ( Figure 1 ).

Figure 1
Flowchart of the steps of cross-cultural adaptation of the U.S. English language CDC-CCI to the Brazilian Portuguese language

The committee of experts in health education assessed conceptual equivalence by checking the applicability, time of use, and capacity to measure (in its 20 questions in seven sections) the domain of “clarity of health materials” by the CDC-CCI in the Brazilian context. We discussed how different public and communication channels would use this instrument. In this moment, the researchers did not assess public health professionals.

Once the experts established conceptual equivalence, the subsequent step consisted of two translations from the original English to Brazilian Portuguese (T1 and T2), by two independent translators, both Brazilian with fluency in English. One of the translators had knowledge and practice in health, having familiarity with the terms and concepts present in the instrument. The other had no specific knowledge regarding the instrument’s technical terms.

Four researchers, experts in health sciences, compared the two translations (T1 and T2), identifying discrepancies. This comparison generated a synthesis of the translations (T1 and T2), which aimed to identify possible difficulties in understanding the instrument. They compared the meaning of words in the different languages (English and Brazilian Portuguese) so that the same results were obtained in both translations.

Following the synthesis of the two translations (T1 and T2), two separate translators, native speakers from the United States with fluency in Brazilian Portuguese, performed independently two back-translations to English. The back-translators had no knowledge of the objectives of this work and did not have access to the original instrument. We sent the back-translations to the main author responsible for the validation of the original instrument (CB) in order to evaluate the quality of the translations and suggest modifications in the instrument. After this stage, the first version of the instrument was completed.

Subsequently, we conducted a review of the back-translations and a synthesis of the translations. Thus, a committee of experts composed of the same four researchers in health sciences, all four translators, a linguist, and two health professionals with experience in health research took the instrument in the original version as a reference. The establishment of a committee of experts was necessary for the achievement of a consensus regarding the conceptual and semantic equivalence of the items.

The committee of experts received the back-translation and original version of the CDC-CCI. For referential meaning, the committee evaluated these two versions without knowing which was the original and which had been back-translated 1111. Praxedes MFS, Abreu MHNG, Ribeiro DD, Marcolino MS, Paiva SM, Martins MAP. Adaptação transcultural do Oral Anticoagulation Knowledge Test para o Português do Brasil. Cienc Saude Coletiva. 2017;22(5):1615-29. https://doi.org/10.1590/1413-81232017225.17782015
https://doi.org/10.1590/1413-81232017225...
, 1414. Reichenheim ME, Moraes CL, Hasselmann MH. [Semantic equivalence of the Portuguese version of the Abuse Assessment Screen tool used for the screening of violence against pregnant women]. Rev Saude Publica. 2000;34(6):610-6. Portuguese. https://doi.org/10.1590/S0034-89102000000600008
https://doi.org/10.1590/S0034-8910200000...
. A visual analog scale was used for referential meaning evaluation. The committee judged the equivalence of the pairs of statements (original and back-translated) by consensus, with a scale from zero to 100% using the following categories: “non-equivalent” (< 80%), “near equivalent” (80−89%), and “equivalent” (90−100%).

For the general meaning evaluation, the committee used a scale from zero to 100%. They evaluated each pair of statements, having to reach a consensus. They classified them as: unaltered (UA), slightly altered (SA), very altered (VA), and completely altered (CA) 1010. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32. https://doi.org/10.1016/0895-4356 (93)90142-N
https://doi.org/10.1016/0895-4356 (93)90...
, 1111. Praxedes MFS, Abreu MHNG, Ribeiro DD, Marcolino MS, Paiva SM, Martins MAP. Adaptação transcultural do Oral Anticoagulation Knowledge Test para o Português do Brasil. Cienc Saude Coletiva. 2017;22(5):1615-29. https://doi.org/10.1590/1413-81232017225.17782015
https://doi.org/10.1590/1413-81232017225...
, 1414. Reichenheim ME, Moraes CL, Hasselmann MH. [Semantic equivalence of the Portuguese version of the Abuse Assessment Screen tool used for the screening of violence against pregnant women]. Rev Saude Publica. 2000;34(6):610-6. Portuguese. https://doi.org/10.1590/S0034-89102000000600008
https://doi.org/10.1590/S0034-8910200000...
, 1515. Streiner DL, Normam GR, Cairney J. Health measurements scales: a practical guide to their development and use. 5. ed. New York: Oxford University Press; 2015. . In this step, the committee was aware of the two versions (the original and the back-translated). The scales used for the semantic equivalence can be seen in Figure 2 .

Figure 2
The scales used in the semantic equivalence of Br-CDC-CCI. Belo Horizonte, 2019

Following semantic equivalence (referential and general meaning evaluation), the research team approached primary healthcare professionals at their places of work in Minas Gerais to perform a pre-test of the Brazilian Portuguese draft instrument (BR-CDC-CCI) in May and June 2018. The researchers asked the healthcare professionals to use the instrument to assess the health education material “Rational Use of Drugs” 1616. Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Assistência Farmacêutica e Insumos Estratégicos. Cartilha para a promoção do uso racional de medicamentos. Brasília, DF; 2015 [cited 2010 Jan 8]. Available from: http://bvsms.saude.gov.br/bvs/publicacoes/cartilha_promocao_uso_racional_medicamentos.pdf .
http://bvsms.saude.gov.br/bvs/publicacoe...
from the Ministry of Health. The research team chose this health education material because it is publicly available, about a common topic, and includes features that the CDC-CCI is designed to evaluate. The professionals used the draft BR-CDC-CCI instrument to score the “Rational Use of Drugs” material. Each of the 30 professionals completed questionnaires on the acceptability of the instrument as a whole, the understanding of each of the 20 items, and individual and professional profiles. For acceptability, we included a general and dichotomous question (“Yes” or “No”): “Do you think that this instrument would be acceptable for Brazilian professionals?” Regarding the understanding of each item, we included the following question: “After you read the BR-CDC-CCI items and evaluation criteria, mark those that were understood (“Yes”) and those that were not understood (“No”). For the items not understood, write in the corresponding space any problem with comprehension you had.” Professionals also reported the amount of time spent answering the items of the instrument. In addition, the professionals answered questions about their age, sex, time since graduation, type of health sciences degree, public service time, and whether they had completed a graduate degree.

We analyzed the scores from the 30 primary care professionals using the Statistical Package for Social Sciences (SPSS for Windows, version 25.0, SPSS Inc., Chicago, IL). The variables related to the profiles and individual characteristics of the healthcare professionals were statistically analyzed by measuring the frequency and central tendency. The statistical analyses also included the calculation of the proportions of acceptability of the instrument and comprehension of each item from the BR-CDC-CCI.

RESULTS

We carried out the cross-cultural adaptation systematically. The first assessment by the experts showed that the applicability, time of use, and capacity to obtain the necessary domains of “clarity of health materials” could be obtained in the Brazilian version of the CDC-CCI. The group considered that the instrument would be used for healthcare professionals when creating and evaluating health information materials in a wide range of communication channels and for a diverse public. They considered the instrument necessary, practical, and useful in the Brazilian context and approved its Conceptual Equivalence.

We changed some sections of the English CDC-CCI in which cities, units of measurement, or U.S. public institutions were mentioned. Examples of this first step were changes of “ Springfield ” to “São Paulo” (item 18), “ ounces ” to “grams” (item 16), and “ Public health organizations (...) (ASTHO) ” to Brazilian Health Organizations such as “CONASS, CONASEMS.” Other considerations included the exclusion of links to U.S. government agencies and institutions, where we inserted Brazilian equivalents. The author responsible for the validation of the original instrument (CB) also highlighted the need to maintain the term “primary audience” instead of “main audience” throughout the instrument. The idea of “primary” is for educators to focus on the most important audience who will use the information, even though other “secondary” audiences may also see the information if it is posted on a website, for example.

Table shows the BR-CDC-CCI adaptation process, from the synthesis of translations to the adapted version, including the conceptual and semantic equivalence evaluations. For referential equivalence, nineteen items presented equivalence or near equivalence (95%), while only question 18 was “non-equivalent.” In the general equivalence between the original instrument and the back-translation, 15 of the 20 items were unaltered (UA=75%); four of the items, questions 2, 3, 5 and 18, were slightly altered (SA=20%); and one item, question 1, was very altered (VA=5%).

Table
Semantic Equivalence (Referential Meaning Equivalence—RME and General Meaning Equivalence—GME) between the original CDC-CCI (in English) and the version in Brazilian Portuguese by a committee of experts, and Conceptual Equivalence (Comprehension-Compr. and Acceptability-Accept.) of the pre-final Brazilian version of the CDC-CCI by health professionals.

The committee of experts highlighted the need for a review by a linguist, who evaluated the material and made recommendations. The main changes occurred in questions 18, considered no referential equivalent, and 1, which was very altered. The changes, as suggested by consensus, are presented in Table . In accordance with the assessment of the committee, question 1 presented a misunderstanding by not specifying what the “Main Message” would be in the context of the information, and for not defining what the educational materials would be. The committee observed linguistic and grammatical errors in questions 2, 3, 5, and 18 and did not approve them as maximum equivalence. Among these were the differences between the terms “section” and “session” in question 2; “highlighted” and “emphasized” in question 3; “calls to action for the primary audience” and “calls to action directed to the public” in question 5; and “web” and “internet” in question 18. We corrected the differences with the aid of a linguist.

The majority of the primary healthcare professionals involved in the pre-test were female (87%), with an average age of 36.8 years (range 24–49), average time since completion of undergraduate degree of 13 years (range 3–31), and 53% with a graduate-level degree. Most of the professionals were nurses (57%), 20% were dentists, and 23% were healthcare professionals in other areas (Speech Therapist, Physician, Nutritionist, and Psychologist). In relation to professionals’ understanding of the BR-CDC-CCI items, six professionals (20%) did not understand question 18 regarding the nature of the risk, and five (17%) did not understand question 1 regarding the main message. One (3%) professional did not understand question 5, regarding call to action, and question 14, regarding behavioral directions. All 30 professionals understood the rest of the questions ( Table ).

In view of these considerations, the committee and the linguist re-evaluated questions 1, 5, 14, and 18. Items 5 and 14 were considered confusing by one professional each, since they did not understand the meaning of the words “primary audience” and the example of the nutrition behavioral recommendation using folic acid. As items 1 and 18 continued to be a problem, the committee observed that the pre-final version should be clarified, and certain sentences shortened. The committee changed the order of some words and removed others, making the final Brazilian version clearer than the previous one ( Table ).

DISCUSSION

The CDC-CCI instrument aims to contribute to the improved performance of healthcare professionals who create educational materials, since it leads them to critically analyze their own communicative capacity 1717. Kaphingst KA, Kreuter MW, Casey C, Leme L, Thompson T, Cheng MR, et al. Health Literacy INDEX: development, reliability, and validity of a new tool for evaluating the health literacy demands of health information materials. J Health Commun. 2012;17 Suppl 3:203-21. https://doi.org/10.1080/10810730.2012.712612
https://doi.org/10.1080/10810730.2012.71...
, 1818. Goto A, Lai AY, Kumagai A, Koizumi S, Yoshida K, Yamawaki K, et al. Collaborative processes of developing a health literacy toolkit: a case from Fukushima after the nuclear accident. J Health Commun. 2018;23(2):200-6. https://doi.org/10.1080/10810730.2018.1423650
https://doi.org/10.1080/10810730.2018.14...
. The use of the CDC-CCI can improve the development and transmission of health messages, as well as the public’s orientation regarding actions and better results in health 1919. Porter KJ, Alexander R, Perzynski KM, Kruzliakova N, Zoellner JM. Using the Clear Communication Index to improve materials for a behavioral intervention. Health Commun. 2019;34(7):782-8 https://doi.org/10.1080/10410236.2018.1436383
https://doi.org/10.1080/10410236.2018.14...
.

Low health literacy is considered a social determinant of health, with low literacy being a predictor of worse health outcomes 2020. Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Int Med. 2011;155(2):97-107. https://doi.org/10.7326/0003-4819-155-2-201107190-00005
https://doi.org/10.7326/0003-4819-155-2-...
, 2121. Rudd RE. The evolving concept of health literacy: new directions for health literacy studies. J Commun Health. 2015;8(1):7-8. https://doi.org/10.1179/1753806815Z.000000000105
https://doi.org/10.1179/1753806815Z.0000...
. Professionals’ use of tools to adapt health messages and materials for low literacy audiences can contribute to improvements in the public’s adherence to care and therapeutic outcomes, as well as to reduce social inequalities 2222. Batterham RW, Hawkins M, Collins PA, Buchbinder R, Osborne RH. Health literacy: applying current concepts to improve health services and reduce health inequalities. Public Health. 2016;132:3-12. https://doi.org/10.1016/j.puhe.2016.01.001
https://doi.org/10.1016/j.puhe.2016.01.0...
. The BR-CDC-CCI, after its final validation, can offer healthcare professionals a practical resource, guiding them in the creation and evaluation of materials and educational messages in health, following the example of other studies in the literature 1818. Goto A, Lai AY, Kumagai A, Koizumi S, Yoshida K, Yamawaki K, et al. Collaborative processes of developing a health literacy toolkit: a case from Fukushima after the nuclear accident. J Health Commun. 2018;23(2):200-6. https://doi.org/10.1080/10810730.2018.1423650
https://doi.org/10.1080/10810730.2018.14...
, 1919. Porter KJ, Alexander R, Perzynski KM, Kruzliakova N, Zoellner JM. Using the Clear Communication Index to improve materials for a behavioral intervention. Health Commun. 2019;34(7):782-8 https://doi.org/10.1080/10410236.2018.1436383
https://doi.org/10.1080/10410236.2018.14...
, 2323. Alpert JM, Desens L, Krist AH, Aycock RA, Kreps GL. Measuring health literacy levels of a patient portal using the CDC’s Clear Communication Index. Health Promot Pract. 2017;18(1):140-9. https://doi.org/10.1177/1524839916643703
https://doi.org/10.1177/1524839916643703...
.

The adaptation of the CDC-CCI instrument is a crucial stage, since it provides an opportunity to test its feasibility in Brazil. This study obtained the results of the conceptual and semantic equivalence using robust methods that were used in other processes for adapting instruments from English to Brazilian Portuguese 1111. Praxedes MFS, Abreu MHNG, Ribeiro DD, Marcolino MS, Paiva SM, Martins MAP. Adaptação transcultural do Oral Anticoagulation Knowledge Test para o Português do Brasil. Cienc Saude Coletiva. 2017;22(5):1615-29. https://doi.org/10.1590/1413-81232017225.17782015
https://doi.org/10.1590/1413-81232017225...
. One adapted instrument must be equivalent to the source instrument in such a way that its meaning is the same for the majority of the desired population 1010. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32. https://doi.org/10.1016/0895-4356 (93)90142-N
https://doi.org/10.1016/0895-4356 (93)90...
in their different cultural and linguistic contexts. For this, original instruments and adaptation “must dialogue with each other” according to a team of judges. These judges should have the ability to understand whether or not the representation of the original instrument is similar to the representation in its final population, which, in this context, is a final population of healthcare professionals or others involved in the development of health education materials.

In this research, two items showed that divergences need to be rigorously analyzed, and the corrected versions should be included in the final format of an instrument. The misunderstanding generated by items 1 (main message) and 18 (nature of risk) made it difficult to evaluate the domains “Main Message” and “Risk” in the Brazilian context. These items were misunderstood in the process of obtaining equivalence (referential and general) and remained critical during the pre-test with 30 health professionals. Such misunderstanding may have two possible causes: semantic/syntax difficulty or the professionals did not consider these two items relevant for evaluation. The second reason could result in the exclusion of items for the Brazilian context, given that the “Main Message” and “Risk” domains would perform differently than the original instrument. As the problems detected were of syntax, our corrections allowed the two domains to follow the original instrument.

Following the evaluation by the committee, the pre-test version of question 1 remained the same as in the synthesis of the translations, but the pre-test with the 30 professionals showed they were confused about what the “Main Message” would be. Modifications to the order of words made the question clearer. In question 18, the word “damage,” contained in the explanation of the question, was replaced by “risk,” repeating the term already used in the question to reinforce the meaning in the original version of the CDC-CCI. We corrected the misunderstanding on what the instrument calls the “Main Message” and “Risk” during the adaptation process. These findings reinforce those found in other studies, highlighting the importance of the work of the committee of experts and pre-test in cross-cultural adaptations 1111. Praxedes MFS, Abreu MHNG, Ribeiro DD, Marcolino MS, Paiva SM, Martins MAP. Adaptação transcultural do Oral Anticoagulation Knowledge Test para o Português do Brasil. Cienc Saude Coletiva. 2017;22(5):1615-29. https://doi.org/10.1590/1413-81232017225.17782015
https://doi.org/10.1590/1413-81232017225...
, 1212. Jeon KY. Cross-cultural adaptation of the US consumer form of the short Primary Care Assessment Tool (PCAT): the Korean consumer form of the short PCAT (KC PCAT) and the Korean standard form of the short PCAT (KS PCAT). Qual Prim Care. 2011;19(2):85-103. , 1414. Reichenheim ME, Moraes CL, Hasselmann MH. [Semantic equivalence of the Portuguese version of the Abuse Assessment Screen tool used for the screening of violence against pregnant women]. Rev Saude Publica. 2000;34(6):610-6. Portuguese. https://doi.org/10.1590/S0034-89102000000600008
https://doi.org/10.1590/S0034-8910200000...
, 1515. Streiner DL, Normam GR, Cairney J. Health measurements scales: a practical guide to their development and use. 5. ed. New York: Oxford University Press; 2015. .

This study also observed the importance of the participation of translators compatible with the criteria that the literature advocates. The independent translations and back-translations allowed us to locate the errors and discrepancies in ambiguous or unmatched items between the two languages. Translation by both a translator with health training and one without this training made it possible to detect a greater range of difficulties in understanding the instrument 1111. Praxedes MFS, Abreu MHNG, Ribeiro DD, Marcolino MS, Paiva SM, Martins MAP. Adaptação transcultural do Oral Anticoagulation Knowledge Test para o Português do Brasil. Cienc Saude Coletiva. 2017;22(5):1615-29. https://doi.org/10.1590/1413-81232017225.17782015
https://doi.org/10.1590/1413-81232017225...
. The author of the instrument observed additional discrepancies or misalignments not detected during translation, synthesis, or back-translations, giving greater credibility and fidelity to the initial proposal.

A future study will evaluate some psychometric properties of the BR-CDC-CCI, after we complete this cross-cultural adaptation. The adapted instrument still needs to undergo a process of evaluation in larger groups of professionals and materials. Despite the fact that the Brazilian National Health System has the same principles –such as comprehensiveness, universality, equitability– for the whole country, some cultural differences between regions and professional groups are likely to occur. Testing the BR-CDC-CCI with a larger number of health professionals located in different Brazilian regions and professionals with different training and experiences is necessary. These evaluation methods could allow the assessment of reliability and validity. We also will do a qualitative assessment to compare this instrument with others 66. Baur C, Prue C. The CDC Clear Communication Index is a new evidence-based tool to prepare and review health information. Health Promot Pract. 2014;15(5):629-37. https://doi.org/10.1177/1524839914538969
https://doi.org/10.1177/1524839914538969...
, 1717. Kaphingst KA, Kreuter MW, Casey C, Leme L, Thompson T, Cheng MR, et al. Health Literacy INDEX: development, reliability, and validity of a new tool for evaluating the health literacy demands of health information materials. J Health Commun. 2012;17 Suppl 3:203-21. https://doi.org/10.1080/10810730.2012.712612
https://doi.org/10.1080/10810730.2012.71...
, 1818. Goto A, Lai AY, Kumagai A, Koizumi S, Yoshida K, Yamawaki K, et al. Collaborative processes of developing a health literacy toolkit: a case from Fukushima after the nuclear accident. J Health Commun. 2018;23(2):200-6. https://doi.org/10.1080/10810730.2018.1423650
https://doi.org/10.1080/10810730.2018.14...
. Other instruments that evaluate the quality of written clinical treatment choices could also be used when we evaluate and create health education materials 2424. Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53(2):105-11. https://doi.org/10.1136/jech.53.2.105
https://doi.org/10.1136/jech.53.2.105...
, 2525. Rees CE, Ford JE, Sheard CE. Evaluating the reliability of DISCERN: a tool for assessing the quality of written patient information on treatment choices. Patient Educ Couns. 2002;47(3):273-5. https://doi.org/10.1016/S0738-3991 (01)00225-7
https://doi.org/10.1016/S0738-3991 (01)0...
. In conclusion, the process of cross-cultural adaptation of the Clear Communication Index provided an adapted instrument to the Brazilian Portuguese language, which this is the first step in a longer process of testing and refining the BR-CDC-CCI for broad use among health professionals.

REFERENCES

  • 1
    Langbecker D, Janda M. Quality and readability of information materials for people with brain tumors and their families. J Cancer Educ. 2012;27(4):738-43. https://doi.org/10.1007/s13187-012-0401-9
    » https://doi.org/10.1007/s13187-012-0401-9
  • 2
    Maybury C, Horowitz AM, Wang MQ, Kleinman DV. Use of communication techniques by Maryland dentists. J Am Dent Assoc. 2013;144(12):1386-96. https://doi.org/10.14219/jada.archive.2013.0075
    » https://doi.org/10.14219/jada.archive.2013.0075
  • 3
    Centers for Disease Control and Prevention. Simple put: a guide for creating easy-to-understand materials. 3. ed. Atlanta, GA: CDC; 2009 [cited 2018 Dec 10]. Available from: https://stacks.cdc.gov/view/cdc/11938
    » https://stacks.cdc.gov/view/cdc/11938
  • 4
    Rowlands G, Protheroe J, Winkley J, Richardson M, Seed PT, Rudd R. A mismatch between population health literacy and the complexity of health information: an observational study. Br J Gen Pract. 2015;65(635):e379-86. https://doi.org/10.3399/bjgp15X685285
    » https://doi.org/10.3399/bjgp15X685285
  • 5
    Carson SS, Vu M, Danis M, Camhi SL, Scheunemann LP, Cox CE, et al. Development and validation of a printed information brochure for families of chronically critically ill patients. Crit Care Med. 2012;40(1):73-8. https://doi.org/10.1097/CCM.0b013e31822d7901
    » https://doi.org/10.1097/CCM.0b013e31822d7901
  • 6
    Baur C, Prue C. The CDC Clear Communication Index is a new evidence-based tool to prepare and review health information. Health Promot Pract. 2014;15(5):629-37. https://doi.org/10.1177/1524839914538969
    » https://doi.org/10.1177/1524839914538969
  • 7
    The United States Government Print Office. Public Law 111 - 274 - Plain Writing Act of 2010 [cited 2019 Jan 11]. Available from: https://www.gpo.gov/fdsys/pkg/PLAW-111publ274/content-detail.html
    » https://www.gpo.gov/fdsys/pkg/PLAW-111publ274/content-detail.html
  • 8
    U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. National Action Plan to Improve Health Literacy. Washington, DC: CDC; 2010. [cited 2019 Feb 20]. Available from: https://health.gov/communication/hlactionplan/pdf/Health_Literacy_Action_Plan.pdf
    » https://health.gov/communication/hlactionplan/pdf/Health_Literacy_Action_Plan.pdf
  • 9
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2010;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014
    » https://doi.org/10.1097/00007632-200012150-00014
  • 10
    Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32. https://doi.org/10.1016/0895-4356 (93)90142-N
    » https://doi.org/10.1016/0895-4356 (93)90142-N
  • 11
    Praxedes MFS, Abreu MHNG, Ribeiro DD, Marcolino MS, Paiva SM, Martins MAP. Adaptação transcultural do Oral Anticoagulation Knowledge Test para o Português do Brasil. Cienc Saude Coletiva. 2017;22(5):1615-29. https://doi.org/10.1590/1413-81232017225.17782015
    » https://doi.org/10.1590/1413-81232017225.17782015
  • 12
    Jeon KY. Cross-cultural adaptation of the US consumer form of the short Primary Care Assessment Tool (PCAT): the Korean consumer form of the short PCAT (KC PCAT) and the Korean standard form of the short PCAT (KS PCAT). Qual Prim Care. 2011;19(2):85-103.
  • 13
    Klotz SGR, Petersen-Ewert C, Ketels G, Scherer M, Barzel A. The German version of the Functional Walking Categories (FWC): translation and initial validation. Top Stroke Rehabil. 2019;26(1):49-57. https://doi.org/10.1080/10749357.2018.1536022
    » https://doi.org/10.1080/10749357.2018.1536022
  • 14
    Reichenheim ME, Moraes CL, Hasselmann MH. [Semantic equivalence of the Portuguese version of the Abuse Assessment Screen tool used for the screening of violence against pregnant women]. Rev Saude Publica. 2000;34(6):610-6. Portuguese. https://doi.org/10.1590/S0034-89102000000600008
    » https://doi.org/10.1590/S0034-89102000000600008
  • 15
    Streiner DL, Normam GR, Cairney J. Health measurements scales: a practical guide to their development and use. 5. ed. New York: Oxford University Press; 2015.
  • 16
    Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Assistência Farmacêutica e Insumos Estratégicos. Cartilha para a promoção do uso racional de medicamentos. Brasília, DF; 2015 [cited 2010 Jan 8]. Available from: http://bvsms.saude.gov.br/bvs/publicacoes/cartilha_promocao_uso_racional_medicamentos.pdf .
    » http://bvsms.saude.gov.br/bvs/publicacoes/cartilha_promocao_uso_racional_medicamentos.pdf
  • 17
    Kaphingst KA, Kreuter MW, Casey C, Leme L, Thompson T, Cheng MR, et al. Health Literacy INDEX: development, reliability, and validity of a new tool for evaluating the health literacy demands of health information materials. J Health Commun. 2012;17 Suppl 3:203-21. https://doi.org/10.1080/10810730.2012.712612
    » https://doi.org/10.1080/10810730.2012.712612
  • 18
    Goto A, Lai AY, Kumagai A, Koizumi S, Yoshida K, Yamawaki K, et al. Collaborative processes of developing a health literacy toolkit: a case from Fukushima after the nuclear accident. J Health Commun. 2018;23(2):200-6. https://doi.org/10.1080/10810730.2018.1423650
    » https://doi.org/10.1080/10810730.2018.1423650
  • 19
    Porter KJ, Alexander R, Perzynski KM, Kruzliakova N, Zoellner JM. Using the Clear Communication Index to improve materials for a behavioral intervention. Health Commun. 2019;34(7):782-8 https://doi.org/10.1080/10410236.2018.1436383
    » https://doi.org/10.1080/10410236.2018.1436383
  • 20
    Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Int Med. 2011;155(2):97-107. https://doi.org/10.7326/0003-4819-155-2-201107190-00005
    » https://doi.org/10.7326/0003-4819-155-2-201107190-00005
  • 21
    Rudd RE. The evolving concept of health literacy: new directions for health literacy studies. J Commun Health. 2015;8(1):7-8. https://doi.org/10.1179/1753806815Z.000000000105
    » https://doi.org/10.1179/1753806815Z.000000000105
  • 22
    Batterham RW, Hawkins M, Collins PA, Buchbinder R, Osborne RH. Health literacy: applying current concepts to improve health services and reduce health inequalities. Public Health. 2016;132:3-12. https://doi.org/10.1016/j.puhe.2016.01.001
    » https://doi.org/10.1016/j.puhe.2016.01.001
  • 23
    Alpert JM, Desens L, Krist AH, Aycock RA, Kreps GL. Measuring health literacy levels of a patient portal using the CDC’s Clear Communication Index. Health Promot Pract. 2017;18(1):140-9. https://doi.org/10.1177/1524839916643703
    » https://doi.org/10.1177/1524839916643703
  • 24
    Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53(2):105-11. https://doi.org/10.1136/jech.53.2.105
    » https://doi.org/10.1136/jech.53.2.105
  • 25
    Rees CE, Ford JE, Sheard CE. Evaluating the reliability of DISCERN: a tool for assessing the quality of written patient information on treatment choices. Patient Educ Couns. 2002;47(3):273-5. https://doi.org/10.1016/S0738-3991 (01)00225-7
    » https://doi.org/10.1016/S0738-3991 (01)00225-7

  • Funding

    This study was partially funded by CAPES (process 001), CNPq (307617 / 2015-7).

Publication Dates

  • Publication in this collection
    16 Mar 2020
  • Date of issue
    2020

History

  • Received
    03 Mar 2019
  • Accepted
    09 Aug 2019
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br