Development of an instrument to measure the cultural competence of health care workers

Victor Pedrero Margarita Bernales Macarena Chepo Jorge Manzi Miguel Pérez Paulina Fernández About the authors

ABSTRACT

OBJECTIVE

To validate an instrument measuring the cultural competence in health care workers from Chile.

METHODS

Using Sue & Sue’s theoretical model of cultural competence, we designed a scale, which was assessed by health care workers and experts. Subsequently, the scale was applied to a sample of 483 different health care workers, during 2018 in Santiago de Chile. The analysis included: exploratory and confirmatory factor analysis, estimation of reliability, and analysis of measurement bias. Finally, the level of cultural competence was calculated for every professional who participated in this study.

RESULTS

The final scale include 14 items that are grouped into three dimensions concordant with the theoretical model: sensitivity to own prejudices, cultural knowledge, and skills to work in culturally diverse environments. This scale showed good fit in factor models, adequate reliability and lack of evidence of measurement bias. Regarding the performance of health care workers, sensitivity showed a lower level compared with the other dimensions evaluated.

CONCLUSION

The scale for measuring the level of cultural competence in health care workers (EMCC-14) is a reliable instrument, with initial support for its validity, which can be used in the Chilean context. Additionally, the results of this study could guide some possible interventions in the health sector to strengthen the level of cultural competence.

Cultural Competency; Culturally Competent Care; Health Knowledge, Attitudes, Practice; Validation Studies

INTRODUCTION

Chile has progressively become a more diverse country as 4.4% of its population is composed of foreign immigrants 11. Instituto Nacional de Estadísticas (CHL). Censo 2017: síntesis de resultados. Santiago (CHL): INE; 2018. ; of these, 12.8% declare themselves to belong to an indigenous group 11. Instituto Nacional de Estadísticas (CHL). Censo 2017: síntesis de resultados. Santiago (CHL): INE; 2018. and 3.1% of men and 2.3% of women identify themselves with a gender different from their sex of birth 22. Ministerio de Desarrollo Social (CHL). CASEN 2015. Diversidad sexual: sintesis de resultados. Santiago (CHL); 2015. . In health care, Chile is committed to providing patient-centred health care 33. Saha S, Beach MC, Cooper LA. Patient centeredness, cultural competence and healthcare quality. J Natl Med Assoc. 2008;100(11):1275-85. https://doi.org/10.1016/S0027-9684(15)31505-4
https://doi.org/10.1016/S0027-9684(15)31...
. It means, among other things, addressing the particular needs of different population groups and providing treatment free of discrimination. To achieve this, it is important to consider the role of cultural aspects in people’s relationship with the processes of health and disease 33. Saha S, Beach MC, Cooper LA. Patient centeredness, cultural competence and healthcare quality. J Natl Med Assoc. 2008;100(11):1275-85. https://doi.org/10.1016/S0027-9684(15)31505-4
https://doi.org/10.1016/S0027-9684(15)31...
.

Culture corresponds to a system of shared conceptual frameworks and schemes used by the members of a group (or subgroup) to interpret reality and relate to the world around them, including their health 44. Kagawa Singer M, Dressler W, George S, Baquet CR, Bell RA, Burhansstipanov L, et al. Culture: the missing link in health research. Soc Sci Med. 2016;170:237-46. https://doi.org/10.1016/j.socscimed.2016.07.015
https://doi.org/10.1016/j.socscimed.2016...
. When cultural aspects are not considered in health care, interactions between patients and professionals are less patient-centred, shorter, and less positive 55. Major B, Mendes WB, Dovidio JF. Intergroup relations and health disparities: a social psychological perspective. Health Psychol. 2013;32(5):514-24. https://doi.org/10.1037/a0030358
https://doi.org/10.1037/a0030358...
. Cultural competence (CC) in health refers to the permanent reflection and questioning by the health care worker about how culture – of the professional and of the patient – impacts on the interaction with the users of the health system 66. Anderson LM, Scrimshaw SC, Fullilove MT, Fielding JE, Normand J; Task Force on Community Preventive Services. Culturally competent healthcare systems: a systematic review. Am J Prev Med. 2003;24(3 Suppl):68-79. https://doi.org/10.1016/S0749-3797(02)00657-8
https://doi.org/10.1016/S0749-3797(02)00...
. CC, includes a commitment to delivering services which take into account the patient’s beliefs and actions.

Although there are different definitions of CC, it is a multidimensional concept (includes at least three areas: sensitivity, skills and knowledge) and multilevel (involves both health professionals and health systems) 77. Bernales M, Pedrero V, Obach A, Pérez C. Competencia cultural en salud: una necesidad urgente en trabajadores de la salud. Rev Med Chil. 2015;143(3):401-2. https://doi.org/10.4067/S0034-98872015000300018
https://doi.org/10.4067/S0034-9887201500...
, 88. Alizadeh S, Chavan M. Cultural competence dimensions and outcomes: a systematic review of the literature. Health Soc Care Community. 2016;24(6):e117-30. https://doi.org/10.1111/hsc.12293
https://doi.org/10.1111/hsc.12293...
. Sue & Sue 88. Alizadeh S, Chavan M. Cultural competence dimensions and outcomes: a systematic review of the literature. Health Soc Care Community. 2016;24(6):e117-30. https://doi.org/10.1111/hsc.12293
https://doi.org/10.1111/hsc.12293...
propose a conceptual framework for CC that includes these two aspects, and four levels of cultural competence are considered: individual (health professionals), professional (professional practices), organizational (institutional practices and policies), and social (social policies). At each of these levels, the following should be considered: sensitivity to prejudices, knowledge of cultural aspects, and the ability to integrate these aspects into care.

One of the relevant characteristics of CC is that it can be trained 99. Sue DW, Sue D. Counseling the culturally diverse: theory and practice. 5. ed. Hoboken, NJ: John Wiley; 2008. . However, its measurement remains a challenge, which makes it difficult to evaluate the effectiveness of interventions in this field 99. Sue DW, Sue D. Counseling the culturally diverse: theory and practice. 5. ed. Hoboken, NJ: John Wiley; 2008. . There are several scales for measuring CC, but aspects associated with their validity 1010. Truong M, Paradies Y, Priest N. Interventions to improve cultural competency in healthcare: a systematic review of reviews. BMC Health Serv Res. 2014;14:99. https://doi.org/10.1186/1472-6963-14-99
https://doi.org/10.1186/1472-6963-14-99...
, 1111. Gozu A, Beach MC, Price EG, Gary TL, Robinson K, Palacio A, et al. Self-administered instruments to measure cultural competence of health professionals: a systematic review. Teach Learn Med. 2007;19(2):180-90. https://doi.org/10.1080/10401330701333654
https://doi.org/10.1080/1040133070133365...
have been questioned. On the other hand, several instruments usually highlight the relevance of ethnic and racial aspects over other cultural encounters, which could make its use difficult in other contexts where these factors do not predominantly explain cultural diversity 1212. Shen Z. Cultural competence models and cultural competence assessment instruments in nursing. J Transcult Nurs. 2015;26(3):308-21. https://doi.org/10.1177/1043659614524790
https://doi.org/10.1177/1043659614524790...
.

This study aimed to validate a measurement instrument for CC in Chile.

METHODS

The development of the Measurement Scale of CC in health care workers in Chile (EMCC-14) considered 1313. Kumas-Tan Z, Beagan B, Loppie C, MacLeod A, Frank B. Measures of cultural competence: examining hidden assumptions. Acad Med. 2007;82(6):548-57. https://doi.org/10.1097/ACM.0b013e3180555a2d
https://doi.org/10.1097/ACM.0b013e318055...
: (i) item development, (ii) content validity study; (iii) internal structure validity analysis; (iii) reliability estimation and; (iv) bias analysis. The data collection took place in the city of Santiago de Chile during 2018.

Development of Items

In addition to considering the components proposed by Sue & Sue 88. Alizadeh S, Chavan M. Cultural competence dimensions and outcomes: a systematic review of the literature. Health Soc Care Community. 2016;24(6):e117-30. https://doi.org/10.1111/hsc.12293
https://doi.org/10.1111/hsc.12293...
, we reviewed the literature concerning CC and measurement instruments previously published. The first version of the EMCC-14 had 31 items divided into three theoretical dimensions (sensitivity, knowledge and skills) 99. Sue DW, Sue D. Counseling the culturally diverse: theory and practice. 5. ed. Hoboken, NJ: John Wiley; 2008. . The final version of the EMCC-14 has 14 items ( Table 1 ). Eight of these were adapted from previous instruments 1414. American Educational Research Association; American Psychological Association; National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: AREA; APA; NCME; 2014.

15. Cai D, Kunaviktikul W, Klunklin A, Sripusanapan A, Avant PK. Developing a cultural competence inventory for nurses in China. Int Nurs Rev. 2017;64(2):205-14. https://doi.org/10.1111/inr.12350
https://doi.org/10.1111/inr.12350...

16. Doorenbos AZ, Schim SM, Benkert R, Borse NN. Psychometric evaluation of the cultural competence assessment instrument among healthcare providers. Nurs Res. 2005;54(5):324-31. https://doi.org/10.1097/00006199-200509000-00006
https://doi.org/10.1097/00006199-2005090...
- 1717. Echeverri M, Brookover C, Kennedy K. Factor analysis of a modified version of the California Brief Multicultural Competence Scale with minority pharmacy students. Adv Health Sci Educ Theory Pract. 2011;16(5):609-26. https://doi.org/10.1007/s10459-011-9280-9
https://doi.org/10.1007/s10459-011-9280-...
and six were created by the authors.

Table 1
Cultural Competence Measurement Scale for Health Care Workers (EMCC-14), Santiago, Chile 2018.

Content Validity

A panel of experts and focus groups evaluated the initial 31 items with health care workers. Seven experts in different areas (CC in health, instrument construction and clinical care) participated in it. Each one evaluated the relevance of the 31 initial items using a 3-point Likert-type scale (1=”essential”; 2=”useful but not essential” and 3=”unnecessary”). With this information, the content validity coefficient (CVI) proposed by Lawshe was calculated. It was considered that an item should be retained when the CVI value was ≥ 0.62 1818. LaFromboise TD, Coleman HLK, Hernandez A. Development and factor structure of the Cross-Cultural Counseling Inventory-Revised. Prof Psychol Res Pract. 1991;22(5):380-8. https://doi.org/10.1037/0735-7028.22.5.380
https://doi.org/10.1037/0735-7028.22.5.3...
.

Four focus groups were organized with health care workers to find out their perceptions about the ownership and understanding of the items. Table 2 shows the characteristics of the participants. Each focus group was recorded, transcribed and subjected to thematic analysis. The health care workers referred to aspects of clarity, comprehensiveness and relevance of the questions, which led to modifications to the items in the instrument.

Table 2
Sociodemographic characteristics of participants, Santiago, Chile 2018.

Of the 31 items initially developed, nine were eliminated. The preliminary version consisted of 22 items and a 5-point Likert answer scale (1 = totally disagree, 2 = disagree, 3 = neither agree nor disagree, 4 = agree, 5 = totally agree).

Validity based on internal structure

The analysis of the internal structure provides empirical evidence of the way in which the different items are grouped according to the theoretical dimensions proposed 1313. Kumas-Tan Z, Beagan B, Loppie C, MacLeod A, Frank B. Measures of cultural competence: examining hidden assumptions. Acad Med. 2007;82(6):548-57. https://doi.org/10.1097/ACM.0b013e3180555a2d
https://doi.org/10.1097/ACM.0b013e318055...
. For this purpose, exploratory (EFA) and confirmatory (CFA) factor analyses were performed.

A sample of 483 health care workers was collected. The inclusion criteria was the direct contact with users. The total sample was randomized into two subsamples ( Table 2 ). In one of them (n = 236) EFA was performed and in the other (n = 247) CFA. The sufficiency of the sample size for the different analyses was checked by means of Monte Carlo simulation 1919. Ayre C, Scally AJ. Critical values for Lawshe’s Content Validity Ratio. Meas Eval Couns Dev. 2014;47(1):79-86. https://doi.org/10.1177/0748175613513808
https://doi.org/10.1177/0748175613513808...
, which showed that both were adequate to achieve a power of 0.80 and type error 1 < 0.05.

The KMO and Bartlett of sphericity test was performed to assess whether the data were susceptible to exploratory factor analysis (EFA) 2020. Brown TA. Confirmatory factor analysis for applied research. New York: Guilford Press; 2006. . EFA were calculated using Weight Least Squeare Mean and Variance Adjusted estimator and Varimax rotation. The number of factors was determined considering 2020. Brown TA. Confirmatory factor analysis for applied research. New York: Guilford Press; 2006.: (i) Kaiser’s criterion (eigenvalue >1); (ii) Scree plot; (iii) theoretical sense of the factor solution. A factor load ≥ 0.3 was considered appropriate and those items with loads ≥ 0.4 on two or more factors were eliminated 2020. Brown TA. Confirmatory factor analysis for applied research. New York: Guilford Press; 2006. .

For confirmatory factor analysis (CFA), the factor structure obtained by EFA was considered. The model fit was evaluated according to different goodness-of-fit indexes: Root mean square error approximation (RMSEA), Standardized root mean square residuals (SRMR), Tucker Lewis index (TLI) and Comparative fit index (CFI). A value of ≥ 0.90 for the CFI and TLI 1919. Ayre C, Scally AJ. Critical values for Lawshe’s Content Validity Ratio. Meas Eval Couns Dev. 2014;47(1):79-86. https://doi.org/10.1177/0748175613513808
https://doi.org/10.1177/0748175613513808...
was accepted as a good fit. For the RMSEA, a value close to 0.06 1919. Ayre C, Scally AJ. Critical values for Lawshe’s Content Validity Ratio. Meas Eval Couns Dev. 2014;47(1):79-86. https://doi.org/10.1177/0748175613513808
https://doi.org/10.1177/0748175613513808...
was considered and for the WRMR, < 1.0 2121. Beavers AS, Lounsbury JW, Richards JK, Huck SW, Skolits GJ, Esquivel SL. Practical considerations for using exploratory factor analysis in educational research. Pract Assess Res Eval. 2013;18(6):1-13. . Since the Chi-square index is susceptible to sample size, the ratio between the model’s chi-square and its degrees of freedom was used. Values < 3.0 suggest an acceptable fit 2222. DiStefano C, Liu J, Jiang N, Shi D. Examination of the weighted root mean square residual: evidence for trustworthiness? Struct Equ Model. 2018;25(3):453-66. https://doi.org/10.1080/10705511.2017.1390394
https://doi.org/10.1080/10705511.2017.13...
.

Reliability

Reliability was determined using Cronbach’s alpha coefficient and calculated for the total scale, for each of its dimensions, and the variations of the coefficient when eliminating items were analyzed. An alpha coefficient value of 0.7 was considered.

Bias analysis

Given the potential subjectivity of self-report scales, it is relevant to assess whether different groups of respondents understand in the same way both the questions and the response scales, as this can be a cause of measurement bias. Given the differences in the sample size of the different groups of professionals, only the presence of bias was examined among the largest groups: physicians (n = 116) and nurses (n = 217), using Differential Item Functioning Analysis (DIF), and Factor Invariance Analysis (FIA).

The presence of DIF was determined using a hierarchical ordinal regression model 2323. Kline RB. Principles and practice of structural equation modeling. 3. ed. New York: The Guilford Press; 2010. . The dependent variable was the response to each of the items and the independent variables were the membership group and the total score obtained in the instrument (model 1: total score; model 2: membership group is added: model 3 is the interaction between total score and group). It was stated that there was a bias if: (i) the difference in the fit statistic (chi-square) between models 1 and 3 was significant (p < 0.01) and (ii) the explained percentage variance variation was > 13.0% between the same models.

The FIA allows determining if the factor structure of the questionnaire is equivalent among the stakeholders (examples: physicians and nurses). To determine the presence of invariance, four successive factor models were estimated (configural, metric, scalar and strict) and compared sequentially with each other (metric v/s configural, scalar v/s metric, etc.) using the CFI 2424. Zumbo BD. A handbook on the theory and methods of Differential Item Functioning (DIF): logistic regression modeling as a unitary framework for binary and likert-type (ordinal) item scores. Ottawa (CA): Directorate of Human Resources Research and Evaluation, Department of National Defense; 1999. . A new level of invariance was accepted if the difference in CFI in the different comparisons was < 0.01 2525. Millsap RE, Yun-Tein J. Assessing factorial invariance in ordered-categorical measures. Multivar Behav Res. 2004;39(3):479-515. https://doi.org/10.1207/S15327906MBR3903_4
https://doi.org/10.1207/S15327906MBR3903...
. A scalar level of invariance is expected to affirm that the factor structure is equivalent.

To facilitate interpretation, the scores of each of the three subscales and the total instrument were scaled to a metric between 0 and 100. Descriptive analyses of the scores obtained were performed. Mann-Whitney U and ANOVA were used for subgroup analysis. Estimates were made in Mplus 8 and SPSS v21.

This study is part of the FONIS SA16I0182 project, approved by the Ethics Committee of the South East Metropolitan Health Service in Santiago, Chile, by resolution in July 2017.

RESULTS

Data were adequate for factor analysis (KMO = 0.824; Bartlet p < 0.01). The EFA showed that the initial 22 items were grouped into the three proposed theoretical dimensions. When analyzing the reliability for each of the dimensions, two items were identified as negatively affecting the reliability, which, after evaluating their content, were eliminated. The same situation was applied to another item that presented a load > 0.4 on two factors. A new factor analysis with 19 items successfully reproduced three dimensions, explaining 50.8% of the variance ( Table 3 ).

Table 3
Results of the Exploratory (EFA) and Confirmatory (CFA) Factor Analysis of the EMCC-14, Santiago, Chile 2018.

The CFA with 19 items and three factors did not show a satisfactory adjustment (RMSEA = 0.09; CFI = 0.860; TLI = 0.839). Six items were eliminated using the modification rates 1919. Ayre C, Scally AJ. Critical values for Lawshe’s Content Validity Ratio. Meas Eval Couns Dev. 2014;47(1):79-86. https://doi.org/10.1177/0748175613513808
https://doi.org/10.1177/0748175613513808...
. The model with 14 items and three dimensions showed a good fit (χ 2/df =2.03, CFI: 0.95, TLI: 0.94, RMSEA 0.065; WRMR: 0.95). The correlation between sensitivity to own prejudices and the ability to incorporate cultural aspects of users into care was not significant. The other correlations between factors were moderate ( Table 3 ).

The alpha coefficient for the overall scale was 0.7. For the dimensions of sensitivity, knowledge and skills, it was 0.65, 0.81 and 0.68 respectively.

In the DIF analysis, two items were identified that could be interpreted as biased (items 9 and 10). However, the difference in percentage variance explained between models was < 13.0% in both cases. Therefore, none of these items met sufficient statistical criteria to claim that they were biased.

In the FIA, the EMCC-14 presented configural, metric and scalar invariance ( Table 4 ). The scale maintained the same number of dimensions in both groups (configural invariance); in addition, the factor loads (metric invariance) and the item means (scalar invariance) were comparable between the groups. This suggests that the scores of physicians and nurses can be validly purchased from each other.

Table 4
EMCC-14 invariance analysis, Santiago, Chile 2018.

The descriptive analysis of the items of the EMCC-14 is found in Table 1 . The average CC score achieved in the total sample was 74.6 points (sd = 10). The dimension with the highest score was knowledge (M = 85.6, sd = 12.6), followed by skills (M = 77.7, sd = 12.7) and sensitivity to own prejudices (M = 58, sd = 22.3). This pattern was maintained by stratifying according to sex, profession, level of the health system in which they work and degree of contact with patients ( Table 5 ). Women presented lower sensitivity scores (p < 0.01), while their scores were higher in knowledge and skills (p < 0.01). Differences were also observed in the level of CC according to the participants’ profession. Physicians achieved higher levels than midwives (p < 0.001) and nutritionists (p = 0.007) in sensitivity, while scores for nutritionists were higher than for physicians in knowledge (p = 0.001).

Table 5
Average for the level of general cultural competence and each dimension in different subgroups, Santiago Chile 2018.

DISCUSSION

This study reports on the development and validation of an instrument to measure cultural competence in health care workers in Chile (EMCC-14). The analyses support the validity, reliability and high comparability between the groups with greater participation in the sample (physicians and nurses) of the EMCC-14.

Most existing questionnaires for measuring CC provide some evidence of content validity. However, many of them do not have appropriate psychometric analyses 1010. Truong M, Paradies Y, Priest N. Interventions to improve cultural competency in healthcare: a systematic review of reviews. BMC Health Serv Res. 2014;14:99. https://doi.org/10.1186/1472-6963-14-99
https://doi.org/10.1186/1472-6963-14-99...
, 1111. Gozu A, Beach MC, Price EG, Gary TL, Robinson K, Palacio A, et al. Self-administered instruments to measure cultural competence of health professionals: a systematic review. Teach Learn Med. 2007;19(2):180-90. https://doi.org/10.1080/10401330701333654
https://doi.org/10.1080/1040133070133365...
. The EMCC-14 provides both aspects, in addition to having questions that are representative of the three dimensions of CC (sensitivity, knowledge and skills 88. Alizadeh S, Chavan M. Cultural competence dimensions and outcomes: a systematic review of the literature. Health Soc Care Community. 2016;24(6):e117-30. https://doi.org/10.1111/hsc.12293
https://doi.org/10.1111/hsc.12293...
.

Moreover, based on the CFA, evidence of discriminatory validity was provided. The three measured dimensions constitute different but complementary constructs, which is reflected in the fact that the correlation between the different factors is adequate and that each of the items is exclusively related to a theoretical dimension. In the analysis of correlation between factors, an association was found between sensitivity and knowledge, and between knowledge and skills. This could indicate that working on sensitivity to one’s own prejudices would be a good precursor to CC, as has been proposed in the literature 2626. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9(2):233-55. https://doi.org/10.1207/S15328007SEM0902_5
https://doi.org/10.1207/S15328007SEM0902...
. In addition to the above, the empirical distinction reached of the constructs of sensitivity, knowledge and skills distinguishes this study from others previously published 2727. Leonard BJ, Plotnikoff GA. Awareness: the heart of cultural competence. AACN Clin Issues. 2000;11(1):51-9. , in which a greater number of dimensions are presented and the constructs that these represent tend to overlap.

The EMCC-14 shows adequate internal consistency. However, two of the subscales obtained a low reliability of 0.7, which could be explained by the small number of items in each of them. Despite this, the indices obtained are comparable with those of other instruments in this area 2727. Leonard BJ, Plotnikoff GA. Awareness: the heart of cultural competence. AACN Clin Issues. 2000;11(1):51-9. .

Most CC instruments have been validated in a single group of health care providers 1010. Truong M, Paradies Y, Priest N. Interventions to improve cultural competency in healthcare: a systematic review of reviews. BMC Health Serv Res. 2014;14:99. https://doi.org/10.1186/1472-6963-14-99
https://doi.org/10.1186/1472-6963-14-99...
, 2828. Lin CJ, Lee CK, Huang MC. Cultural competence of healthcare providers. J Nurs Res. 2016;25(3):174-86. https://doi.org/10.1097/JNR.0000000000000153
https://doi.org/10.1097/JNR.000000000000...
. This study, in addition to including a diverse sample of professionals, evaluated the statistical presence of bias among the groups with greatest representation in our sample (physicians and nurses). These analyses suggest that both the questions and the response scales of the EMCC-14 can be interpreted in an equivalent manner in both groups and, therefore, their results are comparable.

A relevant result is the low score achieved by all professionals in the sensitivity dimension. Sensitivity implies being aware of our own prejudices and preconceived notions 88. Alizadeh S, Chavan M. Cultural competence dimensions and outcomes: a systematic review of the literature. Health Soc Care Community. 2016;24(6):e117-30. https://doi.org/10.1111/hsc.12293
https://doi.org/10.1111/hsc.12293...
, 2828. Lin CJ, Lee CK, Huang MC. Cultural competence of healthcare providers. J Nurs Res. 2016;25(3):174-86. https://doi.org/10.1097/JNR.0000000000000153
https://doi.org/10.1097/JNR.000000000000...
. Our prejudices as well as stereotypes towards certain cultural groups are closely related to the way we relate to these groups 1111. Gozu A, Beach MC, Price EG, Gary TL, Robinson K, Palacio A, et al. Self-administered instruments to measure cultural competence of health professionals: a systematic review. Teach Learn Med. 2007;19(2):180-90. https://doi.org/10.1080/10401330701333654
https://doi.org/10.1080/1040133070133365...
.

Improving the sensitivity of professionals is key to achieving CC. Majumdar, Browne, Roberts and Carpio 2929. Loftin C, Hartin V, Branson M, Reyes H. Measures of cultural competence in nurses: an integrative review. Sci World J. 2013;2013:289101. https://doi.org/10.1155/2013/289101
https://doi.org/10.1155/2013/289101...
showed that a training program for health professionals focused on this area, in addition to favoring the development of sensitivity, could positively affect knowledge and skills and favorably impact user satisfaction 2929. Loftin C, Hartin V, Branson M, Reyes H. Measures of cultural competence in nurses: an integrative review. Sci World J. 2013;2013:289101. https://doi.org/10.1155/2013/289101
https://doi.org/10.1155/2013/289101...
. This is consistent with our other findings suggesting that increased sensitivity may facilitate knowledge acquisition. In turn, greater knowledge would precede greater skills in delivering culturally competent health care.

This is the first instrument to measure CC developed in Chile and represents an advance in this issue in the country. One of the strengths of this study is the inclusion of a diverse sample of health providers, from different levels of health care.

In addition, this study provides a benchmark of the level of health care worker’s CC, which is a good starting point for intervention, either by developing CC training or adapting programs that have been shown to be effective, which can address the areas of greatest deficit. In addition, the EMCC-14 could be used in the field of research on this topic, thus contributing to addressing health inequalities.

Chile has a mixed health system made up of public and private providers. This study only considered a sample of public sector workers of areas of high social vulnerability. Despite this, CC is a new issue in Chile, and it is possible that there are other variables more relevant than administrative dependence that may influence its development. Examples of this are the level of contact of professionals with different populations or individual variables (such as personality characteristics).

In addition to the evidence of the validity and reliability of the EMCC-14 provided in this study, the relationship of the scores of this instrument with other variables 1313. Kumas-Tan Z, Beagan B, Loppie C, MacLeod A, Frank B. Measures of cultural competence: examining hidden assumptions. Acad Med. 2007;82(6):548-57. https://doi.org/10.1097/ACM.0b013e3180555a2d
https://doi.org/10.1097/ACM.0b013e318055...
such as user satisfaction or trust in health care providers could also be explored. This could provide evidence for the predictive validity of EMCC. The limitations noted do not affect the validity of the results of this study.

EMCC is an instrument that has shown favorable evidence about its validity and reliability to measure the level of CC in different health care workers in Chile. Its availability is transformed into a contribution to the health care, academic training and research fields.

REFERENCES

  • 1
    Instituto Nacional de Estadísticas (CHL). Censo 2017: síntesis de resultados. Santiago (CHL): INE; 2018.
  • 2
    Ministerio de Desarrollo Social (CHL). CASEN 2015. Diversidad sexual: sintesis de resultados. Santiago (CHL); 2015.
  • 3
    Saha S, Beach MC, Cooper LA. Patient centeredness, cultural competence and healthcare quality. J Natl Med Assoc. 2008;100(11):1275-85. https://doi.org/10.1016/S0027-9684(15)31505-4
    » https://doi.org/10.1016/S0027-9684(15)31505-4
  • 4
    Kagawa Singer M, Dressler W, George S, Baquet CR, Bell RA, Burhansstipanov L, et al. Culture: the missing link in health research. Soc Sci Med. 2016;170:237-46. https://doi.org/10.1016/j.socscimed.2016.07.015
    » https://doi.org/10.1016/j.socscimed.2016.07.015
  • 5
    Major B, Mendes WB, Dovidio JF. Intergroup relations and health disparities: a social psychological perspective. Health Psychol. 2013;32(5):514-24. https://doi.org/10.1037/a0030358
    » https://doi.org/10.1037/a0030358
  • 6
    Anderson LM, Scrimshaw SC, Fullilove MT, Fielding JE, Normand J; Task Force on Community Preventive Services. Culturally competent healthcare systems: a systematic review. Am J Prev Med. 2003;24(3 Suppl):68-79. https://doi.org/10.1016/S0749-3797(02)00657-8
    » https://doi.org/10.1016/S0749-3797(02)00657-8
  • 7
    Bernales M, Pedrero V, Obach A, Pérez C. Competencia cultural en salud: una necesidad urgente en trabajadores de la salud. Rev Med Chil. 2015;143(3):401-2. https://doi.org/10.4067/S0034-98872015000300018
    » https://doi.org/10.4067/S0034-98872015000300018
  • 8
    Alizadeh S, Chavan M. Cultural competence dimensions and outcomes: a systematic review of the literature. Health Soc Care Community. 2016;24(6):e117-30. https://doi.org/10.1111/hsc.12293
    » https://doi.org/10.1111/hsc.12293
  • 9
    Sue DW, Sue D. Counseling the culturally diverse: theory and practice. 5. ed. Hoboken, NJ: John Wiley; 2008.
  • 10
    Truong M, Paradies Y, Priest N. Interventions to improve cultural competency in healthcare: a systematic review of reviews. BMC Health Serv Res. 2014;14:99. https://doi.org/10.1186/1472-6963-14-99
    » https://doi.org/10.1186/1472-6963-14-99
  • 11
    Gozu A, Beach MC, Price EG, Gary TL, Robinson K, Palacio A, et al. Self-administered instruments to measure cultural competence of health professionals: a systematic review. Teach Learn Med. 2007;19(2):180-90. https://doi.org/10.1080/10401330701333654
    » https://doi.org/10.1080/10401330701333654
  • 12
    Shen Z. Cultural competence models and cultural competence assessment instruments in nursing. J Transcult Nurs. 2015;26(3):308-21. https://doi.org/10.1177/1043659614524790
    » https://doi.org/10.1177/1043659614524790
  • 13
    Kumas-Tan Z, Beagan B, Loppie C, MacLeod A, Frank B. Measures of cultural competence: examining hidden assumptions. Acad Med. 2007;82(6):548-57. https://doi.org/10.1097/ACM.0b013e3180555a2d
    » https://doi.org/10.1097/ACM.0b013e3180555a2d
  • 14
    American Educational Research Association; American Psychological Association; National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: AREA; APA; NCME; 2014.
  • 15
    Cai D, Kunaviktikul W, Klunklin A, Sripusanapan A, Avant PK. Developing a cultural competence inventory for nurses in China. Int Nurs Rev. 2017;64(2):205-14. https://doi.org/10.1111/inr.12350
    » https://doi.org/10.1111/inr.12350
  • 16
    Doorenbos AZ, Schim SM, Benkert R, Borse NN. Psychometric evaluation of the cultural competence assessment instrument among healthcare providers. Nurs Res. 2005;54(5):324-31. https://doi.org/10.1097/00006199-200509000-00006
    » https://doi.org/10.1097/00006199-200509000-00006
  • 17
    Echeverri M, Brookover C, Kennedy K. Factor analysis of a modified version of the California Brief Multicultural Competence Scale with minority pharmacy students. Adv Health Sci Educ Theory Pract. 2011;16(5):609-26. https://doi.org/10.1007/s10459-011-9280-9
    » https://doi.org/10.1007/s10459-011-9280-9
  • 18
    LaFromboise TD, Coleman HLK, Hernandez A. Development and factor structure of the Cross-Cultural Counseling Inventory-Revised. Prof Psychol Res Pract. 1991;22(5):380-8. https://doi.org/10.1037/0735-7028.22.5.380
    » https://doi.org/10.1037/0735-7028.22.5.380
  • 19
    Ayre C, Scally AJ. Critical values for Lawshe’s Content Validity Ratio. Meas Eval Couns Dev. 2014;47(1):79-86. https://doi.org/10.1177/0748175613513808
    » https://doi.org/10.1177/0748175613513808
  • 20
    Brown TA. Confirmatory factor analysis for applied research. New York: Guilford Press; 2006.
  • 21
    Beavers AS, Lounsbury JW, Richards JK, Huck SW, Skolits GJ, Esquivel SL. Practical considerations for using exploratory factor analysis in educational research. Pract Assess Res Eval. 2013;18(6):1-13.
  • 22
    DiStefano C, Liu J, Jiang N, Shi D. Examination of the weighted root mean square residual: evidence for trustworthiness? Struct Equ Model. 2018;25(3):453-66. https://doi.org/10.1080/10705511.2017.1390394
    » https://doi.org/10.1080/10705511.2017.1390394
  • 23
    Kline RB. Principles and practice of structural equation modeling. 3. ed. New York: The Guilford Press; 2010.
  • 24
    Zumbo BD. A handbook on the theory and methods of Differential Item Functioning (DIF): logistic regression modeling as a unitary framework for binary and likert-type (ordinal) item scores. Ottawa (CA): Directorate of Human Resources Research and Evaluation, Department of National Defense; 1999.
  • 25
    Millsap RE, Yun-Tein J. Assessing factorial invariance in ordered-categorical measures. Multivar Behav Res. 2004;39(3):479-515. https://doi.org/10.1207/S15327906MBR3903_4
    » https://doi.org/10.1207/S15327906MBR3903_4
  • 26
    Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9(2):233-55. https://doi.org/10.1207/S15328007SEM0902_5
    » https://doi.org/10.1207/S15328007SEM0902_5
  • 27
    Leonard BJ, Plotnikoff GA. Awareness: the heart of cultural competence. AACN Clin Issues. 2000;11(1):51-9.
  • 28
    Lin CJ, Lee CK, Huang MC. Cultural competence of healthcare providers. J Nurs Res. 2016;25(3):174-86. https://doi.org/10.1097/JNR.0000000000000153
    » https://doi.org/10.1097/JNR.0000000000000153
  • 29
    Loftin C, Hartin V, Branson M, Reyes H. Measures of cultural competence in nurses: an integrative review. Sci World J. 2013;2013:289101. https://doi.org/10.1155/2013/289101
    » https://doi.org/10.1155/2013/289101
  • 30
    Majumdar B, Browne G, Roberts J, Carpio B. Effects of cultural sensitivity training on health care provider attitudes and patient outcomes. J Nurs Scholarsh. 2004;36(2):161-6. https://doi.org/10.1111/j.1547-5069.2004.04029.x
    » https://doi.org/10.1111/j.1547-5069.2004.04029.x

  • Funding

    CONICYT FONDEF XIII CONCURSO FONIS 2016 SA16I0182.

Publication Dates

  • Publication in this collection
    20 Mar 2020
  • Date of issue
    2020

History

  • Received
    29 Apr 2019
  • Accepted
    1 Aug 2019
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br