Participants’ understanding of informed consent in clinical trials over three decades: systematic review and meta-analysis

Compréhension du consentement éclairé par les participants à des essais cliniques sur trois décennies: revue systématique et méta-analyse

La comprensión del consentimiento informado por parte de los participantes de ensayos clínicos a lo largo de tres décadas: revisión sistemática y metaanálisis

فهم المشاركين للموافقة المستنيرة في التجارب السريرية على مدى ثلاثة عقود: استعراض منهجي وتحليل تالٍ

三十年来临床试验中参与者对知情同意的理解:系统回顾和荟萃分析

Понимание участниками клинических исследований информированного согласия за три десятилетия: систематический обзор и мета-анализ

Nguyen Thanh Tam Nguyen Tien Huy Le Thi Bich Thoa Nguyen Phuoc Long Nguyen Thi Huyen Trang Kenji Hirayama Juntra Karbwang About the authors

Objective

To estimate the proportion of participants in clinical trials who understand different components of informed consent.

Methods

Relevant studies were identified by a systematic review of PubMed, Scopus and Google Scholar and by manually reviewing reference lists for publications up to October 2013. A meta-analysis of study results was performed using a random-effects model to take account of heterogeneity.

Findings

The analysis included 103 studies evaluating 135 cohorts of participants. The pooled proportion of participants who understood components of informed consent was 75.8% for freedom to withdraw at any time, 74.7% for the nature of study, 74.7% for the voluntary nature of participation, 74.0% for potential benefits, 69.6% for the study’s purpose, 67.0% for potential risks and side-effects, 66.2% for confidentiality, 64.1% for the availability of alternative treatment if withdrawn, 62.9% for knowing that treatments were being compared, 53.3% for placebo and 52.1% for randomization. Most participants, 62.4%, had no therapeutic misconceptions and 54.9% could name at least one risk. Subgroup and meta-regression analyses identified covariates, such as age, educational level, critical illness, the study phase and location, that significantly affected understanding and indicated that the proportion of participants who understood informed consent had not increased over 30 years.

Conclusion

The proportion of participants in clinical trials who understood different components of informed consent varied from 52.1% to 75.8%. Investigators could do more to help participants achieve a complete understanding.


Résumé

Objectif

Estimer la proportion des participants à des essais cliniques qui comprennent les différents composants du consentement éclairé.

Méthodes

Les études pertinentes ont été identifiées par une revue systématique de PubMed, Scopus et Google Scholar et par l'examen manuel des listes des références des publications allant jusqu'à octobre 2013. Une méta-analyse des résultats de l'étude a été réalisée à l'aide du modèle à effets aléatoires pour tenir compte de l'hétérogénéité.

Résultats

L'analyse a inclus 103 études évaluant 135 cohortes de participants. La proportion regroupée des participants qui ont compris les composants du consentement éclairé était de 75,8% pour la liberté de se retirer à tout moment, de 74,7% pour la nature de l'étude, de 74,7% pour la nature volontaire de la participation, de 74,0% pour les bénéfices potentiels, de 69,6% pour l'objectif de l'étude, de 67,0% pour les risques et effets indésirables potentiels, de 66,2% pour la confidentialité, de 64,1% pour la disponibilité d'un traitement alternatif en cas de retrait de l'étude, de 62,9% pour la connaissance des traitements évalués, de 53,3% pour le placebo et de 52,1% pour la randomisation. La plupart des participants (62,4%) n'avaient pas d'idées fausses sur le traitement, et 54,9% d'entre eux pouvaient citer au moins un risque. Les analyses de sous-groupe et de métarégression ont identifié des covariables, telles que l'âge, le niveau d'éducation, la maladie grave, la phase et le site de l'étude, qui affectaient significativement la compréhension et indiquaient que la proportion des participants ayant compris le consentement éclairé n'avait pas augmenté sur une période de 30 ans.

Conclusion

La proportion des participants à des essais cliniques, qui ont compris les différents composants du consentement éclairé, variait de 52,1% à 75,8%. Les investigateurs pourraient en faire davantage pour aider les participants à parvenir à la compréhension complète.

Resumen

Objetivo

Estimar la proporción de participantes de ensayos clínicos que comprende los distintos componentes del consentimiento informado.

Métodos

Se identificaron los estudios pertinentes mediante una revisión sistemática de PubMed, Scopus y Google Scholar y el examen manual de listas de referencia a fin de hallar publicaciones anteriores a octubre de 2013. Se realizó un metanálisis de los resultados del estudio mediante un modelo de efectos aleatorios para tener en cuenta la heterogeneidad.

Resultados

El análisis incluyó 103 estudios que evaluaron 135 cohortes de participantes. La proporción combinada de participantes que entendía los componentes del consentimiento informado fue del 75,8 % para la libertad de retirarse en cualquier momento, 74,7 % para la naturaleza del estudio, 74,7 % para el carácter voluntario de la participación, 74,0 % para los beneficios potenciales, 69,6 % para el propósito del estudio, 67,0 % para los riesgos y efectos secundarios potenciales, 66,2 % para la confidencialidad, 64,1 % para la disponibilidad de tratamiento alternativo si el paciente se retira, 62,9 % para saber que se comparaban tratamientos, 53,3 % para el placebo y 52,1 % para la aleatorización. La mayoría de los participantes, el 62,4 %, no tenía una idea equivocada sobre la terapia y el 54,9 % no fue capaz de nombrar al menos un riesgo. Los análisis de subgrupos y la metarregresión identificaron covariables, como edad, nivel educativo, enfermedad crítica, fase de estudio y ubicación, que influían considerablemente en la comprensión y señalaron que la proporción de participantes que entendía el consentimiento informado no había aumentado en 30 años.

Conclusión

La proporción de participantes de ensayos clínicos que entendía los diferentes componentes del consentimiento informado varió del 52,1 % al 75,8 %. Los investigadores podrían realizar esfuerzos mayores para ayudar a los pacientes a lograr una comprensión total.

ملخص

الغرض

تقدير نسبة المشاركين في التجارب السريرية الذين يفهمون العناصر المختلفة للموافقة المستنيرة.

الطريقة

تم تحديد الدراسات ذات الصلة عن طريق استعراض منهجي لقواعد بيانات PubMed وScopus وGoogle Scholar وعن طريق استعراض يدوي لقوائم المراجع الخاصة بالمنشورات حتى تشرين الأول/أكتوبر 2013. وتم إجراء تحليل تال لنتائج الدراسة باستخدام نموذج التأثيرات العشوائية لوضع التغايرية في الحسبان.

النتائج

اشتمل التحليل على 103 دراسة تقوم بتقييم 135 مجموعة من المشاركين. وكانت النسبة المجمعة للمشاركين الذين فهموا عناصر الموافقة المستنيرة 75.8 % بالنسبة لحرية الانسحاب في أي وقت و74.7 % بالنسبة لطبيعة الدراسة و74.7 % بالنسبة لطبيعة المشاركة الطوعية و74.0 % بالنسبة للفوائد المحتملة و69.6 % بالنسبة لغرض الدراسة و67.0 % بالنسبة للمخاطر والآثار الجانبية المحتملة و66.2 % بالنسبة لسرية المعلومات و64.1 % بالنسبة لإتاحة العلاج البديل في حالة الانسحاب من التجربة السريرية و62.9 % بالنسبة لمعرفة إجراء مقارنات بين العلاجات و53.3 % بالنسبة للدواء الوهمي و52.1 % بالنسبة للتوزيع العشوائي. ولم يكن لدى معظم المشاركين، 62.4 %، مفاهيم علاجية خاطئة واستطاع 54.9 % تحديد خطر واحد على الأقل. وحددت تحليلات الفئات الفرعية وتحليلات الارتداد التالي المتغيرات المصاحبة، مثل السن والمستوى التعليمي والاعتلالات الحرجة ومرحلة الدراسة وموقعها، والتي أثرت بشكل كبير على الفهم وأشارت إلى أن نسبة المشاركين الذين فهموا الموافقة المستنيرة لم تشهد زيادة على مدار 30 سنة.

الاستنتاج

تراوحت نسبة المشاركين في التجارب السريرية الذين فهموا العناصر المختلفة للموافقة المستنيرة من 52.1 % إلى 75.8 %. ويستطيع الخبراء تقديم المزيد لمساعدة المشاركين في تحقيق الفهم الكامل.

摘要

目的

估算临床试验中参与者理解知情同意不同组成部分的比例。

方法

系统回顾PubMed、Scopus和Google Scholar来识别相关研究。使用随机影响模型执行研究结果荟萃分析,以便将异质性考虑在内。

结果

分析包括评估135组参与者的103项研究。参与者理解知情同意组成部分的混合比例为:75.8%理解随时退出的自由,74.7%理解研究的性质,74.7%理解参与的自愿性质,74.0%理解潜在收益,69.6%理解研究目的,67.0%理解潜在的风险和副作用,66.2%理解保密性,64.1%理解退出情况下替代治疗的提供,62.9%知道治疗正在接受比较,53.3%理解安慰剂,52.1%理解随机化。大多数参与者(62.4%)没有治疗误区,54.9%能够说出至少一个风险。子群和meta回归分析识别出年龄、教育水平、重要疾病、研究分期和位置等对理解产生显著影响的协变量,并指明30多年来参与者理解知情同意的比例并没有增加。

结论

临床试验参与者理解知情同意各个组成的比例为52.1%到75.8%不等。研究者可以做更多的工作来帮助参与者完全理解各个组成部分。

Резюме

Цель

Определить долю участников клинических исследований, которые понимают различные детали информированного согласия.

Методы

Соответствующие исследования были выявлены посредством систематического обзора PubMed, Scopus и Google Scholar, а также путем просмотра вручную библиографических списков публикаций, изданных до октября 2013 г. Мета-анализ результатов исследований проводился с помощью модели со случайными эффектами для учета разнородности.

Результаты

Анализ включал 103 исследования с оценкой 135 групп участников. Общие доли участников, которые понимали следующие компоненты информированного согласия, составляли: 75,8% — о праве прекратить участие в исследовании в любое время, 74,7% — о природе исследования, 74,7% — о добровольном участии, 74,0% — о потенциальной пользе, 69,6 — о целях исследования, 67,0% — о потенциальных рисках и нежелательных явлениях, 66,2% — о конфиденциальности, 64,1% — о наличии альтернативного лечения при выходе из исследования, 62,9% — о знании сравнения терапий, 53,3% — о плацебо и 52,1% — о рандомизации. Большинство участников, а именно 62,4%, имели правильное представление о терапии и 54,9% могли назвать по меньшей мере один риск. С помощью анализа данных в подгруппах и мета-регрессионного анализа были определены независимые переменные, такие как возраст, уровень образования, критическое заболевание, место проведения и фаза исследования, которые оказывали значительное влияние на понимание и указывали на то, что доля участников, понимающих информированное согласие, не увеличилась за 30 лет.

Вывод

Доля участников клинических исследований, которые понимали различные компоненты информированного согласия, варьировалась в диапазоне от 52,1% до 75,8%. Исследователи могли бы предпринять дополнительные меры, чтобы участники исследований в более полной мере поняли суть информированного согласия.

Introduction

Informed consent has its roots in the 1947 Nuremberg Code and the 1964 Declaration of Helsinki and is now a guiding principle for conduct in medical research.1Grodin MA, Annas GJ. Legacies of Nuremberg. Medical ethics and human rights. JAMA. 1996 Nov 27;276(20):1682–3. doi: http://dx.doi.org/10.1001/jama.1996.03540200068035 PMID: 8922458
https://doi.org/10.1001/jama.1996.035402...
,2Emanuel EJ, Wendler D, Grady C. What makes clinical research ethical? JAMA. 2000 May 24-31;283(20):2701–11. doi: http://dx.doi.org/10.1001/jama.283.20.2701 PMID: 10819955
https://doi.org/10.1001/jama.283.20.2701...
Within its ethical and legal foundations,3Annas GJ. Doctors, patients, and lawyers–two centuries of health law. N Engl J Med. 2012 Aug 2;367(5):445–50. doi: http://dx.doi.org/10.1056/NEJMra1108646 PMID: 22853015
https://doi.org/10.1056/NEJMra1108646...
informed consent has two specific goals in clinical research: (i) to respect and promote a participant’s autonomy; and (ii) to protect participants from harm.4Jefford M, Moore R. Improvement of informed consent and the quality of consent documents. Lancet Oncol. 2008 May;9(5):485–93. doi: http://dx.doi.org/10.1016/S1470-2045(08)70128-1 PMID: 18452859
https://doi.org/10.1016/S1470-2045(08)70...
,5Will JF. A brief historical and theoretical perspective on patient autonomy and medical decision making: Part II: The autonomy model. Chest. 2011 Jun;139(6):1491–7. doi: http://dx.doi.org/10.1378/chest.11-0516 PMID: 21652559
https://doi.org/10.1378/chest.11-0516...
Obtaining written informed consent from participants before enrolment in a study is an internationally accepted standard.6Wendler D. How to enroll participants in research ethically. JAMA. 2011 Apr 20;305(15):1587–8. doi: http://dx.doi.org/10.1001/jama.2011.421 PMID: 21505137
https://doi.org/10.1001/jama.2011.421...
1010 Boga M, Davies A, Kamuya D, Kinyanjui SM, Kivaya E, Kombe F, et al. Strengthening the informed consent process in international health research through community engagement: The KEMRI-Wellcome Trust Research Programme Experience. PLoS Med. 2011 Sep;8(9):e1001089. doi: http://dx.doi.org/10.1371/journal.pmed.1001089 PMID: 21931539
https://doi.org/10.1371/journal.pmed.100...

Five concepts must be considered in establishing informed consent: voluntariness, capacity, disclosure, understanding and decision.1111 del Carmen MG, Joffe S. Informed consent for medical treatment and research: a review. Oncologist. 2005 Sep;10(8):636–41. doi: http://dx.doi.org/10.1634/theoncologist.10-8-636 PMID: 16177288
https://doi.org/10.1634/theoncologist.10...
,1212 Beauchamp TL, Childress JF. Principles of biomedical ethics. New York: Oxford University Press; 2001. Voluntariness means that an individual’s decision to participate is made without coercion or persuasion. Capacity relates to an individual’s ability to make decisions that stems from his or her ability to understand the information provided. Disclosure involves giving research participants all relevant information about the research, including its nature, purpose, risks and potential benefits as well as the alternatives available.1313 Weijer C, Grimshaw JM, Eccles MP, McRae AD, White A, Brehaut JC, et al.; Ottawa Ethics of Cluster Randomized Trials Consensus Group. The Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials. PLoS Med. 2012;9(11):e1001346. doi: http://dx.doi.org/10.1371/journal.pmed.1001346 PMID: 23185138
https://doi.org/10.1371/journal.pmed.100...
Understanding implies that research participants are able to comprehend the information provided and appreciate its relevance to their personal situations. Decision is that made to participate, or not.1111 del Carmen MG, Joffe S. Informed consent for medical treatment and research: a review. Oncologist. 2005 Sep;10(8):636–41. doi: http://dx.doi.org/10.1634/theoncologist.10-8-636 PMID: 16177288
https://doi.org/10.1634/theoncologist.10...
,1212 Beauchamp TL, Childress JF. Principles of biomedical ethics. New York: Oxford University Press; 2001.

The quality of informed consent in clinical research is determined by the extent to which participants understand the process of informed consent.1414 Sreenivasan G. Does informed consent to research require comprehension? Lancet. 2003 Dec 13;362(9400):2016–8. doi: http://dx.doi.org/10.1016/S0140-6736(03)15025-8 PMID: 14683665
https://doi.org/10.1016/S0140-6736(03)15...
Understanding plays a pivotal role in clinical research because it directly affects how ethical principles are applied in practice.1515 Lad PM, Dahl R. Audit of the informed consent process as a part of a clinical research quality assurance program. Sci Eng Ethics. 2014 Jun;20(2):469–79. doi: http://dx.doi.org/10.1007/s11948-013-9461-4 PMID: 23975172
https://doi.org/10.1007/s11948-013-9461-...
1717 Bhutta ZA. Beyond informed consent. Bull World Health Organ. 2004 Oct;82(10):771–7. PMID: 15643799 Although the literature on informed consent began to accumulate in the 1980s, little is known about how patients’ understanding has evolved as no meta-analysis has been previously performed. A systematic review considering literature up to 2006 found that only around 50% of participants understood all components of informed consent in surgical and clinical trials.1818 Falagas ME, Korbila IP, Giannopoulou KP, Kondilis BK, Peppas G. Informed consent: how much and what do patients understand? Am J Surg. 2009 Sep;198(3):420–35. doi: http://dx.doi.org/10.1016/j.amjsurg.2009.02.010 PMID: 19716887
https://doi.org/10.1016/j.amjsurg.2009.0...
Another systemic review, which included data up to 2010, compared only the quality of informed consent in developing and developed countries.1919 Mandava A, Pace C, Campbell B, Emanuel E, Grady C. The quality of informed consent: mapping the landscape. A review of empirical data from developing and developed countries. J Med Ethics. 2012 Jun;38(6):356–65. doi: http://dx.doi.org/10.1136/medethics-2011-100178 PMID: 22313664
https://doi.org/10.1136/medethics-2011-1...
The objective of this study was, therefore, to investigate the quality of informed consent in clinical trials in recent decades by performing a systematic review and meta-analysis of the data available.

Methods

We conducted a literature search of PubMed and Scopus using the following terms: “informed consent[mh] AND (comprehension[mh] OR decision making[mh] OR knowledge[mh] OR perception[mh] OR communication[mh] OR understanding) AND (randomized controlled trials as topic[mh] OR clinical trial as topic[mh])”. In addition, in a simple search of Scopus, we used: “allintitle: understanding OR comprehension OR knowledge OR decision OR perception OR communication “informed consent”.” In Google Scholar, we used the keywords “informed consent” as the exact phrase and “understanding, comprehension, knowledge, decision, perception, communication” with the option with at least one of the words and selected “where my words occur in the title of the article”. The search strategy was developed as previously described.2020 Aromataris E, Riitano D. Constructing a search strategy and searching for evidence. A guide to the literature search for a systematic review. Am J Nurs. 2014 May;114(5):49–56. doi: http://dx.doi.org/10.1097/01.NAJ.0000446779.99522.f6 PMID: 24759479
https://doi.org/10.1097/01.NAJ.000044677...
The searches covered all data entered up to October 2013. In addition, we analysed the reference lists of relevant articles. All studies identified were reviewed independently for eligibility by two of five authors and conflicts were resolved by seeking a consensus with other authors.

A study was eligible for inclusion if it assessed the participant’s or the participant’s guardian’s understanding of informed consent1Grodin MA, Annas GJ. Legacies of Nuremberg. Medical ethics and human rights. JAMA. 1996 Nov 27;276(20):1682–3. doi: http://dx.doi.org/10.1001/jama.1996.03540200068035 PMID: 8922458
https://doi.org/10.1001/jama.1996.035402...
,2Emanuel EJ, Wendler D, Grady C. What makes clinical research ethical? JAMA. 2000 May 24-31;283(20):2701–11. doi: http://dx.doi.org/10.1001/jama.283.20.2701 PMID: 10819955
https://doi.org/10.1001/jama.283.20.2701...
and at least one of the following components of the informed consent process:8Rivera R, Borasky D, Rice R, Carayon F, Wong E. Informed consent: an international researchers’ perspective. Am J Public Health. 2007 Jan;97(1):25–30. doi: http://dx.doi.org/10.2105/AJPH.2005.081604 PMID: 17138913
https://doi.org/10.2105/AJPH.2005.081604...
,2121 Protection of human subjects. Code Fed Requl Public Welfare. Washington: U.S. Department of Health and Human Services; 1995 Oct 1;Title 4s: sections 46-101 to 46-409. therapeutic misconception (i.e. lack of awareness of the uncertainty of success); ability to name at least one risk; knowing that treatments were being compared; or understanding of: (i) the nature of the study (i.e. awareness of participating in research); (ii) the purpose of the study; (iii) the risks and side-effects; (iv) the direct benefits; (v) placebo; (vi) randomization; (vii) the voluntary nature of participation; (viii) freedom to withdraw from the study at any time; (ix) the availability of alternative treatment if withdrawn from a trial; or (x) confidentiality (i.e. personal information will not be revealed). There was no restriction by language, age (i.e. children or adults) or study design. French and Japanese articles were translated into English by authors with a good command of these languages. We excluded articles on studies that: (i) compared or evaluated methods of informed consent; (ii) used an intervention to improve participants’ knowledge of informed consent; (iii) involved animals or included only healthy volunteers (e.g. simulated studies); (iv) involved patients with cognitive deficits; (v) were published as posters, in conference proceedings or as a thesis; or (vi) were not clinical trials. Our study protocol was registered with the international prospective register of systematic reviews (PROSPERO) with the identifier CRD42013005526. The study selection process, which was carried out in accordance with MOOSE guidelines for meta-analyses and systematic reviews of observational studies, is shown in Fig. 1.2222 Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000 Apr 19;283(15):2008–12. doi: http://dx.doi.org/10.1001/jama.283.15.2008 PMID: 10789670
https://doi.org/10.1001/jama.283.15.2008...

Fig. 1

Flow diagram for the selection of studies on participants’ understanding of informed consent in clinical trials

Quality of evaluation

The quality of the informed consent evaluation was assessed independently by two authors using seven metrics: (i) the description of participants; (ii) whether or not interviewers were members of the original trial’s staff; (iii) the description of the evaluation method (i.e. by questionnaire or interview); (iv) the description of the questionnaire; (v) the selection of participants (i.e. consecutive participants or a random or cross-sectional selection); (vi) the description of exclusion criteria; and (vii) the timing of the evaluations. Quality scores for the studies included are shown in Appendix A (available at: https://www.researchgate.net/publication/270506278_Online_Only_Supplements_for_Three_decades_of_participants_understanding_of_informed_consent_in_clinical_trials_a_systematic_review_and_meta-analysis).

Study data

Data were extracted for each study on: (i) the year of publication; (ii) the study language and the country where the study was conducted; (iii) the phase of the study; (iv) the baseline characteristics of the study population, including the source of the population, the number of participants and their age, sex and educational level; (v) the medical specialty of the clinical research, including the seriousness of the disease studied; (vi) the method and timing of the informed consent evaluation; (vii) the type of questions participants had to answer; and (viii) the components of informed consent assessed, including understanding of the nature and purpose of the study, knowing that treatments were being compared, therapeutic misconceptions, participants’ ability to name risks, awareness of potential risks and side-effects and understanding of potential benefits, randomization, placebo, the voluntary nature of participation, freedom to withdraw at any time, confidentiality and the availability of alternative treatment.

Statistical analysis and data synthesis

If a study investigated more than one population, a data set was created for each population. The proportion of participants who understood the different components of informed consent was pooled across studies using Comprehensive Meta-Analysis software version 2.0 (Biostat, Englewood, United States of America) and was expressed as a percentage with 95% confidence intervals (CIs). The heterogeneity of study findings was evaluated using the Q statistic and the I2 test and was considered significant if the P-value was < 0.10. Since studies gave heterogeneous results for all components, the proportion of participants who understood each component was pooled using a random-effects model that included weighting for each study. In examining the effect of covariates on these proportions, we used a subgroup or meta-regression analysis when eight or more studies assessed a particular covariate. Differences between subgroups and trends were considered significant if the P-value of Cochran’s Q test was < 0.05.2323 Sedgwick P. Meta-analyses: heterogeneity and subgroup analysis. BMJ. 2013 June 24;346 jun24 2:f4040. doi: http://dx.doi.org/10.1136/bmj.f4040
https://doi.org/10.1136/bmj.f4040...
To determine if publication bias was present, we used Begg’s funnel plot and Egger’s regression test: a P-value < 0.10 indicated significant publication bias.2424 Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Comparison of two methods to detect publication bias in meta-analysis. JAMA. 2006 Feb 8;295(6):676–80. doi: http://dx.doi.org/10.1001/jama.295.6.676 PMID: 16467236
https://doi.org/10.1001/jama.295.6.676...
When publication bias was present, we used Duvall and Tweedie’s trim-and-fill method to enhance symmetry by adjusting for studies that appeared to be missing.2525 Duval S, Tweedie R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000 Jun;56(2):455–63. doi: http://dx.doi.org/10.1111/j.0006-341X.2000.00455.x PMID: 10877304
https://doi.org/10.1111/j.0006-341X.2000...
2727 Kaufert JM, O’Neil J. Culture, power and informed consent: the impact of Aboriginal health interpreters on decision-making. In: Coburn D, D’Arcy C, Torrance G, editors. Health and Canadian society: sociological perspectives. Toronto: University of Toronto Press; 1998. The final proportion of participants who understood each component was computed after adjustment for missing studies.

Results

The final analysis included 103 studies: 85 from the database search and 18 from reviewing reference lists.2828 Ellis RD, Sagara I, Durbin A, Dicko A, Shaffer D, Miller L, et al. Comparing the understanding of subjects receiving a candidate malaria vaccine in the United States and Mali. Am J Trop Med Hyg. 2010 Oct;83(4):868–72. doi: http://dx.doi.org/10.4269/ajtmh.2010.10-0062 PMID: 20889881
https://doi.org/10.4269/ajtmh.2010.10-00...
130130 Verheggen FW, Jonkers R, Kok G. Patients’ perceptions on informed consent and the quality of information disclosure in clinical trials. Patient Educ Couns. 1996 Nov;29(2):137–53. doi: http://dx.doi.org/10.1016/0738-3991(96)00859-2 PMID: 9006231
https://doi.org/10.1016/0738-3991(96)008...
Ultimately 135 data sets were included because some studies evaluated more than one population (Appendix A). The sample size ranged from 8 to 1789 participants and the response rate to interview questions ranged from 9.3% to 100%. Participants were adults in 95 data sets, parents or guardians in 34, adult and child patients in three, child patients in two and adult patients or parents in one. Overall, 79% (106) of data sets were conducted in middle- or high-income countries – as classified by the World Bank131131 Country and lending groups [Internet]. Washington: World Bank; 2014. Available from: http://data.worldbank.org/about/country-and-lending-groups [cited 2014 Dec 12].
http://data.worldbank.org/about/country-...
– and 67% (90) did not report the phase of the clinical trial. The medical specialty was cancer in 33% (44) of data sets, infectious disease in 14% (19), vaccines in 10%, (13) cardiovascular disease in 7% (9), neurology in 6% (8) and other in 31% (42). Moreover, 98% (132) were published in English and only 1% each in Japanese (1) and French (2). Details of the studies and data sets are presented in Table 1 (available at: http://www.who.int/bulletin/volumes/93/3/14-141390).

Table 1
Studies and data sets in the meta-analysis of participants’ understanding of informed consent in clinical trials

Understanding of informed consent

The number of data sets that covered each component of informed consent is shown in Appendix B (available at: https://www.researchgate.net/publication/270506278_Online_Only_Supplements_for_Three_decades_of_participants_understanding_of_informed_consent_in_clinical_trials_a_systematic_review_and_meta-analysis). Understanding of freedom to withdraw at any time was investigated in the largest number of studies (n = 79), whereas understanding of placebo was investigated in the smallest number (n = 15). Our analysis showed some variation in the proportion of participants who understood different components of informed consent. The highest proportions were 75.8% (95% CI: 70.6–80.3) for freedom to withdraw from the study at any time, 74.7% (95% CI: 68.8–79.8) for the nature of study, 74.7% (95% CI: 67.9–80.5) for the voluntary nature of participation and 74.0% (95% CI: 65.0–81.3) for potential benefits (Fig. 2 and Appendix B). Lower proportions were 69.6% (95% CI: 63.5–75.1) for the purpose of the study, 67.0% (95% CI: 57.4–75.4) for potential risks and side-effects, 66.2% (95% CI: 55.3–75.7) for confidentiality, 64.1% (95% CI: 53.7–73.4) for the availability of alternative treatment if withdrawn and 62.9% (95% CI: 45.5–77.5) for knowing that treatments were being compared. In addition, 62.4% (95% CI: 50.1–73.2) had no therapeutic misconceptions. The lowest proportions were 54.9% (95% CI: 43.3–65.0) for naming at least one risk, followed by 53.3% (95% CI: 38.4–67.6) for understanding of placebo and 52.1% (95% CI: 41.3–62.7) for understanding of randomization.

Fig. 2

Participants’ understanding of components of informed consent in clinical trials, by meta-analysisa

Effect of covariates

We performed a meta-regression analysis to evaluate the influence of particular covariates on the proportion of participants who understood informed consent (Table 2). We found that gender had no effect but that, importantly, significantly fewer patients from low-income countries than from middle- and high countries understood randomization, the voluntary nature of participation and freedom to withdraw at any time. In addition, critically ill patients were significantly less likely to understand the nature or benefits of the study or confidentiality or to be able to name at least one risk. However, older participants were more likely to understand the nature of the study and freedom to withdraw at any time. A lower educational level was associated with a reduced likelihood of understanding the nature of the study, placebo, randomization and freedom to withdraw at any time. Participants in phase-I clinical trials were less likely than participants in phase-II, -III or -IV trials to understand the purpose of the study and were more likely to have therapeutic misconceptions. Participants in phase-I trials were also more likely to understand potential risks and side-effects and freedom to withdraw at any time. Participants assessed using open-ended questions were less likely to understand the purpose of the study (Fig. 3), the voluntary nature of participation or freedom to withdraw at any time or to be able to name at least one risk. Additionally, the later the evaluation of understanding was carried out, the less likely the participant was to understand confidentiality or to be able to name at least one risk. The quality of the evaluation did not influence understanding.

Table 2
Influencea of covariates on participants’ understanding of informed consent in clinical trials
Fig. 3

Effect of using an open-ended questiona on participants’ understanding of the purpose of a clinical studyb

Our data also provided us with the opportunity to analyse how study participants’ understanding of informed consent had changed over 30 years. Surprisingly, there was no significant change in understanding of any component (Fig. 4, Fig. 5 and Fig. 6). In particular, we were interested in the past 20 years, after the World Health Organization introduced guidelines for good clinical practice in trials.132132 Idänpäänheikkilä JE. WHO guidelines for good clinical practice (GCP) for trials on pharmaceutical products: responsibilities of the investigator. Ann Med. 1994 Apr;26(2):89–94. doi: http://dx.doi.org/10.3109/07853899409147334 PMID: 8024733
https://doi.org/10.3109/0785389940914733...
After removing four early studies, we again found no significant change in understanding of any component, including the freedom to withdraw (Fig. 7). Furthermore, there was no significant change in understanding of any component over the past 13 years in all studies combined or in subgroups of participants, including those assessed using open-ended questions, those assessed using closed-ended questions and those in middle- and high-income countries assessed using closed-ended questions (Appendices C, D, E and F, respectively, available at: https://www.researchgate.net/publication/270506278_Online_Only_Supplements_for_Three_decades_of_participants_understanding_of_informed_consent_in_clinical_trials_a_systematic_review_and_meta-analysis).

Fig. 4

Participants’ understanding of the potential risks and side-effects of participating in a clinical study

Fig. 5

Participants’ understanding of placebo in clinical studies

Fig. 6

Participants’ understanding of their freedom to withdraw from a study at any time

Fig. 7

Participants’ understanding of their freedom to withdraw from a study at any time, after introduction of WHO guidelines for good clinical practice in trials132 Idänpäänheikkilä JE. WHO guidelines for good clinical practice (GCP) for trials on pharmaceutical products: responsibilities of the investigator. Ann Med. 1994 Apr;26(2):89–94. doi: http://dx.doi.org/10.3109/07853899409147334 PMID: 8024733
https://doi.org/10.3109/0785389940914733...

Discussion

Obtaining informed consent from participants in clinical research is essential because it promotes their welfare and ensures their rights.9World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013 Nov 27;310(20):2191–4. doi: http://dx.doi.org/10.1001/jama.2013.281053 PMID: 24141714
https://doi.org/10.1001/jama.2013.281053...
,133133 Moreno J, Caplan AL, Wolpe PR. Updating protections for human subjects involved in research. Project on Informed Consent, Human Research Ethics Group. JAMA. 1998 Dec 9;280(22):1951–8. doi: http://dx.doi.org/10.1001/jama.280.22.1951 PMID: 9851484
https://doi.org/10.1001/jama.280.22.1951...
However, participants must have a good understanding of what informed consent entails. Our meta-analysis indicates that around 75% of individuals understood the nature of the study, their right to refuse to participate, their right to withdraw at any time and the direct benefits of participation. This percentage is higher than the figure of around 50% found in a previous systematic review1818 Falagas ME, Korbila IP, Giannopoulou KP, Kondilis BK, Peppas G. Informed consent: how much and what do patients understand? Am J Surg. 2009 Sep;198(3):420–35. doi: http://dx.doi.org/10.1016/j.amjsurg.2009.02.010 PMID: 19716887
https://doi.org/10.1016/j.amjsurg.2009.0...
probably because we included only clinical trials, excluded studies of patients with cognitive deficits and weighted the meta-analysis to account for heterogeneous data.

Our data also highlight the difficulty participants had in understanding particular components of informed consent, such as randomization and the use of placebo. Moreover, although participants were aware of potential risks and side-effects, they were less likely to be able to name at least one risk and, although they understood the benefits of participating in a study, they were less aware of the uncertainty of these benefits (i.e. had therapeutic misconceptions). These findings were also noted in previous studies.1818 Falagas ME, Korbila IP, Giannopoulou KP, Kondilis BK, Peppas G. Informed consent: how much and what do patients understand? Am J Surg. 2009 Sep;198(3):420–35. doi: http://dx.doi.org/10.1016/j.amjsurg.2009.02.010 PMID: 19716887
https://doi.org/10.1016/j.amjsurg.2009.0...
,1919 Mandava A, Pace C, Campbell B, Emanuel E, Grady C. The quality of informed consent: mapping the landscape. A review of empirical data from developing and developed countries. J Med Ethics. 2012 Jun;38(6):356–65. doi: http://dx.doi.org/10.1136/medethics-2011-100178 PMID: 22313664
https://doi.org/10.1136/medethics-2011-1...
,134134 de Melo-Martín I, Ho A. Beyond informed consent: the therapeutic misconception and trust. J Med Ethics. 2008 Mar;34(3):202–5. doi: http://dx.doi.org/10.1136/jme.2006.019406 PMID: 18316464
https://doi.org/10.1136/jme.2006.019406...
137137 Ballard HO, Shook LA, Desai NS, Anand KJ. Neonatal research and the validity of informed consent obtained in the perinatal period. J Perinatol. 2004 Jul;24(7):409–15. doi: http://dx.doi.org/10.1038/sj.jp.7211142 PMID: 15152271
https://doi.org/10.1038/sj.jp.7211142...
They are, perhaps, not surprising since a participant’s understanding depends, to a certain degree, on their literacy as well as on the duration of the informed consent process and the explanatory skills of the researchers.138138 Miller FG, Joffe S. Phase 1 oncology trials and informed consent. J Med Ethics. 2013 Dec;39(12):761–4. doi: http://dx.doi.org/10.1136/medethics-2012-100832 PMID: 23161617
https://doi.org/10.1136/medethics-2012-1...
140140 Flory J, Emanuel E. Interventions to improve research participants’ understanding in informed consent for research: a systematic review. JAMA. 2004 Oct 6;292(13):1593–601. doi: http://dx.doi.org/10.1001/jama.292.13.1593 PMID: 15467062
https://doi.org/10.1001/jama.292.13.1593...

In addition, the meta-regression was able to identify differences in understanding of informed consent between population groups. Older participants more often than younger participants understood the nature of the study and freedom to withdraw at any time. The reason for this difference requires further study. As noted in a previous systematic review,1919 Mandava A, Pace C, Campbell B, Emanuel E, Grady C. The quality of informed consent: mapping the landscape. A review of empirical data from developing and developed countries. J Med Ethics. 2012 Jun;38(6):356–65. doi: http://dx.doi.org/10.1136/medethics-2011-100178 PMID: 22313664
https://doi.org/10.1136/medethics-2011-1...
participants from developing countries were less likely than others to understand the voluntary nature of participation and freedom to withdraw at any time. It is possible that patients in these countries dare not refuse to join or dare not withdraw from a study because they fear their doctor’s disapproval.141141 Hyder AA, Rattani A, Krubiner C, Bachani AM, Tran NT. Ethical review of health systems research in low- and middle-income countries: a conceptual exploration. Am J Bioeth. 2014;14(2):28–37. doi: http://dx.doi.org/10.1080/15265161.2013.868950 PMID: 24521334
https://doi.org/10.1080/15265161.2013.86...
Participants from developing countries and those with a low level of literacy were less likely to understand randomization.

Phase-I clinical trials are usually conducted in small numbers of participants to test a drug’s safety and dose range. Consequently, it was expected that participants in phase-I trials would be less likely than those in more advanced trials to understand the purpose of the study or that the benefits were uncertain. In contrast, participants in phase-I trials were more likely to be aware of potential risks and of their freedom to withdraw at any time.

Compared with the use of open-ended questions to evaluate participants' understanding, the use of closed-ended questions was associated with higher rates of understanding of the purpose of the study, the voluntary nature of participation and freedom to withdraw and with a greater likelihood of being able to name at least one risk. However, the use of closed-ended questions could have led to understanding being overestimated because respondents had to choose from a limited number of possible answers and did not have to think clearly about the issues.142142 Cargan L. Doing social research. Lanham: Rowman and Littlefield Publishers; 2007. Consequently, the use of open-ended questions may have reflected better the true extent of understanding since respondents had to put their understanding into words.143143 Takemura Y, Sakurai Y, Yokoya S, Otaki J, Matsuoka T, Ban N, et al. Open-ended questions: are they really beneficial for gathering medical information from patients? Tohoku J Exp Med. 2005 Jun;206(2):151–4. doi: http://dx.doi.org/10.1620/tjem.206.151 PMID: 15888971
https://doi.org/10.1620/tjem.206.151...

Finally, an unexpected finding of our analysis was that understanding of the potential risks and side-effects of trials, of placebo and of freedom to withdraw had not changed over 30 years. This is despite considerable progress in medical research methods over this time144144 Faralli C. Informed consent in medicine: ethical and juridical aspects. Milan: Salute e Società; 2013. and many attempts made to improve the quality of informed consent.145145 Isles AF. Understood consent versus informed consent: a new paradigm for obtaining consent for pediatric research studies. Front Pediatr. 2013;1:38. doi: http://dx.doi.org/10.3389/fped.2013.00038 PMID: 24400284
https://doi.org/10.3389/fped.2013.00038...
There are four possible explanations: (i) the maximum proportion of participants who understand these concepts has been reached; (ii) the increasing complexity of clinical trials has made the informed consent process longer and more difficult to understand; (iii) not enough effort has been put into enhancing the quality of the informed consent process; and (iv) our analysis did not have the statistical power to detect a significant increase in understanding. In fact, the best way to improve understanding of informed consent is still debated. A recent meta-analysis of interventions for improving understanding found that enhanced consent forms and extended discussions led to significant increases in understanding whereas multimedia approaches did not.146146 Nishimura A, Carey J, Erwin PJ, Tilburt JC, Murad MH, McCormick JB. Improving understanding in the research informed consent process: a systematic review of 54 interventions tested in randomized control trials. BMC Med Ethics. 2013;14(1):28. doi: http://dx.doi.org/10.1186/1472-6939-14-28 PMID: 23879694
https://doi.org/10.1186/1472-6939-14-28...
In other words, simple measures such as well formatted, easily readable consent forms and intensive discussions with participants may be more effective than more complex measures.140140 Flory J, Emanuel E. Interventions to improve research participants’ understanding in informed consent for research: a systematic review. JAMA. 2004 Oct 6;292(13):1593–601. doi: http://dx.doi.org/10.1001/jama.292.13.1593 PMID: 15467062
https://doi.org/10.1001/jama.292.13.1593...
,146146 Nishimura A, Carey J, Erwin PJ, Tilburt JC, Murad MH, McCormick JB. Improving understanding in the research informed consent process: a systematic review of 54 interventions tested in randomized control trials. BMC Med Ethics. 2013;14(1):28. doi: http://dx.doi.org/10.1186/1472-6939-14-28 PMID: 23879694
https://doi.org/10.1186/1472-6939-14-28...
148148 Terranova G, Ferro M, Carpeggiani C, Recchia V, Braga L, Semelka RC, et al. Low quality and lack of clarity of current informed consent forms in cardiology: how to improve them. JACC Cardiovasc Imaging. 2012 Jun;5(6):649–55. doi: http://dx.doi.org/10.1016/j.jcmg.2012.03.007 PMID: 22698536
https://doi.org/10.1016/j.jcmg.2012.03.0...

Although an understanding of all the components of informed consent we investigated is required for patients to make a decision on study participation, some components were assessed more often than others. We found a good correlation between the likelihood that a participant would understand a specific component of informed consent and the number of studies that investigated understanding of that component (Appendix G). This suggests either that it was simpler to evaluate understanding of some components or that some components were more important.

One limitation of our study is that we were not able to analyse the effect on understanding of informed consent of the presence of a nurse during the informed consent process, of the duration of the process or of participants choosing not to take part in a clinical trial because only a small number of studies investigated these factors. Moreover, only 79 of the 135 data sets gave information on whether the interviewers were investigators in the original clinical trial. Hence, we were not able to analyse the effect of this factor on the results. Another limitation is that we included studies of children because they have the right to decide whether to participate.149149 Mårtenson EK, Fägerskiöld AM. A review of children’s decision-making competence in health care. J Clin Nurs. 2008 Dec;17(23):3131–41. doi: http://dx.doi.org/10.1111/j.1365-2702.2006.01920.x PMID: 18005126
https://doi.org/10.1111/j.1365-2702.2006...
,150150 Kluge EH. Informed consent by children: the new reality. CMAJ. 1995 May 1;152(9):1495–7. PMID: 7728701 However, the number of studies involving children was small and our sensitivity analysis showed that removing these studies did not influence the pooled results. Although we found a high level of heterogeneity across studies for understanding of all components of informed consent and although Cox et al. suggest that, in these circumstances, individual studies should be described rather than combined in a meta-analysis,151151 Cox DR. Combination of data. In: Kotz S, Johnson NL, Read CB, Balakrishnan N, Vidakovic B, editors. Encyclopedia of statistical sciences. 2nd ed. Hoboken: John Wiley & Sons; 2006.pp. 1074–81. we, like other groups, chose to perform a meta-analysis with a regression analysis and subgroup analysis to gain a better insight into how covariates affect understanding.152152 Baker WL, White CM, Cappelleri JC, Kluger J, Coleman CI; Health Outcomes, Policy, and Economics (HOPE) Collaborative Group. Understanding heterogeneity in meta-analysis: the role of meta-regression. Int J Clin Pract. 2009 Oct;63(10):1426–34. doi: http://dx.doi.org/10.1111/j.1742-1241.2009.02168.x PMID: 19769699
https://doi.org/10.1111/j.1742-1241.2009...
154154 Ioannidis JP, Patsopoulos NA, Rothstein HR. Reasons or excuses for avoiding meta-analysis in forest plots. BMJ. 2008 Jun 21;336(7658):1413–5. doi: http://dx.doi.org/10.1136/bmj.a117 PMID: 18566080
https://doi.org/10.1136/bmj.a117...

In conclusion, we found that most participants in clinical trials understood fundamental components of informed consent such as the nature and benefits of the study, freedom to withdraw at any time and the voluntary nature of participation. Understanding of other components, such as randomization and placebo, was less satisfactory and has not improved over 30 years. Our findings suggest that investigators could make a greater effort to help research participants achieve a complete understanding of informed consent. This would ensure that participants’ decision-making is meaningful and that their interests are protected.

References

  • 1
    Grodin MA, Annas GJ. Legacies of Nuremberg. Medical ethics and human rights. JAMA. 1996 Nov 27;276(20):1682–3. doi: http://dx.doi.org/10.1001/jama.1996.03540200068035 PMID: 8922458
    » https://doi.org/10.1001/jama.1996.03540200068035
  • 2
    Emanuel EJ, Wendler D, Grady C. What makes clinical research ethical? JAMA. 2000 May 24-31;283(20):2701–11. doi: http://dx.doi.org/10.1001/jama.283.20.2701 PMID: 10819955
    » https://doi.org/10.1001/jama.283.20.2701
  • 3
    Annas GJ. Doctors, patients, and lawyers–two centuries of health law. N Engl J Med. 2012 Aug 2;367(5):445–50. doi: http://dx.doi.org/10.1056/NEJMra1108646 PMID: 22853015
    » https://doi.org/10.1056/NEJMra1108646
  • 4
    Jefford M, Moore R. Improvement of informed consent and the quality of consent documents. Lancet Oncol. 2008 May;9(5):485–93. doi: http://dx.doi.org/10.1016/S1470-2045(08)70128-1 PMID: 18452859
    » https://doi.org/10.1016/S1470-2045(08)70128-1
  • 5
    Will JF. A brief historical and theoretical perspective on patient autonomy and medical decision making: Part II: The autonomy model. Chest. 2011 Jun;139(6):1491–7. doi: http://dx.doi.org/10.1378/chest.11-0516 PMID: 21652559
    » https://doi.org/10.1378/chest.11-0516
  • 6
    Wendler D. How to enroll participants in research ethically. JAMA. 2011 Apr 20;305(15):1587–8. doi: http://dx.doi.org/10.1001/jama.2011.421 PMID: 21505137
    » https://doi.org/10.1001/jama.2011.421
  • 7
    Glickman SW, McHutchison JG, Peterson ED, Cairns CB, Harrington RA, Califf RM, et al. Ethical and scientific implications of the globalization of clinical research. N Engl J Med. 2009 Feb 19;360(8):816–23. doi: http://dx.doi.org/10.1056/NEJMsb0803929 PMID: 19228627
    » https://doi.org/10.1056/NEJMsb0803929
  • 8
    Rivera R, Borasky D, Rice R, Carayon F, Wong E. Informed consent: an international researchers’ perspective. Am J Public Health. 2007 Jan;97(1):25–30. doi: http://dx.doi.org/10.2105/AJPH.2005.081604 PMID: 17138913
    » https://doi.org/10.2105/AJPH.2005.081604
  • 9
    World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013 Nov 27;310(20):2191–4. doi: http://dx.doi.org/10.1001/jama.2013.281053 PMID: 24141714
    » https://doi.org/10.1001/jama.2013.281053
  • 10
    Boga M, Davies A, Kamuya D, Kinyanjui SM, Kivaya E, Kombe F, et al. Strengthening the informed consent process in international health research through community engagement: The KEMRI-Wellcome Trust Research Programme Experience. PLoS Med. 2011 Sep;8(9):e1001089. doi: http://dx.doi.org/10.1371/journal.pmed.1001089 PMID: 21931539
    » https://doi.org/10.1371/journal.pmed.1001089
  • 11
    del Carmen MG, Joffe S. Informed consent for medical treatment and research: a review. Oncologist. 2005 Sep;10(8):636–41. doi: http://dx.doi.org/10.1634/theoncologist.10-8-636 PMID: 16177288
    » https://doi.org/10.1634/theoncologist.10-8-636
  • 12
    Beauchamp TL, Childress JF. Principles of biomedical ethics. New York: Oxford University Press; 2001.
  • 13
    Weijer C, Grimshaw JM, Eccles MP, McRae AD, White A, Brehaut JC, et al.; Ottawa Ethics of Cluster Randomized Trials Consensus Group. The Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials. PLoS Med. 2012;9(11):e1001346. doi: http://dx.doi.org/10.1371/journal.pmed.1001346 PMID: 23185138
    » https://doi.org/10.1371/journal.pmed.1001346
  • 14
    Sreenivasan G. Does informed consent to research require comprehension? Lancet. 2003 Dec 13;362(9400):2016–8. doi: http://dx.doi.org/10.1016/S0140-6736(03)15025-8 PMID: 14683665
    » https://doi.org/10.1016/S0140-6736(03)15025-8
  • 15
    Lad PM, Dahl R. Audit of the informed consent process as a part of a clinical research quality assurance program. Sci Eng Ethics. 2014 Jun;20(2):469–79. doi: http://dx.doi.org/10.1007/s11948-013-9461-4 PMID: 23975172
    » https://doi.org/10.1007/s11948-013-9461-4
  • 16
    Richardson V. Patient comprehension of informed consent. J Perioper Pract. 2013 Jan-Feb;23(1-2):26–30. PMID: 23413533
  • 17
    Bhutta ZA. Beyond informed consent. Bull World Health Organ. 2004 Oct;82(10):771–7. PMID: 15643799
  • 18
    Falagas ME, Korbila IP, Giannopoulou KP, Kondilis BK, Peppas G. Informed consent: how much and what do patients understand? Am J Surg. 2009 Sep;198(3):420–35. doi: http://dx.doi.org/10.1016/j.amjsurg.2009.02.010 PMID: 19716887
    » https://doi.org/10.1016/j.amjsurg.2009.02.010
  • 19
    Mandava A, Pace C, Campbell B, Emanuel E, Grady C. The quality of informed consent: mapping the landscape. A review of empirical data from developing and developed countries. J Med Ethics. 2012 Jun;38(6):356–65. doi: http://dx.doi.org/10.1136/medethics-2011-100178 PMID: 22313664
    » https://doi.org/10.1136/medethics-2011-100178
  • 20
    Aromataris E, Riitano D. Constructing a search strategy and searching for evidence. A guide to the literature search for a systematic review. Am J Nurs. 2014 May;114(5):49–56. doi: http://dx.doi.org/10.1097/01.NAJ.0000446779.99522.f6 PMID: 24759479
    » https://doi.org/10.1097/01.NAJ.0000446779.99522.f6
  • 21
    Protection of human subjects. Code Fed Requl Public Welfare. Washington: U.S. Department of Health and Human Services; 1995 Oct 1;Title 4s: sections 46-101 to 46-409.
  • 22
    Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000 Apr 19;283(15):2008–12. doi: http://dx.doi.org/10.1001/jama.283.15.2008 PMID: 10789670
    » https://doi.org/10.1001/jama.283.15.2008
  • 23
    Sedgwick P. Meta-analyses: heterogeneity and subgroup analysis. BMJ. 2013 June 24;346 jun24 2:f4040. doi: http://dx.doi.org/10.1136/bmj.f4040
    » https://doi.org/10.1136/bmj.f4040
  • 24
    Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Comparison of two methods to detect publication bias in meta-analysis. JAMA. 2006 Feb 8;295(6):676–80. doi: http://dx.doi.org/10.1001/jama.295.6.676 PMID: 16467236
    » https://doi.org/10.1001/jama.295.6.676
  • 25
    Duval S, Tweedie R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000 Jun;56(2):455–63. doi: http://dx.doi.org/10.1111/j.0006-341X.2000.00455.x PMID: 10877304
    » https://doi.org/10.1111/j.0006-341X.2000.00455.x
  • 26
    Mengoli C, Cruciani M, Barnes RA, Loeffler J, Donnelly JP. Use of PCR for diagnosis of invasive aspergillosis: systematic review and meta-analysis. Lancet Infect Dis. 2009 Feb;9(2):89–96. doi: http://dx.doi.org/10.1016/S1473-3099(09)70019-2 PMID: 19179225
    » https://doi.org/10.1016/S1473-3099(09)70019-2
  • 27
    Kaufert JM, O’Neil J. Culture, power and informed consent: the impact of Aboriginal health interpreters on decision-making. In: Coburn D, D’Arcy C, Torrance G, editors. Health and Canadian society: sociological perspectives. Toronto: University of Toronto Press; 1998.
  • 28
    Ellis RD, Sagara I, Durbin A, Dicko A, Shaffer D, Miller L, et al. Comparing the understanding of subjects receiving a candidate malaria vaccine in the United States and Mali. Am J Trop Med Hyg. 2010 Oct;83(4):868–72. doi: http://dx.doi.org/10.4269/ajtmh.2010.10-0062 PMID: 20889881
    » https://doi.org/10.4269/ajtmh.2010.10-0062
  • 29
    Vallely A, Lees S, Shagi C, Kasindi S, Soteli S, Kavit N, et al.; Microbicides Development Programme (MDP). How informed is consent in vulnerable populations? Experience using a continuous consent process during the MDP301 vaginal microbicide trial in Mwanza, Tanzania. BMC Med Ethics. 2010;11(1):10. doi: http://dx.doi.org/10.1186/1472-6939-11-10 PMID: 20540803
    » https://doi.org/10.1186/1472-6939-11-10
  • 30
    Hill Z, Tawiah-Agyemang C, Odei-Danso S, Kirkwood B. Informed consent in Ghana: what do participants really understand? J Med Ethics. 2008 Jan;34(1):48–53. doi: http://dx.doi.org/10.1136/jme.2006.019059 PMID: 18156522
    » https://doi.org/10.1136/jme.2006.019059
  • 31
    Minnies D, Hawkridge T, Hanekom W, Ehrlich R, London L, Hussey G. Evaluation of the quality of informed consent in a vaccine field trial in a developing country setting. BMC Med Ethics. 2008;9(1):15. doi: http://dx.doi.org/10.1186/1472-6939-9-15 PMID: 18826637
    » https://doi.org/10.1186/1472-6939-9-15
  • 32
    Kaewpoonsri N, Okanurak K, Kitayaporn D, Kaewkungwal J, Vijaykadga S, Thamaree S. Factors related to volunteer comprehension of informed consent for a clinical trial. Southeast Asian J Trop Med Public Health. 2006 Sep;37(5):996–1004. PMID: 17333746
  • 33
    Krosin MT, Klitzman R, Levin B, Cheng J, Ranney ML. Problems in comprehension of informed consent in rural and peri-urban Mali, West Africa. Clin Trials. 2006;3(3):306–13. doi: http://dx.doi.org/10.1191/1740774506cn150oa PMID: 16895047
    » https://doi.org/10.1191/1740774506cn150oa
  • 34
    Moodley K, Pather M, Myer L. Informed consent and participant perceptions of influenza vaccine trials in South Africa. J Med Ethics. 2005 Dec;31(12):727–32. doi: http://dx.doi.org/10.1136/jme.2004.009910 PMID: 16319239
    » https://doi.org/10.1136/jme.2004.009910
  • 35
    Pace C, Emanuel EJ, Chuenyam T, Duncombe C, Bebchuk JD, Wendler D, et al. The quality of informed consent in a clinical research study in Thailand. IRB. 2005 Jan-Feb;27(1):9–17. doi: http://dx.doi.org/10.2307/3563866 PMID: 15835065
    » https://doi.org/10.2307/3563866
  • 36
    Pace C, Talisuna A, Wendler D, Maiso F, Wabwire-Mangen F, Bakyaita N, et al. Quality of parental consent in a Ugandan malaria study. Am J Public Health. 2005 Jul;95(7):1184–9. doi: http://dx.doi.org/10.2105/AJPH.2004.053082 PMID: 15933235
    » https://doi.org/10.2105/AJPH.2004.053082
  • 37
    ANRS1201/1202 Ditrame Plus Study Group. Obtaining informed consent from HIV-infected pregnant women, Abidjan, Côte d’Ivoire. AIDS. 2004 Jul 2;18(10):1486–8. doi: http://dx.doi.org/10.1097/01.aids.0000131349.22032.63 PMID: 15199334
    » https://doi.org/10.1097/01.aids.0000131349.22032.63
  • 38
    Joubert G, Steinberg H, van der Ryst E, Chikobvu P. Consent for participation in the Bloemfontein vitamin A trial: how informed and voluntary? Am J Public Health. 2003 Apr;93(4):582–4. doi: http://dx.doi.org/10.2105/AJPH.93.4.582 PMID: 12660201
    » https://doi.org/10.2105/AJPH.93.4.582
  • 39
    Lynöe N, Hyder Z, Chowdhury M, Ekström L. Obtaining informed consent in Bangladesh. N Engl J Med. 2001 Feb 8;344(6):460–1. doi: http://dx.doi.org/10.1056/NEJM200102083440617 PMID: 11221611
    » https://doi.org/10.1056/NEJM200102083440617
  • 40
    Lynöe N, Näsström B, Sandlund M. Study of the quality of information given to patients participating in a clinical trial regarding chronic hemodialysis. Scand J Urol Nephrol. 2004;38(6):517–20. doi: http://dx.doi.org/10.1080/00365590410033362 PMID: 15841789
    » https://doi.org/10.1080/00365590410033362
  • 41
    Lynöe N, Sandlund M, Dahlqvist G, Jacobsson L. Informed consent: study of quality of information given to participants in a clinical trial. BMJ. 1991 Sep 14;303(6803):610–3. doi: http://dx.doi.org/10.1136/bmj.303.6803.610 PMID: 1932901
    » https://doi.org/10.1136/bmj.303.6803.610
  • 42
    Lynöe N, Boman K, Andersson H, Sandlund M. Informed consent and participants’ inclination to delegate decision-making to the doctor. Acta Oncol. 2004;43(8):769. doi: http://dx.doi.org/10.1080/02841860410002734 PMID: 15764224
    » https://doi.org/10.1080/02841860410002734
  • 43
    Lynöe N, Sandlund M, Jacobsson L. Informed consent in two Swedish prisons: a study of quality of information and reasons for participating in a clinical trial. Med Law. 2001;20(4):515–23. PMID: 11817382
  • 44
    Leach A, Hilton S, Greenwood BM, Manneh E, Dibba B, Wilkins A, et al. An evaluation of the informed consent procedure used during a trial of a Haemophilus influenzae type B conjugate vaccine undertaken in the Gambia, West Africa. Soc Sci Med. 1999 Jan;48(2):139–48. doi: http://dx.doi.org/10.1016/S0277-9536(98)00317-7 PMID: 10048773
    » https://doi.org/10.1016/S0277-9536(98)00317-7
  • 45
    Pitisuttithum P, Migasena S, Laothai A, Suntharasamai P, Kumpong C, Vanichseni S. Risk behaviours and comprehension among intravenous drug users volunteered for HIV vaccine trial. J Med Assoc Thai. 1997 Jan;80(1):47–50. PMID: 9078816
  • 46
    Bergenmar M, Molin C, Wilking N, Brandberg Y. Knowledge and understanding among cancer patients consenting to participate in clinical trials. Eur J Cancer. 2008 Nov;44(17):2627–33. doi: http://dx.doi.org/10.1016/j.ejca.2008.08.013 PMID: 18818068
    » https://doi.org/10.1016/j.ejca.2008.08.013
  • 47
    Knifed E, Lipsman N, Mason W, Bernstein M. Patients’ perception of the informed consent process for neurooncology clinical trials. Neuro-oncol. 2008 Jun;10(3):348–54. doi: http://dx.doi.org/10.1215/15228517-2008-007 PMID: 18388256
    » https://doi.org/10.1215/15228517-2008-007
  • 48
    Agrawal M, Grady C, Fairclough DL, Meropol NJ, Maynard K, Emanuel EJ. Patients’ decision-making process regarding participation in phase I oncology research. J Clin Oncol. 2006 Sep 20;24(27):4479–84. doi: http://dx.doi.org/10.1200/JCO.2006.06.0269 PMID: 16983117
    » https://doi.org/10.1200/JCO.2006.06.0269
  • 49
    Franck LS, Winter I, Oulton K. The quality of parental consent for research with children: a prospective repeated measure self-report survey. Int J Nurs Stud. 2007 May;44(4):525–33. doi: http://dx.doi.org/10.1016/j.ijnurstu.2006.03.014 PMID: 16712850
    » https://doi.org/10.1016/j.ijnurstu.2006.03.014
  • 50
    Gammelgaard A, Mortensen OS, Rossel P; DANAMI-2 Investigators. Patients’ perceptions of informed consent in acute myocardial infarction research: a questionnaire based survey of the consent process in the DANAMI-2 trial. Heart. 2004 Oct;90(10):1124–8. doi: http://dx.doi.org/10.1136/hrt.2003.021931 PMID: 15367504
    » https://doi.org/10.1136/hrt.2003.021931
  • 51
    Kodish E, Eder M, Noll RB, Ruccione K, Lange B, Angiolillo A, et al. Communication of randomization in childhood leukemia trials. JAMA. 2004 Jan 28;291(4):470–5. doi: http://dx.doi.org/10.1001/jama.291.4.470 PMID: 14747504
    » https://doi.org/10.1001/jama.291.4.470
  • 52
    Criscione LG, Sugarman J, Sanders L, Pisetsky DS, St Clair EW. Informed consent in a clinical trial of a novel treatment for rheumatoid arthritis. Arthritis Rheum. 2003 Jun 15;49(3):361–7. doi: http://dx.doi.org/10.1002/art.11057 PMID: 12794792
    » https://doi.org/10.1002/art.11057
  • 53
    Kupst MJ, Patenaude AF, Walco GA, Sterling C. Clinical trials in pediatric cancer: parental perspectives on informed consent. J Pediatr Hematol Oncol. 2003 Oct;25(10):787–90. doi: http://dx.doi.org/10.1097/00043426-200310000-00009 PMID: 14528101
    » https://doi.org/10.1097/00043426-200310000-00009
  • 54
    Pope JE, Tingey DP, Arnold JM, Hong P, Ouimet JM, Krizova A. Are subjects satisfied with the informed consent process? A survey of research participants. J Rheumatol. 2003 Apr;30(4):815–24. PMID: 12672205
  • 55
    Schats R, Brilstra EH, Rinkel GJ, Algra A, Van Gijn J. Informed consent in trials for neurological emergencies: the example of subarachnoid haemorrhage. J Neurol Neurosurg Psychiatry. 2003 Jul;74(7):988–91. doi: http://dx.doi.org/10.1136/jnnp.74.7.988 PMID: 12810803
    » https://doi.org/10.1136/jnnp.74.7.988
  • 56
    Simon C, Zyzanski SJ, Eder M, Raiz P, Kodish ED, Siminoff LA. Groups potentially at risk for making poorly informed decisions about entry into clinical trials for childhood cancer. J Clin Oncol. 2003 Jun 1;21(11):2173–8. doi: http://dx.doi.org/10.1200/JCO.2003.03.003 PMID: 12775743
    » https://doi.org/10.1200/JCO.2003.03.003
  • 57
    Joffe S, Cook EF, Cleary PD, Clark JW, Weeks JC. Quality of informed consent in cancer clinical trials: a cross-sectional survey. Lancet. 2001 Nov 24;358(9295):1772–7. doi: http://dx.doi.org/10.1016/S0140-6736(01)06805-2 PMID: 11734235
    » https://doi.org/10.1016/S0140-6736(01)06805-2
  • 58
    Daugherty C, Ratain MJ, Grochowski E, Stocking C, Kodish E, Mick R, et al. Perceptions of cancer patients and their physicians involved in phase I trials. J Clin Oncol. 1995 May;13(5):1062–72. PMID: 7738612
  • 59
    Daugherty CK, Banik DM, Janish L, Ratain MJ. Quantitative analysis of ethical issues in phase I trials: a survey interview of 144 advanced cancer patients. IRB. 2000 May-Jun;22(3):6–14. doi: http://dx.doi.org/10.2307/3564113 PMID: 11697385
    » https://doi.org/10.2307/3564113
  • 60
    Hietanen P, Aro AR, Holli K, Absetz P. Information and communication in the context of a clinical trial. Eur J Cancer. 2000 Oct;36(16):2096–104. doi: http://dx.doi.org/10.1016/S0959-8049(00)00191-X PMID: 11044647
    » https://doi.org/10.1016/S0959-8049(00)00191-X
  • 61
    Montgomery JE, Sneyd JR. Consent to clinical trials in anaesthesia. Anaesthesia. 1998 Mar;53(3):227–30. doi: http://dx.doi.org/10.1046/j.1365-2044.1998.00309.x PMID: 9613266
    » https://doi.org/10.1046/j.1365-2044.1998.00309.x
  • 62
    van Stuijvenberg M, Suur MH, de Vos S, Tjiang GC, Steyerberg EW, Derksen-Lubsen G, et al. Informed consent, parental awareness, and reasons for participating in a randomised controlled study. Arch Dis Child. 1998 Aug;79(2):120–5. doi: http://dx.doi.org/10.1136/adc.79.2.120 PMID: 9797591
    » https://doi.org/10.1136/adc.79.2.120
  • 63
    Harrison K, Vlahov D, Jones K, Charron K, Clements ML. Medical eligibility, comprehension of the consent process, and retention of injection drug users recruited for an HIV vaccine trial. J Acquir Immune Defic Syndr Hum Retrovirol. 1995 Nov 1;10(3):386–90. doi: http://dx.doi.org/10.1097/00042560-199511000-00012 PMID: 7552502
    » https://doi.org/10.1097/00042560-199511000-00012
  • 64
    Harth SC, Thong YH. Parental perceptions and attitudes about informed consent in clinical research involving children. Soc Sci Med. 1995 Jun;40(11):1573–7. doi: http://dx.doi.org/10.1016/0277-9536(94)00412-M PMID: 7667661
    » https://doi.org/10.1016/0277-9536(94)00412-M
  • 65
    Estey A, Wilkin G, Dossetor J. Are research subjects able to retain the information they are given during the consent process. Health Law Rev. 1994;3:37–41.
  • 66
    Howard JM, DeMets D. How informed is informed consent? The BHAT experience. Control Clin Trials. 1981 Dec;2(4):287–303. doi: http://dx.doi.org/10.1016/0197-2456(81)90019-2 PMID: 6120794
    » https://doi.org/10.1016/0197-2456(81)90019-2
  • 67
    Griffin JM, Struve JK, Collins D, Liu A, Nelson DB, Bloomfield HE. Long term clinical trials: how much information do participants retain from the informed consent process? Contemp Clin Trials. 2006 Oct;27(5):441–8. doi: http://dx.doi.org/10.1016/j.cct.2006.04.006 PMID: 16798101
    » https://doi.org/10.1016/j.cct.2006.04.006
  • 68
    Guarino P, Lamping DL, Elbourne D, Carpenter J, Peduzzi P. A brief measure of perceived understanding of informed consent in a clinical trial was validated. J Clin Epidemiol. 2006 Jun;59(6):608–14. doi: http://dx.doi.org/10.1016/j.jclinepi.2005.11.009 PMID: 16713523
    » https://doi.org/10.1016/j.jclinepi.2005.11.009
  • 69
    Barrett R. Quality of informed consent: measuring understanding among participants in oncology clinical trials. Oncol Nurs Forum. 2005 Jul;32(4):751–5. doi: http://dx.doi.org/10.1188/05.ONF.751-755 PMID: 15990904
    » https://doi.org/10.1188/05.ONF.751-755
  • 70
    Sugarman J, Lavori PW, Boeger M, Cain C, Edsond R, Morrison V, et al. Evaluating the quality of informed consent. Clin Trials. 2005;2(1):34–41. doi: http://dx.doi.org/10.1191/1740774505cn066oa PMID: 16279577
    » https://doi.org/10.1191/1740774505cn066oa
  • 71
    Simon CM, Siminoff LA, Kodish ED, Burant C. Comparison of the informed consent process for randomized clinical trials in pediatric and adult oncology. J Clin Oncol. 2004 Jul 1;22(13):2708–17. doi: http://dx.doi.org/10.1200/JCO.2004.10.034 PMID: 15226338
    » https://doi.org/10.1200/JCO.2004.10.034
  • 72
    Pentz RD, Flamm AL, Sugarman J, Cohen MZ, Daniel Ayers G, Herbst RS, et al. Study of the media’s potential influence on prospective research participants’ understanding of and motivations for participation in a high-profile phase I trial. J Clin Oncol. 2002 Sep 15;20(18):3785–91. doi: http://dx.doi.org/10.1200/JCO.2002.04.084 PMID: 12228198
    » https://doi.org/10.1200/JCO.2002.04.084
  • 73
    Cohen L, de Moor C, Amato RJ. The association between treatment-specific optimism and depressive symptomatology in patients enrolled in a phase I cancer clinical trial. Cancer. 2001 May 15;91(10):1949–55. doi: http://dx.doi.org/10.1002/1097-0142(20010515)91:10<1949::AID-CNCR1218>3.0.CO;2-A PMID: 11346878
    » https://doi.org/10.1002/1097-0142(20010515)91:10<1949::AID-CNCR1218>3.0.CO;2-A
  • 74
    Fortney JA. Assessing recall and understanding of informed consent in a contraceptive clinical trial. Stud Fam Plann. 1999 Dec;30(4):339–46. doi: http://dx.doi.org/10.1111/j.1728-4465.1999.t01-5-.x PMID: 10674329
    » https://doi.org/10.1111/j.1728-4465.1999.t01-5-.x
  • 75
    Hutchison C. Phase I trials in cancer patients: participants’ perceptions. Eur J Cancer Care (Engl). 1998 Mar;7(1):15–22. doi: http://dx.doi.org/10.1046/j.1365-2354.1998.00062.x PMID: 9582747
    » https://doi.org/10.1046/j.1365-2354.1998.00062.x
  • 76
    Négrier S, Lanier-Demma F, Lacroix-Kante V, Chauvin F, Saltel P, Mercatello A, et al. Evaluation of the informed consent procedure in cancer patients candidate to immunotherapy. Eur J Cancer. 1995 Sep;31A(10):1650–2. doi: http://dx.doi.org/10.1016/0959-8049(95)00329-H PMID: 7488418
    » https://doi.org/10.1016/0959-8049(95)00329-H
  • 77
    Tankanow RM, Sweet BV, Weiskopf JA. Patients’ perceived understanding of informed consent in investigational drug studies. Am J Hosp Pharm. 1992 Mar;49(3):633–5. PMID: 1598945
  • 78
    Rodenhuis S, van den Heuvel WJ, Annyas AA, Koops HS, Sleijfer DT, Mulder NH. Patient motivation and informed consent in a phase I study of an anticancer agent. Eur J Cancer Clin Oncol. 1984 Apr;20(4):457–62. doi: http://dx.doi.org/10.1016/0277-5379(84)90229-3 PMID: 6539201
    » https://doi.org/10.1016/0277-5379(84)90229-3
  • 79
    Penman DT, Holland JC, Bahna GF, Morrow G, Schmale AH, Derogatis LR, et al. Informed consent for investigational chemotherapy: patients’ and physicians’ perceptions. J Clin Oncol. 1984 Jul;2(7):849–55. PMID: 6737023
  • 80
    Goodman NW, Cooper GM, Malins AF, Prys-Roberts C. The validity of informed consent in a clinical study. Anaesthesia. 1984 Sep;39(9):911–6. doi: http://dx.doi.org/10.1111/j.1365-2044.1984.tb06582.x PMID: 6545095
    » https://doi.org/10.1111/j.1365-2044.1984.tb06582.x
  • 81
    Riecken HW, Ravich R. Informed consent to biomedical research in Veterans Administration Hospitals. JAMA. 1982 Jul 16;248(3):344–8. doi: http://dx.doi.org/10.1001/jama.1982.03330030050025 PMID: 7045434
    » https://doi.org/10.1001/jama.1982.03330030050025
  • 82
    Bergler JH, Pennington AC, Metcalfe M, Freis ED. Informed consent: how much does the patient understand? Clin Pharmacol Ther. 1980 Apr;27(4):435–40. doi: http://dx.doi.org/10.1038/clpt.1980.60 PMID: 6987027
    » https://doi.org/10.1038/clpt.1980.60
  • 83
    Ritsuko A, Noda K, Etsuko S, Etsuko M, Tomoko S, Midori N, et al. [Survey of participants to clinical trial in Fukuoka university hospital: relationship between the participant’s understanding of informed consent and their feeling of unease for clinical trials]. Fukuoka Daigaku Igaku Kiyō. 2006;33(1):25–9. Japanese.
  • 84
    Paediatric European Network for Treatment of AIDS. Parents’ attitudes to their HIV-infected children being enrolled into a placebo-controlled trial: the PENTA 1 trial. HIV Med. 1999 Oct;1(1):25–31. doi: http://dx.doi.org/10.1046/j.1468-1293.1999.00005.x PMID: 11737326
    » https://doi.org/10.1046/j.1468-1293.1999.00005.x
  • 85
    Ballard HO, Shook LA, Desai NS, Anand KJ. Neonatal research and the validity of informed consent obtained in the perinatal period. J Perinatol. 2004 Jul;24(7):409–15. doi: http://dx.doi.org/10.1038/sj.jp.7211142 PMID: 15152271
    » https://doi.org/10.1038/sj.jp.7211142
  • 86
    Bertoli AM, Strusberg I, Fierro GA, Ramos M, Strusberg AM. Lack of correlation between satisfaction and knowledge in clinical trials participants: a pilot study. Contemp Clin Trials. 2007 Nov;28(6):730–6. doi: http://dx.doi.org/10.1016/j.cct.2007.04.005 PMID: 17581796
    » https://doi.org/10.1016/j.cct.2007.04.005
  • 87
    Burgess E, Singhal N, Amin H, McMillan DD, Devrome H. Consent for clinical research in the neonatal intensive care unit: a retrospective survey and a prospective study. Arch Dis Child Fetal Neonatal Ed. 2003 Jul;88(4):F280–5, discussion F285–6. doi: http://dx.doi.org/10.1136/fn.88.4.F280 PMID: 12819158
    » https://doi.org/10.1136/fn.88.4.F280
  • 88
    Chaisson LH, Kass NE, Chengeta B, Mathebula U, Samandari T. Repeated assessments of informed consent comprehension among HIV-infected participants of a three-year clinical trial in Botswana. PLoS ONE. 2011;6(10):e22696. doi: http://dx.doi.org/10.1371/journal.pone.0022696 PMID: 22046230
    » https://doi.org/10.1371/journal.pone.0022696
  • 89
    Chappuy H, Baruchel A, Leverger G, Oudot C, Brethon B, Haouy S, et al. Parental comprehension and satisfaction in informed consent in paediatric clinical trials: a prospective study on childhood leukaemia. Arch Dis Child. 2010 Oct;95(10):800–4. doi: http://dx.doi.org/10.1136/adc.2009.180695 PMID: 20551191
    » https://doi.org/10.1136/adc.2009.180695
  • 90
    Chappuy H, Bouazza N, Minard-Colin V, Patte C, Brugières L, Landman-Parker J, et al. Parental comprehension of the benefits/risks of first-line randomised clinical trials in children with solid tumours: a two-stage cross-sectional interview study. BMJ Open. 2013;3(5):e002733. doi: http://dx.doi.org/10.1136/bmjopen-2013-002733 PMID: 23793670
    » https://doi.org/10.1136/bmjopen-2013-002733
  • 91
    Chappuy H, Doz F, Blanche S, Gentet JC, Pons G, Tréluyer JM. Parental consent in paediatric clinical research. Arch Dis Child. 2006 Feb;91(2):112–6. doi: http://dx.doi.org/10.1136/adc.2005.076141 PMID: 16246853
    » https://doi.org/10.1136/adc.2005.076141
  • 92
    Chappuy H, Doz F, Blanche S, Gentet JC, Tréluyer JM. Children’s views on their involvement in clinical research. Pediatr Blood Cancer. 2008 May;50(5):1043–6. doi: http://dx.doi.org/10.1002/pbc.21359 PMID: 17960770
    » https://doi.org/10.1002/pbc.21359
  • 93
    Chenaud C, Merlani P, Luyasu S, Ricou B. Informed consent for research obtained during the intensive care unit stay. Crit Care. 2006;10(6):R170. doi: http://dx.doi.org/10.1186/cc5120 PMID: 17156444
    » https://doi.org/10.1186/cc5120
  • 94
    Chu SH, Jeong SH, Kim EJ, Park MS, Park K, Nam M, et al. The views of patients and healthy volunteers on participation in clinical trials: an exploratory survey study. Contemp Clin Trials. 2012 Jul;33(4):611–9. doi: http://dx.doi.org/10.1016/j.cct.2012.02.018 PMID: 22405971
    » https://doi.org/10.1016/j.cct.2012.02.018
  • 95
    Constantinou M, Jhanji V, Chiang PP, Lamoureux EL, Rees G, Vajpayee RB. Determinants of informed consent in a cataract surgery clinical trial: why patients participate. Can J Ophthalmol. 2012 Apr;47(2):118–23. doi: http://dx.doi.org/10.1016/j.jcjo.2012.01.006 PMID: 22560415
    » https://doi.org/10.1016/j.jcjo.2012.01.006
  • 96
    Cousino MK, Zyzanski SJ, Yamokoski AD, Hazen RA, Baker JN, Noll RB, et al. Communicating and understanding the purpose of pediatric phase I cancer trials. J Clin Oncol. 2012 Dec 10;30(35):4367–72. doi: http://dx.doi.org/10.1200/JCO.2012.42.3004 PMID: 23071225
    » https://doi.org/10.1200/JCO.2012.42.3004
  • 97
    Durand-Zaleski IS, Alberti C, Durieux P, Duval X, Gottot S, Ravaud P, et al. Informed consent in clinical research in France: assessment and factors associated with therapeutic misconception. J Med Ethics. 2008 Sep;34(9):e16. doi: http://dx.doi.org/10.1136/jme.2007.023473 PMID: 18757616
    » https://doi.org/10.1136/jme.2007.023473
  • 98
    Eiser C, Davies H, Jenney M, Glaser A. Mothers’ attitudes to the randomized controlled trial (RCT): the case of acute lymphoblastic leukaemia (ALL) in children. Child Care Health Dev. 2005 Sep;31(5):517–23. doi: http://dx.doi.org/10.1111/j.1365-2214.2005.00538.x PMID: 16101646
    » https://doi.org/10.1111/j.1365-2214.2005.00538.x
  • 99
    Featherstone K, Donovan JL. Random allocation or allocation at random? Patients’ perspectives of participation in a randomised controlled trial. BMJ. 1998 Oct 31;317(7167):1177–80. doi: http://dx.doi.org/10.1136/bmj.317.7167.1177 PMID: 9794849
    » https://doi.org/10.1136/bmj.317.7167.1177
  • 100
    Hazen RA, Drotar D, Kodish E. The role of the consent document in informed consent for pediatric leukemia trials. Contemp Clin Trials. 2007 Jul;28(4):401–8. doi: http://dx.doi.org/10.1016/j.cct.2006.10.011 PMID: 17196888
    » https://doi.org/10.1016/j.cct.2006.10.011
  • 101
    Hereu P, Pérez E, Fuentes I, Vidal X, Suñé P, Arnau JM. Consent in clinical trials: what do patients know? Contemp Clin Trials. 2010 Sep;31(5):443–6. doi: http://dx.doi.org/10.1016/j.cct.2010.05.004 PMID: 20462521
    » https://doi.org/10.1016/j.cct.2010.05.004
  • 102
    Hofmeijer J, Amelink GJ, den Hertog HM, Algra A, Kappelle LJ, van der Worp HB, et al.; PAIS investigators. Appreciation of the informed consent procedure in a randomised trial of decompressive surgery for space occupying hemispheric infarction. J Neurol Neurosurg Psychiatry. 2007 Oct;78(10):1124–8. doi: http://dx.doi.org/10.1136/jnnp.2006.110726 PMID: 17400593
    » https://doi.org/10.1136/jnnp.2006.110726
  • 103
    Itoh K, Sasaki Y, Fujii H, Ohtsu T, Wakita H, Igarashi T, et al. Patients in phase I trials of anti-cancer agents in Japan: motivation, comprehension and expectations. Br J Cancer. 1997;76(1):107–13. doi: http://dx.doi.org/10.1038/bjc.1997.344 PMID: 9218741
    » https://doi.org/10.1038/bjc.1997.344
  • 104
    Jenkins V, Fallowfield L. Reasons for accepting or declining to participate in randomized clinical trials for cancer therapy. Br J Cancer. 2000 Jun;82(11):1783–8. doi: http://dx.doi.org/10.1054/bjoc.2000.1142 PMID: 10839291
    » https://doi.org/10.1054/bjoc.2000.1142
  • 105
    Kass NE, Maman S, Atkinson J. Motivations, understanding, and voluntariness in international randomized trials. IRB. 2005 Nov-Dec;27(6):1–8. doi: http://dx.doi.org/10.2307/3563534 PMID: 16425478
    » https://doi.org/10.2307/3563534
  • 106
    Kenyon S, Dixon-Woods M, Jackson CJ, Windridge K, Pitchforth E. Participating in a trial in a critical situation: a qualitative study in pregnancy. Qual Saf Health Care. 2006 Apr;15(2):98–101. doi: http://dx.doi.org/10.1136/qshc.2005.015636 PMID: 16585108
    » https://doi.org/10.1136/qshc.2005.015636
  • 107
    Kiguba R, Kutyabami P, Kiwuwa S, Katabira E, Sewankambo NK. Assessing the quality of informed consent in a resource-limited setting: a cross-sectional study. BMC Med Ethics. 2012;13(1):21. doi: http://dx.doi.org/10.1186/1472-6939-13-21 PMID: 22906301
    » https://doi.org/10.1186/1472-6939-13-21
  • 108
    Lidz CW, Appelbaum PS, Grisso T, Renaud M. Therapeutic misconception and the appreciation of risks in clinical trials. Soc Sci Med. 2004 May;58(9):1689–97. doi: http://dx.doi.org/10.1016/S0277-9536(03)00338-1 PMID: 14990370
    » https://doi.org/10.1016/S0277-9536(03)00338-1
  • 109
    Leroy T, Christophe V, Penel N, Antoine P, Clisant S. Factual understanding of randomized clinical trials: a multicenter case-control study in cancer patients. Invest New Drugs. 2011 Aug;29(4):700–5. doi: http://dx.doi.org/10.1007/s10637-009-9315-8 PMID: 19760365
    » https://doi.org/10.1007/s10637-009-9315-8
  • 110
    Levi RB, Marsick R, Drotar D, Kodish ED. Diagnosis, disclosure, and informed consent: learning from parents of children with cancer. J Pediatr Hematol Oncol. 2000 Jan-Feb;22(1):3–12. doi: http://dx.doi.org/10.1097/00043426-200001000-00002 PMID: 10695815
    » https://doi.org/10.1097/00043426-200001000-00002
  • 111
    Manafa O, Lindegger G, Ijsselmuiden C. Informed consent in an antiretroviral trial in Nigeria. Indian J Med Ethics. 2007 Jan-Mar;4(1):26–30. PMID: 18630217
  • 112
    McNally T, Grigg J. Parents’ understanding of a randomised double-blind controlled trial. Paediatr Nurs. 2001 May;13(4):11–4. doi: http://dx.doi.org/10.7748/paed2001.05.13.4.11.c736 PMID: 12025022
    » https://doi.org/10.7748/paed2001.05.13.4.11.c736
  • 113
    Mangset M, Førde R, Nessa J, Berge E, Wyller TB. I don’t like that, it’s tricking people too much...: acute informed consent to participation in a trial of thrombolysis for stroke. J Med Ethics. 2008 Oct;34(10):751–6. doi: http://dx.doi.org/10.1136/jme.2007.023168 PMID: 18827109
    » https://doi.org/10.1136/jme.2007.023168
  • 114
    Meneguin S, Zoboli EL, Domingues RZ, Nobre MR, César LA. [Informed consent as viewed by patients participating in cardiology drug trial]. Arq Bras Cardiol. 2010 Jan;94(1):4–9. Portuguese.doi: http://dx.doi.org/10.1590/S0066-782X2010000100003 PMID: 20414520
    » https://doi.org/10.1590/S0066-782X2010000100003
  • 115
    Miller VA, Baker JN, Leek AC, Hizlan S, Rheingold SR, Yamokoski AD, et al. Adolescent perspectives on phase I cancer research. Pediatr Blood Cancer. 2013 May;60(5):873–8. doi: http://dx.doi.org/10.1002/pbc.24326 PMID: 23034985
    » https://doi.org/10.1002/pbc.24326
  • 116
    Mills N, Donovan JL, Smith M, Jacoby A, Neal DE, Hamdy FC. Perceptions of equipoise are crucial to trial participation: a qualitative study of men in the ProtecT study. Control Clin Trials. 2003 Jun;24(3):272–82. doi: http://dx.doi.org/10.1016/S0197-2456(03)00020-5 PMID: 12757993
    » https://doi.org/10.1016/S0197-2456(03)00020-5
  • 117
    Nurgat ZA, Craig W, Campbell NC, Bissett JD, Cassidy J, Nicolson MC. Patient motivations surrounding participation in phase I and phase II clinical trials of cancer chemotherapy. Br J Cancer. 2005 Mar 28;92(6):1001–5. doi: http://dx.doi.org/10.1038/sj.bjc.6602423 PMID: 15770219
    » https://doi.org/10.1038/sj.bjc.6602423
  • 118
    Ockene IS, Miner J, Shannon TA, Gore JM, Weiner BH, Ball SP. The consent process in the Thrombolysis in Myocardial Infarction (TIMI–phase I) trial. Clin Res. 1991 Feb;39(1):13–7. PMID: 1999082
  • 119
    Petersen I, Spix C, Kaatsch P, Graf N, Janka G, Kollek R. Parental informed consent in pediatric cancer trials: a population-based survey in Germany. Pediatr Blood Cancer. 2013 Mar;60(3):446–50. doi: http://dx.doi.org/10.1002/pbc.24330 PMID: 23015470
    » https://doi.org/10.1002/pbc.24330
  • 120
    Queiroz da Fonseca O, Lie RK. Comprehension of the informed consent form and general knowledge of vaccines among potential participants for an HIV vaccine trial in Brazil. Int J Pharm Med. 1999;13(5):253–60.
  • 121
    Russell FM, Carapetis JR, Liddle H, Edwards T, Ruff TA, Devitt J. A pilot study of the quality of informed consent materials for Aboriginal participants in clinical trials. J Med Ethics. 2005 Aug;31(8):490–4. doi: http://dx.doi.org/10.1136/jme.2002.002279 PMID: 16076978
    » https://doi.org/10.1136/jme.2002.002279
  • 122
    Schaeffer MH, Krantz DS, Wichman A, Masur H, Reed E, Vinicky JK. The impact of disease severity on the informed consent process in clinical research. Am J Med. 1996 Mar;100(3):261–8. doi: http://dx.doi.org/10.1016/S0002-9343(97)89483-1 PMID: 8629670
    » https://doi.org/10.1016/S0002-9343(97)89483-1
  • 123
    Coulibaly-Traoré D, Msellati P, Vidal L, Ekra CW, Dabis F. [The Ditrame (ANRS 049) clinical trial aimed at reducing the mother-child transmission of HIV in Abidjan. Participants’ understanding of the trial principles]. Presse Med. 2003 Mar 1;32(8):343–50. French. PMID: 12712680
  • 124
    Ducrocq X, Taillandier L, Anxionnat R, Lacour JC, Debouverie M, Lanotte L, et al. [Ethical approach to informed consent for participation in clinical studies in acute cerebral infarct]. Presse Med. 2000 Jul 8-15;29(24):1335–40. French. PMID: 10938684
  • 125
    Schutta KM, Burnett CB. Factors that influence a patient’s decision to participate in a phase I cancer clinical trial. Oncol Nurs Forum. 2000 Oct;27(9):1435–8. PMID: 11058975
  • 126
    Snowdon C, Garcia J, Elbourne D. Making sense of randomization; responses of parents of critically ill babies to random allocation of treatment in a clinical trial. Soc Sci Med. 1997 Nov;45(9):1337–55. doi: http://dx.doi.org/10.1016/S0277-9536(97)00063-4 PMID: 9351153
    » https://doi.org/10.1016/S0277-9536(97)00063-4
  • 127
    Stenson BJ, Becher JC, McIntosh N. Neonatal research: the parental perspective. Arch Dis Child Fetal Neonatal Ed. 2004 Jul;89(4):F321–4. doi: http://dx.doi.org/10.1136/adc.2002.021931 PMID: 15210665
    » https://doi.org/10.1136/adc.2002.021931
  • 128
    Unguru Y, Sill AM, Kamani N. The experiences of children enrolled in pediatric oncology research: implications for assent. Pediatrics. 2010 Apr;125(4):e876–83. doi: http://dx.doi.org/10.1542/peds.2008-3429 PMID: 20351001
    » https://doi.org/10.1542/peds.2008-3429
  • 129
    Yoong J, Jefford M, Mileshkin L. Patients’ understanding of clinical trials needs to be assessed in the context of understanding of overall goals of care. Support Care Cancer. 2011 Aug;19(8):1067–8. doi: http://dx.doi.org/10.1007/s00520-011-1201-1 PMID: 21637973
    » https://doi.org/10.1007/s00520-011-1201-1
  • 130
    Verheggen FW, Jonkers R, Kok G. Patients’ perceptions on informed consent and the quality of information disclosure in clinical trials. Patient Educ Couns. 1996 Nov;29(2):137–53. doi: http://dx.doi.org/10.1016/0738-3991(96)00859-2 PMID: 9006231
    » https://doi.org/10.1016/0738-3991(96)00859-2
  • 131
    Country and lending groups [Internet]. Washington: World Bank; 2014. Available from: http://data.worldbank.org/about/country-and-lending-groups [cited 2014 Dec 12].
    » http://data.worldbank.org/about/country-and-lending-groups
  • 132
    Idänpäänheikkilä JE. WHO guidelines for good clinical practice (GCP) for trials on pharmaceutical products: responsibilities of the investigator. Ann Med. 1994 Apr;26(2):89–94. doi: http://dx.doi.org/10.3109/07853899409147334 PMID: 8024733
    » https://doi.org/10.3109/07853899409147334
  • 133
    Moreno J, Caplan AL, Wolpe PR. Updating protections for human subjects involved in research. Project on Informed Consent, Human Research Ethics Group. JAMA. 1998 Dec 9;280(22):1951–8. doi: http://dx.doi.org/10.1001/jama.280.22.1951 PMID: 9851484
    » https://doi.org/10.1001/jama.280.22.1951
  • 134
    de Melo-Martín I, Ho A. Beyond informed consent: the therapeutic misconception and trust. J Med Ethics. 2008 Mar;34(3):202–5. doi: http://dx.doi.org/10.1136/jme.2006.019406 PMID: 18316464
    » https://doi.org/10.1136/jme.2006.019406
  • 135
    Bergenmar M, Molin C, Wilking N, Brandberg Y. Knowledge and understanding among cancer patients consenting to participate in clinical trials. Eur J Cancer. 2008 Nov;44(17):2627–33. doi: http://dx.doi.org/10.1016/j.ejca.2008.08.013 PMID: 18818068
    » https://doi.org/10.1016/j.ejca.2008.08.013
  • 136
    Durand-Zaleski IS, Alberti C, Durieux P, Duval X, Gottot S, Ravaud P, et al. Informed consent in clinical research in France: assessment and factors associated with therapeutic misconception. J Med Ethics. 2008 Sep;34(9):e16. doi: http://dx.doi.org/10.1136/jme.2007.023473 PMID: 18757616
    » https://doi.org/10.1136/jme.2007.023473
  • 137
    Ballard HO, Shook LA, Desai NS, Anand KJ. Neonatal research and the validity of informed consent obtained in the perinatal period. J Perinatol. 2004 Jul;24(7):409–15. doi: http://dx.doi.org/10.1038/sj.jp.7211142 PMID: 15152271
    » https://doi.org/10.1038/sj.jp.7211142
  • 138
    Miller FG, Joffe S. Phase 1 oncology trials and informed consent. J Med Ethics. 2013 Dec;39(12):761–4. doi: http://dx.doi.org/10.1136/medethics-2012-100832 PMID: 23161617
    » https://doi.org/10.1136/medethics-2012-100832
  • 139
    Tamariz L, Palacio A, Robert M, Marcus EN. Improving the informed consent process for research subjects with low literacy: a systematic review. J Gen Intern Med. 2013 Jan;28(1):121–6. doi: http://dx.doi.org/10.1007/s11606-012-2133-2 PMID: 22782275
    » https://doi.org/10.1007/s11606-012-2133-2
  • 140
    Flory J, Emanuel E. Interventions to improve research participants’ understanding in informed consent for research: a systematic review. JAMA. 2004 Oct 6;292(13):1593–601. doi: http://dx.doi.org/10.1001/jama.292.13.1593 PMID: 15467062
    » https://doi.org/10.1001/jama.292.13.1593
  • 141
    Hyder AA, Rattani A, Krubiner C, Bachani AM, Tran NT. Ethical review of health systems research in low- and middle-income countries: a conceptual exploration. Am J Bioeth. 2014;14(2):28–37. doi: http://dx.doi.org/10.1080/15265161.2013.868950 PMID: 24521334
    » https://doi.org/10.1080/15265161.2013.868950
  • 142
    Cargan L. Doing social research. Lanham: Rowman and Littlefield Publishers; 2007.
  • 143
    Takemura Y, Sakurai Y, Yokoya S, Otaki J, Matsuoka T, Ban N, et al. Open-ended questions: are they really beneficial for gathering medical information from patients? Tohoku J Exp Med. 2005 Jun;206(2):151–4. doi: http://dx.doi.org/10.1620/tjem.206.151 PMID: 15888971
    » https://doi.org/10.1620/tjem.206.151
  • 144
    Faralli C. Informed consent in medicine: ethical and juridical aspects. Milan: Salute e Società; 2013.
  • 145
    Isles AF. Understood consent versus informed consent: a new paradigm for obtaining consent for pediatric research studies. Front Pediatr. 2013;1:38. doi: http://dx.doi.org/10.3389/fped.2013.00038 PMID: 24400284
    » https://doi.org/10.3389/fped.2013.00038
  • 146
    Nishimura A, Carey J, Erwin PJ, Tilburt JC, Murad MH, McCormick JB. Improving understanding in the research informed consent process: a systematic review of 54 interventions tested in randomized control trials. BMC Med Ethics. 2013;14(1):28. doi: http://dx.doi.org/10.1186/1472-6939-14-28 PMID: 23879694
    » https://doi.org/10.1186/1472-6939-14-28
  • 147
    Baker JN, Leek AC, Salas HS, Drotar D, Noll R, Rheingold SR, et al. Suggestions from adolescents, young adults, and parents for improving informed consent in phase 1 pediatric oncology trials. Cancer. 2013 Dec 1;119(23):4154–61. doi: http://dx.doi.org/10.1002/cncr.28335 PMID: 24006119
    » https://doi.org/10.1002/cncr.28335
  • 148
    Terranova G, Ferro M, Carpeggiani C, Recchia V, Braga L, Semelka RC, et al. Low quality and lack of clarity of current informed consent forms in cardiology: how to improve them. JACC Cardiovasc Imaging. 2012 Jun;5(6):649–55. doi: http://dx.doi.org/10.1016/j.jcmg.2012.03.007 PMID: 22698536
    » https://doi.org/10.1016/j.jcmg.2012.03.007
  • 149
    Mårtenson EK, Fägerskiöld AM. A review of children’s decision-making competence in health care. J Clin Nurs. 2008 Dec;17(23):3131–41. doi: http://dx.doi.org/10.1111/j.1365-2702.2006.01920.x PMID: 18005126
    » https://doi.org/10.1111/j.1365-2702.2006.01920.x
  • 150
    Kluge EH. Informed consent by children: the new reality. CMAJ. 1995 May 1;152(9):1495–7. PMID: 7728701
  • 151
    Cox DR. Combination of data. In: Kotz S, Johnson NL, Read CB, Balakrishnan N, Vidakovic B, editors. Encyclopedia of statistical sciences. 2nd ed. Hoboken: John Wiley & Sons; 2006.pp. 1074–81.
  • 152
    Baker WL, White CM, Cappelleri JC, Kluger J, Coleman CI; Health Outcomes, Policy, and Economics (HOPE) Collaborative Group. Understanding heterogeneity in meta-analysis: the role of meta-regression. Int J Clin Pract. 2009 Oct;63(10):1426–34. doi: http://dx.doi.org/10.1111/j.1742-1241.2009.02168.x PMID: 19769699
    » https://doi.org/10.1111/j.1742-1241.2009.02168.x
  • 153
    Huy NT, Van Giang T, Thuy DH, Kikuchi M, Hien TT, Zamora J, et al. Factors associated with dengue shock syndrome: a systematic review and meta-analysis. PLoS Negl Trop Dis. 2013;7(9):e2412. doi: http://dx.doi.org/10.1371/journal.pntd.0002412 PMID: 24086778
    » https://doi.org/10.1371/journal.pntd.0002412
  • 154
    Ioannidis JP, Patsopoulos NA, Rothstein HR. Reasons or excuses for avoiding meta-analysis in forest plots. BMJ. 2008 Jun 21;336(7658):1413–5. doi: http://dx.doi.org/10.1136/bmj.a117 PMID: 18566080
    » https://doi.org/10.1136/bmj.a117

Competing interests:

  • None declared.

Publication Dates

    History

    • Received
      13 May 2014
    • Reviewed
      29 Oct 2014
    • Accepted
      26 Nov 2014
    Creative Common -
    This is an open access article distributed under the terms of the Creative Commons Attribution IGO License (http://creativecommons.org/licenses/by/3.0/igo/legalcode), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. In any reproduction of this article there should not be any suggestion that WHO or this article endorse any specific organization or products. The use of the WHO logo is not permitted. This notice should be preserved along with the article's original URL.
    World Health Organization Genebra - Genebra - Switzerland
    E-mail: bulletin@who.int